2023-11-28T12:46:59.556 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T12:46:59.557 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} --archive /home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469970 --verbose --name neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi --owner scheduled_neesingh@teuthology -- /home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469970/orig.config.yaml 2023-11-28T12:46:59.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:46:59.678 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469970 branch: wip-neesingh-testing-231123 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} email: neesingh@redhat.com first_in_suite: false job_id: '7469970' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-neesingh-testing-231123 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: issue_54557 sha1: 3ae99413970476692dfab1fe38dadb056700a61d owner: scheduled_neesingh@teuthology priority: 10 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6754 sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 sleep_before_teardown: 0 suite: fs suite_branch: issue_54557 suite_path: /home/teuthworker/src/github.com_neesingh-rh_ceph_3ae99413970476692dfab1fe38dadb056700a61d/qa suite_relpath: qa suite_repo: https://github.com/neesingh-rh/ceph suite_sha1: 3ae99413970476692dfab1fe38dadb056700a61d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 5ae09a5cc7064ca2bf994df19f3006b79794789a timestamp: 2023-11-28_12:38:30 tube: smithi user: neesingh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-28T12:46:59.678 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_neesingh-rh_ceph_3ae99413970476692dfab1fe38dadb056700a61d/qa; will attempt to use it 2023-11-28T12:46:59.679 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_neesingh-rh_ceph_3ae99413970476692dfab1fe38dadb056700a61d/qa/tasks 2023-11-28T12:46:59.679 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-28T12:46:59.681 INFO:teuthology.task.internal:Checking packages... 2023-11-28T12:46:59.704 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '2f5f6028b893ad41357cd06e827373f0fe2a1232' 2023-11-28T12:46:59.704 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-28T12:46:59.705 INFO:teuthology.packaging:ref: None 2023-11-28T12:46:59.705 INFO:teuthology.packaging:tag: None 2023-11-28T12:46:59.705 INFO:teuthology.packaging:branch: wip-neesingh-testing-231123 2023-11-28T12:46:59.705 INFO:teuthology.packaging:sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T12:46:59.705 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-neesingh-testing-231123 2023-11-28T12:46:59.929 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-2697-g2f5f6028-1focal 2023-11-28T12:46:59.929 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-28T12:46:59.935 INFO:teuthology.task.internal:no buildpackages task found 2023-11-28T12:46:59.936 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-28T12:46:59.955 INFO:teuthology.task.internal:Saving configuration 2023-11-28T12:46:59.971 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-28T12:46:59.999 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T12:47:00.025 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469970', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 12:41:05.820021', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-11-28T12:47:00.049 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469970', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 12:41:05.818043', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-11-28T12:47:00.049 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-28T12:47:00.055 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-28T12:47:00.055 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-28T12:47:00.055 INFO:teuthology.run_tasks:Running task console_log... 2023-11-28T12:47:00.159 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fda398d8160>, signals=[15]) 2023-11-28T12:47:00.159 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-28T12:47:00.165 INFO:teuthology.task.internal:Opening connections... 2023-11-28T12:47:00.165 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2023-11-28T12:47:00.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:47:00.225 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi114.front.sepia.ceph.com 2023-11-28T12:47:00.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:47:00.274 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-28T12:47:00.281 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2023-11-28T12:47:00.301 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2023-11-28T12:47:00.302 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2023-11-28T12:47:00.348 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Ubuntu" 2023-11-28T12:47:00.349 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-28T12:47:00.349 INFO:teuthology.orchestra.run.smithi082.stdout:ID=ubuntu 2023-11-28T12:47:00.349 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE=debian 2023-11-28T12:47:00.349 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-28T12:47:00.349 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="20.04" 2023-11-28T12:47:00.349 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T12:47:00.350 INFO:teuthology.orchestra.run.smithi082.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T12:47:00.350 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T12:47:00.350 INFO:teuthology.orchestra.run.smithi082.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T12:47:00.350 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_CODENAME=focal 2023-11-28T12:47:00.351 INFO:teuthology.orchestra.run.smithi082.stdout:UBUNTU_CODENAME=focal 2023-11-28T12:47:00.351 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2023-11-28T12:47:00.379 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2023-11-28T12:47:00.386 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2023-11-28T12:47:00.386 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-11-28T12:47:00.436 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Ubuntu" 2023-11-28T12:47:00.436 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-28T12:47:00.436 INFO:teuthology.orchestra.run.smithi114.stdout:ID=ubuntu 2023-11-28T12:47:00.436 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE=debian 2023-11-28T12:47:00.436 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-28T12:47:00.436 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="20.04" 2023-11-28T12:47:00.436 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T12:47:00.437 INFO:teuthology.orchestra.run.smithi114.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T12:47:00.437 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T12:47:00.437 INFO:teuthology.orchestra.run.smithi114.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T12:47:00.437 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_CODENAME=focal 2023-11-28T12:47:00.437 INFO:teuthology.orchestra.run.smithi114.stdout:UBUNTU_CODENAME=focal 2023-11-28T12:47:00.437 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-11-28T12:47:00.462 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-28T12:47:00.471 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-28T12:47:00.485 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-28T12:47:00.486 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2023-11-28T12:47:00.488 DEBUG:teuthology.orchestra.run.smithi114:> test '!' -e /home/ubuntu/cephtest 2023-11-28T12:47:00.494 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-28T12:47:00.500 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-28T12:47:00.500 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2023-11-28T12:47:00.502 DEBUG:teuthology.orchestra.run.smithi114:> test -z $(ls -A /var/lib/ceph) 2023-11-28T12:47:00.521 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-28T12:47:00.580 INFO:teuthology.run_tasks:Running task kernel... 2023-11-28T12:47:00.597 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-28T12:47:00.597 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-28T12:47:00.597 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T12:47:00.598 DEBUG:teuthology.orchestra.run.smithi114:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T12:47:00.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:47:00.604 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2023-11-28T12:47:00.604 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:47:00.605 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2023-11-28T12:47:00.612 INFO:teuthology.orchestra.run.smithi082.stdout:5.4.0-124-generic 2023-11-28T12:47:00.613 INFO:teuthology.task.kernel:Running kernel on smithi082: 5.4.0-124-generic 2023-11-28T12:47:00.613 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-get clean 2023-11-28T12:47:00.615 INFO:teuthology.orchestra.run.smithi114.stdout:5.4.0-124-generic 2023-11-28T12:47:00.615 INFO:teuthology.task.kernel:Running kernel on smithi114: 5.4.0-124-generic 2023-11-28T12:47:00.615 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-get clean 2023-11-28T12:47:00.712 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-get update 2023-11-28T12:47:00.770 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-get update 2023-11-28T12:47:01.001 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-28T12:47:01.078 INFO:teuthology.orchestra.run.smithi082.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-11-28T12:47:01.083 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-28T12:47:01.083 INFO:teuthology.orchestra.run.smithi114.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-11-28T12:47:01.136 INFO:teuthology.orchestra.run.smithi114.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-11-28T12:47:01.422 INFO:teuthology.orchestra.run.smithi082.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-11-28T12:47:01.430 INFO:teuthology.orchestra.run.smithi082.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-11-28T12:47:01.490 INFO:teuthology.orchestra.run.smithi114.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-11-28T12:47:01.564 INFO:teuthology.orchestra.run.smithi114.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,593 kB] 2023-11-28T12:47:01.564 INFO:teuthology.orchestra.run.smithi082.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,981 kB] 2023-11-28T12:47:01.707 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [912 kB] 2023-11-28T12:47:01.772 INFO:teuthology.orchestra.run.smithi082.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [679 kB] 2023-11-28T12:47:01.862 INFO:teuthology.orchestra.run.smithi082.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,593 kB] 2023-11-28T12:47:01.902 INFO:teuthology.orchestra.run.smithi082.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [401 kB] 2023-11-28T12:47:01.905 INFO:teuthology.orchestra.run.smithi082.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-11-28T12:47:01.905 INFO:teuthology.orchestra.run.smithi082.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [34.7 kB] 2023-11-28T12:47:01.906 INFO:teuthology.orchestra.run.smithi082.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,398 kB] 2023-11-28T12:47:01.922 INFO:teuthology.orchestra.run.smithi082.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [335 kB] 2023-11-28T12:47:01.924 INFO:teuthology.orchestra.run.smithi082.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2023-11-28T12:47:01.924 INFO:teuthology.orchestra.run.smithi082.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [623 kB] 2023-11-28T12:47:01.928 INFO:teuthology.orchestra.run.smithi082.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [901 kB] 2023-11-28T12:47:01.934 INFO:teuthology.orchestra.run.smithi082.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [189 kB] 2023-11-28T12:47:01.935 INFO:teuthology.orchestra.run.smithi082.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2023-11-28T12:47:01.937 INFO:teuthology.orchestra.run.smithi082.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-11-28T12:47:01.938 INFO:teuthology.orchestra.run.smithi082.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,188 B] 2023-11-28T12:47:01.938 INFO:teuthology.orchestra.run.smithi082.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-11-28T12:47:01.950 INFO:teuthology.orchestra.run.smithi082.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [912 kB] 2023-11-28T12:47:01.954 INFO:teuthology.orchestra.run.smithi082.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-11-28T12:47:01.979 INFO:teuthology.orchestra.run.smithi082.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [484 kB] 2023-11-28T12:47:01.992 INFO:teuthology.orchestra.run.smithi082.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2023-11-28T12:47:01.993 INFO:teuthology.orchestra.run.smithi082.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [36.0 kB] 2023-11-28T12:47:01.994 INFO:teuthology.orchestra.run.smithi082.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,516 kB] 2023-11-28T12:47:02.055 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,981 kB] 2023-11-28T12:47:02.055 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [679 kB] 2023-11-28T12:47:02.059 INFO:teuthology.orchestra.run.smithi082.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [351 kB] 2023-11-28T12:47:02.068 INFO:teuthology.orchestra.run.smithi082.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2023-11-28T12:47:02.070 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [401 kB] 2023-11-28T12:47:02.079 INFO:teuthology.orchestra.run.smithi114.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-11-28T12:47:02.079 INFO:teuthology.orchestra.run.smithi114.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,398 kB] 2023-11-28T12:47:02.155 INFO:teuthology.orchestra.run.smithi114.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [34.7 kB] 2023-11-28T12:47:02.155 INFO:teuthology.orchestra.run.smithi114.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [335 kB] 2023-11-28T12:47:02.162 INFO:teuthology.orchestra.run.smithi114.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2023-11-28T12:47:02.163 INFO:teuthology.orchestra.run.smithi114.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [623 kB] 2023-11-28T12:47:02.176 INFO:teuthology.orchestra.run.smithi114.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [901 kB] 2023-11-28T12:47:02.231 INFO:teuthology.orchestra.run.smithi114.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [484 kB] 2023-11-28T12:47:02.232 INFO:teuthology.orchestra.run.smithi082.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [757 kB] 2023-11-28T12:47:02.244 INFO:teuthology.orchestra.run.smithi114.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2023-11-28T12:47:02.244 INFO:teuthology.orchestra.run.smithi114.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [36.0 kB] 2023-11-28T12:47:02.245 INFO:teuthology.orchestra.run.smithi114.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,516 kB] 2023-11-28T12:47:02.316 INFO:teuthology.orchestra.run.smithi114.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [351 kB] 2023-11-28T12:47:02.322 INFO:teuthology.orchestra.run.smithi114.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2023-11-28T12:47:02.359 INFO:teuthology.orchestra.run.smithi114.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [189 kB] 2023-11-28T12:47:02.486 INFO:teuthology.orchestra.run.smithi114.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,134 kB] 2023-11-28T12:47:02.778 INFO:teuthology.orchestra.run.smithi114.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2023-11-28T12:47:02.784 INFO:teuthology.orchestra.run.smithi114.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-11-28T12:47:02.791 INFO:teuthology.orchestra.run.smithi114.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,188 B] 2023-11-28T12:47:02.794 INFO:teuthology.orchestra.run.smithi114.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-11-28T12:47:02.795 INFO:teuthology.orchestra.run.smithi114.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-11-28T12:47:02.825 INFO:teuthology.orchestra.run.smithi082.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,134 kB] 2023-11-28T12:47:02.934 INFO:teuthology.orchestra.run.smithi082.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [270 kB] 2023-11-28T12:47:02.954 INFO:teuthology.orchestra.run.smithi082.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2023-11-28T12:47:02.956 INFO:teuthology.orchestra.run.smithi082.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2023-11-28T12:47:02.956 INFO:teuthology.orchestra.run.smithi082.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-11-28T12:47:02.959 INFO:teuthology.orchestra.run.smithi082.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-11-28T12:47:02.959 INFO:teuthology.orchestra.run.smithi082.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-11-28T12:47:02.959 INFO:teuthology.orchestra.run.smithi082.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-11-28T12:47:02.961 INFO:teuthology.orchestra.run.smithi082.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-11-28T12:47:02.964 INFO:teuthology.orchestra.run.smithi082.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-11-28T12:47:03.129 INFO:teuthology.orchestra.run.smithi082.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-11-28T12:47:03.130 INFO:teuthology.orchestra.run.smithi114.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [757 kB] 2023-11-28T12:47:03.169 INFO:teuthology.orchestra.run.smithi114.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [270 kB] 2023-11-28T12:47:03.186 INFO:teuthology.orchestra.run.smithi114.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2023-11-28T12:47:03.186 INFO:teuthology.orchestra.run.smithi114.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2023-11-28T12:47:03.186 INFO:teuthology.orchestra.run.smithi114.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-11-28T12:47:03.186 INFO:teuthology.orchestra.run.smithi114.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-11-28T12:47:03.186 INFO:teuthology.orchestra.run.smithi114.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-11-28T12:47:03.186 INFO:teuthology.orchestra.run.smithi114.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-11-28T12:47:03.187 INFO:teuthology.orchestra.run.smithi114.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-11-28T12:47:03.213 INFO:teuthology.orchestra.run.smithi114.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-11-28T12:47:03.315 INFO:teuthology.orchestra.run.smithi082.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-11-28T12:47:03.337 INFO:teuthology.orchestra.run.smithi082.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-11-28T12:47:03.377 INFO:teuthology.orchestra.run.smithi114.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-11-28T12:47:03.562 INFO:teuthology.orchestra.run.smithi114.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-11-28T12:47:03.585 INFO:teuthology.orchestra.run.smithi114.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-11-28T12:47:05.837 INFO:teuthology.orchestra.run.smithi082.stdout:Fetched 18.2 MB in 3s (5,870 kB/s) 2023-11-28T12:47:06.026 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 18.2 MB in 3s (5,736 kB/s) 2023-11-28T12:47:07.281 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2023-11-28T12:47:07.307 DEBUG:teuthology.orchestra.run.smithi082:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-28T12:47:07.387 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2023-11-28T12:47:07.544 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2023-11-28T12:47:07.570 DEBUG:teuthology.orchestra.run.smithi114:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-28T12:47:07.591 INFO:teuthology.orchestra.run.smithi082.stdout:Building dependency tree... 2023-11-28T12:47:07.591 INFO:teuthology.orchestra.run.smithi082.stdout:Reading state information... 2023-11-28T12:47:07.660 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2023-11-28T12:47:07.786 INFO:teuthology.orchestra.run.smithi082.stdout:The following additional packages will be installed: 2023-11-28T12:47:07.786 INFO:teuthology.orchestra.run.smithi082.stdout: linux-generic linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-11-28T12:47:07.786 INFO:teuthology.orchestra.run.smithi082.stdout: linux-headers-generic linux-image-5.4.0-167-generic 2023-11-28T12:47:07.787 INFO:teuthology.orchestra.run.smithi082.stdout: linux-modules-5.4.0-167-generic linux-modules-extra-5.4.0-167-generic 2023-11-28T12:47:07.788 INFO:teuthology.orchestra.run.smithi082.stdout:Suggested packages: 2023-11-28T12:47:07.788 INFO:teuthology.orchestra.run.smithi082.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-11-28T12:47:07.788 INFO:teuthology.orchestra.run.smithi082.stdout:Recommended packages: 2023-11-28T12:47:07.788 INFO:teuthology.orchestra.run.smithi082.stdout: thermald 2023-11-28T12:47:07.849 INFO:teuthology.orchestra.run.smithi082.stdout:The following NEW packages will be installed: 2023-11-28T12:47:07.849 INFO:teuthology.orchestra.run.smithi082.stdout: linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-11-28T12:47:07.849 INFO:teuthology.orchestra.run.smithi082.stdout: linux-image-5.4.0-167-generic linux-modules-5.4.0-167-generic 2023-11-28T12:47:07.849 INFO:teuthology.orchestra.run.smithi082.stdout: linux-modules-extra-5.4.0-167-generic 2023-11-28T12:47:07.850 INFO:teuthology.orchestra.run.smithi082.stdout:The following packages will be upgraded: 2023-11-28T12:47:07.850 INFO:teuthology.orchestra.run.smithi082.stdout: linux-generic linux-headers-generic linux-image-generic 2023-11-28T12:47:07.863 INFO:teuthology.orchestra.run.smithi114.stdout:Building dependency tree... 2023-11-28T12:47:07.864 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... 2023-11-28T12:47:07.904 INFO:teuthology.orchestra.run.smithi082.stdout:3 upgraded, 5 newly installed, 0 to remove and 278 not upgraded. 2023-11-28T12:47:07.904 INFO:teuthology.orchestra.run.smithi082.stdout:Need to get 77.0 MB of archives. 2023-11-28T12:47:07.904 INFO:teuthology.orchestra.run.smithi082.stdout:After this operation, 380 MB of additional disk space will be used. 2023-11-28T12:47:07.904 INFO:teuthology.orchestra.run.smithi082.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-167-generic amd64 5.4.0-167.184 [15.0 MB] 2023-11-28T12:47:08.048 INFO:teuthology.orchestra.run.smithi114.stdout:The following additional packages will be installed: 2023-11-28T12:47:08.048 INFO:teuthology.orchestra.run.smithi114.stdout: linux-generic linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-11-28T12:47:08.048 INFO:teuthology.orchestra.run.smithi114.stdout: linux-headers-generic linux-image-5.4.0-167-generic 2023-11-28T12:47:08.048 INFO:teuthology.orchestra.run.smithi114.stdout: linux-modules-5.4.0-167-generic linux-modules-extra-5.4.0-167-generic 2023-11-28T12:47:08.049 INFO:teuthology.orchestra.run.smithi114.stdout:Suggested packages: 2023-11-28T12:47:08.049 INFO:teuthology.orchestra.run.smithi114.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-11-28T12:47:08.049 INFO:teuthology.orchestra.run.smithi114.stdout:Recommended packages: 2023-11-28T12:47:08.050 INFO:teuthology.orchestra.run.smithi114.stdout: thermald 2023-11-28T12:47:08.104 INFO:teuthology.orchestra.run.smithi114.stdout:The following NEW packages will be installed: 2023-11-28T12:47:08.104 INFO:teuthology.orchestra.run.smithi114.stdout: linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-11-28T12:47:08.104 INFO:teuthology.orchestra.run.smithi114.stdout: linux-image-5.4.0-167-generic linux-modules-5.4.0-167-generic 2023-11-28T12:47:08.104 INFO:teuthology.orchestra.run.smithi114.stdout: linux-modules-extra-5.4.0-167-generic 2023-11-28T12:47:08.105 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages will be upgraded: 2023-11-28T12:47:08.106 INFO:teuthology.orchestra.run.smithi114.stdout: linux-generic linux-headers-generic linux-image-generic 2023-11-28T12:47:08.164 INFO:teuthology.orchestra.run.smithi114.stdout:3 upgraded, 5 newly installed, 0 to remove and 278 not upgraded. 2023-11-28T12:47:08.164 INFO:teuthology.orchestra.run.smithi114.stdout:Need to get 77.0 MB of archives. 2023-11-28T12:47:08.164 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 380 MB of additional disk space will be used. 2023-11-28T12:47:08.164 INFO:teuthology.orchestra.run.smithi114.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-167-generic amd64 5.4.0-167.184 [15.0 MB] 2023-11-28T12:47:08.228 INFO:teuthology.orchestra.run.smithi082.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-167-generic amd64 5.4.0-167.184 [10.5 MB] 2023-11-28T12:47:08.320 INFO:teuthology.orchestra.run.smithi082.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-167-generic amd64 5.4.0-167.184 [39.2 MB] 2023-11-28T12:47:08.571 INFO:teuthology.orchestra.run.smithi114.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-167-generic amd64 5.4.0-167.184 [10.5 MB] 2023-11-28T12:47:08.672 INFO:teuthology.orchestra.run.smithi114.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-167-generic amd64 5.4.0-167.184 [39.2 MB] 2023-11-28T12:47:08.822 INFO:teuthology.orchestra.run.smithi082.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.167.164 [1,900 B] 2023-11-28T12:47:08.822 INFO:teuthology.orchestra.run.smithi082.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.167.164 [2,564 B] 2023-11-28T12:47:08.822 INFO:teuthology.orchestra.run.smithi082.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167 all 5.4.0-167.184 [11.0 MB] 2023-11-28T12:47:08.914 INFO:teuthology.orchestra.run.smithi082.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167-generic amd64 5.4.0-167.184 [1,367 kB] 2023-11-28T12:47:08.924 INFO:teuthology.orchestra.run.smithi082.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.167.164 [2,428 B] 2023-11-28T12:47:09.290 INFO:teuthology.orchestra.run.smithi114.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.167.164 [1,900 B] 2023-11-28T12:47:09.291 INFO:teuthology.orchestra.run.smithi114.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.167.164 [2,564 B] 2023-11-28T12:47:09.291 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167 all 5.4.0-167.184 [11.0 MB] 2023-11-28T12:47:09.624 INFO:teuthology.orchestra.run.smithi082.stdout:Fetched 77.0 MB in 1s (72.2 MB/s) 2023-11-28T12:47:09.820 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package linux-modules-5.4.0-167-generic. 2023-11-28T12:47:09.883 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167-generic amd64 5.4.0-167.184 [1,367 kB] 2023-11-28T12:47:09.904 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.167.164 [2,428 B] 2023-11-28T12:47:10.591 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 77.0 MB in 2s (43.0 MB/s) 2023-11-28T12:47:10.797 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package linux-modules-5.4.0-167-generic. 2023-11-28T12:47:11.730 INFO:teuthology.orchestra.run.smithi082.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-11-28T12:47:11.735 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../0-linux-modules-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-28T12:47:11.850 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T12:47:12.522 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-11-28T12:47:12.527 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../0-linux-modules-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-28T12:47:12.686 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T12:47:13.808 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package linux-image-5.4.0-167-generic. 2023-11-28T12:47:13.821 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../1-linux-image-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-28T12:47:13.924 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T12:47:14.753 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package linux-image-5.4.0-167-generic. 2023-11-28T12:47:14.767 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../1-linux-image-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-28T12:47:14.861 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T12:47:14.994 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-167-generic. 2023-11-28T12:47:15.010 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-28T12:47:15.052 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T12:47:15.897 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-167-generic. 2023-11-28T12:47:15.910 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-28T12:47:15.972 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T12:47:19.968 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../3-linux-generic_5.4.0.167.164_amd64.deb ... 2023-11-28T12:47:20.092 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-28T12:47:20.446 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.167.164_amd64.deb ... 2023-11-28T12:47:20.571 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-image-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-28T12:47:20.906 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../3-linux-generic_5.4.0.167.164_amd64.deb ... 2023-11-28T12:47:20.932 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package linux-headers-5.4.0-167. 2023-11-28T12:47:20.949 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../5-linux-headers-5.4.0-167_5.4.0-167.184_all.deb ... 2023-11-28T12:47:20.990 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-11-28T12:47:21.029 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-28T12:47:21.397 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.167.164_amd64.deb ... 2023-11-28T12:47:21.524 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-image-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-28T12:47:21.894 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package linux-headers-5.4.0-167. 2023-11-28T12:47:21.908 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../5-linux-headers-5.4.0-167_5.4.0-167.184_all.deb ... 2023-11-28T12:47:21.952 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-11-28T12:47:26.659 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package linux-headers-5.4.0-167-generic. 2023-11-28T12:47:26.682 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../6-linux-headers-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-28T12:47:26.725 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T12:47:27.939 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package linux-headers-5.4.0-167-generic. 2023-11-28T12:47:27.963 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../6-linux-headers-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-28T12:47:28.005 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T12:47:29.368 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.167.164_amd64.deb ... 2023-11-28T12:47:29.513 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-headers-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-28T12:47:29.849 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T12:47:30.839 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.167.164_amd64.deb ... 2023-11-28T12:47:30.976 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-headers-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-28T12:47:31.067 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-11-28T12:47:31.194 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T12:47:31.333 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T12:47:31.336 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T12:47:32.483 INFO:teuthology.orchestra.run.smithi082.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-167-generic 2023-11-28T12:47:32.483 INFO:teuthology.orchestra.run.smithi082.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-167-generic 2023-11-28T12:47:32.580 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-11-28T12:47:32.622 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T12:47:33.161 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T12:47:33.427 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T12:47:33.814 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-image-generic (5.4.0.167.164) ... 2023-11-28T12:47:33.924 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-headers-generic (5.4.0.167.164) ... 2023-11-28T12:47:34.066 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-generic (5.4.0.167.164) ... 2023-11-28T12:47:34.193 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T12:47:34.265 INFO:teuthology.orchestra.run.smithi082.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-11-28T12:47:34.265 INFO:teuthology.orchestra.run.smithi082.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-167-generic 2023-11-28T12:47:34.607 INFO:teuthology.orchestra.run.smithi114.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-167-generic 2023-11-28T12:47:34.607 INFO:teuthology.orchestra.run.smithi114.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-167-generic 2023-11-28T12:47:34.754 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T12:47:35.947 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-image-generic (5.4.0.167.164) ... 2023-11-28T12:47:36.098 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-headers-generic (5.4.0.167.164) ... 2023-11-28T12:47:36.251 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-generic (5.4.0.167.164) ... 2023-11-28T12:47:36.376 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T12:47:36.457 INFO:teuthology.orchestra.run.smithi114.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-11-28T12:47:36.457 INFO:teuthology.orchestra.run.smithi114.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-167-generic 2023-11-28T12:47:56.352 INFO:teuthology.orchestra.run.smithi082.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-11-28T12:47:56.352 INFO:teuthology.orchestra.run.smithi082.stdout:Sourcing file `/etc/default/grub' 2023-11-28T12:47:56.363 INFO:teuthology.orchestra.run.smithi082.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T12:47:56.376 INFO:teuthology.orchestra.run.smithi082.stdout:Generating grub configuration file ... 2023-11-28T12:47:56.757 INFO:teuthology.orchestra.run.smithi082.stdout:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-11-28T12:47:56.784 INFO:teuthology.orchestra.run.smithi082.stdout:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-11-28T12:47:57.156 INFO:teuthology.orchestra.run.smithi082.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-28T12:47:57.167 INFO:teuthology.orchestra.run.smithi082.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-28T12:47:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-11-28T12:47:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:Sourcing file `/etc/default/grub' 2023-11-28T12:47:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T12:47:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:Generating grub configuration file ... 2023-11-28T12:47:59.054 INFO:teuthology.orchestra.run.smithi114.stdout:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-11-28T12:47:59.076 INFO:teuthology.orchestra.run.smithi114.stdout:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-11-28T12:47:59.255 INFO:teuthology.orchestra.run.smithi082.stdout:done 2023-11-28T12:47:59.543 INFO:teuthology.orchestra.run.smithi114.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-28T12:47:59.555 INFO:teuthology.orchestra.run.smithi114.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-28T12:47:59.697 DEBUG:teuthology.orchestra.run.smithi082:> dpkg -s linux-image-generic 2023-11-28T12:47:59.752 INFO:teuthology.orchestra.run.smithi082.stdout:Package: linux-image-generic 2023-11-28T12:47:59.753 INFO:teuthology.orchestra.run.smithi082.stdout:Status: install ok installed 2023-11-28T12:47:59.753 INFO:teuthology.orchestra.run.smithi082.stdout:Priority: optional 2023-11-28T12:47:59.753 INFO:teuthology.orchestra.run.smithi082.stdout:Section: kernel 2023-11-28T12:47:59.753 INFO:teuthology.orchestra.run.smithi082.stdout:Installed-Size: 20 2023-11-28T12:47:59.753 INFO:teuthology.orchestra.run.smithi082.stdout:Maintainer: Ubuntu Kernel Team 2023-11-28T12:47:59.753 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: amd64 2023-11-28T12:47:59.753 INFO:teuthology.orchestra.run.smithi082.stdout:Source: linux-meta 2023-11-28T12:47:59.753 INFO:teuthology.orchestra.run.smithi082.stdout:Version: 5.4.0.167.164 2023-11-28T12:47:59.753 INFO:teuthology.orchestra.run.smithi082.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-11-28T12:47:59.753 INFO:teuthology.orchestra.run.smithi082.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-28T12:47:59.753 INFO:teuthology.orchestra.run.smithi082.stdout:Recommends: thermald 2023-11-28T12:47:59.753 INFO:teuthology.orchestra.run.smithi082.stdout:Description: Generic Linux kernel image 2023-11-28T12:47:59.754 INFO:teuthology.orchestra.run.smithi082.stdout: This package will always depend on the latest generic kernel image 2023-11-28T12:47:59.754 INFO:teuthology.orchestra.run.smithi082.stdout: available. 2023-11-28T12:47:59.754 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-167-generic 2023-11-28T12:47:59.754 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-28T12:47:59.754 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-28T12:47:59.754 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-28T12:47:59.754 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi082.front.sepia.ceph.com, path=None, version=distro) 2023-11-28T12:47:59.755 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-get clean 2023-11-28T12:47:59.871 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-get update 2023-11-28T12:48:00.021 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-28T12:48:00.140 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-28T12:48:00.220 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-28T12:48:00.304 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-28T12:48:01.711 INFO:teuthology.orchestra.run.smithi114.stdout:done 2023-11-28T12:48:01.755 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2023-11-28T12:48:01.779 DEBUG:teuthology.orchestra.run.smithi082:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-28T12:48:01.849 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2023-11-28T12:48:02.052 INFO:teuthology.orchestra.run.smithi082.stdout:Building dependency tree... 2023-11-28T12:48:02.052 INFO:teuthology.orchestra.run.smithi082.stdout:Reading state information... 2023-11-28T12:48:02.155 DEBUG:teuthology.orchestra.run.smithi114:> dpkg -s linux-image-generic 2023-11-28T12:48:02.196 INFO:teuthology.orchestra.run.smithi114.stdout:Package: linux-image-generic 2023-11-28T12:48:02.197 INFO:teuthology.orchestra.run.smithi114.stdout:Status: install ok installed 2023-11-28T12:48:02.197 INFO:teuthology.orchestra.run.smithi114.stdout:Priority: optional 2023-11-28T12:48:02.197 INFO:teuthology.orchestra.run.smithi114.stdout:Section: kernel 2023-11-28T12:48:02.197 INFO:teuthology.orchestra.run.smithi114.stdout:Installed-Size: 20 2023-11-28T12:48:02.197 INFO:teuthology.orchestra.run.smithi114.stdout:Maintainer: Ubuntu Kernel Team 2023-11-28T12:48:02.197 INFO:teuthology.orchestra.run.smithi114.stdout:Architecture: amd64 2023-11-28T12:48:02.197 INFO:teuthology.orchestra.run.smithi114.stdout:Source: linux-meta 2023-11-28T12:48:02.197 INFO:teuthology.orchestra.run.smithi114.stdout:Version: 5.4.0.167.164 2023-11-28T12:48:02.197 INFO:teuthology.orchestra.run.smithi114.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-11-28T12:48:02.197 INFO:teuthology.orchestra.run.smithi114.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-28T12:48:02.198 INFO:teuthology.orchestra.run.smithi114.stdout:Recommends: thermald 2023-11-28T12:48:02.198 INFO:teuthology.orchestra.run.smithi114.stdout:Description: Generic Linux kernel image 2023-11-28T12:48:02.198 INFO:teuthology.orchestra.run.smithi114.stdout: This package will always depend on the latest generic kernel image 2023-11-28T12:48:02.198 INFO:teuthology.orchestra.run.smithi114.stdout: available. 2023-11-28T12:48:02.198 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-167-generic 2023-11-28T12:48:02.198 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-28T12:48:02.198 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-28T12:48:02.198 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-11-28T12:48:02.198 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi114.front.sepia.ceph.com, path=None, version=distro) 2023-11-28T12:48:02.199 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-get clean 2023-11-28T12:48:02.270 INFO:teuthology.orchestra.run.smithi082.stdout:linux-image-generic is already the newest version (5.4.0.167.164). 2023-11-28T12:48:02.270 INFO:teuthology.orchestra.run.smithi082.stdout:0 upgraded, 0 newly installed, 0 to remove and 278 not upgraded. 2023-11-28T12:48:02.272 DEBUG:teuthology.orchestra.run.smithi082:> dpkg -s linux-image-generic 2023-11-28T12:48:02.276 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-get update 2023-11-28T12:48:02.293 INFO:teuthology.orchestra.run.smithi082.stdout:Package: linux-image-generic 2023-11-28T12:48:02.293 INFO:teuthology.orchestra.run.smithi082.stdout:Status: install ok installed 2023-11-28T12:48:02.293 INFO:teuthology.orchestra.run.smithi082.stdout:Priority: optional 2023-11-28T12:48:02.293 INFO:teuthology.orchestra.run.smithi082.stdout:Section: kernel 2023-11-28T12:48:02.293 INFO:teuthology.orchestra.run.smithi082.stdout:Installed-Size: 20 2023-11-28T12:48:02.293 INFO:teuthology.orchestra.run.smithi082.stdout:Maintainer: Ubuntu Kernel Team 2023-11-28T12:48:02.293 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: amd64 2023-11-28T12:48:02.293 INFO:teuthology.orchestra.run.smithi082.stdout:Source: linux-meta 2023-11-28T12:48:02.293 INFO:teuthology.orchestra.run.smithi082.stdout:Version: 5.4.0.167.164 2023-11-28T12:48:02.293 INFO:teuthology.orchestra.run.smithi082.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-11-28T12:48:02.294 INFO:teuthology.orchestra.run.smithi082.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-28T12:48:02.294 INFO:teuthology.orchestra.run.smithi082.stdout:Recommends: thermald 2023-11-28T12:48:02.294 INFO:teuthology.orchestra.run.smithi082.stdout:Description: Generic Linux kernel image 2023-11-28T12:48:02.294 INFO:teuthology.orchestra.run.smithi082.stdout: This package will always depend on the latest generic kernel image 2023-11-28T12:48:02.294 INFO:teuthology.orchestra.run.smithi082.stdout: available. 2023-11-28T12:48:02.294 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2023-11-28T12:48:02.302 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.U4mH4wyWWr 2023-11-28T12:48:02.303 DEBUG:teuthology.orchestra.run.smithi082:> sudo cp /boot/grub/grub.cfg /tmp/tmp.U4mH4wyWWr 2023-11-28T12:48:02.362 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.U4mH4wyWWr 2023-11-28T12:48:02.404 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.U4mH4wyWWr is 9KB 2023-11-28T12:48:02.418 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.U4mH4wyWWr 2023-11-28T12:48:02.425 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-11-28T12:48:02.482 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T12:48:02.482 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-11-28T12:48:02.482 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-11-28T12:48:02.526 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-167-generic 2023-11-28T12:48:02.526 DEBUG:teuthology.orchestra.run.smithi082:> sudo update-grub 2023-11-28T12:48:02.535 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-28T12:48:02.535 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-28T12:48:02.611 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-28T12:48:02.687 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-28T12:48:03.828 INFO:teuthology.orchestra.run.smithi082.stderr:Sourcing file `/etc/default/grub' 2023-11-28T12:48:03.834 INFO:teuthology.orchestra.run.smithi082.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T12:48:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2023-11-28T12:48:04.142 INFO:teuthology.orchestra.run.smithi082.stderr:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-11-28T12:48:04.154 INFO:teuthology.orchestra.run.smithi082.stderr:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-11-28T12:48:04.294 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2023-11-28T12:48:04.319 DEBUG:teuthology.orchestra.run.smithi114:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-28T12:48:04.385 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2023-11-28T12:48:04.538 INFO:teuthology.orchestra.run.smithi082.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-28T12:48:04.553 INFO:teuthology.orchestra.run.smithi082.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-28T12:48:04.566 INFO:teuthology.orchestra.run.smithi114.stdout:Building dependency tree... 2023-11-28T12:48:04.566 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... 2023-11-28T12:48:04.776 INFO:teuthology.orchestra.run.smithi114.stdout:linux-image-generic is already the newest version (5.4.0.167.164). 2023-11-28T12:48:04.776 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 0 newly installed, 0 to remove and 278 not upgraded. 2023-11-28T12:48:04.778 DEBUG:teuthology.orchestra.run.smithi114:> dpkg -s linux-image-generic 2023-11-28T12:48:04.797 INFO:teuthology.orchestra.run.smithi114.stdout:Package: linux-image-generic 2023-11-28T12:48:04.797 INFO:teuthology.orchestra.run.smithi114.stdout:Status: install ok installed 2023-11-28T12:48:04.797 INFO:teuthology.orchestra.run.smithi114.stdout:Priority: optional 2023-11-28T12:48:04.797 INFO:teuthology.orchestra.run.smithi114.stdout:Section: kernel 2023-11-28T12:48:04.797 INFO:teuthology.orchestra.run.smithi114.stdout:Installed-Size: 20 2023-11-28T12:48:04.798 INFO:teuthology.orchestra.run.smithi114.stdout:Maintainer: Ubuntu Kernel Team 2023-11-28T12:48:04.798 INFO:teuthology.orchestra.run.smithi114.stdout:Architecture: amd64 2023-11-28T12:48:04.798 INFO:teuthology.orchestra.run.smithi114.stdout:Source: linux-meta 2023-11-28T12:48:04.798 INFO:teuthology.orchestra.run.smithi114.stdout:Version: 5.4.0.167.164 2023-11-28T12:48:04.798 INFO:teuthology.orchestra.run.smithi114.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-11-28T12:48:04.799 INFO:teuthology.orchestra.run.smithi114.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-28T12:48:04.799 INFO:teuthology.orchestra.run.smithi114.stdout:Recommends: thermald 2023-11-28T12:48:04.799 INFO:teuthology.orchestra.run.smithi114.stdout:Description: Generic Linux kernel image 2023-11-28T12:48:04.799 INFO:teuthology.orchestra.run.smithi114.stdout: This package will always depend on the latest generic kernel image 2023-11-28T12:48:04.799 INFO:teuthology.orchestra.run.smithi114.stdout: available. 2023-11-28T12:48:04.800 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2023-11-28T12:48:04.807 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.6ykJQ7ZUVp 2023-11-28T12:48:04.807 DEBUG:teuthology.orchestra.run.smithi114:> sudo cp /boot/grub/grub.cfg /tmp/tmp.6ykJQ7ZUVp 2023-11-28T12:48:04.864 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.6ykJQ7ZUVp 2023-11-28T12:48:04.904 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.6ykJQ7ZUVp is 9KB 2023-11-28T12:48:04.918 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.6ykJQ7ZUVp 2023-11-28T12:48:04.925 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-11-28T12:48:04.982 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T12:48:04.982 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-11-28T12:48:04.982 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-11-28T12:48:05.014 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-167-generic 2023-11-28T12:48:05.014 DEBUG:teuthology.orchestra.run.smithi114:> sudo update-grub 2023-11-28T12:48:05.536 INFO:teuthology.orchestra.run.smithi082.stderr:done 2023-11-28T12:48:05.538 DEBUG:teuthology.orchestra.run.smithi082:> sudo shutdown -r now 2023-11-28T12:48:06.425 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub' 2023-11-28T12:48:06.437 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T12:48:06.455 INFO:teuthology.orchestra.run.smithi114.stderr:Generating grub configuration file ... 2023-11-28T12:48:06.728 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-11-28T12:48:06.739 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-11-28T12:48:07.119 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-28T12:48:07.131 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-28T12:48:08.189 INFO:teuthology.orchestra.run.smithi114.stderr:done 2023-11-28T12:48:08.191 DEBUG:teuthology.orchestra.run.smithi114:> sudo shutdown -r now 2023-11-28T12:48:35.568 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-28T12:48:35.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-11-28T12:48:35.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:48:38.194 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-28T12:48:38.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-11-28T12:48:38.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:49:35.627 DEBUG:teuthology.orchestra.remote:timed out 2023-11-28T12:49:38.198 DEBUG:teuthology.orchestra.remote:timed out 2023-11-28T12:49:44.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-11-28T12:49:44.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:49:45.084 DEBUG:teuthology.orchestra.run.smithi082:> true 2023-11-28T12:49:45.898 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-11-28T12:49:45.898 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-167-generic"... 2023-11-28T12:49:45.899 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2023-11-28T12:49:45.905 INFO:teuthology.orchestra.run.smithi082.stdout:5.4.0-167-generic 2023-11-28T12:49:45.905 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-167-generic vs 5.4.0-167-generic 2023-11-28T12:49:45.905 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T12:49:45.905 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-28T12:49:46.906 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-28T12:49:46.907 DEBUG:teuthology.orchestra.run.smithi082:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-28T12:49:47.068 INFO:teuthology.orchestra.run.smithi082.stdout:ttyS1 2023-11-28T12:49:47.091 DEBUG:teuthology.parallel:result is None 2023-11-28T12:49:47.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-11-28T12:49:47.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:49:47.562 DEBUG:teuthology.orchestra.run.smithi114:> true 2023-11-28T12:49:48.751 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-11-28T12:49:48.752 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-167-generic"... 2023-11-28T12:49:48.752 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2023-11-28T12:49:48.758 INFO:teuthology.orchestra.run.smithi114.stdout:5.4.0-167-generic 2023-11-28T12:49:48.759 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-167-generic vs 5.4.0-167-generic 2023-11-28T12:49:48.759 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T12:49:48.759 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-28T12:49:49.761 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-28T12:49:49.761 DEBUG:teuthology.orchestra.run.smithi114:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-28T12:49:49.908 INFO:teuthology.orchestra.run.smithi114.stdout:ttyS1 2023-11-28T12:49:49.932 DEBUG:teuthology.parallel:result is None 2023-11-28T12:49:49.932 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-28T12:49:49.940 INFO:teuthology.task.internal:Creating test directory... 2023-11-28T12:49:49.940 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T12:49:49.943 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T12:49:49.950 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-28T12:49:49.958 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-28T12:49:49.967 INFO:teuthology.task.internal:Creating archive directory... 2023-11-28T12:49:49.967 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T12:49:49.969 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T12:49:49.995 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-28T12:49:50.002 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-28T12:49:50.003 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T12:49:50.027 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T12:49:50.047 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T12:49:50.059 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T12:49:50.059 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T12:49:50.070 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T12:49:50.072 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-28T12:49:50.078 INFO:teuthology.task.internal:Configuring sudo... 2023-11-28T12:49:50.079 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T12:49:50.082 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T12:49:50.097 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-28T12:49:50.108 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-28T12:49:50.108 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T12:49:50.111 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T12:49:50.116 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T12:49:50.163 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T12:49:50.170 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T12:49:50.170 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T12:49:50.207 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T12:49:50.214 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T12:49:50.222 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T12:49:50.222 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T12:49:50.240 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2023-11-28T12:49:50.242 DEBUG:teuthology.orchestra.run.smithi114:> sudo service rsyslog restart 2023-11-28T12:49:50.292 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-28T12:49:50.299 INFO:teuthology.task.internal:Starting timer... 2023-11-28T12:49:50.300 INFO:teuthology.run_tasks:Running task pcp... 2023-11-28T12:49:50.312 INFO:teuthology.run_tasks:Running task selinux... 2023-11-28T12:49:50.320 DEBUG:teuthology.task.selinux:Excluding smithi082: OS 'ubuntu' does not support SELinux 2023-11-28T12:49:50.320 DEBUG:teuthology.task.selinux:Excluding smithi114: OS 'ubuntu' does not support SELinux 2023-11-28T12:49:50.321 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-28T12:49:50.321 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-28T12:49:50.321 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-28T12:49:50.321 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-28T12:49:50.329 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-28T12:49:50.335 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-28T12:49:50.456 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-28T12:49:50.474 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-28T12:49:50.475 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi082.front.sepia.ceph.com,smithi114.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-28T12:55:59.450 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi082.front.sepia.ceph.com'), Remote(name='ubuntu@smithi114.front.sepia.ceph.com')] 2023-11-28T12:55:59.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-11-28T12:55:59.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:55:59.503 DEBUG:teuthology.orchestra.run.smithi082:> true 2023-11-28T12:55:59.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-11-28T12:55:59.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-11-28T12:55:59.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:55:59.680 DEBUG:teuthology.orchestra.run.smithi114:> true 2023-11-28T12:55:59.795 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-11-28T12:55:59.796 INFO:teuthology.run_tasks:Running task clock... 2023-11-28T12:55:59.806 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-28T12:55:59.806 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T12:55:59.807 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T12:55:59.809 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T12:55:59.809 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T12:55:59.844 INFO:teuthology.orchestra.run.smithi082.stdout:28 Nov 12:55:59 ntpd[23587]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-11-28T12:55:59.845 INFO:teuthology.orchestra.run.smithi082.stdout:28 Nov 12:55:59 ntpd[23587]: Command line: ntpd -gq 2023-11-28T12:55:59.845 INFO:teuthology.orchestra.run.smithi082.stdout:28 Nov 12:55:59 ntpd[23587]: proto: precision = 0.130 usec (-23) 2023-11-28T12:55:59.845 INFO:teuthology.orchestra.run.smithi082.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T12:55:59.845 INFO:teuthology.orchestra.run.smithi082.stdout:28 Nov 12:55:59 ntpd[23587]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T12:55:59.845 INFO:teuthology.orchestra.run.smithi082.stdout:28 Nov 12:55:59 ntpd[23587]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T12:55:59.846 INFO:teuthology.orchestra.run.smithi082.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T12:55:59.846 INFO:teuthology.orchestra.run.smithi082.stdout:28 Nov 12:55:59 ntpd[23587]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T12:55:59.847 INFO:teuthology.orchestra.run.smithi082.stdout:28 Nov 12:55:59 ntpd[23587]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T12:55:59.847 INFO:teuthology.orchestra.run.smithi082.stdout:28 Nov 12:55:59 ntpd[23587]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T12:55:59.847 INFO:teuthology.orchestra.run.smithi082.stdout:28 Nov 12:55:59 ntpd[23587]: Listen normally on 3 enp3s0f1 172.21.15.82:123 2023-11-28T12:55:59.847 INFO:teuthology.orchestra.run.smithi082.stdout:28 Nov 12:55:59 ntpd[23587]: Listen normally on 4 lo [::1]:123 2023-11-28T12:55:59.847 INFO:teuthology.orchestra.run.smithi082.stdout:28 Nov 12:55:59 ntpd[23587]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3ff%5]:123 2023-11-28T12:55:59.847 INFO:teuthology.orchestra.run.smithi082.stdout:28 Nov 12:55:59 ntpd[23587]: Listening on routing socket on fd #22 for interface updates 2023-11-28T12:55:59.873 INFO:teuthology.orchestra.run.smithi114.stdout:28 Nov 12:55:59 ntpd[23585]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-11-28T12:55:59.873 INFO:teuthology.orchestra.run.smithi114.stdout:28 Nov 12:55:59 ntpd[23585]: Command line: ntpd -gq 2023-11-28T12:55:59.874 INFO:teuthology.orchestra.run.smithi114.stdout:28 Nov 12:55:59 ntpd[23585]: proto: precision = 0.116 usec (-23) 2023-11-28T12:55:59.875 INFO:teuthology.orchestra.run.smithi114.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T12:55:59.875 INFO:teuthology.orchestra.run.smithi114.stdout:28 Nov 12:55:59 ntpd[23585]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T12:55:59.875 INFO:teuthology.orchestra.run.smithi114.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T12:55:59.876 INFO:teuthology.orchestra.run.smithi114.stdout:28 Nov 12:55:59 ntpd[23585]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T12:55:59.876 INFO:teuthology.orchestra.run.smithi114.stdout:28 Nov 12:55:59 ntpd[23585]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T12:55:59.876 INFO:teuthology.orchestra.run.smithi114.stdout:28 Nov 12:55:59 ntpd[23585]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T12:55:59.876 INFO:teuthology.orchestra.run.smithi114.stdout:28 Nov 12:55:59 ntpd[23585]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T12:55:59.876 INFO:teuthology.orchestra.run.smithi114.stdout:28 Nov 12:55:59 ntpd[23585]: Listen normally on 3 enp3s0f1 172.21.15.114:123 2023-11-28T12:55:59.876 INFO:teuthology.orchestra.run.smithi114.stdout:28 Nov 12:55:59 ntpd[23585]: Listen normally on 4 lo [::1]:123 2023-11-28T12:55:59.877 INFO:teuthology.orchestra.run.smithi114.stdout:28 Nov 12:55:59 ntpd[23585]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cb63%5]:123 2023-11-28T12:55:59.877 INFO:teuthology.orchestra.run.smithi114.stdout:28 Nov 12:55:59 ntpd[23585]: Listening on routing socket on fd #22 for interface updates 2023-11-28T12:56:00.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:00 ntpd[23587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:00.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:00 ntpd[23587]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:00.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:00 ntpd[23587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:00.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:00 ntpd[23587]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:00.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:00 ntpd[23587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:00.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:00 ntpd[23587]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:00.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:00 ntpd[23587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:00.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:00 ntpd[23587]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:00.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:00 ntpd[23587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T12:56:00.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:00 ntpd[23587]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T12:56:00.846 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:00 ntpd[23587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:00.846 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:00 ntpd[23587]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:00.846 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:00 ntpd[23587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T12:56:00.846 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:00 ntpd[23587]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T12:56:00.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:00 ntpd[23585]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:00.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:00 ntpd[23585]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:00.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:00 ntpd[23585]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:00.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:00 ntpd[23585]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:00.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:00 ntpd[23585]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T12:56:00.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:00 ntpd[23585]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T12:56:01.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:01 ntpd[23585]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:01.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:01 ntpd[23585]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:01.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:01 ntpd[23585]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:01.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:01 ntpd[23585]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:01.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:01 ntpd[23585]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T12:56:01.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:01 ntpd[23585]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T12:56:02.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:02 ntpd[23587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:02.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:02 ntpd[23587]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:02.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:02 ntpd[23587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:02.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:02 ntpd[23587]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:02.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:02 ntpd[23587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:02.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:02 ntpd[23587]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:02.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:02 ntpd[23587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T12:56:02.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:02 ntpd[23587]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T12:56:02.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:02 ntpd[23587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:02.846 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:02 ntpd[23587]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:02.846 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:02 ntpd[23587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T12:56:02.846 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:02 ntpd[23587]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T12:56:02.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:02 ntpd[23585]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:02.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:02 ntpd[23585]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:02.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:02 ntpd[23585]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:02.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:02 ntpd[23585]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:02.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:02 ntpd[23585]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:02.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:02 ntpd[23585]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:02.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:02 ntpd[23585]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T12:56:02.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:02 ntpd[23585]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T12:56:03.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:03 ntpd[23585]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:03.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:03 ntpd[23585]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:03.875 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:03 ntpd[23585]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:03.875 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:03 ntpd[23585]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:03.875 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:03 ntpd[23585]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T12:56:03.875 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:03 ntpd[23585]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T12:56:04.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:04 ntpd[23587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:04.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:04 ntpd[23587]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:04.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:04 ntpd[23587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:04.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:04 ntpd[23587]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:04.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:04 ntpd[23587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:04.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:04 ntpd[23587]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:04.846 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:04 ntpd[23587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:04.846 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:04 ntpd[23587]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:04.846 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:04 ntpd[23587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T12:56:04.846 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:04 ntpd[23587]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T12:56:04.846 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:04 ntpd[23587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:04.846 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:04 ntpd[23587]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:04.846 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:04 ntpd[23587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T12:56:04.846 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:04 ntpd[23587]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T12:56:04.846 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:04 ntpd[23587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:04.846 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:04 ntpd[23587]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:04.846 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:04 ntpd[23587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T12:56:04.847 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:04 ntpd[23587]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T12:56:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:04 ntpd[23585]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:04 ntpd[23585]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:04 ntpd[23585]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:04 ntpd[23585]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:04 ntpd[23585]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:04 ntpd[23585]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:04 ntpd[23585]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T12:56:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:04 ntpd[23585]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T12:56:04.875 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:04 ntpd[23585]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:04.875 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:04 ntpd[23585]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:04.875 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:04 ntpd[23585]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T12:56:04.875 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:04 ntpd[23585]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T12:56:05.873 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:05 ntpd[23585]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:05.873 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:05 ntpd[23585]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:05.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:05 ntpd[23585]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:05.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:05 ntpd[23585]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:05.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:05 ntpd[23585]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T12:56:05.874 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:05 ntpd[23585]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T12:56:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:06 ntpd[23587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:06 ntpd[23587]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:06 ntpd[23587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:06 ntpd[23587]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:06 ntpd[23587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:06 ntpd[23587]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:06 ntpd[23587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:06.846 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:06 ntpd[23587]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:06.846 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:06 ntpd[23587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T12:56:06.846 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:06 ntpd[23587]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T12:56:06.846 INFO:teuthology.orchestra.run.smithi082.stdout:28 Nov 12:56:06 ntpd[23587]: ntpd: time slew +0.000555 s 2023-11-28T12:56:06.846 INFO:teuthology.orchestra.run.smithi082.stdout:ntpd: time slew +0.000555s 2023-11-28T12:56:06.847 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:06 ntpd[23587]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T12:56:06.847 INFO:teuthology.orchestra.run.smithi082.stderr:28 Nov 12:56:06 ntpd[23587]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T12:56:06.876 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:06 ntpd[23585]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:06.876 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:06 ntpd[23585]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:06.876 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:06 ntpd[23585]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:06.877 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:06 ntpd[23585]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:06.877 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:06 ntpd[23585]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:06.877 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:06 ntpd[23585]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:06.878 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:06 ntpd[23585]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T12:56:06.878 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:06 ntpd[23585]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T12:56:06.878 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:06 ntpd[23585]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T12:56:06.879 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:06 ntpd[23585]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T12:56:06.879 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:06 ntpd[23585]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T12:56:06.879 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:06 ntpd[23585]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T12:56:06.879 INFO:teuthology.orchestra.run.smithi114.stdout:28 Nov 12:56:06 ntpd[23585]: ntpd: time slew -0.000730 s 2023-11-28T12:56:06.880 INFO:teuthology.orchestra.run.smithi114.stdout:ntpd: time slew -0.000730s 2023-11-28T12:56:06.880 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:06 ntpd[23585]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T12:56:06.881 INFO:teuthology.orchestra.run.smithi114.stderr:28 Nov 12:56:06 ntpd[23585]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T12:56:06.914 INFO:teuthology.orchestra.run.smithi082.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T12:56:06.914 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================== 2023-11-28T12:56:06.915 INFO:teuthology.orchestra.run.smithi082.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T12:56:06.915 INFO:teuthology.orchestra.run.smithi082.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T12:56:06.915 INFO:teuthology.orchestra.run.smithi082.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T12:56:06.915 INFO:teuthology.orchestra.run.smithi082.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T12:56:06.948 INFO:teuthology.orchestra.run.smithi114.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T12:56:06.948 INFO:teuthology.orchestra.run.smithi114.stdout:============================================================================== 2023-11-28T12:56:06.948 INFO:teuthology.orchestra.run.smithi114.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T12:56:06.948 INFO:teuthology.orchestra.run.smithi114.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T12:56:06.948 INFO:teuthology.orchestra.run.smithi114.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T12:56:06.948 INFO:teuthology.orchestra.run.smithi114.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T12:56:06.949 INFO:teuthology.run_tasks:Running task install... 2023-11-28T12:56:06.958 DEBUG:teuthology.task.install:project ceph 2023-11-28T12:56:06.958 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}} 2023-11-28T12:56:06.958 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'} 2023-11-28T12:56:06.959 INFO:teuthology.task.install:Using flavor: default 2023-11-28T12:56:06.964 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-28T12:56:06.964 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-28T12:56:06.965 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-key list | grep Ceph 2023-11-28T12:56:06.965 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-key list | grep Ceph 2023-11-28T12:56:07.060 INFO:teuthology.orchestra.run.smithi082.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-11-28T12:56:07.063 INFO:teuthology.orchestra.run.smithi114.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-11-28T12:56:07.119 INFO:teuthology.orchestra.run.smithi082.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T12:56:07.119 INFO:teuthology.orchestra.run.smithi082.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T12:56:07.119 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T12:56:07.119 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T12:56:07.120 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T12:56:07.125 INFO:teuthology.orchestra.run.smithi114.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T12:56:07.125 INFO:teuthology.orchestra.run.smithi114.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T12:56:07.125 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T12:56:07.126 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T12:56:07.126 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T12:56:07.540 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default/ 2023-11-28T12:56:07.541 INFO:teuthology.task.install.deb:Package version is 18.0.0-2697-g2f5f6028-1focal 2023-11-28T12:56:07.545 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default/ 2023-11-28T12:56:07.545 INFO:teuthology.task.install.deb:Package version is 18.0.0-2697-g2f5f6028-1focal 2023-11-28T12:56:07.660 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T12:56:07.660 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T12:56:07.663 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T12:56:07.663 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T12:56:07.680 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-get update 2023-11-28T12:56:07.682 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-get update 2023-11-28T12:56:07.826 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-28T12:56:07.832 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-28T12:56:07.849 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-28T12:56:07.944 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-28T12:56:07.954 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-28T12:56:07.954 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-28T12:56:07.994 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-28T12:56:08.044 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-28T12:56:08.093 INFO:teuthology.orchestra.run.smithi082.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal InRelease 2023-11-28T12:56:08.134 INFO:teuthology.orchestra.run.smithi114.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal InRelease 2023-11-28T12:56:08.169 INFO:teuthology.orchestra.run.smithi082.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-11-28T12:56:08.199 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-11-28T12:56:08.244 INFO:teuthology.orchestra.run.smithi082.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal Release.gpg 2023-11-28T12:56:08.279 INFO:teuthology.orchestra.run.smithi114.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal Release.gpg 2023-11-28T12:56:08.324 INFO:teuthology.orchestra.run.smithi082.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main i386 Packages [3,418 B] 2023-11-28T12:56:08.350 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-11-28T12:56:08.381 INFO:teuthology.orchestra.run.smithi082.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-11-28T12:56:08.398 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main i386 Packages [3,418 B] 2023-11-28T12:56:08.479 INFO:teuthology.orchestra.run.smithi082.stdout:Fetched 28.4 kB in 1s (44.6 kB/s) 2023-11-28T12:56:08.598 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 28.4 kB in 1s (39.9 kB/s) 2023-11-28T12:56:09.537 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2023-11-28T12:56:09.563 DEBUG:teuthology.orchestra.run.smithi082:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-2697-g2f5f6028-1focal cephadm=18.0.0-2697-g2f5f6028-1focal ceph-mds=18.0.0-2697-g2f5f6028-1focal ceph-mgr=18.0.0-2697-g2f5f6028-1focal ceph-common=18.0.0-2697-g2f5f6028-1focal ceph-fuse=18.0.0-2697-g2f5f6028-1focal ceph-test=18.0.0-2697-g2f5f6028-1focal ceph-volume=18.0.0-2697-g2f5f6028-1focal radosgw=18.0.0-2697-g2f5f6028-1focal python3-rados=18.0.0-2697-g2f5f6028-1focal python3-rgw=18.0.0-2697-g2f5f6028-1focal python3-cephfs=18.0.0-2697-g2f5f6028-1focal python3-rbd=18.0.0-2697-g2f5f6028-1focal libcephfs2=18.0.0-2697-g2f5f6028-1focal libcephfs-dev=18.0.0-2697-g2f5f6028-1focal librados2=18.0.0-2697-g2f5f6028-1focal librbd1=18.0.0-2697-g2f5f6028-1focal rbd-fuse=18.0.0-2697-g2f5f6028-1focal python3-cephfs=18.0.0-2697-g2f5f6028-1focal cephfs-shell=18.0.0-2697-g2f5f6028-1focal cephfs-top=18.0.0-2697-g2f5f6028-1focal cephfs-mirror=18.0.0-2697-g2f5f6028-1focal 2023-11-28T12:56:09.634 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2023-11-28T12:56:09.659 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2023-11-28T12:56:09.684 DEBUG:teuthology.orchestra.run.smithi114:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-2697-g2f5f6028-1focal cephadm=18.0.0-2697-g2f5f6028-1focal ceph-mds=18.0.0-2697-g2f5f6028-1focal ceph-mgr=18.0.0-2697-g2f5f6028-1focal ceph-common=18.0.0-2697-g2f5f6028-1focal ceph-fuse=18.0.0-2697-g2f5f6028-1focal ceph-test=18.0.0-2697-g2f5f6028-1focal ceph-volume=18.0.0-2697-g2f5f6028-1focal radosgw=18.0.0-2697-g2f5f6028-1focal python3-rados=18.0.0-2697-g2f5f6028-1focal python3-rgw=18.0.0-2697-g2f5f6028-1focal python3-cephfs=18.0.0-2697-g2f5f6028-1focal python3-rbd=18.0.0-2697-g2f5f6028-1focal libcephfs2=18.0.0-2697-g2f5f6028-1focal libcephfs-dev=18.0.0-2697-g2f5f6028-1focal librados2=18.0.0-2697-g2f5f6028-1focal librbd1=18.0.0-2697-g2f5f6028-1focal rbd-fuse=18.0.0-2697-g2f5f6028-1focal python3-cephfs=18.0.0-2697-g2f5f6028-1focal cephfs-shell=18.0.0-2697-g2f5f6028-1focal cephfs-top=18.0.0-2697-g2f5f6028-1focal cephfs-mirror=18.0.0-2697-g2f5f6028-1focal 2023-11-28T12:56:09.754 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2023-11-28T12:56:09.836 INFO:teuthology.orchestra.run.smithi082.stdout:Building dependency tree... 2023-11-28T12:56:09.837 INFO:teuthology.orchestra.run.smithi082.stdout:Reading state information... 2023-11-28T12:56:09.934 INFO:teuthology.orchestra.run.smithi114.stdout:Building dependency tree... 2023-11-28T12:56:09.934 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... 2023-11-28T12:56:10.019 INFO:teuthology.orchestra.run.smithi082.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T12:56:10.020 INFO:teuthology.orchestra.run.smithi082.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-28T12:56:10.020 INFO:teuthology.orchestra.run.smithi082.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T12:56:10.020 INFO:teuthology.orchestra.run.smithi082.stdout:The following additional packages will be installed: 2023-11-28T12:56:10.021 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T12:56:10.021 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-11-28T12:56:10.021 INFO:teuthology.orchestra.run.smithi082.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-11-28T12:56:10.021 INFO:teuthology.orchestra.run.smithi082.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-11-28T12:56:10.021 INFO:teuthology.orchestra.run.smithi082.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-11-28T12:56:10.022 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-11-28T12:56:10.022 INFO:teuthology.orchestra.run.smithi082.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-28T12:56:10.022 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-28T12:56:10.022 INFO:teuthology.orchestra.run.smithi082.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-28T12:56:10.022 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-28T12:56:10.022 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-11-28T12:56:10.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-11-28T12:56:10.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-11-28T12:56:10.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-11-28T12:56:10.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T12:56:10.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-28T12:56:10.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T12:56:10.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-11-28T12:56:10.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-28T12:56:10.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-28T12:56:10.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-28T12:56:10.023 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-28T12:56:10.023 INFO:teuthology.orchestra.run.smithi082.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-28T12:56:10.024 INFO:teuthology.orchestra.run.smithi082.stdout:Suggested packages: 2023-11-28T12:56:10.024 INFO:teuthology.orchestra.run.smithi082.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-11-28T12:56:10.024 INFO:teuthology.orchestra.run.smithi082.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-11-28T12:56:10.024 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-11-28T12:56:10.024 INFO:teuthology.orchestra.run.smithi082.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-11-28T12:56:10.024 INFO:teuthology.orchestra.run.smithi082.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-11-28T12:56:10.024 INFO:teuthology.orchestra.run.smithi082.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-11-28T12:56:10.024 INFO:teuthology.orchestra.run.smithi082.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-11-28T12:56:10.025 INFO:teuthology.orchestra.run.smithi082.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T12:56:10.025 INFO:teuthology.orchestra.run.smithi082.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-11-28T12:56:10.025 INFO:teuthology.orchestra.run.smithi082.stdout:Recommended packages: 2023-11-28T12:56:10.025 INFO:teuthology.orchestra.run.smithi082.stdout: btrfs-tools 2023-11-28T12:56:10.108 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T12:56:10.110 INFO:teuthology.orchestra.run.smithi114.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-28T12:56:10.110 INFO:teuthology.orchestra.run.smithi114.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T12:56:10.110 INFO:teuthology.orchestra.run.smithi114.stdout:The following additional packages will be installed: 2023-11-28T12:56:10.110 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T12:56:10.111 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-11-28T12:56:10.111 INFO:teuthology.orchestra.run.smithi114.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-11-28T12:56:10.111 INFO:teuthology.orchestra.run.smithi114.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-11-28T12:56:10.111 INFO:teuthology.orchestra.run.smithi114.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-11-28T12:56:10.113 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-11-28T12:56:10.114 INFO:teuthology.orchestra.run.smithi114.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-28T12:56:10.114 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-28T12:56:10.114 INFO:teuthology.orchestra.run.smithi114.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-28T12:56:10.114 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-28T12:56:10.114 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-11-28T12:56:10.114 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-11-28T12:56:10.114 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-11-28T12:56:10.114 INFO:teuthology.orchestra.run.smithi114.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-11-28T12:56:10.114 INFO:teuthology.orchestra.run.smithi114.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T12:56:10.115 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-28T12:56:10.115 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T12:56:10.115 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-11-28T12:56:10.115 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-28T12:56:10.115 INFO:teuthology.orchestra.run.smithi114.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-28T12:56:10.115 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-28T12:56:10.116 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-28T12:56:10.116 INFO:teuthology.orchestra.run.smithi114.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-28T12:56:10.116 INFO:teuthology.orchestra.run.smithi114.stdout:Suggested packages: 2023-11-28T12:56:10.116 INFO:teuthology.orchestra.run.smithi114.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-11-28T12:56:10.116 INFO:teuthology.orchestra.run.smithi114.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-11-28T12:56:10.116 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-11-28T12:56:10.116 INFO:teuthology.orchestra.run.smithi114.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-11-28T12:56:10.116 INFO:teuthology.orchestra.run.smithi114.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-11-28T12:56:10.116 INFO:teuthology.orchestra.run.smithi114.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-11-28T12:56:10.116 INFO:teuthology.orchestra.run.smithi114.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-11-28T12:56:10.117 INFO:teuthology.orchestra.run.smithi114.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T12:56:10.117 INFO:teuthology.orchestra.run.smithi114.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-11-28T12:56:10.117 INFO:teuthology.orchestra.run.smithi114.stdout:Recommended packages: 2023-11-28T12:56:10.117 INFO:teuthology.orchestra.run.smithi114.stdout: btrfs-tools 2023-11-28T12:56:10.143 INFO:teuthology.orchestra.run.smithi082.stdout:The following NEW packages will be installed: 2023-11-28T12:56:10.143 INFO:teuthology.orchestra.run.smithi082.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T12:56:10.144 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T12:56:10.144 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T12:56:10.144 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-11-28T12:56:10.144 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-11-28T12:56:10.144 INFO:teuthology.orchestra.run.smithi082.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-11-28T12:56:10.144 INFO:teuthology.orchestra.run.smithi082.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-11-28T12:56:10.145 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-11-28T12:56:10.145 INFO:teuthology.orchestra.run.smithi082.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-28T12:56:10.146 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-28T12:56:10.146 INFO:teuthology.orchestra.run.smithi082.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-28T12:56:10.146 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-11-28T12:56:10.146 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-11-28T12:56:10.146 INFO:teuthology.orchestra.run.smithi082.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-11-28T12:56:10.146 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-11-28T12:56:10.147 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-11-28T12:56:10.147 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-11-28T12:56:10.147 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-11-28T12:56:10.147 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-11-28T12:56:10.147 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-11-28T12:56:10.147 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T12:56:10.147 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-28T12:56:10.147 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-28T12:56:10.147 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-28T12:56:10.147 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-28T12:56:10.147 INFO:teuthology.orchestra.run.smithi082.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-11-28T12:56:10.148 INFO:teuthology.orchestra.run.smithi082.stdout:The following packages will be upgraded: 2023-11-28T12:56:10.148 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 librbd1 2023-11-28T12:56:10.234 INFO:teuthology.orchestra.run.smithi114.stdout:The following NEW packages will be installed: 2023-11-28T12:56:10.234 INFO:teuthology.orchestra.run.smithi114.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T12:56:10.235 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T12:56:10.235 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T12:56:10.235 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-11-28T12:56:10.235 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-11-28T12:56:10.235 INFO:teuthology.orchestra.run.smithi114.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-11-28T12:56:10.235 INFO:teuthology.orchestra.run.smithi114.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-11-28T12:56:10.236 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-11-28T12:56:10.237 INFO:teuthology.orchestra.run.smithi114.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-28T12:56:10.237 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-28T12:56:10.237 INFO:teuthology.orchestra.run.smithi114.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-28T12:56:10.237 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-11-28T12:56:10.237 INFO:teuthology.orchestra.run.smithi114.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-11-28T12:56:10.237 INFO:teuthology.orchestra.run.smithi114.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-11-28T12:56:10.237 INFO:teuthology.orchestra.run.smithi114.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-11-28T12:56:10.237 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-11-28T12:56:10.238 INFO:teuthology.orchestra.run.smithi114.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-11-28T12:56:10.238 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-11-28T12:56:10.238 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-11-28T12:56:10.238 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-11-28T12:56:10.238 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T12:56:10.238 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-28T12:56:10.238 INFO:teuthology.orchestra.run.smithi114.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-28T12:56:10.238 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-28T12:56:10.238 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-28T12:56:10.238 INFO:teuthology.orchestra.run.smithi114.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-11-28T12:56:10.238 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages will be upgraded: 2023-11-28T12:56:10.239 INFO:teuthology.orchestra.run.smithi114.stdout: librados2 librbd1 2023-11-28T12:56:10.277 INFO:teuthology.orchestra.run.smithi082.stdout:2 upgraded, 116 newly installed, 0 to remove and 257 not upgraded. 2023-11-28T12:56:10.277 INFO:teuthology.orchestra.run.smithi082.stdout:Need to get 207 MB of archives. 2023-11-28T12:56:10.278 INFO:teuthology.orchestra.run.smithi082.stdout:After this operation, 1,026 MB of additional disk space will be used. 2023-11-28T12:56:10.278 INFO:teuthology.orchestra.run.smithi082.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-11-28T12:56:10.322 INFO:teuthology.orchestra.run.smithi082.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-11-28T12:56:10.356 INFO:teuthology.orchestra.run.smithi082.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-11-28T12:56:10.411 INFO:teuthology.orchestra.run.smithi114.stdout:2 upgraded, 116 newly installed, 0 to remove and 257 not upgraded. 2023-11-28T12:56:10.411 INFO:teuthology.orchestra.run.smithi114.stdout:Need to get 207 MB of archives. 2023-11-28T12:56:10.411 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 1,026 MB of additional disk space will be used. 2023-11-28T12:56:10.411 INFO:teuthology.orchestra.run.smithi114.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-2697-g2f5f6028-1focal [3,431 kB] 2023-11-28T12:56:10.417 INFO:teuthology.orchestra.run.smithi082.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-11-28T12:56:10.429 INFO:teuthology.orchestra.run.smithi114.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-11-28T12:56:10.505 INFO:teuthology.orchestra.run.smithi082.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-11-28T12:56:10.513 INFO:teuthology.orchestra.run.smithi114.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-11-28T12:56:10.515 INFO:teuthology.orchestra.run.smithi082.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-11-28T12:56:10.523 INFO:teuthology.orchestra.run.smithi082.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-2697-g2f5f6028-1focal [3,431 kB] 2023-11-28T12:56:10.550 INFO:teuthology.orchestra.run.smithi082.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-11-28T12:56:10.551 INFO:teuthology.orchestra.run.smithi114.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-11-28T12:56:10.678 INFO:teuthology.orchestra.run.smithi082.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-11-28T12:56:10.681 INFO:teuthology.orchestra.run.smithi082.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-11-28T12:56:10.688 INFO:teuthology.orchestra.run.smithi114.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-11-28T12:56:10.695 INFO:teuthology.orchestra.run.smithi082.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-11-28T12:56:10.698 INFO:teuthology.orchestra.run.smithi082.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-11-28T12:56:10.698 INFO:teuthology.orchestra.run.smithi082.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-11-28T12:56:10.702 INFO:teuthology.orchestra.run.smithi082.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-11-28T12:56:10.702 INFO:teuthology.orchestra.run.smithi082.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-11-28T12:56:10.713 INFO:teuthology.orchestra.run.smithi082.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-11-28T12:56:10.714 INFO:teuthology.orchestra.run.smithi082.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-11-28T12:56:10.719 INFO:teuthology.orchestra.run.smithi082.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-11-28T12:56:10.720 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-2697-g2f5f6028-1focal [3,982 kB] 2023-11-28T12:56:10.757 INFO:teuthology.orchestra.run.smithi082.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-11-28T12:56:10.758 INFO:teuthology.orchestra.run.smithi082.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-11-28T12:56:10.758 INFO:teuthology.orchestra.run.smithi082.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-11-28T12:56:10.760 INFO:teuthology.orchestra.run.smithi082.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T12:56:10.761 INFO:teuthology.orchestra.run.smithi082.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-11-28T12:56:10.762 INFO:teuthology.orchestra.run.smithi082.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-11-28T12:56:10.763 INFO:teuthology.orchestra.run.smithi082.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-11-28T12:56:10.764 INFO:teuthology.orchestra.run.smithi082.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-11-28T12:56:10.767 INFO:teuthology.orchestra.run.smithi082.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-11-28T12:56:10.819 INFO:teuthology.orchestra.run.smithi082.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-11-28T12:56:10.820 INFO:teuthology.orchestra.run.smithi082.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-11-28T12:56:10.821 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-11-28T12:56:10.828 INFO:teuthology.orchestra.run.smithi082.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-11-28T12:56:10.828 INFO:teuthology.orchestra.run.smithi082.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-11-28T12:56:10.829 INFO:teuthology.orchestra.run.smithi082.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-11-28T12:56:10.830 INFO:teuthology.orchestra.run.smithi082.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-11-28T12:56:10.832 INFO:teuthology.orchestra.run.smithi082.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-11-28T12:56:10.835 INFO:teuthology.orchestra.run.smithi082.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-11-28T12:56:10.837 INFO:teuthology.orchestra.run.smithi082.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-11-28T12:56:10.839 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-11-28T12:56:10.879 INFO:teuthology.orchestra.run.smithi082.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-11-28T12:56:10.882 INFO:teuthology.orchestra.run.smithi082.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-11-28T12:56:10.891 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-2697-g2f5f6028-1focal [721 kB] 2023-11-28T12:56:10.900 INFO:teuthology.orchestra.run.smithi114.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-11-28T12:56:10.918 INFO:teuthology.orchestra.run.smithi114.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-2697-g2f5f6028-1focal [376 kB] 2023-11-28T12:56:11.099 INFO:teuthology.orchestra.run.smithi114.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-2697-g2f5f6028-1focal [22.4 kB] 2023-11-28T12:56:11.100 INFO:teuthology.orchestra.run.smithi114.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-2697-g2f5f6028-1focal [184 kB] 2023-11-28T12:56:11.100 INFO:teuthology.orchestra.run.smithi114.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-2697-g2f5f6028-1focal [47.7 kB] 2023-11-28T12:56:11.100 INFO:teuthology.orchestra.run.smithi114.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-2697-g2f5f6028-1focal [353 kB] 2023-11-28T12:56:11.100 INFO:teuthology.orchestra.run.smithi114.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-2697-g2f5f6028-1focal [6,529 kB] 2023-11-28T12:56:11.102 INFO:teuthology.orchestra.run.smithi082.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-11-28T12:56:11.102 INFO:teuthology.orchestra.run.smithi082.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-11-28T12:56:11.102 INFO:teuthology.orchestra.run.smithi082.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-11-28T12:56:11.102 INFO:teuthology.orchestra.run.smithi082.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-11-28T12:56:11.102 INFO:teuthology.orchestra.run.smithi082.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-11-28T12:56:11.102 INFO:teuthology.orchestra.run.smithi082.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-11-28T12:56:11.103 INFO:teuthology.orchestra.run.smithi082.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-11-28T12:56:11.103 INFO:teuthology.orchestra.run.smithi082.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-11-28T12:56:11.103 INFO:teuthology.orchestra.run.smithi082.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T12:56:11.103 INFO:teuthology.orchestra.run.smithi082.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-11-28T12:56:11.103 INFO:teuthology.orchestra.run.smithi082.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-11-28T12:56:11.103 INFO:teuthology.orchestra.run.smithi082.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-11-28T12:56:11.103 INFO:teuthology.orchestra.run.smithi082.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-11-28T12:56:11.104 INFO:teuthology.orchestra.run.smithi082.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-11-28T12:56:11.104 INFO:teuthology.orchestra.run.smithi082.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-11-28T12:56:11.104 INFO:teuthology.orchestra.run.smithi114.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-11-28T12:56:11.110 INFO:teuthology.orchestra.run.smithi114.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-11-28T12:56:11.135 INFO:teuthology.orchestra.run.smithi114.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-11-28T12:56:11.143 INFO:teuthology.orchestra.run.smithi114.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-11-28T12:56:11.308 INFO:teuthology.orchestra.run.smithi114.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-11-28T12:56:11.371 INFO:teuthology.orchestra.run.smithi082.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-11-28T12:56:11.417 INFO:teuthology.orchestra.run.smithi082.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-11-28T12:56:11.419 INFO:teuthology.orchestra.run.smithi082.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-11-28T12:56:11.449 INFO:teuthology.orchestra.run.smithi114.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-2697-g2f5f6028-1focal [103 kB] 2023-11-28T12:56:11.454 INFO:teuthology.orchestra.run.smithi114.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-2697-g2f5f6028-1focal [468 kB] 2023-11-28T12:56:11.457 INFO:teuthology.orchestra.run.smithi082.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-11-28T12:56:11.457 INFO:teuthology.orchestra.run.smithi082.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-11-28T12:56:11.457 INFO:teuthology.orchestra.run.smithi082.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-11-28T12:56:11.463 INFO:teuthology.orchestra.run.smithi082.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-11-28T12:56:11.463 INFO:teuthology.orchestra.run.smithi082.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-11-28T12:56:11.467 INFO:teuthology.orchestra.run.smithi082.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-11-28T12:56:11.467 INFO:teuthology.orchestra.run.smithi082.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-11-28T12:56:11.482 INFO:teuthology.orchestra.run.smithi082.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-11-28T12:56:11.483 INFO:teuthology.orchestra.run.smithi082.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-11-28T12:56:11.510 INFO:teuthology.orchestra.run.smithi114.stdout:Get:24 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-2697-g2f5f6028-1focal [25.0 MB] 2023-11-28T12:56:11.519 INFO:teuthology.orchestra.run.smithi082.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-11-28T12:56:11.525 INFO:teuthology.orchestra.run.smithi082.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-11-28T12:56:11.530 INFO:teuthology.orchestra.run.smithi082.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-11-28T12:56:11.534 INFO:teuthology.orchestra.run.smithi082.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-11-28T12:56:11.534 INFO:teuthology.orchestra.run.smithi082.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-11-28T12:56:11.537 INFO:teuthology.orchestra.run.smithi082.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-11-28T12:56:11.539 INFO:teuthology.orchestra.run.smithi082.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-11-28T12:56:11.539 INFO:teuthology.orchestra.run.smithi082.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-11-28T12:56:11.586 INFO:teuthology.orchestra.run.smithi082.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-11-28T12:56:11.590 INFO:teuthology.orchestra.run.smithi082.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-11-28T12:56:11.625 INFO:teuthology.orchestra.run.smithi082.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-11-28T12:56:11.674 INFO:teuthology.orchestra.run.smithi114.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-11-28T12:56:11.693 INFO:teuthology.orchestra.run.smithi114.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-11-28T12:56:11.769 INFO:teuthology.orchestra.run.smithi082.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-11-28T12:56:11.770 INFO:teuthology.orchestra.run.smithi082.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-11-28T12:56:11.771 INFO:teuthology.orchestra.run.smithi082.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-11-28T12:56:11.771 INFO:teuthology.orchestra.run.smithi082.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-11-28T12:56:11.797 INFO:teuthology.orchestra.run.smithi082.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T12:56:11.800 INFO:teuthology.orchestra.run.smithi082.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-11-28T12:56:11.802 INFO:teuthology.orchestra.run.smithi082.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-11-28T12:56:11.803 INFO:teuthology.orchestra.run.smithi082.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-11-28T12:56:11.803 INFO:teuthology.orchestra.run.smithi082.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-11-28T12:56:11.870 INFO:teuthology.orchestra.run.smithi114.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-11-28T12:56:11.879 INFO:teuthology.orchestra.run.smithi114.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-11-28T12:56:11.912 INFO:teuthology.orchestra.run.smithi114.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-11-28T12:56:11.918 INFO:teuthology.orchestra.run.smithi114.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-11-28T12:56:11.922 INFO:teuthology.orchestra.run.smithi114.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-11-28T12:56:11.923 INFO:teuthology.orchestra.run.smithi114.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-11-28T12:56:11.933 INFO:teuthology.orchestra.run.smithi114.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T12:56:11.937 INFO:teuthology.orchestra.run.smithi114.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-11-28T12:56:12.102 INFO:teuthology.orchestra.run.smithi114.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-11-28T12:56:12.146 INFO:teuthology.orchestra.run.smithi082.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-2697-g2f5f6028-1focal [3,982 kB] 2023-11-28T12:56:12.422 INFO:teuthology.orchestra.run.smithi114.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-11-28T12:56:12.446 INFO:teuthology.orchestra.run.smithi114.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-11-28T12:56:12.553 INFO:teuthology.orchestra.run.smithi114.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-11-28T12:56:12.555 INFO:teuthology.orchestra.run.smithi114.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-2697-g2f5f6028-1focal [10.9 MB] 2023-11-28T12:56:12.580 INFO:teuthology.orchestra.run.smithi114.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-11-28T12:56:12.589 INFO:teuthology.orchestra.run.smithi114.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-11-28T12:56:12.710 INFO:teuthology.orchestra.run.smithi114.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-11-28T12:56:12.711 INFO:teuthology.orchestra.run.smithi114.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-11-28T12:56:12.714 INFO:teuthology.orchestra.run.smithi114.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-11-28T12:56:12.718 INFO:teuthology.orchestra.run.smithi114.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-11-28T12:56:12.730 INFO:teuthology.orchestra.run.smithi114.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-11-28T12:56:12.895 INFO:teuthology.orchestra.run.smithi114.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-2697-g2f5f6028-1focal [221 kB] 2023-11-28T12:56:12.901 INFO:teuthology.orchestra.run.smithi114.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-2697-g2f5f6028-1focal [133 kB] 2023-11-28T12:56:12.916 INFO:teuthology.orchestra.run.smithi114.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-11-28T12:56:12.922 INFO:teuthology.orchestra.run.smithi114.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-2697-g2f5f6028-1focal [1,547 kB] 2023-11-28T12:56:12.989 INFO:teuthology.orchestra.run.smithi114.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-2697-g2f5f6028-1focal [9,378 kB] 2023-11-28T12:56:13.353 INFO:teuthology.orchestra.run.smithi114.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-11-28T12:56:13.365 INFO:teuthology.orchestra.run.smithi114.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-11-28T12:56:13.409 INFO:teuthology.orchestra.run.smithi114.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-11-28T12:56:13.455 INFO:teuthology.orchestra.run.smithi114.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-11-28T12:56:13.463 INFO:teuthology.orchestra.run.smithi114.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-11-28T12:56:13.468 INFO:teuthology.orchestra.run.smithi114.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-11-28T12:56:13.478 INFO:teuthology.orchestra.run.smithi114.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-11-28T12:56:13.484 INFO:teuthology.orchestra.run.smithi114.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-11-28T12:56:13.501 INFO:teuthology.orchestra.run.smithi114.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-11-28T12:56:13.501 INFO:teuthology.orchestra.run.smithi114.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-11-28T12:56:13.573 INFO:teuthology.orchestra.run.smithi114.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-2697-g2f5f6028-1focal [31.3 MB] 2023-11-28T12:56:13.671 INFO:teuthology.orchestra.run.smithi114.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-11-28T12:56:14.085 INFO:teuthology.orchestra.run.smithi114.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T12:56:14.089 INFO:teuthology.orchestra.run.smithi114.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-11-28T12:56:14.124 INFO:teuthology.orchestra.run.smithi114.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-11-28T12:56:14.173 INFO:teuthology.orchestra.run.smithi114.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-11-28T12:56:14.204 INFO:teuthology.orchestra.run.smithi114.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-11-28T12:56:14.207 INFO:teuthology.orchestra.run.smithi114.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-11-28T12:56:14.218 INFO:teuthology.orchestra.run.smithi114.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-11-28T12:56:14.699 INFO:teuthology.orchestra.run.smithi114.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-11-28T12:56:14.754 INFO:teuthology.orchestra.run.smithi114.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-11-28T12:56:14.757 INFO:teuthology.orchestra.run.smithi114.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-11-28T12:56:14.961 INFO:teuthology.orchestra.run.smithi114.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-11-28T12:56:15.045 INFO:teuthology.orchestra.run.smithi114.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-11-28T12:56:15.187 INFO:teuthology.orchestra.run.smithi114.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-11-28T12:56:15.241 INFO:teuthology.orchestra.run.smithi114.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-11-28T12:56:15.267 INFO:teuthology.orchestra.run.smithi114.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-11-28T12:56:15.307 INFO:teuthology.orchestra.run.smithi114.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-11-28T12:56:15.320 INFO:teuthology.orchestra.run.smithi114.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-11-28T12:56:15.369 INFO:teuthology.orchestra.run.smithi114.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-11-28T12:56:15.376 INFO:teuthology.orchestra.run.smithi114.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-11-28T12:56:15.390 INFO:teuthology.orchestra.run.smithi114.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-11-28T12:56:15.470 INFO:teuthology.orchestra.run.smithi114.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-11-28T12:56:15.660 INFO:teuthology.orchestra.run.smithi114.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-11-28T12:56:15.888 INFO:teuthology.orchestra.run.smithi114.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-2697-g2f5f6028-1focal [3,812 B] 2023-11-28T12:56:15.922 INFO:teuthology.orchestra.run.smithi114.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-2697-g2f5f6028-1focal [831 kB] 2023-11-28T12:56:15.938 INFO:teuthology.orchestra.run.smithi114.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-2697-g2f5f6028-1focal [2,284 kB] 2023-11-28T12:56:15.954 INFO:teuthology.orchestra.run.smithi114.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-2697-g2f5f6028-1focal [96.8 kB] 2023-11-28T12:56:15.955 INFO:teuthology.orchestra.run.smithi114.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-2697-g2f5f6028-1focal [117 kB] 2023-11-28T12:56:15.956 INFO:teuthology.orchestra.run.smithi114.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-2697-g2f5f6028-1focal [1,795 kB] 2023-11-28T12:56:15.982 INFO:teuthology.orchestra.run.smithi114.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-2697-g2f5f6028-1focal [7,878 kB] 2023-11-28T12:56:16.023 INFO:teuthology.orchestra.run.smithi114.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-11-28T12:56:16.048 INFO:teuthology.orchestra.run.smithi114.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-11-28T12:56:16.200 INFO:teuthology.orchestra.run.smithi114.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-11-28T12:56:16.255 INFO:teuthology.orchestra.run.smithi114.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-11-28T12:56:16.259 INFO:teuthology.orchestra.run.smithi114.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-11-28T12:56:16.301 INFO:teuthology.orchestra.run.smithi114.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-2697-g2f5f6028-1focal [3,936 B] 2023-11-28T12:56:16.301 INFO:teuthology.orchestra.run.smithi114.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-2697-g2f5f6028-1focal [49.9 MB] 2023-11-28T12:56:16.428 INFO:teuthology.orchestra.run.smithi114.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-11-28T12:56:16.438 INFO:teuthology.orchestra.run.smithi114.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-11-28T12:56:16.446 INFO:teuthology.orchestra.run.smithi114.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-11-28T12:56:16.602 INFO:teuthology.orchestra.run.smithi114.stdout:Get:103 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-11-28T12:56:16.603 INFO:teuthology.orchestra.run.smithi114.stdout:Get:104 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-11-28T12:56:16.713 INFO:teuthology.orchestra.run.smithi082.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-2697-g2f5f6028-1focal [721 kB] 2023-11-28T12:56:16.767 INFO:teuthology.orchestra.run.smithi114.stdout:Get:105 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-11-28T12:56:17.075 INFO:teuthology.orchestra.run.smithi082.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-2697-g2f5f6028-1focal [376 kB] 2023-11-28T12:56:17.097 INFO:teuthology.orchestra.run.smithi114.stdout:Get:106 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-11-28T12:56:17.299 INFO:teuthology.orchestra.run.smithi082.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-2697-g2f5f6028-1focal [22.4 kB] 2023-11-28T12:56:17.301 INFO:teuthology.orchestra.run.smithi082.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-2697-g2f5f6028-1focal [184 kB] 2023-11-28T12:56:17.409 INFO:teuthology.orchestra.run.smithi082.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-2697-g2f5f6028-1focal [47.7 kB] 2023-11-28T12:56:17.463 INFO:teuthology.orchestra.run.smithi114.stdout:Get:107 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T12:56:17.467 INFO:teuthology.orchestra.run.smithi114.stdout:Get:108 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-11-28T12:56:17.472 INFO:teuthology.orchestra.run.smithi082.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-2697-g2f5f6028-1focal [353 kB] 2023-11-28T12:56:17.478 INFO:teuthology.orchestra.run.smithi114.stdout:Get:109 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-11-28T12:56:17.479 INFO:teuthology.orchestra.run.smithi114.stdout:Get:110 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-11-28T12:56:17.486 INFO:teuthology.orchestra.run.smithi114.stdout:Get:111 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-11-28T12:56:17.706 INFO:teuthology.orchestra.run.smithi082.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-2697-g2f5f6028-1focal [6,529 kB] 2023-11-28T12:56:18.854 INFO:teuthology.orchestra.run.smithi114.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-2697-g2f5f6028-1focal [225 kB] 2023-11-28T12:56:18.857 INFO:teuthology.orchestra.run.smithi114.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-2697-g2f5f6028-1focal [253 kB] 2023-11-28T12:56:18.862 INFO:teuthology.orchestra.run.smithi114.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-2697-g2f5f6028-1focal [23.3 kB] 2023-11-28T12:56:18.918 INFO:teuthology.orchestra.run.smithi114.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-2697-g2f5f6028-1focal [13.0 kB] 2023-11-28T12:56:18.919 INFO:teuthology.orchestra.run.smithi114.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-2697-g2f5f6028-1focal [27.4 kB] 2023-11-28T12:56:18.920 INFO:teuthology.orchestra.run.smithi114.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-2697-g2f5f6028-1focal [13.3 MB] 2023-11-28T12:56:19.354 INFO:teuthology.orchestra.run.smithi114.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-2697-g2f5f6028-1focal [97.4 kB] 2023-11-28T12:56:19.985 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 207 MB in 9s (22.7 MB/s) 2023-11-28T12:56:20.135 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T12:56:20.190 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141728 files and directories currently installed.) 2023-11-28T12:56:20.194 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-11-28T12:56:20.258 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-11-28T12:56:20.588 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T12:56:20.604 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-11-28T12:56:20.646 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-28T12:56:20.819 INFO:teuthology.orchestra.run.smithi082.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-2697-g2f5f6028-1focal [103 kB] 2023-11-28T12:56:20.826 INFO:teuthology.orchestra.run.smithi082.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-2697-g2f5f6028-1focal [468 kB] 2023-11-28T12:56:20.949 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T12:56:20.967 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-11-28T12:56:20.975 INFO:teuthology.orchestra.run.smithi082.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-2697-g2f5f6028-1focal [25.0 MB] 2023-11-28T12:56:20.999 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-11-28T12:56:21.343 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-11-28T12:56:21.360 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-11-28T12:56:21.444 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-28T12:56:21.848 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T12:56:21.866 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-11-28T12:56:21.906 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-28T12:56:22.234 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T12:56:22.254 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-11-28T12:56:22.292 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-28T12:56:22.784 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T12:56:22.803 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-28T12:56:22.856 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T12:56:23.423 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T12:56:23.440 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-28T12:56:23.490 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T12:56:23.828 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T12:56:23.847 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-28T12:56:23.877 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T12:56:24.297 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-11-28T12:56:24.312 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-11-28T12:56:24.355 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-28T12:56:24.735 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../010-librbd1_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:24.859 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librbd1 (18.0.0-2697-g2f5f6028-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-28T12:56:25.322 INFO:teuthology.orchestra.run.smithi082.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-2697-g2f5f6028-1focal [10.9 MB] 2023-11-28T12:56:25.564 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../011-librados2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:25.722 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librados2 (18.0.0-2697-g2f5f6028-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-28T12:56:26.471 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T12:56:26.487 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:26.526 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libcephfs2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:26.592 INFO:teuthology.orchestra.run.smithi082.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-2697-g2f5f6028-1focal [221 kB] 2023-11-28T12:56:26.596 INFO:teuthology.orchestra.run.smithi082.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-2697-g2f5f6028-1focal [133 kB] 2023-11-28T12:56:26.599 INFO:teuthology.orchestra.run.smithi082.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-2697-g2f5f6028-1focal [1,547 kB] 2023-11-28T12:56:26.740 INFO:teuthology.orchestra.run.smithi082.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-2697-g2f5f6028-1focal [9,378 kB] 2023-11-28T12:56:26.853 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rados. 2023-11-28T12:56:26.871 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../013-python3-rados_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:26.903 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rados (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:27.298 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T12:56:27.316 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T12:56:27.356 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-ceph-argparse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:27.642 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T12:56:27.659 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:27.700 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cephfs (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:27.730 INFO:teuthology.orchestra.run.smithi082.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-2697-g2f5f6028-1focal [31.3 MB] 2023-11-28T12:56:28.286 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T12:56:28.304 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T12:56:28.336 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:28.648 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T12:56:28.665 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-11-28T12:56:28.706 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-11-28T12:56:28.984 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T12:56:29.000 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:29.042 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rbd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:29.403 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-11-28T12:56:29.422 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-11-28T12:56:29.461 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-28T12:56:29.789 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-11-28T12:56:29.807 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-11-28T12:56:29.873 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-11-28T12:56:30.226 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T12:56:30.243 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-11-28T12:56:30.284 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-28T12:56:30.653 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librgw2. 2023-11-28T12:56:30.671 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../022-librgw2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:30.711 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librgw2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:31.573 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T12:56:31.589 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:31.622 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:31.975 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liboath0. 2023-11-28T12:56:31.992 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-11-28T12:56:32.033 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-11-28T12:56:32.319 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T12:56:32.336 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:32.386 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libradosstriper1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:32.881 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-common. 2023-11-28T12:56:32.884 INFO:teuthology.orchestra.run.smithi082.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-2697-g2f5f6028-1focal [3,812 B] 2023-11-28T12:56:32.885 INFO:teuthology.orchestra.run.smithi082.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-2697-g2f5f6028-1focal [831 kB] 2023-11-28T12:56:32.899 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../026-ceph-common_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:32.909 INFO:teuthology.orchestra.run.smithi082.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-2697-g2f5f6028-1focal [2,284 kB] 2023-11-28T12:56:32.939 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:33.160 INFO:teuthology.orchestra.run.smithi082.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-2697-g2f5f6028-1focal [96.8 kB] 2023-11-28T12:56:33.163 INFO:teuthology.orchestra.run.smithi082.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-2697-g2f5f6028-1focal [117 kB] 2023-11-28T12:56:33.177 INFO:teuthology.orchestra.run.smithi082.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-2697-g2f5f6028-1focal [1,795 kB] 2023-11-28T12:56:33.377 INFO:teuthology.orchestra.run.smithi082.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-2697-g2f5f6028-1focal [7,878 kB] 2023-11-28T12:56:34.250 INFO:teuthology.orchestra.run.smithi082.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-2697-g2f5f6028-1focal [3,936 B] 2023-11-28T12:56:34.258 INFO:teuthology.orchestra.run.smithi082.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-2697-g2f5f6028-1focal [49.9 MB] 2023-11-28T12:56:35.478 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-base. 2023-11-28T12:56:35.495 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../027-ceph-base_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:35.546 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-base (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:37.016 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T12:56:37.032 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-11-28T12:56:37.074 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-11-28T12:56:37.419 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T12:56:37.436 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-11-28T12:56:37.477 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-11-28T12:56:37.872 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T12:56:37.891 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-11-28T12:56:37.930 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-11-28T12:56:38.258 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T12:56:38.278 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-11-28T12:56:38.341 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-11-28T12:56:38.644 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-mako. 2023-11-28T12:56:38.660 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-11-28T12:56:38.694 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-28T12:56:39.014 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T12:56:39.029 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T12:56:39.064 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T12:56:39.358 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T12:56:39.374 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-11-28T12:56:39.416 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-11-28T12:56:39.744 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-webob. 2023-11-28T12:56:39.760 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-11-28T12:56:39.819 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-11-28T12:56:40.164 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-soupsieve. 2023-11-28T12:56:40.180 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-11-28T12:56:40.222 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-28T12:56:40.382 INFO:teuthology.orchestra.run.smithi082.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-2697-g2f5f6028-1focal [225 kB] 2023-11-28T12:56:40.386 INFO:teuthology.orchestra.run.smithi082.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-2697-g2f5f6028-1focal [253 kB] 2023-11-28T12:56:40.391 INFO:teuthology.orchestra.run.smithi082.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-2697-g2f5f6028-1focal [23.3 kB] 2023-11-28T12:56:40.392 INFO:teuthology.orchestra.run.smithi082.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-2697-g2f5f6028-1focal [13.0 kB] 2023-11-28T12:56:40.392 INFO:teuthology.orchestra.run.smithi082.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-2697-g2f5f6028-1focal [27.4 kB] 2023-11-28T12:56:40.393 INFO:teuthology.orchestra.run.smithi082.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-2697-g2f5f6028-1focal [13.3 MB] 2023-11-28T12:56:40.550 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-bs4. 2023-11-28T12:56:40.565 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-11-28T12:56:40.608 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-11-28T12:56:40.978 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T12:56:40.998 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-11-28T12:56:41.065 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-28T12:56:41.423 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T12:56:41.440 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-11-28T12:56:41.481 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-11-28T12:56:41.563 INFO:teuthology.orchestra.run.smithi082.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-2697-g2f5f6028-1focal [97.4 kB] 2023-11-28T12:56:41.801 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-paste. 2023-11-28T12:56:41.819 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-11-28T12:56:41.858 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-11-28T12:56:42.191 INFO:teuthology.orchestra.run.smithi082.stdout:Fetched 207 MB in 31s (6,592 kB/s) 2023-11-28T12:56:42.279 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T12:56:42.279 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-11-28T12:56:42.279 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-11-28T12:56:42.331 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T12:56:42.387 INFO:teuthology.orchestra.run.smithi082.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141728 files and directories currently installed.) 2023-11-28T12:56:42.391 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-11-28T12:56:42.430 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-11-28T12:56:42.623 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T12:56:42.638 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-11-28T12:56:42.697 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-11-28T12:56:43.025 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T12:56:43.041 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-11-28T12:56:43.084 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-11-28T12:56:43.442 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T12:56:43.458 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-11-28T12:56:43.500 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-28T12:56:43.737 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T12:56:43.755 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-11-28T12:56:43.819 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T12:56:43.839 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-11-28T12:56:43.878 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-11-28T12:56:44.212 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-11-28T12:56:44.214 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-11-28T12:56:44.231 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-11-28T12:56:44.297 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-28T12:56:44.567 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T12:56:44.586 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-11-28T12:56:44.618 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T12:56:44.634 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-11-28T12:56:44.658 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-28T12:56:44.668 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-28T12:56:44.978 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T12:56:44.998 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T12:56:45.027 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-modules-core (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:45.029 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T12:56:45.048 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-11-28T12:56:45.088 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-28T12:56:45.449 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T12:56:45.468 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:45.507 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:45.608 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T12:56:45.625 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-28T12:56:45.676 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T12:56:45.868 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cryptography. 2023-11-28T12:56:45.885 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-11-28T12:56:45.960 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-28T12:56:46.169 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T12:56:46.185 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-28T12:56:46.227 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T12:56:46.364 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T12:56:46.380 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-11-28T12:56:46.422 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-11-28T12:56:46.614 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T12:56:46.632 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-28T12:56:46.672 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T12:56:46.775 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T12:56:46.792 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:46.833 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:47.026 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-11-28T12:56:47.042 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-11-28T12:56:47.083 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-28T12:56:47.345 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T12:56:47.361 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:47.403 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mon (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:47.473 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../010-librbd1_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:47.596 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librbd1 (18.0.0-2697-g2f5f6028-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-28T12:56:48.283 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../011-librados2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:48.434 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librados2 (18.0.0-2697-g2f5f6028-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-28T12:56:48.798 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T12:56:48.818 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:48.856 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-osd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:49.155 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T12:56:49.173 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:49.213 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libcephfs2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:49.541 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-rados. 2023-11-28T12:56:49.557 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../013-python3-rados_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:49.624 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-rados (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:49.985 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T12:56:50.001 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T12:56:50.043 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-ceph-argparse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:50.312 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T12:56:50.329 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:50.370 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cephfs (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:50.707 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T12:56:50.722 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T12:56:50.765 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:51.102 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T12:56:51.122 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-11-28T12:56:51.160 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-11-28T12:56:51.438 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T12:56:51.456 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:51.496 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-rbd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:51.824 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-11-28T12:56:51.843 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-11-28T12:56:51.882 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-28T12:56:51.952 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph. 2023-11-28T12:56:51.970 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../053-ceph_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:52.003 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:52.260 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-11-28T12:56:52.277 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-11-28T12:56:52.278 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T12:56:52.298 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:52.318 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-11-28T12:56:52.352 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:52.672 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T12:56:52.689 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-11-28T12:56:52.730 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-28T12:56:52.765 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T12:56:52.783 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:52.824 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mds (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:53.074 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package librgw2. 2023-11-28T12:56:53.090 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../022-librgw2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:53.132 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librgw2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:53.368 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephadm. 2023-11-28T12:56:53.385 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../056-cephadm_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:53.426 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:53.721 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T12:56:53.739 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-11-28T12:56:53.771 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-11-28T12:56:53.993 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T12:56:54.011 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:54.051 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-rgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:54.165 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T12:56:54.181 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-11-28T12:56:54.223 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-11-28T12:56:54.438 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package liboath0. 2023-11-28T12:56:54.453 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-11-28T12:56:54.496 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-11-28T12:56:54.626 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T12:56:54.642 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T12:56:54.684 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:54.815 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T12:56:54.832 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:54.873 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libradosstriper1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:55.021 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T12:56:55.039 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-11-28T12:56:55.079 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-28T12:56:55.352 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-common. 2023-11-28T12:56:55.369 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../026-ceph-common_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jwt. 2023-11-28T12:56:55.410 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:55.424 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-11-28T12:56:55.465 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-28T12:56:55.810 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-attr. 2023-11-28T12:56:55.825 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2023-11-28T12:56:55.893 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-11-28T12:56:56.271 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T12:56:56.288 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2023-11-28T12:56:56.329 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-11-28T12:56:56.657 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-py. 2023-11-28T12:56:56.675 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-11-28T12:56:56.715 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-11-28T12:56:57.043 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-atomicwrites. 2023-11-28T12:56:57.062 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-11-28T12:56:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-11-28T12:56:57.437 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-packaging. 2023-11-28T12:56:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2023-11-28T12:56:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-packaging (20.3-1) ... 2023-11-28T12:56:57.840 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T12:56:57.859 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2023-11-28T12:56:57.865 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-base. 2023-11-28T12:56:57.882 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../027-ceph-base_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:56:57.898 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-11-28T12:56:57.934 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-base (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:56:58.268 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T12:56:58.284 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T12:56:58.326 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T12:56:58.604 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libjs-underscore. 2023-11-28T12:56:58.620 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-11-28T12:56:58.662 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-28T12:56:58.956 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-11-28T12:56:58.975 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-11-28T12:56:59.014 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-28T12:56:59.409 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-routes. 2023-11-28T12:56:59.427 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2023-11-28T12:56:59.467 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-11-28T12:56:59.604 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T12:56:59.623 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-11-28T12:56:59.654 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-11-28T12:57:00.033 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T12:57:00.051 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-11-28T12:57:00.091 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-11-28T12:57:00.146 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T12:57:00.161 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T12:57:00.228 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-dashboard (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:00.410 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T12:57:00.428 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-11-28T12:57:00.468 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-11-28T12:57:00.757 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-decorator. 2023-11-28T12:57:00.773 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-11-28T12:57:00.788 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T12:57:00.807 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-11-28T12:57:00.840 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-11-28T12:57:00.846 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-11-28T12:57:01.166 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-mako. 2023-11-28T12:57:01.176 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-11-28T12:57:01.181 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-11-28T12:57:01.195 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-11-28T12:57:01.224 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-28T12:57:01.234 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-28T12:57:01.535 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T12:57:01.557 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T12:57:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-scipy. 2023-11-28T12:57:01.582 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-11-28T12:57:01.593 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T12:57:01.620 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-11-28T12:57:01.930 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T12:57:01.946 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-11-28T12:57:01.988 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-11-28T12:57:02.324 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-webob. 2023-11-28T12:57:02.340 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-11-28T12:57:02.382 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-11-28T12:57:02.710 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-soupsieve. 2023-11-28T12:57:02.726 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-11-28T12:57:02.769 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-28T12:57:02.976 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-11-28T12:57:02.993 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-11-28T12:57:03.035 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-28T12:57:03.080 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-bs4. 2023-11-28T12:57:03.099 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-11-28T12:57:03.138 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-11-28T12:57:03.516 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T12:57:03.533 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-11-28T12:57:03.577 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-28T12:57:03.598 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T12:57:03.613 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2023-11-28T12:57:03.655 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-11-28T12:57:03.911 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T12:57:03.931 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-11-28T12:57:03.969 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-11-28T12:57:04.058 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T12:57:04.078 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-11-28T12:57:04.116 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-28T12:57:04.305 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-paste. 2023-11-28T12:57:04.322 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-11-28T12:57:04.363 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-11-28T12:57:04.700 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T12:57:04.717 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-11-28T12:57:04.758 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-11-28T12:57:04.819 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T12:57:04.839 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T12:57:04.868 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:05.061 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T12:57:05.077 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-11-28T12:57:05.119 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-11-28T12:57:05.439 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T12:57:05.458 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-11-28T12:57:05.497 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-11-28T12:57:05.792 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T12:57:05.811 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-11-28T12:57:05.850 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-11-28T12:57:06.047 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T12:57:06.066 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2023-11-28T12:57:06.121 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-11-28T12:57:06.213 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T12:57:06.231 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-11-28T12:57:06.271 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-28T12:57:06.530 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T12:57:06.546 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-11-28T12:57:06.588 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-11-28T12:57:06.599 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T12:57:06.617 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T12:57:06.658 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-modules-core (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:06.993 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T12:57:07.012 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-11-28T12:57:07.029 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T12:57:07.048 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:57:07.050 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-28T12:57:07.104 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:07.386 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T12:57:07.402 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2023-11-28T12:57:07.440 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cryptography. 2023-11-28T12:57:07.444 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rsa (4.0-3) ... 2023-11-28T12:57:07.460 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-11-28T12:57:07.498 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-28T12:57:07.806 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T12:57:07.822 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2023-11-28T12:57:07.864 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-11-28T12:57:07.894 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T12:57:07.910 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-11-28T12:57:07.952 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-11-28T12:57:08.217 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-blinker. 2023-11-28T12:57:08.233 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-11-28T12:57:08.301 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-28T12:57:08.330 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T12:57:08.348 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:57:08.388 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:08.629 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-oauthlib. 2023-11-28T12:57:08.645 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-11-28T12:57:08.687 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-28T12:57:08.892 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T12:57:08.909 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:57:08.950 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mon (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:09.049 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T12:57:09.068 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-11-28T12:57:09.107 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-28T12:57:09.427 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T12:57:09.447 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-11-28T12:57:09.485 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-11-28T12:57:09.822 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T12:57:09.838 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-11-28T12:57:09.896 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-11-28T12:57:10.195 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T12:57:10.215 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:57:10.245 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-osd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:10.518 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T12:57:10.535 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T12:57:10.576 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:10.904 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T12:57:10.921 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2023-11-28T12:57:10.962 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-11-28T12:57:11.332 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T12:57:11.351 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-28T12:57:11.390 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-28T12:57:11.684 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package jq. 2023-11-28T12:57:11.701 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-28T12:57:11.770 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-11-28T12:57:12.037 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package socat. 2023-11-28T12:57:12.055 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2023-11-28T12:57:12.120 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking socat (1.7.3.3-2) ... 2023-11-28T12:57:12.457 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T12:57:12.475 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-11-28T12:57:12.506 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-11-28T12:57:12.886 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-test. 2023-11-28T12:57:12.902 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../096-ceph-test_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:57:12.944 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-test (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:13.347 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph. 2023-11-28T12:57:13.365 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../053-ceph_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:57:13.405 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:13.733 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T12:57:13.749 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:57:13.791 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:14.219 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T12:57:14.235 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:57:14.319 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mds (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:14.831 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package cephadm. 2023-11-28T12:57:14.846 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../056-cephadm_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:57:14.889 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:15.227 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T12:57:15.247 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-11-28T12:57:15.285 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-11-28T12:57:15.705 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T12:57:15.721 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-11-28T12:57:15.763 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-11-28T12:57:16.082 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T12:57:16.098 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T12:57:16.141 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:16.502 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T12:57:16.518 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-11-28T12:57:16.561 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-28T12:57:16.888 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-jwt. 2023-11-28T12:57:16.905 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-11-28T12:57:16.946 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-28T12:57:17.258 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-attr. 2023-11-28T12:57:17.274 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2023-11-28T12:57:17.316 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-11-28T12:57:17.441 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T12:57:17.458 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../097-ceph-volume_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T12:57:17.499 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-volume (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:17.652 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T12:57:17.668 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2023-11-28T12:57:17.710 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-11-28T12:57:17.870 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T12:57:17.888 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../098-cephfs-mirror_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:57:17.928 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephfs-mirror (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:18.055 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-py. 2023-11-28T12:57:18.075 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-11-28T12:57:18.113 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-11-28T12:57:18.264 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T12:57:18.283 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2023-11-28T12:57:18.322 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-11-28T12:57:18.441 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-atomicwrites. 2023-11-28T12:57:18.458 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-11-28T12:57:18.508 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-11-28T12:57:18.608 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T12:57:18.625 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../100-cephfs-shell_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T12:57:18.666 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephfs-shell (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:18.836 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-packaging. 2023-11-28T12:57:18.855 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2023-11-28T12:57:18.894 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-packaging (20.3-1) ... 2023-11-28T12:57:18.969 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T12:57:18.985 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../101-cephfs-top_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T12:57:19.027 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephfs-top (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:19.222 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T12:57:19.238 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2023-11-28T12:57:19.280 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-11-28T12:57:19.305 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package fonts-mathjax. 2023-11-28T12:57:19.323 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-28T12:57:19.363 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-28T12:57:19.600 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T12:57:19.620 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T12:57:19.658 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T12:57:19.883 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T12:57:19.900 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../103-libcephfs-dev_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:57:19.933 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libcephfs-dev (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:19.935 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libjs-underscore. 2023-11-28T12:57:19.953 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-11-28T12:57:19.994 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-28T12:57:20.254 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-11-28T12:57:20.273 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-11-28T12:57:20.313 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-28T12:57:20.378 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T12:57:20.396 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-11-28T12:57:20.478 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-11-28T12:57:20.641 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-routes. 2023-11-28T12:57:20.660 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2023-11-28T12:57:20.698 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-11-28T12:57:20.824 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T12:57:20.844 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-11-28T12:57:20.882 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-11-28T12:57:21.052 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T12:57:21.071 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T12:57:21.110 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-dashboard (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:21.268 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libjs-mathjax. 2023-11-28T12:57:21.286 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-28T12:57:21.318 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-28T12:57:21.580 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-decorator. 2023-11-28T12:57:21.597 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-11-28T12:57:21.654 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-11-28T12:57:21.957 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-11-28T12:57:21.974 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-11-28T12:57:22.015 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-28T12:57:22.360 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-scipy. 2023-11-28T12:57:22.377 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-11-28T12:57:22.418 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-11-28T12:57:23.081 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python-natsort-doc. 2023-11-28T12:57:23.102 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2023-11-28T12:57:23.139 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-11-28T12:57:23.492 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-webencodings. 2023-11-28T12:57:23.510 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-11-28T12:57:23.551 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-28T12:57:23.761 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-11-28T12:57:23.779 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-11-28T12:57:23.818 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-28T12:57:23.888 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-html5lib. 2023-11-28T12:57:23.903 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2023-11-28T12:57:23.970 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-11-28T12:57:24.339 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-11-28T12:57:24.357 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-11-28T12:57:24.397 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-28T12:57:24.404 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T12:57:24.421 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2023-11-28T12:57:24.462 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-11-28T12:57:24.874 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T12:57:24.890 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-11-28T12:57:24.892 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T12:57:24.909 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T12:57:24.932 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-28T12:57:24.975 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T12:57:25.320 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T12:57:25.338 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-11-28T12:57:25.378 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-11-28T12:57:25.607 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T12:57:25.623 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T12:57:25.665 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:25.723 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T12:57:25.743 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-11-28T12:57:25.781 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-28T12:57:26.142 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T12:57:26.159 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-11-28T12:57:26.225 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-28T12:57:26.573 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T12:57:26.592 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-11-28T12:57:26.630 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-28T12:57:26.801 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T12:57:26.818 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2023-11-28T12:57:26.859 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-11-28T12:57:27.290 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T12:57:27.306 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-11-28T12:57:27.348 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-11-28T12:57:27.359 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package radosgw. 2023-11-28T12:57:27.378 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../116-radosgw_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:57:27.417 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking radosgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:27.715 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T12:57:27.733 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-11-28T12:57:27.773 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-28T12:57:28.068 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T12:57:28.088 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2023-11-28T12:57:28.126 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-rsa (4.0-3) ... 2023-11-28T12:57:28.471 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T12:57:28.489 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2023-11-28T12:57:28.528 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-11-28T12:57:28.799 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T12:57:28.817 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:57:28.882 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-blinker. 2023-11-28T12:57:28.890 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking rbd-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:28.898 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-11-28T12:57:28.940 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-28T12:57:29.212 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-attr (19.3.0-2) ... 2023-11-28T12:57:29.251 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-oauthlib. 2023-11-28T12:57:29.271 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-11-28T12:57:29.309 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-28T12:57:29.520 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-11-28T12:57:29.646 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-28T12:57:29.772 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-11-28T12:57:30.001 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:30.040 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T12:57:30.060 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-11-28T12:57:30.105 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-28T12:57:30.400 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T12:57:30.419 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-11-28T12:57:30.458 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-11-28T12:57:30.786 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T12:57:30.804 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-11-28T12:57:30.844 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-11-28T12:57:31.072 INFO:teuthology.orchestra.run.smithi114.stdout:Adding system user cephadm....done 2023-11-28T12:57:31.248 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-28T12:57:31.366 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T12:57:31.374 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-28T12:57:31.385 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T12:57:31.424 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:31.717 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T12:57:31.735 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T12:57:31.752 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2023-11-28T12:57:31.793 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-11-28T12:57:32.044 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-28T12:57:32.163 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T12:57:32.179 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-28T12:57:32.194 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-11-28T12:57:32.221 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-28T12:57:32.304 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-11-28T12:57:32.491 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package jq. 2023-11-28T12:57:32.510 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-28T12:57:32.549 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-11-28T12:57:32.622 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-11-28T12:57:32.802 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package socat. 2023-11-28T12:57:32.819 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2023-11-28T12:57:32.860 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking socat (1.7.3.3-2) ... 2023-11-28T12:57:33.024 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-28T12:57:33.189 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T12:57:33.209 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-11-28T12:57:33.247 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-11-28T12:57:33.334 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-11-28T12:57:33.592 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-test. 2023-11-28T12:57:33.609 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../096-ceph-test_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:57:33.650 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-test (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:33.668 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-11-28T12:57:33.978 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-28T12:57:34.281 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-28T12:57:34.607 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-ceph-argparse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:34.900 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-28T12:57:35.034 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-11-28T12:57:35.343 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-11-28T12:57:35.654 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-28T12:57:35.965 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-28T12:57:36.097 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-11-28T12:57:36.490 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-11-28T12:57:36.774 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-11-28T12:57:37.050 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-28T12:57:37.401 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-11-28T12:57:37.686 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-11-28T12:57:37.955 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T12:57:37.971 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../097-ceph-volume_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T12:57:38.013 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-volume (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:38.020 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-11-28T12:57:38.313 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-packaging (20.3-1) ... 2023-11-28T12:57:38.352 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T12:57:38.368 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../098-cephfs-mirror_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:57:38.435 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking cephfs-mirror (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:38.614 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-11-28T12:57:38.740 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-28T12:57:38.771 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T12:57:38.787 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2023-11-28T12:57:38.829 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-11-28T12:57:38.891 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-28T12:57:39.098 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T12:57:39.115 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../100-cephfs-shell_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T12:57:39.156 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking cephfs-shell (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:39.192 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-11-28T12:57:39.417 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T12:57:39.437 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../101-cephfs-top_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T12:57:39.476 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking cephfs-top (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:39.585 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-11-28T12:57:39.753 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package fonts-mathjax. 2023-11-28T12:57:39.770 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-28T12:57:39.811 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-28T12:57:39.886 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-28T12:57:40.246 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-28T12:57:40.332 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T12:57:40.349 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../103-libcephfs-dev_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:57:40.390 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libcephfs-dev (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:40.606 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up socat (1.7.3.3-2) ... 2023-11-28T12:57:40.724 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:40.810 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T12:57:40.826 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-11-28T12:57:40.885 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-11-28T12:57:41.050 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T12:57:41.181 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T12:57:41.198 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-11-28T12:57:41.218 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-11-28T12:57:41.239 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-11-28T12:57:41.569 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-28T12:57:41.634 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libjs-mathjax. 2023-11-28T12:57:41.650 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-28T12:57:41.695 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-11-28T12:57:41.700 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-28T12:57:41.829 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-11-28T12:57:42.097 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-28T12:57:42.407 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T12:57:42.533 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-28T12:57:42.659 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-11-28T12:57:43.036 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-11-28T12:57:43.325 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-11-28T12:57:43.349 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python-natsort-doc. 2023-11-28T12:57:43.367 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2023-11-28T12:57:43.406 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-11-28T12:57:43.596 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-28T12:57:43.731 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T12:57:43.743 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-webencodings. 2023-11-28T12:57:43.759 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-11-28T12:57:43.828 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-28T12:57:44.024 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-11-28T12:57:44.112 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-html5lib. 2023-11-28T12:57:44.132 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2023-11-28T12:57:44.170 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-11-28T12:57:44.325 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-28T12:57:44.531 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-11-28T12:57:44.548 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-11-28T12:57:44.606 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-28T12:57:44.642 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-11-28T12:57:45.035 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-11-28T12:57:45.084 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T12:57:45.101 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T12:57:45.142 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T12:57:45.295 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-11-28T12:57:45.405 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-28T12:57:45.496 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T12:57:45.512 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-11-28T12:57:45.578 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-11-28T12:57:45.697 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-11-28T12:57:45.915 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T12:57:45.934 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-11-28T12:57:45.973 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-28T12:57:46.025 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-28T12:57:46.207 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-28T12:57:46.293 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T12:57:46.312 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-11-28T12:57:46.337 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-11-28T12:57:46.350 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-28T12:57:46.620 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T12:57:46.637 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-11-28T12:57:46.655 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-28T12:57:46.679 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-28T12:57:46.923 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-11-28T12:57:47.393 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package radosgw. 2023-11-28T12:57:47.410 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../116-radosgw_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:57:47.451 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking radosgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:48.370 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-28T12:57:48.505 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-11-28T12:57:48.840 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-11-28T12:57:48.920 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T12:57:48.937 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T12:57:48.978 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking rbd-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:49.141 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-11-28T12:57:49.314 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-attr (19.3.0-2) ... 2023-11-28T12:57:49.459 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T12:57:49.587 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-11-28T12:57:49.611 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-11-28T12:57:49.770 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-28T12:57:49.897 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-11-28T12:57:49.921 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-28T12:57:50.090 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:50.223 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-11-28T12:57:50.591 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-28T12:57:50.686 INFO:teuthology.orchestra.run.smithi082.stdout:Adding system user cephadm....done 2023-11-28T12:57:50.848 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-28T12:57:50.943 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-28T12:57:50.990 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-28T12:57:51.333 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T12:57:51.609 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-28T12:57:51.735 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-11-28T12:57:51.861 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-11-28T12:57:52.025 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-28T12:57:52.150 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-11-28T12:57:52.196 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-11-28T12:57:52.310 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-11-28T12:57:52.436 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rsa (4.0-3) ... 2023-11-28T12:57:52.598 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-28T12:57:52.712 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-28T12:57:52.838 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-11-28T12:57:52.916 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-11-28T12:57:53.164 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-28T12:57:53.209 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-11-28T12:57:53.490 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T12:57:53.527 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-28T12:57:53.803 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-28T12:57:53.816 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-11-28T12:57:54.137 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-ceph-argparse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:54.243 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librados2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:54.455 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-11-28T12:57:54.463 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-28T12:57:54.590 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-11-28T12:57:54.606 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librgw2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:54.732 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libsqlite3-mod-ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:54.874 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-11-28T12:57:54.883 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libcephfs2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:55.009 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-routes (2.4.1-2) ... 2023-11-28T12:57:55.166 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-28T12:57:55.302 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libradosstriper1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-11-28T12:57:55.451 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-28T12:57:55.576 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-11-28T12:57:55.747 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librbd1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:55.889 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-modules-core (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:55.986 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-11-28T12:57:56.023 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:56.271 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T12:57:56.271 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T12:57:56.287 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-11-28T12:57:56.571 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-28T12:57:56.742 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libcephfs-dev (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:56.893 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rados (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:56.914 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-11-28T12:57:57.019 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephfs-top (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-11-28T12:57:57.198 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-11-28T12:57:57.533 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-11-28T12:57:57.825 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-packaging (20.3-1) ... 2023-11-28T12:57:58.090 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rbd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:58.110 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-11-28T12:57:58.216 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up rbd-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:58.236 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-28T12:57:58.342 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:58.362 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-28T12:57:58.493 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cephfs (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:58.619 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephfs-shell (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:58.646 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-11-28T12:57:58.762 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:57:59.047 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-11-28T12:57:59.331 INFO:teuthology.orchestra.run.smithi114.stdout:Adding group ceph....done 2023-11-28T12:57:59.340 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-28T12:57:59.691 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-28T12:57:59.741 INFO:teuthology.orchestra.run.smithi114.stdout:Adding system user ceph....done 2023-11-28T12:57:59.917 INFO:teuthology.orchestra.run.smithi114.stdout:Setting system user ceph properties....done 2023-11-28T12:57:59.940 INFO:teuthology.orchestra.run.smithi114.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T12:58:00.051 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up socat (1.7.3.3-2) ... 2023-11-28T12:58:00.088 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T12:58:00.178 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:00.401 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T12:58:00.487 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T12:58:00.871 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephfs-mirror (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:00.888 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-11-28T12:58:01.022 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-test (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:01.157 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up radosgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:01.323 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-28T12:58:01.449 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-11-28T12:58:01.457 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T12:58:01.457 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T12:58:01.598 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-11-28T12:58:01.884 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-28T12:58:02.167 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-base (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:02.227 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T12:58:02.353 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-28T12:58:02.487 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-11-28T12:58:02.579 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T12:58:02.816 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-11-28T12:58:03.027 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mds (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:03.098 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-11-28T12:58:03.243 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T12:58:03.243 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T12:58:03.407 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-28T12:58:03.533 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T12:58:03.688 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:03.809 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-11-28T12:58:03.898 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T12:58:03.899 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T12:58:04.102 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-28T12:58:04.364 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-osd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:04.403 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-11-28T12:58:04.783 INFO:teuthology.orchestra.run.smithi082.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-11-28T12:58:04.905 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T12:58:04.906 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T12:58:05.039 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-11-28T12:58:05.190 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-28T12:58:05.349 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-k8sevents (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:05.491 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-11-28T12:58:05.500 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:05.634 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mon (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:05.834 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-28T12:58:05.855 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T12:58:05.855 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T12:58:05.959 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-28T12:58:06.086 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-11-28T12:58:06.302 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:06.420 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-28T12:58:06.461 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:06.579 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-dashboard (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:06.705 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-11-28T12:58:06.755 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-volume (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:06.960 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-28T12:58:07.276 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-28T12:58:07.577 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-28T12:58:08.171 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-28T12:58:08.297 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-11-28T12:58:08.698 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-11-28T12:58:08.999 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-11-28T12:58:09.309 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T12:58:09.434 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-11-28T12:58:09.760 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-28T12:58:10.087 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-11-28T12:58:10.430 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-11-28T12:58:10.507 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-28T12:58:10.834 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-28T12:58:11.051 INFO:teuthology.orchestra.run.smithi114.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T12:58:11.054 DEBUG:teuthology.orchestra.run.smithi114:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T12:58:11.127 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2023-11-28T12:58:11.333 INFO:teuthology.orchestra.run.smithi114.stdout:Building dependency tree... 2023-11-28T12:58:11.334 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... 2023-11-28T12:58:11.535 INFO:teuthology.orchestra.run.smithi114.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-11-28T12:58:11.535 INFO:teuthology.orchestra.run.smithi114.stdout:flex is already the newest version (2.6.4-6.2). 2023-11-28T12:58:11.535 INFO:teuthology.orchestra.run.smithi114.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-11-28T12:58:11.535 INFO:teuthology.orchestra.run.smithi114.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-11-28T12:58:11.535 INFO:teuthology.orchestra.run.smithi114.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-11-28T12:58:11.535 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T12:58:11.536 INFO:teuthology.orchestra.run.smithi114.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-28T12:58:11.536 INFO:teuthology.orchestra.run.smithi114.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T12:58:11.536 INFO:teuthology.orchestra.run.smithi114.stdout:The following additional packages will be installed: 2023-11-28T12:58:11.537 INFO:teuthology.orchestra.run.smithi114.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-11-28T12:58:11.537 INFO:teuthology.orchestra.run.smithi114.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-11-28T12:58:11.537 INFO:teuthology.orchestra.run.smithi114.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-11-28T12:58:11.537 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-11-28T12:58:11.537 INFO:teuthology.orchestra.run.smithi114.stdout: usb-modeswitch-data wpasupplicant 2023-11-28T12:58:11.538 INFO:teuthology.orchestra.run.smithi114.stdout:Suggested packages: 2023-11-28T12:58:11.538 INFO:teuthology.orchestra.run.smithi114.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-11-28T12:58:11.538 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-11-28T12:58:11.538 INFO:teuthology.orchestra.run.smithi114.stdout: libengine-pkcs11-openssl 2023-11-28T12:58:11.598 INFO:teuthology.orchestra.run.smithi114.stdout:The following NEW packages will be installed: 2023-11-28T12:58:11.599 INFO:teuthology.orchestra.run.smithi114.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-11-28T12:58:11.599 INFO:teuthology.orchestra.run.smithi114.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-11-28T12:58:11.599 INFO:teuthology.orchestra.run.smithi114.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-11-28T12:58:11.599 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-11-28T12:58:11.600 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-11-28T12:58:11.600 INFO:teuthology.orchestra.run.smithi114.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T12:58:11.601 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages will be upgraded: 2023-11-28T12:58:11.602 INFO:teuthology.orchestra.run.smithi114.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-11-28T12:58:11.807 INFO:teuthology.orchestra.run.smithi114.stdout:6 upgraded, 31 newly installed, 0 to remove and 251 not upgraded. 2023-11-28T12:58:11.807 INFO:teuthology.orchestra.run.smithi114.stdout:Need to get 25.3 MB of archives. 2023-11-28T12:58:11.807 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-11-28T12:58:11.807 INFO:teuthology.orchestra.run.smithi114.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-11-28T12:58:11.864 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-28T12:58:11.990 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-11-28T12:58:12.116 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-11-28T12:58:12.258 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-rsa (4.0-3) ... 2023-11-28T12:58:12.440 INFO:teuthology.orchestra.run.smithi114.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-11-28T12:58:12.441 INFO:teuthology.orchestra.run.smithi114.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-11-28T12:58:12.442 INFO:teuthology.orchestra.run.smithi114.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-11-28T12:58:12.456 INFO:teuthology.orchestra.run.smithi114.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-11-28T12:58:12.458 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-11-28T12:58:12.556 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-11-28T12:58:12.558 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-11-28T12:58:12.565 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-11-28T12:58:12.571 INFO:teuthology.orchestra.run.smithi114.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-11-28T12:58:12.571 INFO:teuthology.orchestra.run.smithi114.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-11-28T12:58:12.577 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-28T12:58:12.703 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-11-28T12:58:12.738 INFO:teuthology.orchestra.run.smithi114.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-11-28T12:58:13.017 INFO:teuthology.orchestra.run.smithi114.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-11-28T12:58:13.029 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-28T12:58:13.143 INFO:teuthology.orchestra.run.smithi114.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-11-28T12:58:13.150 INFO:teuthology.orchestra.run.smithi114.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-11-28T12:58:13.245 INFO:teuthology.orchestra.run.smithi114.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-11-28T12:58:13.249 INFO:teuthology.orchestra.run.smithi114.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-11-28T12:58:13.330 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T12:58:13.331 INFO:teuthology.orchestra.run.smithi114.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-11-28T12:58:13.349 INFO:teuthology.orchestra.run.smithi114.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-11-28T12:58:13.415 INFO:teuthology.orchestra.run.smithi114.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-11-28T12:58:13.416 INFO:teuthology.orchestra.run.smithi114.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-11-28T12:58:13.499 INFO:teuthology.orchestra.run.smithi114.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-11-28T12:58:13.664 INFO:teuthology.orchestra.run.smithi114.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-11-28T12:58:13.665 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-11-28T12:58:14.017 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librados2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:14.228 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-11-28T12:58:14.278 INFO:teuthology.orchestra.run.smithi114.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-11-28T12:58:14.354 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librgw2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:14.377 INFO:teuthology.orchestra.run.smithi114.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-11-28T12:58:14.466 INFO:teuthology.orchestra.run.smithi114.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-11-28T12:58:14.476 INFO:teuthology.orchestra.run.smithi114.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-11-28T12:58:14.476 INFO:teuthology.orchestra.run.smithi114.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-11-28T12:58:14.477 INFO:teuthology.orchestra.run.smithi114.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-11-28T12:58:14.478 INFO:teuthology.orchestra.run.smithi114.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-11-28T12:58:14.480 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libsqlite3-mod-ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:14.511 INFO:teuthology.orchestra.run.smithi114.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-11-28T12:58:14.515 INFO:teuthology.orchestra.run.smithi114.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-11-28T12:58:14.631 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libcephfs2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:14.757 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-routes (2.4.1-2) ... 2023-11-28T12:58:14.886 INFO:teuthology.orchestra.run.smithi114.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-11-28T12:58:15.050 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libradosstriper1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:15.098 INFO:teuthology.orchestra.run.smithi114.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-11-28T12:58:15.181 INFO:teuthology.orchestra.run.smithi114.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-11-28T12:58:15.181 INFO:teuthology.orchestra.run.smithi114.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-11-28T12:58:15.201 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-11-28T12:58:15.314 INFO:teuthology.orchestra.run.smithi114.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-11-28T12:58:15.494 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librbd1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:15.620 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-modules-core (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:15.771 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:15.812 INFO:teuthology.orchestra.run.smithi114.stdout:Preconfiguring packages ... 2023-11-28T12:58:15.981 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T12:58:15.982 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T12:58:16.002 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 25.3 MB in 4s (6,668 kB/s) 2023-11-28T12:58:16.281 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152830 files and directories currently installed.) 2023-11-28T12:58:16.285 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-28T12:58:16.439 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libcephfs-dev (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:16.466 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-28T12:58:16.565 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-rados (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:16.691 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up cephfs-top (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:16.817 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-11-28T12:58:17.729 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-rbd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:17.855 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up rbd-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:17.981 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-rgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:18.132 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cephfs (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:18.258 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up cephfs-shell (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:18.384 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:18.492 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-11-28T12:58:18.945 INFO:teuthology.orchestra.run.smithi082.stdout:Adding group ceph....done 2023-11-28T12:58:19.346 INFO:teuthology.orchestra.run.smithi082.stdout:Adding system user ceph....done 2023-11-28T12:58:19.522 INFO:teuthology.orchestra.run.smithi082.stdout:Setting system user ceph properties....done 2023-11-28T12:58:19.544 INFO:teuthology.orchestra.run.smithi082.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T12:58:19.690 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T12:58:20.014 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T12:58:20.018 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152830 files and directories currently installed.) 2023-11-28T12:58:20.023 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-28T12:58:20.156 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-28T12:58:20.493 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up cephfs-mirror (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:20.590 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-28T12:58:20.619 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-test (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:20.729 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up radosgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:20.779 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-28T12:58:21.000 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T12:58:21.000 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T12:58:21.137 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-28T12:58:21.576 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152830 files and directories currently installed.) 2023-11-28T12:58:21.581 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-28T12:58:21.640 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-base (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:21.737 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-28T12:58:22.015 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T12:58:22.212 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-28T12:58:22.367 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-28T12:58:22.482 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mds (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:22.703 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T12:58:22.704 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T12:58:22.824 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-28T12:58:22.954 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-11-28T12:58:23.142 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:23.370 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T12:58:23.370 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T12:58:23.492 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T12:58:23.509 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-11-28T12:58:23.755 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-11-28T12:58:23.835 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-osd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:24.379 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T12:58:24.379 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T12:58:24.497 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package dump. 2023-11-28T12:58:24.516 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-11-28T12:58:24.546 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking dump (0.4b46-6) ... 2023-11-28T12:58:24.838 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-k8sevents (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:24.859 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package indent. 2023-11-28T12:58:24.877 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-11-28T12:58:24.942 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-28T12:58:24.963 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:25.106 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mon (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:25.270 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T12:58:25.289 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-11-28T12:58:25.328 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-11-28T12:58:25.363 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T12:58:25.363 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T12:58:25.665 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T12:58:25.682 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-11-28T12:58:25.723 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-28T12:58:25.815 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:25.958 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:25.992 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T12:58:26.012 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-28T12:58:26.050 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T12:58:26.084 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-dashboard (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:26.229 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-volume (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T12:58:26.370 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T12:58:26.381 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-28T12:58:26.387 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T12:58:26.428 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T12:58:26.702 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-28T12:58:26.739 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T12:58:26.756 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T12:58:26.819 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T12:58:26.984 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-28T12:58:27.184 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T12:58:27.201 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T12:58:27.242 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T12:58:27.553 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T12:58:27.572 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-11-28T12:58:27.603 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-28T12:58:27.948 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T12:58:27.967 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-28T12:58:28.014 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-28T12:58:28.467 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T12:58:28.485 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-28T12:58:28.525 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T12:58:28.870 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T12:58:28.889 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T12:58:28.920 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T12:58:29.264 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T12:58:29.282 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T12:58:29.322 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T12:58:29.819 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T12:58:29.828 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-11-28T12:58:29.839 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-28T12:58:29.877 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-28T12:58:30.431 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T12:58:30.448 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-11-28T12:58:30.458 INFO:teuthology.orchestra.run.smithi082.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T12:58:30.461 DEBUG:teuthology.orchestra.run.smithi082:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T12:58:30.488 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-11-28T12:58:30.534 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2023-11-28T12:58:30.739 INFO:teuthology.orchestra.run.smithi082.stdout:Building dependency tree... 2023-11-28T12:58:30.740 INFO:teuthology.orchestra.run.smithi082.stdout:Reading state information... 2023-11-28T12:58:30.894 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package modemmanager. 2023-11-28T12:58:30.911 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T12:58:30.942 INFO:teuthology.orchestra.run.smithi082.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-11-28T12:58:30.943 INFO:teuthology.orchestra.run.smithi082.stdout:flex is already the newest version (2.6.4-6.2). 2023-11-28T12:58:30.943 INFO:teuthology.orchestra.run.smithi082.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-11-28T12:58:30.943 INFO:teuthology.orchestra.run.smithi082.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-11-28T12:58:30.943 INFO:teuthology.orchestra.run.smithi082.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-11-28T12:58:30.943 INFO:teuthology.orchestra.run.smithi082.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T12:58:30.943 INFO:teuthology.orchestra.run.smithi082.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-28T12:58:30.943 INFO:teuthology.orchestra.run.smithi082.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T12:58:30.944 INFO:teuthology.orchestra.run.smithi082.stdout:The following additional packages will be installed: 2023-11-28T12:58:30.944 INFO:teuthology.orchestra.run.smithi082.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-11-28T12:58:30.944 INFO:teuthology.orchestra.run.smithi082.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-11-28T12:58:30.945 INFO:teuthology.orchestra.run.smithi082.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-11-28T12:58:30.945 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-11-28T12:58:30.945 INFO:teuthology.orchestra.run.smithi082.stdout: usb-modeswitch-data wpasupplicant 2023-11-28T12:58:30.946 INFO:teuthology.orchestra.run.smithi082.stdout:Suggested packages: 2023-11-28T12:58:30.946 INFO:teuthology.orchestra.run.smithi082.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-11-28T12:58:30.946 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-11-28T12:58:30.946 INFO:teuthology.orchestra.run.smithi082.stdout: libengine-pkcs11-openssl 2023-11-28T12:58:30.982 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T12:58:31.009 INFO:teuthology.orchestra.run.smithi082.stdout:The following NEW packages will be installed: 2023-11-28T12:58:31.009 INFO:teuthology.orchestra.run.smithi082.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-11-28T12:58:31.009 INFO:teuthology.orchestra.run.smithi082.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-11-28T12:58:31.010 INFO:teuthology.orchestra.run.smithi082.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-11-28T12:58:31.010 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-11-28T12:58:31.010 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-11-28T12:58:31.010 INFO:teuthology.orchestra.run.smithi082.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T12:58:31.011 INFO:teuthology.orchestra.run.smithi082.stdout:The following packages will be upgraded: 2023-11-28T12:58:31.012 INFO:teuthology.orchestra.run.smithi082.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-11-28T12:58:31.198 INFO:teuthology.orchestra.run.smithi082.stdout:6 upgraded, 31 newly installed, 0 to remove and 251 not upgraded. 2023-11-28T12:58:31.198 INFO:teuthology.orchestra.run.smithi082.stdout:Need to get 25.3 MB of archives. 2023-11-28T12:58:31.198 INFO:teuthology.orchestra.run.smithi082.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-11-28T12:58:31.198 INFO:teuthology.orchestra.run.smithi082.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-11-28T12:58:31.641 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T12:58:31.660 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-11-28T12:58:31.699 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-28T12:58:31.819 INFO:teuthology.orchestra.run.smithi082.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-11-28T12:58:31.823 INFO:teuthology.orchestra.run.smithi082.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-11-28T12:58:31.828 INFO:teuthology.orchestra.run.smithi082.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-11-28T12:58:31.835 INFO:teuthology.orchestra.run.smithi082.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-11-28T12:58:31.840 INFO:teuthology.orchestra.run.smithi082.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-11-28T12:58:31.943 INFO:teuthology.orchestra.run.smithi082.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-11-28T12:58:31.978 INFO:teuthology.orchestra.run.smithi082.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-11-28T12:58:32.003 INFO:teuthology.orchestra.run.smithi082.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-11-28T12:58:32.048 INFO:teuthology.orchestra.run.smithi082.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-11-28T12:58:32.058 INFO:teuthology.orchestra.run.smithi082.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-11-28T12:58:32.243 INFO:teuthology.orchestra.run.smithi082.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-11-28T12:58:32.288 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package network-manager. 2023-11-28T12:58:32.306 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-28T12:58:32.363 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-11-28T12:58:32.522 INFO:teuthology.orchestra.run.smithi082.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-11-28T12:58:32.649 INFO:teuthology.orchestra.run.smithi082.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-11-28T12:58:32.656 INFO:teuthology.orchestra.run.smithi082.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-11-28T12:58:32.751 INFO:teuthology.orchestra.run.smithi082.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-11-28T12:58:32.754 INFO:teuthology.orchestra.run.smithi082.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-11-28T12:58:32.837 INFO:teuthology.orchestra.run.smithi082.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-11-28T12:58:32.853 INFO:teuthology.orchestra.run.smithi082.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-11-28T12:58:32.920 INFO:teuthology.orchestra.run.smithi082.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-11-28T12:58:32.921 INFO:teuthology.orchestra.run.smithi082.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-11-28T12:58:33.005 INFO:teuthology.orchestra.run.smithi082.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-11-28T12:58:33.168 INFO:teuthology.orchestra.run.smithi082.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-11-28T12:58:33.170 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ppp. 2023-11-28T12:58:33.191 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-11-28T12:58:33.492 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-28T12:58:33.783 INFO:teuthology.orchestra.run.smithi082.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-11-28T12:58:33.882 INFO:teuthology.orchestra.run.smithi082.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-11-28T12:58:33.900 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T12:58:33.918 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-11-28T12:58:33.959 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-11-28T12:58:33.971 INFO:teuthology.orchestra.run.smithi082.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-11-28T12:58:33.981 INFO:teuthology.orchestra.run.smithi082.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-11-28T12:58:33.982 INFO:teuthology.orchestra.run.smithi082.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-11-28T12:58:33.983 INFO:teuthology.orchestra.run.smithi082.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-11-28T12:58:33.984 INFO:teuthology.orchestra.run.smithi082.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-11-28T12:58:34.016 INFO:teuthology.orchestra.run.smithi082.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-11-28T12:58:34.021 INFO:teuthology.orchestra.run.smithi082.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-11-28T12:58:34.337 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T12:58:34.356 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-11-28T12:58:34.413 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-11-28T12:58:34.432 INFO:teuthology.orchestra.run.smithi082.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-11-28T12:58:34.596 INFO:teuthology.orchestra.run.smithi082.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-11-28T12:58:34.679 INFO:teuthology.orchestra.run.smithi082.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-11-28T12:58:34.679 INFO:teuthology.orchestra.run.smithi082.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-11-28T12:58:34.732 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T12:58:34.749 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-11-28T12:58:34.805 INFO:teuthology.orchestra.run.smithi082.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-11-28T12:58:34.881 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-11-28T12:58:35.303 INFO:teuthology.orchestra.run.smithi082.stdout:Preconfiguring packages ... 2023-11-28T12:58:35.488 INFO:teuthology.orchestra.run.smithi082.stdout:Fetched 25.3 MB in 4s (6,535 kB/s) 2023-11-28T12:58:35.763 INFO:teuthology.orchestra.run.smithi082.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152830 files and directories currently installed.) 2023-11-28T12:58:35.768 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-28T12:58:35.769 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-client-12. 2023-11-28T12:58:35.788 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-28T12:58:35.853 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T12:58:35.939 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-28T12:58:36.532 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T12:58:36.549 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-11-28T12:58:36.616 INFO:teuthology.orchestra.run.smithi114.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T12:58:36.642 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-11-28T12:58:37.070 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-11-28T12:58:37.189 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-12. 2023-11-28T12:58:37.206 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-28T12:58:37.251 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T12:58:38.474 INFO:teuthology.orchestra.run.smithi082.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152830 files and directories currently installed.) 2023-11-28T12:58:40.754 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql. 2023-11-28T12:58:40.754 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-11-28T12:58:40.754 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-11-28T12:58:40.755 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T12:58:40.755 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-11-28T12:58:40.755 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-11-28T12:58:40.755 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T12:58:40.755 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-11-28T12:58:40.755 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-11-28T12:58:40.755 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T12:58:40.755 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-11-28T12:58:40.755 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-11-28T12:58:40.755 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T12:58:40.755 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-11-28T12:58:40.755 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-28T12:58:40.755 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-11-28T12:58:40.756 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-28T12:58:40.756 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-28T12:58:40.756 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-28T12:58:40.756 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-28T12:58:40.756 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-28T12:58:40.756 INFO:teuthology.orchestra.run.smithi082.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152830 files and directories currently installed.) 2023-11-28T12:58:40.756 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-28T12:58:40.756 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-28T12:58:40.756 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-28T12:58:40.781 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-28T12:58:40.990 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-28T12:58:41.272 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-28T12:58:41.325 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T12:58:41.419 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-11-28T12:58:41.443 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-11-28T12:58:41.602 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-11-28T12:58:41.728 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-28T12:58:41.939 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T12:58:41.958 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-11-28T12:58:41.997 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-11-28T12:58:42.150 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T12:58:42.150 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T12:58:42.284 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package dump. 2023-11-28T12:58:42.304 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-11-28T12:58:42.358 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking dump (0.4b46-6) ... 2023-11-28T12:58:42.640 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T12:58:43.032 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package indent. 2023-11-28T12:58:43.053 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-11-28T12:58:43.269 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-28T12:58:43.520 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T12:58:43.620 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-28T12:58:43.746 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-11-28T12:58:43.825 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T12:58:43.842 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-11-28T12:58:43.875 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-11-28T12:58:43.922 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-11-28T12:58:44.187 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T12:58:44.204 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-11-28T12:58:44.254 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-28T12:58:44.548 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T12:58:44.566 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-28T12:58:44.606 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T12:58:44.976 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T12:58:44.994 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T12:58:45.021 INFO:teuthology.orchestra.run.smithi114.stdout:Adding user postgres to group ssl-cert 2023-11-28T12:58:45.034 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T12:58:45.270 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T12:58:45.279 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:58:45.280 INFO:teuthology.orchestra.run.smithi114.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T12:58:45.289 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T12:58:45.328 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T12:58:45.521 INFO:teuthology.orchestra.run.smithi114.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T12:58:45.522 INFO:teuthology.orchestra.run.smithi114.stdout:Removing obsolete dictionary files: 2023-11-28T12:58:45.673 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T12:58:45.693 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T12:58:45.731 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T12:58:45.864 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T12:58:46.126 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T12:58:46.143 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-11-28T12:58:46.184 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-28T12:58:46.478 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T12:58:46.497 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-28T12:58:46.528 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-28T12:58:46.657 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-28T12:58:46.792 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-11-28T12:58:46.910 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-28T12:58:46.923 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T12:58:46.941 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-28T12:58:46.981 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T12:58:47.069 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-28T12:58:47.359 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T12:58:47.377 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T12:58:47.417 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T12:58:47.753 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T12:58:47.770 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T12:58:47.836 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T12:58:48.073 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-11-28T12:58:48.089 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T12:58:48.106 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-28T12:58:48.147 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-28T12:58:48.319 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up dump (0.4b46-6) ... 2023-11-28T12:58:48.406 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T12:58:48.468 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T12:58:48.594 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-28T12:58:48.692 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T12:58:48.710 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-11-28T12:58:48.753 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-28T12:58:48.879 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-28T12:58:48.969 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-11-28T12:58:49.097 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-28T12:58:49.224 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T12:58:49.497 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package modemmanager. 2023-11-28T12:58:49.514 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T12:58:49.566 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T12:58:49.610 INFO:teuthology.orchestra.run.smithi114.stdout:Creating new PostgreSQL cluster 12/main ... 2023-11-28T12:58:49.626 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-11-28T12:58:49.692 INFO:teuthology.orchestra.run.smithi114.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T12:58:49.692 INFO:teuthology.orchestra.run.smithi114.stdout:This user must also own the server process. 2023-11-28T12:58:49.692 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:58:49.692 INFO:teuthology.orchestra.run.smithi114.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T12:58:49.692 INFO:teuthology.orchestra.run.smithi114.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T12:58:49.693 INFO:teuthology.orchestra.run.smithi114.stdout:The default text search configuration will be set to "english". 2023-11-28T12:58:49.693 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:58:49.693 INFO:teuthology.orchestra.run.smithi114.stdout:Data page checksums are disabled. 2023-11-28T12:58:49.693 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:58:49.693 INFO:teuthology.orchestra.run.smithi114.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-11-28T12:58:49.693 INFO:teuthology.orchestra.run.smithi114.stdout:creating subdirectories ... ok 2023-11-28T12:58:49.693 INFO:teuthology.orchestra.run.smithi114.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T12:58:49.714 INFO:teuthology.orchestra.run.smithi114.stdout:selecting default max_connections ... 100 2023-11-28T12:58:49.739 INFO:teuthology.orchestra.run.smithi114.stdout:selecting default shared_buffers ... 128MB 2023-11-28T12:58:49.755 INFO:teuthology.orchestra.run.smithi114.stdout:selecting default time zone ... Etc/UTC 2023-11-28T12:58:49.755 INFO:teuthology.orchestra.run.smithi114.stdout:creating configuration files ... ok 2023-11-28T12:58:49.864 INFO:teuthology.orchestra.run.smithi114.stdout:running bootstrap script ... ok 2023-11-28T12:58:50.128 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T12:58:50.145 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-11-28T12:58:50.211 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-28T12:58:50.404 INFO:teuthology.orchestra.run.smithi114.stdout:performing post-bootstrap initialization ... ok 2023-11-28T12:58:50.766 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package network-manager. 2023-11-28T12:58:50.783 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-28T12:58:50.849 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-11-28T12:58:51.230 INFO:teuthology.orchestra.run.smithi114.stdout:syncing data to disk ... ok 2023-11-28T12:58:51.231 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:58:51.231 INFO:teuthology.orchestra.run.smithi114.stdout:Success. You can now start the database server using: 2023-11-28T12:58:51.231 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:58:51.231 INFO:teuthology.orchestra.run.smithi114.stdout: pg_ctlcluster 12 main start 2023-11-28T12:58:51.231 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:58:51.532 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ppp. 2023-11-28T12:58:51.550 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-11-28T12:58:51.557 INFO:teuthology.orchestra.run.smithi114.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-11-28T12:58:51.557 INFO:teuthology.orchestra.run.smithi114.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-11-28T12:58:51.649 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T12:58:51.817 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-28T12:58:52.187 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T12:58:52.208 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-11-28T12:58:52.245 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-11-28T12:58:52.615 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T12:58:52.634 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-11-28T12:58:52.691 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-11-28T12:58:52.976 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T12:58:52.993 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-11-28T12:58:53.051 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-11-28T12:58:53.372 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package postgresql-client-12. 2023-11-28T12:58:53.390 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-28T12:58:53.430 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T12:58:54.060 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T12:58:54.078 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-11-28T12:58:54.141 INFO:teuthology.orchestra.run.smithi082.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T12:58:54.162 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-11-28T12:58:54.689 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T12:58:54.808 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package postgresql-12. 2023-11-28T12:58:54.815 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T12:58:54.826 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-28T12:58:54.869 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T12:58:54.957 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-11-28T12:58:55.101 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T12:58:55.244 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-11-28T12:58:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-11-28T12:58:56.110 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:58:56.111 INFO:teuthology.orchestra.run.smithi114.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T12:58:56.111 INFO:teuthology.orchestra.run.smithi114.stdout:which means they are currently configured by ifupdown: 2023-11-28T12:58:56.111 INFO:teuthology.orchestra.run.smithi114.stdout:- enp3s0f1 2023-11-28T12:58:56.111 INFO:teuthology.orchestra.run.smithi114.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T12:58:56.111 INFO:teuthology.orchestra.run.smithi114.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T12:58:56.111 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:58:56.272 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T12:58:56.453 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package postgresql. 2023-11-28T12:58:56.471 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-11-28T12:58:56.511 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-11-28T12:58:56.591 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T12:58:56.780 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T12:58:56.798 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-11-28T12:58:56.838 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-11-28T12:58:57.082 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T12:58:57.099 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-11-28T12:58:57.140 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-11-28T12:58:57.147 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T12:58:57.409 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T12:58:57.426 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-11-28T12:58:57.467 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-11-28T12:58:57.648 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T12:58:57.816 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-11-28T12:58:57.854 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T12:58:57.871 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-11-28T12:58:57.931 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-28T12:58:57.958 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T12:58:58.109 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-11-28T12:58:58.223 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-11-28T12:58:58.235 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-11-28T12:58:58.361 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T12:58:58.434 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-28T12:58:58.512 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T12:58:58.630 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T12:58:58.761 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T12:58:58.887 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-11-28T12:58:58.929 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T12:58:58.929 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T12:58:59.013 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-11-28T12:58:59.164 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-28T12:58:59.469 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-11-28T12:58:59.560 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T12:58:59.560 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T12:58:59.567 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T12:58:59.718 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-28T12:58:59.886 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-28T12:59:00.025 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T12:59:00.180 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-28T12:59:00.914 INFO:teuthology.orchestra.run.smithi082.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T12:59:01.006 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-28T12:59:01.115 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-11-28T12:59:01.224 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-11-28T12:59:02.272 INFO:teuthology.orchestra.run.smithi082.stdout:Adding user postgres to group ssl-cert 2023-11-28T12:59:02.543 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:02.543 INFO:teuthology.orchestra.run.smithi082.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T12:59:02.793 INFO:teuthology.orchestra.run.smithi082.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T12:59:02.794 INFO:teuthology.orchestra.run.smithi082.stdout:Removing obsolete dictionary files: 2023-11-28T12:59:03.120 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T12:59:03.868 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-28T12:59:04.019 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-11-28T12:59:04.145 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-28T12:59:04.271 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-28T12:59:05.653 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-11-28T12:59:05.910 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up dump (0.4b46-6) ... 2023-11-28T12:59:06.007 INFO:teuthology.orchestra.run.smithi082.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T12:59:06.071 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T12:59:06.196 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-28T12:59:06.347 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-28T12:59:06.473 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-28T12:59:06.649 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-28T12:59:06.775 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T12:59:07.148 INFO:teuthology.orchestra.run.smithi082.stdout:Creating new PostgreSQL cluster 12/main ... 2023-11-28T12:59:07.163 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-11-28T12:59:07.209 INFO:teuthology.orchestra.run.smithi082.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T12:59:07.209 INFO:teuthology.orchestra.run.smithi082.stdout:This user must also own the server process. 2023-11-28T12:59:07.209 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:07.209 INFO:teuthology.orchestra.run.smithi082.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T12:59:07.209 INFO:teuthology.orchestra.run.smithi082.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T12:59:07.209 INFO:teuthology.orchestra.run.smithi082.stdout:The default text search configuration will be set to "english". 2023-11-28T12:59:07.209 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:07.209 INFO:teuthology.orchestra.run.smithi082.stdout:Data page checksums are disabled. 2023-11-28T12:59:07.210 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:07.210 INFO:teuthology.orchestra.run.smithi082.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-11-28T12:59:07.210 INFO:teuthology.orchestra.run.smithi082.stdout:creating subdirectories ... ok 2023-11-28T12:59:07.210 INFO:teuthology.orchestra.run.smithi082.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T12:59:07.228 INFO:teuthology.orchestra.run.smithi082.stdout:selecting default max_connections ... 100 2023-11-28T12:59:07.252 INFO:teuthology.orchestra.run.smithi082.stdout:selecting default shared_buffers ... 128MB 2023-11-28T12:59:07.259 INFO:teuthology.orchestra.run.smithi082.stdout:selecting default time zone ... Etc/UTC 2023-11-28T12:59:07.260 INFO:teuthology.orchestra.run.smithi082.stdout:creating configuration files ... ok 2023-11-28T12:59:07.325 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-11-28T12:59:07.363 INFO:teuthology.orchestra.run.smithi082.stdout:running bootstrap script ... ok 2023-11-28T12:59:07.459 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-11-28T12:59:07.910 INFO:teuthology.orchestra.run.smithi082.stdout:performing post-bootstrap initialization ... ok 2023-11-28T12:59:08.321 INFO:teuthology.orchestra.run.smithi114.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T12:59:08.324 DEBUG:teuthology.parallel:result is None 2023-11-28T12:59:08.637 INFO:teuthology.orchestra.run.smithi082.stdout:syncing data to disk ... ok 2023-11-28T12:59:08.637 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:08.637 INFO:teuthology.orchestra.run.smithi082.stdout:Success. You can now start the database server using: 2023-11-28T12:59:08.637 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:08.637 INFO:teuthology.orchestra.run.smithi082.stdout: pg_ctlcluster 12 main start 2023-11-28T12:59:08.637 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:08.963 INFO:teuthology.orchestra.run.smithi082.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-11-28T12:59:08.963 INFO:teuthology.orchestra.run.smithi082.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-11-28T12:59:09.048 INFO:teuthology.orchestra.run.smithi082.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T12:59:12.015 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T12:59:12.149 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T12:59:12.308 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-11-28T12:59:12.476 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T12:59:12.602 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-11-28T12:59:12.728 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-11-28T12:59:13.479 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:13.479 INFO:teuthology.orchestra.run.smithi082.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T12:59:13.479 INFO:teuthology.orchestra.run.smithi082.stdout:which means they are currently configured by ifupdown: 2023-11-28T12:59:13.480 INFO:teuthology.orchestra.run.smithi082.stdout:- enp3s0f1 2023-11-28T12:59:13.480 INFO:teuthology.orchestra.run.smithi082.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T12:59:13.480 INFO:teuthology.orchestra.run.smithi082.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T12:59:13.480 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:13.641 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T12:59:13.969 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T12:59:14.501 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T12:59:14.981 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T12:59:15.124 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-11-28T12:59:15.309 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T12:59:15.501 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-11-28T12:59:15.627 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-11-28T12:59:15.753 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T12:59:15.904 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T12:59:16.030 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T12:59:16.291 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T12:59:16.291 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T12:59:16.833 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-11-28T12:59:16.935 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T12:59:17.078 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-28T12:59:17.238 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-28T12:59:17.523 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-28T12:59:24.735 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-11-28T12:59:24.852 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-11-28T12:59:25.734 INFO:teuthology.orchestra.run.smithi082.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T12:59:25.736 DEBUG:teuthology.parallel:result is None 2023-11-28T12:59:25.737 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T12:59:25.965 DEBUG:teuthology.orchestra.run.smithi082:> dpkg-query -W -f '${Version}' ceph 2023-11-28T12:59:25.988 INFO:teuthology.orchestra.run.smithi082.stdout:18.0.0-2697-g2f5f6028-1focal 2023-11-28T12:59:25.989 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2697-g2f5f6028-1focal 2023-11-28T12:59:25.989 INFO:teuthology.task.install:The correct ceph version 18.0.0-2697-g2f5f6028-1focal is installed. 2023-11-28T12:59:25.989 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T12:59:26.211 DEBUG:teuthology.orchestra.run.smithi114:> dpkg-query -W -f '${Version}' ceph 2023-11-28T12:59:26.234 INFO:teuthology.orchestra.run.smithi114.stdout:18.0.0-2697-g2f5f6028-1focal 2023-11-28T12:59:26.235 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2697-g2f5f6028-1focal 2023-11-28T12:59:26.235 INFO:teuthology.task.install:The correct ceph version 18.0.0-2697-g2f5f6028-1focal is installed. 2023-11-28T12:59:26.235 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-28T12:59:26.235 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T12:59:26.235 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T12:59:26.252 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T12:59:26.252 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T12:59:26.291 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-28T12:59:26.291 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T12:59:26.291 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T12:59:26.308 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T12:59:26.364 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T12:59:26.365 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T12:59:26.381 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T12:59:26.440 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-28T12:59:26.440 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T12:59:26.440 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T12:59:26.455 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T12:59:26.470 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T12:59:26.470 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T12:59:26.486 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T12:59:26.543 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-28T12:59:26.544 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T12:59:26.544 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T12:59:26.560 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T12:59:26.573 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T12:59:26.573 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T12:59:26.589 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T12:59:26.599 INFO:teuthology.run_tasks:Running task ceph... 2023-11-28T12:59:26.665 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-28T12:59:26.665 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /var/log/ceph 2023-11-28T12:59:26.668 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 777 /var/log/ceph 2023-11-28T12:59:26.682 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-28T12:59:26.683 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T12:59:26.724 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T12:59:26.759 INFO:tasks.ceph:Creating extra log directories... 2023-11-28T12:59:26.759 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T12:59:26.762 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T12:59:26.783 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-28T12:59:26.784 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-28T12:59:26.784 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-28T12:59:26.784 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T12:59:26.784 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T12:59:26.826 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T12:59:26.861 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T12:59:26.861 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T12:59:26.867 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T12:59:26.953 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-28T12:59:26.953 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-28T12:59:26.953 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469970', 'branch': 'wip-neesingh-testing-231123', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub}', 'email': 'neesingh@redhat.com', 'first_in_suite': False, 'job_id': '7469970', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-neesingh-testing-231123'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'issue_54557', 'sha1': '3ae99413970476692dfab1fe38dadb056700a61d'}}, 'owner': 'scheduled_neesingh@teuthology', 'priority': 10, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6754, 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'issue_54557', 'suite_path': '/home/teuthworker/src/github.com_neesingh-rh_ceph_3ae99413970476692dfab1fe38dadb056700a61d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/neesingh-rh/ceph', 'suite_sha1': '3ae99413970476692dfab1fe38dadb056700a61d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi082.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi114.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '5ae09a5cc7064ca2bf994df19f3006b79794789a', 'timestamp': '2023-11-28_12:38:30', 'tube': 'smithi', 'user': 'neesingh', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-28T12:59:26.953 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T12:59:26.956 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T12:59:26.963 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T12:59:27.004 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T12:59:27.020 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T12:59:27.020 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T12:59:27.026 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T12:59:27.026 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2023-11-28T12:59:27.032 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T12:59:27.032 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T12:59:27.032 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 361 Links: 1 2023-11-28T12:59:27.032 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T12:59:27.032 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-11-28 12:54:25.315755835 +0000 2023-11-28T12:59:27.032 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-11-28 12:54:25.023762569 +0000 2023-11-28T12:59:27.032 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-11-28 12:54:25.023762569 +0000 2023-11-28T12:59:27.033 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2023-11-28T12:59:27.033 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T12:59:27.089 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-11-28T12:59:27.089 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-11-28T12:59:27.089 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000436177 s, 1.2 MB/s 2023-11-28T12:59:27.090 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T12:59:27.097 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2023-11-28T12:59:27.102 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T12:59:27.102 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T12:59:27.102 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 364 Links: 1 2023-11-28T12:59:27.103 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T12:59:27.103 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-11-28 12:54:25.795744767 +0000 2023-11-28T12:59:27.103 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-11-28 12:54:25.519751132 +0000 2023-11-28T12:59:27.103 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-11-28 12:54:25.519751132 +0000 2023-11-28T12:59:27.103 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2023-11-28T12:59:27.103 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T12:59:27.160 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-11-28T12:59:27.160 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-11-28T12:59:27.161 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000384856 s, 1.3 MB/s 2023-11-28T12:59:27.161 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T12:59:27.170 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2023-11-28T12:59:27.176 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T12:59:27.176 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T12:59:27.176 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 370 Links: 1 2023-11-28T12:59:27.176 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T12:59:27.176 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-11-28 12:54:26.331732405 +0000 2023-11-28T12:59:27.177 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-11-28 12:54:26.031739324 +0000 2023-11-28T12:59:27.177 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-11-28 12:54:26.031739324 +0000 2023-11-28T12:59:27.177 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2023-11-28T12:59:27.177 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T12:59:27.232 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-11-28T12:59:27.233 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-11-28T12:59:27.233 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000395266 s, 1.3 MB/s 2023-11-28T12:59:27.234 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T12:59:27.241 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2023-11-28T12:59:27.247 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T12:59:27.247 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T12:59:27.247 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 378 Links: 1 2023-11-28T12:59:27.248 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T12:59:27.248 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-11-28 12:54:26.863720137 +0000 2023-11-28T12:59:27.248 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-11-28 12:54:26.583726593 +0000 2023-11-28T12:59:27.248 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-11-28 12:54:26.583726593 +0000 2023-11-28T12:59:27.248 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2023-11-28T12:59:27.248 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T12:59:27.303 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-11-28T12:59:27.303 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-11-28T12:59:27.303 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000417856 s, 1.2 MB/s 2023-11-28T12:59:27.304 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T12:59:27.312 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T12:59:27.313 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T12:59:27.313 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T12:59:27.320 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T12:59:27.320 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_1 2023-11-28T12:59:27.327 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T12:59:27.327 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T12:59:27.327 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 360 Links: 1 2023-11-28T12:59:27.328 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T12:59:27.328 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2023-11-28 12:54:26.354769689 +0000 2023-11-28T12:59:27.328 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2023-11-28 12:54:26.350769779 +0000 2023-11-28T12:59:27.328 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2023-11-28 12:54:26.350769779 +0000 2023-11-28T12:59:27.328 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2023-11-28T12:59:27.328 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T12:59:27.339 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2023-11-28T12:59:27.339 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2023-11-28T12:59:27.339 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000420981 s, 1.2 MB/s 2023-11-28T12:59:27.340 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T12:59:27.347 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_2 2023-11-28T12:59:27.395 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T12:59:27.396 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T12:59:27.396 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 366 Links: 1 2023-11-28T12:59:27.396 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T12:59:27.396 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2023-11-28 12:54:27.158751369 +0000 2023-11-28T12:59:27.396 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2023-11-28 12:54:26.874757840 +0000 2023-11-28T12:59:27.396 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2023-11-28 12:54:26.874757840 +0000 2023-11-28T12:59:27.396 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2023-11-28T12:59:27.397 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T12:59:27.408 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2023-11-28T12:59:27.408 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2023-11-28T12:59:27.408 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000399385 s, 1.3 MB/s 2023-11-28T12:59:27.410 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T12:59:27.418 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_3 2023-11-28T12:59:27.425 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T12:59:27.425 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T12:59:27.426 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 373 Links: 1 2023-11-28T12:59:27.426 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T12:59:27.426 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2023-11-28 12:54:27.654740067 +0000 2023-11-28T12:59:27.426 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2023-11-28 12:54:27.390746083 +0000 2023-11-28T12:59:27.426 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2023-11-28 12:54:27.390746083 +0000 2023-11-28T12:59:27.426 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2023-11-28T12:59:27.426 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T12:59:27.438 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2023-11-28T12:59:27.438 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2023-11-28T12:59:27.438 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000322121 s, 1.6 MB/s 2023-11-28T12:59:27.440 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T12:59:27.489 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_4 2023-11-28T12:59:27.495 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T12:59:27.495 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T12:59:27.496 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 378 Links: 1 2023-11-28T12:59:27.496 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T12:59:27.496 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2023-11-28 12:54:28.162728491 +0000 2023-11-28T12:59:27.496 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2023-11-28 12:54:27.878734962 +0000 2023-11-28T12:59:27.496 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2023-11-28 12:54:27.878734962 +0000 2023-11-28T12:59:27.496 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2023-11-28T12:59:27.496 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T12:59:27.508 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2023-11-28T12:59:27.508 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2023-11-28T12:59:27.508 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000404425 s, 1.3 MB/s 2023-11-28T12:59:27.509 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T12:59:27.562 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T12:59:27.562 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T12:59:27.562 INFO:tasks.ceph:Generating config... 2023-11-28T12:59:27.563 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-28T12:59:27.563 INFO:tasks.ceph:[client] debug client = 20 2023-11-28T12:59:27.563 INFO:tasks.ceph:[client] debug ms = 1 2023-11-28T12:59:27.564 INFO:tasks.ceph:[client] pid file = 2023-11-28T12:59:27.564 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-28T12:59:27.564 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-28T12:59:27.564 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-28T12:59:27.564 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-28T12:59:27.564 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-28T12:59:27.564 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-28T12:59:27.564 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-28T12:59:27.564 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-28T12:59:27.564 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-28T12:59:27.564 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-28T12:59:27.564 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-28T12:59:27.565 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-28T12:59:27.565 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-28T12:59:27.565 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-28T12:59:27.565 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-28T12:59:27.565 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-28T12:59:27.565 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-28T12:59:27.565 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-28T12:59:27.565 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-28T12:59:27.565 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-28T12:59:27.565 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-28T12:59:27.565 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-28T12:59:27.565 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-28T12:59:27.566 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-28T12:59:27.566 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-28T12:59:27.566 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-28T12:59:27.566 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-28T12:59:27.566 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-28T12:59:27.566 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-28T12:59:27.566 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-28T12:59:27.566 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-28T12:59:27.566 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-28T12:59:27.566 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-28T12:59:27.566 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-28T12:59:27.567 INFO:tasks.ceph:Setting up mon.a... 2023-11-28T12:59:27.567 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-28T12:59:27.607 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.keyring 2023-11-28T12:59:27.625 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-28T12:59:27.668 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T12:59:27.724 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.82'), ('mon.b', '172.21.15.114'), ('mon.c', '[v2:172.21.15.114:3301,v1:172.21.15.114:6790]')] 2023-11-28T12:59:27.724 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.82,172.21.15.114,[v2:172.21.15.114:3301,v1:172.21.15.114:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-28T12:59:27.725 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T12:59:27.725 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T12:59:27.730 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.82 --add b 172.21.15.114 --addv c '[v2:172.21.15.114:3301,v1:172.21.15.114:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:59:27.775 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:59:27.775 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool: generated fsid aef8a97f-1d6c-4a2b-9410-16861b3e9e35 2023-11-28T12:59:27.775 INFO:teuthology.orchestra.run.smithi082.stdout:setting min_mon_release = pacific 2023-11-28T12:59:27.775 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 0 2023-11-28T12:59:27.776 INFO:teuthology.orchestra.run.smithi082.stdout:fsid aef8a97f-1d6c-4a2b-9410-16861b3e9e35 2023-11-28T12:59:27.776 INFO:teuthology.orchestra.run.smithi082.stdout:last_changed 2023-11-28T12:59:27.775140+0000 2023-11-28T12:59:27.776 INFO:teuthology.orchestra.run.smithi082.stdout:created 2023-11-28T12:59:27.775140+0000 2023-11-28T12:59:27.776 INFO:teuthology.orchestra.run.smithi082.stdout:min_mon_release 16 (pacific) 2023-11-28T12:59:27.776 INFO:teuthology.orchestra.run.smithi082.stdout:election_strategy: 1 2023-11-28T12:59:27.776 INFO:teuthology.orchestra.run.smithi082.stdout:0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2023-11-28T12:59:27.776 INFO:teuthology.orchestra.run.smithi082.stdout:1: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.b 2023-11-28T12:59:27.776 INFO:teuthology.orchestra.run.smithi082.stdout:2: [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] mon.c 2023-11-28T12:59:27.776 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-28T12:59:27.777 DEBUG:teuthology.orchestra.run.smithi082:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T12:59:27.782 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID aef8a97f-1d6c-4a2b-9410-16861b3e9e35... 2023-11-28T12:59:27.783 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T12:59:27.785 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T12:59:27.816 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2023-11-28T12:59:27.816 INFO:teuthology.orchestra.run.smithi082.stdout: chdir = "" 2023-11-28T12:59:27.816 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T12:59:27.816 INFO:teuthology.orchestra.run.smithi082.stdout: auth supported = cephx 2023-11-28T12:59:27.816 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.816 INFO:teuthology.orchestra.run.smithi082.stdout: filestore xattr use omap = true 2023-11-28T12:59:27.816 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.817 INFO:teuthology.orchestra.run.smithi082.stdout: mon clock drift allowed = 1.000 2023-11-28T12:59:27.817 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.817 INFO:teuthology.orchestra.run.smithi082.stdout: osd crush chooseleaf type = 0 2023-11-28T12:59:27.817 INFO:teuthology.orchestra.run.smithi082.stdout: auth debug = true 2023-11-28T12:59:27.817 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.817 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on old message = true 2023-11-28T12:59:27.817 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on bug = true 2023-11-28T12:59:27.817 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.817 INFO:teuthology.orchestra.run.smithi082.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T12:59:27.817 INFO:teuthology.orchestra.run.smithi082.stdout: mon pg warn max object skew = 0 2023-11-28T12:59:27.817 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.817 INFO:teuthology.orchestra.run.smithi082.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T12:59:27.818 INFO:teuthology.orchestra.run.smithi082.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T12:59:27.818 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.818 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default size = 2 2023-11-28T12:59:27.818 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.818 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow primary affinity = true 2023-11-28T12:59:27.818 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow pg remap = true 2023-11-28T12:59:27.818 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on legacy crush tunables = false 2023-11-28T12:59:27.818 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on crush straw calc version zero = false 2023-11-28T12:59:27.818 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on no sortbitwise = false 2023-11-28T12:59:27.818 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on osd down out interval zero = false 2023-11-28T12:59:27.818 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on too few osds = false 2023-11-28T12:59:27.819 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T12:59:27.819 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T12:59:27.819 INFO:teuthology.orchestra.run.smithi082.stdout: mon_allow_pool_size_one = true 2023-11-28T12:59:27.819 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.819 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T12:59:27.819 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.819 INFO:teuthology.orchestra.run.smithi082.stdout: osd default data pool replay window = 5 2023-11-28T12:59:27.819 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.819 INFO:teuthology.orchestra.run.smithi082.stdout: mon allow pool delete = true 2023-11-28T12:59:27.819 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.819 INFO:teuthology.orchestra.run.smithi082.stdout: mon cluster log file level = debug 2023-11-28T12:59:27.819 INFO:teuthology.orchestra.run.smithi082.stdout: debug asserts on shutdown = true 2023-11-28T12:59:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: mon health detail to clog = false 2023-11-28T12:59:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: mon host = "172.21.15.82,172.21.15.114,[v2:172.21.15.114:3301,v1:172.21.15.114:6790]" 2023-11-28T12:59:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = aef8a97f-1d6c-4a2b-9410-16861b3e9e35 2023-11-28T12:59:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.820 INFO:teuthology.orchestra.run.smithi082.stdout:[osd] 2023-11-28T12:59:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: osd journal size = 100 2023-11-28T12:59:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub load threshold = 5.0 2023-11-28T12:59:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub max interval = 600 2023-11-28T12:59:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: osd recover clone overlap = true 2023-11-28T12:59:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: osd recovery max chunk = 1048576 2023-11-28T12:59:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug shutdown = true 2023-11-28T12:59:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug op order = true 2023-11-28T12:59:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug verify stray on activate = true 2023-11-28T12:59:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: osd open classes on start = true 2023-11-28T12:59:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug pg log writeout = true 2023-11-28T12:59:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: osd deep scrub update digest min age = 30 2023-11-28T12:59:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: osd map max advance = 10 2023-11-28T12:59:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: journal zero on create = true 2023-11-28T12:59:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: filestore ondisk finisher threads = 3 2023-11-28T12:59:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: filestore apply finisher threads = 3 2023-11-28T12:59:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: bdev debug aio = true 2023-11-28T12:59:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug misdirected ops = true 2023-11-28T12:59:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: bdev async discard = True 2023-11-28T12:59:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: bdev enable discard = True 2023-11-28T12:59:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore allocator = bitmap 2023-11-28T12:59:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore block size = 96636764160 2023-11-28T12:59:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore fsck on mount = True 2023-11-28T12:59:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluefs = 1/20 2023-11-28T12:59:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluestore = 1/20 2023-11-28T12:59:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2023-11-28T12:59:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: debug osd = 20 2023-11-28T12:59:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: debug rocksdb = 4/10 2023-11-28T12:59:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T12:59:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd full ratio = 0.9 2023-11-28T12:59:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd nearfull ratio = 0.8 2023-11-28T12:59:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: osd failsafe full ratio = 0.95 2023-11-28T12:59:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: osd objectstore = bluestore 2023-11-28T12:59:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2023-11-28T12:59:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.824 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr] 2023-11-28T12:59:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2023-11-28T12:59:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: debug mgr = 20 2023-11-28T12:59:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2023-11-28T12:59:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2023-11-28T12:59:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2023-11-28T12:59:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2023-11-28T12:59:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: mgr/telemetry/nag = false 2023-11-28T12:59:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.825 INFO:teuthology.orchestra.run.smithi082.stdout:[mon] 2023-11-28T12:59:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2023-11-28T12:59:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2023-11-28T12:59:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: debug paxos = 20 2023-11-28T12:59:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2023-11-28T12:59:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: mon data avail warn = 5 2023-11-28T12:59:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: mon mgr mkfs grace = 240 2023-11-28T12:59:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2023-11-28T12:59:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd reporter subtree level = osd 2023-11-28T12:59:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd prime pg temp = true 2023-11-28T12:59:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2023-11-28T12:59:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T12:59:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T12:59:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T12:59:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T12:59:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T12:59:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T12:59:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: # 1m isn't quite enough 2023-11-28T12:59:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: mon_down_mkfs_grace = 2m 2023-11-28T12:59:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_filestore_osds = false 2023-11-28T12:59:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: mon op complaint time = 120 2023-11-28T12:59:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T12:59:27.827 INFO:teuthology.orchestra.run.smithi082.stdout:[client] 2023-11-28T12:59:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: rgw cache enabled = true 2023-11-28T12:59:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable ops log = true 2023-11-28T12:59:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable usage log = true 2023-11-28T12:59:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T12:59:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T12:59:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: client mount timeout = 600 2023-11-28T12:59:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2023-11-28T12:59:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2023-11-28T12:59:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = "" 2023-11-28T12:59:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2023-11-28T12:59:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2023-11-28T12:59:27.828 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.a] 2023-11-28T12:59:27.828 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.b] 2023-11-28T12:59:27.828 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.c] 2023-11-28T12:59:27.828 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2023-11-28T12:59:27.828 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c] 2023-11-28T12:59:27.828 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2023-11-28T12:59:27.828 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d] 2023-11-28T12:59:27.828 INFO:teuthology.orchestra.run.smithi082.stdout:[mds] 2023-11-28T12:59:27.828 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds = 20 2023-11-28T12:59:27.828 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds balancer = 20 2023-11-28T12:59:27.828 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2023-11-28T12:59:27.828 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug frag = True 2023-11-28T12:59:27.828 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug scatterstat = True 2023-11-28T12:59:27.828 INFO:teuthology.orchestra.run.smithi082.stdout: mds op complaint time = 180 2023-11-28T12:59:27.829 INFO:teuthology.orchestra.run.smithi082.stdout: mds verify scatter = True 2023-11-28T12:59:27.829 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2023-11-28T12:59:27.829 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2023-11-28T12:59:27.829 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2023-11-28T12:59:27.830 INFO:teuthology.orchestra.run.smithi114.stdout:[global] 2023-11-28T12:59:27.830 INFO:teuthology.orchestra.run.smithi114.stdout: chdir = "" 2023-11-28T12:59:27.830 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T12:59:27.830 INFO:teuthology.orchestra.run.smithi114.stdout: auth supported = cephx 2023-11-28T12:59:27.830 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.831 INFO:teuthology.orchestra.run.smithi114.stdout: filestore xattr use omap = true 2023-11-28T12:59:27.831 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.831 INFO:teuthology.orchestra.run.smithi114.stdout: mon clock drift allowed = 1.000 2023-11-28T12:59:27.831 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.831 INFO:teuthology.orchestra.run.smithi114.stdout: osd crush chooseleaf type = 0 2023-11-28T12:59:27.831 INFO:teuthology.orchestra.run.smithi114.stdout: auth debug = true 2023-11-28T12:59:27.831 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.831 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on old message = true 2023-11-28T12:59:27.832 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on bug = true 2023-11-28T12:59:27.832 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.832 INFO:teuthology.orchestra.run.smithi114.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T12:59:27.832 INFO:teuthology.orchestra.run.smithi114.stdout: mon pg warn max object skew = 0 2023-11-28T12:59:27.832 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.832 INFO:teuthology.orchestra.run.smithi114.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T12:59:27.832 INFO:teuthology.orchestra.run.smithi114.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T12:59:27.832 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.832 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default size = 2 2023-11-28T12:59:27.833 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.833 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow primary affinity = true 2023-11-28T12:59:27.833 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow pg remap = true 2023-11-28T12:59:27.833 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on legacy crush tunables = false 2023-11-28T12:59:27.833 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on crush straw calc version zero = false 2023-11-28T12:59:27.833 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on no sortbitwise = false 2023-11-28T12:59:27.833 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on osd down out interval zero = false 2023-11-28T12:59:27.833 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on too few osds = false 2023-11-28T12:59:27.833 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T12:59:27.833 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T12:59:27.833 INFO:teuthology.orchestra.run.smithi114.stdout: mon_allow_pool_size_one = true 2023-11-28T12:59:27.833 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.834 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T12:59:27.834 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.834 INFO:teuthology.orchestra.run.smithi114.stdout: osd default data pool replay window = 5 2023-11-28T12:59:27.834 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.834 INFO:teuthology.orchestra.run.smithi114.stdout: mon allow pool delete = true 2023-11-28T12:59:27.834 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.834 INFO:teuthology.orchestra.run.smithi114.stdout: mon cluster log file level = debug 2023-11-28T12:59:27.834 INFO:teuthology.orchestra.run.smithi114.stdout: debug asserts on shutdown = true 2023-11-28T12:59:27.834 INFO:teuthology.orchestra.run.smithi114.stdout: mon health detail to clog = false 2023-11-28T12:59:27.834 INFO:teuthology.orchestra.run.smithi114.stdout: mon host = "172.21.15.82,172.21.15.114,[v2:172.21.15.114:3301,v1:172.21.15.114:6790]" 2023-11-28T12:59:27.834 INFO:teuthology.orchestra.run.smithi114.stdout: fsid = aef8a97f-1d6c-4a2b-9410-16861b3e9e35 2023-11-28T12:59:27.834 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.835 INFO:teuthology.orchestra.run.smithi114.stdout:[osd] 2023-11-28T12:59:27.835 INFO:teuthology.orchestra.run.smithi114.stdout: osd journal size = 100 2023-11-28T12:59:27.835 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.835 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub load threshold = 5.0 2023-11-28T12:59:27.835 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub max interval = 600 2023-11-28T12:59:27.835 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.835 INFO:teuthology.orchestra.run.smithi114.stdout: osd recover clone overlap = true 2023-11-28T12:59:27.835 INFO:teuthology.orchestra.run.smithi114.stdout: osd recovery max chunk = 1048576 2023-11-28T12:59:27.835 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.835 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug shutdown = true 2023-11-28T12:59:27.835 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug op order = true 2023-11-28T12:59:27.835 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug verify stray on activate = true 2023-11-28T12:59:27.835 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.836 INFO:teuthology.orchestra.run.smithi114.stdout: osd open classes on start = true 2023-11-28T12:59:27.836 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug pg log writeout = true 2023-11-28T12:59:27.836 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.836 INFO:teuthology.orchestra.run.smithi114.stdout: osd deep scrub update digest min age = 30 2023-11-28T12:59:27.836 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.836 INFO:teuthology.orchestra.run.smithi114.stdout: osd map max advance = 10 2023-11-28T12:59:27.836 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.836 INFO:teuthology.orchestra.run.smithi114.stdout: journal zero on create = true 2023-11-28T12:59:27.836 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.836 INFO:teuthology.orchestra.run.smithi114.stdout: filestore ondisk finisher threads = 3 2023-11-28T12:59:27.836 INFO:teuthology.orchestra.run.smithi114.stdout: filestore apply finisher threads = 3 2023-11-28T12:59:27.836 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.837 INFO:teuthology.orchestra.run.smithi114.stdout: bdev debug aio = true 2023-11-28T12:59:27.837 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug misdirected ops = true 2023-11-28T12:59:27.837 INFO:teuthology.orchestra.run.smithi114.stdout: bdev async discard = True 2023-11-28T12:59:27.837 INFO:teuthology.orchestra.run.smithi114.stdout: bdev enable discard = True 2023-11-28T12:59:27.837 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore allocator = bitmap 2023-11-28T12:59:27.837 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore block size = 96636764160 2023-11-28T12:59:27.837 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore fsck on mount = True 2023-11-28T12:59:27.837 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluefs = 1/20 2023-11-28T12:59:27.837 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluestore = 1/20 2023-11-28T12:59:27.837 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-11-28T12:59:27.837 INFO:teuthology.orchestra.run.smithi114.stdout: debug osd = 20 2023-11-28T12:59:27.837 INFO:teuthology.orchestra.run.smithi114.stdout: debug rocksdb = 4/10 2023-11-28T12:59:27.837 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T12:59:27.838 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd full ratio = 0.9 2023-11-28T12:59:27.838 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd nearfull ratio = 0.8 2023-11-28T12:59:27.838 INFO:teuthology.orchestra.run.smithi114.stdout: osd failsafe full ratio = 0.95 2023-11-28T12:59:27.838 INFO:teuthology.orchestra.run.smithi114.stdout: osd objectstore = bluestore 2023-11-28T12:59:27.838 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2023-11-28T12:59:27.838 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.838 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr] 2023-11-28T12:59:27.838 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-11-28T12:59:27.838 INFO:teuthology.orchestra.run.smithi114.stdout: debug mgr = 20 2023-11-28T12:59:27.838 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2023-11-28T12:59:27.838 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2023-11-28T12:59:27.838 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2023-11-28T12:59:27.839 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2023-11-28T12:59:27.839 INFO:teuthology.orchestra.run.smithi114.stdout: mgr/telemetry/nag = false 2023-11-28T12:59:27.839 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.839 INFO:teuthology.orchestra.run.smithi114.stdout:[mon] 2023-11-28T12:59:27.839 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-11-28T12:59:27.839 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2023-11-28T12:59:27.839 INFO:teuthology.orchestra.run.smithi114.stdout: debug paxos = 20 2023-11-28T12:59:27.839 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2023-11-28T12:59:27.839 INFO:teuthology.orchestra.run.smithi114.stdout: mon data avail warn = 5 2023-11-28T12:59:27.839 INFO:teuthology.orchestra.run.smithi114.stdout: mon mgr mkfs grace = 240 2023-11-28T12:59:27.839 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2023-11-28T12:59:27.839 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd reporter subtree level = osd 2023-11-28T12:59:27.839 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd prime pg temp = true 2023-11-28T12:59:27.839 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2023-11-28T12:59:27.840 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.840 INFO:teuthology.orchestra.run.smithi114.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T12:59:27.840 INFO:teuthology.orchestra.run.smithi114.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T12:59:27.840 INFO:teuthology.orchestra.run.smithi114.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T12:59:27.840 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.840 INFO:teuthology.orchestra.run.smithi114.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T12:59:27.840 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T12:59:27.840 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T12:59:27.840 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.840 INFO:teuthology.orchestra.run.smithi114.stdout: # 1m isn't quite enough 2023-11-28T12:59:27.840 INFO:teuthology.orchestra.run.smithi114.stdout: mon_down_mkfs_grace = 2m 2023-11-28T12:59:27.840 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.841 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_filestore_osds = false 2023-11-28T12:59:27.841 INFO:teuthology.orchestra.run.smithi114.stdout: mon op complaint time = 120 2023-11-28T12:59:27.841 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-28T12:59:27.841 INFO:teuthology.orchestra.run.smithi114.stdout:[client] 2023-11-28T12:59:27.841 INFO:teuthology.orchestra.run.smithi114.stdout: rgw cache enabled = true 2023-11-28T12:59:27.841 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable ops log = true 2023-11-28T12:59:27.841 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable usage log = true 2023-11-28T12:59:27.841 INFO:teuthology.orchestra.run.smithi114.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T12:59:27.841 INFO:teuthology.orchestra.run.smithi114.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T12:59:27.841 INFO:teuthology.orchestra.run.smithi114.stdout: client mount timeout = 600 2023-11-28T12:59:27.841 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2023-11-28T12:59:27.841 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-11-28T12:59:27.841 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = "" 2023-11-28T12:59:27.842 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2023-11-28T12:59:27.842 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2023-11-28T12:59:27.842 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.a] 2023-11-28T12:59:27.842 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.b] 2023-11-28T12:59:27.842 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.c] 2023-11-28T12:59:27.842 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2023-11-28T12:59:27.842 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2023-11-28T12:59:27.842 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2023-11-28T12:59:27.842 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2023-11-28T12:59:27.842 INFO:teuthology.orchestra.run.smithi114.stdout:[mds] 2023-11-28T12:59:27.842 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds = 20 2023-11-28T12:59:27.842 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds balancer = 20 2023-11-28T12:59:27.842 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-11-28T12:59:27.843 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug frag = True 2023-11-28T12:59:27.843 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug scatterstat = True 2023-11-28T12:59:27.843 INFO:teuthology.orchestra.run.smithi114.stdout: mds op complaint time = 180 2023-11-28T12:59:27.843 INFO:teuthology.orchestra.run.smithi114.stdout: mds verify scatter = True 2023-11-28T12:59:27.843 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2023-11-28T12:59:27.843 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2023-11-28T12:59:27.843 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2023-11-28T12:59:27.843 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-28T12:59:27.843 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-28T12:59:27.929 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-28T12:59:27.930 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T12:59:27.930 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-28T12:59:27.936 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T12:59:27.936 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-28T12:59:27.942 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi082.front.sepia.ceph.com 2023-11-28T12:59:27.943 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T12:59:27.943 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T12:59:27.943 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T12:59:27.966 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T12:59:27.966 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:59:28.017 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi114.front.sepia.ceph.com 2023-11-28T12:59:28.017 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T12:59:28.017 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T12:59:28.017 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T12:59:28.045 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T12:59:28.046 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:59:28.095 INFO:tasks.ceph:Setting up mon nodes... 2023-11-28T12:59:28.095 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-28T12:59:28.096 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T12:59:28.146 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T12:59:28.149 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T12:59:28.200 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T12:59:28.214 INFO:tasks.ceph:Setting up mds nodes... 2023-11-28T12:59:28.214 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T12:59:28.264 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T12:59:28.266 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-28T12:59:28.279 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T12:59:28.322 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T12:59:28.325 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-28T12:59:28.336 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T12:59:28.385 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T12:59:28.388 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-28T12:59:28.402 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T12:59:28.447 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T12:59:28.451 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-28T12:59:28.465 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-28T12:59:28.466 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-28T12:59:28.506 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-28T12:59:28.519 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-28T12:59:28.604 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-28T12:59:28.618 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-28T12:59:28.659 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-28T12:59:28.673 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-28T12:59:28.710 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-28T12:59:28.722 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-28T12:59:28.722 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T12:59:28.722 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-28T12:59:28.738 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T12:59:28.739 INFO:tasks.ceph:role: osd.0 2023-11-28T12:59:28.739 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com 2023-11-28T12:59:28.739 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T12:59:29.269 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T12:59:29.269 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T12:59:29.269 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T12:59:29.269 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 2023-11-28T12:59:29.270 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T12:59:29.270 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2023-11-28T12:59:29.270 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T12:59:29.270 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T12:59:29.270 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T12:59:29.270 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T12:59:29.271 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2023-11-28T12:59:29.271 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-28T12:59:29.350 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-28T12:59:29.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:59:29.361 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T12:59:29.361 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-28T12:59:29.417 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T12:59:29.418 INFO:tasks.ceph:role: osd.1 2023-11-28T12:59:29.418 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com 2023-11-28T12:59:29.418 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T12:59:29.950 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T12:59:29.951 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T12:59:29.951 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T12:59:29.951 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 2023-11-28T12:59:29.951 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T12:59:29.951 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2023-11-28T12:59:29.951 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T12:59:29.951 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T12:59:29.952 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T12:59:29.952 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T12:59:29.952 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2023-11-28T12:59:29.953 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-28T12:59:29.995 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-28T12:59:30.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:59:30.049 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T12:59:30.049 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-28T12:59:30.060 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T12:59:30.060 INFO:tasks.ceph:role: osd.2 2023-11-28T12:59:30.060 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com 2023-11-28T12:59:30.060 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T12:59:30.528 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T12:59:30.528 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T12:59:30.528 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T12:59:30.528 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 2023-11-28T12:59:30.528 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T12:59:30.528 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2023-11-28T12:59:30.528 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T12:59:30.528 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T12:59:30.528 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T12:59:30.529 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T12:59:30.530 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2023-11-28T12:59:30.530 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-28T12:59:30.596 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-28T12:59:30.608 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:59:30.608 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T12:59:30.609 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-28T12:59:30.622 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T12:59:30.622 INFO:tasks.ceph:role: osd.3 2023-11-28T12:59:30.622 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi082.front.sepia.ceph.com 2023-11-28T12:59:30.622 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T12:59:31.131 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T12:59:31.131 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T12:59:31.131 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T12:59:31.131 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 2023-11-28T12:59:31.131 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T12:59:31.131 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2023-11-28T12:59:31.131 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T12:59:31.131 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T12:59:31.132 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T12:59:31.132 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T12:59:31.133 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2023-11-28T12:59:31.133 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-28T12:59:31.202 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-28T12:59:31.212 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T12:59:31.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:59:31.213 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:59:31.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:31.281+0000 7fd996b20700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-28T12:59:31.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:31.281+0000 7fd996b20700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-28T12:59:31.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:31.281+0000 7fd996b20700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T12:59:31.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:31.285+0000 7fd996b20700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T12:59:31.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:31.285+0000 7fd996b20700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T12:59:31.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:31.289+0000 7fd996b20700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-28T12:59:34.546 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-28T12:59:34.560 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:59:34.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:34.649+0000 7fdfc823f700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-28T12:59:34.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:34.649+0000 7fdfc823f700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-28T12:59:34.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:34.649+0000 7fdfc823f700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T12:59:34.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:34.649+0000 7fdfc823f700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T12:59:34.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:34.649+0000 7fdfc823f700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T12:59:34.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:34.649+0000 7fdfc823f700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-28T12:59:37.894 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-28T12:59:37.909 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:59:37.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:37.949+0000 7f44b29ec700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-28T12:59:37.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:37.949+0000 7f44b29ec700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-28T12:59:37.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:37.949+0000 7f44b29ec700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T12:59:37.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:37.949+0000 7f44b29ec700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T12:59:37.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:37.949+0000 7f44b29ec700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T12:59:37.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:37.949+0000 7f44b29ec700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-28T12:59:40.948 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-28T12:59:41.007 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:59:41.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:41.049+0000 7f17c0e5c700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-28T12:59:41.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:41.049+0000 7f17c0e5c700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-28T12:59:41.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:41.049+0000 7f17c0e5c700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T12:59:41.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:41.049+0000 7f17c0e5c700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T12:59:41.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:41.049+0000 7f17c0e5c700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T12:59:41.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T12:59:41.053+0000 7f17c0e5c700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-28T12:59:44.057 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-28T12:59:44.071 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-28T12:59:44.088 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T12:59:44.088 INFO:tasks.ceph:role: osd.4 2023-11-28T12:59:44.088 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com 2023-11-28T12:59:44.088 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T12:59:44.621 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T12:59:44.621 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T12:59:44.621 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T12:59:44.621 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 2023-11-28T12:59:44.621 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T12:59:44.621 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2023-11-28T12:59:44.621 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T12:59:44.622 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T12:59:44.622 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T12:59:44.622 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T12:59:44.623 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2023-11-28T12:59:44.623 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-28T12:59:44.726 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-28T12:59:44.738 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:59:44.738 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T12:59:44.738 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-28T12:59:44.748 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T12:59:44.748 INFO:tasks.ceph:role: osd.5 2023-11-28T12:59:44.748 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com 2023-11-28T12:59:44.748 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T12:59:45.291 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T12:59:45.291 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T12:59:45.291 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T12:59:45.292 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 2023-11-28T12:59:45.292 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T12:59:45.292 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2023-11-28T12:59:45.292 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T12:59:45.292 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T12:59:45.292 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T12:59:45.292 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T12:59:45.293 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2023-11-28T12:59:45.293 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-28T12:59:45.331 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-28T12:59:45.389 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T12:59:45.390 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:59:45.391 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-28T12:59:45.401 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T12:59:45.402 INFO:tasks.ceph:role: osd.6 2023-11-28T12:59:45.402 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com 2023-11-28T12:59:45.402 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T12:59:45.876 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T12:59:45.876 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T12:59:45.876 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T12:59:45.876 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 2023-11-28T12:59:45.876 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T12:59:45.876 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2023-11-28T12:59:45.876 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T12:59:45.877 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T12:59:45.877 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T12:59:45.877 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T12:59:45.878 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2023-11-28T12:59:45.878 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-28T12:59:45.944 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-28T12:59:45.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:59:45.955 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T12:59:45.956 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-28T12:59:45.967 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T12:59:45.967 INFO:tasks.ceph:role: osd.7 2023-11-28T12:59:45.967 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com 2023-11-28T12:59:45.967 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T12:59:46.502 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T12:59:46.502 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T12:59:46.502 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T12:59:46.502 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 2023-11-28T12:59:46.503 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T12:59:46.503 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2023-11-28T12:59:46.503 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T12:59:46.503 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T12:59:46.503 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T12:59:46.503 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T12:59:46.504 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2023-11-28T12:59:46.504 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-28T12:59:46.572 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-28T12:59:46.582 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:59:46.583 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T12:59:46.583 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:59:46.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:46.702+0000 7fce95d82700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-28T12:59:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:46.706+0000 7fce95d82700 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-28T12:59:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:46.710+0000 7fce95d82700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T12:59:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:46.710+0000 7fce95d82700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T12:59:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:46.710+0000 7fce95d82700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T12:59:46.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:46.714+0000 7fce95d82700 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-28T12:59:49.962 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-28T12:59:49.977 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:59:50.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:50.066+0000 7fdae11a1700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-28T12:59:50.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:50.066+0000 7fdae11a1700 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-28T12:59:50.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:50.066+0000 7fdae11a1700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T12:59:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:50.066+0000 7fdae11a1700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T12:59:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:50.066+0000 7fdae11a1700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T12:59:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:50.066+0000 7fdae11a1700 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-28T12:59:53.309 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-28T12:59:53.324 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:59:53.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:53.366+0000 7f3905c2c700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-28T12:59:53.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:53.366+0000 7f3905c2c700 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-28T12:59:53.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:53.366+0000 7f3905c2c700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T12:59:53.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:53.366+0000 7f3905c2c700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T12:59:53.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:53.366+0000 7f3905c2c700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T12:59:53.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:53.366+0000 7f3905c2c700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-28T12:59:56.404 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-28T12:59:56.462 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:59:56.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:56.506+0000 7f739ffec700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-28T12:59:56.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:56.506+0000 7f739ffec700 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-28T12:59:56.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:56.506+0000 7f739ffec700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T12:59:56.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:56.506+0000 7f739ffec700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T12:59:56.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:56.506+0000 7f739ffec700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T12:59:56.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T12:59:56.506+0000 7f739ffec700 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-28T12:59:56.955 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:59:56.958 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:59:59.767 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-28T12:59:59.780 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-28T12:59:59.781 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T12:59:59.781 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-28T12:59:59.797 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T12:59:59.797 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-28T12:59:59.806 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T12:59:59.806 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-28T12:59:59.818 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T12:59:59.818 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-28T12:59:59.876 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T12:59:59.877 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-28T12:59:59.886 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T12:59:59.886 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-28T12:59:59.901 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T12:59:59.901 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-28T12:59:59.914 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T12:59:59.914 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-28T12:59:59.930 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T12:59:59.930 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-28T12:59:59.945 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T12:59:59.945 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-28T12:59:59.957 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T12:59:59.957 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-28T12:59:59.967 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T12:59:59.967 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-28T12:59:59.980 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T12:59:59.980 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-28T12:59:59.994 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T12:59:59.994 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-28T13:00:00.050 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:00:00.050 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-28T13:00:00.056 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:00:00.057 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-28T13:00:00.104 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:00:00.104 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-28T13:00:00.111 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:00:00.111 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-28T13:00:00.117 INFO:tasks.ceph:Adding keys to all mons... 2023-11-28T13:00:00.118 DEBUG:teuthology.orchestra.run.smithi082:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T13:00:00.120 DEBUG:teuthology.orchestra.run.smithi114:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T13:00:00.130 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr.y] 2023-11-28T13:00:00.130 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAw5GVlpOu6CBAAlqY+m5+MrGgcRTUOT2+seQ== 2023-11-28T13:00:00.130 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2023-11-28T13:00:00.130 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAw5GVlCdS5DxAA6mejkVFcUsLxQRj3VIVjiA== 2023-11-28T13:00:00.130 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c] 2023-11-28T13:00:00.131 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAw5GVltTgvExAA5x6bGq3lWvWbwnvFAHNIHQ== 2023-11-28T13:00:00.131 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.0] 2023-11-28T13:00:00.131 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAz5GVlMpQBERAAim3Dp31FdCvBHZRLRmpUEA== 2023-11-28T13:00:00.131 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.1] 2023-11-28T13:00:00.131 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA25GVlbynJJhAAVPGWlzi2gCbAx8A2CtTDew== 2023-11-28T13:00:00.131 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.2] 2023-11-28T13:00:00.131 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA55GVl8le5OBAA6KTsYliyG4l1fqTHluWUgA== 2023-11-28T13:00:00.131 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.3] 2023-11-28T13:00:00.131 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA95GVlupEwAxAAb2UOrNbiicmvMKlJkWrwVA== 2023-11-28T13:00:00.131 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr.x] 2023-11-28T13:00:00.131 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAw5GVlas3pCxAAHp82YHi3DweifxetdtSMQg== 2023-11-28T13:00:00.131 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2023-11-28T13:00:00.132 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAw5GVls/voFhAAwSFuDQwvvCr9AWGJTcYVYA== 2023-11-28T13:00:00.132 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d] 2023-11-28T13:00:00.132 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAw5GVlT4ecGhAA/S/lIx6fXgbKUmDq6TXAag== 2023-11-28T13:00:00.132 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.4] 2023-11-28T13:00:00.132 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBC5GVlXgk5KhAAUhkPiT909nUDc/DQ2uITYQ== 2023-11-28T13:00:00.132 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.5] 2023-11-28T13:00:00.132 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBG5GVloYsaBBAAn1PYxCBVxsjA6Mmq/cnUrQ== 2023-11-28T13:00:00.132 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.6] 2023-11-28T13:00:00.132 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBJ5GVljJcAFhAAVy/GB5HhhbKfmXji0e+7sw== 2023-11-28T13:00:00.132 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.7] 2023-11-28T13:00:00.132 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBM5GVlNcBbHhAAvMcutUUBiQEgLHGFK4Nb7Q== 2023-11-28T13:00:00.132 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2023-11-28T13:00:00.132 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAw5GVlK0wtHhAAALaA+R3pU9RtJq4wvijo3Q== 2023-11-28T13:00:00.133 INFO:teuthology.orchestra.run.smithi082.stdout:[client.2] 2023-11-28T13:00:00.133 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAw5GVlOosGJBAAO019e3SgRbOsmZWZdVihpA== 2023-11-28T13:00:00.133 INFO:teuthology.orchestra.run.smithi082.stdout:[client.1] 2023-11-28T13:00:00.133 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAw5GVlb19GJxAApBeChk0RMz7CTiIBPNn+kQ== 2023-11-28T13:00:00.133 INFO:teuthology.orchestra.run.smithi082.stdout:[client.3] 2023-11-28T13:00:00.133 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAw5GVlf59HKhAAvROZEH3qiOM8RLS2pgNGxw== 2023-11-28T13:00:00.134 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.y] 2023-11-28T13:00:00.134 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAw5GVlpOu6CBAAlqY+m5+MrGgcRTUOT2+seQ== 2023-11-28T13:00:00.135 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2023-11-28T13:00:00.135 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAw5GVlCdS5DxAA6mejkVFcUsLxQRj3VIVjiA== 2023-11-28T13:00:00.135 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2023-11-28T13:00:00.135 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAw5GVltTgvExAA5x6bGq3lWvWbwnvFAHNIHQ== 2023-11-28T13:00:00.135 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.0] 2023-11-28T13:00:00.135 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAz5GVlMpQBERAAim3Dp31FdCvBHZRLRmpUEA== 2023-11-28T13:00:00.135 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.1] 2023-11-28T13:00:00.135 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQA25GVlbynJJhAAVPGWlzi2gCbAx8A2CtTDew== 2023-11-28T13:00:00.135 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.2] 2023-11-28T13:00:00.135 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQA55GVl8le5OBAA6KTsYliyG4l1fqTHluWUgA== 2023-11-28T13:00:00.135 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.3] 2023-11-28T13:00:00.135 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQA95GVlupEwAxAAb2UOrNbiicmvMKlJkWrwVA== 2023-11-28T13:00:00.135 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.x] 2023-11-28T13:00:00.136 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAw5GVlas3pCxAAHp82YHi3DweifxetdtSMQg== 2023-11-28T13:00:00.136 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2023-11-28T13:00:00.136 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAw5GVls/voFhAAwSFuDQwvvCr9AWGJTcYVYA== 2023-11-28T13:00:00.136 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2023-11-28T13:00:00.136 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAw5GVlT4ecGhAA/S/lIx6fXgbKUmDq6TXAag== 2023-11-28T13:00:00.136 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.4] 2023-11-28T13:00:00.136 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBC5GVlXgk5KhAAUhkPiT909nUDc/DQ2uITYQ== 2023-11-28T13:00:00.136 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.5] 2023-11-28T13:00:00.136 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBG5GVloYsaBBAAn1PYxCBVxsjA6Mmq/cnUrQ== 2023-11-28T13:00:00.136 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.6] 2023-11-28T13:00:00.136 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBJ5GVljJcAFhAAVy/GB5HhhbKfmXji0e+7sw== 2023-11-28T13:00:00.136 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.7] 2023-11-28T13:00:00.136 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBM5GVlNcBbHhAAvMcutUUBiQEgLHGFK4Nb7Q== 2023-11-28T13:00:00.136 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2023-11-28T13:00:00.137 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAw5GVlK0wtHhAAALaA+R3pU9RtJq4wvijo3Q== 2023-11-28T13:00:00.137 INFO:teuthology.orchestra.run.smithi114.stdout:[client.2] 2023-11-28T13:00:00.137 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAw5GVlOosGJBAAO019e3SgRbOsmZWZdVihpA== 2023-11-28T13:00:00.137 INFO:teuthology.orchestra.run.smithi114.stdout:[client.1] 2023-11-28T13:00:00.137 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAw5GVlb19GJxAApBeChk0RMz7CTiIBPNn+kQ== 2023-11-28T13:00:00.137 INFO:teuthology.orchestra.run.smithi114.stdout:[client.3] 2023-11-28T13:00:00.137 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAw5GVlf59HKhAAvROZEH3qiOM8RLS2pgNGxw== 2023-11-28T13:00:00.138 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T13:00:00.179 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T13:00:00.232 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T13:00:00.234 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T13:00:00.286 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T13:00:00.289 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T13:00:00.340 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T13:00:00.343 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T13:00:00.393 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T13:00:00.395 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T13:00:00.440 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T13:00:00.442 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T13:00:00.531 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T13:00:00.533 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T13:00:00.583 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T13:00:00.586 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T13:00:00.637 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T13:00:00.639 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T13:00:00.694 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T13:00:00.697 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T13:00:00.748 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T13:00:00.750 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T13:00:00.801 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T13:00:00.803 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T13:00:00.851 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T13:00:00.853 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T13:00:00.901 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T13:00:00.940 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T13:00:00.990 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T13:00:00.993 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T13:00:01.041 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T13:00:01.043 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T13:00:01.091 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T13:00:01.093 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T13:00:01.145 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T13:00:01.149 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T13:00:01.195 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-28T13:00:01.195 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-28T13:00:01.209 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T13:00:01.348 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-28T13:00:01.365 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-28T13:00:01.382 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T13:00:01.467 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-28T13:00:01.486 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-28T13:00:01.544 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T13:00:01.625 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-28T13:00:01.640 DEBUG:teuthology.orchestra.run.smithi082:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T13:00:01.642 DEBUG:teuthology.orchestra.run.smithi114:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T13:00:01.687 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-28T13:00:01.687 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T13:00:01.687 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T13:00:01.690 INFO:tasks.ceph.mon.a:Started 2023-11-28T13:00:01.690 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-28T13:00:01.690 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-28T13:00:01.692 INFO:tasks.ceph.mon.b:Started 2023-11-28T13:00:01.692 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T13:00:01.692 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T13:00:01.694 INFO:tasks.ceph.mon.c:Started 2023-11-28T13:00:01.694 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-28T13:00:01.695 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-28T13:00:01.695 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-28T13:00:01.697 INFO:tasks.ceph.mgr.y:Started 2023-11-28T13:00:01.697 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-28T13:00:01.697 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-28T13:00:01.699 INFO:tasks.ceph.mgr.x:Started 2023-11-28T13:00:01.699 INFO:tasks.ceph:Setting crush tunables to default 2023-11-28T13:00:01.699 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd crush tunables default 2023-11-28T13:00:01.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.797+0000 7fad66558700 1 Processor -- start 2023-11-28T13:00:01.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.797+0000 7fad66558700 1 -- start start 2023-11-28T13:00:01.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.801+0000 7fad66558700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fad60158eb0 0x7fad600c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:01.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.801+0000 7fad66558700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad600ae090 0x7fad600b0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:01.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.801+0000 7fad66558700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad600ad9b0 con 0x7fad600b0aa0 2023-11-28T13:00:01.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.801+0000 7fad66558700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad600adee0 con 0x7fad60158eb0 2023-11-28T13:00:01.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.801+0000 7fad66558700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad60159280 con 0x7fad600ae090 2023-11-28T13:00:01.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.801+0000 7fad65556700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fad60158eb0 0x7fad600c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:01.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.801+0000 7fad65d57700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fad600b0aa0 0x7fad60070000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53590/0 (socket says 172.21.15.82:53590) 2023-11-28T13:00:01.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.801+0000 7fad65d57700 1 -- 172.21.15.82:0/3140537 learned_addr learned my addr 172.21.15.82:0/3140537 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:01.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.801+0000 7fad64d55700 1 --2- 172.21.15.82:0/3140537 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad600ae090 0x7fad600b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:01.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.801+0000 7fad65556700 1 -- 172.21.15.82:0/3140537 >> v2:172.21.15.114:3300/0 conn(0x7fad60158eb0 msgr2=0x7fad600c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T13:00:01.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.801+0000 7fad65556700 1 -- 172.21.15.82:0/3140537 >> v2:172.21.15.114:3300/0 conn(0x7fad60158eb0 msgr2=0x7fad600c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T13:00:01.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.801+0000 7fad65556700 1 --2- 172.21.15.82:0/3140537 >> v2:172.21.15.114:3300/0 conn(0x7fad60158eb0 0x7fad600c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T13:00:01.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.801+0000 7fad65556700 1 --2- 172.21.15.82:0/3140537 >> v2:172.21.15.114:3300/0 conn(0x7fad60158eb0 0x7fad600c8c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T13:00:01.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.801+0000 7fad64d55700 1 -- 172.21.15.82:0/3140537 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad600ae090 msgr2=0x7fad600b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T13:00:01.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.801+0000 7fad64d55700 1 -- 172.21.15.82:0/3140537 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad600ae090 msgr2=0x7fad600b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T13:00:01.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.801+0000 7fad64d55700 1 --2- 172.21.15.82:0/3140537 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad600ae090 0x7fad600b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T13:00:01.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.801+0000 7fad64d55700 1 --2- 172.21.15.82:0/3140537 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad600ae090 0x7fad600b0560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T13:00:01.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.889+0000 7fad57fff700 1 -- 172.21.15.82:0/3140537 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258896137 0 0) 0x7fad600ad9b0 con 0x7fad600b0aa0 2023-11-28T13:00:01.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.889+0000 7fad57fff700 1 -- 172.21.15.82:0/3140537 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad4c0035d0 con 0x7fad600b0aa0 2023-11-28T13:00:01.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.889+0000 7fad57fff700 1 -- 172.21.15.82:0/3140537 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1129325786 0 0) 0x7fad4c0035d0 con 0x7fad600b0aa0 2023-11-28T13:00:01.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad57fff700 1 -- 172.21.15.82:0/3140537 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad600ae090 msgr2=0x7fad600b0560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T13:00:01.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad57fff700 1 --2- 172.21.15.82:0/3140537 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad600ae090 0x7fad600b0560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:01.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad57fff700 1 -- 172.21.15.82:0/3140537 >> v2:172.21.15.114:3300/0 conn(0x7fad60158eb0 msgr2=0x7fad600c8c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T13:00:01.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad57fff700 1 --2- 172.21.15.82:0/3140537 >> v2:172.21.15.114:3300/0 conn(0x7fad60158eb0 0x7fad600c8c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:01.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad57fff700 1 -- 172.21.15.82:0/3140537 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad60069e60 con 0x7fad600b0aa0 2023-11-28T13:00:01.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad57fff700 1 -- 172.21.15.82:0/3140537 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7fad580019f0 con 0x7fad600b0aa0 2023-11-28T13:00:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad57fff700 1 -- 172.21.15.82:0/3140537 >> v1:172.21.15.82:6789/0 conn(0x7fad600b0aa0 legacy=0x7fad60070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad57fff700 1 --2- 172.21.15.82:0/3140537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad4c003a20 0x7fad4c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad57fff700 1 --2- 172.21.15.82:0/3140537 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad600ae090 0x7fad4c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad57fff700 1 --2- 172.21.15.82:0/3140537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad4c004db0 0x7fad4c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad57fff700 1 -- 172.21.15.82:0/3140537 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad600adee0 con 0x7fad4c003a20 2023-11-28T13:00:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad57fff700 1 -- 172.21.15.82:0/3140537 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad60159280 con 0x7fad4c004db0 2023-11-28T13:00:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad57fff700 1 -- 172.21.15.82:0/3140537 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c00bb60 con 0x7fad600ae090 2023-11-28T13:00:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad65556700 1 --2- 172.21.15.82:0/3140537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad4c003a20 0x7fad4c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad65d57700 1 --2- 172.21.15.82:0/3140537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad4c004db0 0x7fad4c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad64d55700 1 --2- 172.21.15.82:0/3140537 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad600ae090 0x7fad4c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad65556700 1 -- 172.21.15.82:0/3140537 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad600ae090 msgr2=0x7fad4c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad65556700 1 --2- 172.21.15.82:0/3140537 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad600ae090 0x7fad4c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad65556700 1 -- 172.21.15.82:0/3140537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad4c004db0 msgr2=0x7fad4c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:01.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad65556700 1 --2- 172.21.15.82:0/3140537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad4c004db0 0x7fad4c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:01.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad65556700 1 -- 172.21.15.82:0/3140537 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c0035d0 con 0x7fad4c003a20 2023-11-28T13:00:01.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad65556700 1 --2- 172.21.15.82:0/3140537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad4c003a20 0x7fad4c003e30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fad5c009870 tx=0x7fad4c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f23a6e8feb83e6a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:01.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad57fff700 1 -- 172.21.15.82:0/3140537 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c00c070 con 0x7fad4c003a20 2023-11-28T13:00:01.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad57fff700 1 -- 172.21.15.82:0/3140537 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c013610 con 0x7fad4c003a20 2023-11-28T13:00:01.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.893+0000 7fad57fff700 1 -- 172.21.15.82:0/3140537 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c0139c0 con 0x7fad4c003a20 2023-11-28T13:00:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.897+0000 7fad66558700 1 -- 172.21.15.82:0/3140537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad4c003a20 msgr2=0x7fad4c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.897+0000 7fad66558700 1 --2- 172.21.15.82:0/3140537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad4c003a20 0x7fad4c003e30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fad5c009870 tx=0x7fad4c0058a0 comp rx=0 tx=0).stop 2023-11-28T13:00:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.897+0000 7fad65d57700 1 -- 172.21.15.82:0/3140537 reap_dead start 2023-11-28T13:00:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.897+0000 7fad66558700 1 -- 172.21.15.82:0/3140537 shutdown_connections 2023-11-28T13:00:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.897+0000 7fad66558700 1 -- 172.21.15.82:0/3140537 >> 172.21.15.82:0/3140537 conn(0x7fad600ce630 msgr2=0x7fad600cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.897+0000 7fad66558700 1 -- 172.21.15.82:0/3140537 shutdown_connections 2023-11-28T13:00:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.897+0000 7fad66558700 1 -- 172.21.15.82:0/3140537 wait complete. 2023-11-28T13:00:01.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.901+0000 7fad66558700 1 Processor -- start 2023-11-28T13:00:01.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.901+0000 7fad66558700 1 -- start start 2023-11-28T13:00:01.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.901+0000 7fad66558700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad4c003a20 0x7fad60166680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:01.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.901+0000 7fad66558700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad6015a1d0 0x7fad6015a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:01.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.901+0000 7fad66558700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad60146210 0x7fad60146680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:01.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.901+0000 7fad66558700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6015ab80 con 0x7fad60146210 2023-11-28T13:00:01.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.901+0000 7fad66558700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad60146bc0 con 0x7fad6015a1d0 2023-11-28T13:00:01.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.901+0000 7fad66558700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad60144980 con 0x7fad4c003a20 2023-11-28T13:00:01.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.901+0000 7fad65d57700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad60146210 0x7fad60146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:01.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.901+0000 7fad64d55700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad6015a1d0 0x7fad6015a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:01.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.901+0000 7fad65556700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad4c003a20 0x7fad60166680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:01.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.901+0000 7fad65d57700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad60146210 0x7fad60146680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37666/0 (socket says 172.21.15.82:37666) 2023-11-28T13:00:01.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.901+0000 7fad64d55700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad6015a1d0 0x7fad6015a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:51146/0 (socket says 172.21.15.82:51146) 2023-11-28T13:00:01.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.901+0000 7fad65d57700 1 -- 172.21.15.82:0/1441611193 learned_addr learned my addr 172.21.15.82:0/1441611193 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:01.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.901+0000 7fad65556700 1 -- 172.21.15.82:0/1441611193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad6015a1d0 msgr2=0x7fad6015a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:01.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.901+0000 7fad65556700 1 --2- 172.21.15.82:0/1441611193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad6015a1d0 0x7fad6015a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:01.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.901+0000 7fad65556700 1 -- 172.21.15.82:0/1441611193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad60146210 msgr2=0x7fad60146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:01.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.901+0000 7fad65556700 1 --2- 172.21.15.82:0/1441611193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad60146210 0x7fad60146680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:01.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.901+0000 7fad65556700 1 -- 172.21.15.82:0/1441611193 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad60071c90 con 0x7fad4c003a20 2023-11-28T13:00:01.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.905+0000 7fad65556700 1 --2- 172.21.15.82:0/1441611193 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad4c003a20 0x7fad60166680 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fad5c009100 tx=0x7fad5c0047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:01.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.905+0000 7fad55ffb700 1 -- 172.21.15.82:0/1441611193 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c013b90 con 0x7fad4c003a20 2023-11-28T13:00:01.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.905+0000 7fad55ffb700 1 -- 172.21.15.82:0/1441611193 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c013cf0 con 0x7fad4c003a20 2023-11-28T13:00:01.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.905+0000 7fad66558700 1 -- 172.21.15.82:0/1441611193 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad600adc00 con 0x7fad4c003a20 2023-11-28T13:00:01.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.905+0000 7fad55ffb700 1 -- 172.21.15.82:0/1441611193 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c0038e0 con 0x7fad4c003a20 2023-11-28T13:00:01.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.905+0000 7fad66558700 1 -- 172.21.15.82:0/1441611193 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad60071f70 con 0x7fad4c003a20 2023-11-28T13:00:01.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.905+0000 7fad55ffb700 1 -- 172.21.15.82:0/1441611193 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fad5c003a40 con 0x7fad4c003a20 2023-11-28T13:00:01.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.905+0000 7fad55ffb700 1 -- 172.21.15.82:0/1441611193 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fad5c01c7f0 con 0x7fad4c003a20 2023-11-28T13:00:01.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.905+0000 7fad66558700 1 -- 172.21.15.82:0/1441611193 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad60065fc0 con 0x7fad4c003a20 2023-11-28T13:00:01.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.909+0000 7fad55ffb700 1 -- 172.21.15.82:0/1441611193 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fad5c02c020 con 0x7fad4c003a20 2023-11-28T13:00:01.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.985+0000 7fad66558700 1 -- 172.21.15.82:0/1441611193 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fad6015c240 con 0x7fad4c003a20 2023-11-28T13:00:01.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.993+0000 7fad55ffb700 1 -- 172.21.15.82:0/1441611193 <== mon.2 v2:172.21.15.114:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fad5c017020 con 0x7fad4c003a20 2023-11-28T13:00:01.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.993+0000 7fad66558700 1 -- 172.21.15.82:0/1441611193 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad4c003a20 msgr2=0x7fad60166680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:01.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.993+0000 7fad66558700 1 --2- 172.21.15.82:0/1441611193 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad4c003a20 0x7fad60166680 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fad5c009100 tx=0x7fad5c0047e0 comp rx=0 tx=0).stop 2023-11-28T13:00:01.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.993+0000 7fad66558700 1 -- 172.21.15.82:0/1441611193 shutdown_connections 2023-11-28T13:00:01.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.993+0000 7fad66558700 1 --2- 172.21.15.82:0/1441611193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad60146210 0x7fad60146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:01.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.993+0000 7fad66558700 1 --2- 172.21.15.82:0/1441611193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad6015a1d0 0x7fad6015a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:01.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.993+0000 7fad66558700 1 --2- 172.21.15.82:0/1441611193 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad4c003a20 0x7fad60166680 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:01.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.993+0000 7fad66558700 1 -- 172.21.15.82:0/1441611193 >> 172.21.15.82:0/1441611193 conn(0x7fad600ce630 msgr2=0x7fad60154da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:01.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.993+0000 7fad66558700 1 -- 172.21.15.82:0/1441611193 shutdown_connections 2023-11-28T13:00:01.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:01.993+0000 7fad66558700 1 -- 172.21.15.82:0/1441611193 wait complete. 2023-11-28T13:00:01.998 INFO:teuthology.orchestra.run.smithi082.stderr:adjusted tunables profile to default 2023-11-28T13:00:02.014 INFO:tasks.ceph:check_enable_crimson: False 2023-11-28T13:00:02.014 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-28T13:00:02.015 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:00:02.015 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-28T13:00:02.027 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:00:02.027 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-28T13:00:02.041 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:00:02.042 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-28T13:00:02.055 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:00:02.055 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-28T13:00:02.092 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:02.089+0000 7f67cc7e42c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T13:00:02.105 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:00:02.105 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-28T13:00:02.111 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:02.106+0000 7f5930f3b2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T13:00:02.121 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:00:02.121 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-28T13:00:02.180 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:00:02.180 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-28T13:00:02.189 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:00:02.189 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-28T13:00:02.198 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new f0346359-05e2-462a-835a-2a98ce816643 0 2023-11-28T13:00:02.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.350+0000 7f5351cbe700 1 Processor -- start 2023-11-28T13:00:02.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.350+0000 7f5351cbe700 1 -- start start 2023-11-28T13:00:02.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.350+0000 7f5351cbe700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f534c15ac30 0x7f534c070a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:02.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.350+0000 7f5351cbe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f534c070f60 0x7f534c146150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:02.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.350+0000 7f5351cbe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f534c146690 0x7f534c06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:02.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.350+0000 7f5351cbe700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534c164220 con 0x7f534c070f60 2023-11-28T13:00:02.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.350+0000 7f5351cbe700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534c0713b0 con 0x7f534c146690 2023-11-28T13:00:02.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.350+0000 7f5351cbe700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c164430 con 0x7f534c15ac30 2023-11-28T13:00:02.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.350+0000 7f534bfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f534c146690 0x7f534c06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:02.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.350+0000 7f534b7fe700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f534c15ac30 0x7f534c070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:02.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.350+0000 7f534bfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f534c146690 0x7f534c06dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45426/0 (socket says 172.21.15.114:45426) 2023-11-28T13:00:02.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.350+0000 7f534bfff700 1 -- 172.21.15.114:0/144124958 learned_addr learned my addr 172.21.15.114:0/144124958 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-28T13:00:02.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f534affd700 1 --2- 172.21.15.114:0/144124958 >> v2:172.21.15.82:3300/0 conn(0x7f534c070f60 0x7f534c146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:02.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f534bfff700 1 -- 172.21.15.114:0/144124958 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f534c15ac30 msgr2=0x7f534c070a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:02.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f534bfff700 1 --2- 172.21.15.114:0/144124958 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f534c15ac30 0x7f534c070a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f534bfff700 1 -- 172.21.15.114:0/144124958 >> v2:172.21.15.82:3300/0 conn(0x7f534c070f60 msgr2=0x7f534c146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:02.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f534bfff700 1 --2- 172.21.15.114:0/144124958 >> v2:172.21.15.82:3300/0 conn(0x7f534c070f60 0x7f534c146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f534bfff700 1 -- 172.21.15.114:0/144124958 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c164710 con 0x7f534c146690 2023-11-28T13:00:02.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f534affd700 1 --2- 172.21.15.114:0/144124958 >> v2:172.21.15.82:3300/0 conn(0x7f534c070f60 0x7f534c146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:02.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f534bfff700 1 --2- 172.21.15.114:0/144124958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f534c146690 0x7f534c06dd50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f534c0709b0 tx=0x7f534400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=436459b9d4ed27d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:02.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f534a7fc700 1 -- 172.21.15.114:0/144124958 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534400e070 con 0x7f534c146690 2023-11-28T13:00:02.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f534a7fc700 1 -- 172.21.15.114:0/144124958 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534400b910 con 0x7f534c146690 2023-11-28T13:00:02.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f534a7fc700 1 -- 172.21.15.114:0/144124958 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534400bcc0 con 0x7f534c146690 2023-11-28T13:00:02.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f5351cbe700 1 -- 172.21.15.114:0/144124958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f534c146690 msgr2=0x7f534c06dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:02.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f5351cbe700 1 --2- 172.21.15.114:0/144124958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f534c146690 0x7f534c06dd50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f534c0709b0 tx=0x7f534400b330 comp rx=0 tx=0).stop 2023-11-28T13:00:02.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f5351cbe700 1 -- 172.21.15.114:0/144124958 shutdown_connections 2023-11-28T13:00:02.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f5351cbe700 1 --2- 172.21.15.114:0/144124958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f534c146690 0x7f534c06dd50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f5351cbe700 1 --2- 172.21.15.114:0/144124958 >> v2:172.21.15.82:3300/0 conn(0x7f534c070f60 0x7f534c146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f5351cbe700 1 --2- 172.21.15.114:0/144124958 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f534c15ac30 0x7f534c070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f5351cbe700 1 -- 172.21.15.114:0/144124958 >> 172.21.15.114:0/144124958 conn(0x7f534c0b18c0 msgr2=0x7f534c0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:02.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f5351cbe700 1 -- 172.21.15.114:0/144124958 shutdown_connections 2023-11-28T13:00:02.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f5351cbe700 1 -- 172.21.15.114:0/144124958 wait complete. 2023-11-28T13:00:02.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f5351cbe700 1 Processor -- start 2023-11-28T13:00:02.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.354+0000 7f5351cbe700 1 -- start start 2023-11-28T13:00:02.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f5351cbe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f534c070f60 0x7f534c1637d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:02.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f5351cbe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f534c146690 0x7f534c0c7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:02.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f5351cbe700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f534c15ac30 0x7f534c0b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:02.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f5351cbe700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c0b2990 con 0x7f534c146690 2023-11-28T13:00:02.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f5351cbe700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c163d10 con 0x7f534c070f60 2023-11-28T13:00:02.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f5351cbe700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c0b2060 con 0x7f534c15ac30 2023-11-28T13:00:02.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f534b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f534c070f60 0x7f534c1637d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:02.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f534b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f534c070f60 0x7f534c1637d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45432/0 (socket says 172.21.15.114:45432) 2023-11-28T13:00:02.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f534b7fe700 1 -- 172.21.15.114:0/1605160549 learned_addr learned my addr 172.21.15.114:0/1605160549 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-28T13:00:02.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f534bfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f534c15ac30 0x7f534c0b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:02.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f534affd700 1 --2- 172.21.15.114:0/1605160549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f534c146690 0x7f534c0c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:02.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f534b7fe700 1 -- 172.21.15.114:0/1605160549 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f534c15ac30 msgr2=0x7f534c0b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:02.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f534b7fe700 1 --2- 172.21.15.114:0/1605160549 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f534c15ac30 0x7f534c0b3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f534b7fe700 1 -- 172.21.15.114:0/1605160549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f534c146690 msgr2=0x7f534c0c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:02.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f534b7fe700 1 --2- 172.21.15.114:0/1605160549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f534c146690 0x7f534c0c7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f534b7fe700 1 -- 172.21.15.114:0/1605160549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5344009b30 con 0x7f534c070f60 2023-11-28T13:00:02.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f534bfff700 1 --2- 172.21.15.114:0/1605160549 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f534c15ac30 0x7f534c0b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:02.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f534b7fe700 1 --2- 172.21.15.114:0/1605160549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f534c070f60 0x7f534c1637d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f533c00e9d0 tx=0x7f533c00ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:02.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f5333fff700 1 -- 172.21.15.114:0/1605160549 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c009720 con 0x7f534c070f60 2023-11-28T13:00:02.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f5333fff700 1 -- 172.21.15.114:0/1605160549 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c00c850 con 0x7f534c070f60 2023-11-28T13:00:02.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f5351cbe700 1 -- 172.21.15.114:0/1605160549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534c164cd0 con 0x7f534c070f60 2023-11-28T13:00:02.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f5333fff700 1 -- 172.21.15.114:0/1605160549 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c00cbc0 con 0x7f534c070f60 2023-11-28T13:00:02.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f5351cbe700 1 -- 172.21.15.114:0/1605160549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534c1649f0 con 0x7f534c070f60 2023-11-28T13:00:02.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f5333fff700 1 -- 172.21.15.114:0/1605160549 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f533c019030 con 0x7f534c070f60 2023-11-28T13:00:02.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f5333fff700 1 -- 172.21.15.114:0/1605160549 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f533c0066a0 con 0x7f534c070f60 2023-11-28T13:00:02.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.358+0000 7f5351cbe700 1 -- 172.21.15.114:0/1605160549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534c143e00 con 0x7f534c070f60 2023-11-28T13:00:02.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.362+0000 7f5333fff700 1 -- 172.21.15.114:0/1605160549 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f533c021060 con 0x7f534c070f60 2023-11-28T13:00:02.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.438+0000 7f5351cbe700 1 -- 172.21.15.114:0/1605160549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f0346359-05e2-462a-835a-2a98ce816643", "id": 0} v 0) v1 -- 0x7f534c073e20 con 0x7f534c070f60 2023-11-28T13:00:02.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.446+0000 7f5333fff700 1 -- 172.21.15.114:0/1605160549 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f0346359-05e2-462a-835a-2a98ce816643", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f533c017070 con 0x7f534c070f60 2023-11-28T13:00:02.452 INFO:teuthology.orchestra.run.smithi114.stdout:0 2023-11-28T13:00:02.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.446+0000 7f5351cbe700 1 -- 172.21.15.114:0/1605160549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f534c070f60 msgr2=0x7f534c1637d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:02.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.446+0000 7f5351cbe700 1 --2- 172.21.15.114:0/1605160549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f534c070f60 0x7f534c1637d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f533c00e9d0 tx=0x7f533c00ece0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.446+0000 7f5351cbe700 1 -- 172.21.15.114:0/1605160549 shutdown_connections 2023-11-28T13:00:02.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.446+0000 7f5351cbe700 1 --2- 172.21.15.114:0/1605160549 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f534c15ac30 0x7f534c0b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.446+0000 7f5351cbe700 1 --2- 172.21.15.114:0/1605160549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f534c146690 0x7f534c0c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.450+0000 7f5351cbe700 1 --2- 172.21.15.114:0/1605160549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f534c070f60 0x7f534c1637d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.450+0000 7f5351cbe700 1 -- 172.21.15.114:0/1605160549 >> 172.21.15.114:0/1605160549 conn(0x7f534c0b18c0 msgr2=0x7f534c0c4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:02.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.450+0000 7f5351cbe700 1 -- 172.21.15.114:0/1605160549 shutdown_connections 2023-11-28T13:00:02.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.450+0000 7f5351cbe700 1 -- 172.21.15.114:0/1605160549 wait complete. 2023-11-28T13:00:02.467 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new d796feec-c9a1-4ef0-999a-fd6ecd844f39 1 2023-11-28T13:00:02.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f0271a06700 1 Processor -- start 2023-11-28T13:00:02.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f0271a06700 1 -- start start 2023-11-28T13:00:02.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f0271a06700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f026c06caa0 0x7f026c069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:02.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f0271a06700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026c0ccb60 con 0x7f026c1500e0 2023-11-28T13:00:02.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f0271a06700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026c0ca930 con 0x7f026c06ce70 2023-11-28T13:00:02.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f0271a06700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026c0cac10 con 0x7f026c06caa0 2023-11-28T13:00:02.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f026bfff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f026c06ce70 0x7f026c14f9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:39426/0 (socket says 172.21.15.114:39426) 2023-11-28T13:00:02.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f0270a04700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f026c06caa0 0x7f026c069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:02.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f026bfff700 1 -- 172.21.15.114:0/2139927767 learned_addr learned my addr 172.21.15.114:0/2139927767 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-28T13:00:02.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f026b7fe700 1 -- 172.21.15.114:0/2139927767 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434840125 0 0) 0x7f026c0ca930 con 0x7f026c06ce70 2023-11-28T13:00:02.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f026b7fe700 1 -- 172.21.15.114:0/2139927767 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f025c0035d0 con 0x7f026c06ce70 2023-11-28T13:00:02.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f0270a04700 1 -- 172.21.15.114:0/2139927767 >> v1:172.21.15.114:6789/0 conn(0x7f026c06ce70 legacy=0x7f026c14f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:02.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f0270a04700 1 -- 172.21.15.114:0/2139927767 >> v1:172.21.15.82:6789/0 conn(0x7f026c1500e0 legacy=0x7f026c0c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:02.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f0270a04700 1 -- 172.21.15.114:0/2139927767 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026c0caef0 con 0x7f026c06caa0 2023-11-28T13:00:02.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f0270a04700 1 --2- 172.21.15.114:0/2139927767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026c06caa0 0x7f026c069bc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0260009850 tx=0x7f0260009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c36e4f91f0aefc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:02.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f026b7fe700 1 -- 172.21.15.114:0/2139927767 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0260011830 con 0x7f026c06caa0 2023-11-28T13:00:02.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f026b7fe700 1 -- 172.21.15.114:0/2139927767 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0260011990 con 0x7f026c06caa0 2023-11-28T13:00:02.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f026b7fe700 1 -- 172.21.15.114:0/2139927767 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0260011d40 con 0x7f026c06caa0 2023-11-28T13:00:02.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f0271a06700 1 -- 172.21.15.114:0/2139927767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026c06caa0 msgr2=0x7f026c069bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:02.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f0271a06700 1 --2- 172.21.15.114:0/2139927767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026c06caa0 0x7f026c069bc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0260009850 tx=0x7f0260009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:02.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f0271a06700 1 -- 172.21.15.114:0/2139927767 shutdown_connections 2023-11-28T13:00:02.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f0271a06700 1 --2- 172.21.15.114:0/2139927767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026c06caa0 0x7f026c069bc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f0271a06700 1 -- 172.21.15.114:0/2139927767 >> 172.21.15.114:0/2139927767 conn(0x7f026c0cb890 msgr2=0x7f026c0cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:02.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f0271a06700 1 -- 172.21.15.114:0/2139927767 shutdown_connections 2023-11-28T13:00:02.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.574+0000 7f0271a06700 1 -- 172.21.15.114:0/2139927767 wait complete. 2023-11-28T13:00:02.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0271a06700 1 Processor -- start 2023-11-28T13:00:02.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0271a06700 1 -- start start 2023-11-28T13:00:02.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0271a06700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f026c06caa0 0x7f026c0ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:02.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0271a06700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f026c06ce70 0x7f026c1f5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:02.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0271a06700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026c1500e0 0x7f026c14f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:02.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0271a06700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c1566e0 con 0x7f026c06ce70 2023-11-28T13:00:02.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0271a06700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c1f56d0 con 0x7f026c1500e0 2023-11-28T13:00:02.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0271a06700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026c14f880 con 0x7f026c06caa0 2023-11-28T13:00:02.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0270a04700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f026c06caa0 0x7f026c0ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:02.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0271205700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026c1500e0 0x7f026c14f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:02.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0270a04700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f026c06caa0 0x7f026c0ae250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.114:34214/0 (socket says 172.21.15.114:34214) 2023-11-28T13:00:02.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0270a04700 1 -- 172.21.15.114:0/1269843654 learned_addr learned my addr 172.21.15.114:0/1269843654 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-28T13:00:02.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0271205700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026c1500e0 0x7f026c14f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45454/0 (socket says 172.21.15.114:45454) 2023-11-28T13:00:02.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f026bfff700 1 --2- 172.21.15.114:0/1269843654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f026c06ce70 0x7f026c1f5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:02.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0271205700 1 -- 172.21.15.114:0/1269843654 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f026c06caa0 msgr2=0x7f026c0ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:02.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0271205700 1 --2- 172.21.15.114:0/1269843654 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f026c06caa0 0x7f026c0ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0271205700 1 -- 172.21.15.114:0/1269843654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f026c06ce70 msgr2=0x7f026c1f5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:02.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0271205700 1 --2- 172.21.15.114:0/1269843654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f026c06ce70 0x7f026c1f5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0271205700 1 -- 172.21.15.114:0/1269843654 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02600094b0 con 0x7f026c1500e0 2023-11-28T13:00:02.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0270a04700 1 --2- 172.21.15.114:0/1269843654 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f026c06caa0 0x7f026c0ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:02.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0271205700 1 --2- 172.21.15.114:0/1269843654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026c1500e0 0x7f026c14f340 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f026400cae0 tx=0x7f026400cdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:02.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f02697fa700 1 -- 172.21.15.114:0/1269843654 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0264003c20 con 0x7f026c1500e0 2023-11-28T13:00:02.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f02697fa700 1 -- 172.21.15.114:0/1269843654 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0264003d80 con 0x7f026c1500e0 2023-11-28T13:00:02.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0271a06700 1 -- 172.21.15.114:0/1269843654 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026c0ca310 con 0x7f026c1500e0 2023-11-28T13:00:02.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f02697fa700 1 -- 172.21.15.114:0/1269843654 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026400aa20 con 0x7f026c1500e0 2023-11-28T13:00:02.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0271a06700 1 -- 172.21.15.114:0/1269843654 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026c0ccdb0 con 0x7f026c1500e0 2023-11-28T13:00:02.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f02697fa700 1 -- 172.21.15.114:0/1269843654 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f0264010050 con 0x7f026c1500e0 2023-11-28T13:00:02.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f02697fa700 1 -- 172.21.15.114:0/1269843654 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f0264005880 con 0x7f026c1500e0 2023-11-28T13:00:02.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.578+0000 7f0271a06700 1 -- 172.21.15.114:0/1269843654 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026c0ca4a0 con 0x7f026c1500e0 2023-11-28T13:00:02.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.582+0000 7f02697fa700 1 -- 172.21.15.114:0/1269843654 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f02640050d0 con 0x7f026c1500e0 2023-11-28T13:00:02.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.658+0000 7f0271a06700 1 -- 172.21.15.114:0/1269843654 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d796feec-c9a1-4ef0-999a-fd6ecd844f39", "id": 1} v 0) v1 -- 0x7f026c065fc0 con 0x7f026c1500e0 2023-11-28T13:00:02.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.666+0000 7f02697fa700 1 -- 172.21.15.114:0/1269843654 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d796feec-c9a1-4ef0-999a-fd6ecd844f39", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0264005270 con 0x7f026c1500e0 2023-11-28T13:00:02.672 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-11-28T13:00:02.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.670+0000 7f0271a06700 1 -- 172.21.15.114:0/1269843654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026c1500e0 msgr2=0x7f026c14f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:02.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.670+0000 7f0271a06700 1 --2- 172.21.15.114:0/1269843654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026c1500e0 0x7f026c14f340 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f026400cae0 tx=0x7f026400cdf0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.670+0000 7f0271a06700 1 -- 172.21.15.114:0/1269843654 shutdown_connections 2023-11-28T13:00:02.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.670+0000 7f0271a06700 1 --2- 172.21.15.114:0/1269843654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026c1500e0 0x7f026c14f340 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.670+0000 7f0271a06700 1 --2- 172.21.15.114:0/1269843654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f026c06ce70 0x7f026c1f5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.670+0000 7f0271a06700 1 --2- 172.21.15.114:0/1269843654 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f026c06caa0 0x7f026c0ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.670+0000 7f0271a06700 1 -- 172.21.15.114:0/1269843654 >> 172.21.15.114:0/1269843654 conn(0x7f026c0cb890 msgr2=0x7f026c0af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:02.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.670+0000 7f0271a06700 1 -- 172.21.15.114:0/1269843654 shutdown_connections 2023-11-28T13:00:02.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.670+0000 7f0271a06700 1 -- 172.21.15.114:0/1269843654 wait complete. 2023-11-28T13:00:02.690 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new d5527c57-1b08-46b1-a9ca-237581f84c3e 2 2023-11-28T13:00:02.723 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:02.721+0000 7f67cc7e42c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T13:00:02.762 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:02.758+0000 7f5930f3b2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T13:00:02.781 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:02.777+0000 7f67cc7e42c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T13:00:02.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.794+0000 7f5b276ec700 1 Processor -- start 2023-11-28T13:00:02.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.794+0000 7f5b276ec700 1 -- start start 2023-11-28T13:00:02.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b276ec700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5b2006dd50 0x7f5b200c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:02.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b276ec700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5b200ccbf0 0x7f5b2006e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:02.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b276ec700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b200cd120 0x7f5b200ca180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:02.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b276ec700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b200c4fb0 con 0x7f5b2006dd50 2023-11-28T13:00:02.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b276ec700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b2015d560 con 0x7f5b200ccbf0 2023-11-28T13:00:02.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b276ec700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b200c45e0 con 0x7f5b200cd120 2023-11-28T13:00:02.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b24c87700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5b200ccbf0 0x7f5b2006e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:02.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b25c89700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b200cd120 0x7f5b200ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:02.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b24c87700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5b200ccbf0 0x7f5b2006e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45464/0 (socket says 172.21.15.114:45464) 2023-11-28T13:00:02.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b24c87700 1 -- 172.21.15.114:0/1482872066 learned_addr learned my addr 172.21.15.114:0/1482872066 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-28T13:00:02.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b25488700 1 --2- 172.21.15.114:0/1482872066 >> v2:172.21.15.82:3300/0 conn(0x7f5b2006dd50 0x7f5b200c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:02.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b24c87700 1 -- 172.21.15.114:0/1482872066 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b200cd120 msgr2=0x7f5b200ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:02.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b24c87700 1 --2- 172.21.15.114:0/1482872066 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b200cd120 0x7f5b200ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b24c87700 1 -- 172.21.15.114:0/1482872066 >> v2:172.21.15.82:3300/0 conn(0x7f5b2006dd50 msgr2=0x7f5b200c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:02.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b24c87700 1 --2- 172.21.15.114:0/1482872066 >> v2:172.21.15.82:3300/0 conn(0x7f5b2006dd50 0x7f5b200c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b24c87700 1 -- 172.21.15.114:0/1482872066 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2006f440 con 0x7f5b200ccbf0 2023-11-28T13:00:02.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b25c89700 1 --2- 172.21.15.114:0/1482872066 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b200cd120 0x7f5b200ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:02.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b25488700 1 --2- 172.21.15.114:0/1482872066 >> v2:172.21.15.82:3300/0 conn(0x7f5b2006dd50 0x7f5b200c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:02.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b24c87700 1 --2- 172.21.15.114:0/1482872066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b200ccbf0 0x7f5b2006e120 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5b200b51f0 tx=0x7f5b10009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20dfb9d1fcc2d1b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:02.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b17fff700 1 -- 172.21.15.114:0/1482872066 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10011830 con 0x7f5b200ccbf0 2023-11-28T13:00:02.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b17fff700 1 -- 172.21.15.114:0/1482872066 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b10011990 con 0x7f5b200ccbf0 2023-11-28T13:00:02.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b17fff700 1 -- 172.21.15.114:0/1482872066 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10011d20 con 0x7f5b200ccbf0 2023-11-28T13:00:02.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b276ec700 1 -- 172.21.15.114:0/1482872066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b200ccbf0 msgr2=0x7f5b2006e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:02.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b276ec700 1 --2- 172.21.15.114:0/1482872066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b200ccbf0 0x7f5b2006e120 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5b200b51f0 tx=0x7f5b10009bf0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b276ec700 1 -- 172.21.15.114:0/1482872066 shutdown_connections 2023-11-28T13:00:02.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b276ec700 1 --2- 172.21.15.114:0/1482872066 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b200cd120 0x7f5b200ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b276ec700 1 --2- 172.21.15.114:0/1482872066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b200ccbf0 0x7f5b2006e120 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b276ec700 1 --2- 172.21.15.114:0/1482872066 >> v2:172.21.15.82:3300/0 conn(0x7f5b2006dd50 0x7f5b200c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b276ec700 1 -- 172.21.15.114:0/1482872066 >> 172.21.15.114:0/1482872066 conn(0x7f5b200b18c0 msgr2=0x7f5b200cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:02.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b276ec700 1 -- 172.21.15.114:0/1482872066 shutdown_connections 2023-11-28T13:00:02.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.798+0000 7f5b276ec700 1 -- 172.21.15.114:0/1482872066 wait complete. 2023-11-28T13:00:02.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b276ec700 1 Processor -- start 2023-11-28T13:00:02.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b276ec700 1 -- start start 2023-11-28T13:00:02.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b276ec700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b2006dd50 0x7f5b200c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:02.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b276ec700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b200ccbf0 0x7f5b2014dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:02.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b276ec700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b200cd120 0x7f5b2014d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:02.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b276ec700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b201e3f70 con 0x7f5b200ccbf0 2023-11-28T13:00:02.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b276ec700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b200c7ec0 con 0x7f5b2006dd50 2023-11-28T13:00:02.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b276ec700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2014e0f0 con 0x7f5b200cd120 2023-11-28T13:00:02.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b25488700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b2006dd50 0x7f5b200c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:02.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b25c89700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b200cd120 0x7f5b2014d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:02.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b25c89700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b200cd120 0x7f5b2014d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.114:34232/0 (socket says 172.21.15.114:34232) 2023-11-28T13:00:02.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b25c89700 1 -- 172.21.15.114:0/4204524841 learned_addr learned my addr 172.21.15.114:0/4204524841 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-28T13:00:02.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b25488700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b2006dd50 0x7f5b200c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45478/0 (socket says 172.21.15.114:45478) 2023-11-28T13:00:02.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b24c87700 1 --2- 172.21.15.114:0/4204524841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b200ccbf0 0x7f5b2014dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:02.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b25488700 1 -- 172.21.15.114:0/4204524841 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b200cd120 msgr2=0x7f5b2014d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:02.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b25488700 1 --2- 172.21.15.114:0/4204524841 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b200cd120 0x7f5b2014d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b25488700 1 -- 172.21.15.114:0/4204524841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b200ccbf0 msgr2=0x7f5b2014dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:02.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b25488700 1 --2- 172.21.15.114:0/4204524841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b200ccbf0 0x7f5b2014dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b25488700 1 -- 172.21.15.114:0/4204524841 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b18009a70 con 0x7f5b2006dd50 2023-11-28T13:00:02.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b25c89700 1 --2- 172.21.15.114:0/4204524841 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b200cd120 0x7f5b2014d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:02.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b25488700 1 --2- 172.21.15.114:0/4204524841 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b2006dd50 0x7f5b200c8a00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c010680 tx=0x7f5b1c010990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:02.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b15ffb700 1 -- 172.21.15.114:0/4204524841 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c004230 con 0x7f5b2006dd50 2023-11-28T13:00:02.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b276ec700 1 -- 172.21.15.114:0/4204524841 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b10009570 con 0x7f5b2006dd50 2023-11-28T13:00:02.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b15ffb700 1 -- 172.21.15.114:0/4204524841 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c004390 con 0x7f5b2006dd50 2023-11-28T13:00:02.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b15ffb700 1 -- 172.21.15.114:0/4204524841 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c0036c0 con 0x7f5b2006dd50 2023-11-28T13:00:02.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b276ec700 1 -- 172.21.15.114:0/4204524841 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b200c3fd0 con 0x7f5b2006dd50 2023-11-28T13:00:02.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b15ffb700 1 -- 172.21.15.114:0/4204524841 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f5b1c003b10 con 0x7f5b2006dd50 2023-11-28T13:00:02.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.802+0000 7f5b15ffb700 1 -- 172.21.15.114:0/4204524841 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f5b1c019850 con 0x7f5b2006dd50 2023-11-28T13:00:02.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.806+0000 7f5b276ec700 1 -- 172.21.15.114:0/4204524841 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2015da90 con 0x7f5b2006dd50 2023-11-28T13:00:02.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.810+0000 7f5b15ffb700 1 -- 172.21.15.114:0/4204524841 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f5b1c027060 con 0x7f5b2006dd50 2023-11-28T13:00:02.820 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:02.814+0000 7f5930f3b2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T13:00:02.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.886+0000 7f5b276ec700 1 -- 172.21.15.114:0/4204524841 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d5527c57-1b08-46b1-a9ca-237581f84c3e", "id": 2} v 0) v1 -- 0x7f5b200cebd0 con 0x7f5b2006dd50 2023-11-28T13:00:02.899 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:02.897+0000 7f67cc7e42c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T13:00:02.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.898+0000 7f5b15ffb700 1 -- 172.21.15.114:0/4204524841 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d5527c57-1b08-46b1-a9ca-237581f84c3e", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5b1c019430 con 0x7f5b2006dd50 2023-11-28T13:00:02.901 INFO:teuthology.orchestra.run.smithi114.stdout:2 2023-11-28T13:00:02.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.898+0000 7f5b276ec700 1 -- 172.21.15.114:0/4204524841 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b2006dd50 msgr2=0x7f5b200c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:02.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.898+0000 7f5b276ec700 1 --2- 172.21.15.114:0/4204524841 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b2006dd50 0x7f5b200c8a00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c010680 tx=0x7f5b1c010990 comp rx=0 tx=0).stop 2023-11-28T13:00:02.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.898+0000 7f5b276ec700 1 -- 172.21.15.114:0/4204524841 shutdown_connections 2023-11-28T13:00:02.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.898+0000 7f5b276ec700 1 --2- 172.21.15.114:0/4204524841 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b200cd120 0x7f5b2014d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.898+0000 7f5b276ec700 1 --2- 172.21.15.114:0/4204524841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b200ccbf0 0x7f5b2014dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.898+0000 7f5b276ec700 1 --2- 172.21.15.114:0/4204524841 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b2006dd50 0x7f5b200c8a00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:02.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.898+0000 7f5b276ec700 1 -- 172.21.15.114:0/4204524841 >> 172.21.15.114:0/4204524841 conn(0x7f5b200b18c0 msgr2=0x7f5b2006a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:02.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.898+0000 7f5b276ec700 1 -- 172.21.15.114:0/4204524841 shutdown_connections 2023-11-28T13:00:02.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:02.898+0000 7f5b276ec700 1 -- 172.21.15.114:0/4204524841 wait complete. 2023-11-28T13:00:02.915 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new 2fc42c69-ef00-4571-8936-19e4a078f577 3 2023-11-28T13:00:02.934 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:02.930+0000 7f5930f3b2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T13:00:03.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.018+0000 7fb5f759e700 1 Processor -- start 2023-11-28T13:00:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.018+0000 7fb5f759e700 1 -- start start 2023-11-28T13:00:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5f8160750 0x7fb5f80d0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f759e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5f806bc70 0x7fb5f80b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f759e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f80ce400 con 0x7fb5f806c780 2023-11-28T13:00:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f759e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f80c4220 con 0x7fb5f806bc70 2023-11-28T13:00:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80cec10 con 0x7fb5f8160750 2023-11-28T13:00:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f659c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5f8160750 0x7fb5f80d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f659c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5f8160750 0x7fb5f80d0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.114:34242/0 (socket says 172.21.15.114:34242) 2023-11-28T13:00:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f659c700 1 -- 172.21.15.114:0/2050469371 learned_addr learned my addr 172.21.15.114:0/2050469371 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-28T13:00:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f6d9d700 1 --2- 172.21.15.114:0/2050469371 >> v2:172.21.15.82:3300/0 conn(0x7fb5f806bc70 0x7fb5f80b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f659c700 1 -- 172.21.15.114:0/2050469371 >> v2:172.21.15.82:3300/0 conn(0x7fb5f806bc70 msgr2=0x7fb5f80b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f659c700 1 --2- 172.21.15.114:0/2050469371 >> v2:172.21.15.82:3300/0 conn(0x7fb5f806bc70 0x7fb5f80b0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f659c700 1 -- 172.21.15.114:0/2050469371 >> v1:172.21.15.82:6789/0 conn(0x7fb5f806c780 legacy=0x7fb5f806b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f659c700 1 -- 172.21.15.114:0/2050469371 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f80d0540 con 0x7fb5f8160750 2023-11-28T13:00:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f659c700 1 --2- 172.21.15.114:0/2050469371 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5f8160750 0x7fb5f80d0000 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8009910 tx=0x7fb5e8009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44274a414e5c064b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f559a700 1 -- 172.21.15.114:0/2050469371 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8011830 con 0x7fb5f8160750 2023-11-28T13:00:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f559a700 1 -- 172.21.15.114:0/2050469371 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e8011990 con 0x7fb5f8160750 2023-11-28T13:00:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f559a700 1 -- 172.21.15.114:0/2050469371 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8011d40 con 0x7fb5f8160750 2023-11-28T13:00:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f759e700 1 -- 172.21.15.114:0/2050469371 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5f8160750 msgr2=0x7fb5f80d0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f759e700 1 --2- 172.21.15.114:0/2050469371 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5f8160750 0x7fb5f80d0000 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8009910 tx=0x7fb5e8009c20 comp rx=0 tx=0).stop 2023-11-28T13:00:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f759e700 1 -- 172.21.15.114:0/2050469371 shutdown_connections 2023-11-28T13:00:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f759e700 1 --2- 172.21.15.114:0/2050469371 >> v2:172.21.15.82:3300/0 conn(0x7fb5f806bc70 0x7fb5f80b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f759e700 1 --2- 172.21.15.114:0/2050469371 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5f8160750 0x7fb5f80d0000 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f759e700 1 -- 172.21.15.114:0/2050469371 >> 172.21.15.114:0/2050469371 conn(0x7fb5f80cdf40 msgr2=0x7fb5f80d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f759e700 1 -- 172.21.15.114:0/2050469371 shutdown_connections 2023-11-28T13:00:03.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.022+0000 7fb5f759e700 1 -- 172.21.15.114:0/2050469371 wait complete. 2023-11-28T13:00:03.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5f759e700 1 Processor -- start 2023-11-28T13:00:03.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5f759e700 1 -- start start 2023-11-28T13:00:03.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5f759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5f806bc70 0x7fb5f80ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5f759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5f806c780 0x7fb5f80c1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5f759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5f8160750 0x7fb5f80c0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5f759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80bf590 con 0x7fb5f806c780 2023-11-28T13:00:03.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5f759e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80bf870 con 0x7fb5f806bc70 2023-11-28T13:00:03.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5f759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80bfb50 con 0x7fb5f8160750 2023-11-28T13:00:03.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5f659c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5f806bc70 0x7fb5f80ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5f6d9d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5f8160750 0x7fb5f80c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5f659c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5f806bc70 0x7fb5f80ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45484/0 (socket says 172.21.15.114:45484) 2023-11-28T13:00:03.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5f659c700 1 -- 172.21.15.114:0/2511372392 learned_addr learned my addr 172.21.15.114:0/2511372392 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-28T13:00:03.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5f5d9b700 1 --2- 172.21.15.114:0/2511372392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5f806c780 0x7fb5f80c1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5f6d9d700 1 -- 172.21.15.114:0/2511372392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5f806bc70 msgr2=0x7fb5f80ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5f6d9d700 1 --2- 172.21.15.114:0/2511372392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5f806bc70 0x7fb5f80ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5f6d9d700 1 -- 172.21.15.114:0/2511372392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5f806c780 msgr2=0x7fb5f80c1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5f6d9d700 1 --2- 172.21.15.114:0/2511372392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5f806c780 0x7fb5f80c1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5f6d9d700 1 -- 172.21.15.114:0/2511372392 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e8009570 con 0x7fb5f8160750 2023-11-28T13:00:03.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5f6d9d700 1 --2- 172.21.15.114:0/2511372392 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5f8160750 0x7fb5f80c0630 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000efc0 tx=0x7fb5f000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:03.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5e6ffd700 1 -- 172.21.15.114:0/2511372392 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f000cc90 con 0x7fb5f8160750 2023-11-28T13:00:03.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5e6ffd700 1 -- 172.21.15.114:0/2511372392 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f000f040 con 0x7fb5f8160750 2023-11-28T13:00:03.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5f759e700 1 -- 172.21.15.114:0/2511372392 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f806c320 con 0x7fb5f8160750 2023-11-28T13:00:03.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5e6ffd700 1 -- 172.21.15.114:0/2511372392 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00146c0 con 0x7fb5f8160750 2023-11-28T13:00:03.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5f759e700 1 -- 172.21.15.114:0/2511372392 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f806d500 con 0x7fb5f8160750 2023-11-28T13:00:03.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5e6ffd700 1 -- 172.21.15.114:0/2511372392 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fb5f0014820 con 0x7fb5f8160750 2023-11-28T13:00:03.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.026+0000 7fb5e6ffd700 1 -- 172.21.15.114:0/2511372392 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fb5f001d630 con 0x7fb5f8160750 2023-11-28T13:00:03.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.034+0000 7fb5f759e700 1 -- 172.21.15.114:0/2511372392 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f80ce650 con 0x7fb5f8160750 2023-11-28T13:00:03.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.034+0000 7fb5e6ffd700 1 -- 172.21.15.114:0/2511372392 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fb5f003bb00 con 0x7fb5f8160750 2023-11-28T13:00:03.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.114+0000 7fb5f759e700 1 -- 172.21.15.114:0/2511372392 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2fc42c69-ef00-4571-8936-19e4a078f577", "id": 3} v 0) v1 -- 0x7fb5f80cf6d0 con 0x7fb5f8160750 2023-11-28T13:00:03.130 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:03.129+0000 7f67cc7e42c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T13:00:03.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.126+0000 7fb5e6ffd700 1 -- 172.21.15.114:0/2511372392 <== mon.2 v2:172.21.15.114:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2fc42c69-ef00-4571-8936-19e4a078f577", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb5f002a070 con 0x7fb5f8160750 2023-11-28T13:00:03.131 INFO:teuthology.orchestra.run.smithi114.stdout:3 2023-11-28T13:00:03.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.126+0000 7fb5f759e700 1 -- 172.21.15.114:0/2511372392 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5f8160750 msgr2=0x7fb5f80c0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.126+0000 7fb5f759e700 1 --2- 172.21.15.114:0/2511372392 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5f8160750 0x7fb5f80c0630 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000efc0 tx=0x7fb5f000c3a0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.126+0000 7fb5f759e700 1 -- 172.21.15.114:0/2511372392 shutdown_connections 2023-11-28T13:00:03.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.126+0000 7fb5f759e700 1 --2- 172.21.15.114:0/2511372392 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5f8160750 0x7fb5f80c0630 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.126+0000 7fb5f759e700 1 --2- 172.21.15.114:0/2511372392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5f806c780 0x7fb5f80c1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.126+0000 7fb5f759e700 1 --2- 172.21.15.114:0/2511372392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5f806bc70 0x7fb5f80ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.126+0000 7fb5f759e700 1 -- 172.21.15.114:0/2511372392 >> 172.21.15.114:0/2511372392 conn(0x7fb5f80cdf40 msgr2=0x7fb5f815f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:03.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.126+0000 7fb5f759e700 1 -- 172.21.15.114:0/2511372392 shutdown_connections 2023-11-28T13:00:03.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.126+0000 7fb5f759e700 1 -- 172.21.15.114:0/2511372392 wait complete. 2023-11-28T13:00:03.146 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new e75dc42f-d78f-44f0-8660-c8c0bd22520f 4 2023-11-28T13:00:03.162 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:03.158+0000 7f5930f3b2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T13:00:03.180 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:03.177+0000 7f67cc7e42c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T13:00:03.213 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:03.210+0000 7f5930f3b2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T13:00:03.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce7fff700 1 Processor -- start 2023-11-28T13:00:03.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce7fff700 1 -- start start 2023-11-28T13:00:03.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce7fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbce003b7e0 0x7fbce00520d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce7fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbce0054d90 0x7fbce0037d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce7fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce0038290 con 0x7fbce0037900 2023-11-28T13:00:03.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce7fff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce00e40f0 con 0x7fbce0054d90 2023-11-28T13:00:03.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce7fff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce00e3b70 con 0x7fbce003b7e0 2023-11-28T13:00:03.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce6ffd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbce003b7e0 0x7fbce00520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce67fc700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbce0037900 0x7fbce0007e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:39436/0 (socket says 172.21.15.114:39436) 2023-11-28T13:00:03.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce67fc700 1 -- 172.21.15.114:0/1065481804 learned_addr learned my addr 172.21.15.114:0/1065481804 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-28T13:00:03.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce77fe700 1 --2- 172.21.15.114:0/1065481804 >> v2:172.21.15.82:3300/0 conn(0x7fbce0054d90 0x7fbce0037d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce5ffb700 1 -- 172.21.15.114:0/1065481804 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744793281 0 0) 0x7fbcdc001110 con 0x7fbce0037900 2023-11-28T13:00:03.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce5ffb700 1 -- 172.21.15.114:0/1065481804 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcd00035d0 con 0x7fbce0037900 2023-11-28T13:00:03.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce6ffd700 1 -- 172.21.15.114:0/1065481804 >> v2:172.21.15.82:3300/0 conn(0x7fbce0054d90 msgr2=0x7fbce0037d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:03.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce6ffd700 1 --2- 172.21.15.114:0/1065481804 >> v2:172.21.15.82:3300/0 conn(0x7fbce0054d90 0x7fbce0037d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce6ffd700 1 -- 172.21.15.114:0/1065481804 >> v1:172.21.15.114:6789/0 conn(0x7fbce0037900 legacy=0x7fbce0007e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce6ffd700 1 -- 172.21.15.114:0/1065481804 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce0050c50 con 0x7fbce003b7e0 2023-11-28T13:00:03.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce6ffd700 1 --2- 172.21.15.114:0/1065481804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbce003b7e0 0x7fbce00520d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbce000f170 tx=0x7fbcd8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e2d50dee980bd7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:03.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce5ffb700 1 -- 172.21.15.114:0/1065481804 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8011830 con 0x7fbce003b7e0 2023-11-28T13:00:03.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce5ffb700 1 -- 172.21.15.114:0/1065481804 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd8011990 con 0x7fbce003b7e0 2023-11-28T13:00:03.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce5ffb700 1 -- 172.21.15.114:0/1065481804 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8011d20 con 0x7fbce003b7e0 2023-11-28T13:00:03.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce7fff700 1 -- 172.21.15.114:0/1065481804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbce003b7e0 msgr2=0x7fbce00520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.250+0000 7fbce7fff700 1 --2- 172.21.15.114:0/1065481804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbce003b7e0 0x7fbce00520d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbce000f170 tx=0x7fbcd8009b30 comp rx=0 tx=0).stop 2023-11-28T13:00:03.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce7fff700 1 -- 172.21.15.114:0/1065481804 shutdown_connections 2023-11-28T13:00:03.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce7fff700 1 --2- 172.21.15.114:0/1065481804 >> v2:172.21.15.82:3300/0 conn(0x7fbce0054d90 0x7fbce0037d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce7fff700 1 --2- 172.21.15.114:0/1065481804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbce003b7e0 0x7fbce00520d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce7fff700 1 -- 172.21.15.114:0/1065481804 >> 172.21.15.114:0/1065481804 conn(0x7fbce0052900 msgr2=0x7fbce0052d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:03.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce7fff700 1 -- 172.21.15.114:0/1065481804 shutdown_connections 2023-11-28T13:00:03.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce7fff700 1 -- 172.21.15.114:0/1065481804 wait complete. 2023-11-28T13:00:03.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce7fff700 1 Processor -- start 2023-11-28T13:00:03.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce7fff700 1 -- start start 2023-11-28T13:00:03.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce7fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbce0037900 0x7fbce00d2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbce003b7e0 0x7fbce00e15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbce0054d90 0x7fbce00362f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce7fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce00d98a0 con 0x7fbce0054d90 2023-11-28T13:00:03.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce7fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce0049d00 con 0x7fbce003b7e0 2023-11-28T13:00:03.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce7fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce0049fe0 con 0x7fbce0037900 2023-11-28T13:00:03.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce6ffd700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbce0037900 0x7fbce00d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce6ffd700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbce0037900 0x7fbce00d2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.114:34262/0 (socket says 172.21.15.114:34262) 2023-11-28T13:00:03.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce67fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbce003b7e0 0x7fbce00e15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce6ffd700 1 -- 172.21.15.114:0/2777028356 learned_addr learned my addr 172.21.15.114:0/2777028356 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-28T13:00:03.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce77fe700 1 --2- 172.21.15.114:0/2777028356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbce0054d90 0x7fbce00362f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce67fc700 1 -- 172.21.15.114:0/2777028356 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbce0037900 msgr2=0x7fbce00d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce67fc700 1 --2- 172.21.15.114:0/2777028356 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbce0037900 0x7fbce00d2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce67fc700 1 -- 172.21.15.114:0/2777028356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbce0054d90 msgr2=0x7fbce00362f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce67fc700 1 --2- 172.21.15.114:0/2777028356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbce0054d90 0x7fbce00362f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce67fc700 1 -- 172.21.15.114:0/2777028356 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd80094b0 con 0x7fbce003b7e0 2023-11-28T13:00:03.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce67fc700 1 --2- 172.21.15.114:0/2777028356 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbce003b7e0 0x7fbce00e15c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00c410 tx=0x7fbcdc00c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:03.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbccf7fe700 1 -- 172.21.15.114:0/2777028356 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc005d90 con 0x7fbce003b7e0 2023-11-28T13:00:03.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbccf7fe700 1 -- 172.21.15.114:0/2777028356 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc00ce10 con 0x7fbce003b7e0 2023-11-28T13:00:03.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbccf7fe700 1 -- 172.21.15.114:0/2777028356 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc0072f0 con 0x7fbce003b7e0 2023-11-28T13:00:03.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce7fff700 1 -- 172.21.15.114:0/2777028356 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce00e3e10 con 0x7fbce003b7e0 2023-11-28T13:00:03.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbce7fff700 1 -- 172.21.15.114:0/2777028356 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce00356b0 con 0x7fbce003b7e0 2023-11-28T13:00:03.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbccf7fe700 1 -- 172.21.15.114:0/2777028356 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fbcdc010070 con 0x7fbce003b7e0 2023-11-28T13:00:03.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.254+0000 7fbccf7fe700 1 -- 172.21.15.114:0/2777028356 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fbcdc01a870 con 0x7fbce003b7e0 2023-11-28T13:00:03.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.258+0000 7fbce7fff700 1 -- 172.21.15.114:0/2777028356 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce0050600 con 0x7fbce003b7e0 2023-11-28T13:00:03.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.258+0000 7fbccf7fe700 1 -- 172.21.15.114:0/2777028356 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fbcdc017070 con 0x7fbce003b7e0 2023-11-28T13:00:03.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.330+0000 7fbce7fff700 1 -- 172.21.15.114:0/2777028356 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e75dc42f-d78f-44f0-8660-c8c0bd22520f", "id": 4} v 0) v1 -- 0x7fbce0050e10 con 0x7fbce003b7e0 2023-11-28T13:00:03.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.334+0000 7fbccf7fe700 1 -- 172.21.15.114:0/2777028356 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e75dc42f-d78f-44f0-8660-c8c0bd22520f", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbce0038290 con 0x7fbce003b7e0 2023-11-28T13:00:03.341 INFO:teuthology.orchestra.run.smithi114.stdout:4 2023-11-28T13:00:03.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.338+0000 7fbce7fff700 1 -- 172.21.15.114:0/2777028356 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbce003b7e0 msgr2=0x7fbce00e15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.338+0000 7fbce7fff700 1 --2- 172.21.15.114:0/2777028356 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbce003b7e0 0x7fbce00e15c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00c410 tx=0x7fbcdc00c720 comp rx=0 tx=0).stop 2023-11-28T13:00:03.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.338+0000 7fbce7fff700 1 -- 172.21.15.114:0/2777028356 shutdown_connections 2023-11-28T13:00:03.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.338+0000 7fbce7fff700 1 --2- 172.21.15.114:0/2777028356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbce0054d90 0x7fbce00362f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.338+0000 7fbce7fff700 1 --2- 172.21.15.114:0/2777028356 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbce003b7e0 0x7fbce00e15c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.338+0000 7fbce7fff700 1 --2- 172.21.15.114:0/2777028356 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbce0037900 0x7fbce00d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.338+0000 7fbce7fff700 1 -- 172.21.15.114:0/2777028356 >> 172.21.15.114:0/2777028356 conn(0x7fbce0052900 msgr2=0x7fbce0005110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:03.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.338+0000 7fbce7fff700 1 -- 172.21.15.114:0/2777028356 shutdown_connections 2023-11-28T13:00:03.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.338+0000 7fbce7fff700 1 -- 172.21.15.114:0/2777028356 wait complete. 2023-11-28T13:00:03.356 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new a5a1c7bb-1023-4612-b514-c08962299656 5 2023-11-28T13:00:03.362 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:03.361+0000 7f67cc7e42c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T13:00:03.417 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:03.414+0000 7f5930f3b2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T13:00:03.424 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:03.421+0000 7f67cc7e42c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T13:00:03.483 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:03.478+0000 7f5930f3b2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T13:00:03.487 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:03.485+0000 7f67cc7e42c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T13:00:03.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.506+0000 7fc1d0033700 1 Processor -- start 2023-11-28T13:00:03.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.506+0000 7fc1d0033700 1 -- start start 2023-11-28T13:00:03.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.506+0000 7fc1d0033700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc1c80ced60 0x7fc1c806b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.506+0000 7fc1d0033700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1c806bd40 0x7fc1c80d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.506+0000 7fc1d0033700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c806af10 con 0x7fc1c815fcb0 2023-11-28T13:00:03.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.506+0000 7fc1d0033700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c80cf1e0 con 0x7fc1c80ced60 2023-11-28T13:00:03.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.506+0000 7fc1d0033700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c806c1c0 con 0x7fc1c806bd40 2023-11-28T13:00:03.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.506+0000 7fc1ce5d0700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1c806bd40 0x7fc1c80d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.506+0000 7fc1ce5d0700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1c806bd40 0x7fc1c80d0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.114:34266/0 (socket says 172.21.15.114:34266) 2023-11-28T13:00:03.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.506+0000 7fc1ce5d0700 1 -- 172.21.15.114:0/2495948308 learned_addr learned my addr 172.21.15.114:0/2495948308 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-28T13:00:03.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.506+0000 7fc1cd5ce700 1 --2- 172.21.15.114:0/2495948308 >> v2:172.21.15.82:3300/0 conn(0x7fc1c80ced60 0x7fc1c806b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.506+0000 7fc1ce5d0700 1 -- 172.21.15.114:0/2495948308 >> v2:172.21.15.82:3300/0 conn(0x7fc1c80ced60 msgr2=0x7fc1c806b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:03.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.506+0000 7fc1ce5d0700 1 --2- 172.21.15.114:0/2495948308 >> v2:172.21.15.82:3300/0 conn(0x7fc1c80ced60 0x7fc1c806b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.506+0000 7fc1ce5d0700 1 -- 172.21.15.114:0/2495948308 >> v1:172.21.15.82:6789/0 conn(0x7fc1c815fcb0 legacy=0x7fc1c80cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.506+0000 7fc1ce5d0700 1 -- 172.21.15.114:0/2495948308 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c80cd910 con 0x7fc1c806bd40 2023-11-28T13:00:03.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.506+0000 7fc1ce5d0700 1 --2- 172.21.15.114:0/2495948308 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1c806bd40 0x7fc1c80d0d20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009e50 tx=0x7fc1c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fb3a9e4b9dfbdc7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:03.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.506+0000 7fc1ccdcd700 1 -- 172.21.15.114:0/2495948308 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c000e070 con 0x7fc1c806bd40 2023-11-28T13:00:03.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.506+0000 7fc1ccdcd700 1 -- 172.21.15.114:0/2495948308 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c000b910 con 0x7fc1c806bd40 2023-11-28T13:00:03.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.506+0000 7fc1ccdcd700 1 -- 172.21.15.114:0/2495948308 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c000bcc0 con 0x7fc1c806bd40 2023-11-28T13:00:03.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.510+0000 7fc1d0033700 1 -- 172.21.15.114:0/2495948308 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1c806bd40 msgr2=0x7fc1c80d0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.510+0000 7fc1d0033700 1 --2- 172.21.15.114:0/2495948308 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1c806bd40 0x7fc1c80d0d20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009e50 tx=0x7fc1c000b330 comp rx=0 tx=0).stop 2023-11-28T13:00:03.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.510+0000 7fc1d0033700 1 -- 172.21.15.114:0/2495948308 shutdown_connections 2023-11-28T13:00:03.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.510+0000 7fc1d0033700 1 --2- 172.21.15.114:0/2495948308 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1c806bd40 0x7fc1c80d0d20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.510+0000 7fc1d0033700 1 --2- 172.21.15.114:0/2495948308 >> v2:172.21.15.82:3300/0 conn(0x7fc1c80ced60 0x7fc1c806b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.510+0000 7fc1d0033700 1 -- 172.21.15.114:0/2495948308 >> 172.21.15.114:0/2495948308 conn(0x7fc1c80d02c0 msgr2=0x7fc1c80d2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:03.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.510+0000 7fc1d0033700 1 -- 172.21.15.114:0/2495948308 shutdown_connections 2023-11-28T13:00:03.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.510+0000 7fc1d0033700 1 -- 172.21.15.114:0/2495948308 wait complete. 2023-11-28T13:00:03.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.510+0000 7fc1d0033700 1 Processor -- start 2023-11-28T13:00:03.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.510+0000 7fc1d0033700 1 -- start start 2023-11-28T13:00:03.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.510+0000 7fc1d0033700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1c806bd40 0x7fc1c81f2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.510+0000 7fc1d0033700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1c80ced60 0x7fc1c815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.510+0000 7fc1d0033700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1c815fcb0 0x7fc1c815b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.510+0000 7fc1d0033700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c81589b0 con 0x7fc1c80ced60 2023-11-28T13:00:03.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.510+0000 7fc1d0033700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c80b2240 con 0x7fc1c815fcb0 2023-11-28T13:00:03.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.510+0000 7fc1d0033700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c81f2e70 con 0x7fc1c806bd40 2023-11-28T13:00:03.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.510+0000 7fc1cddcf700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1c806bd40 0x7fc1c81f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.510+0000 7fc1cddcf700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1c806bd40 0x7fc1c81f2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.114:34278/0 (socket says 172.21.15.114:34278) 2023-11-28T13:00:03.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.510+0000 7fc1cddcf700 1 -- 172.21.15.114:0/2489472092 learned_addr learned my addr 172.21.15.114:0/2489472092 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-28T13:00:03.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.510+0000 7fc1ce5d0700 1 --2- 172.21.15.114:0/2489472092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1c815fcb0 0x7fc1c815b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.510+0000 7fc1cd5ce700 1 --2- 172.21.15.114:0/2489472092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1c80ced60 0x7fc1c815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.514+0000 7fc1cddcf700 1 -- 172.21.15.114:0/2489472092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1c815fcb0 msgr2=0x7fc1c815b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.514+0000 7fc1cddcf700 1 --2- 172.21.15.114:0/2489472092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1c815fcb0 0x7fc1c815b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.514+0000 7fc1cddcf700 1 -- 172.21.15.114:0/2489472092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1c80ced60 msgr2=0x7fc1c815ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.514+0000 7fc1cddcf700 1 --2- 172.21.15.114:0/2489472092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1c80ced60 0x7fc1c815ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.514+0000 7fc1cddcf700 1 -- 172.21.15.114:0/2489472092 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c0009b30 con 0x7fc1c806bd40 2023-11-28T13:00:03.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.514+0000 7fc1ce5d0700 1 --2- 172.21.15.114:0/2489472092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1c815fcb0 0x7fc1c815b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:03.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.514+0000 7fc1cddcf700 1 --2- 172.21.15.114:0/2489472092 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1c806bd40 0x7fc1c81f2930 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400c500 tx=0x7fc1c400c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:03.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.514+0000 7fc1be7fc700 1 -- 172.21.15.114:0/2489472092 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c40052d0 con 0x7fc1c806bd40 2023-11-28T13:00:03.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.514+0000 7fc1be7fc700 1 -- 172.21.15.114:0/2489472092 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c4005430 con 0x7fc1c806bd40 2023-11-28T13:00:03.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.514+0000 7fc1d0033700 1 -- 172.21.15.114:0/2489472092 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c806a670 con 0x7fc1c806bd40 2023-11-28T13:00:03.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.514+0000 7fc1be7fc700 1 -- 172.21.15.114:0/2489472092 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c40055a0 con 0x7fc1c806bd40 2023-11-28T13:00:03.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.514+0000 7fc1d0033700 1 -- 172.21.15.114:0/2489472092 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c80d0820 con 0x7fc1c806bd40 2023-11-28T13:00:03.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.514+0000 7fc1be7fc700 1 -- 172.21.15.114:0/2489472092 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fc1c4019030 con 0x7fc1c806bd40 2023-11-28T13:00:03.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.514+0000 7fc1be7fc700 1 -- 172.21.15.114:0/2489472092 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fc1c4011d40 con 0x7fc1c806bd40 2023-11-28T13:00:03.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.514+0000 7fc1d0033700 1 -- 172.21.15.114:0/2489472092 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c806a950 con 0x7fc1c806bd40 2023-11-28T13:00:03.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.518+0000 7fc1be7fc700 1 -- 172.21.15.114:0/2489472092 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fc1c4017070 con 0x7fc1c806bd40 2023-11-28T13:00:03.560 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:03.554+0000 7f5930f3b2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T13:00:03.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.594+0000 7fc1d0033700 1 -- 172.21.15.114:0/2489472092 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a5a1c7bb-1023-4612-b514-c08962299656", "id": 5} v 0) v1 -- 0x7fc1c80b8670 con 0x7fc1c806bd40 2023-11-28T13:00:03.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.602+0000 7fc1be7fc700 1 -- 172.21.15.114:0/2489472092 <== mon.2 v2:172.21.15.114:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a5a1c7bb-1023-4612-b514-c08962299656", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc1c40117c0 con 0x7fc1c806bd40 2023-11-28T13:00:03.610 INFO:teuthology.orchestra.run.smithi114.stdout:5 2023-11-28T13:00:03.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.606+0000 7fc1d0033700 1 -- 172.21.15.114:0/2489472092 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1c806bd40 msgr2=0x7fc1c81f2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.606+0000 7fc1d0033700 1 --2- 172.21.15.114:0/2489472092 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1c806bd40 0x7fc1c81f2930 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400c500 tx=0x7fc1c400c810 comp rx=0 tx=0).stop 2023-11-28T13:00:03.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.606+0000 7fc1d0033700 1 -- 172.21.15.114:0/2489472092 shutdown_connections 2023-11-28T13:00:03.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.606+0000 7fc1d0033700 1 --2- 172.21.15.114:0/2489472092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1c815fcb0 0x7fc1c815b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.606+0000 7fc1d0033700 1 --2- 172.21.15.114:0/2489472092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1c80ced60 0x7fc1c815ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.606+0000 7fc1d0033700 1 --2- 172.21.15.114:0/2489472092 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1c806bd40 0x7fc1c81f2930 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.606+0000 7fc1d0033700 1 -- 172.21.15.114:0/2489472092 >> 172.21.15.114:0/2489472092 conn(0x7fc1c80d02c0 msgr2=0x7fc1c80b6270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:03.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.606+0000 7fc1d0033700 1 -- 172.21.15.114:0/2489472092 shutdown_connections 2023-11-28T13:00:03.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.606+0000 7fc1d0033700 1 -- 172.21.15.114:0/2489472092 wait complete. 2023-11-28T13:00:03.624 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new d0fd94dd-a682-4b21-866a-9a1c6dd593bf 6 2023-11-28T13:00:03.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.726+0000 7f672bfff700 1 Processor -- start 2023-11-28T13:00:03.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.726+0000 7f672bfff700 1 -- start start 2023-11-28T13:00:03.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.726+0000 7f672bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f672c06d3d0 0x7f672c06d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.726+0000 7f672bfff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672c06dd60 con 0x7f672c158ff0 2023-11-28T13:00:03.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.726+0000 7f672bfff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672c0ce870 con 0x7f672c06ba90 2023-11-28T13:00:03.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.726+0000 7f672bfff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f672c1593c0 con 0x7f672c06d3d0 2023-11-28T13:00:03.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.726+0000 7f672b7fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f672c06ba90 0x7f672c06bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:39444/0 (socket says 172.21.15.114:39444) 2023-11-28T13:00:03.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.726+0000 7f672b7fe700 1 -- 172.21.15.114:0/2418898789 learned_addr learned my addr 172.21.15.114:0/2418898789 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-28T13:00:03.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.726+0000 7f672a7fc700 1 --2- 172.21.15.114:0/2418898789 >> v2:172.21.15.82:3300/0 conn(0x7f672c06d3d0 0x7f672c06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f6729ffb700 1 -- 172.21.15.114:0/2418898789 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296776739 0 0) 0x7f671c001110 con 0x7f672c158ff0 2023-11-28T13:00:03.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f6729ffb700 1 -- 172.21.15.114:0/2418898789 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67140035d0 con 0x7f672c158ff0 2023-11-28T13:00:03.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f6729ffb700 1 -- 172.21.15.114:0/2418898789 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850974047 0 0) 0x7f672c0ce870 con 0x7f672c06ba90 2023-11-28T13:00:03.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f6729ffb700 1 -- 172.21.15.114:0/2418898789 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f671c001110 con 0x7f672c06ba90 2023-11-28T13:00:03.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672a7fc700 1 -- 172.21.15.114:0/2418898789 >> v1:172.21.15.114:6789/0 conn(0x7f672c06ba90 legacy=0x7f672c06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672a7fc700 1 -- 172.21.15.114:0/2418898789 >> v1:172.21.15.82:6789/0 conn(0x7f672c158ff0 legacy=0x7f672c15d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672a7fc700 1 -- 172.21.15.114:0/2418898789 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c0cd9c0 con 0x7f672c06d3d0 2023-11-28T13:00:03.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672a7fc700 1 --2- 172.21.15.114:0/2418898789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672c06d3d0 0x7f672c06d820 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6720009850 tx=0x7f6720009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5164c6bc1902229 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:03.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f6729ffb700 1 -- 172.21.15.114:0/2418898789 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6720011830 con 0x7f672c06d3d0 2023-11-28T13:00:03.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f6729ffb700 1 -- 172.21.15.114:0/2418898789 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6720011990 con 0x7f672c06d3d0 2023-11-28T13:00:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f6729ffb700 1 -- 172.21.15.114:0/2418898789 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6720011d40 con 0x7f672c06d3d0 2023-11-28T13:00:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672bfff700 1 -- 172.21.15.114:0/2418898789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672c06d3d0 msgr2=0x7f672c06d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672bfff700 1 --2- 172.21.15.114:0/2418898789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672c06d3d0 0x7f672c06d820 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6720009850 tx=0x7f6720009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672bfff700 1 -- 172.21.15.114:0/2418898789 shutdown_connections 2023-11-28T13:00:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672bfff700 1 --2- 172.21.15.114:0/2418898789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672c06d3d0 0x7f672c06d820 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672bfff700 1 -- 172.21.15.114:0/2418898789 >> 172.21.15.114:0/2418898789 conn(0x7f672c0cf710 msgr2=0x7f672c0cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672bfff700 1 -- 172.21.15.114:0/2418898789 shutdown_connections 2023-11-28T13:00:03.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672bfff700 1 -- 172.21.15.114:0/2418898789 wait complete. 2023-11-28T13:00:03.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672bfff700 1 Processor -- start 2023-11-28T13:00:03.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672bfff700 1 -- start start 2023-11-28T13:00:03.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f672c06ba90 0x7f672c0b4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672bfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f672c06d3d0 0x7f672c1ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672c158ff0 0x7f672c0c36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672bfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c1ed620 con 0x7f672c158ff0 2023-11-28T13:00:03.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672bfff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c0b25e0 con 0x7f672c06ba90 2023-11-28T13:00:03.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672bfff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672c0c3be0 con 0x7f672c06d3d0 2023-11-28T13:00:03.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f672c06ba90 0x7f672c0b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672a7fc700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f672c06d3d0 0x7f672c1ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f672c06ba90 0x7f672c0b4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45530/0 (socket says 172.21.15.114:45530) 2023-11-28T13:00:03.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672c158ff0 0x7f672c0c36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.730+0000 7f672affd700 1 -- 172.21.15.114:0/1186924372 learned_addr learned my addr 172.21.15.114:0/1186924372 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-28T13:00:03.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.734+0000 7f672affd700 1 -- 172.21.15.114:0/1186924372 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f672c06d3d0 msgr2=0x7f672c1ed0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.734+0000 7f672affd700 1 --2- 172.21.15.114:0/1186924372 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f672c06d3d0 0x7f672c1ed0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.734+0000 7f672affd700 1 -- 172.21.15.114:0/1186924372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672c158ff0 msgr2=0x7f672c0c36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.734+0000 7f672affd700 1 --2- 172.21.15.114:0/1186924372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672c158ff0 0x7f672c0c36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.734+0000 7f672affd700 1 -- 172.21.15.114:0/1186924372 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67200094b0 con 0x7f672c06ba90 2023-11-28T13:00:03.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.734+0000 7f672affd700 1 --2- 172.21.15.114:0/1186924372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f672c06ba90 0x7f672c0b4870 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f671c00c700 tx=0x7f671c00ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:03.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.734+0000 7f67137fe700 1 -- 172.21.15.114:0/1186924372 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c0052d0 con 0x7f672c06ba90 2023-11-28T13:00:03.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.734+0000 7f67137fe700 1 -- 172.21.15.114:0/1186924372 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c005450 con 0x7f672c06ba90 2023-11-28T13:00:03.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.734+0000 7f672bfff700 1 -- 172.21.15.114:0/1186924372 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672c0cdf40 con 0x7f672c06ba90 2023-11-28T13:00:03.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.734+0000 7f67137fe700 1 -- 172.21.15.114:0/1186924372 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c0038e0 con 0x7f672c06ba90 2023-11-28T13:00:03.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.734+0000 7f672bfff700 1 -- 172.21.15.114:0/1186924372 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672c0cdc60 con 0x7f672c06ba90 2023-11-28T13:00:03.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.734+0000 7f67137fe700 1 -- 172.21.15.114:0/1186924372 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f671c019030 con 0x7f672c06ba90 2023-11-28T13:00:03.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.734+0000 7f67137fe700 1 -- 172.21.15.114:0/1186924372 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f671c011ea0 con 0x7f672c06ba90 2023-11-28T13:00:03.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.734+0000 7f672bfff700 1 -- 172.21.15.114:0/1186924372 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672c0ce220 con 0x7f672c06ba90 2023-11-28T13:00:03.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.738+0000 7f67137fe700 1 -- 172.21.15.114:0/1186924372 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f671c017070 con 0x7f672c06ba90 2023-11-28T13:00:03.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.810+0000 7f672bfff700 1 -- 172.21.15.114:0/1186924372 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d0fd94dd-a682-4b21-866a-9a1c6dd593bf", "id": 6} v 0) v1 -- 0x7f672c065fc0 con 0x7f672c06ba90 2023-11-28T13:00:03.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.818+0000 7f67137fe700 1 -- 172.21.15.114:0/1186924372 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d0fd94dd-a682-4b21-866a-9a1c6dd593bf", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f672c06dd60 con 0x7f672c06ba90 2023-11-28T13:00:03.824 INFO:teuthology.orchestra.run.smithi114.stdout:6 2023-11-28T13:00:03.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.818+0000 7f672bfff700 1 -- 172.21.15.114:0/1186924372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f672c06ba90 msgr2=0x7f672c0b4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.818+0000 7f672bfff700 1 --2- 172.21.15.114:0/1186924372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f672c06ba90 0x7f672c0b4870 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f671c00c700 tx=0x7f671c00ca10 comp rx=0 tx=0).stop 2023-11-28T13:00:03.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.822+0000 7f672bfff700 1 -- 172.21.15.114:0/1186924372 shutdown_connections 2023-11-28T13:00:03.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.822+0000 7f672bfff700 1 --2- 172.21.15.114:0/1186924372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672c158ff0 0x7f672c0c36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.822+0000 7f672bfff700 1 --2- 172.21.15.114:0/1186924372 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f672c06d3d0 0x7f672c1ed0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.822+0000 7f672bfff700 1 --2- 172.21.15.114:0/1186924372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f672c06ba90 0x7f672c0b4870 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.822+0000 7f672bfff700 1 -- 172.21.15.114:0/1186924372 >> 172.21.15.114:0/1186924372 conn(0x7f672c0cf710 msgr2=0x7f672c155420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.822+0000 7f672bfff700 1 -- 172.21.15.114:0/1186924372 shutdown_connections 2023-11-28T13:00:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.822+0000 7f672bfff700 1 -- 172.21.15.114:0/1186924372 wait complete. 2023-11-28T13:00:03.838 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new 72e4a428-ed3b-4d32-875f-b1cbb9eefced 7 2023-11-28T13:00:03.870 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:03.869+0000 7f67cc7e42c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T13:00:03.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc46880d700 1 Processor -- start 2023-11-28T13:00:03.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc46880d700 1 -- start start 2023-11-28T13:00:03.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc46880d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc46415a180 0x7fc4640d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc46880d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4640cae80 0x7fc4640c4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc46880d700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4640cc9f0 con 0x7fc4640ce400 2023-11-28T13:00:03.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc46880d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4640c48c0 con 0x7fc46415a180 2023-11-28T13:00:03.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc46880d700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640cefd0 con 0x7fc4640cae80 2023-11-28T13:00:03.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc462ffd700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4640cae80 0x7fc4640c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc4637fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc46415a180 0x7fc4640d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc462ffd700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4640cae80 0x7fc4640c4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.114:34300/0 (socket says 172.21.15.114:34300) 2023-11-28T13:00:03.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc462ffd700 1 -- 172.21.15.114:0/4193781770 learned_addr learned my addr 172.21.15.114:0/4193781770 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-28T13:00:03.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc462ffd700 1 -- 172.21.15.114:0/4193781770 >> v2:172.21.15.114:3300/0 conn(0x7fc46415a180 msgr2=0x7fc4640d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:03.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc462ffd700 1 --2- 172.21.15.114:0/4193781770 >> v2:172.21.15.114:3300/0 conn(0x7fc46415a180 0x7fc4640d13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc462ffd700 1 -- 172.21.15.114:0/4193781770 >> v1:172.21.15.82:6789/0 conn(0x7fc4640ce400 legacy=0x7fc4640b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:03.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc462ffd700 1 -- 172.21.15.114:0/4193781770 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4640cf2b0 con 0x7fc4640cae80 2023-11-28T13:00:03.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc462ffd700 1 --2- 172.21.15.114:0/4193781770 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4640cae80 0x7fc4640c4380 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc458009910 tx=0x7fc458009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cf7fd4fe64fda8d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:03.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc4627fc700 1 -- 172.21.15.114:0/4193781770 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc458004230 con 0x7fc4640cae80 2023-11-28T13:00:03.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc4627fc700 1 -- 172.21.15.114:0/4193781770 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc458004390 con 0x7fc4640cae80 2023-11-28T13:00:03.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc4627fc700 1 -- 172.21.15.114:0/4193781770 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4580036c0 con 0x7fc4640cae80 2023-11-28T13:00:03.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc46880d700 1 -- 172.21.15.114:0/4193781770 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4640cae80 msgr2=0x7fc4640c4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc46880d700 1 --2- 172.21.15.114:0/4193781770 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4640cae80 0x7fc4640c4380 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc458009910 tx=0x7fc458009c20 comp rx=0 tx=0).stop 2023-11-28T13:00:03.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc46880d700 1 -- 172.21.15.114:0/4193781770 shutdown_connections 2023-11-28T13:00:03.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc46880d700 1 --2- 172.21.15.114:0/4193781770 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4640cae80 0x7fc4640c4380 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc46880d700 1 --2- 172.21.15.114:0/4193781770 >> v2:172.21.15.114:3300/0 conn(0x7fc46415a180 0x7fc4640d13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc46880d700 1 -- 172.21.15.114:0/4193781770 >> 172.21.15.114:0/4193781770 conn(0x7fc4640cdf40 msgr2=0x7fc4640d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:03.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc46880d700 1 -- 172.21.15.114:0/4193781770 shutdown_connections 2023-11-28T13:00:03.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.946+0000 7fc46880d700 1 -- 172.21.15.114:0/4193781770 wait complete. 2023-11-28T13:00:03.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc46880d700 1 Processor -- start 2023-11-28T13:00:03.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc46880d700 1 -- start start 2023-11-28T13:00:03.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc46880d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4640cae80 0x7fc464154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc46880d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4640ce400 0x7fc4640b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc46880d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc46415a180 0x7fc464155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:03.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc46880d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640c8790 con 0x7fc46415a180 2023-11-28T13:00:03.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc46880d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4641df620 con 0x7fc4640cae80 2023-11-28T13:00:03.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc46880d700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640c7900 con 0x7fc4640ce400 2023-11-28T13:00:03.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc4637fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4640cae80 0x7fc464154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc462ffd700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4640ce400 0x7fc4640b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc4637fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4640cae80 0x7fc464154330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45562/0 (socket says 172.21.15.114:45562) 2023-11-28T13:00:03.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc4637fe700 1 -- 172.21.15.114:0/959542041 learned_addr learned my addr 172.21.15.114:0/959542041 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-28T13:00:03.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc463fff700 1 --2- 172.21.15.114:0/959542041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc46415a180 0x7fc464155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:03.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc4637fe700 1 -- 172.21.15.114:0/959542041 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4640ce400 msgr2=0x7fc4640b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc4637fe700 1 --2- 172.21.15.114:0/959542041 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4640ce400 0x7fc4640b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc4637fe700 1 -- 172.21.15.114:0/959542041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc46415a180 msgr2=0x7fc464155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:03.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc4637fe700 1 --2- 172.21.15.114:0/959542041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc46415a180 0x7fc464155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:03.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc4637fe700 1 -- 172.21.15.114:0/959542041 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc458009570 con 0x7fc4640cae80 2023-11-28T13:00:03.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc4637fe700 1 --2- 172.21.15.114:0/959542041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4640cae80 0x7fc464154330 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc45400e870 tx=0x7fc45400eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:03.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc44bfff700 1 -- 172.21.15.114:0/959542041 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4540095c0 con 0x7fc4640cae80 2023-11-28T13:00:03.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc44bfff700 1 -- 172.21.15.114:0/959542041 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc454013680 con 0x7fc4640cae80 2023-11-28T13:00:03.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc46880d700 1 -- 172.21.15.114:0/959542041 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4640cf590 con 0x7fc4640cae80 2023-11-28T13:00:03.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc44bfff700 1 -- 172.21.15.114:0/959542041 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454013a10 con 0x7fc4640cae80 2023-11-28T13:00:03.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.950+0000 7fc46880d700 1 -- 172.21.15.114:0/959542041 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4640ccc90 con 0x7fc4640cae80 2023-11-28T13:00:03.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.954+0000 7fc44bfff700 1 -- 172.21.15.114:0/959542041 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fc454019030 con 0x7fc4640cae80 2023-11-28T13:00:03.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.954+0000 7fc44bfff700 1 -- 172.21.15.114:0/959542041 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fc454006860 con 0x7fc4640cae80 2023-11-28T13:00:03.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.954+0000 7fc46880d700 1 -- 172.21.15.114:0/959542041 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc46415a550 con 0x7fc4640cae80 2023-11-28T13:00:03.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:03.958+0000 7fc44bfff700 1 -- 172.21.15.114:0/959542041 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fc454021060 con 0x7fc4640cae80 2023-11-28T13:00:03.988 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:03.985+0000 7f67cc7e42c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T13:00:03.991 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:03.986+0000 7f5930f3b2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T13:00:04.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:04.030+0000 7fc46880d700 1 -- 172.21.15.114:0/959542041 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd new", "uuid": "72e4a428-ed3b-4d32-875f-b1cbb9eefced", "id": 7} v 0) v1 -- 0x7fc4640c88d0 con 0x7fc4640cae80 2023-11-28T13:00:04.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:04.042+0000 7fc44bfff700 1 -- 172.21.15.114:0/959542041 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "72e4a428-ed3b-4d32-875f-b1cbb9eefced", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc4640c88d0 con 0x7fc4640cae80 2023-11-28T13:00:04.047 INFO:teuthology.orchestra.run.smithi114.stdout:7 2023-11-28T13:00:04.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:04.042+0000 7fc46880d700 1 -- 172.21.15.114:0/959542041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4640cae80 msgr2=0x7fc464154330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:04.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:04.042+0000 7fc46880d700 1 --2- 172.21.15.114:0/959542041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4640cae80 0x7fc464154330 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc45400e870 tx=0x7fc45400eb80 comp rx=0 tx=0).stop 2023-11-28T13:00:04.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:04.042+0000 7fc46880d700 1 -- 172.21.15.114:0/959542041 shutdown_connections 2023-11-28T13:00:04.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:04.042+0000 7fc46880d700 1 --2- 172.21.15.114:0/959542041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc46415a180 0x7fc464155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:04.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:04.042+0000 7fc46880d700 1 --2- 172.21.15.114:0/959542041 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4640ce400 0x7fc4640b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:04.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:04.042+0000 7fc46880d700 1 --2- 172.21.15.114:0/959542041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4640cae80 0x7fc464154330 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:04.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:04.042+0000 7fc46880d700 1 -- 172.21.15.114:0/959542041 >> 172.21.15.114:0/959542041 conn(0x7fc4640cdf40 msgr2=0x7fc4640af740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:04.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:04.042+0000 7fc46880d700 1 -- 172.21.15.114:0/959542041 shutdown_connections 2023-11-28T13:00:04.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-28T13:00:04.042+0000 7fc46880d700 1 -- 172.21.15.114:0/959542041 wait complete. 2023-11-28T13:00:04.060 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-28T13:00:04.061 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-28T13:00:04.063 INFO:tasks.ceph.osd.0:Started 2023-11-28T13:00:04.063 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-28T13:00:04.064 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-28T13:00:04.069 INFO:tasks.ceph.osd.1:Started 2023-11-28T13:00:04.069 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-28T13:00:04.070 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-28T13:00:04.072 INFO:tasks.ceph.osd.2:Started 2023-11-28T13:00:04.072 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-28T13:00:04.072 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-28T13:00:04.074 INFO:tasks.ceph.osd.3:Started 2023-11-28T13:00:04.075 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-28T13:00:04.075 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-28T13:00:04.077 INFO:tasks.ceph.osd.4:Started 2023-11-28T13:00:04.078 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-28T13:00:04.078 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-28T13:00:04.080 INFO:tasks.ceph.osd.5:Started 2023-11-28T13:00:04.080 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-28T13:00:04.080 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-28T13:00:04.081 INFO:tasks.ceph.osd.6:Started 2023-11-28T13:00:04.082 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-28T13:00:04.083 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-28T13:00:04.085 INFO:tasks.ceph.osd.7:Started 2023-11-28T13:00:04.086 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:00:04.121 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:04.118+0000 7f5930f3b2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T13:00:04.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.189+0000 7f7beaf5a700 1 Processor -- start 2023-11-28T13:00:04.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.189+0000 7f7beaf5a700 1 -- start start 2023-11-28T13:00:04.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.189+0000 7f7beaf5a700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7be4070af0 0x7f7be40ce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:04.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.189+0000 7f7beaf5a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7be406db90 0x7f7be406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:04.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.189+0000 7f7beaf5a700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be406ab20 con 0x7f7be40ca860 2023-11-28T13:00:04.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.189+0000 7f7beaf5a700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be4069f10 con 0x7f7be4070af0 2023-11-28T13:00:04.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.189+0000 7f7beaf5a700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be406a1f0 con 0x7f7be406db90 2023-11-28T13:00:04.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.189+0000 7f7be3fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7be4070af0 0x7f7be40ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:04.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.189+0000 7f7be94f7700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7be406db90 0x7f7be406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:04.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.189+0000 7f7be3fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7be4070af0 0x7f7be40ce310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:51182/0 (socket says 172.21.15.82:51182) 2023-11-28T13:00:04.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.189+0000 7f7be3fff700 1 -- 172.21.15.82:0/4286354109 learned_addr learned my addr 172.21.15.82:0/4286354109 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:04.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.189+0000 7f7be8cf6700 1 --1- 172.21.15.82:0/4286354109 >> v1:172.21.15.114:6789/0 conn(0x7f7be40ca860 0x7f7be40703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:59488/0 (socket says 172.21.15.82:59488) 2023-11-28T13:00:04.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.189+0000 7f7be94f7700 1 -- 172.21.15.82:0/4286354109 >> v2:172.21.15.114:3300/0 conn(0x7f7be4070af0 msgr2=0x7f7be40ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:04.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.189+0000 7f7be94f7700 1 --2- 172.21.15.82:0/4286354109 >> v2:172.21.15.114:3300/0 conn(0x7f7be4070af0 0x7f7be40ce310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:04.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.189+0000 7f7be94f7700 1 -- 172.21.15.82:0/4286354109 >> v1:172.21.15.114:6789/0 conn(0x7f7be40ca860 legacy=0x7f7be40703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:04.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.189+0000 7f7be94f7700 1 -- 172.21.15.82:0/4286354109 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be406a4d0 con 0x7f7be406db90 2023-11-28T13:00:04.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.189+0000 7f7be3fff700 1 --2- 172.21.15.82:0/4286354109 >> v2:172.21.15.114:3300/0 conn(0x7f7be4070af0 0x7f7be40ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:04.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.189+0000 7f7be94f7700 1 --2- 172.21.15.82:0/4286354109 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7be406db90 0x7f7be406c3a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc009850 tx=0x7f7bdc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2db54d3b7cee77e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:04.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.189+0000 7f7be37fe700 1 -- 172.21.15.82:0/4286354109 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc011830 con 0x7f7be406db90 2023-11-28T13:00:04.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.189+0000 7f7be37fe700 1 -- 172.21.15.82:0/4286354109 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bdc011990 con 0x7f7be406db90 2023-11-28T13:00:04.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.189+0000 7f7be37fe700 1 -- 172.21.15.82:0/4286354109 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc011d40 con 0x7f7be406db90 2023-11-28T13:00:04.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.193+0000 7f7beaf5a700 1 -- 172.21.15.82:0/4286354109 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7be406db90 msgr2=0x7f7be406c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:04.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.193+0000 7f7beaf5a700 1 --2- 172.21.15.82:0/4286354109 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7be406db90 0x7f7be406c3a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc009850 tx=0x7f7bdc009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:04.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.193+0000 7f7beaf5a700 1 -- 172.21.15.82:0/4286354109 shutdown_connections 2023-11-28T13:00:04.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.193+0000 7f7beaf5a700 1 --2- 172.21.15.82:0/4286354109 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7be406db90 0x7f7be406c3a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:04.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.193+0000 7f7beaf5a700 1 --2- 172.21.15.82:0/4286354109 >> v2:172.21.15.114:3300/0 conn(0x7f7be4070af0 0x7f7be40ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:04.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.193+0000 7f7beaf5a700 1 -- 172.21.15.82:0/4286354109 >> 172.21.15.82:0/4286354109 conn(0x7f7be40ce9b0 msgr2=0x7f7be40ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:04.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.193+0000 7f7beaf5a700 1 -- 172.21.15.82:0/4286354109 shutdown_connections 2023-11-28T13:00:04.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.193+0000 7f7beaf5a700 1 -- 172.21.15.82:0/4286354109 wait complete. 2023-11-28T13:00:04.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.193+0000 7f7beaf5a700 1 Processor -- start 2023-11-28T13:00:04.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.193+0000 7f7beaf5a700 1 -- start start 2023-11-28T13:00:04.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7beaf5a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7be406db90 0x7f7be4157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:04.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7beaf5a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be4070af0 0x7f7be40b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:04.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7beaf5a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7be40ca860 0x7f7be40c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:04.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7beaf5a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be4157a60 con 0x7f7be406db90 2023-11-28T13:00:04.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7beaf5a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be41e7770 con 0x7f7be4070af0 2023-11-28T13:00:04.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7beaf5a700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be40c5b90 con 0x7f7be40ca860 2023-11-28T13:00:04.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7be8cf6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7be406db90 0x7f7be4157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:04.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7be8cf6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7be406db90 0x7f7be4157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37710/0 (socket says 172.21.15.82:37710) 2023-11-28T13:00:04.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7be8cf6700 1 -- 172.21.15.82:0/2708601861 learned_addr learned my addr 172.21.15.82:0/2708601861 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:04.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7be3fff700 1 --2- 172.21.15.82:0/2708601861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be4070af0 0x7f7be40b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:04.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7be94f7700 1 --2- 172.21.15.82:0/2708601861 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7be40ca860 0x7f7be40c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:04.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7be8cf6700 1 -- 172.21.15.82:0/2708601861 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7be40ca860 msgr2=0x7f7be40c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:04.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7be8cf6700 1 --2- 172.21.15.82:0/2708601861 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7be40ca860 0x7f7be40c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:04.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7be8cf6700 1 -- 172.21.15.82:0/2708601861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be4070af0 msgr2=0x7f7be40b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:04.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7be8cf6700 1 --2- 172.21.15.82:0/2708601861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be4070af0 0x7f7be40b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:04.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7be8cf6700 1 -- 172.21.15.82:0/2708601861 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd4009b30 con 0x7f7be406db90 2023-11-28T13:00:04.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7be8cf6700 1 --2- 172.21.15.82:0/2708601861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7be406db90 0x7f7be4157520 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800c410 tx=0x7f7bd800c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:04.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7be17fa700 1 -- 172.21.15.82:0/2708601861 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8005cd0 con 0x7f7be406db90 2023-11-28T13:00:04.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7be17fa700 1 -- 172.21.15.82:0/2708601861 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd8005e30 con 0x7f7be406db90 2023-11-28T13:00:04.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7beaf5a700 1 -- 172.21.15.82:0/2708601861 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bdc0094b0 con 0x7f7be406db90 2023-11-28T13:00:04.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7be17fa700 1 -- 172.21.15.82:0/2708601861 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd80072f0 con 0x7f7be406db90 2023-11-28T13:00:04.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7beaf5a700 1 -- 172.21.15.82:0/2708601861 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be4069bc0 con 0x7f7be406db90 2023-11-28T13:00:04.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7be17fa700 1 -- 172.21.15.82:0/2708601861 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f7bd8019030 con 0x7f7be406db90 2023-11-28T13:00:04.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7be17fa700 1 -- 172.21.15.82:0/2708601861 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7bd801ba80 con 0x7f7be406db90 2023-11-28T13:00:04.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.197+0000 7f7beaf5a700 1 -- 172.21.15.82:0/2708601861 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be406a7b0 con 0x7f7be406db90 2023-11-28T13:00:04.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.201+0000 7f7be17fa700 1 -- 172.21.15.82:0/2708601861 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f7bd8017070 con 0x7f7be406db90 2023-11-28T13:00:04.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.265+0000 7f7beaf5a700 1 -- 172.21.15.82:0/2708601861 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7be40cac30 con 0x7f7be406db90 2023-11-28T13:00:04.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.265+0000 7f7be17fa700 1 -- 172.21.15.82:0/2708601861 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7bd801bd10 con 0x7f7be406db90 2023-11-28T13:00:04.269 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:04.269 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":10,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:00:04.037126+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:00:04.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.269+0000 7f7beaf5a700 1 -- 172.21.15.82:0/2708601861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7be406db90 msgr2=0x7f7be4157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:04.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.269+0000 7f7beaf5a700 1 --2- 172.21.15.82:0/2708601861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7be406db90 0x7f7be4157520 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800c410 tx=0x7f7bd800c720 comp rx=0 tx=0).stop 2023-11-28T13:00:04.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.269+0000 7f7beaf5a700 1 -- 172.21.15.82:0/2708601861 shutdown_connections 2023-11-28T13:00:04.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.269+0000 7f7beaf5a700 1 --2- 172.21.15.82:0/2708601861 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7be40ca860 0x7f7be40c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:04.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.269+0000 7f7beaf5a700 1 --2- 172.21.15.82:0/2708601861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be4070af0 0x7f7be40b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:04.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.269+0000 7f7beaf5a700 1 --2- 172.21.15.82:0/2708601861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7be406db90 0x7f7be4157520 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:04.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.269+0000 7f7beaf5a700 1 -- 172.21.15.82:0/2708601861 >> 172.21.15.82:0/2708601861 conn(0x7f7be40ce9b0 msgr2=0x7f7be40ac170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:04.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.269+0000 7f7beaf5a700 1 -- 172.21.15.82:0/2708601861 shutdown_connections 2023-11-28T13:00:04.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:04.269+0000 7f7beaf5a700 1 -- 172.21.15.82:0/2708601861 wait complete. 2023-11-28T13:00:04.287 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-28T13:00:04.287 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-28T13:00:04.426 INFO:tasks.ceph.osd.3.smithi082.stderr:2023-11-28T13:00:04.421+0000 7fd8f0b84700 -1 Falling back to public interface 2023-11-28T13:00:04.443 INFO:tasks.ceph.osd.1.smithi082.stderr:2023-11-28T13:00:04.441+0000 7fdc483f7700 -1 Falling back to public interface 2023-11-28T13:00:04.472 INFO:tasks.ceph.osd.0.smithi082.stderr:2023-11-28T13:00:04.469+0000 7f60f12d1700 -1 Falling back to public interface 2023-11-28T13:00:04.479 INFO:tasks.ceph.osd.4.smithi114.stderr:2023-11-28T13:00:04.474+0000 7f1ff6c47700 -1 Falling back to public interface 2023-11-28T13:00:04.604 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:04.600+0000 7f67cc7e42c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T13:00:04.708 INFO:tasks.ceph.osd.5.smithi114.stderr:2023-11-28T13:00:04.702+0000 7f76198ac700 -1 Falling back to public interface 2023-11-28T13:00:04.710 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:04.706+0000 7f5930f3b2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T13:00:04.716 INFO:tasks.ceph.osd.2.smithi082.stderr:2023-11-28T13:00:04.712+0000 7f918e801700 -1 Falling back to public interface 2023-11-28T13:00:04.734 INFO:tasks.ceph.osd.7.smithi114.stderr:2023-11-28T13:00:04.730+0000 7ffb9c14b700 -1 Falling back to public interface 2023-11-28T13:00:04.750 INFO:tasks.ceph.osd.6.smithi114.stderr:2023-11-28T13:00:04.746+0000 7f394f21c700 -1 Falling back to public interface 2023-11-28T13:00:04.773 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:04.768+0000 7f67cc7e42c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T13:00:04.879 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:04.874+0000 7f5930f3b2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T13:00:04.946 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:04.940+0000 7f67cc7e42c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T13:00:05.001 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:04.996+0000 7f67cc7e42c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T13:00:05.070 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:05.066+0000 7f5930f3b2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T13:00:05.093 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T13:00:05.125 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:05.118+0000 7f5930f3b2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T13:00:05.192 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.188+0000 7fc6973b5700 1 Processor -- start 2023-11-28T13:00:05.192 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.188+0000 7fc6973b5700 1 -- start start 2023-11-28T13:00:05.193 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.188+0000 7fc6973b5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc6900c9540 0x7fc6900c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:05.193 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.188+0000 7fc6973b5700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc6900cc1a0 0x7fc690159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:05.193 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.188+0000 7fc6973b5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6900ca740 con 0x7fc6900b0050 2023-11-28T13:00:05.193 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.188+0000 7fc6973b5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6900c99b0 con 0x7fc6900c9540 2023-11-28T13:00:05.194 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.188+0000 7fc6973b5700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6901597d0 con 0x7fc6900cc1a0 2023-11-28T13:00:05.194 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.188+0000 7fc6963b3700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc6900b0050 0x7fc6900b0420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53618/0 (socket says 172.21.15.82:53618) 2023-11-28T13:00:05.194 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.188+0000 7fc6963b3700 1 -- 172.21.15.82:0/889079172 learned_addr learned my addr 172.21.15.82:0/889079172 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:05.194 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.188+0000 7fc695bb2700 1 --2- 172.21.15.82:0/889079172 >> v2:172.21.15.82:3300/0 conn(0x7fc6900c9540 0x7fc6900c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:05.194 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.188+0000 7fc696bb4700 1 --2- 172.21.15.82:0/889079172 >> v2:172.21.15.114:3300/0 conn(0x7fc6900cc1a0 0x7fc690159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:05.194 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.188+0000 7fc6953b1700 1 -- 172.21.15.82:0/889079172 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119196647 0 0) 0x7fc6900ca740 con 0x7fc6900b0050 2023-11-28T13:00:05.194 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.188+0000 7fc6953b1700 1 -- 172.21.15.82:0/889079172 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc67c0035d0 con 0x7fc6900b0050 2023-11-28T13:00:05.194 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.188+0000 7fc695bb2700 1 -- 172.21.15.82:0/889079172 >> v2:172.21.15.114:3300/0 conn(0x7fc6900cc1a0 msgr2=0x7fc690159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:05.194 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.188+0000 7fc695bb2700 1 --2- 172.21.15.82:0/889079172 >> v2:172.21.15.114:3300/0 conn(0x7fc6900cc1a0 0x7fc690159cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:05.194 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.188+0000 7fc695bb2700 1 -- 172.21.15.82:0/889079172 >> v1:172.21.15.82:6789/0 conn(0x7fc6900b0050 legacy=0x7fc6900b0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:05.194 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.188+0000 7fc695bb2700 1 -- 172.21.15.82:0/889079172 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6900c9bc0 con 0x7fc6900c9540 2023-11-28T13:00:05.195 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.188+0000 7fc695bb2700 1 --2- 172.21.15.82:0/889079172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6900c9540 0x7fc6900c8c20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc69006e3d0 tx=0x7fc680009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365e33156b5f7fc8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:05.195 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.188+0000 7fc6953b1700 1 -- 172.21.15.82:0/889079172 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc680011830 con 0x7fc6900c9540 2023-11-28T13:00:05.195 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.188+0000 7fc6953b1700 1 -- 172.21.15.82:0/889079172 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc680011990 con 0x7fc6900c9540 2023-11-28T13:00:05.195 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.188+0000 7fc6953b1700 1 -- 172.21.15.82:0/889079172 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc680011d00 con 0x7fc6900c9540 2023-11-28T13:00:05.195 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.192+0000 7fc6973b5700 1 -- 172.21.15.82:0/889079172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6900c9540 msgr2=0x7fc6900c8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:05.196 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.192+0000 7fc6973b5700 1 --2- 172.21.15.82:0/889079172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6900c9540 0x7fc6900c8c20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc69006e3d0 tx=0x7fc680009b30 comp rx=0 tx=0).stop 2023-11-28T13:00:05.196 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.192+0000 7fc6973b5700 1 -- 172.21.15.82:0/889079172 shutdown_connections 2023-11-28T13:00:05.196 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.192+0000 7fc6973b5700 1 --2- 172.21.15.82:0/889079172 >> v2:172.21.15.114:3300/0 conn(0x7fc6900cc1a0 0x7fc690159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:05.196 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.192+0000 7fc6973b5700 1 --2- 172.21.15.82:0/889079172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6900c9540 0x7fc6900c8c20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:05.196 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.192+0000 7fc6973b5700 1 -- 172.21.15.82:0/889079172 >> 172.21.15.82:0/889079172 conn(0x7fc69006cc80 msgr2=0x7fc6900cb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:05.196 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.192+0000 7fc6973b5700 1 -- 172.21.15.82:0/889079172 shutdown_connections 2023-11-28T13:00:05.196 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.192+0000 7fc6973b5700 1 -- 172.21.15.82:0/889079172 wait complete. 2023-11-28T13:00:05.197 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.192+0000 7fc6973b5700 1 Processor -- start 2023-11-28T13:00:05.197 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.192+0000 7fc6973b5700 1 -- start start 2023-11-28T13:00:05.200 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc6973b5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6900c9540 0x7fc69014dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:05.200 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc6973b5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6900cc1a0 0x7fc6900abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:05.200 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc6973b5700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6900ac0e0 0x7fc690069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:05.200 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc6973b5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900c2310 con 0x7fc6900cc1a0 2023-11-28T13:00:05.200 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc6973b5700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900ac710 con 0x7fc6900c9540 2023-11-28T13:00:05.201 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc6973b5700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900ac9f0 con 0x7fc6900ac0e0 2023-11-28T13:00:05.201 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc695bb2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6900cc1a0 0x7fc6900abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:05.201 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc695bb2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6900cc1a0 0x7fc6900abba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37726/0 (socket says 172.21.15.82:37726) 2023-11-28T13:00:05.201 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc695bb2700 1 -- 172.21.15.82:0/3136073543 learned_addr learned my addr 172.21.15.82:0/3136073543 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:05.201 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc6963b3700 1 --2- 172.21.15.82:0/3136073543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6900c9540 0x7fc69014dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:05.201 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc696bb4700 1 --2- 172.21.15.82:0/3136073543 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6900ac0e0 0x7fc690069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:05.201 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc695bb2700 1 -- 172.21.15.82:0/3136073543 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6900ac0e0 msgr2=0x7fc690069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:05.201 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc695bb2700 1 --2- 172.21.15.82:0/3136073543 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6900ac0e0 0x7fc690069bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:05.201 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc695bb2700 1 -- 172.21.15.82:0/3136073543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6900c9540 msgr2=0x7fc69014dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:05.201 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc695bb2700 1 --2- 172.21.15.82:0/3136073543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6900c9540 0x7fc69014dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:05.201 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc695bb2700 1 -- 172.21.15.82:0/3136073543 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6800094b0 con 0x7fc6900cc1a0 2023-11-28T13:00:05.201 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc696bb4700 1 --2- 172.21.15.82:0/3136073543 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6900ac0e0 0x7fc690069bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:00:05.202 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc695bb2700 1 --2- 172.21.15.82:0/3136073543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6900cc1a0 0x7fc6900abba0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc6800097a0 tx=0x7fc680004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:05.202 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc686ffd700 1 -- 172.21.15.82:0/3136073543 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6800044d0 con 0x7fc6900cc1a0 2023-11-28T13:00:05.202 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc686ffd700 1 -- 172.21.15.82:0/3136073543 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68001f070 con 0x7fc6900cc1a0 2023-11-28T13:00:05.202 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc6973b5700 1 -- 172.21.15.82:0/3136073543 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6900ca180 con 0x7fc6900cc1a0 2023-11-28T13:00:05.202 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc686ffd700 1 -- 172.21.15.82:0/3136073543 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6800038c0 con 0x7fc6900cc1a0 2023-11-28T13:00:05.202 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc6973b5700 1 -- 172.21.15.82:0/3136073543 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6900c9ea0 con 0x7fc6900cc1a0 2023-11-28T13:00:05.202 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc686ffd700 1 -- 172.21.15.82:0/3136073543 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fc68000f050 con 0x7fc6900cc1a0 2023-11-28T13:00:05.202 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc686ffd700 1 -- 172.21.15.82:0/3136073543 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc680021070 con 0x7fc6900cc1a0 2023-11-28T13:00:05.202 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.196+0000 7fc6973b5700 1 -- 172.21.15.82:0/3136073543 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6900ca460 con 0x7fc6900cc1a0 2023-11-28T13:00:05.204 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.200+0000 7fc686ffd700 1 -- 172.21.15.82:0/3136073543 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fc68002b020 con 0x7fc6900cc1a0 2023-11-28T13:00:05.279 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.276+0000 7fc6973b5700 1 -- 172.21.15.82:0/3136073543 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6900ac4e0 con 0x7fc6900cc1a0 2023-11-28T13:00:05.280 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.276+0000 7fc686ffd700 1 -- 172.21.15.82:0/3136073543 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc680015020 con 0x7fc6900cc1a0 2023-11-28T13:00:05.280 INFO:teuthology.misc.health.smithi082.stdout: 2023-11-28T13:00:05.280 INFO:teuthology.misc.health.smithi082.stdout:{"epoch":10,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:00:04.037126+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:00:05.281 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.276+0000 7fc6973b5700 1 -- 172.21.15.82:0/3136073543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6900cc1a0 msgr2=0x7fc6900abba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:05.282 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.276+0000 7fc6973b5700 1 --2- 172.21.15.82:0/3136073543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6900cc1a0 0x7fc6900abba0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc6800097a0 tx=0x7fc680004770 comp rx=0 tx=0).stop 2023-11-28T13:00:05.282 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.276+0000 7fc6973b5700 1 -- 172.21.15.82:0/3136073543 shutdown_connections 2023-11-28T13:00:05.282 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.276+0000 7fc6973b5700 1 --2- 172.21.15.82:0/3136073543 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6900ac0e0 0x7fc690069bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:05.282 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.276+0000 7fc6973b5700 1 --2- 172.21.15.82:0/3136073543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6900cc1a0 0x7fc6900abba0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:05.282 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.276+0000 7fc6973b5700 1 --2- 172.21.15.82:0/3136073543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6900c9540 0x7fc69014dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:05.282 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.276+0000 7fc6973b5700 1 -- 172.21.15.82:0/3136073543 >> 172.21.15.82:0/3136073543 conn(0x7fc6900b0050 msgr2=0x7fc690070ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:05.282 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.276+0000 7fc6973b5700 1 -- 172.21.15.82:0/3136073543 shutdown_connections 2023-11-28T13:00:05.282 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:05.276+0000 7fc6973b5700 1 -- 172.21.15.82:0/3136073543 wait complete. 2023-11-28T13:00:05.291 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-28T13:00:05.704 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:05.700+0000 7f67cc7e42c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T13:00:05.771 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:05.768+0000 7f67cc7e42c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T13:00:05.894 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:05.890+0000 7f5930f3b2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T13:00:05.924 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:05.920+0000 7f67cc7e42c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T13:00:05.965 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:05.958+0000 7f5930f3b2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T13:00:05.988 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:05.984+0000 7f67cc7e42c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T13:00:06.132 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:06.126+0000 7f5930f3b2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T13:00:06.194 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:06.188+0000 7f67cc7e42c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T13:00:06.199 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:06.194+0000 7f5930f3b2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T13:00:06.354 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:06.352+0000 7f67cc7e42c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T13:00:06.421 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:06.418+0000 7f5930f3b2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T13:00:06.422 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:06.416+0000 7f67cc7e42c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T13:00:06.597 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:06.594+0000 7f5930f3b2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T13:00:06.671 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:06.666+0000 7f5930f3b2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T13:00:07.119 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:07.116+0000 7f67cc7e42c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T13:00:07.428 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-11-28T13:00:07.422+0000 7f5930f3b2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T13:00:08.163 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:08.160+0000 7f67b3055700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-28T13:00:08.164 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-11-28T13:00:08.160+0000 7f67b3055700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-28T13:00:08.210 INFO:tasks.ceph.osd.1.smithi082.stderr:2023-11-28T13:00:08.208+0000 7fdc483f7700 -1 osd.1 0 log_to_monitors true 2023-11-28T13:00:08.292 INFO:tasks.ceph.osd.3.smithi082.stderr:2023-11-28T13:00:08.288+0000 7fd8f0b84700 -1 osd.3 0 log_to_monitors true 2023-11-28T13:00:08.340 INFO:tasks.ceph.osd.4.smithi114.stderr:2023-11-28T13:00:08.334+0000 7f1ff6c47700 -1 osd.4 0 log_to_monitors true 2023-11-28T13:00:08.391 INFO:tasks.ceph.osd.7.smithi114.stderr:2023-11-28T13:00:08.386+0000 7ffb9c14b700 -1 osd.7 0 log_to_monitors true 2023-11-28T13:00:08.411 INFO:tasks.ceph.osd.0.smithi082.stderr:2023-11-28T13:00:08.408+0000 7f60f12d1700 -1 osd.0 0 log_to_monitors true 2023-11-28T13:00:08.520 INFO:tasks.ceph.osd.5.smithi114.stderr:2023-11-28T13:00:08.514+0000 7f76198ac700 -1 osd.5 0 log_to_monitors true 2023-11-28T13:00:08.597 INFO:tasks.ceph.osd.2.smithi082.stderr:2023-11-28T13:00:08.592+0000 7f918e801700 -1 osd.2 0 log_to_monitors true 2023-11-28T13:00:08.602 INFO:tasks.ceph.osd.6.smithi114.stderr:2023-11-28T13:00:08.598+0000 7f394f21c700 -1 osd.6 0 log_to_monitors true 2023-11-28T13:00:12.098 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T13:00:12.248 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.244+0000 7ff2fcc8d700 1 Processor -- start 2023-11-28T13:00:12.248 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.244+0000 7ff2fcc8d700 1 -- start start 2023-11-28T13:00:12.248 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.244+0000 7ff2fcc8d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff2f815c2a0 0x7ff2f80b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:12.249 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.244+0000 7ff2fcc8d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff2f80b0e10 0x7ff2f8069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:12.249 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.244+0000 7ff2fcc8d700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f80cab40 con 0x7ff2f81588a0 2023-11-28T13:00:12.249 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.244+0000 7ff2fcc8d700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f80b1290 con 0x7ff2f80b0e10 2023-11-28T13:00:12.249 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.244+0000 7ff2fcc8d700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f80b0470 con 0x7ff2f815c2a0 2023-11-28T13:00:12.249 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.244+0000 7ff2f6d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff2f80b0e10 0x7ff2f8069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:12.249 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.244+0000 7ff2f659c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff2f81588a0 0x7ff2f80af0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45978/0 (socket says 172.21.15.82:45978) 2023-11-28T13:00:12.249 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.244+0000 7ff2f659c700 1 -- 172.21.15.82:0/2850999150 learned_addr learned my addr 172.21.15.82:0/2850999150 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:12.249 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.244+0000 7ff2f5d9b700 1 --2- 172.21.15.82:0/2850999150 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff2f815c2a0 0x7ff2f80b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:12.249 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.244+0000 7ff2f6d9d700 1 -- 172.21.15.82:0/2850999150 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff2f815c2a0 msgr2=0x7ff2f80b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:12.249 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.244+0000 7ff2f6d9d700 1 --2- 172.21.15.82:0/2850999150 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff2f815c2a0 0x7ff2f80b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:12.249 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.244+0000 7ff2f6d9d700 1 -- 172.21.15.82:0/2850999150 >> v1:172.21.15.82:6789/0 conn(0x7ff2f81588a0 legacy=0x7ff2f80af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:12.249 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.244+0000 7ff2f6d9d700 1 -- 172.21.15.82:0/2850999150 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f80af8f0 con 0x7ff2f80b0e10 2023-11-28T13:00:12.250 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.244+0000 7ff2f6d9d700 1 --2- 172.21.15.82:0/2850999150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f80b0e10 0x7ff2f8069ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000bfa0 tx=0x7ff2f000d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ada882296d7ad81 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:12.250 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2f559a700 1 -- 172.21.15.82:0/2850999150 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0010070 con 0x7ff2f80b0e10 2023-11-28T13:00:12.250 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2f559a700 1 -- 172.21.15.82:0/2850999150 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f000b2e0 con 0x7ff2f80b0e10 2023-11-28T13:00:12.251 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2fcc8d700 1 -- 172.21.15.82:0/2850999150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f80b0e10 msgr2=0x7ff2f8069ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:12.251 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2fcc8d700 1 --2- 172.21.15.82:0/2850999150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f80b0e10 0x7ff2f8069ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000bfa0 tx=0x7ff2f000d330 comp rx=0 tx=0).stop 2023-11-28T13:00:12.251 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2fcc8d700 1 -- 172.21.15.82:0/2850999150 shutdown_connections 2023-11-28T13:00:12.251 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2fcc8d700 1 --2- 172.21.15.82:0/2850999150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f80b0e10 0x7ff2f8069ea0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:12.251 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2fcc8d700 1 --2- 172.21.15.82:0/2850999150 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff2f815c2a0 0x7ff2f80b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:12.251 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2fcc8d700 1 -- 172.21.15.82:0/2850999150 >> 172.21.15.82:0/2850999150 conn(0x7ff2f80cf440 msgr2=0x7ff2f80cb230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:12.251 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2fcc8d700 1 -- 172.21.15.82:0/2850999150 shutdown_connections 2023-11-28T13:00:12.251 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2fcc8d700 1 -- 172.21.15.82:0/2850999150 wait complete. 2023-11-28T13:00:12.253 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2fcc8d700 1 Processor -- start 2023-11-28T13:00:12.253 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2fcc8d700 1 -- start start 2023-11-28T13:00:12.254 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2fcc8d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff2f81588a0 0x7ff2f81464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:12.254 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2fcc8d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2f815c2a0 0x7ff2f8159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:12.254 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2fcc8d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f80c4920 0x7ff2f81458a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:12.254 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2fcc8d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f815b1e0 con 0x7ff2f80c4920 2023-11-28T13:00:12.254 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2fcc8d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f815a330 con 0x7ff2f815c2a0 2023-11-28T13:00:12.255 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2fcc8d700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f815a5d0 con 0x7ff2f81588a0 2023-11-28T13:00:12.255 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2f6d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f80c4920 0x7ff2f81458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:12.255 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2f6d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f80c4920 0x7ff2f81458a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44796/0 (socket says 172.21.15.82:44796) 2023-11-28T13:00:12.255 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2f6d9d700 1 -- 172.21.15.82:0/3774122293 learned_addr learned my addr 172.21.15.82:0/3774122293 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:12.255 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.248+0000 7ff2f5d9b700 1 --2- 172.21.15.82:0/3774122293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2f815c2a0 0x7ff2f8159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:12.255 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.252+0000 7ff2f659c700 1 --2- 172.21.15.82:0/3774122293 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff2f81588a0 0x7ff2f81464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:12.255 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.252+0000 7ff2f6d9d700 1 -- 172.21.15.82:0/3774122293 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff2f81588a0 msgr2=0x7ff2f81464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:12.255 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.252+0000 7ff2f6d9d700 1 --2- 172.21.15.82:0/3774122293 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff2f81588a0 0x7ff2f81464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:12.255 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.252+0000 7ff2f6d9d700 1 -- 172.21.15.82:0/3774122293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2f815c2a0 msgr2=0x7ff2f8159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:12.255 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.252+0000 7ff2f6d9d700 1 --2- 172.21.15.82:0/3774122293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2f815c2a0 0x7ff2f8159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:12.255 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.252+0000 7ff2f6d9d700 1 -- 172.21.15.82:0/3774122293 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f000bc80 con 0x7ff2f80c4920 2023-11-28T13:00:12.255 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.252+0000 7ff2f5d9b700 1 --2- 172.21.15.82:0/3774122293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2f815c2a0 0x7ff2f8159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:12.256 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.252+0000 7ff2f6d9d700 1 --2- 172.21.15.82:0/3774122293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f80c4920 0x7ff2f81458a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80cba30 tx=0x7ff2f0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:12.256 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.252+0000 7ff2e6ffd700 1 -- 172.21.15.82:0/3774122293 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0022070 con 0x7ff2f80c4920 2023-11-28T13:00:12.256 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.252+0000 7ff2fcc8d700 1 -- 172.21.15.82:0/3774122293 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f80afeb0 con 0x7ff2f80c4920 2023-11-28T13:00:12.257 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.252+0000 7ff2fcc8d700 1 -- 172.21.15.82:0/3774122293 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f80afbd0 con 0x7ff2f80c4920 2023-11-28T13:00:12.257 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.252+0000 7ff2e6ffd700 1 -- 172.21.15.82:0/3774122293 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f0003e20 con 0x7ff2f80c4920 2023-11-28T13:00:12.257 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.252+0000 7ff2e6ffd700 1 -- 172.21.15.82:0/3774122293 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f000bb20 con 0x7ff2f80c4920 2023-11-28T13:00:12.257 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.252+0000 7ff2fcc8d700 1 -- 172.21.15.82:0/3774122293 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2dc005310 con 0x7ff2f80c4920 2023-11-28T13:00:12.257 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.252+0000 7ff2e6ffd700 1 -- 172.21.15.82:0/3774122293 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7ff2f0009970 con 0x7ff2f80c4920 2023-11-28T13:00:12.265 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.252+0000 7ff2e6ffd700 1 --2- 172.21.15.82:0/3774122293 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff2d8064e90 0x7ff2d8067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:12.265 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.252+0000 7ff2e6ffd700 1 -- 172.21.15.82:0/3774122293 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7ff2f00818a0 con 0x7ff2f80c4920 2023-11-28T13:00:12.265 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.260+0000 7ff2f659c700 1 --2- 172.21.15.82:0/3774122293 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff2d8064e90 0x7ff2d8067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:12.265 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.260+0000 7ff2e6ffd700 1 -- 172.21.15.82:0/3774122293 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff2f0050900 con 0x7ff2f80c4920 2023-11-28T13:00:12.266 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.260+0000 7ff2f659c700 1 --2- 172.21.15.82:0/3774122293 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff2d8064e90 0x7ff2d8067340 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec00a630 tx=0x7ff2ec00a5c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:12.353 INFO:tasks.ceph.osd.1.smithi082.stderr:2023-11-28T13:00:12.348+0000 7fdc43a13700 -1 osd.1 0 waiting for initial osdmap 2023-11-28T13:00:12.361 INFO:tasks.ceph.osd.1.smithi082.stderr:2023-11-28T13:00:12.356+0000 7fdc3bce8700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T13:00:12.364 INFO:tasks.ceph.osd.4.smithi114.stderr:2023-11-28T13:00:12.358+0000 7f1ff2263700 -1 osd.4 0 waiting for initial osdmap 2023-11-28T13:00:12.367 INFO:tasks.ceph.osd.6.smithi114.stderr:2023-11-28T13:00:12.362+0000 7f394a838700 -1 osd.6 0 waiting for initial osdmap 2023-11-28T13:00:12.373 INFO:tasks.ceph.osd.4.smithi114.stderr:2023-11-28T13:00:12.366+0000 7f1fea538700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T13:00:12.376 INFO:tasks.ceph.osd.6.smithi114.stderr:2023-11-28T13:00:12.370+0000 7f3942b0d700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T13:00:12.376 INFO:tasks.ceph.osd.2.smithi082.stderr:2023-11-28T13:00:12.372+0000 7f9189e1d700 -1 osd.2 0 waiting for initial osdmap 2023-11-28T13:00:12.382 INFO:tasks.ceph.osd.2.smithi082.stderr:2023-11-28T13:00:12.376+0000 7f91820f2700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T13:00:12.402 INFO:tasks.ceph.osd.0.smithi082.stderr:2023-11-28T13:00:12.396+0000 7f60ec8ed700 -1 osd.0 0 waiting for initial osdmap 2023-11-28T13:00:12.409 INFO:tasks.ceph.osd.0.smithi082.stderr:2023-11-28T13:00:12.404+0000 7f60e4bc2700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T13:00:12.410 INFO:tasks.ceph.osd.5.smithi114.stderr:2023-11-28T13:00:12.406+0000 7f7614ec8700 -1 osd.5 0 waiting for initial osdmap 2023-11-28T13:00:12.416 INFO:tasks.ceph.osd.5.smithi114.stderr:2023-11-28T13:00:12.410+0000 7f760d19d700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T13:00:12.471 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.468+0000 7ff2fcc8d700 1 -- 172.21.15.82:0/3774122293 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2dc0055c0 con 0x7ff2f80c4920 2023-11-28T13:00:12.472 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.468+0000 7ff2e6ffd700 1 -- 172.21.15.82:0/3774122293 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff2f0053f20 con 0x7ff2f80c4920 2023-11-28T13:00:12.472 INFO:teuthology.misc.health.smithi082.stdout: 2023-11-28T13:00:12.472 INFO:teuthology.misc.health.smithi082.stdout:{"epoch":12,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:00:10.155726+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:00:12.474 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.468+0000 7ff2fcc8d700 1 -- 172.21.15.82:0/3774122293 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff2d8064e90 msgr2=0x7ff2d8067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:12.474 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.468+0000 7ff2fcc8d700 1 --2- 172.21.15.82:0/3774122293 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff2d8064e90 0x7ff2d8067340 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec00a630 tx=0x7ff2ec00a5c0 comp rx=0 tx=0).stop 2023-11-28T13:00:12.475 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.468+0000 7ff2fcc8d700 1 -- 172.21.15.82:0/3774122293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f80c4920 msgr2=0x7ff2f81458a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:12.475 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.468+0000 7ff2fcc8d700 1 --2- 172.21.15.82:0/3774122293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f80c4920 0x7ff2f81458a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80cba30 tx=0x7ff2f0004af0 comp rx=0 tx=0).stop 2023-11-28T13:00:12.475 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.472+0000 7ff2fcc8d700 1 -- 172.21.15.82:0/3774122293 shutdown_connections 2023-11-28T13:00:12.475 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.472+0000 7ff2fcc8d700 1 --2- 172.21.15.82:0/3774122293 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff2d8064e90 0x7ff2d8067340 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:12.475 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.472+0000 7ff2fcc8d700 1 --2- 172.21.15.82:0/3774122293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f80c4920 0x7ff2f81458a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:12.475 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.472+0000 7ff2fcc8d700 1 --2- 172.21.15.82:0/3774122293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2f815c2a0 0x7ff2f8159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:12.475 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.472+0000 7ff2fcc8d700 1 --2- 172.21.15.82:0/3774122293 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff2f81588a0 0x7ff2f81464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:12.475 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.472+0000 7ff2fcc8d700 1 -- 172.21.15.82:0/3774122293 >> 172.21.15.82:0/3774122293 conn(0x7ff2f80cf440 msgr2=0x7ff2f80cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:12.475 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.472+0000 7ff2fcc8d700 1 -- 172.21.15.82:0/3774122293 shutdown_connections 2023-11-28T13:00:12.475 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:12.472+0000 7ff2fcc8d700 1 -- 172.21.15.82:0/3774122293 wait complete. 2023-11-28T13:00:12.479 INFO:tasks.ceph.osd.3.smithi082.stderr:2023-11-28T13:00:12.476+0000 7fd8ec1a0700 -1 osd.3 0 waiting for initial osdmap 2023-11-28T13:00:12.484 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-28T13:00:12.485 INFO:tasks.ceph.osd.3.smithi082.stderr:2023-11-28T13:00:12.480+0000 7fd8e4475700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T13:00:12.496 INFO:tasks.ceph.osd.7.smithi114.stderr:2023-11-28T13:00:12.490+0000 7ffb99112700 -1 osd.7 0 waiting for initial osdmap 2023-11-28T13:00:12.501 INFO:tasks.ceph.osd.7.smithi114.stderr:2023-11-28T13:00:12.498+0000 7ffb8fa3c700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T13:00:19.293 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T13:00:19.406 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.400+0000 7efd2cb41700 1 Processor -- start 2023-11-28T13:00:19.407 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.400+0000 7efd2cb41700 1 -- start start 2023-11-28T13:00:19.418 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd2cb41700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efd2806a5d0 0x7efd2806b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:19.419 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd2cb41700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd280cdea0 con 0x7efd280ca4a0 2023-11-28T13:00:19.419 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd2cb41700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd280ccfb0 con 0x7efd28158eb0 2023-11-28T13:00:19.419 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd2cb41700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd28159280 con 0x7efd2806a5d0 2023-11-28T13:00:19.419 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd27fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efd2806a5d0 0x7efd2806b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:19.419 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd1ffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efd280ca4a0 0x7efd2806c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33170/0 (socket says 172.21.15.82:33170) 2023-11-28T13:00:19.419 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd1ffff700 1 -- 172.21.15.82:0/1324203014 learned_addr learned my addr 172.21.15.82:0/1324203014 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:19.419 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd27fff700 1 -- 172.21.15.82:0/1324203014 >> v1:172.21.15.114:6789/0 conn(0x7efd28158eb0 legacy=0x7efd280c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:19.419 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd26ffd700 1 -- 172.21.15.82:0/1324203014 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523175051 0 0) 0x7efd280cdea0 con 0x7efd280ca4a0 2023-11-28T13:00:19.420 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd27fff700 1 -- 172.21.15.82:0/1324203014 >> v1:172.21.15.82:6789/0 conn(0x7efd280ca4a0 legacy=0x7efd2806c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:19.420 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd27fff700 1 -- 172.21.15.82:0/1324203014 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd280cd290 con 0x7efd2806a5d0 2023-11-28T13:00:19.420 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd27fff700 1 --2- 172.21.15.82:0/1324203014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd2806a5d0 0x7efd2806b480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efd20009d90 tx=0x7efd2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516223283e5d3d49 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:19.420 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd26ffd700 1 -- 172.21.15.82:0/1324203014 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2000e070 con 0x7efd2806a5d0 2023-11-28T13:00:19.420 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd26ffd700 1 -- 172.21.15.82:0/1324203014 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2000bbd0 con 0x7efd2806a5d0 2023-11-28T13:00:19.420 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd26ffd700 1 -- 172.21.15.82:0/1324203014 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd20012430 con 0x7efd2806a5d0 2023-11-28T13:00:19.420 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd2cb41700 1 -- 172.21.15.82:0/1324203014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd2806a5d0 msgr2=0x7efd2806b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:19.420 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd2cb41700 1 --2- 172.21.15.82:0/1324203014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd2806a5d0 0x7efd2806b480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efd20009d90 tx=0x7efd2000b330 comp rx=0 tx=0).stop 2023-11-28T13:00:19.420 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd2cb41700 1 -- 172.21.15.82:0/1324203014 shutdown_connections 2023-11-28T13:00:19.421 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd2cb41700 1 --2- 172.21.15.82:0/1324203014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd2806a5d0 0x7efd2806b480 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:19.421 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd2cb41700 1 -- 172.21.15.82:0/1324203014 >> 172.21.15.82:0/1324203014 conn(0x7efd280cedc0 msgr2=0x7efd280cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:19.421 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd2cb41700 1 -- 172.21.15.82:0/1324203014 shutdown_connections 2023-11-28T13:00:19.421 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.404+0000 7efd2cb41700 1 -- 172.21.15.82:0/1324203014 wait complete. 2023-11-28T13:00:19.421 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd2cb41700 1 Processor -- start 2023-11-28T13:00:19.421 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd2cb41700 1 -- start start 2023-11-28T13:00:19.421 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd2cb41700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd2806a5d0 0x7efd280c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:19.421 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd2cb41700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efd280ca4a0 0x7efd2815b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:19.421 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd2cb41700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd28158eb0 0x7efd281efb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:19.422 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd2cb41700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd280a85e0 con 0x7efd2806a5d0 2023-11-28T13:00:19.422 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd2cb41700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd280a79d0 con 0x7efd28158eb0 2023-11-28T13:00:19.422 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd2cb41700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd280a7cb0 con 0x7efd280ca4a0 2023-11-28T13:00:19.422 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd277fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd2806a5d0 0x7efd280c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:19.422 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd277fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd2806a5d0 0x7efd280c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39264/0 (socket says 172.21.15.82:39264) 2023-11-28T13:00:19.422 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd277fe700 1 -- 172.21.15.82:0/573544539 learned_addr learned my addr 172.21.15.82:0/573544539 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:19.422 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd27fff700 1 --2- 172.21.15.82:0/573544539 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd28158eb0 0x7efd281efb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:19.422 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd1ffff700 1 --2- 172.21.15.82:0/573544539 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efd280ca4a0 0x7efd2815b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:19.422 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd277fe700 1 -- 172.21.15.82:0/573544539 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efd280ca4a0 msgr2=0x7efd2815b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:19.423 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd277fe700 1 --2- 172.21.15.82:0/573544539 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efd280ca4a0 0x7efd2815b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:19.424 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd277fe700 1 -- 172.21.15.82:0/573544539 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd28158eb0 msgr2=0x7efd281efb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:19.424 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd277fe700 1 --2- 172.21.15.82:0/573544539 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd28158eb0 0x7efd281efb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:19.424 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd277fe700 1 -- 172.21.15.82:0/573544539 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd20009a70 con 0x7efd2806a5d0 2023-11-28T13:00:19.424 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd1ffff700 1 --2- 172.21.15.82:0/573544539 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efd280ca4a0 0x7efd2815b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:00:19.424 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd277fe700 1 --2- 172.21.15.82:0/573544539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd2806a5d0 0x7efd280c8690 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efd1800c500 tx=0x7efd1800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:19.424 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd24ff9700 1 -- 172.21.15.82:0/573544539 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd180052d0 con 0x7efd2806a5d0 2023-11-28T13:00:19.425 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd24ff9700 1 -- 172.21.15.82:0/573544539 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd18005430 con 0x7efd2806a5d0 2023-11-28T13:00:19.425 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd2cb41700 1 -- 172.21.15.82:0/573544539 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd280cd850 con 0x7efd2806a5d0 2023-11-28T13:00:19.425 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd24ff9700 1 -- 172.21.15.82:0/573544539 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd180055a0 con 0x7efd2806a5d0 2023-11-28T13:00:19.425 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd2cb41700 1 -- 172.21.15.82:0/573544539 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd280cd570 con 0x7efd2806a5d0 2023-11-28T13:00:19.425 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.408+0000 7efd2cb41700 1 -- 172.21.15.82:0/573544539 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd280cdb30 con 0x7efd2806a5d0 2023-11-28T13:00:19.425 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.412+0000 7efd24ff9700 1 -- 172.21.15.82:0/573544539 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efd18019030 con 0x7efd2806a5d0 2023-11-28T13:00:19.426 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.412+0000 7efd24ff9700 1 --2- 172.21.15.82:0/573544539 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efd08064ee0 0x7efd08067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:19.426 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.412+0000 7efd24ff9700 1 -- 172.21.15.82:0/573544539 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efd18080ce0 con 0x7efd2806a5d0 2023-11-28T13:00:19.426 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.412+0000 7efd1ffff700 1 --2- 172.21.15.82:0/573544539 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efd08064ee0 0x7efd08067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:19.426 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.412+0000 7efd1ffff700 1 --2- 172.21.15.82:0/573544539 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efd08064ee0 0x7efd08067390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efd280c5d70 tx=0x7efd10009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:19.427 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.420+0000 7efd24ff9700 1 -- 172.21.15.82:0/573544539 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efd1804f330 con 0x7efd2806a5d0 2023-11-28T13:00:19.589 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.584+0000 7efd2cb41700 1 -- 172.21.15.82:0/573544539 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd28067b90 con 0x7efd2806a5d0 2023-11-28T13:00:19.591 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.588+0000 7efd24ff9700 1 -- 172.21.15.82:0/573544539 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12382 (secure 0 0 0) 0x7efd18052950 con 0x7efd2806a5d0 2023-11-28T13:00:19.593 INFO:teuthology.misc.health.smithi082.stdout: 2023-11-28T13:00:19.593 INFO:teuthology.misc.health.smithi082.stdout:{"epoch":17,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:00:17.399812+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:00:19.595 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.588+0000 7efd2cb41700 1 -- 172.21.15.82:0/573544539 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efd08064ee0 msgr2=0x7efd08067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:19.595 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.588+0000 7efd2cb41700 1 --2- 172.21.15.82:0/573544539 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efd08064ee0 0x7efd08067390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efd280c5d70 tx=0x7efd10009040 comp rx=0 tx=0).stop 2023-11-28T13:00:19.595 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.588+0000 7efd2cb41700 1 -- 172.21.15.82:0/573544539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd2806a5d0 msgr2=0x7efd280c8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:19.595 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.588+0000 7efd2cb41700 1 --2- 172.21.15.82:0/573544539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd2806a5d0 0x7efd280c8690 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efd1800c500 tx=0x7efd1800c8c0 comp rx=0 tx=0).stop 2023-11-28T13:00:19.595 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.588+0000 7efd2cb41700 1 -- 172.21.15.82:0/573544539 shutdown_connections 2023-11-28T13:00:19.595 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.588+0000 7efd2cb41700 1 --2- 172.21.15.82:0/573544539 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efd08064ee0 0x7efd08067390 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:19.596 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.588+0000 7efd2cb41700 1 --2- 172.21.15.82:0/573544539 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd28158eb0 0x7efd281efb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:19.596 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.588+0000 7efd2cb41700 1 --2- 172.21.15.82:0/573544539 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efd280ca4a0 0x7efd2815b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:19.596 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.588+0000 7efd2cb41700 1 --2- 172.21.15.82:0/573544539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd2806a5d0 0x7efd280c8690 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:19.596 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.588+0000 7efd2cb41700 1 -- 172.21.15.82:0/573544539 >> 172.21.15.82:0/573544539 conn(0x7efd280cedc0 msgr2=0x7efd280b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:19.596 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.588+0000 7efd2cb41700 1 -- 172.21.15.82:0/573544539 shutdown_connections 2023-11-28T13:00:19.596 INFO:teuthology.misc.health.smithi082.stderr:2023-11-28T13:00:19.588+0000 7efd2cb41700 1 -- 172.21.15.82:0/573544539 wait complete. 2023-11-28T13:00:19.604 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-28T13:00:19.604 INFO:tasks.ceph:Creating RBD pool 2023-11-28T13:00:19.604 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd pool create rbd 8 2023-11-28T13:00:19.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f43fff700 1 Processor -- start 2023-11-28T13:00:19.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f43fff700 1 -- start start 2023-11-28T13:00:19.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f43fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f440ad820 0x7f5f4406a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:19.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f43fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5f440c9b10 0x7f5f440c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:19.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f43fff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f440c93a0 con 0x7f5f44070910 2023-11-28T13:00:19.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f43fff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f440c96f0 con 0x7f5f440c9b10 2023-11-28T13:00:19.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f43fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f44071580 con 0x7f5f440ad820 2023-11-28T13:00:19.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f437fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5f440c9b10 0x7f5f440c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:19.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f437fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5f440c9b10 0x7f5f440c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39270/0 (socket says 172.21.15.82:39270) 2023-11-28T13:00:19.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f42ffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5f44070910 0x7f5f44070ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33186/0 (socket says 172.21.15.82:33186) 2023-11-28T13:00:19.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f437fe700 1 -- 172.21.15.82:0/2663173592 learned_addr learned my addr 172.21.15.82:0/2663173592 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:19.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f427fc700 1 --2- 172.21.15.82:0/2663173592 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f440ad820 0x7f5f4406a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:19.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f437fe700 1 -- 172.21.15.82:0/2663173592 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f440ad820 msgr2=0x7f5f4406a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:19.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f437fe700 1 --2- 172.21.15.82:0/2663173592 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f440ad820 0x7f5f4406a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:19.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f437fe700 1 -- 172.21.15.82:0/2663173592 >> v1:172.21.15.82:6789/0 conn(0x7f5f44070910 legacy=0x7f5f44070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:19.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f437fe700 1 -- 172.21.15.82:0/2663173592 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4406ab10 con 0x7f5f440c9b10 2023-11-28T13:00:19.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f41ffb700 1 -- 172.21.15.82:0/2663173592 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511812149 0 0) 0x7f5f440c93a0 con 0x7f5f44070910 2023-11-28T13:00:19.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f437fe700 1 --2- 172.21.15.82:0/2663173592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f440c9b10 0x7f5f440c9f80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009940 tx=0x7f5f3c009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402455ff2283a11a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:19.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f41ffb700 1 -- 172.21.15.82:0/2663173592 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c011830 con 0x7f5f440c9b10 2023-11-28T13:00:19.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f41ffb700 1 -- 172.21.15.82:0/2663173592 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3c011990 con 0x7f5f440c9b10 2023-11-28T13:00:19.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f41ffb700 1 -- 172.21.15.82:0/2663173592 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c011d20 con 0x7f5f440c9b10 2023-11-28T13:00:19.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f43fff700 1 -- 172.21.15.82:0/2663173592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f440c9b10 msgr2=0x7f5f440c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:19.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f43fff700 1 --2- 172.21.15.82:0/2663173592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f440c9b10 0x7f5f440c9f80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009940 tx=0x7f5f3c009c50 comp rx=0 tx=0).stop 2023-11-28T13:00:19.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f43fff700 1 -- 172.21.15.82:0/2663173592 shutdown_connections 2023-11-28T13:00:19.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f43fff700 1 --2- 172.21.15.82:0/2663173592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f440c9b10 0x7f5f440c9f80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:19.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f43fff700 1 --2- 172.21.15.82:0/2663173592 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f440ad820 0x7f5f4406a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:19.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f43fff700 1 -- 172.21.15.82:0/2663173592 >> 172.21.15.82:0/2663173592 conn(0x7f5f440ce630 msgr2=0x7f5f440cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:19.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f43fff700 1 -- 172.21.15.82:0/2663173592 shutdown_connections 2023-11-28T13:00:19.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.716+0000 7f5f43fff700 1 -- 172.21.15.82:0/2663173592 wait complete. 2023-11-28T13:00:19.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f43fff700 1 Processor -- start 2023-11-28T13:00:19.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f43fff700 1 -- start start 2023-11-28T13:00:19.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f43fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f44070910 0x7f5f44158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:19.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f43fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f440ad820 0x7f5f440cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:19.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f43fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f440c9b10 0x7f5f4415b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:19.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f43fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f440cb6c0 con 0x7f5f44070910 2023-11-28T13:00:19.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f43fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f44158b50 con 0x7f5f440ad820 2023-11-28T13:00:19.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f43fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f440cb910 con 0x7f5f440c9b10 2023-11-28T13:00:19.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f42ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f44070910 0x7f5f44158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:19.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f42ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f44070910 0x7f5f44158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39276/0 (socket says 172.21.15.82:39276) 2023-11-28T13:00:19.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f42ffd700 1 -- 172.21.15.82:0/1097003447 learned_addr learned my addr 172.21.15.82:0/1097003447 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:19.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f427fc700 1 --2- 172.21.15.82:0/1097003447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f440ad820 0x7f5f440cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:19.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f437fe700 1 --2- 172.21.15.82:0/1097003447 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f440c9b10 0x7f5f4415b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:19.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f42ffd700 1 -- 172.21.15.82:0/1097003447 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f440c9b10 msgr2=0x7f5f4415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:19.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f42ffd700 1 --2- 172.21.15.82:0/1097003447 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f440c9b10 0x7f5f4415b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:19.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f42ffd700 1 -- 172.21.15.82:0/1097003447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f440ad820 msgr2=0x7f5f440cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:19.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f42ffd700 1 --2- 172.21.15.82:0/1097003447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f440ad820 0x7f5f440cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:19.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f42ffd700 1 -- 172.21.15.82:0/1097003447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c009570 con 0x7f5f44070910 2023-11-28T13:00:19.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f42ffd700 1 --2- 172.21.15.82:0/1097003447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f44070910 0x7f5f44158610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800c510 tx=0x7f5f3800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:19.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f2b7fe700 1 -- 172.21.15.82:0/1097003447 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38004ca0 con 0x7f5f44070910 2023-11-28T13:00:19.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f2b7fe700 1 -- 172.21.15.82:0/1097003447 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f38004e20 con 0x7f5f44070910 2023-11-28T13:00:19.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f43fff700 1 -- 172.21.15.82:0/1097003447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4406b0c0 con 0x7f5f44070910 2023-11-28T13:00:19.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f43fff700 1 -- 172.21.15.82:0/1097003447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4406ade0 con 0x7f5f44070910 2023-11-28T13:00:19.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.720+0000 7f5f2b7fe700 1 -- 172.21.15.82:0/1097003447 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38007310 con 0x7f5f44070910 2023-11-28T13:00:19.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.724+0000 7f5f43fff700 1 -- 172.21.15.82:0/1097003447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f4406b3a0 con 0x7f5f44070910 2023-11-28T13:00:19.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.724+0000 7f5f2b7fe700 1 -- 172.21.15.82:0/1097003447 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5f3801a020 con 0x7f5f44070910 2023-11-28T13:00:19.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.724+0000 7f5f2b7fe700 1 --2- 172.21.15.82:0/1097003447 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5f30064ee0 0x7f5f30067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:19.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.724+0000 7f5f427fc700 1 --2- 172.21.15.82:0/1097003447 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5f30064ee0 0x7f5f30067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:19.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.724+0000 7f5f2b7fe700 1 -- 172.21.15.82:0/1097003447 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5f38081640 con 0x7f5f44070910 2023-11-28T13:00:19.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.724+0000 7f5f427fc700 1 --2- 172.21.15.82:0/1097003447 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5f30064ee0 0x7f5f30067390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5f44159930 tx=0x7f5f3400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:19.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.736+0000 7f5f2b7fe700 1 -- 172.21.15.82:0/1097003447 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5f3804fc30 con 0x7f5f44070910 2023-11-28T13:00:19.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:19.896+0000 7f5f43fff700 1 -- 172.21.15.82:0/1097003447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f5f44065fc0 con 0x7f5f44070910 2023-11-28T13:00:20.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.440+0000 7f5f2b7fe700 1 -- 172.21.15.82:0/1097003447 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7f5f38053250 con 0x7f5f44070910 2023-11-28T13:00:20.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.444+0000 7f5f43fff700 1 -- 172.21.15.82:0/1097003447 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5f30064ee0 msgr2=0x7f5f30067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:20.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.444+0000 7f5f43fff700 1 --2- 172.21.15.82:0/1097003447 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5f30064ee0 0x7f5f30067390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5f44159930 tx=0x7f5f3400b040 comp rx=0 tx=0).stop 2023-11-28T13:00:20.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.444+0000 7f5f43fff700 1 -- 172.21.15.82:0/1097003447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f44070910 msgr2=0x7f5f44158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:20.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.444+0000 7f5f43fff700 1 --2- 172.21.15.82:0/1097003447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f44070910 0x7f5f44158610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800c510 tx=0x7f5f3800c8d0 comp rx=0 tx=0).stop 2023-11-28T13:00:20.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.444+0000 7f5f43fff700 1 -- 172.21.15.82:0/1097003447 shutdown_connections 2023-11-28T13:00:20.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.444+0000 7f5f43fff700 1 --2- 172.21.15.82:0/1097003447 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5f30064ee0 0x7f5f30067390 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:20.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.444+0000 7f5f43fff700 1 --2- 172.21.15.82:0/1097003447 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f440c9b10 0x7f5f4415b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:20.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.444+0000 7f5f43fff700 1 --2- 172.21.15.82:0/1097003447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f440ad820 0x7f5f440cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:20.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.444+0000 7f5f43fff700 1 --2- 172.21.15.82:0/1097003447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f44070910 0x7f5f44158610 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:20.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.444+0000 7f5f43fff700 1 -- 172.21.15.82:0/1097003447 >> 172.21.15.82:0/1097003447 conn(0x7f5f440ce630 msgr2=0x7f5f440b1620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:20.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.444+0000 7f5f43fff700 1 -- 172.21.15.82:0/1097003447 shutdown_connections 2023-11-28T13:00:20.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.444+0000 7f5f43fff700 1 -- 172.21.15.82:0/1097003447 wait complete. 2023-11-28T13:00:20.451 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'rbd' created 2023-11-28T13:00:20.463 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-11-28T13:00:20.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b61ff1700 1 Processor -- start 2023-11-28T13:00:20.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b61ff1700 1 -- start start 2023-11-28T13:00:20.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b61ff1700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7b5c0c27f0 0x7f7b5c0b1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:20.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b61ff1700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5c0aef00 con 0x7f7b5c0ca010 2023-11-28T13:00:20.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b61ff1700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5c0cda70 con 0x7f7b5c160800 2023-11-28T13:00:20.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b61ff1700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b5c0b1d70 con 0x7f7b5c0c27f0 2023-11-28T13:00:20.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b617f0700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7b5c0ca010 0x7f7b5c0ca430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33198/0 (socket says 172.21.15.82:33198) 2023-11-28T13:00:20.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b617f0700 1 -- 172.21.15.82:0/1245738620 learned_addr learned my addr 172.21.15.82:0/1245738620 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:20.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b5bfff700 1 --2- 172.21.15.82:0/1245738620 >> v2:172.21.15.114:3300/0 conn(0x7f7b5c0c27f0 0x7f7b5c0b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:20.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b5b7fe700 1 -- 172.21.15.82:0/1245738620 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2692262780 0 0) 0x7f7b5c0aef00 con 0x7f7b5c0ca010 2023-11-28T13:00:20.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b5b7fe700 1 -- 172.21.15.82:0/1245738620 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b440035d0 con 0x7f7b5c0ca010 2023-11-28T13:00:20.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b5b7fe700 1 -- 172.21.15.82:0/1245738620 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 763902447 0 0) 0x7f7b440035d0 con 0x7f7b5c0ca010 2023-11-28T13:00:20.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b5b7fe700 1 -- 172.21.15.82:0/1245738620 >> v2:172.21.15.114:3300/0 conn(0x7f7b5c0c27f0 msgr2=0x7f7b5c0b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:20.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b5b7fe700 1 --2- 172.21.15.82:0/1245738620 >> v2:172.21.15.114:3300/0 conn(0x7f7b5c0c27f0 0x7f7b5c0b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:20.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b5b7fe700 1 -- 172.21.15.82:0/1245738620 >> v1:172.21.15.114:6789/0 conn(0x7f7b5c160800 legacy=0x7f7b5c0ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:20.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b5b7fe700 1 -- 172.21.15.82:0/1245738620 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5c0b17b0 con 0x7f7b5c0ca010 2023-11-28T13:00:20.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b5bfff700 1 --2- 172.21.15.82:0/1245738620 >> v2:172.21.15.114:3300/0 conn(0x7f7b5c0c27f0 0x7f7b5c0b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:20.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b5b7fe700 1 -- 172.21.15.82:0/1245738620 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f7b540019f0 con 0x7f7b5c0ca010 2023-11-28T13:00:20.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b5b7fe700 1 -- 172.21.15.82:0/1245738620 >> v1:172.21.15.82:6789/0 conn(0x7f7b5c0ca010 legacy=0x7f7b5c0ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:20.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b5b7fe700 1 --2- 172.21.15.82:0/1245738620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b44003a20 0x7f7b44003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:20.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b5b7fe700 1 --2- 172.21.15.82:0/1245738620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b44004870 0x7f7b44004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:20.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b5b7fe700 1 --2- 172.21.15.82:0/1245738620 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b44005340 0x7f7b4400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:20.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b5b7fe700 1 -- 172.21.15.82:0/1245738620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c0b1d70 con 0x7f7b44003a20 2023-11-28T13:00:20.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b5b7fe700 1 -- 172.21.15.82:0/1245738620 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4400c270 con 0x7f7b44004870 2023-11-28T13:00:20.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b5b7fe700 1 -- 172.21.15.82:0/1245738620 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4400c430 con 0x7f7b44005340 2023-11-28T13:00:20.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b60fef700 1 --2- 172.21.15.82:0/1245738620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b44003a20 0x7f7b44003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:20.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b5bfff700 1 --2- 172.21.15.82:0/1245738620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b44004870 0x7f7b44004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:20.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b60fef700 1 -- 172.21.15.82:0/1245738620 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b44005340 msgr2=0x7f7b4400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:20.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b60fef700 1 --2- 172.21.15.82:0/1245738620 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b44005340 0x7f7b4400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:20.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b60fef700 1 -- 172.21.15.82:0/1245738620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b44004870 msgr2=0x7f7b44004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:20.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b60fef700 1 --2- 172.21.15.82:0/1245738620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b44004870 0x7f7b44004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:20.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b60fef700 1 -- 172.21.15.82:0/1245738620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b440035d0 con 0x7f7b44003a20 2023-11-28T13:00:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b5bfff700 1 --2- 172.21.15.82:0/1245738620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b44004870 0x7f7b44004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:00:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b617f0700 1 -- 172.21.15.82:0/1245738620 reap_dead start 2023-11-28T13:00:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.572+0000 7f7b60fef700 1 --2- 172.21.15.82:0/1245738620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b44003a20 0x7f7b44003e30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0017e0 tx=0x7f7b440058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c406376a582a9c33 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.576+0000 7f7b5b7fe700 1 -- 172.21.15.82:0/1245738620 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c0052d0 con 0x7f7b44003a20 2023-11-28T13:00:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.576+0000 7f7b5b7fe700 1 -- 172.21.15.82:0/1245738620 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4c005430 con 0x7f7b44003a20 2023-11-28T13:00:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.576+0000 7f7b5b7fe700 1 -- 172.21.15.82:0/1245738620 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c0055a0 con 0x7f7b44003a20 2023-11-28T13:00:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.576+0000 7f7b61ff1700 1 -- 172.21.15.82:0/1245738620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b44003a20 msgr2=0x7f7b44003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.576+0000 7f7b61ff1700 1 --2- 172.21.15.82:0/1245738620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b44003a20 0x7f7b44003e30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0017e0 tx=0x7f7b440058a0 comp rx=0 tx=0).stop 2023-11-28T13:00:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.576+0000 7f7b61ff1700 1 -- 172.21.15.82:0/1245738620 shutdown_connections 2023-11-28T13:00:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.576+0000 7f7b61ff1700 1 --2- 172.21.15.82:0/1245738620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b44003a20 0x7f7b44003e30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.576+0000 7f7b61ff1700 1 -- 172.21.15.82:0/1245738620 >> 172.21.15.82:0/1245738620 conn(0x7f7b5c0cc120 msgr2=0x7f7b5c0cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.576+0000 7f7b61ff1700 1 -- 172.21.15.82:0/1245738620 shutdown_connections 2023-11-28T13:00:20.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.576+0000 7f7b61ff1700 1 -- 172.21.15.82:0/1245738620 wait complete. 2023-11-28T13:00:20.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.576+0000 7f7b61ff1700 1 Processor -- start 2023-11-28T13:00:20.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.576+0000 7f7b61ff1700 1 -- start start 2023-11-28T13:00:20.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b61ff1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b44003a20 0x7f7b5c1f73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:20.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b61ff1700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b5c0c5810 0x7f7b5c1f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:20.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b61ff1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b5c1f3a70 0x7f7b5c0c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:20.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b61ff1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c15d9f0 con 0x7f7b5c1f3a70 2023-11-28T13:00:20.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b61ff1700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c1f6220 con 0x7f7b44003a20 2023-11-28T13:00:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b61ff1700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c160f50 con 0x7f7b5c0c5810 2023-11-28T13:00:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b617f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b5c1f3a70 0x7f7b5c0c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b617f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b5c1f3a70 0x7f7b5c0c7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39302/0 (socket says 172.21.15.82:39302) 2023-11-28T13:00:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b617f0700 1 -- 172.21.15.82:0/3918482106 learned_addr learned my addr 172.21.15.82:0/3918482106 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b60fef700 1 --2- 172.21.15.82:0/3918482106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b44003a20 0x7f7b5c1f73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b5bfff700 1 --2- 172.21.15.82:0/3918482106 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b5c0c5810 0x7f7b5c1f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b617f0700 1 -- 172.21.15.82:0/3918482106 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b5c0c5810 msgr2=0x7f7b5c1f3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b617f0700 1 --2- 172.21.15.82:0/3918482106 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b5c0c5810 0x7f7b5c1f3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b617f0700 1 -- 172.21.15.82:0/3918482106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b44003a20 msgr2=0x7f7b5c1f73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b617f0700 1 --2- 172.21.15.82:0/3918482106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b44003a20 0x7f7b5c1f73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b617f0700 1 -- 172.21.15.82:0/3918482106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5c0cdd10 con 0x7f7b5c1f3a70 2023-11-28T13:00:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b617f0700 1 --2- 172.21.15.82:0/3918482106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b5c1f3a70 0x7f7b5c0c7d60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7b540012e0 tx=0x7f7b5400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:20.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b597fa700 1 -- 172.21.15.82:0/3918482106 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5400aa60 con 0x7f7b5c1f3a70 2023-11-28T13:00:20.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b597fa700 1 -- 172.21.15.82:0/3918482106 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5400abc0 con 0x7f7b5c1f3a70 2023-11-28T13:00:20.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b61ff1700 1 -- 172.21.15.82:0/3918482106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5c0b1a90 con 0x7f7b5c1f3a70 2023-11-28T13:00:20.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b597fa700 1 -- 172.21.15.82:0/3918482106 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54007030 con 0x7f7b5c1f3a70 2023-11-28T13:00:20.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.580+0000 7f7b61ff1700 1 -- 172.21.15.82:0/3918482106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5c0b1120 con 0x7f7b5c1f3a70 2023-11-28T13:00:20.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.584+0000 7f7b61ff1700 1 -- 172.21.15.82:0/3918482106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b5c1f6440 con 0x7f7b5c1f3a70 2023-11-28T13:00:20.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.584+0000 7f7b597fa700 1 -- 172.21.15.82:0/3918482106 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7b54010070 con 0x7f7b5c1f3a70 2023-11-28T13:00:20.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.584+0000 7f7b597fa700 1 --2- 172.21.15.82:0/3918482106 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b48064ee0 0x7f7b48067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:20.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.584+0000 7f7b597fa700 1 -- 172.21.15.82:0/3918482106 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f7b54081130 con 0x7f7b5c1f3a70 2023-11-28T13:00:20.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.584+0000 7f7b60fef700 1 --2- 172.21.15.82:0/3918482106 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b48064ee0 0x7f7b48067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:20.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.584+0000 7f7b60fef700 1 --2- 172.21.15.82:0/3918482106 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b48064ee0 0x7f7b48067390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c005040 tx=0x7f7b4c009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:20.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.592+0000 7f7b597fa700 1 -- 172.21.15.82:0/3918482106 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7b5c1f6440 con 0x7f7b5c1f3a70 2023-11-28T13:00:20.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:20.752+0000 7f7b61ff1700 1 -- 172.21.15.82:0/3918482106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7b5c1f63e0 con 0x7f7b5c1f3a70 2023-11-28T13:00:21.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.452+0000 7f7b597fa700 1 -- 172.21.15.82:0/3918482106 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7b54018020 con 0x7f7b5c1f3a70 2023-11-28T13:00:21.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.456+0000 7f7b61ff1700 1 -- 172.21.15.82:0/3918482106 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b48064ee0 msgr2=0x7f7b48067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:21.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.456+0000 7f7b61ff1700 1 --2- 172.21.15.82:0/3918482106 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b48064ee0 0x7f7b48067390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c005040 tx=0x7f7b4c009030 comp rx=0 tx=0).stop 2023-11-28T13:00:21.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.456+0000 7f7b61ff1700 1 -- 172.21.15.82:0/3918482106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b5c1f3a70 msgr2=0x7f7b5c0c7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:21.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.456+0000 7f7b61ff1700 1 --2- 172.21.15.82:0/3918482106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b5c1f3a70 0x7f7b5c0c7d60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7b540012e0 tx=0x7f7b5400a060 comp rx=0 tx=0).stop 2023-11-28T13:00:21.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.456+0000 7f7b61ff1700 1 -- 172.21.15.82:0/3918482106 shutdown_connections 2023-11-28T13:00:21.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.456+0000 7f7b61ff1700 1 --2- 172.21.15.82:0/3918482106 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b48064ee0 0x7f7b48067390 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:21.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.456+0000 7f7b61ff1700 1 --2- 172.21.15.82:0/3918482106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b5c1f3a70 0x7f7b5c0c7d60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:21.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.456+0000 7f7b61ff1700 1 --2- 172.21.15.82:0/3918482106 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b5c0c5810 0x7f7b5c1f3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:21.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.456+0000 7f7b61ff1700 1 --2- 172.21.15.82:0/3918482106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b44003a20 0x7f7b5c1f73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:21.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.456+0000 7f7b61ff1700 1 -- 172.21.15.82:0/3918482106 >> 172.21.15.82:0/3918482106 conn(0x7f7b5c0cc120 msgr2=0x7f7b5c071030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:21.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.456+0000 7f7b61ff1700 1 -- 172.21.15.82:0/3918482106 shutdown_connections 2023-11-28T13:00:21.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.456+0000 7f7b61ff1700 1 -- 172.21.15.82:0/3918482106 wait complete. 2023-11-28T13:00:21.462 INFO:teuthology.orchestra.run.smithi082.stderr:enabled application 'rbd' on pool 'rbd' 2023-11-28T13:00:21.474 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-28T13:00:21.474 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T13:00:21.474 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T13:00:21.476 INFO:tasks.ceph.mds.a:Started 2023-11-28T13:00:21.476 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T13:00:21.476 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T13:00:21.478 INFO:tasks.ceph.mds.c:Started 2023-11-28T13:00:21.478 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T13:00:21.478 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T13:00:21.481 INFO:tasks.ceph.mds.b:Started 2023-11-28T13:00:21.481 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T13:00:21.481 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T13:00:21.483 INFO:tasks.ceph.mds.d:Started 2023-11-28T13:00:21.483 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-28T13:00:21.484 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:00:21.558 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-11-28T13:00:21.558 INFO:tasks.ceph.mds.b.smithi114.stdout:starting mds.b at 2023-11-28T13:00:21.560 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-11-28T13:00:21.569 INFO:tasks.ceph.mds.d.smithi114.stdout:starting mds.d at 2023-11-28T13:00:21.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b40c72700 1 Processor -- start 2023-11-28T13:00:21.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b40c72700 1 -- start start 2023-11-28T13:00:21.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b40c72700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b3c070070 0x7f7b3c0cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:21.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b40c72700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b3c06de00 con 0x7f7b3c0cc1d0 2023-11-28T13:00:21.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b40c72700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b3c0ce420 con 0x7f7b3c06d430 2023-11-28T13:00:21.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b40c72700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c06b520 con 0x7f7b3c070070 2023-11-28T13:00:21.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b3bfff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7b3c0cc1d0 0x7f7b3c069bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33216/0 (socket says 172.21.15.82:33216) 2023-11-28T13:00:21.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b3bfff700 1 -- 172.21.15.82:0/1128469666 learned_addr learned my addr 172.21.15.82:0/1128469666 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:21.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b3b7fe700 1 --2- 172.21.15.82:0/1128469666 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b3c070070 0x7f7b3c0cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:21.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b3a7fc700 1 -- 172.21.15.82:0/1128469666 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246142028 0 0) 0x7f7b3c06de00 con 0x7f7b3c0cc1d0 2023-11-28T13:00:21.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b3a7fc700 1 -- 172.21.15.82:0/1128469666 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b240035d0 con 0x7f7b3c0cc1d0 2023-11-28T13:00:21.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b3a7fc700 1 -- 172.21.15.82:0/1128469666 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726287760 0 0) 0x7f7b3c0ce420 con 0x7f7b3c06d430 2023-11-28T13:00:21.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b3a7fc700 1 -- 172.21.15.82:0/1128469666 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b3c06de00 con 0x7f7b3c06d430 2023-11-28T13:00:21.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b3b7fe700 1 -- 172.21.15.82:0/1128469666 >> v1:172.21.15.114:6789/0 conn(0x7f7b3c06d430 legacy=0x7f7b3c070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:21.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b3b7fe700 1 -- 172.21.15.82:0/1128469666 >> v1:172.21.15.82:6789/0 conn(0x7f7b3c0cc1d0 legacy=0x7f7b3c069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:21.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b3b7fe700 1 -- 172.21.15.82:0/1128469666 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c06cb20 con 0x7f7b3c070070 2023-11-28T13:00:21.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b3b7fe700 1 --2- 172.21.15.82:0/1128469666 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b3c070070 0x7f7b3c0cdee0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c009880 tx=0x7f7b2c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d04e0a6225ee585 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:21.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b3a7fc700 1 -- 172.21.15.82:0/1128469666 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c011830 con 0x7f7b3c070070 2023-11-28T13:00:21.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b3a7fc700 1 -- 172.21.15.82:0/1128469666 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2c011990 con 0x7f7b3c070070 2023-11-28T13:00:21.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b3a7fc700 1 -- 172.21.15.82:0/1128469666 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c011d20 con 0x7f7b3c070070 2023-11-28T13:00:21.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b40c72700 1 -- 172.21.15.82:0/1128469666 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b3c070070 msgr2=0x7f7b3c0cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:21.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b40c72700 1 --2- 172.21.15.82:0/1128469666 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b3c070070 0x7f7b3c0cdee0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c009880 tx=0x7f7b2c009b90 comp rx=0 tx=0).stop 2023-11-28T13:00:21.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b40c72700 1 -- 172.21.15.82:0/1128469666 shutdown_connections 2023-11-28T13:00:21.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b40c72700 1 --2- 172.21.15.82:0/1128469666 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b3c070070 0x7f7b3c0cdee0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:21.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b40c72700 1 -- 172.21.15.82:0/1128469666 >> 172.21.15.82:0/1128469666 conn(0x7f7b3c0cbd10 msgr2=0x7f7b3c0ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:21.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b40c72700 1 -- 172.21.15.82:0/1128469666 shutdown_connections 2023-11-28T13:00:21.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.592+0000 7f7b40c72700 1 -- 172.21.15.82:0/1128469666 wait complete. 2023-11-28T13:00:21.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b40c72700 1 Processor -- start 2023-11-28T13:00:21.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b40c72700 1 -- start start 2023-11-28T13:00:21.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b40c72700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b3c06d430 0x7f7b3c0c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:21.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b40c72700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b3c070070 0x7f7b3c156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:21.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b40c72700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b3c0cc1d0 0x7f7b3c069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:21.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b40c72700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c0c6e90 con 0x7f7b3c0cc1d0 2023-11-28T13:00:21.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b40c72700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c157140 con 0x7f7b3c06d430 2023-11-28T13:00:21.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b40c72700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c0c9ce0 con 0x7f7b3c070070 2023-11-28T13:00:21.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b3bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b3c0cc1d0 0x7f7b3c069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:21.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b3b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b3c06d430 0x7f7b3c0c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:21.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b3bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b3c0cc1d0 0x7f7b3c069bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39342/0 (socket says 172.21.15.82:39342) 2023-11-28T13:00:21.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b3affd700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b3c070070 0x7f7b3c156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:21.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b3bfff700 1 -- 172.21.15.82:0/1501719244 learned_addr learned my addr 172.21.15.82:0/1501719244 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:21.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b3bfff700 1 -- 172.21.15.82:0/1501719244 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b3c070070 msgr2=0x7f7b3c156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:21.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b3bfff700 1 --2- 172.21.15.82:0/1501719244 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b3c070070 0x7f7b3c156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:21.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b3bfff700 1 -- 172.21.15.82:0/1501719244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b3c06d430 msgr2=0x7f7b3c0c6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:21.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b3bfff700 1 --2- 172.21.15.82:0/1501719244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b3c06d430 0x7f7b3c0c6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:21.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b3bfff700 1 -- 172.21.15.82:0/1501719244 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2c0094b0 con 0x7f7b3c0cc1d0 2023-11-28T13:00:21.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b3bfff700 1 --2- 172.21.15.82:0/1501719244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b3c0cc1d0 0x7f7b3c069bc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400cb70 tx=0x7f7b3400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:21.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b23fff700 1 -- 172.21.15.82:0/1501719244 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34007480 con 0x7f7b3c0cc1d0 2023-11-28T13:00:21.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b23fff700 1 -- 172.21.15.82:0/1501719244 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b340075e0 con 0x7f7b3c0cc1d0 2023-11-28T13:00:21.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b40c72700 1 -- 172.21.15.82:0/1501719244 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b3c06da90 con 0x7f7b3c0cc1d0 2023-11-28T13:00:21.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b23fff700 1 -- 172.21.15.82:0/1501719244 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34007970 con 0x7f7b3c0cc1d0 2023-11-28T13:00:21.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.596+0000 7f7b40c72700 1 -- 172.21.15.82:0/1501719244 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b3c06ce00 con 0x7f7b3c0cc1d0 2023-11-28T13:00:21.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.600+0000 7f7b40c72700 1 -- 172.21.15.82:0/1501719244 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b3c15c500 con 0x7f7b3c0cc1d0 2023-11-28T13:00:21.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.600+0000 7f7b23fff700 1 -- 172.21.15.82:0/1501719244 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7b34019030 con 0x7f7b3c0cc1d0 2023-11-28T13:00:21.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.600+0000 7f7b23fff700 1 --2- 172.21.15.82:0/1501719244 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b28064ee0 0x7f7b28067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:21.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.600+0000 7f7b23fff700 1 -- 172.21.15.82:0/1501719244 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7b34081420 con 0x7f7b3c0cc1d0 2023-11-28T13:00:21.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.600+0000 7f7b3b7fe700 1 --2- 172.21.15.82:0/1501719244 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b28064ee0 0x7f7b28067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:21.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.600+0000 7f7b3b7fe700 1 --2- 172.21.15.82:0/1501719244 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b28064ee0 0x7f7b28067390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0090b0 tx=0x7f7b2c01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:21.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.608+0000 7f7b23fff700 1 -- 172.21.15.82:0/1501719244 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7b3404f890 con 0x7f7b3c0cc1d0 2023-11-28T13:00:21.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.768+0000 7f7b40c72700 1 -- 172.21.15.82:0/1501719244 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b3c065fc0 con 0x7f7b3c0cc1d0 2023-11-28T13:00:21.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.772+0000 7f7b23fff700 1 -- 172.21.15.82:0/1501719244 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14181 (secure 0 0 0) 0x7f7b34052eb0 con 0x7f7b3c0cc1d0 2023-11-28T13:00:21.776 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:21.776 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":19,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:00:21.438969+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:00:21.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.772+0000 7f7b40c72700 1 -- 172.21.15.82:0/1501719244 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b28064ee0 msgr2=0x7f7b28067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:21.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.772+0000 7f7b40c72700 1 --2- 172.21.15.82:0/1501719244 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b28064ee0 0x7f7b28067390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0090b0 tx=0x7f7b2c01c040 comp rx=0 tx=0).stop 2023-11-28T13:00:21.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.772+0000 7f7b40c72700 1 -- 172.21.15.82:0/1501719244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b3c0cc1d0 msgr2=0x7f7b3c069bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:21.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.772+0000 7f7b40c72700 1 --2- 172.21.15.82:0/1501719244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b3c0cc1d0 0x7f7b3c069bc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400cb70 tx=0x7f7b3400cba0 comp rx=0 tx=0).stop 2023-11-28T13:00:21.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.772+0000 7f7b40c72700 1 -- 172.21.15.82:0/1501719244 shutdown_connections 2023-11-28T13:00:21.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.772+0000 7f7b40c72700 1 --2- 172.21.15.82:0/1501719244 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b28064ee0 0x7f7b28067390 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:21.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.772+0000 7f7b40c72700 1 --2- 172.21.15.82:0/1501719244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b3c0cc1d0 0x7f7b3c069bc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:21.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.772+0000 7f7b40c72700 1 --2- 172.21.15.82:0/1501719244 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b3c070070 0x7f7b3c156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:21.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.772+0000 7f7b40c72700 1 --2- 172.21.15.82:0/1501719244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b3c06d430 0x7f7b3c0c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:21.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.772+0000 7f7b40c72700 1 -- 172.21.15.82:0/1501719244 >> 172.21.15.82:0/1501719244 conn(0x7f7b3c0cbd10 msgr2=0x7f7b3c0ab8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:21.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.772+0000 7f7b40c72700 1 -- 172.21.15.82:0/1501719244 shutdown_connections 2023-11-28T13:00:21.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.772+0000 7f7b40c72700 1 -- 172.21.15.82:0/1501719244 wait complete. 2023-11-28T13:00:21.790 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:00:21.790 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:00:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.904+0000 7f21b3fff700 1 Processor -- start 2023-11-28T13:00:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.904+0000 7f21b3fff700 1 -- start start 2023-11-28T13:00:21.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b3fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21b40cee20 0x7f21b415cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:21.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b3fff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b40cd0e0 con 0x7f21b415d4c0 2023-11-28T13:00:21.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b3fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b40cd3c0 con 0x7f21b40b8300 2023-11-28T13:00:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b3fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b40b86d0 con 0x7f21b40cee20 2023-11-28T13:00:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b37fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f21b415d4c0 0x7f21b40b4470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33228/0 (socket says 172.21.15.82:33228) 2023-11-28T13:00:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b37fe700 1 -- 172.21.15.82:0/3656164848 learned_addr learned my addr 172.21.15.82:0/3656164848 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b27fc700 1 --2- 172.21.15.82:0/3656164848 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21b40cee20 0x7f21b415cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b1ffb700 1 -- 172.21.15.82:0/3656164848 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787812897 0 0) 0x7f21b40cd0e0 con 0x7f21b415d4c0 2023-11-28T13:00:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b1ffb700 1 -- 172.21.15.82:0/3656164848 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f219c0035d0 con 0x7f21b415d4c0 2023-11-28T13:00:21.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b1ffb700 1 -- 172.21.15.82:0/3656164848 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270660044 0 0) 0x7f21b40cd3c0 con 0x7f21b40b8300 2023-11-28T13:00:21.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b1ffb700 1 -- 172.21.15.82:0/3656164848 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21b40cd0e0 con 0x7f21b40b8300 2023-11-28T13:00:21.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b1ffb700 1 -- 172.21.15.82:0/3656164848 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 105489438 0 0) 0x7f219c0035d0 con 0x7f21b415d4c0 2023-11-28T13:00:21.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b1ffb700 1 -- 172.21.15.82:0/3656164848 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21b40cee20 msgr2=0x7f21b415cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:21.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b1ffb700 1 --2- 172.21.15.82:0/3656164848 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21b40cee20 0x7f21b415cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:21.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b1ffb700 1 -- 172.21.15.82:0/3656164848 >> v1:172.21.15.114:6789/0 conn(0x7f21b40b8300 legacy=0x7f21b4160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:21.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b1ffb700 1 -- 172.21.15.82:0/3656164848 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b40cd6a0 con 0x7f21b415d4c0 2023-11-28T13:00:21.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b1ffb700 1 -- 172.21.15.82:0/3656164848 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f21ac0019f0 con 0x7f21b415d4c0 2023-11-28T13:00:21.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b27fc700 1 --2- 172.21.15.82:0/3656164848 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21b40cee20 0x7f21b415cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:21.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b1ffb700 1 -- 172.21.15.82:0/3656164848 >> v1:172.21.15.82:6789/0 conn(0x7f21b415d4c0 legacy=0x7f21b40b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:21.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b1ffb700 1 --2- 172.21.15.82:0/3656164848 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f219c003be0 0x7f219c003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:21.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b1ffb700 1 --2- 172.21.15.82:0/3656164848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f219c004870 0x7f219c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:21.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b1ffb700 1 --2- 172.21.15.82:0/3656164848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f219c005220 0x7f219c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:21.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b1ffb700 1 -- 172.21.15.82:0/3656164848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b40b86d0 con 0x7f219c004870 2023-11-28T13:00:21.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b1ffb700 1 -- 172.21.15.82:0/3656164848 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219c00bff0 con 0x7f219c005220 2023-11-28T13:00:21.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b1ffb700 1 -- 172.21.15.82:0/3656164848 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219c00c1b0 con 0x7f219c003be0 2023-11-28T13:00:21.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b27fc700 1 --2- 172.21.15.82:0/3656164848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f219c004870 0x7f219c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:21.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b37fe700 1 --2- 172.21.15.82:0/3656164848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f219c005220 0x7f219c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:21.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b2ffd700 1 --2- 172.21.15.82:0/3656164848 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f219c003be0 0x7f219c003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:21.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b27fc700 1 -- 172.21.15.82:0/3656164848 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f219c003be0 msgr2=0x7f219c003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:21.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b27fc700 1 --2- 172.21.15.82:0/3656164848 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f219c003be0 0x7f219c003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:21.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b27fc700 1 -- 172.21.15.82:0/3656164848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f219c005220 msgr2=0x7f219c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:21.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b27fc700 1 --2- 172.21.15.82:0/3656164848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f219c005220 0x7f219c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:21.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b27fc700 1 -- 172.21.15.82:0/3656164848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c0035d0 con 0x7f219c004870 2023-11-28T13:00:21.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b37fe700 1 --2- 172.21.15.82:0/3656164848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f219c005220 0x7f219c00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:21.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b27fc700 1 --2- 172.21.15.82:0/3656164848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f219c004870 0x7f219c004ce0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f21a4009bd0 tx=0x7f219c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=116fb8aab5caf452 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:21.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b1ffb700 1 -- 172.21.15.82:0/3656164848 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a40096e0 con 0x7f219c004870 2023-11-28T13:00:21.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b1ffb700 1 -- 172.21.15.82:0/3656164848 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a4004030 con 0x7f219c004870 2023-11-28T13:00:21.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.908+0000 7f21b1ffb700 1 -- 172.21.15.82:0/3656164848 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a40043c0 con 0x7f219c004870 2023-11-28T13:00:21.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.912+0000 7f21b3fff700 1 -- 172.21.15.82:0/3656164848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f219c004870 msgr2=0x7f219c004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:21.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.912+0000 7f21b3fff700 1 --2- 172.21.15.82:0/3656164848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f219c004870 0x7f219c004ce0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f21a4009bd0 tx=0x7f219c0058a0 comp rx=0 tx=0).stop 2023-11-28T13:00:21.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.912+0000 7f21b37fe700 1 -- 172.21.15.82:0/3656164848 reap_dead start 2023-11-28T13:00:21.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.912+0000 7f21b3fff700 1 -- 172.21.15.82:0/3656164848 shutdown_connections 2023-11-28T13:00:21.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.912+0000 7f21b3fff700 1 -- 172.21.15.82:0/3656164848 >> 172.21.15.82:0/3656164848 conn(0x7f21b40cf470 msgr2=0x7f21b40cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:21.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.912+0000 7f21b3fff700 1 -- 172.21.15.82:0/3656164848 shutdown_connections 2023-11-28T13:00:21.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.912+0000 7f21b3fff700 1 -- 172.21.15.82:0/3656164848 wait complete. 2023-11-28T13:00:21.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.912+0000 7f21b3fff700 1 Processor -- start 2023-11-28T13:00:21.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.912+0000 7f21b3fff700 1 -- start start 2023-11-28T13:00:21.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21b41561e0 0x7f21b4157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:21.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b3fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21b41565b0 0x7f21b4157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:21.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21b415d8b0 0x7f21b415dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b3fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b40cf290 con 0x7f21b41561e0 2023-11-28T13:00:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b3fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b41f1f60 con 0x7f21b415d8b0 2023-11-28T13:00:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b3fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b415e260 con 0x7f21b41565b0 2023-11-28T13:00:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21b41561e0 0x7f21b4157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21b41561e0 0x7f21b4157420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39352/0 (socket says 172.21.15.82:39352) 2023-11-28T13:00:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b2ffd700 1 -- 172.21.15.82:0/3087142510 learned_addr learned my addr 172.21.15.82:0/3087142510 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b37fe700 1 --2- 172.21.15.82:0/3087142510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21b415d8b0 0x7f21b415dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b27fc700 1 --2- 172.21.15.82:0/3087142510 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21b41565b0 0x7f21b4157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:21.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b2ffd700 1 -- 172.21.15.82:0/3087142510 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21b41565b0 msgr2=0x7f21b4157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:21.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b2ffd700 1 --2- 172.21.15.82:0/3087142510 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21b41565b0 0x7f21b4157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:21.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b2ffd700 1 -- 172.21.15.82:0/3087142510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21b415d8b0 msgr2=0x7f21b415dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:21.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b2ffd700 1 --2- 172.21.15.82:0/3087142510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21b415d8b0 0x7f21b415dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:21.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b2ffd700 1 -- 172.21.15.82:0/3087142510 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b415c6b0 con 0x7f21b41561e0 2023-11-28T13:00:21.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b27fc700 1 --2- 172.21.15.82:0/3087142510 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21b41565b0 0x7f21b4157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:21.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b37fe700 1 --2- 172.21.15.82:0/3087142510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21b415d8b0 0x7f21b415dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:21.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b2ffd700 1 --2- 172.21.15.82:0/3087142510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21b41561e0 0x7f21b4157420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f21a800f840 tx=0x7f21a800fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:21.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f219bfff700 1 -- 172.21.15.82:0/3087142510 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a80052e0 con 0x7f21b41561e0 2023-11-28T13:00:21.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f219bfff700 1 -- 172.21.15.82:0/3087142510 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a8005440 con 0x7f21b41561e0 2023-11-28T13:00:21.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f219bfff700 1 -- 172.21.15.82:0/3087142510 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a80038e0 con 0x7f21b41561e0 2023-11-28T13:00:21.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b3fff700 1 -- 172.21.15.82:0/3087142510 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b415ca60 con 0x7f21b41561e0 2023-11-28T13:00:21.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b3fff700 1 -- 172.21.15.82:0/3087142510 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b40b4b80 con 0x7f21b41561e0 2023-11-28T13:00:21.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.916+0000 7f21b3fff700 1 -- 172.21.15.82:0/3087142510 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b404ee90 con 0x7f21b41561e0 2023-11-28T13:00:21.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.920+0000 7f219bfff700 1 -- 172.21.15.82:0/3087142510 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f21a8003a40 con 0x7f21b41561e0 2023-11-28T13:00:21.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.920+0000 7f219bfff700 1 --2- 172.21.15.82:0/3087142510 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f21a0064ee0 0x7f21a0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:21.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.920+0000 7f219bfff700 1 -- 172.21.15.82:0/3087142510 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f21a8081c60 con 0x7f21b41561e0 2023-11-28T13:00:21.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.920+0000 7f21b27fc700 1 --2- 172.21.15.82:0/3087142510 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f21a0064ee0 0x7f21a0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:21.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.920+0000 7f21b27fc700 1 --2- 172.21.15.82:0/3087142510 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f21a0064ee0 0x7f21a0067390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f21b4069550 tx=0x7f21a4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:21.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:21.924+0000 7f219bfff700 1 -- 172.21.15.82:0/3087142510 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f21a8050150 con 0x7f21b41561e0 2023-11-28T13:00:22.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.084+0000 7f21b3fff700 1 -- 172.21.15.82:0/3087142510 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21b406af50 con 0x7f21b41561e0 2023-11-28T13:00:22.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.088+0000 7f219bfff700 1 -- 172.21.15.82:0/3087142510 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21a8053770 con 0x7f21b41561e0 2023-11-28T13:00:22.090 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:00:22.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.092+0000 7f21b3fff700 1 -- 172.21.15.82:0/3087142510 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f21a0064ee0 msgr2=0x7f21a0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:22.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.092+0000 7f21b3fff700 1 --2- 172.21.15.82:0/3087142510 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f21a0064ee0 0x7f21a0067390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f21b4069550 tx=0x7f21a4008030 comp rx=0 tx=0).stop 2023-11-28T13:00:22.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.092+0000 7f21b3fff700 1 -- 172.21.15.82:0/3087142510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21b41561e0 msgr2=0x7f21b4157420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:22.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.092+0000 7f21b3fff700 1 --2- 172.21.15.82:0/3087142510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21b41561e0 0x7f21b4157420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f21a800f840 tx=0x7f21a800fc00 comp rx=0 tx=0).stop 2023-11-28T13:00:22.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.092+0000 7f21b3fff700 1 -- 172.21.15.82:0/3087142510 shutdown_connections 2023-11-28T13:00:22.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.092+0000 7f21b3fff700 1 --2- 172.21.15.82:0/3087142510 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f21a0064ee0 0x7f21a0067390 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.092+0000 7f21b3fff700 1 --2- 172.21.15.82:0/3087142510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21b415d8b0 0x7f21b415dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.092+0000 7f21b3fff700 1 --2- 172.21.15.82:0/3087142510 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21b41565b0 0x7f21b4157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.092+0000 7f21b3fff700 1 --2- 172.21.15.82:0/3087142510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21b41561e0 0x7f21b4157420 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.092+0000 7f21b3fff700 1 -- 172.21.15.82:0/3087142510 >> 172.21.15.82:0/3087142510 conn(0x7f21b40cf470 msgr2=0x7f21b40d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:22.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.092+0000 7f21b3fff700 1 -- 172.21.15.82:0/3087142510 shutdown_connections 2023-11-28T13:00:22.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.092+0000 7f21b3fff700 1 -- 172.21.15.82:0/3087142510 wait complete. 2023-11-28T13:00:22.111 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:00:22.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcb05ff5700 1 Processor -- start 2023-11-28T13:00:22.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcb05ff5700 1 -- start start 2023-11-28T13:00:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcb05ff5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcb000caaa0 0x7fcb0015c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcb05ff5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0015d840 con 0x7fcb000cf060 2023-11-28T13:00:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcb05ff5700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0015d280 con 0x7fcb0015cd90 2023-11-28T13:00:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcb05ff5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb0006a450 con 0x7fcb000caaa0 2023-11-28T13:00:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcafffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcb000caaa0 0x7fcb0015c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcb04ff3700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcb000cf060 0x7fcb001607c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33244/0 (socket says 172.21.15.82:33244) 2023-11-28T13:00:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcafffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcb000caaa0 0x7fcb0015c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39364/0 (socket says 172.21.15.82:39364) 2023-11-28T13:00:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcb04ff3700 1 -- 172.21.15.82:0/2610197501 learned_addr learned my addr 172.21.15.82:0/2610197501 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcafffff700 1 -- 172.21.15.82:0/2610197501 >> v1:172.21.15.114:6789/0 conn(0x7fcb0015cd90 legacy=0x7fcb00071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcafffff700 1 -- 172.21.15.82:0/2610197501 >> v1:172.21.15.82:6789/0 conn(0x7fcb000cf060 legacy=0x7fcb001607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcaff7fe700 1 -- 172.21.15.82:0/2610197501 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326994392 0 0) 0x7fcb0015d840 con 0x7fcb000cf060 2023-11-28T13:00:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcafffff700 1 -- 172.21.15.82:0/2610197501 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0015d560 con 0x7fcb000caaa0 2023-11-28T13:00:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcafffff700 1 --2- 172.21.15.82:0/2610197501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb000caaa0 0x7fcb0015c850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcb0006a590 tx=0x7fcae8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e81489759bbb3a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcaff7fe700 1 -- 172.21.15.82:0/2610197501 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae8011830 con 0x7fcb000caaa0 2023-11-28T13:00:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcaff7fe700 1 -- 172.21.15.82:0/2610197501 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae8011990 con 0x7fcb000caaa0 2023-11-28T13:00:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcaff7fe700 1 -- 172.21.15.82:0/2610197501 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae8011d20 con 0x7fcb000caaa0 2023-11-28T13:00:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcb05ff5700 1 -- 172.21.15.82:0/2610197501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb000caaa0 msgr2=0x7fcb0015c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcb05ff5700 1 --2- 172.21.15.82:0/2610197501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb000caaa0 0x7fcb0015c850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcb0006a590 tx=0x7fcae8009b30 comp rx=0 tx=0).stop 2023-11-28T13:00:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcb05ff5700 1 -- 172.21.15.82:0/2610197501 shutdown_connections 2023-11-28T13:00:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcb05ff5700 1 --2- 172.21.15.82:0/2610197501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb000caaa0 0x7fcb0015c850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcb05ff5700 1 -- 172.21.15.82:0/2610197501 >> 172.21.15.82:0/2610197501 conn(0x7fcb000b1f50 msgr2=0x7fcb000cf790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcb05ff5700 1 -- 172.21.15.82:0/2610197501 shutdown_connections 2023-11-28T13:00:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.232+0000 7fcb05ff5700 1 -- 172.21.15.82:0/2610197501 wait complete. 2023-11-28T13:00:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcb05ff5700 1 Processor -- start 2023-11-28T13:00:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcb05ff5700 1 -- start start 2023-11-28T13:00:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcb05ff5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb000caaa0 0x7fcb001554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcb05ff5700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcb000cf060 0x7fcb001570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcb05ff5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb0015cd90 0x7fcb00157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcb05ff5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb000c9700 con 0x7fcb0015cd90 2023-11-28T13:00:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcb05ff5700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb00156410 con 0x7fcb000caaa0 2023-11-28T13:00:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcb05ff5700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb000c6900 con 0x7fcb000cf060 2023-11-28T13:00:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcb057f4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb0015cd90 0x7fcb00157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcb057f4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb0015cd90 0x7fcb00157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39372/0 (socket says 172.21.15.82:39372) 2023-11-28T13:00:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcb057f4700 1 -- 172.21.15.82:0/3058268023 learned_addr learned my addr 172.21.15.82:0/3058268023 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcafffff700 1 --2- 172.21.15.82:0/3058268023 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcb000cf060 0x7fcb001570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcb04ff3700 1 --2- 172.21.15.82:0/3058268023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb000caaa0 0x7fcb001554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcb057f4700 1 -- 172.21.15.82:0/3058268023 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcb000cf060 msgr2=0x7fcb001570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:22.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcb057f4700 1 --2- 172.21.15.82:0/3058268023 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcb000cf060 0x7fcb001570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcb057f4700 1 -- 172.21.15.82:0/3058268023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb000caaa0 msgr2=0x7fcb001554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcb057f4700 1 --2- 172.21.15.82:0/3058268023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb000caaa0 0x7fcb001554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcb057f4700 1 -- 172.21.15.82:0/3058268023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae80094b0 con 0x7fcb0015cd90 2023-11-28T13:00:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcafffff700 1 --2- 172.21.15.82:0/3058268023 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcb000cf060 0x7fcb001570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcb057f4700 1 --2- 172.21.15.82:0/3058268023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb0015cd90 0x7fcb00157620 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800b9a0 tx=0x7fcaf800bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:22.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcafd7fa700 1 -- 172.21.15.82:0/3058268023 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf800c930 con 0x7fcb0015cd90 2023-11-28T13:00:22.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcafd7fa700 1 -- 172.21.15.82:0/3058268023 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf800ca90 con 0x7fcb0015cd90 2023-11-28T13:00:22.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcb05ff5700 1 -- 172.21.15.82:0/3058268023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb001602a0 con 0x7fcb0015cd90 2023-11-28T13:00:22.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcafd7fa700 1 -- 172.21.15.82:0/3058268023 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf800ce40 con 0x7fcb0015cd90 2023-11-28T13:00:22.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.236+0000 7fcb05ff5700 1 -- 172.21.15.82:0/3058268023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0015ffc0 con 0x7fcb0015cd90 2023-11-28T13:00:22.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.240+0000 7fcb05ff5700 1 -- 172.21.15.82:0/3058268023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb000cf430 con 0x7fcb0015cd90 2023-11-28T13:00:22.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.240+0000 7fcafd7fa700 1 -- 172.21.15.82:0/3058268023 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcaf801b030 con 0x7fcb0015cd90 2023-11-28T13:00:22.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.240+0000 7fcafd7fa700 1 --2- 172.21.15.82:0/3058268023 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcae0064ee0 0x7fcae0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:22.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.240+0000 7fcafd7fa700 1 -- 172.21.15.82:0/3058268023 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcaf80817f0 con 0x7fcb0015cd90 2023-11-28T13:00:22.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.240+0000 7fcb04ff3700 1 --2- 172.21.15.82:0/3058268023 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcae0064ee0 0x7fcae0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:22.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.240+0000 7fcb04ff3700 1 --2- 172.21.15.82:0/3058268023 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcae0064ee0 0x7fcae0067390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0000f60 tx=0x7fcaf0007e00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:22.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.248+0000 7fcafd7fa700 1 -- 172.21.15.82:0/3058268023 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcaf804fbf0 con 0x7fcb0015cd90 2023-11-28T13:00:22.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.408+0000 7fcb05ff5700 1 -- 172.21.15.82:0/3058268023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcb00065fc0 con 0x7fcb0015cd90 2023-11-28T13:00:22.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.408+0000 7fcafd7fa700 1 -- 172.21.15.82:0/3058268023 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcaf8053210 con 0x7fcb0015cd90 2023-11-28T13:00:22.411 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:00:22.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.408+0000 7fcb05ff5700 1 -- 172.21.15.82:0/3058268023 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcae0064ee0 msgr2=0x7fcae0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:22.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.408+0000 7fcb05ff5700 1 --2- 172.21.15.82:0/3058268023 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcae0064ee0 0x7fcae0067390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0000f60 tx=0x7fcaf0007e00 comp rx=0 tx=0).stop 2023-11-28T13:00:22.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.408+0000 7fcb05ff5700 1 -- 172.21.15.82:0/3058268023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb0015cd90 msgr2=0x7fcb00157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:22.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.408+0000 7fcb05ff5700 1 --2- 172.21.15.82:0/3058268023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb0015cd90 0x7fcb00157620 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800b9a0 tx=0x7fcaf800bcb0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.408+0000 7fcb05ff5700 1 -- 172.21.15.82:0/3058268023 shutdown_connections 2023-11-28T13:00:22.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.408+0000 7fcb05ff5700 1 --2- 172.21.15.82:0/3058268023 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcae0064ee0 0x7fcae0067390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.408+0000 7fcb05ff5700 1 --2- 172.21.15.82:0/3058268023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb0015cd90 0x7fcb00157620 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.408+0000 7fcb05ff5700 1 --2- 172.21.15.82:0/3058268023 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcb000cf060 0x7fcb001570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.408+0000 7fcb05ff5700 1 --2- 172.21.15.82:0/3058268023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb000caaa0 0x7fcb001554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.408+0000 7fcb05ff5700 1 -- 172.21.15.82:0/3058268023 >> 172.21.15.82:0/3058268023 conn(0x7fcb000b1f50 msgr2=0x7fcb00158b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:22.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.408+0000 7fcb05ff5700 1 -- 172.21.15.82:0/3058268023 shutdown_connections 2023-11-28T13:00:22.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.408+0000 7fcb05ff5700 1 -- 172.21.15.82:0/3058268023 wait complete. 2023-11-28T13:00:22.426 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:00:22.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.532+0000 7f8e818c0700 1 Processor -- start 2023-11-28T13:00:22.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.532+0000 7f8e818c0700 1 -- start start 2023-11-28T13:00:22.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.532+0000 7f8e818c0700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8e7c0aecb0 0x7f8e7c0b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:22.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.532+0000 7f8e818c0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e7c0b1330 con 0x7f8e7c0d0590 2023-11-28T13:00:22.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.532+0000 7f8e818c0700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e7c06ccf0 con 0x7f8e7c0af080 2023-11-28T13:00:22.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.532+0000 7f8e818c0700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e7c0b15e0 con 0x7f8e7c0aecb0 2023-11-28T13:00:22.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.532+0000 7f8e7b7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8e7c0d0590 0x7f8e7c0afec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33256/0 (socket says 172.21.15.82:33256) 2023-11-28T13:00:22.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.532+0000 7f8e7b7fe700 1 -- 172.21.15.82:0/3611525289 learned_addr learned my addr 172.21.15.82:0/3611525289 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:22.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.532+0000 7f8e7affd700 1 --2- 172.21.15.82:0/3611525289 >> v2:172.21.15.114:3300/0 conn(0x7f8e7c0aecb0 0x7f8e7c0b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:22.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.536+0000 7f8e7a7fc700 1 -- 172.21.15.82:0/3611525289 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465092209 0 0) 0x7f8e7c0b1330 con 0x7f8e7c0d0590 2023-11-28T13:00:22.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.536+0000 7f8e7a7fc700 1 -- 172.21.15.82:0/3611525289 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e680035d0 con 0x7f8e7c0d0590 2023-11-28T13:00:22.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.536+0000 7f8e7affd700 1 -- 172.21.15.82:0/3611525289 >> v1:172.21.15.114:6789/0 conn(0x7f8e7c0af080 legacy=0x7f8e7c06c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:22.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.536+0000 7f8e7affd700 1 -- 172.21.15.82:0/3611525289 >> v1:172.21.15.82:6789/0 conn(0x7f8e7c0d0590 legacy=0x7f8e7c0afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:22.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.536+0000 7f8e7a7fc700 1 -- 172.21.15.82:0/3611525289 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2109737408 0 0) 0x7f8e680035d0 con 0x7f8e7c0d0590 2023-11-28T13:00:22.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.536+0000 7f8e7affd700 1 -- 172.21.15.82:0/3611525289 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7c0b18c0 con 0x7f8e7c0aecb0 2023-11-28T13:00:22.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.536+0000 7f8e7affd700 1 --2- 172.21.15.82:0/3611525289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e7c0aecb0 0x7f8e7c0b20c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c009840 tx=0x7f8e6c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cf44e0ce291a34c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:22.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.536+0000 7f8e7a7fc700 1 -- 172.21.15.82:0/3611525289 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e740019f0 con 0x7f8e7c0aecb0 2023-11-28T13:00:22.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.536+0000 7f8e7a7fc700 1 -- 172.21.15.82:0/3611525289 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c004030 con 0x7f8e7c0aecb0 2023-11-28T13:00:22.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.536+0000 7f8e7a7fc700 1 -- 172.21.15.82:0/3611525289 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c0043a0 con 0x7f8e7c0aecb0 2023-11-28T13:00:22.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.536+0000 7f8e818c0700 1 -- 172.21.15.82:0/3611525289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e7c0aecb0 msgr2=0x7f8e7c0b20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:22.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.536+0000 7f8e818c0700 1 --2- 172.21.15.82:0/3611525289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e7c0aecb0 0x7f8e7c0b20c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c009840 tx=0x7f8e6c009b50 comp rx=0 tx=0).stop 2023-11-28T13:00:22.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.536+0000 7f8e818c0700 1 -- 172.21.15.82:0/3611525289 shutdown_connections 2023-11-28T13:00:22.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.536+0000 7f8e818c0700 1 --2- 172.21.15.82:0/3611525289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e7c0aecb0 0x7f8e7c0b20c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.536+0000 7f8e818c0700 1 -- 172.21.15.82:0/3611525289 >> 172.21.15.82:0/3611525289 conn(0x7f8e7c0b2a30 msgr2=0x7f8e7c0b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:22.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.536+0000 7f8e818c0700 1 -- 172.21.15.82:0/3611525289 shutdown_connections 2023-11-28T13:00:22.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.536+0000 7f8e818c0700 1 -- 172.21.15.82:0/3611525289 wait complete. 2023-11-28T13:00:22.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e818c0700 1 Processor -- start 2023-11-28T13:00:22.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e818c0700 1 -- start start 2023-11-28T13:00:22.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e818c0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e7c0aecb0 0x7f8e7c158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:22.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e818c0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e7c0af080 0x7f8e7c06a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:22.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e818c0700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e7c0d0590 0x7f8e7c15c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:22.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e818c0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c06b170 con 0x7f8e7c0af080 2023-11-28T13:00:22.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e818c0700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c06abb0 con 0x7f8e7c0aecb0 2023-11-28T13:00:22.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e818c0700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c06ae90 con 0x7f8e7c0d0590 2023-11-28T13:00:22.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e73fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e7c0af080 0x7f8e7c06a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:22.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e7affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e7c0aecb0 0x7f8e7c158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:22.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e73fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e7c0af080 0x7f8e7c06a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39376/0 (socket says 172.21.15.82:39376) 2023-11-28T13:00:22.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e73fff700 1 -- 172.21.15.82:0/1118131037 learned_addr learned my addr 172.21.15.82:0/1118131037 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:22.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e7b7fe700 1 --2- 172.21.15.82:0/1118131037 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e7c0d0590 0x7f8e7c15c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:22.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e73fff700 1 -- 172.21.15.82:0/1118131037 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e7c0d0590 msgr2=0x7f8e7c15c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:22.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e73fff700 1 --2- 172.21.15.82:0/1118131037 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e7c0d0590 0x7f8e7c15c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e73fff700 1 -- 172.21.15.82:0/1118131037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e7c0aecb0 msgr2=0x7f8e7c158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:22.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e73fff700 1 --2- 172.21.15.82:0/1118131037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e7c0aecb0 0x7f8e7c158170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e73fff700 1 -- 172.21.15.82:0/1118131037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c009450 con 0x7f8e7c0af080 2023-11-28T13:00:22.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e73fff700 1 --2- 172.21.15.82:0/1118131037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e7c0af080 0x7f8e7c06a160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400c500 tx=0x7f8e6400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:22.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e78ff9700 1 -- 172.21.15.82:0/1118131037 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e640052d0 con 0x7f8e7c0af080 2023-11-28T13:00:22.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e78ff9700 1 -- 172.21.15.82:0/1118131037 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e64005430 con 0x7f8e7c0af080 2023-11-28T13:00:22.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e818c0700 1 -- 172.21.15.82:0/1118131037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e7c0b05d0 con 0x7f8e7c0af080 2023-11-28T13:00:22.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e78ff9700 1 -- 172.21.15.82:0/1118131037 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e640055a0 con 0x7f8e7c0af080 2023-11-28T13:00:22.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.540+0000 7f8e818c0700 1 -- 172.21.15.82:0/1118131037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e7c0b1ba0 con 0x7f8e7c0af080 2023-11-28T13:00:22.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.544+0000 7f8e818c0700 1 -- 172.21.15.82:0/1118131037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e7c0b0760 con 0x7f8e7c0af080 2023-11-28T13:00:22.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.544+0000 7f8e78ff9700 1 -- 172.21.15.82:0/1118131037 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8e64010050 con 0x7f8e7c0af080 2023-11-28T13:00:22.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.544+0000 7f8e78ff9700 1 --2- 172.21.15.82:0/1118131037 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8e5c064ee0 0x7f8e5c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:22.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.544+0000 7f8e7affd700 1 --2- 172.21.15.82:0/1118131037 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8e5c064ee0 0x7f8e5c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:22.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.544+0000 7f8e78ff9700 1 -- 172.21.15.82:0/1118131037 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8e64080cd0 con 0x7f8e7c0af080 2023-11-28T13:00:22.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.544+0000 7f8e7affd700 1 --2- 172.21.15.82:0/1118131037 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8e5c064ee0 0x7f8e5c067390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00a010 tx=0x7f8e6c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:22.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.552+0000 7f8e78ff9700 1 -- 172.21.15.82:0/1118131037 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8e64049400 con 0x7f8e7c0af080 2023-11-28T13:00:22.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.752+0000 7f8e818c0700 1 -- 172.21.15.82:0/1118131037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e7c066230 con 0x7f8e7c0af080 2023-11-28T13:00:22.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.756+0000 7f8e78ff9700 1 -- 172.21.15.82:0/1118131037 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f8e6404f070 con 0x7f8e7c0af080 2023-11-28T13:00:22.758 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:22.758 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2058451312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2058451312},{"type":"v1","addr":"172.21.15.82:6835","nonce":2058451312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/4064345694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":4064345694},{"type":"v1","addr":"172.21.15.114:6833","nonce":4064345694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2802500604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2802500604},{"type":"v1","addr":"172.21.15.114:6835","nonce":2802500604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4314,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2893797521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2893797521},{"type":"v1","addr":"172.21.15.82:6837","nonce":2893797521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-11-28T13:00:22.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.756+0000 7f8e818c0700 1 -- 172.21.15.82:0/1118131037 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8e5c064ee0 msgr2=0x7f8e5c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:22.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.756+0000 7f8e818c0700 1 --2- 172.21.15.82:0/1118131037 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8e5c064ee0 0x7f8e5c067390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00a010 tx=0x7f8e6c008030 comp rx=0 tx=0).stop 2023-11-28T13:00:22.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.756+0000 7f8e818c0700 1 -- 172.21.15.82:0/1118131037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e7c0af080 msgr2=0x7f8e7c06a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:22.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.756+0000 7f8e818c0700 1 --2- 172.21.15.82:0/1118131037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e7c0af080 0x7f8e7c06a160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400c500 tx=0x7f8e6400c810 comp rx=0 tx=0).stop 2023-11-28T13:00:22.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.756+0000 7f8e818c0700 1 -- 172.21.15.82:0/1118131037 shutdown_connections 2023-11-28T13:00:22.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.756+0000 7f8e818c0700 1 --2- 172.21.15.82:0/1118131037 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8e5c064ee0 0x7f8e5c067390 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.756+0000 7f8e818c0700 1 --2- 172.21.15.82:0/1118131037 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e7c0d0590 0x7f8e7c15c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.756+0000 7f8e818c0700 1 --2- 172.21.15.82:0/1118131037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e7c0af080 0x7f8e7c06a160 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.756+0000 7f8e818c0700 1 --2- 172.21.15.82:0/1118131037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e7c0aecb0 0x7f8e7c158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.756+0000 7f8e818c0700 1 -- 172.21.15.82:0/1118131037 >> 172.21.15.82:0/1118131037 conn(0x7f8e7c0b2a30 msgr2=0x7f8e7c06de30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:22.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.756+0000 7f8e818c0700 1 -- 172.21.15.82:0/1118131037 shutdown_connections 2023-11-28T13:00:22.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.756+0000 7f8e818c0700 1 -- 172.21.15.82:0/1118131037 wait complete. 2023-11-28T13:00:22.762 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 3 2023-11-28T13:00:22.777 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:00:22.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.884+0000 7f992e3d8700 1 Processor -- start 2023-11-28T13:00:22.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.884+0000 7f992e3d8700 1 -- start start 2023-11-28T13:00:22.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.884+0000 7f992e3d8700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f99280b3910 0x7f992806b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:22.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.884+0000 7f992e3d8700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f992806c480 con 0x7f992806c910 2023-11-28T13:00:22.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.884+0000 7f992e3d8700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f992806dbe0 con 0x7f9928070070 2023-11-28T13:00:22.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.884+0000 7f992e3d8700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992806dec0 con 0x7f99280b3910 2023-11-28T13:00:22.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.884+0000 7f992cbd5700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f992806c910 0x7f992806d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33262/0 (socket says 172.21.15.82:33262) 2023-11-28T13:00:22.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.884+0000 7f992cbd5700 1 -- 172.21.15.82:0/4239334564 learned_addr learned my addr 172.21.15.82:0/4239334564 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:22.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.884+0000 7f992d3d6700 1 --2- 172.21.15.82:0/4239334564 >> v2:172.21.15.82:3300/0 conn(0x7f99280b3910 0x7f992806b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:22.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.884+0000 7f991ffff700 1 -- 172.21.15.82:0/4239334564 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424255237 0 0) 0x7f992806c480 con 0x7f992806c910 2023-11-28T13:00:22.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.884+0000 7f991ffff700 1 -- 172.21.15.82:0/4239334564 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99140035d0 con 0x7f992806c910 2023-11-28T13:00:22.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.884+0000 7f992d3d6700 1 -- 172.21.15.82:0/4239334564 >> v1:172.21.15.114:6789/0 conn(0x7f9928070070 legacy=0x7f9928070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:22.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.884+0000 7f991ffff700 1 -- 172.21.15.82:0/4239334564 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308993807 0 0) 0x7f992806dbe0 con 0x7f9928070070 2023-11-28T13:00:22.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.884+0000 7f992d3d6700 1 -- 172.21.15.82:0/4239334564 >> v1:172.21.15.82:6789/0 conn(0x7f992806c910 legacy=0x7f992806d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:22.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.884+0000 7f992d3d6700 1 -- 172.21.15.82:0/4239334564 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992806c110 con 0x7f99280b3910 2023-11-28T13:00:22.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.884+0000 7f992d3d6700 1 --2- 172.21.15.82:0/4239334564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99280b3910 0x7f992806b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9918009850 tx=0x7f9918009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74774fe2b892852 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:22.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.884+0000 7f991ffff700 1 -- 172.21.15.82:0/4239334564 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9918011830 con 0x7f99280b3910 2023-11-28T13:00:22.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.884+0000 7f991ffff700 1 -- 172.21.15.82:0/4239334564 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9918011990 con 0x7f99280b3910 2023-11-28T13:00:22.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.884+0000 7f991ffff700 1 -- 172.21.15.82:0/4239334564 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9918011d00 con 0x7f99280b3910 2023-11-28T13:00:22.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.888+0000 7f992e3d8700 1 -- 172.21.15.82:0/4239334564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99280b3910 msgr2=0x7f992806b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:22.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.888+0000 7f992e3d8700 1 --2- 172.21.15.82:0/4239334564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99280b3910 0x7f992806b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9918009850 tx=0x7f9918009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:22.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.888+0000 7f992e3d8700 1 -- 172.21.15.82:0/4239334564 shutdown_connections 2023-11-28T13:00:22.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.888+0000 7f992e3d8700 1 --2- 172.21.15.82:0/4239334564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99280b3910 0x7f992806b0a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.888+0000 7f992e3d8700 1 -- 172.21.15.82:0/4239334564 >> 172.21.15.82:0/4239334564 conn(0x7f99280ce600 msgr2=0x7f99280ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:22.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.888+0000 7f992e3d8700 1 -- 172.21.15.82:0/4239334564 shutdown_connections 2023-11-28T13:00:22.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.888+0000 7f992e3d8700 1 -- 172.21.15.82:0/4239334564 wait complete. 2023-11-28T13:00:22.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992e3d8700 1 Processor -- start 2023-11-28T13:00:22.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992e3d8700 1 -- start start 2023-11-28T13:00:22.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992e3d8700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f992806c910 0x7f992815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:22.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992e3d8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9928070070 0x7f99280accc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:22.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992e3d8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99280b3910 0x7f992815b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:22.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992e3d8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992815a920 con 0x7f99280b3910 2023-11-28T13:00:22.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992e3d8700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99280ad200 con 0x7f9928070070 2023-11-28T13:00:22.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992e3d8700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99280abc20 con 0x7f992806c910 2023-11-28T13:00:22.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992dbd7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99280b3910 0x7f992815b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:22.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992cbd5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9928070070 0x7f99280accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:22.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992dbd7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99280b3910 0x7f992815b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39394/0 (socket says 172.21.15.82:39394) 2023-11-28T13:00:22.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992d3d6700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f992806c910 0x7f992815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:22.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992dbd7700 1 -- 172.21.15.82:0/411949516 learned_addr learned my addr 172.21.15.82:0/411949516 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:22.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992cbd5700 1 -- 172.21.15.82:0/411949516 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f992806c910 msgr2=0x7f992815a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:22.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992cbd5700 1 --2- 172.21.15.82:0/411949516 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f992806c910 0x7f992815a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992cbd5700 1 -- 172.21.15.82:0/411949516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99280b3910 msgr2=0x7f992815b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:22.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992cbd5700 1 --2- 172.21.15.82:0/411949516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99280b3910 0x7f992815b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:22.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992cbd5700 1 -- 172.21.15.82:0/411949516 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99180094b0 con 0x7f9928070070 2023-11-28T13:00:22.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992cbd5700 1 --2- 172.21.15.82:0/411949516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9928070070 0x7f99280accc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f992400cae0 tx=0x7f992400cb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:22.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992d3d6700 1 --2- 172.21.15.82:0/411949516 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f992806c910 0x7f992815a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:22.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f991dffb700 1 -- 172.21.15.82:0/411949516 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9924007480 con 0x7f9928070070 2023-11-28T13:00:22.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992e3d8700 1 -- 172.21.15.82:0/411949516 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99280b3ce0 con 0x7f9928070070 2023-11-28T13:00:22.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f991dffb700 1 -- 172.21.15.82:0/411949516 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99240075e0 con 0x7f9928070070 2023-11-28T13:00:22.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f991dffb700 1 -- 172.21.15.82:0/411949516 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9924007950 con 0x7f9928070070 2023-11-28T13:00:22.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.892+0000 7f992e3d8700 1 -- 172.21.15.82:0/411949516 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99280c8f80 con 0x7f9928070070 2023-11-28T13:00:22.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.896+0000 7f992e3d8700 1 -- 172.21.15.82:0/411949516 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99280b3e70 con 0x7f9928070070 2023-11-28T13:00:22.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.896+0000 7f991dffb700 1 -- 172.21.15.82:0/411949516 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9924019030 con 0x7f9928070070 2023-11-28T13:00:22.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.896+0000 7f991dffb700 1 --2- 172.21.15.82:0/411949516 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f990c064ee0 0x7f990c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:22.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.896+0000 7f991dffb700 1 -- 172.21.15.82:0/411949516 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f99240813a0 con 0x7f9928070070 2023-11-28T13:00:22.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.896+0000 7f992d3d6700 1 --2- 172.21.15.82:0/411949516 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f990c064ee0 0x7f990c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:22.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.900+0000 7f992d3d6700 1 --2- 172.21.15.82:0/411949516 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f990c064ee0 0x7f990c067390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f99180090b0 tx=0x7f9918008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:22.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:22.904+0000 7f991dffb700 1 -- 172.21.15.82:0/411949516 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f992404f940 con 0x7f9928070070 2023-11-28T13:00:23.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.068+0000 7f992e3d8700 1 -- 172.21.15.82:0/411949516 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9928065fc0 con 0x7f9928070070 2023-11-28T13:00:23.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.072+0000 7f991dffb700 1 -- 172.21.15.82:0/411949516 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14168 (secure 0 0 0) 0x7f9924052f60 con 0x7f9928070070 2023-11-28T13:00:23.076 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:23.076 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":20,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:00:22.449027+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:00:23.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.076+0000 7f992e3d8700 1 -- 172.21.15.82:0/411949516 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f990c064ee0 msgr2=0x7f990c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:23.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.076+0000 7f992e3d8700 1 --2- 172.21.15.82:0/411949516 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f990c064ee0 0x7f990c067390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f99180090b0 tx=0x7f9918008030 comp rx=0 tx=0).stop 2023-11-28T13:00:23.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.076+0000 7f992e3d8700 1 -- 172.21.15.82:0/411949516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9928070070 msgr2=0x7f99280accc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:23.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.076+0000 7f992e3d8700 1 --2- 172.21.15.82:0/411949516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9928070070 0x7f99280accc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f992400cae0 tx=0x7f992400cb10 comp rx=0 tx=0).stop 2023-11-28T13:00:23.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.076+0000 7f992e3d8700 1 -- 172.21.15.82:0/411949516 shutdown_connections 2023-11-28T13:00:23.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.076+0000 7f992e3d8700 1 --2- 172.21.15.82:0/411949516 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f990c064ee0 0x7f990c067390 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.076+0000 7f992e3d8700 1 --2- 172.21.15.82:0/411949516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99280b3910 0x7f992815b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.076+0000 7f992e3d8700 1 --2- 172.21.15.82:0/411949516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9928070070 0x7f99280accc0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.076+0000 7f992e3d8700 1 --2- 172.21.15.82:0/411949516 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f992806c910 0x7f992815a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.076+0000 7f992e3d8700 1 -- 172.21.15.82:0/411949516 >> 172.21.15.82:0/411949516 conn(0x7f99280ce600 msgr2=0x7f99280ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:23.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.076+0000 7f992e3d8700 1 -- 172.21.15.82:0/411949516 shutdown_connections 2023-11-28T13:00:23.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.076+0000 7f992e3d8700 1 -- 172.21.15.82:0/411949516 wait complete. 2023-11-28T13:00:23.091 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:00:23.091 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:00:23.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.208+0000 7f97162e3700 1 Processor -- start 2023-11-28T13:00:23.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.208+0000 7f97162e3700 1 -- start start 2023-11-28T13:00:23.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.208+0000 7f97162e3700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f971006a450 0x7f971006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:23.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.208+0000 7f97162e3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9710158af0 con 0x7f9710158720 2023-11-28T13:00:23.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.208+0000 7f97162e3700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97100af490 con 0x7f9710071130 2023-11-28T13:00:23.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.208+0000 7f97162e3700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971006ae10 con 0x7f971006a450 2023-11-28T13:00:23.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.208+0000 7f97152e1700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9710158720 0x7f97100b0250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33278/0 (socket says 172.21.15.82:33278) 2023-11-28T13:00:23.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.208+0000 7f97152e1700 1 -- 172.21.15.82:0/3844257545 learned_addr learned my addr 172.21.15.82:0/3844257545 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:23.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.208+0000 7f9714ae0700 1 --2- 172.21.15.82:0/3844257545 >> v2:172.21.15.114:3300/0 conn(0x7f971006a450 0x7f971006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:23.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.208+0000 7f9707fff700 1 -- 172.21.15.82:0/3844257545 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3480824895 0 0) 0x7f9710158af0 con 0x7f9710158720 2023-11-28T13:00:23.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.208+0000 7f9707fff700 1 -- 172.21.15.82:0/3844257545 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96fc0035d0 con 0x7f9710158720 2023-11-28T13:00:23.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.208+0000 7f9707fff700 1 -- 172.21.15.82:0/3844257545 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3099626339 0 0) 0x7f96fc0035d0 con 0x7f9710158720 2023-11-28T13:00:23.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.208+0000 7f9707fff700 1 -- 172.21.15.82:0/3844257545 >> v2:172.21.15.114:3300/0 conn(0x7f971006a450 msgr2=0x7f971006a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:23.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.208+0000 7f9707fff700 1 --2- 172.21.15.82:0/3844257545 >> v2:172.21.15.114:3300/0 conn(0x7f971006a450 0x7f971006a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.208+0000 7f9707fff700 1 -- 172.21.15.82:0/3844257545 >> v1:172.21.15.114:6789/0 conn(0x7f9710071130 legacy=0x7f9710071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:23.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.208+0000 7f9707fff700 1 -- 172.21.15.82:0/3844257545 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97100af770 con 0x7f9710158720 2023-11-28T13:00:23.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.208+0000 7f9707fff700 1 -- 172.21.15.82:0/3844257545 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f9700001670 con 0x7f9710158720 2023-11-28T13:00:23.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.208+0000 7f9707fff700 1 -- 172.21.15.82:0/3844257545 >> v1:172.21.15.82:6789/0 conn(0x7f9710158720 legacy=0x7f97100b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:23.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.208+0000 7f9707fff700 1 --2- 172.21.15.82:0/3844257545 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f96fc003a20 0x7f96fc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:23.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f9707fff700 1 --2- 172.21.15.82:0/3844257545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96fc004870 0x7f96fc004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:23.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f9707fff700 1 --2- 172.21.15.82:0/3844257545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96fc005220 0x7f96fc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:23.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f9707fff700 1 -- 172.21.15.82:0/3844257545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971006ae10 con 0x7f96fc004870 2023-11-28T13:00:23.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f9707fff700 1 -- 172.21.15.82:0/3844257545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc00c0a0 con 0x7f96fc005220 2023-11-28T13:00:23.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f9707fff700 1 -- 172.21.15.82:0/3844257545 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc00c260 con 0x7f96fc003a20 2023-11-28T13:00:23.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f9714ae0700 1 --2- 172.21.15.82:0/3844257545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96fc004870 0x7f96fc004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:23.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f97152e1700 1 --2- 172.21.15.82:0/3844257545 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f96fc003a20 0x7f96fc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:23.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f9715ae2700 1 --2- 172.21.15.82:0/3844257545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96fc005220 0x7f96fc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:23.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f9714ae0700 1 -- 172.21.15.82:0/3844257545 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f96fc003a20 msgr2=0x7f96fc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:23.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f9714ae0700 1 --2- 172.21.15.82:0/3844257545 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f96fc003a20 0x7f96fc003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f9714ae0700 1 -- 172.21.15.82:0/3844257545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96fc005220 msgr2=0x7f96fc00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:23.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f9714ae0700 1 --2- 172.21.15.82:0/3844257545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96fc005220 0x7f96fc00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f9714ae0700 1 -- 172.21.15.82:0/3844257545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96fc0035d0 con 0x7f96fc004870 2023-11-28T13:00:23.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f9715ae2700 1 --2- 172.21.15.82:0/3844257545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96fc005220 0x7f96fc00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:00:23.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f9715ae2700 1 -- 172.21.15.82:0/3844257545 reap_dead start 2023-11-28T13:00:23.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f9714ae0700 1 --2- 172.21.15.82:0/3844257545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96fc004870 0x7f96fc004ce0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f970c00ab70 tx=0x7f96fc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94045c6904c1dcd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:23.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f9707fff700 1 -- 172.21.15.82:0/3844257545 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970c00f9d0 con 0x7f96fc004870 2023-11-28T13:00:23.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f9707fff700 1 -- 172.21.15.82:0/3844257545 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970c00fb30 con 0x7f96fc004870 2023-11-28T13:00:23.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f9707fff700 1 -- 172.21.15.82:0/3844257545 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970c00fec0 con 0x7f96fc004870 2023-11-28T13:00:23.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f97162e3700 1 -- 172.21.15.82:0/3844257545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96fc004870 msgr2=0x7f96fc004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:23.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f97162e3700 1 --2- 172.21.15.82:0/3844257545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96fc004870 0x7f96fc004ce0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f970c00ab70 tx=0x7f96fc0058a0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f97162e3700 1 -- 172.21.15.82:0/3844257545 shutdown_connections 2023-11-28T13:00:23.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f97162e3700 1 --2- 172.21.15.82:0/3844257545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96fc004870 0x7f96fc004ce0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f97162e3700 1 -- 172.21.15.82:0/3844257545 >> 172.21.15.82:0/3844257545 conn(0x7f97100ce630 msgr2=0x7f97100cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:23.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f97162e3700 1 -- 172.21.15.82:0/3844257545 shutdown_connections 2023-11-28T13:00:23.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f97162e3700 1 -- 172.21.15.82:0/3844257545 wait complete. 2023-11-28T13:00:23.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f97162e3700 1 Processor -- start 2023-11-28T13:00:23.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.212+0000 7f97162e3700 1 -- start start 2023-11-28T13:00:23.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f97162e3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96fc004870 0x7f9710136a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:23.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f97162e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97100b1620 0x7f97100cd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:23.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f97162e3700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97100cd9c0 0x7f9710135e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:23.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f97162e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97100b1e00 con 0x7f97100b1620 2023-11-28T13:00:23.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f97162e3700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971015a230 con 0x7f96fc004870 2023-11-28T13:00:23.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f97162e3700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971015a650 con 0x7f97100cd9c0 2023-11-28T13:00:23.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f9714ae0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97100b1620 0x7f97100cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:23.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f9714ae0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97100b1620 0x7f97100cd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39410/0 (socket says 172.21.15.82:39410) 2023-11-28T13:00:23.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f9714ae0700 1 -- 172.21.15.82:0/3486646889 learned_addr learned my addr 172.21.15.82:0/3486646889 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:23.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f97152e1700 1 --2- 172.21.15.82:0/3486646889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96fc004870 0x7f9710136a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:23.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f9715ae2700 1 --2- 172.21.15.82:0/3486646889 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97100cd9c0 0x7f9710135e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:23.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f9714ae0700 1 -- 172.21.15.82:0/3486646889 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97100cd9c0 msgr2=0x7f9710135e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:23.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f9714ae0700 1 --2- 172.21.15.82:0/3486646889 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97100cd9c0 0x7f9710135e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f9714ae0700 1 -- 172.21.15.82:0/3486646889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96fc004870 msgr2=0x7f9710136a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:23.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f9714ae0700 1 --2- 172.21.15.82:0/3486646889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96fc004870 0x7f9710136a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f9714ae0700 1 -- 172.21.15.82:0/3486646889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97100afd30 con 0x7f97100b1620 2023-11-28T13:00:23.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f9714ae0700 1 --2- 172.21.15.82:0/3486646889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97100b1620 0x7f97100cd480 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f96fc00c070 tx=0x7f970c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:23.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f9705ffb700 1 -- 172.21.15.82:0/3486646889 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970c01f070 con 0x7f97100b1620 2023-11-28T13:00:23.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f9705ffb700 1 -- 172.21.15.82:0/3486646889 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970c00fca0 con 0x7f97100b1620 2023-11-28T13:00:23.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f97162e3700 1 -- 172.21.15.82:0/3486646889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97100afa50 con 0x7f97100b1620 2023-11-28T13:00:23.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f9705ffb700 1 -- 172.21.15.82:0/3486646889 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970c01ac20 con 0x7f97100b1620 2023-11-28T13:00:23.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.216+0000 7f97162e3700 1 -- 172.21.15.82:0/3486646889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97100af0f0 con 0x7f97100b1620 2023-11-28T13:00:23.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.220+0000 7f97162e3700 1 -- 172.21.15.82:0/3486646889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9710065fc0 con 0x7f97100b1620 2023-11-28T13:00:23.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.220+0000 7f9705ffb700 1 -- 172.21.15.82:0/3486646889 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f970c00e040 con 0x7f97100b1620 2023-11-28T13:00:23.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.220+0000 7f9705ffb700 1 --2- 172.21.15.82:0/3486646889 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f96f4064ee0 0x7f96f4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:23.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.220+0000 7f9705ffb700 1 -- 172.21.15.82:0/3486646889 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f970c082840 con 0x7f97100b1620 2023-11-28T13:00:23.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.220+0000 7f97152e1700 1 --2- 172.21.15.82:0/3486646889 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f96f4064ee0 0x7f96f4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:23.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.220+0000 7f97152e1700 1 --2- 172.21.15.82:0/3486646889 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f96f4064ee0 0x7f96f4067390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9700000c00 tx=0x7f9700007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:23.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.228+0000 7f9705ffb700 1 -- 172.21.15.82:0/3486646889 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f970c050cb0 con 0x7f97100b1620 2023-11-28T13:00:23.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.388+0000 7f97162e3700 1 -- 172.21.15.82:0/3486646889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f971006b4f0 con 0x7f97100b1620 2023-11-28T13:00:23.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.392+0000 7f9705ffb700 1 -- 172.21.15.82:0/3486646889 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f970c0542d0 con 0x7f97100b1620 2023-11-28T13:00:23.394 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:00:23.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.392+0000 7f97162e3700 1 -- 172.21.15.82:0/3486646889 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f96f4064ee0 msgr2=0x7f96f4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.392+0000 7f97162e3700 1 --2- 172.21.15.82:0/3486646889 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f96f4064ee0 0x7f96f4067390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9700000c00 tx=0x7f9700007040 comp rx=0 tx=0).stop 2023-11-28T13:00:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.392+0000 7f97162e3700 1 -- 172.21.15.82:0/3486646889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97100b1620 msgr2=0x7f97100cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.392+0000 7f97162e3700 1 --2- 172.21.15.82:0/3486646889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97100b1620 0x7f97100cd480 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f96fc00c070 tx=0x7f970c0047e0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.392+0000 7f97162e3700 1 -- 172.21.15.82:0/3486646889 shutdown_connections 2023-11-28T13:00:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.392+0000 7f97162e3700 1 --2- 172.21.15.82:0/3486646889 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f96f4064ee0 0x7f96f4067390 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.392+0000 7f97162e3700 1 --2- 172.21.15.82:0/3486646889 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97100cd9c0 0x7f9710135e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.392+0000 7f97162e3700 1 --2- 172.21.15.82:0/3486646889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97100b1620 0x7f97100cd480 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.392+0000 7f97162e3700 1 --2- 172.21.15.82:0/3486646889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96fc004870 0x7f9710136a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.392+0000 7f97162e3700 1 -- 172.21.15.82:0/3486646889 >> 172.21.15.82:0/3486646889 conn(0x7f97100ce630 msgr2=0x7f971014db50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.392+0000 7f97162e3700 1 -- 172.21.15.82:0/3486646889 shutdown_connections 2023-11-28T13:00:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.392+0000 7f97162e3700 1 -- 172.21.15.82:0/3486646889 wait complete. 2023-11-28T13:00:23.408 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:00:23.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.524+0000 7f3bf690c700 1 Processor -- start 2023-11-28T13:00:23.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.524+0000 7f3bf690c700 1 -- start start 2023-11-28T13:00:23.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.524+0000 7f3bf690c700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3bf00ae090 0x7f3bf00c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:23.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.524+0000 7f3bf690c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3bf00b0c70 0x7f3bf015c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:23.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.524+0000 7f3bf690c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf00ad9b0 con 0x7f3bf0158eb0 2023-11-28T13:00:23.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.524+0000 7f3bf690c700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf00adee0 con 0x7f3bf00ae090 2023-11-28T13:00:23.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.524+0000 7f3bf690c700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf0159280 con 0x7f3bf00b0c70 2023-11-28T13:00:23.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.524+0000 7f3bf590a700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3bf0158eb0 0x7f3bf00b0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33282/0 (socket says 172.21.15.82:33282) 2023-11-28T13:00:23.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf590a700 1 -- 172.21.15.82:0/2895609093 learned_addr learned my addr 172.21.15.82:0/2895609093 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:23.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf5109700 1 --2- 172.21.15.82:0/2895609093 >> v2:172.21.15.114:3300/0 conn(0x7f3bf00ae090 0x7f3bf00c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:23.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf610b700 1 --2- 172.21.15.82:0/2895609093 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3bf00b0c70 0x7f3bf015c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:23.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf4908700 1 -- 172.21.15.82:0/2895609093 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730351427 0 0) 0x7f3bf00ad9b0 con 0x7f3bf0158eb0 2023-11-28T13:00:23.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf4908700 1 -- 172.21.15.82:0/2895609093 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bd80035d0 con 0x7f3bf0158eb0 2023-11-28T13:00:23.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf5109700 1 -- 172.21.15.82:0/2895609093 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3bf00b0c70 msgr2=0x7f3bf015c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:23.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf5109700 1 --2- 172.21.15.82:0/2895609093 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3bf00b0c70 0x7f3bf015c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf5109700 1 -- 172.21.15.82:0/2895609093 >> v1:172.21.15.82:6789/0 conn(0x7f3bf0158eb0 legacy=0x7f3bf00b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:23.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf5109700 1 -- 172.21.15.82:0/2895609093 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf0069e60 con 0x7f3bf00ae090 2023-11-28T13:00:23.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf610b700 1 --2- 172.21.15.82:0/2895609093 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3bf00b0c70 0x7f3bf015c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:23.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf5109700 1 --2- 172.21.15.82:0/2895609093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bf00ae090 0x7f3bf00c8c80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3bec009850 tx=0x7f3bec009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=baf7351f8ba74693 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:23.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf4908700 1 -- 172.21.15.82:0/2895609093 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec011830 con 0x7f3bf00ae090 2023-11-28T13:00:23.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf4908700 1 -- 172.21.15.82:0/2895609093 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec011990 con 0x7f3bf00ae090 2023-11-28T13:00:23.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf4908700 1 -- 172.21.15.82:0/2895609093 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec011d40 con 0x7f3bf00ae090 2023-11-28T13:00:23.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf690c700 1 -- 172.21.15.82:0/2895609093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bf00ae090 msgr2=0x7f3bf00c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:23.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf690c700 1 --2- 172.21.15.82:0/2895609093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bf00ae090 0x7f3bf00c8c80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3bec009850 tx=0x7f3bec009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:23.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf690c700 1 -- 172.21.15.82:0/2895609093 shutdown_connections 2023-11-28T13:00:23.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf690c700 1 --2- 172.21.15.82:0/2895609093 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3bf00b0c70 0x7f3bf015c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf690c700 1 --2- 172.21.15.82:0/2895609093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bf00ae090 0x7f3bf00c8c80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf690c700 1 -- 172.21.15.82:0/2895609093 >> 172.21.15.82:0/2895609093 conn(0x7f3bf00ce630 msgr2=0x7f3bf00cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:23.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf690c700 1 -- 172.21.15.82:0/2895609093 shutdown_connections 2023-11-28T13:00:23.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf690c700 1 -- 172.21.15.82:0/2895609093 wait complete. 2023-11-28T13:00:23.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf690c700 1 Processor -- start 2023-11-28T13:00:23.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf690c700 1 -- start start 2023-11-28T13:00:23.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf690c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bf00ae090 0x7f3bf0144e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:23.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.528+0000 7f3bf690c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bf00b0c70 0x7f3bf01453d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:23.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3bf690c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3bf0158eb0 0x7f3bf00b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:23.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3bf690c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf0146260 con 0x7f3bf00b0c70 2023-11-28T13:00:23.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3bf690c700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf01459c0 con 0x7f3bf00ae090 2023-11-28T13:00:23.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3bf690c700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf0145ca0 con 0x7f3bf0158eb0 2023-11-28T13:00:23.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3bf5109700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bf00b0c70 0x7f3bf01453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:23.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3bf5109700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bf00b0c70 0x7f3bf01453d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39424/0 (socket says 172.21.15.82:39424) 2023-11-28T13:00:23.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3bf5109700 1 -- 172.21.15.82:0/2386025518 learned_addr learned my addr 172.21.15.82:0/2386025518 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:23.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3bf590a700 1 --2- 172.21.15.82:0/2386025518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bf00ae090 0x7f3bf0144e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:23.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3bf610b700 1 --2- 172.21.15.82:0/2386025518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3bf0158eb0 0x7f3bf00b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:23.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3bf5109700 1 -- 172.21.15.82:0/2386025518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3bf0158eb0 msgr2=0x7f3bf00b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:23.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3bf5109700 1 --2- 172.21.15.82:0/2386025518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3bf0158eb0 0x7f3bf00b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3bf5109700 1 -- 172.21.15.82:0/2386025518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bf00ae090 msgr2=0x7f3bf0144e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:23.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3bf5109700 1 --2- 172.21.15.82:0/2386025518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bf00ae090 0x7f3bf0144e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3bf5109700 1 -- 172.21.15.82:0/2386025518 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be8009a70 con 0x7f3bf00b0c70 2023-11-28T13:00:23.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3bf590a700 1 --2- 172.21.15.82:0/2386025518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bf00ae090 0x7f3bf0144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:23.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3bf5109700 1 --2- 172.21.15.82:0/2386025518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bf00b0c70 0x7f3bf01453d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3bec014040 tx=0x7f3bec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:23.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3be67fc700 1 -- 172.21.15.82:0/2386025518 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec0036c0 con 0x7f3bf00b0c70 2023-11-28T13:00:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3bf690c700 1 -- 172.21.15.82:0/2386025518 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bec0094b0 con 0x7f3bf00b0c70 2023-11-28T13:00:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3be67fc700 1 -- 172.21.15.82:0/2386025518 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec01e070 con 0x7f3bf00b0c70 2023-11-28T13:00:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3be67fc700 1 -- 172.21.15.82:0/2386025518 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec003a80 con 0x7f3bf00b0c70 2023-11-28T13:00:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3bf690c700 1 -- 172.21.15.82:0/2386025518 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf0071c90 con 0x7f3bf00b0c70 2023-11-28T13:00:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3bf690c700 1 -- 172.21.15.82:0/2386025518 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf00adc00 con 0x7f3bf00b0c70 2023-11-28T13:00:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3be67fc700 1 -- 172.21.15.82:0/2386025518 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3bec00f050 con 0x7f3bf00b0c70 2023-11-28T13:00:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3be67fc700 1 --2- 172.21.15.82:0/2386025518 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3bdc064ee0 0x7f3bdc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3be67fc700 1 -- 172.21.15.82:0/2386025518 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3bec020070 con 0x7f3bf00b0c70 2023-11-28T13:00:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.532+0000 7f3bf590a700 1 --2- 172.21.15.82:0/2386025518 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3bdc064ee0 0x7f3bdc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.536+0000 7f3bf590a700 1 --2- 172.21.15.82:0/2386025518 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3bdc064ee0 0x7f3bdc067390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3be00011e0 tx=0x7f3be0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:23.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.540+0000 7f3be67fc700 1 -- 172.21.15.82:0/2386025518 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3bec0514d0 con 0x7f3bf00b0c70 2023-11-28T13:00:23.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.700+0000 7f3bf690c700 1 -- 172.21.15.82:0/2386025518 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3bf0071f70 con 0x7f3bf00b0c70 2023-11-28T13:00:23.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.700+0000 7f3be67fc700 1 -- 172.21.15.82:0/2386025518 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3bec02a0a0 con 0x7f3bf00b0c70 2023-11-28T13:00:23.703 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:00:23.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.700+0000 7f3bf690c700 1 -- 172.21.15.82:0/2386025518 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3bdc064ee0 msgr2=0x7f3bdc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:23.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.700+0000 7f3bf690c700 1 --2- 172.21.15.82:0/2386025518 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3bdc064ee0 0x7f3bdc067390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3be00011e0 tx=0x7f3be0009040 comp rx=0 tx=0).stop 2023-11-28T13:00:23.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.700+0000 7f3bf690c700 1 -- 172.21.15.82:0/2386025518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bf00b0c70 msgr2=0x7f3bf01453d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:23.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.700+0000 7f3bf690c700 1 --2- 172.21.15.82:0/2386025518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bf00b0c70 0x7f3bf01453d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3bec014040 tx=0x7f3bec004770 comp rx=0 tx=0).stop 2023-11-28T13:00:23.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.700+0000 7f3bf690c700 1 -- 172.21.15.82:0/2386025518 shutdown_connections 2023-11-28T13:00:23.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.700+0000 7f3bf690c700 1 --2- 172.21.15.82:0/2386025518 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3bdc064ee0 0x7f3bdc067390 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.700+0000 7f3bf690c700 1 --2- 172.21.15.82:0/2386025518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3bf0158eb0 0x7f3bf00b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.700+0000 7f3bf690c700 1 --2- 172.21.15.82:0/2386025518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bf00b0c70 0x7f3bf01453d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.700+0000 7f3bf690c700 1 --2- 172.21.15.82:0/2386025518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bf00ae090 0x7f3bf0144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.700+0000 7f3bf690c700 1 -- 172.21.15.82:0/2386025518 >> 172.21.15.82:0/2386025518 conn(0x7f3bf00ce630 msgr2=0x7f3bf0157ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:23.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.700+0000 7f3bf690c700 1 -- 172.21.15.82:0/2386025518 shutdown_connections 2023-11-28T13:00:23.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.700+0000 7f3bf690c700 1 -- 172.21.15.82:0/2386025518 wait complete. 2023-11-28T13:00:23.718 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T13:00:23.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.820+0000 7fe1152ed700 1 Processor -- start 2023-11-28T13:00:23.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.820+0000 7fe1152ed700 1 -- start start 2023-11-28T13:00:23.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe1152ed700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe1101586f0 0x7fe11015c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:23.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe1152ed700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe110070900 0x7fe110070d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:23.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe1152ed700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11006c3b0 con 0x7fe1100c8c50 2023-11-28T13:00:23.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe1152ed700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe110071280 con 0x7fe110070900 2023-11-28T13:00:23.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe1152ed700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11015c8b0 con 0x7fe1101586f0 2023-11-28T13:00:23.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe114aec700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe110070900 0x7fe110070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:23.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe10f7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe1100c8c50 0x7fe11006d880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33288/0 (socket says 172.21.15.82:33288) 2023-11-28T13:00:23.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe10f7fe700 1 -- 172.21.15.82:0/2476122016 learned_addr learned my addr 172.21.15.82:0/2476122016 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:23.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe10ffff700 1 --2- 172.21.15.82:0/2476122016 >> v2:172.21.15.114:3300/0 conn(0x7fe1101586f0 0x7fe11015c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe114aec700 1 -- 172.21.15.82:0/2476122016 >> v2:172.21.15.114:3300/0 conn(0x7fe1101586f0 msgr2=0x7fe11015c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe114aec700 1 --2- 172.21.15.82:0/2476122016 >> v2:172.21.15.114:3300/0 conn(0x7fe1101586f0 0x7fe11015c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe114aec700 1 -- 172.21.15.82:0/2476122016 >> v1:172.21.15.82:6789/0 conn(0x7fe1100c8c50 legacy=0x7fe11006d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe114aec700 1 -- 172.21.15.82:0/2476122016 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11015cb90 con 0x7fe110070900 2023-11-28T13:00:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe10effd700 1 -- 172.21.15.82:0/2476122016 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550672682 0 0) 0x7fe11006c3b0 con 0x7fe1100c8c50 2023-11-28T13:00:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe114aec700 1 --2- 172.21.15.82:0/2476122016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe110070900 0x7fe110070d40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe1100c5680 tx=0x7fe108009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d5162d6bf1c0de1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe10effd700 1 -- 172.21.15.82:0/2476122016 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe108011830 con 0x7fe110070900 2023-11-28T13:00:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe10effd700 1 -- 172.21.15.82:0/2476122016 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe108011990 con 0x7fe110070900 2023-11-28T13:00:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe10effd700 1 -- 172.21.15.82:0/2476122016 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe108011d20 con 0x7fe110070900 2023-11-28T13:00:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe1152ed700 1 -- 172.21.15.82:0/2476122016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe110070900 msgr2=0x7fe110070d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe1152ed700 1 --2- 172.21.15.82:0/2476122016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe110070900 0x7fe110070d40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe1100c5680 tx=0x7fe108009b30 comp rx=0 tx=0).stop 2023-11-28T13:00:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe1152ed700 1 -- 172.21.15.82:0/2476122016 shutdown_connections 2023-11-28T13:00:23.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe1152ed700 1 --2- 172.21.15.82:0/2476122016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe110070900 0x7fe110070d40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe1152ed700 1 --2- 172.21.15.82:0/2476122016 >> v2:172.21.15.114:3300/0 conn(0x7fe1101586f0 0x7fe11015c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe1152ed700 1 -- 172.21.15.82:0/2476122016 >> 172.21.15.82:0/2476122016 conn(0x7fe1100ce600 msgr2=0x7fe1100ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:23.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe1152ed700 1 -- 172.21.15.82:0/2476122016 shutdown_connections 2023-11-28T13:00:23.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe1152ed700 1 -- 172.21.15.82:0/2476122016 wait complete. 2023-11-28T13:00:23.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe1152ed700 1 Processor -- start 2023-11-28T13:00:23.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.824+0000 7fe1152ed700 1 -- start start 2023-11-28T13:00:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe1152ed700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe110070900 0x7fe1101594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe1152ed700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1100c8c50 0x7fe1100c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe1152ed700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1101586f0 0x7fe11015a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe1152ed700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1100c49d0 con 0x7fe1101586f0 2023-11-28T13:00:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe1152ed700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1101567f0 con 0x7fe110070900 2023-11-28T13:00:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe1152ed700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe110159ad0 con 0x7fe1100c8c50 2023-11-28T13:00:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe114aec700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1101586f0 0x7fe11015a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe114aec700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1101586f0 0x7fe11015a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39440/0 (socket says 172.21.15.82:39440) 2023-11-28T13:00:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe114aec700 1 -- 172.21.15.82:0/296013446 learned_addr learned my addr 172.21.15.82:0/296013446 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe10ffff700 1 --2- 172.21.15.82:0/296013446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe110070900 0x7fe1101594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe10f7fe700 1 --2- 172.21.15.82:0/296013446 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1100c8c50 0x7fe1100c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe114aec700 1 -- 172.21.15.82:0/296013446 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1100c8c50 msgr2=0x7fe1100c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe114aec700 1 --2- 172.21.15.82:0/296013446 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1100c8c50 0x7fe1100c4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe114aec700 1 -- 172.21.15.82:0/296013446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe110070900 msgr2=0x7fe1101594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe114aec700 1 --2- 172.21.15.82:0/296013446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe110070900 0x7fe1101594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe114aec700 1 -- 172.21.15.82:0/296013446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1080094b0 con 0x7fe1101586f0 2023-11-28T13:00:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe114aec700 1 --2- 172.21.15.82:0/296013446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1101586f0 0x7fe11015a6c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe108009fd0 tx=0x7fe108004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe10cff9700 1 -- 172.21.15.82:0/296013446 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1080045b0 con 0x7fe1101586f0 2023-11-28T13:00:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe10cff9700 1 -- 172.21.15.82:0/296013446 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10801f070 con 0x7fe1101586f0 2023-11-28T13:00:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe1152ed700 1 -- 172.21.15.82:0/296013446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11015d150 con 0x7fe1101586f0 2023-11-28T13:00:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe10cff9700 1 -- 172.21.15.82:0/296013446 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1080038e0 con 0x7fe1101586f0 2023-11-28T13:00:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.828+0000 7fe1152ed700 1 -- 172.21.15.82:0/296013446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11015ce70 con 0x7fe1101586f0 2023-11-28T13:00:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.832+0000 7fe1152ed700 1 -- 172.21.15.82:0/296013446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1100c90f0 con 0x7fe1101586f0 2023-11-28T13:00:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.832+0000 7fe10cff9700 1 -- 172.21.15.82:0/296013446 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe10802a020 con 0x7fe1101586f0 2023-11-28T13:00:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.832+0000 7fe10cff9700 1 --2- 172.21.15.82:0/296013446 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe0fc064ee0 0x7fe0fc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.832+0000 7fe10cff9700 1 -- 172.21.15.82:0/296013446 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe108083100 con 0x7fe1101586f0 2023-11-28T13:00:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.832+0000 7fe10ffff700 1 --2- 172.21.15.82:0/296013446 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe0fc064ee0 0x7fe0fc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:23.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.832+0000 7fe10ffff700 1 --2- 172.21.15.82:0/296013446 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe0fc064ee0 0x7fe0fc067390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe104009ae0 tx=0x7fe104008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:23.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:23.840+0000 7fe10cff9700 1 -- 172.21.15.82:0/296013446 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe108051570 con 0x7fe1101586f0 2023-11-28T13:00:24.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.000+0000 7fe1152ed700 1 -- 172.21.15.82:0/296013446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe110065fc0 con 0x7fe1101586f0 2023-11-28T13:00:24.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.004+0000 7fe10cff9700 1 -- 172.21.15.82:0/296013446 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7fe108015090 con 0x7fe1101586f0 2023-11-28T13:00:24.007 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:24.007 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-11-28T13:00:24.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:00:24.007 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2023-11-28T13:00:24.007 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2023-11-28T13:00:24.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:00:24.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:00:24.007 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 2, 2023-11-28T13:00:24.007 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "rbd" 2023-11-28T13:00:24.007 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:00:24.008 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-11-28T13:00:24.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.004+0000 7fe1152ed700 1 -- 172.21.15.82:0/296013446 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe0fc064ee0 msgr2=0x7fe0fc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:24.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.004+0000 7fe1152ed700 1 --2- 172.21.15.82:0/296013446 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe0fc064ee0 0x7fe0fc067390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe104009ae0 tx=0x7fe104008040 comp rx=0 tx=0).stop 2023-11-28T13:00:24.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.004+0000 7fe1152ed700 1 -- 172.21.15.82:0/296013446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1101586f0 msgr2=0x7fe11015a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:24.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.004+0000 7fe1152ed700 1 --2- 172.21.15.82:0/296013446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1101586f0 0x7fe11015a6c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe108009fd0 tx=0x7fe108004770 comp rx=0 tx=0).stop 2023-11-28T13:00:24.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.004+0000 7fe1152ed700 1 -- 172.21.15.82:0/296013446 shutdown_connections 2023-11-28T13:00:24.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.004+0000 7fe1152ed700 1 --2- 172.21.15.82:0/296013446 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe0fc064ee0 0x7fe0fc067390 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:24.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.004+0000 7fe1152ed700 1 --2- 172.21.15.82:0/296013446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1101586f0 0x7fe11015a6c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:24.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.004+0000 7fe1152ed700 1 --2- 172.21.15.82:0/296013446 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1100c8c50 0x7fe1100c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:24.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.004+0000 7fe1152ed700 1 --2- 172.21.15.82:0/296013446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe110070900 0x7fe1101594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:24.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.004+0000 7fe1152ed700 1 -- 172.21.15.82:0/296013446 >> 172.21.15.82:0/296013446 conn(0x7fe1100ce600 msgr2=0x7fe1100b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:24.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.004+0000 7fe1152ed700 1 -- 172.21.15.82:0/296013446 shutdown_connections 2023-11-28T13:00:24.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.004+0000 7fe1152ed700 1 -- 172.21.15.82:0/296013446 wait complete. 2023-11-28T13:00:24.021 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T13:00:24.021 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T13:00:24.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.140+0000 7fa68bfff700 1 Processor -- start 2023-11-28T13:00:24.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.140+0000 7fa68bfff700 1 -- start start 2023-11-28T13:00:24.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa68bfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa68c0d25c0 0x7fa68c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:24.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa68bfff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68c0ccfe0 con 0x7fa68c0d2190 2023-11-28T13:00:24.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa68bfff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68c0d10f0 con 0x7fa68c06b800 2023-11-28T13:00:24.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa68bfff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68c0d13d0 con 0x7fa68c0d25c0 2023-11-28T13:00:24.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa68a7fc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa68c0d2190 0x7fa68c0b5a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33304/0 (socket says 172.21.15.82:33304) 2023-11-28T13:00:24.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa68a7fc700 1 -- 172.21.15.82:0/772676951 learned_addr learned my addr 172.21.15.82:0/772676951 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:24.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa68b7fe700 1 --2- 172.21.15.82:0/772676951 >> v2:172.21.15.114:3300/0 conn(0x7fa68c0d25c0 0x7fa68c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:24.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa689ffb700 1 -- 172.21.15.82:0/772676951 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802624180 0 0) 0x7fa68c0ccfe0 con 0x7fa68c0d2190 2023-11-28T13:00:24.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa689ffb700 1 -- 172.21.15.82:0/772676951 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6780035d0 con 0x7fa68c0d2190 2023-11-28T13:00:24.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa68b7fe700 1 -- 172.21.15.82:0/772676951 >> v1:172.21.15.114:6789/0 conn(0x7fa68c06b800 legacy=0x7fa68c06bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:24.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa68b7fe700 1 -- 172.21.15.82:0/772676951 >> v1:172.21.15.82:6789/0 conn(0x7fa68c0d2190 legacy=0x7fa68c0b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:24.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa68b7fe700 1 -- 172.21.15.82:0/772676951 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68c0cd230 con 0x7fa68c0d25c0 2023-11-28T13:00:24.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa68b7fe700 1 --2- 172.21.15.82:0/772676951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa68c0d25c0 0x7fa68c0b6130 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa684009d90 tx=0x7fa68400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61570c242e619a7f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:24.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa689ffb700 1 -- 172.21.15.82:0/772676951 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68400e070 con 0x7fa68c0d25c0 2023-11-28T13:00:24.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa689ffb700 1 -- 172.21.15.82:0/772676951 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68400bb20 con 0x7fa68c0d25c0 2023-11-28T13:00:24.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa689ffb700 1 -- 172.21.15.82:0/772676951 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa684012430 con 0x7fa68c0d25c0 2023-11-28T13:00:24.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa68bfff700 1 -- 172.21.15.82:0/772676951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa68c0d25c0 msgr2=0x7fa68c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:24.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa68bfff700 1 --2- 172.21.15.82:0/772676951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa68c0d25c0 0x7fa68c0b6130 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa684009d90 tx=0x7fa68400b330 comp rx=0 tx=0).stop 2023-11-28T13:00:24.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa68bfff700 1 -- 172.21.15.82:0/772676951 shutdown_connections 2023-11-28T13:00:24.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa68bfff700 1 --2- 172.21.15.82:0/772676951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa68c0d25c0 0x7fa68c0b6130 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:24.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa68bfff700 1 -- 172.21.15.82:0/772676951 >> 172.21.15.82:0/772676951 conn(0x7fa68c0d00a0 msgr2=0x7fa68c0d2990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:24.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa68bfff700 1 -- 172.21.15.82:0/772676951 shutdown_connections 2023-11-28T13:00:24.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa68bfff700 1 -- 172.21.15.82:0/772676951 wait complete. 2023-11-28T13:00:24.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.144+0000 7fa68bfff700 1 Processor -- start 2023-11-28T13:00:24.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa68bfff700 1 -- start start 2023-11-28T13:00:24.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa68bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa68c06b800 0x7fa68c15a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:24.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa68bfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa68c0d2190 0x7fa68c0b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:24.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa68bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa68c0d25c0 0x7fa68c0b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:24.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa68bfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c0b4130 con 0x7fa68c0d25c0 2023-11-28T13:00:24.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa68bfff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c1e9110 con 0x7fa68c06b800 2023-11-28T13:00:24.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa68bfff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c1e93f0 con 0x7fa68c0d2190 2023-11-28T13:00:24.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa68b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa68c0d25c0 0x7fa68c0b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa68b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa68c0d25c0 0x7fa68c0b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39448/0 (socket says 172.21.15.82:39448) 2023-11-28T13:00:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa68b7fe700 1 -- 172.21.15.82:0/3677744005 learned_addr learned my addr 172.21.15.82:0/3677744005 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa68a7fc700 1 --2- 172.21.15.82:0/3677744005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa68c0d2190 0x7fa68c0b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa68affd700 1 --2- 172.21.15.82:0/3677744005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa68c06b800 0x7fa68c15a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa68b7fe700 1 -- 172.21.15.82:0/3677744005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa68c0d2190 msgr2=0x7fa68c0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa68b7fe700 1 --2- 172.21.15.82:0/3677744005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa68c0d2190 0x7fa68c0b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa68b7fe700 1 -- 172.21.15.82:0/3677744005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa68c06b800 msgr2=0x7fa68c15a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa68b7fe700 1 --2- 172.21.15.82:0/3677744005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa68c06b800 0x7fa68c15a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa68b7fe700 1 -- 172.21.15.82:0/3677744005 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa684009a70 con 0x7fa68c0d25c0 2023-11-28T13:00:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa68b7fe700 1 --2- 172.21.15.82:0/3677744005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa68c0d25c0 0x7fa68c0b2b10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa684014040 tx=0x7fa684004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:24.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa6837fe700 1 -- 172.21.15.82:0/3677744005 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa684012430 con 0x7fa68c0d25c0 2023-11-28T13:00:24.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa6837fe700 1 -- 172.21.15.82:0/3677744005 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa684020070 con 0x7fa68c0d25c0 2023-11-28T13:00:24.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa68bfff700 1 -- 172.21.15.82:0/3677744005 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68c0b1ec0 con 0x7fa68c0d25c0 2023-11-28T13:00:24.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa6837fe700 1 -- 172.21.15.82:0/3677744005 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa684004280 con 0x7fa68c0d25c0 2023-11-28T13:00:24.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa68bfff700 1 -- 172.21.15.82:0/3677744005 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68c0cd510 con 0x7fa68c0d25c0 2023-11-28T13:00:24.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.148+0000 7fa68bfff700 1 -- 172.21.15.82:0/3677744005 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68c0b2050 con 0x7fa68c0d25c0 2023-11-28T13:00:24.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.152+0000 7fa6837fe700 1 -- 172.21.15.82:0/3677744005 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa6840043e0 con 0x7fa68c0d25c0 2023-11-28T13:00:24.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.152+0000 7fa6837fe700 1 --2- 172.21.15.82:0/3677744005 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa66c064f10 0x7fa66c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:24.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.152+0000 7fa6837fe700 1 -- 172.21.15.82:0/3677744005 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa684022070 con 0x7fa68c0d25c0 2023-11-28T13:00:24.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.152+0000 7fa68affd700 1 --2- 172.21.15.82:0/3677744005 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa66c064f10 0x7fa66c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:24.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.152+0000 7fa68affd700 1 --2- 172.21.15.82:0/3677744005 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa66c064f10 0x7fa66c0673c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa67c000f60 tx=0x7fa67c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:24.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.160+0000 7fa6837fe700 1 -- 172.21.15.82:0/3677744005 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa684052110 con 0x7fa68c0d25c0 2023-11-28T13:00:24.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.320+0000 7fa68bfff700 1 -- 172.21.15.82:0/3677744005 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa68c065fc0 con 0x7fa68c0d25c0 2023-11-28T13:00:24.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.592+0000 7fa6837fe700 1 -- 172.21.15.82:0/3677744005 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa684055730 con 0x7fa68c0d25c0 2023-11-28T13:00:24.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.604+0000 7fa68bfff700 1 -- 172.21.15.82:0/3677744005 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa66c064f10 msgr2=0x7fa66c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:24.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.604+0000 7fa68bfff700 1 --2- 172.21.15.82:0/3677744005 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa66c064f10 0x7fa66c0673c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa67c000f60 tx=0x7fa67c009040 comp rx=0 tx=0).stop 2023-11-28T13:00:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.604+0000 7fa68bfff700 1 -- 172.21.15.82:0/3677744005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa68c0d25c0 msgr2=0x7fa68c0b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.604+0000 7fa68bfff700 1 --2- 172.21.15.82:0/3677744005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa68c0d25c0 0x7fa68c0b2b10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa684014040 tx=0x7fa684004b40 comp rx=0 tx=0).stop 2023-11-28T13:00:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.604+0000 7fa68bfff700 1 -- 172.21.15.82:0/3677744005 shutdown_connections 2023-11-28T13:00:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.604+0000 7fa68bfff700 1 --2- 172.21.15.82:0/3677744005 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa66c064f10 0x7fa66c0673c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.604+0000 7fa68bfff700 1 --2- 172.21.15.82:0/3677744005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa68c0d25c0 0x7fa68c0b2b10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.604+0000 7fa68bfff700 1 --2- 172.21.15.82:0/3677744005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa68c0d2190 0x7fa68c0b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.604+0000 7fa68bfff700 1 --2- 172.21.15.82:0/3677744005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa68c06b800 0x7fa68c15a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.604+0000 7fa68bfff700 1 -- 172.21.15.82:0/3677744005 >> 172.21.15.82:0/3677744005 conn(0x7fa68c0d00a0 msgr2=0x7fa68c0cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.604+0000 7fa68bfff700 1 -- 172.21.15.82:0/3677744005 shutdown_connections 2023-11-28T13:00:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.604+0000 7fa68bfff700 1 -- 172.21.15.82:0/3677744005 wait complete. 2023-11-28T13:00:24.608 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2023-11-28T13:00:24.619 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T13:00:24.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.732+0000 7ff87cb38700 1 Processor -- start 2023-11-28T13:00:24.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.732+0000 7ff87cb38700 1 -- start start 2023-11-28T13:00:24.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff87cb38700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8781578a0 0x7ff8780afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:24.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff87cb38700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff87815a480 0x7ff8780ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:24.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff87cb38700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff87815abf0 con 0x7ff8780ce8f0 2023-11-28T13:00:24.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff87cb38700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8780b00b0 con 0x7ff87815a480 2023-11-28T13:00:24.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff87cb38700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87815aed0 con 0x7ff8781578a0 2023-11-28T13:00:24.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff876ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff87815a480 0x7ff8780ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:24.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff876ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff87815a480 0x7ff8780ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39452/0 (socket says 172.21.15.82:39452) 2023-11-28T13:00:24.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff876ffd700 1 -- 172.21.15.82:0/574411949 learned_addr learned my addr 172.21.15.82:0/574411949 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:24.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff8777fe700 1 --2- 172.21.15.82:0/574411949 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8781578a0 0x7ff8780afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff876ffd700 1 -- 172.21.15.82:0/574411949 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8781578a0 msgr2=0x7ff8780afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff876ffd700 1 --2- 172.21.15.82:0/574411949 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8781578a0 0x7ff8780afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff876ffd700 1 -- 172.21.15.82:0/574411949 >> v1:172.21.15.114:6789/0 conn(0x7ff8780ce8f0 legacy=0x7ff87806de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff876ffd700 1 -- 172.21.15.82:0/574411949 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87815b1b0 con 0x7ff87815a480 2023-11-28T13:00:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff876ffd700 1 --2- 172.21.15.82:0/574411949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff87815a480 0x7ff8780ce3b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff868009910 tx=0x7ff868009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843fc1b95a91fdac server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff8767fc700 1 -- 172.21.15.82:0/574411949 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868011830 con 0x7ff87815a480 2023-11-28T13:00:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff8767fc700 1 -- 172.21.15.82:0/574411949 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff868011990 con 0x7ff87815a480 2023-11-28T13:00:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff8767fc700 1 -- 172.21.15.82:0/574411949 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868011d40 con 0x7ff87815a480 2023-11-28T13:00:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff87cb38700 1 -- 172.21.15.82:0/574411949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff87815a480 msgr2=0x7ff8780ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:24.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff87cb38700 1 --2- 172.21.15.82:0/574411949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff87815a480 0x7ff8780ce3b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff868009910 tx=0x7ff868009c20 comp rx=0 tx=0).stop 2023-11-28T13:00:24.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff87cb38700 1 -- 172.21.15.82:0/574411949 shutdown_connections 2023-11-28T13:00:24.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff87cb38700 1 --2- 172.21.15.82:0/574411949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff87815a480 0x7ff8780ce3b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:24.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff87cb38700 1 --2- 172.21.15.82:0/574411949 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8781578a0 0x7ff8780afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:24.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff87cb38700 1 -- 172.21.15.82:0/574411949 >> 172.21.15.82:0/574411949 conn(0x7ff8780d07e0 msgr2=0x7ff8780d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:24.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff87cb38700 1 -- 172.21.15.82:0/574411949 shutdown_connections 2023-11-28T13:00:24.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.736+0000 7ff87cb38700 1 -- 172.21.15.82:0/574411949 wait complete. 2023-11-28T13:00:24.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff87cb38700 1 Processor -- start 2023-11-28T13:00:24.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff87cb38700 1 -- start start 2023-11-28T13:00:24.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff87cb38700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8780ce8f0 0x7ff878159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:24.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff87cb38700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8781578a0 0x7ff8781eedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:24.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff87cb38700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff87815a480 0x7ff8781e4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:24.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff87cb38700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8781e3890 con 0x7ff8780ce8f0 2023-11-28T13:00:24.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff87cb38700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8781e4060 con 0x7ff87815a480 2023-11-28T13:00:24.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff87cb38700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780c8460 con 0x7ff8781578a0 2023-11-28T13:00:24.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff8777fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8780ce8f0 0x7ff878159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:24.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff8777fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8780ce8f0 0x7ff878159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39454/0 (socket says 172.21.15.82:39454) 2023-11-28T13:00:24.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff8777fe700 1 -- 172.21.15.82:0/40362783 learned_addr learned my addr 172.21.15.82:0/40362783 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:24.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff877fff700 1 --2- 172.21.15.82:0/40362783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff87815a480 0x7ff8781e4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:24.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff876ffd700 1 --2- 172.21.15.82:0/40362783 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8781578a0 0x7ff8781eedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:24.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff8777fe700 1 -- 172.21.15.82:0/40362783 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8781578a0 msgr2=0x7ff8781eedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:24.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff8777fe700 1 --2- 172.21.15.82:0/40362783 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8781578a0 0x7ff8781eedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:24.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff8777fe700 1 -- 172.21.15.82:0/40362783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff87815a480 msgr2=0x7ff8781e4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:24.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff8777fe700 1 --2- 172.21.15.82:0/40362783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff87815a480 0x7ff8781e4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:24.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff8777fe700 1 -- 172.21.15.82:0/40362783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff868009570 con 0x7ff8780ce8f0 2023-11-28T13:00:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff8777fe700 1 --2- 172.21.15.82:0/40362783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8780ce8f0 0x7ff878159780 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff86000ea00 tx=0x7ff86000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff86ffff700 1 -- 172.21.15.82:0/40362783 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff860009720 con 0x7ff8780ce8f0 2023-11-28T13:00:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff86ffff700 1 -- 172.21.15.82:0/40362783 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86000c850 con 0x7ff8780ce8f0 2023-11-28T13:00:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff87cb38700 1 -- 172.21.15.82:0/40362783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87815a8d0 con 0x7ff8780ce8f0 2023-11-28T13:00:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff86ffff700 1 -- 172.21.15.82:0/40362783 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86000cbc0 con 0x7ff8780ce8f0 2023-11-28T13:00:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.740+0000 7ff87cb38700 1 -- 172.21.15.82:0/40362783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff87806d910 con 0x7ff8780ce8f0 2023-11-28T13:00:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.744+0000 7ff87cb38700 1 -- 172.21.15.82:0/40362783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff878157c70 con 0x7ff8780ce8f0 2023-11-28T13:00:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.744+0000 7ff86ffff700 1 -- 172.21.15.82:0/40362783 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff860019030 con 0x7ff8780ce8f0 2023-11-28T13:00:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.744+0000 7ff86ffff700 1 --2- 172.21.15.82:0/40362783 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff858064f10 0x7ff8580673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.744+0000 7ff876ffd700 1 --2- 172.21.15.82:0/40362783 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff858064f10 0x7ff8580673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.744+0000 7ff86ffff700 1 -- 172.21.15.82:0/40362783 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7ff860081cf0 con 0x7ff8780ce8f0 2023-11-28T13:00:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.744+0000 7ff876ffd700 1 --2- 172.21.15.82:0/40362783 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff858064f10 0x7ff8580673c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff868014040 tx=0x7ff868008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.752+0000 7ff86ffff700 1 -- 172.21.15.82:0/40362783 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff86004fff0 con 0x7ff8780ce8f0 2023-11-28T13:00:24.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:24.916+0000 7ff87cb38700 1 -- 172.21.15.82:0/40362783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff8780d0650 con 0x7ff8780ce8f0 2023-11-28T13:00:25.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.608+0000 7ff86ffff700 1 -- 172.21.15.82:0/40362783 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v22) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff860053610 con 0x7ff8780ce8f0 2023-11-28T13:00:25.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.632+0000 7ff87cb38700 1 -- 172.21.15.82:0/40362783 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff858064f10 msgr2=0x7ff8580673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:25.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.632+0000 7ff87cb38700 1 --2- 172.21.15.82:0/40362783 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff858064f10 0x7ff8580673c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff868014040 tx=0x7ff868008030 comp rx=0 tx=0).stop 2023-11-28T13:00:25.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.632+0000 7ff87cb38700 1 -- 172.21.15.82:0/40362783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8780ce8f0 msgr2=0x7ff878159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:25.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.632+0000 7ff87cb38700 1 --2- 172.21.15.82:0/40362783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8780ce8f0 0x7ff878159780 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff86000ea00 tx=0x7ff86000edc0 comp rx=0 tx=0).stop 2023-11-28T13:00:25.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.632+0000 7ff87cb38700 1 -- 172.21.15.82:0/40362783 shutdown_connections 2023-11-28T13:00:25.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.632+0000 7ff87cb38700 1 --2- 172.21.15.82:0/40362783 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff858064f10 0x7ff8580673c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:25.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.632+0000 7ff87cb38700 1 --2- 172.21.15.82:0/40362783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff87815a480 0x7ff8781e4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:25.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.632+0000 7ff87cb38700 1 --2- 172.21.15.82:0/40362783 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8781578a0 0x7ff8781eedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:25.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.632+0000 7ff87cb38700 1 --2- 172.21.15.82:0/40362783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8780ce8f0 0x7ff878159780 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:25.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.632+0000 7ff87cb38700 1 -- 172.21.15.82:0/40362783 >> 172.21.15.82:0/40362783 conn(0x7ff8780d07e0 msgr2=0x7ff87815da00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:25.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.632+0000 7ff87cb38700 1 -- 172.21.15.82:0/40362783 shutdown_connections 2023-11-28T13:00:25.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.632+0000 7ff87cb38700 1 -- 172.21.15.82:0/40362783 wait complete. 2023-11-28T13:00:25.637 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2023-11-28T13:00:25.648 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T13:00:25.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.756+0000 7fdf9ca52700 1 Processor -- start 2023-11-28T13:00:25.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.756+0000 7fdf9ca52700 1 -- start start 2023-11-28T13:00:25.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.756+0000 7fdf9ca52700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf980b1d10 0x7fdf980cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:25.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.756+0000 7fdf9ca52700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdf9806c140 0x7fdf9806a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:25.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.756+0000 7fdf9ca52700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf98069bc0 con 0x7fdf980d25b0 2023-11-28T13:00:25.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.756+0000 7fdf9ca52700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf980d1480 con 0x7fdf9806c140 2023-11-28T13:00:25.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.756+0000 7fdf9ca52700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980cd280 con 0x7fdf980b1d10 2023-11-28T13:00:25.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.756+0000 7fdf97fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdf9806c140 0x7fdf9806a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:25.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.756+0000 7fdf977fe700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf980b1d10 0x7fdf980cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:25.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.756+0000 7fdf97fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdf9806c140 0x7fdf9806a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:49906/0 (socket says 172.21.15.82:49906) 2023-11-28T13:00:25.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.756+0000 7fdf97fff700 1 -- 172.21.15.82:0/2108468422 learned_addr learned my addr 172.21.15.82:0/2108468422 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:25.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.756+0000 7fdf96ffd700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdf980d25b0 0x7fdf9806ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:53266/0 (socket says 172.21.15.82:53266) 2023-11-28T13:00:25.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.756+0000 7fdf977fe700 1 -- 172.21.15.82:0/2108468422 >> v2:172.21.15.114:3300/0 conn(0x7fdf9806c140 msgr2=0x7fdf9806a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:25.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.756+0000 7fdf977fe700 1 --2- 172.21.15.82:0/2108468422 >> v2:172.21.15.114:3300/0 conn(0x7fdf9806c140 0x7fdf9806a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:25.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.756+0000 7fdf977fe700 1 -- 172.21.15.82:0/2108468422 >> v1:172.21.15.114:6789/0 conn(0x7fdf980d25b0 legacy=0x7fdf9806ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:25.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.756+0000 7fdf977fe700 1 -- 172.21.15.82:0/2108468422 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf980cd560 con 0x7fdf980b1d10 2023-11-28T13:00:25.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.756+0000 7fdf97fff700 1 --2- 172.21.15.82:0/2108468422 >> v2:172.21.15.114:3300/0 conn(0x7fdf9806c140 0x7fdf9806a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:25.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.756+0000 7fdf977fe700 1 --2- 172.21.15.82:0/2108468422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf980b1d10 0x7fdf980cec20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009850 tx=0x7fdf88009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b13f2f1c917d672 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:25.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.756+0000 7fdf967fc700 1 -- 172.21.15.82:0/2108468422 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88011830 con 0x7fdf980b1d10 2023-11-28T13:00:25.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.756+0000 7fdf967fc700 1 -- 172.21.15.82:0/2108468422 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf88011990 con 0x7fdf980b1d10 2023-11-28T13:00:25.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.756+0000 7fdf967fc700 1 -- 172.21.15.82:0/2108468422 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88011d40 con 0x7fdf980b1d10 2023-11-28T13:00:25.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.760+0000 7fdf9ca52700 1 -- 172.21.15.82:0/2108468422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf980b1d10 msgr2=0x7fdf980cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:25.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.760+0000 7fdf9ca52700 1 --2- 172.21.15.82:0/2108468422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf980b1d10 0x7fdf980cec20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009850 tx=0x7fdf88009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:25.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.760+0000 7fdf9ca52700 1 -- 172.21.15.82:0/2108468422 shutdown_connections 2023-11-28T13:00:25.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.760+0000 7fdf9ca52700 1 --2- 172.21.15.82:0/2108468422 >> v2:172.21.15.114:3300/0 conn(0x7fdf9806c140 0x7fdf9806a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:25.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.760+0000 7fdf9ca52700 1 --2- 172.21.15.82:0/2108468422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf980b1d10 0x7fdf980cec20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:25.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.760+0000 7fdf9ca52700 1 -- 172.21.15.82:0/2108468422 >> 172.21.15.82:0/2108468422 conn(0x7fdf980b52a0 msgr2=0x7fdf980d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:25.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.760+0000 7fdf9ca52700 1 -- 172.21.15.82:0/2108468422 shutdown_connections 2023-11-28T13:00:25.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.760+0000 7fdf9ca52700 1 -- 172.21.15.82:0/2108468422 wait complete. 2023-11-28T13:00:25.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.760+0000 7fdf9ca52700 1 Processor -- start 2023-11-28T13:00:25.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.760+0000 7fdf9ca52700 1 -- start start 2023-11-28T13:00:25.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.760+0000 7fdf9ca52700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf9806c140 0x7fdf980b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:25.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.760+0000 7fdf9ca52700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf980b1d10 0x7fdf98153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:25.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.760+0000 7fdf9ca52700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf980d25b0 0x7fdf980c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:25.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.760+0000 7fdf9ca52700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980ca840 con 0x7fdf9806c140 2023-11-28T13:00:25.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.760+0000 7fdf9ca52700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980c9030 con 0x7fdf980b1d10 2023-11-28T13:00:25.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.760+0000 7fdf9ca52700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980c9310 con 0x7fdf980d25b0 2023-11-28T13:00:25.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.764+0000 7fdf977fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf9806c140 0x7fdf980b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:25.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.764+0000 7fdf977fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf9806c140 0x7fdf980b5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39464/0 (socket says 172.21.15.82:39464) 2023-11-28T13:00:25.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.764+0000 7fdf977fe700 1 -- 172.21.15.82:0/3934517849 learned_addr learned my addr 172.21.15.82:0/3934517849 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:25.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.764+0000 7fdf97fff700 1 --2- 172.21.15.82:0/3934517849 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf980d25b0 0x7fdf980c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:25.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.764+0000 7fdf96ffd700 1 --2- 172.21.15.82:0/3934517849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf980b1d10 0x7fdf98153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:25.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.764+0000 7fdf977fe700 1 -- 172.21.15.82:0/3934517849 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf980d25b0 msgr2=0x7fdf980c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:25.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.764+0000 7fdf977fe700 1 --2- 172.21.15.82:0/3934517849 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf980d25b0 0x7fdf980c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:25.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.764+0000 7fdf977fe700 1 -- 172.21.15.82:0/3934517849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf980b1d10 msgr2=0x7fdf98153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:25.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.764+0000 7fdf977fe700 1 --2- 172.21.15.82:0/3934517849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf980b1d10 0x7fdf98153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:25.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.764+0000 7fdf977fe700 1 -- 172.21.15.82:0/3934517849 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf90009b30 con 0x7fdf9806c140 2023-11-28T13:00:25.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.764+0000 7fdf97fff700 1 --2- 172.21.15.82:0/3934517849 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf980d25b0 0x7fdf980c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:25.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.764+0000 7fdf977fe700 1 --2- 172.21.15.82:0/3934517849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf9806c140 0x7fdf980b5940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdf880090b0 tx=0x7fdf88004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:25.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.764+0000 7fdf7ffff700 1 -- 172.21.15.82:0/3934517849 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88004480 con 0x7fdf9806c140 2023-11-28T13:00:25.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.764+0000 7fdf7ffff700 1 -- 172.21.15.82:0/3934517849 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8801f070 con 0x7fdf9806c140 2023-11-28T13:00:25.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.764+0000 7fdf9ca52700 1 -- 172.21.15.82:0/3934517849 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf880094b0 con 0x7fdf9806c140 2023-11-28T13:00:25.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.764+0000 7fdf7ffff700 1 -- 172.21.15.82:0/3934517849 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88003900 con 0x7fdf9806c140 2023-11-28T13:00:25.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.764+0000 7fdf9ca52700 1 -- 172.21.15.82:0/3934517849 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf980d1050 con 0x7fdf9806c140 2023-11-28T13:00:25.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.764+0000 7fdf9ca52700 1 -- 172.21.15.82:0/3934517849 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf980b20e0 con 0x7fdf9806c140 2023-11-28T13:00:25.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.764+0000 7fdf7ffff700 1 -- 172.21.15.82:0/3934517849 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdf8802a020 con 0x7fdf9806c140 2023-11-28T13:00:25.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.768+0000 7fdf7ffff700 1 --2- 172.21.15.82:0/3934517849 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdf84064ee0 0x7fdf84067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:25.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.768+0000 7fdf7ffff700 1 -- 172.21.15.82:0/3934517849 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fdf88083270 con 0x7fdf9806c140 2023-11-28T13:00:25.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.768+0000 7fdf96ffd700 1 --2- 172.21.15.82:0/3934517849 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdf84064ee0 0x7fdf84067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:25.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.768+0000 7fdf96ffd700 1 --2- 172.21.15.82:0/3934517849 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdf84064ee0 0x7fdf84067390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdf980d2150 tx=0x7fdf8c007ef0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:25.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.772+0000 7fdf7ffff700 1 -- 172.21.15.82:0/3934517849 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdf88051470 con 0x7fdf9806c140 2023-11-28T13:00:25.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.972+0000 7fdf9ca52700 1 -- 172.21.15.82:0/3934517849 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdf980d11e0 con 0x7fdf9806c140 2023-11-28T13:00:25.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:25.988+0000 7fdf7ffff700 1 -- 172.21.15.82:0/3934517849 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdf88054a90 con 0x7fdf9806c140 2023-11-28T13:00:26.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.000+0000 7fdf9ca52700 1 -- 172.21.15.82:0/3934517849 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdf84064ee0 msgr2=0x7fdf84067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:26.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.000+0000 7fdf9ca52700 1 --2- 172.21.15.82:0/3934517849 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdf84064ee0 0x7fdf84067390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdf980d2150 tx=0x7fdf8c007ef0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.000+0000 7fdf9ca52700 1 -- 172.21.15.82:0/3934517849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf9806c140 msgr2=0x7fdf980b5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:26.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.000+0000 7fdf9ca52700 1 --2- 172.21.15.82:0/3934517849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf9806c140 0x7fdf980b5940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdf880090b0 tx=0x7fdf88004770 comp rx=0 tx=0).stop 2023-11-28T13:00:26.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.004+0000 7fdf9ca52700 1 -- 172.21.15.82:0/3934517849 shutdown_connections 2023-11-28T13:00:26.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.004+0000 7fdf9ca52700 1 --2- 172.21.15.82:0/3934517849 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdf84064ee0 0x7fdf84067390 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.004+0000 7fdf9ca52700 1 --2- 172.21.15.82:0/3934517849 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf980d25b0 0x7fdf980c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.004+0000 7fdf9ca52700 1 --2- 172.21.15.82:0/3934517849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf980b1d10 0x7fdf98153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.004+0000 7fdf9ca52700 1 --2- 172.21.15.82:0/3934517849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf9806c140 0x7fdf980b5940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.004+0000 7fdf9ca52700 1 -- 172.21.15.82:0/3934517849 >> 172.21.15.82:0/3934517849 conn(0x7fdf980b52a0 msgr2=0x7fdf980b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.004+0000 7fdf9ca52700 1 -- 172.21.15.82:0/3934517849 shutdown_connections 2023-11-28T13:00:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.004+0000 7fdf9ca52700 1 -- 172.21.15.82:0/3934517849 wait complete. 2023-11-28T13:00:26.011 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 3 and data pool 4 2023-11-28T13:00:26.024 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:00:26.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.120+0000 7f4a5e34f700 1 Processor -- start 2023-11-28T13:00:26.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.120+0000 7f4a5e34f700 1 -- start start 2023-11-28T13:00:26.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.120+0000 7f4a5e34f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a5806de80 0x7f4a580cae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:26.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.120+0000 7f4a5e34f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4a580cd900 0x7f4a580afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:26.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.120+0000 7f4a5e34f700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a580affc0 con 0x7f4a580b6060 2023-11-28T13:00:26.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.120+0000 7f4a5e34f700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a580d06a0 con 0x7f4a580cd900 2023-11-28T13:00:26.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.120+0000 7f4a5e34f700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580cd1f0 con 0x7f4a5806de80 2023-11-28T13:00:26.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.120+0000 7f4a5db4e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4a580cd900 0x7f4a580afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:26.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.120+0000 7f4a5cb4c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a5806de80 0x7f4a580cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:26.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.120+0000 7f4a5db4e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4a580cd900 0x7f4a580afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:49924/0 (socket says 172.21.15.82:49924) 2023-11-28T13:00:26.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.120+0000 7f4a5db4e700 1 -- 172.21.15.82:0/1473954935 learned_addr learned my addr 172.21.15.82:0/1473954935 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:26.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.120+0000 7f4a5d34d700 1 --1- 172.21.15.82:0/1473954935 >> v1:172.21.15.114:6789/0 conn(0x7f4a580b6060 0x7f4a5806d770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:53272/0 (socket says 172.21.15.82:53272) 2023-11-28T13:00:26.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.124+0000 7f4a5db4e700 1 -- 172.21.15.82:0/1473954935 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a5806de80 msgr2=0x7f4a580cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:26.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.124+0000 7f4a5db4e700 1 --2- 172.21.15.82:0/1473954935 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a5806de80 0x7f4a580cae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.124+0000 7f4a5db4e700 1 -- 172.21.15.82:0/1473954935 >> v1:172.21.15.114:6789/0 conn(0x7f4a580b6060 legacy=0x7f4a5806d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:26.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.124+0000 7f4a5db4e700 1 -- 172.21.15.82:0/1473954935 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a580cfe90 con 0x7f4a580cd900 2023-11-28T13:00:26.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.124+0000 7f4a5db4e700 1 --2- 172.21.15.82:0/1473954935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a580cd900 0x7f4a580afa80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009910 tx=0x7f4a48009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c22c7174deeac0d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:26.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.124+0000 7f4a57fff700 1 -- 172.21.15.82:0/1473954935 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48011830 con 0x7f4a580cd900 2023-11-28T13:00:26.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.124+0000 7f4a57fff700 1 -- 172.21.15.82:0/1473954935 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a48011990 con 0x7f4a580cd900 2023-11-28T13:00:26.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.124+0000 7f4a57fff700 1 -- 172.21.15.82:0/1473954935 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48011d40 con 0x7f4a580cd900 2023-11-28T13:00:26.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.124+0000 7f4a5e34f700 1 -- 172.21.15.82:0/1473954935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a580cd900 msgr2=0x7f4a580afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:26.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.124+0000 7f4a5e34f700 1 --2- 172.21.15.82:0/1473954935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a580cd900 0x7f4a580afa80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009910 tx=0x7f4a48009c20 comp rx=0 tx=0).stop 2023-11-28T13:00:26.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.124+0000 7f4a5e34f700 1 -- 172.21.15.82:0/1473954935 shutdown_connections 2023-11-28T13:00:26.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.124+0000 7f4a5e34f700 1 --2- 172.21.15.82:0/1473954935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a580cd900 0x7f4a580afa80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.124+0000 7f4a5e34f700 1 --2- 172.21.15.82:0/1473954935 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a5806de80 0x7f4a580cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.124+0000 7f4a5e34f700 1 -- 172.21.15.82:0/1473954935 >> 172.21.15.82:0/1473954935 conn(0x7f4a580b2320 msgr2=0x7f4a580b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:26.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.124+0000 7f4a5e34f700 1 -- 172.21.15.82:0/1473954935 shutdown_connections 2023-11-28T13:00:26.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.124+0000 7f4a5e34f700 1 -- 172.21.15.82:0/1473954935 wait complete. 2023-11-28T13:00:26.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.128+0000 7f4a5e34f700 1 Processor -- start 2023-11-28T13:00:26.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.128+0000 7f4a5e34f700 1 -- start start 2023-11-28T13:00:26.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.128+0000 7f4a5e34f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a5806de80 0x7f4a580c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:26.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.128+0000 7f4a5e34f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a580b6060 0x7f4a5806ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:26.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.128+0000 7f4a5e34f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a580cd900 0x7f4a58156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:26.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.128+0000 7f4a5e34f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a581f1a00 con 0x7f4a580b6060 2023-11-28T13:00:26.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.128+0000 7f4a5e34f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a581f1cc0 con 0x7f4a580cd900 2023-11-28T13:00:26.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.128+0000 7f4a5e34f700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a581f1fa0 con 0x7f4a5806de80 2023-11-28T13:00:26.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.128+0000 7f4a5cb4c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a580b6060 0x7f4a5806ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:26.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.128+0000 7f4a5cb4c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a580b6060 0x7f4a5806ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39468/0 (socket says 172.21.15.82:39468) 2023-11-28T13:00:26.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.128+0000 7f4a5cb4c700 1 -- 172.21.15.82:0/3733969563 learned_addr learned my addr 172.21.15.82:0/3733969563 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:26.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.128+0000 7f4a5d34d700 1 --2- 172.21.15.82:0/3733969563 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a5806de80 0x7f4a580c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:26.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.128+0000 7f4a5db4e700 1 --2- 172.21.15.82:0/3733969563 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a580cd900 0x7f4a58156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:26.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.132+0000 7f4a5cb4c700 1 -- 172.21.15.82:0/3733969563 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a5806de80 msgr2=0x7f4a580c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:26.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.132+0000 7f4a5cb4c700 1 --2- 172.21.15.82:0/3733969563 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a5806de80 0x7f4a580c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.132+0000 7f4a5cb4c700 1 -- 172.21.15.82:0/3733969563 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a580cd900 msgr2=0x7f4a58156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:26.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.132+0000 7f4a5cb4c700 1 --2- 172.21.15.82:0/3733969563 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a580cd900 0x7f4a58156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.132+0000 7f4a5cb4c700 1 -- 172.21.15.82:0/3733969563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a48009570 con 0x7f4a580b6060 2023-11-28T13:00:26.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.132+0000 7f4a5d34d700 1 --2- 172.21.15.82:0/3733969563 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a5806de80 0x7f4a580c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:26.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.132+0000 7f4a5cb4c700 1 --2- 172.21.15.82:0/3733969563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a580b6060 0x7f4a5806ce50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00e9a0 tx=0x7f4a4c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:26.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.132+0000 7f4a55ffb700 1 -- 172.21.15.82:0/3733969563 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c009720 con 0x7f4a580b6060 2023-11-28T13:00:26.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.132+0000 7f4a55ffb700 1 -- 172.21.15.82:0/3733969563 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4c00c690 con 0x7f4a580b6060 2023-11-28T13:00:26.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.132+0000 7f4a5e34f700 1 -- 172.21.15.82:0/3733969563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a580d00e0 con 0x7f4a580b6060 2023-11-28T13:00:26.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.132+0000 7f4a55ffb700 1 -- 172.21.15.82:0/3733969563 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c00ca40 con 0x7f4a580b6060 2023-11-28T13:00:26.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.132+0000 7f4a5e34f700 1 -- 172.21.15.82:0/3733969563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a580cd470 con 0x7f4a580b6060 2023-11-28T13:00:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.132+0000 7f4a5e34f700 1 -- 172.21.15.82:0/3733969563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a580d03c0 con 0x7f4a580b6060 2023-11-28T13:00:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.132+0000 7f4a55ffb700 1 -- 172.21.15.82:0/3733969563 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4a4c019030 con 0x7f4a580b6060 2023-11-28T13:00:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.132+0000 7f4a55ffb700 1 --2- 172.21.15.82:0/3733969563 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4a44064ee0 0x7f4a44067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.132+0000 7f4a55ffb700 1 -- 172.21.15.82:0/3733969563 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a4c081cf0 con 0x7f4a580b6060 2023-11-28T13:00:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.132+0000 7f4a5d34d700 1 --2- 172.21.15.82:0/3733969563 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4a44064ee0 0x7f4a44067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:26.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.136+0000 7f4a5d34d700 1 --2- 172.21.15.82:0/3733969563 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4a44064ee0 0x7f4a44067390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4a500012e0 tx=0x7f4a50001b20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:26.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.140+0000 7f4a55ffb700 1 -- 172.21.15.82:0/3733969563 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4a4c04fe90 con 0x7f4a580b6060 2023-11-28T13:00:26.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.300+0000 7f4a5e34f700 1 -- 172.21.15.82:0/3733969563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a58065fc0 con 0x7f4a580b6060 2023-11-28T13:00:26.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.304+0000 7f4a55ffb700 1 -- 172.21.15.82:0/3733969563 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17824 (secure 0 0 0) 0x7f4a4c0534b0 con 0x7f4a580b6060 2023-11-28T13:00:26.309 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:26.310 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:00:25.977392+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:00:24.360641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T13:00:24.960863+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:00:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.308+0000 7f4a5e34f700 1 -- 172.21.15.82:0/3733969563 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4a44064ee0 msgr2=0x7f4a44067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.308+0000 7f4a5e34f700 1 --2- 172.21.15.82:0/3733969563 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4a44064ee0 0x7f4a44067390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4a500012e0 tx=0x7f4a50001b20 comp rx=0 tx=0).stop 2023-11-28T13:00:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.308+0000 7f4a5e34f700 1 -- 172.21.15.82:0/3733969563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a580b6060 msgr2=0x7f4a5806ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.308+0000 7f4a5e34f700 1 --2- 172.21.15.82:0/3733969563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a580b6060 0x7f4a5806ce50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00e9a0 tx=0x7f4a4c00ecb0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.308+0000 7f4a5e34f700 1 -- 172.21.15.82:0/3733969563 shutdown_connections 2023-11-28T13:00:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.308+0000 7f4a5e34f700 1 --2- 172.21.15.82:0/3733969563 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4a44064ee0 0x7f4a44067390 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.308+0000 7f4a5e34f700 1 --2- 172.21.15.82:0/3733969563 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a580cd900 0x7f4a58156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.308+0000 7f4a5e34f700 1 --2- 172.21.15.82:0/3733969563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a580b6060 0x7f4a5806ce50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.308+0000 7f4a5e34f700 1 --2- 172.21.15.82:0/3733969563 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a5806de80 0x7f4a580c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.308+0000 7f4a5e34f700 1 -- 172.21.15.82:0/3733969563 >> 172.21.15.82:0/3733969563 conn(0x7f4a580b2320 msgr2=0x7f4a580b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:26.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.308+0000 7f4a5e34f700 1 -- 172.21.15.82:0/3733969563 shutdown_connections 2023-11-28T13:00:26.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.308+0000 7f4a5e34f700 1 -- 172.21.15.82:0/3733969563 wait complete. 2023-11-28T13:00:26.325 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:00:26.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.428+0000 7efc8b4d9700 1 Processor -- start 2023-11-28T13:00:26.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.428+0000 7efc8b4d9700 1 -- start start 2023-11-28T13:00:26.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.428+0000 7efc8b4d9700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efc84158df0 0x7efc8415d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:26.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.428+0000 7efc8b4d9700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efc841591c0 0x7efc8406c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:26.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.428+0000 7efc8b4d9700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8415da50 con 0x7efc84070070 2023-11-28T13:00:26.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.428+0000 7efc8b4d9700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc840c9e20 con 0x7efc84158df0 2023-11-28T13:00:26.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.428+0000 7efc8b4d9700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc8406c5b0 con 0x7efc841591c0 2023-11-28T13:00:26.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.428+0000 7efc8a4d7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efc84158df0 0x7efc8415d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:26.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.428+0000 7efc8acd8700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efc84070070 0x7efc840ca2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33312/0 (socket says 172.21.15.82:33312) 2023-11-28T13:00:26.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.428+0000 7efc8acd8700 1 -- 172.21.15.82:0/4022000161 learned_addr learned my addr 172.21.15.82:0/4022000161 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:26.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.428+0000 7efc89cd6700 1 --2- 172.21.15.82:0/4022000161 >> v2:172.21.15.114:3300/0 conn(0x7efc841591c0 0x7efc8406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:26.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.428+0000 7efc8a4d7700 1 -- 172.21.15.82:0/4022000161 >> v2:172.21.15.114:3300/0 conn(0x7efc841591c0 msgr2=0x7efc8406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:26.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.428+0000 7efc8a4d7700 1 --2- 172.21.15.82:0/4022000161 >> v2:172.21.15.114:3300/0 conn(0x7efc841591c0 0x7efc8406c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.428+0000 7efc8a4d7700 1 -- 172.21.15.82:0/4022000161 >> v1:172.21.15.82:6789/0 conn(0x7efc84070070 legacy=0x7efc840ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:26.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.428+0000 7efc8a4d7700 1 -- 172.21.15.82:0/4022000161 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc840cc640 con 0x7efc84158df0 2023-11-28T13:00:26.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.428+0000 7efc8a4d7700 1 --2- 172.21.15.82:0/4022000161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc84158df0 0x7efc8415d510 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efc840b11a0 tx=0x7efc80009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d258ccc6be786ec7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:26.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.428+0000 7efc894d5700 1 -- 172.21.15.82:0/4022000161 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc80011830 con 0x7efc84158df0 2023-11-28T13:00:26.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.428+0000 7efc894d5700 1 -- 172.21.15.82:0/4022000161 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc80011990 con 0x7efc84158df0 2023-11-28T13:00:26.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.428+0000 7efc894d5700 1 -- 172.21.15.82:0/4022000161 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc80011d20 con 0x7efc84158df0 2023-11-28T13:00:26.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.432+0000 7efc8b4d9700 1 -- 172.21.15.82:0/4022000161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc84158df0 msgr2=0x7efc8415d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:26.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.432+0000 7efc8b4d9700 1 --2- 172.21.15.82:0/4022000161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc84158df0 0x7efc8415d510 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efc840b11a0 tx=0x7efc80009b30 comp rx=0 tx=0).stop 2023-11-28T13:00:26.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.432+0000 7efc8b4d9700 1 -- 172.21.15.82:0/4022000161 shutdown_connections 2023-11-28T13:00:26.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.432+0000 7efc8b4d9700 1 --2- 172.21.15.82:0/4022000161 >> v2:172.21.15.114:3300/0 conn(0x7efc841591c0 0x7efc8406c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.432+0000 7efc8b4d9700 1 --2- 172.21.15.82:0/4022000161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc84158df0 0x7efc8415d510 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.432+0000 7efc8b4d9700 1 -- 172.21.15.82:0/4022000161 >> 172.21.15.82:0/4022000161 conn(0x7efc840ce600 msgr2=0x7efc840ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:26.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.432+0000 7efc8b4d9700 1 -- 172.21.15.82:0/4022000161 shutdown_connections 2023-11-28T13:00:26.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.432+0000 7efc8b4d9700 1 -- 172.21.15.82:0/4022000161 wait complete. 2023-11-28T13:00:26.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.432+0000 7efc8b4d9700 1 Processor -- start 2023-11-28T13:00:26.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.432+0000 7efc8b4d9700 1 -- start start 2023-11-28T13:00:26.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc8b4d9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc84070070 0x7efc840c3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:26.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc8b4d9700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc84158df0 0x7efc84152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:26.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc8b4d9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc841591c0 0x7efc840c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:26.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc8b4d9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc840c3560 con 0x7efc84070070 2023-11-28T13:00:26.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc8b4d9700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc84156e30 con 0x7efc841591c0 2023-11-28T13:00:26.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc8b4d9700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc840c6c00 con 0x7efc84158df0 2023-11-28T13:00:26.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc8a4d7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc84070070 0x7efc840c3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:26.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc8a4d7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc84070070 0x7efc840c3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39482/0 (socket says 172.21.15.82:39482) 2023-11-28T13:00:26.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc8a4d7700 1 -- 172.21.15.82:0/2755601987 learned_addr learned my addr 172.21.15.82:0/2755601987 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:26.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc89cd6700 1 --2- 172.21.15.82:0/2755601987 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc84158df0 0x7efc84152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:26.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc8a4d7700 1 -- 172.21.15.82:0/2755601987 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc84158df0 msgr2=0x7efc84152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:26.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc8acd8700 1 --2- 172.21.15.82:0/2755601987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc841591c0 0x7efc840c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:26.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc8a4d7700 1 --2- 172.21.15.82:0/2755601987 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc84158df0 0x7efc84152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc8a4d7700 1 -- 172.21.15.82:0/2755601987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc841591c0 msgr2=0x7efc840c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:26.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc8a4d7700 1 --2- 172.21.15.82:0/2755601987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc841591c0 0x7efc840c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc8a4d7700 1 -- 172.21.15.82:0/2755601987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc800094b0 con 0x7efc84070070 2023-11-28T13:00:26.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc8acd8700 1 --2- 172.21.15.82:0/2755601987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc841591c0 0x7efc840c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:00:26.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc89cd6700 1 --2- 172.21.15.82:0/2755601987 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc84158df0 0x7efc84152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:00:26.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc8a4d7700 1 --2- 172.21.15.82:0/2755601987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc84070070 0x7efc840c3020 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efc80009b70 tx=0x7efc80004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:26.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc7affd700 1 -- 172.21.15.82:0/2755601987 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc800036c0 con 0x7efc84070070 2023-11-28T13:00:26.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc7affd700 1 -- 172.21.15.82:0/2755601987 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8001f070 con 0x7efc84070070 2023-11-28T13:00:26.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc7affd700 1 -- 172.21.15.82:0/2755601987 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc80003a20 con 0x7efc84070070 2023-11-28T13:00:26.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc8b4d9700 1 -- 172.21.15.82:0/2755601987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc840c9ab0 con 0x7efc84070070 2023-11-28T13:00:26.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc8b4d9700 1 -- 172.21.15.82:0/2755601987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc840c97d0 con 0x7efc84070070 2023-11-28T13:00:26.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.436+0000 7efc8b4d9700 1 -- 172.21.15.82:0/2755601987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc840c9480 con 0x7efc84070070 2023-11-28T13:00:26.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.440+0000 7efc7affd700 1 -- 172.21.15.82:0/2755601987 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efc8000f050 con 0x7efc84070070 2023-11-28T13:00:26.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.440+0000 7efc7affd700 1 --2- 172.21.15.82:0/2755601987 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efc68064ee0 0x7efc68067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:26.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.440+0000 7efc7affd700 1 -- 172.21.15.82:0/2755601987 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efc80021070 con 0x7efc84070070 2023-11-28T13:00:26.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.440+0000 7efc89cd6700 1 --2- 172.21.15.82:0/2755601987 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efc68064ee0 0x7efc68067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:26.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.440+0000 7efc89cd6700 1 --2- 172.21.15.82:0/2755601987 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efc68064ee0 0x7efc68067390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc840c1c80 tx=0x7efc74008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.448+0000 7efc7affd700 1 -- 172.21.15.82:0/2755601987 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efc80051970 con 0x7efc84070070 2023-11-28T13:00:26.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.612+0000 7efc8b4d9700 1 -- 172.21.15.82:0/2755601987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc84065fc0 con 0x7efc84070070 2023-11-28T13:00:26.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.616+0000 7efc7affd700 1 -- 172.21.15.82:0/2755601987 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17824 (secure 0 0 0) 0x7efc80015090 con 0x7efc84070070 2023-11-28T13:00:26.619 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:26.619 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:00:25.977392+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:00:24.360641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T13:00:24.960863+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:00:26.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.616+0000 7efc8b4d9700 1 -- 172.21.15.82:0/2755601987 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efc68064ee0 msgr2=0x7efc68067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:26.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.616+0000 7efc8b4d9700 1 --2- 172.21.15.82:0/2755601987 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efc68064ee0 0x7efc68067390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc840c1c80 tx=0x7efc74008040 comp rx=0 tx=0).stop 2023-11-28T13:00:26.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.616+0000 7efc8b4d9700 1 -- 172.21.15.82:0/2755601987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc84070070 msgr2=0x7efc840c3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:26.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.616+0000 7efc8b4d9700 1 --2- 172.21.15.82:0/2755601987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc84070070 0x7efc840c3020 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efc80009b70 tx=0x7efc80004770 comp rx=0 tx=0).stop 2023-11-28T13:00:26.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.616+0000 7efc8b4d9700 1 -- 172.21.15.82:0/2755601987 shutdown_connections 2023-11-28T13:00:26.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.616+0000 7efc8b4d9700 1 --2- 172.21.15.82:0/2755601987 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efc68064ee0 0x7efc68067390 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.616+0000 7efc8b4d9700 1 --2- 172.21.15.82:0/2755601987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc841591c0 0x7efc840c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.616+0000 7efc8b4d9700 1 --2- 172.21.15.82:0/2755601987 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc84158df0 0x7efc84152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.616+0000 7efc8b4d9700 1 --2- 172.21.15.82:0/2755601987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc84070070 0x7efc840c3020 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.616+0000 7efc8b4d9700 1 -- 172.21.15.82:0/2755601987 >> 172.21.15.82:0/2755601987 conn(0x7efc840ce600 msgr2=0x7efc840b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:26.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.616+0000 7efc8b4d9700 1 -- 172.21.15.82:0/2755601987 shutdown_connections 2023-11-28T13:00:26.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.616+0000 7efc8b4d9700 1 -- 172.21.15.82:0/2755601987 wait complete. 2023-11-28T13:00:26.633 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T13:00:26.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.752+0000 7f6717fff700 1 Processor -- start 2023-11-28T13:00:26.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.752+0000 7f6717fff700 1 -- start start 2023-11-28T13:00:26.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.752+0000 7f6717fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67180b1d10 0x7f67180cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:26.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.752+0000 7f6717fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f67180d25b0 0x7f671806ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:26.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.752+0000 7f6717fff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6718069bc0 con 0x7f67180b5940 2023-11-28T13:00:26.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.752+0000 7f6717fff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67180d1480 con 0x7f67180d25b0 2023-11-28T13:00:26.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.752+0000 7f6717fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67180cd280 con 0x7f67180b1d10 2023-11-28T13:00:26.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.752+0000 7f67167fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f67180d25b0 0x7f671806ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:26.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.752+0000 7f67177fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f67180b5940 0x7f671806a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:37024/0 (socket says 172.21.15.82:37024) 2023-11-28T13:00:26.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.752+0000 7f67167fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f67180d25b0 0x7f671806ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57248/0 (socket says 172.21.15.82:57248) 2023-11-28T13:00:26.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.752+0000 7f67177fe700 1 -- 172.21.15.82:0/3238165276 learned_addr learned my addr 172.21.15.82:0/3238165276 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:26.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.756+0000 7f6716ffd700 1 --2- 172.21.15.82:0/3238165276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67180b1d10 0x7f67180cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:26.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.756+0000 7f67167fc700 1 -- 172.21.15.82:0/3238165276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67180b1d10 msgr2=0x7f67180cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:26.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.756+0000 7f67167fc700 1 --2- 172.21.15.82:0/3238165276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67180b1d10 0x7f67180cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.756+0000 7f67167fc700 1 -- 172.21.15.82:0/3238165276 >> v1:172.21.15.82:6789/0 conn(0x7f67180b5940 legacy=0x7f671806a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:26.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.756+0000 7f67167fc700 1 -- 172.21.15.82:0/3238165276 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67180cd560 con 0x7f67180d25b0 2023-11-28T13:00:26.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.756+0000 7f67167fc700 1 --2- 172.21.15.82:0/3238165276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67180d25b0 0x7f671806ba30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6708009880 tx=0x7f6708009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54c9a4e7b1e8388 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:26.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.756+0000 7f6715ffb700 1 -- 172.21.15.82:0/3238165276 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708011830 con 0x7f67180d25b0 2023-11-28T13:00:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.756+0000 7f6715ffb700 1 -- 172.21.15.82:0/3238165276 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6708011990 con 0x7f67180d25b0 2023-11-28T13:00:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.756+0000 7f6715ffb700 1 -- 172.21.15.82:0/3238165276 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708011d20 con 0x7f67180d25b0 2023-11-28T13:00:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.756+0000 7f6717fff700 1 -- 172.21.15.82:0/3238165276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67180d25b0 msgr2=0x7f671806ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.756+0000 7f6717fff700 1 --2- 172.21.15.82:0/3238165276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67180d25b0 0x7f671806ba30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6708009880 tx=0x7f6708009b90 comp rx=0 tx=0).stop 2023-11-28T13:00:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.756+0000 7f6717fff700 1 -- 172.21.15.82:0/3238165276 shutdown_connections 2023-11-28T13:00:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.756+0000 7f6717fff700 1 --2- 172.21.15.82:0/3238165276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67180d25b0 0x7f671806ba30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.756+0000 7f6717fff700 1 --2- 172.21.15.82:0/3238165276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67180b1d10 0x7f67180cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.756+0000 7f6717fff700 1 -- 172.21.15.82:0/3238165276 >> 172.21.15.82:0/3238165276 conn(0x7f67180b52a0 msgr2=0x7f67180d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:26.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.756+0000 7f6717fff700 1 -- 172.21.15.82:0/3238165276 shutdown_connections 2023-11-28T13:00:26.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.756+0000 7f6717fff700 1 -- 172.21.15.82:0/3238165276 wait complete. 2023-11-28T13:00:26.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f6717fff700 1 Processor -- start 2023-11-28T13:00:26.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f6717fff700 1 -- start start 2023-11-28T13:00:26.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f6717fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67180b1d10 0x7f67180c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:26.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f6717fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67180b5940 0x7f671814cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:26.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f6717fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67180d25b0 0x7f67180c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:26.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f6717fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67180d2110 con 0x7f67180d25b0 2023-11-28T13:00:26.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f6717fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67180c7890 con 0x7f67180b5940 2023-11-28T13:00:26.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f6717fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671814d170 con 0x7f67180b1d10 2023-11-28T13:00:26.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f67177fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67180d25b0 0x7f67180c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:26.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f67177fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67180d25b0 0x7f67180c7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57258/0 (socket says 172.21.15.82:57258) 2023-11-28T13:00:26.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f67177fe700 1 -- 172.21.15.82:0/1975240754 learned_addr learned my addr 172.21.15.82:0/1975240754 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:26.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f6716ffd700 1 --2- 172.21.15.82:0/1975240754 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67180b1d10 0x7f67180c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:26.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f67167fc700 1 --2- 172.21.15.82:0/1975240754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67180b5940 0x7f671814cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:26.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f67177fe700 1 -- 172.21.15.82:0/1975240754 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67180b1d10 msgr2=0x7f67180c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:26.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f67177fe700 1 --2- 172.21.15.82:0/1975240754 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67180b1d10 0x7f67180c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f67177fe700 1 -- 172.21.15.82:0/1975240754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67180b5940 msgr2=0x7f671814cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:26.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f67177fe700 1 --2- 172.21.15.82:0/1975240754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67180b5940 0x7f671814cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:26.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f67177fe700 1 -- 172.21.15.82:0/1975240754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67080094b0 con 0x7f67180d25b0 2023-11-28T13:00:26.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f67177fe700 1 --2- 172.21.15.82:0/1975240754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67180d25b0 0x7f67180c7d20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f671000cbf0 tx=0x7f671000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:26.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f66ff7fe700 1 -- 172.21.15.82:0/1975240754 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6710007480 con 0x7f67180d25b0 2023-11-28T13:00:26.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f66ff7fe700 1 -- 172.21.15.82:0/1975240754 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67100075e0 con 0x7f67180d25b0 2023-11-28T13:00:26.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f6717fff700 1 -- 172.21.15.82:0/1975240754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67180d1050 con 0x7f67180d25b0 2023-11-28T13:00:26.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f66ff7fe700 1 -- 172.21.15.82:0/1975240754 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6710007950 con 0x7f67180d25b0 2023-11-28T13:00:26.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.760+0000 7f6717fff700 1 -- 172.21.15.82:0/1975240754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67180b20e0 con 0x7f67180d25b0 2023-11-28T13:00:26.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.764+0000 7f66ff7fe700 1 -- 172.21.15.82:0/1975240754 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6710019030 con 0x7f67180d25b0 2023-11-28T13:00:26.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.764+0000 7f6717fff700 1 -- 172.21.15.82:0/1975240754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67180d11e0 con 0x7f67180d25b0 2023-11-28T13:00:26.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.764+0000 7f66ff7fe700 1 --2- 172.21.15.82:0/1975240754 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6704064ee0 0x7f6704067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:26.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.764+0000 7f6716ffd700 1 --2- 172.21.15.82:0/1975240754 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6704064ee0 0x7f6704067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:26.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.764+0000 7f66ff7fe700 1 -- 172.21.15.82:0/1975240754 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6710081670 con 0x7f67180d25b0 2023-11-28T13:00:26.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.764+0000 7f6716ffd700 1 --2- 172.21.15.82:0/1975240754 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6704064ee0 0x7f6704067390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f670c009bf0 tx=0x7f670c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:26.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.772+0000 7f66ff7fe700 1 -- 172.21.15.82:0/1975240754 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f671004a400 con 0x7f67180d25b0 2023-11-28T13:00:26.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:26.972+0000 7f6717fff700 1 -- 172.21.15.82:0/1975240754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f67180c7a40 con 0x7f67180d25b0 2023-11-28T13:00:27.061 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:00:27.064 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:00:27.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.816+0000 7f66ff7fe700 1 -- 172.21.15.82:0/1975240754 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f67180c7a40 con 0x7f67180d25b0 2023-11-28T13:00:27.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.820+0000 7f6717fff700 1 -- 172.21.15.82:0/1975240754 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6704064ee0 msgr2=0x7f6704067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:27.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.820+0000 7f6717fff700 1 --2- 172.21.15.82:0/1975240754 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6704064ee0 0x7f6704067390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f670c009bf0 tx=0x7f670c009240 comp rx=0 tx=0).stop 2023-11-28T13:00:27.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.820+0000 7f6717fff700 1 -- 172.21.15.82:0/1975240754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67180d25b0 msgr2=0x7f67180c7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:27.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.820+0000 7f6717fff700 1 --2- 172.21.15.82:0/1975240754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67180d25b0 0x7f67180c7d20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f671000cbf0 tx=0x7f671000cc20 comp rx=0 tx=0).stop 2023-11-28T13:00:27.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.820+0000 7f6717fff700 1 -- 172.21.15.82:0/1975240754 shutdown_connections 2023-11-28T13:00:27.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.820+0000 7f6717fff700 1 --2- 172.21.15.82:0/1975240754 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6704064ee0 0x7f6704067390 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:27.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.820+0000 7f6717fff700 1 --2- 172.21.15.82:0/1975240754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67180d25b0 0x7f67180c7d20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:27.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.820+0000 7f6717fff700 1 --2- 172.21.15.82:0/1975240754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67180b5940 0x7f671814cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:27.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.820+0000 7f6717fff700 1 --2- 172.21.15.82:0/1975240754 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67180b1d10 0x7f67180c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:27.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.820+0000 7f6717fff700 1 -- 172.21.15.82:0/1975240754 >> 172.21.15.82:0/1975240754 conn(0x7f67180b52a0 msgr2=0x7f67180b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:27.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.820+0000 7f6717fff700 1 -- 172.21.15.82:0/1975240754 shutdown_connections 2023-11-28T13:00:27.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.820+0000 7f6717fff700 1 -- 172.21.15.82:0/1975240754 wait complete. 2023-11-28T13:00:27.842 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T13:00:27.843 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T13:00:27.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.964+0000 7f967759e700 1 Processor -- start 2023-11-28T13:00:27.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.964+0000 7f967759e700 1 -- start start 2023-11-28T13:00:27.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.964+0000 7f967759e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9678158720 0x7f96780b0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:27.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.964+0000 7f967759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f967806a450 0x7f967806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:27.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.964+0000 7f967759e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9678071130 0x7f96780715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:27.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.964+0000 7f967759e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967806ae00 con 0x7f9678158720 2023-11-28T13:00:27.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.964+0000 7f967759e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96780b0790 con 0x7f9678071130 2023-11-28T13:00:27.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.964+0000 7f967759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9678158af0 con 0x7f967806a450 2023-11-28T13:00:27.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f967659c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9678158720 0x7f96780b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:27.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f967659c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9678158720 0x7f96780b0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57272/0 (socket says 172.21.15.82:57272) 2023-11-28T13:00:27.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f967659c700 1 -- 172.21.15.82:0/1783160719 learned_addr learned my addr 172.21.15.82:0/1783160719 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:27.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f9676d9d700 1 --2- 172.21.15.82:0/1783160719 >> v2:172.21.15.114:3300/0 conn(0x7f9678071130 0x7f96780715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:27.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f9675d9b700 1 --2- 172.21.15.82:0/1783160719 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f967806a450 0x7f967806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:27.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f967659c700 1 -- 172.21.15.82:0/1783160719 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f967806a450 msgr2=0x7f967806a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:27.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f967659c700 1 --2- 172.21.15.82:0/1783160719 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f967806a450 0x7f967806a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:27.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f967659c700 1 -- 172.21.15.82:0/1783160719 >> v2:172.21.15.114:3300/0 conn(0x7f9678071130 msgr2=0x7f96780715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:27.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f967659c700 1 --2- 172.21.15.82:0/1783160719 >> v2:172.21.15.114:3300/0 conn(0x7f9678071130 0x7f96780715b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:27.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f967659c700 1 -- 172.21.15.82:0/1783160719 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96780af490 con 0x7f9678158720 2023-11-28T13:00:27.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f967659c700 1 --2- 172.21.15.82:0/1783160719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9678158720 0x7f96780b0250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f967806bd70 tx=0x7f9660009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91280929724542ef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:27.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f967559a700 1 -- 172.21.15.82:0/1783160719 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9660011830 con 0x7f9678158720 2023-11-28T13:00:27.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f967559a700 1 -- 172.21.15.82:0/1783160719 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9660011990 con 0x7f9678158720 2023-11-28T13:00:27.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f967559a700 1 -- 172.21.15.82:0/1783160719 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9660011d40 con 0x7f9678158720 2023-11-28T13:00:27.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f967759e700 1 -- 172.21.15.82:0/1783160719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9678158720 msgr2=0x7f96780b0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:27.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f967759e700 1 --2- 172.21.15.82:0/1783160719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9678158720 0x7f96780b0250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f967806bd70 tx=0x7f9660009c20 comp rx=0 tx=0).stop 2023-11-28T13:00:27.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f967759e700 1 -- 172.21.15.82:0/1783160719 shutdown_connections 2023-11-28T13:00:27.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f967759e700 1 --2- 172.21.15.82:0/1783160719 >> v2:172.21.15.114:3300/0 conn(0x7f9678071130 0x7f96780715b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:27.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f967759e700 1 --2- 172.21.15.82:0/1783160719 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f967806a450 0x7f967806a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:27.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f967759e700 1 --2- 172.21.15.82:0/1783160719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9678158720 0x7f96780b0250 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:27.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f967759e700 1 -- 172.21.15.82:0/1783160719 >> 172.21.15.82:0/1783160719 conn(0x7f96780ce630 msgr2=0x7f96780cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:27.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f967759e700 1 -- 172.21.15.82:0/1783160719 shutdown_connections 2023-11-28T13:00:27.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.968+0000 7f967759e700 1 -- 172.21.15.82:0/1783160719 wait complete. 2023-11-28T13:00:27.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f967759e700 1 Processor -- start 2023-11-28T13:00:27.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f967759e700 1 -- start start 2023-11-28T13:00:27.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f967759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f967806a450 0x7f9678156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:27.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f967759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9678071130 0x7f96781417a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f967759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9678158720 0x7f967814ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f967759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9678145430 con 0x7f9678071130 2023-11-28T13:00:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f967759e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96781559b0 con 0x7f9678158720 2023-11-28T13:00:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f967759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9678155c90 con 0x7f967806a450 2023-11-28T13:00:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f9675d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9678071130 0x7f96781417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f9675d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9678071130 0x7f96781417a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57274/0 (socket says 172.21.15.82:57274) 2023-11-28T13:00:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f9675d9b700 1 -- 172.21.15.82:0/202532339 learned_addr learned my addr 172.21.15.82:0/202532339 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f9676d9d700 1 --2- 172.21.15.82:0/202532339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9678158720 0x7f967814ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f967659c700 1 --2- 172.21.15.82:0/202532339 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f967806a450 0x7f9678156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f9675d9b700 1 -- 172.21.15.82:0/202532339 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f967806a450 msgr2=0x7f9678156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f9675d9b700 1 --2- 172.21.15.82:0/202532339 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f967806a450 0x7f9678156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f9675d9b700 1 -- 172.21.15.82:0/202532339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9678158720 msgr2=0x7f967814ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:27.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f9675d9b700 1 --2- 172.21.15.82:0/202532339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9678158720 0x7f967814ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:27.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f9675d9b700 1 -- 172.21.15.82:0/202532339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9660009570 con 0x7f9678071130 2023-11-28T13:00:27.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f9676d9d700 1 --2- 172.21.15.82:0/202532339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9678158720 0x7f967814ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:27.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f967659c700 1 --2- 172.21.15.82:0/202532339 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f967806a450 0x7f9678156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:27.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f9675d9b700 1 --2- 172.21.15.82:0/202532339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9678071130 0x7f96781417a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f966800ebe0 tx=0x7f9668009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:27.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f966effd700 1 -- 172.21.15.82:0/202532339 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9668009740 con 0x7f9678071130 2023-11-28T13:00:27.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f966effd700 1 -- 172.21.15.82:0/202532339 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966800c8b0 con 0x7f9678071130 2023-11-28T13:00:27.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f967759e700 1 -- 172.21.15.82:0/202532339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96780afa50 con 0x7f9678071130 2023-11-28T13:00:27.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f966effd700 1 -- 172.21.15.82:0/202532339 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966800cc40 con 0x7f9678071130 2023-11-28T13:00:27.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.972+0000 7f967759e700 1 -- 172.21.15.82:0/202532339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96780af770 con 0x7f9678071130 2023-11-28T13:00:27.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.976+0000 7f967759e700 1 -- 172.21.15.82:0/202532339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96780afd30 con 0x7f9678071130 2023-11-28T13:00:27.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.976+0000 7f966effd700 1 -- 172.21.15.82:0/202532339 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9668019030 con 0x7f9678071130 2023-11-28T13:00:27.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.976+0000 7f966effd700 1 --2- 172.21.15.82:0/202532339 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9658064ee0 0x7f9658067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:27.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.976+0000 7f966effd700 1 -- 172.21.15.82:0/202532339 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9668081f10 con 0x7f9678071130 2023-11-28T13:00:27.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.976+0000 7f967659c700 1 --2- 172.21.15.82:0/202532339 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9658064ee0 0x7f9658067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:27.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.976+0000 7f967659c700 1 --2- 172.21.15.82:0/202532339 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9658064ee0 0x7f9658067390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9660014040 tx=0x7f9660008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:27.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:27.984+0000 7f966effd700 1 -- 172.21.15.82:0/202532339 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f96680500b0 con 0x7f9678071130 2023-11-28T13:00:28.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:28.184+0000 7f967759e700 1 -- 172.21.15.82:0/202532339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9678065fc0 con 0x7f9678071130 2023-11-28T13:00:28.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:28.992+0000 7f966effd700 1 -- 172.21.15.82:0/202532339 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f96680536d0 con 0x7f9678071130 2023-11-28T13:00:29.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.000+0000 7f967759e700 1 -- 172.21.15.82:0/202532339 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9658064ee0 msgr2=0x7f9658067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:29.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.000+0000 7f967759e700 1 --2- 172.21.15.82:0/202532339 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9658064ee0 0x7f9658067390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9660014040 tx=0x7f9660008030 comp rx=0 tx=0).stop 2023-11-28T13:00:29.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.000+0000 7f967759e700 1 -- 172.21.15.82:0/202532339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9678071130 msgr2=0x7f96781417a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:29.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.000+0000 7f967759e700 1 --2- 172.21.15.82:0/202532339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9678071130 0x7f96781417a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f966800ebe0 tx=0x7f9668009e00 comp rx=0 tx=0).stop 2023-11-28T13:00:29.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.000+0000 7f967759e700 1 -- 172.21.15.82:0/202532339 shutdown_connections 2023-11-28T13:00:29.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.000+0000 7f967759e700 1 --2- 172.21.15.82:0/202532339 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9658064ee0 0x7f9658067390 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.000+0000 7f967759e700 1 --2- 172.21.15.82:0/202532339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9678158720 0x7f967814ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.000+0000 7f967759e700 1 --2- 172.21.15.82:0/202532339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9678071130 0x7f96781417a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.000+0000 7f967759e700 1 --2- 172.21.15.82:0/202532339 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f967806a450 0x7f9678156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.000+0000 7f967759e700 1 -- 172.21.15.82:0/202532339 >> 172.21.15.82:0/202532339 conn(0x7f96780ce630 msgr2=0x7f9678148310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:29.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.000+0000 7f967759e700 1 -- 172.21.15.82:0/202532339 shutdown_connections 2023-11-28T13:00:29.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.000+0000 7f967759e700 1 -- 172.21.15.82:0/202532339 wait complete. 2023-11-28T13:00:29.017 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T13:00:29.017 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:00:29.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.132+0000 7f63de90e700 1 Processor -- start 2023-11-28T13:00:29.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.132+0000 7f63de90e700 1 -- start start 2023-11-28T13:00:29.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63de90e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63d81591c0 0x7f63d815d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:29.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63de90e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f63d8070070 0x7f63d80704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:29.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63de90e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d815da50 con 0x7f63d8158df0 2023-11-28T13:00:29.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63de90e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d8070a30 con 0x7f63d8070070 2023-11-28T13:00:29.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63de90e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d80c9e20 con 0x7f63d81591c0 2023-11-28T13:00:29.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63de10d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f63d8070070 0x7f63d80704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:29.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63de10d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f63d8070070 0x7f63d80704f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57290/0 (socket says 172.21.15.82:57290) 2023-11-28T13:00:29.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63de10d700 1 -- 172.21.15.82:0/695586499 learned_addr learned my addr 172.21.15.82:0/695586499 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:29.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63dd10b700 1 --2- 172.21.15.82:0/695586499 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63d81591c0 0x7f63d815d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:29.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63de10d700 1 -- 172.21.15.82:0/695586499 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63d81591c0 msgr2=0x7f63d815d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:29.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63de10d700 1 --2- 172.21.15.82:0/695586499 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63d81591c0 0x7f63d815d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63de10d700 1 -- 172.21.15.82:0/695586499 >> v1:172.21.15.114:6789/0 conn(0x7f63d8158df0 legacy=0x7f63d806c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:29.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63de10d700 1 -- 172.21.15.82:0/695586499 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d80cc640 con 0x7f63d8070070 2023-11-28T13:00:29.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63dd10b700 1 --2- 172.21.15.82:0/695586499 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63d81591c0 0x7f63d815d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:29.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63de10d700 1 --2- 172.21.15.82:0/695586499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63d8070070 0x7f63d80704f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f63d0009e50 tx=0x7f63d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923e498da5a70cf4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:29.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63dc90a700 1 -- 172.21.15.82:0/695586499 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d000e070 con 0x7f63d8070070 2023-11-28T13:00:29.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63dc90a700 1 -- 172.21.15.82:0/695586499 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d000b910 con 0x7f63d8070070 2023-11-28T13:00:29.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63dc90a700 1 -- 172.21.15.82:0/695586499 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d000bcc0 con 0x7f63d8070070 2023-11-28T13:00:29.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63de90e700 1 -- 172.21.15.82:0/695586499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63d8070070 msgr2=0x7f63d80704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:29.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63de90e700 1 --2- 172.21.15.82:0/695586499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63d8070070 0x7f63d80704f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f63d0009e50 tx=0x7f63d000b330 comp rx=0 tx=0).stop 2023-11-28T13:00:29.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63de90e700 1 -- 172.21.15.82:0/695586499 shutdown_connections 2023-11-28T13:00:29.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63de90e700 1 --2- 172.21.15.82:0/695586499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63d8070070 0x7f63d80704f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63de90e700 1 --2- 172.21.15.82:0/695586499 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63d81591c0 0x7f63d815d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63de90e700 1 -- 172.21.15.82:0/695586499 >> 172.21.15.82:0/695586499 conn(0x7f63d80ce600 msgr2=0x7f63d80ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:29.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63de90e700 1 -- 172.21.15.82:0/695586499 shutdown_connections 2023-11-28T13:00:29.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.136+0000 7f63de90e700 1 -- 172.21.15.82:0/695586499 wait complete. 2023-11-28T13:00:29.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.140+0000 7f63de90e700 1 Processor -- start 2023-11-28T13:00:29.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.140+0000 7f63de90e700 1 -- start start 2023-11-28T13:00:29.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63de90e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63d8070070 0x7f63d8157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:29.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63de90e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63d8158df0 0x7f63d8147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:29.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63de90e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63d81591c0 0x7f63d80b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:29.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63de90e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d8158070 con 0x7f63d81591c0 2023-11-28T13:00:29.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63de90e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d80c3230 con 0x7f63d8070070 2023-11-28T13:00:29.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63de90e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d80c3510 con 0x7f63d8158df0 2023-11-28T13:00:29.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63de10d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63d81591c0 0x7f63d80b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:29.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63de10d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63d81591c0 0x7f63d80b0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57298/0 (socket says 172.21.15.82:57298) 2023-11-28T13:00:29.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63de10d700 1 -- 172.21.15.82:0/338826160 learned_addr learned my addr 172.21.15.82:0/338826160 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:29.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63dd10b700 1 --2- 172.21.15.82:0/338826160 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63d8158df0 0x7f63d8147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:29.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63dd90c700 1 --2- 172.21.15.82:0/338826160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63d8070070 0x7f63d8157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:29.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63de10d700 1 -- 172.21.15.82:0/338826160 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63d8158df0 msgr2=0x7f63d8147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:29.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63de10d700 1 --2- 172.21.15.82:0/338826160 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63d8158df0 0x7f63d8147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63de10d700 1 -- 172.21.15.82:0/338826160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63d8070070 msgr2=0x7f63d8157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:29.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63de10d700 1 --2- 172.21.15.82:0/338826160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63d8070070 0x7f63d8157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63de10d700 1 -- 172.21.15.82:0/338826160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c80094b0 con 0x7f63d81591c0 2023-11-28T13:00:29.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63dd10b700 1 --2- 172.21.15.82:0/338826160 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63d8158df0 0x7f63d8147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:29.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63de10d700 1 --2- 172.21.15.82:0/338826160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63d81591c0 0x7f63d80b0430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f63d8071980 tx=0x7f63d0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:29.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63d67fc700 1 -- 172.21.15.82:0/338826160 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d00099b0 con 0x7f63d81591c0 2023-11-28T13:00:29.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63d67fc700 1 -- 172.21.15.82:0/338826160 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d0004970 con 0x7f63d81591c0 2023-11-28T13:00:29.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63de90e700 1 -- 172.21.15.82:0/338826160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d0009b30 con 0x7f63d81591c0 2023-11-28T13:00:29.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63d67fc700 1 -- 172.21.15.82:0/338826160 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d001c680 con 0x7f63d81591c0 2023-11-28T13:00:29.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63de90e700 1 -- 172.21.15.82:0/338826160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d80c9ab0 con 0x7f63d81591c0 2023-11-28T13:00:29.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.144+0000 7f63de90e700 1 -- 172.21.15.82:0/338826160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d80c97d0 con 0x7f63d81591c0 2023-11-28T13:00:29.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.148+0000 7f63d67fc700 1 -- 172.21.15.82:0/338826160 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f63d002c070 con 0x7f63d81591c0 2023-11-28T13:00:29.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.148+0000 7f63d67fc700 1 --2- 172.21.15.82:0/338826160 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f63c4064ee0 0x7f63c4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:29.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.148+0000 7f63d67fc700 1 -- 172.21.15.82:0/338826160 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f63d0083b70 con 0x7f63d81591c0 2023-11-28T13:00:29.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.148+0000 7f63dd90c700 1 --2- 172.21.15.82:0/338826160 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f63c4064ee0 0x7f63c4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:29.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.148+0000 7f63dd90c700 1 --2- 172.21.15.82:0/338826160 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f63c4064ee0 0x7f63c4067390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f63d815a000 tx=0x7f63cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:29.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.156+0000 7f63d67fc700 1 -- 172.21.15.82:0/338826160 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f63d0051ba0 con 0x7f63d81591c0 2023-11-28T13:00:29.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.352+0000 7f63de90e700 1 -- 172.21.15.82:0/338826160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63d80c9480 con 0x7f63d81591c0 2023-11-28T13:00:29.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.352+0000 7f63d67fc700 1 -- 172.21.15.82:0/338826160 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4648 (secure 0 0 0) 0x7f63d00551c0 con 0x7f63d81591c0 2023-11-28T13:00:29.357 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:29.358 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2058451312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2058451312},{"type":"v1","addr":"172.21.15.82:6835","nonce":2058451312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/4064345694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":4064345694},{"type":"v1","addr":"172.21.15.114:6833","nonce":4064345694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2802500604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2802500604},{"type":"v1","addr":"172.21.15.114:6835","nonce":2802500604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:00:25.978137+0000","modified":"2023-11-28T13:00:28.990262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2893797521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2893797521},{"type":"v1","addr":"172.21.15.82:6837","nonce":2893797521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T13:00:29.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.356+0000 7f63de90e700 1 -- 172.21.15.82:0/338826160 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f63c4064ee0 msgr2=0x7f63c4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:29.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.356+0000 7f63de90e700 1 --2- 172.21.15.82:0/338826160 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f63c4064ee0 0x7f63c4067390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f63d815a000 tx=0x7f63cc009040 comp rx=0 tx=0).stop 2023-11-28T13:00:29.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.356+0000 7f63de90e700 1 -- 172.21.15.82:0/338826160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63d81591c0 msgr2=0x7f63d80b0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:29.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.356+0000 7f63de90e700 1 --2- 172.21.15.82:0/338826160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63d81591c0 0x7f63d80b0430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f63d8071980 tx=0x7f63d0004af0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.356+0000 7f63de90e700 1 -- 172.21.15.82:0/338826160 shutdown_connections 2023-11-28T13:00:29.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.356+0000 7f63de90e700 1 --2- 172.21.15.82:0/338826160 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f63c4064ee0 0x7f63c4067390 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.356+0000 7f63de90e700 1 --2- 172.21.15.82:0/338826160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63d81591c0 0x7f63d80b0430 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.356+0000 7f63de90e700 1 --2- 172.21.15.82:0/338826160 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63d8158df0 0x7f63d8147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.356+0000 7f63de90e700 1 --2- 172.21.15.82:0/338826160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63d8070070 0x7f63d8157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.356+0000 7f63de90e700 1 -- 172.21.15.82:0/338826160 >> 172.21.15.82:0/338826160 conn(0x7f63d80ce600 msgr2=0x7f63d80b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:29.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.356+0000 7f63de90e700 1 -- 172.21.15.82:0/338826160 shutdown_connections 2023-11-28T13:00:29.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.356+0000 7f63de90e700 1 -- 172.21.15.82:0/338826160 wait complete. 2023-11-28T13:00:29.361 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 7 2023-11-28T13:00:29.372 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:00:29.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.472+0000 7fccb508e700 1 Processor -- start 2023-11-28T13:00:29.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.472+0000 7fccb508e700 1 -- start start 2023-11-28T13:00:29.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccb508e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fccb0070070 0x7fccb0070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:29.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccb508e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fccb0160900 0x7fccb00cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccb508e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb0070980 con 0x7fccb00c1910 2023-11-28T13:00:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccb508e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb00ce030 con 0x7fccb0160900 2023-11-28T13:00:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccb508e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb00ce310 con 0x7fccb0070070 2023-11-28T13:00:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccaf7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fccb0160900 0x7fccb00cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccaf7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fccb0160900 0x7fccb00cc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57300/0 (socket says 172.21.15.82:57300) 2023-11-28T13:00:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccaf7fe700 1 -- 172.21.15.82:0/1972528790 learned_addr learned my addr 172.21.15.82:0/1972528790 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccaffff700 1 --2- 172.21.15.82:0/1972528790 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fccb0070070 0x7fccb0070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccaf7fe700 1 -- 172.21.15.82:0/1972528790 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fccb0070070 msgr2=0x7fccb0070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccaf7fe700 1 --2- 172.21.15.82:0/1972528790 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fccb0070070 0x7fccb0070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccaf7fe700 1 -- 172.21.15.82:0/1972528790 >> v1:172.21.15.114:6789/0 conn(0x7fccb00c1910 legacy=0x7fccb01641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccaf7fe700 1 -- 172.21.15.82:0/1972528790 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb006a5d0 con 0x7fccb0160900 2023-11-28T13:00:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccaf7fe700 1 --2- 172.21.15.82:0/1972528790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb0160900 0x7fccb00cc1d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009910 tx=0x7fcca0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8009c16900ccf23b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccaeffd700 1 -- 172.21.15.82:0/1972528790 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca000ba60 con 0x7fccb0160900 2023-11-28T13:00:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccaeffd700 1 -- 172.21.15.82:0/1972528790 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca000bbc0 con 0x7fccb0160900 2023-11-28T13:00:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccaeffd700 1 -- 172.21.15.82:0/1972528790 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca0009e60 con 0x7fccb0160900 2023-11-28T13:00:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccb508e700 1 -- 172.21.15.82:0/1972528790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb0160900 msgr2=0x7fccb00cc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccb508e700 1 --2- 172.21.15.82:0/1972528790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb0160900 0x7fccb00cc1d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009910 tx=0x7fcca0009c20 comp rx=0 tx=0).stop 2023-11-28T13:00:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccb508e700 1 -- 172.21.15.82:0/1972528790 shutdown_connections 2023-11-28T13:00:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccb508e700 1 --2- 172.21.15.82:0/1972528790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb0160900 0x7fccb00cc1d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccb508e700 1 --2- 172.21.15.82:0/1972528790 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fccb0070070 0x7fccb0070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccb508e700 1 -- 172.21.15.82:0/1972528790 >> 172.21.15.82:0/1972528790 conn(0x7fccb00ce600 msgr2=0x7fccb00ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccb508e700 1 -- 172.21.15.82:0/1972528790 shutdown_connections 2023-11-28T13:00:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.476+0000 7fccb508e700 1 -- 172.21.15.82:0/1972528790 wait complete. 2023-11-28T13:00:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccb508e700 1 Processor -- start 2023-11-28T13:00:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccb508e700 1 -- start start 2023-11-28T13:00:29.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccb508e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb0070070 0x7fccb00c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:29.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccb508e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccb00c32b0 0x7fccb00c3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:29.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccb508e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fccb00c7f20 0x7fccb00c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:29.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccb508e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb00c3d00 con 0x7fccb0070070 2023-11-28T13:00:29.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccb508e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb00c3fe0 con 0x7fccb00c32b0 2023-11-28T13:00:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccb508e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb00c42c0 con 0x7fccb00c7f20 2023-11-28T13:00:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccaffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb0070070 0x7fccb00c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccaffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb0070070 0x7fccb00c5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57306/0 (socket says 172.21.15.82:57306) 2023-11-28T13:00:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccaffff700 1 -- 172.21.15.82:0/2424299507 learned_addr learned my addr 172.21.15.82:0/2424299507 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccaf7fe700 1 --2- 172.21.15.82:0/2424299507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccb00c32b0 0x7fccb00c3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccb488d700 1 --2- 172.21.15.82:0/2424299507 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fccb00c7f20 0x7fccb00c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccaffff700 1 -- 172.21.15.82:0/2424299507 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fccb00c7f20 msgr2=0x7fccb00c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccaffff700 1 --2- 172.21.15.82:0/2424299507 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fccb00c7f20 0x7fccb00c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccaffff700 1 -- 172.21.15.82:0/2424299507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccb00c32b0 msgr2=0x7fccb00c3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccaffff700 1 --2- 172.21.15.82:0/2424299507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccb00c32b0 0x7fccb00c3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccaffff700 1 -- 172.21.15.82:0/2424299507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca0009570 con 0x7fccb0070070 2023-11-28T13:00:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccaffff700 1 --2- 172.21.15.82:0/2424299507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb0070070 0x7fccb00c5940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcca400d800 tx=0x7fcca400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccacff9700 1 -- 172.21.15.82:0/2424299507 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca40125f0 con 0x7fccb0070070 2023-11-28T13:00:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccacff9700 1 -- 172.21.15.82:0/2424299507 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca4012750 con 0x7fccb0070070 2023-11-28T13:00:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccb508e700 1 -- 172.21.15.82:0/2424299507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb006ab90 con 0x7fccb0070070 2023-11-28T13:00:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccacff9700 1 -- 172.21.15.82:0/2424299507 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca4012ac0 con 0x7fccb0070070 2023-11-28T13:00:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.480+0000 7fccb508e700 1 -- 172.21.15.82:0/2424299507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb006a8b0 con 0x7fccb0070070 2023-11-28T13:00:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.484+0000 7fccb508e700 1 -- 172.21.15.82:0/2424299507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb00cc710 con 0x7fccb0070070 2023-11-28T13:00:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.484+0000 7fccacff9700 1 -- 172.21.15.82:0/2424299507 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcca4012c20 con 0x7fccb0070070 2023-11-28T13:00:29.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.484+0000 7fccacff9700 1 --2- 172.21.15.82:0/2424299507 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcc9c064ee0 0x7fcc9c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:29.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.484+0000 7fccaf7fe700 1 --2- 172.21.15.82:0/2424299507 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcc9c064ee0 0x7fcc9c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:29.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.484+0000 7fccacff9700 1 -- 172.21.15.82:0/2424299507 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcca4082120 con 0x7fccb0070070 2023-11-28T13:00:29.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.484+0000 7fccaf7fe700 1 --2- 172.21.15.82:0/2424299507 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcc9c064ee0 0x7fcc9c067390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcca0000c00 tx=0x7fcca0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:29.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.492+0000 7fccacff9700 1 -- 172.21.15.82:0/2424299507 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcca40501d0 con 0x7fccb0070070 2023-11-28T13:00:29.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.656+0000 7fccb508e700 1 -- 172.21.15.82:0/2424299507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccb0065fc0 con 0x7fccb0070070 2023-11-28T13:00:29.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.660+0000 7fccacff9700 1 -- 172.21.15.82:0/2424299507 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17811 (secure 0 0 0) 0x7fcca40537f0 con 0x7fccb0070070 2023-11-28T13:00:29.664 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:29.664 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:00:26.981345+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:00:24.360641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T13:00:24.960863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:00:29.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.660+0000 7fccb508e700 1 -- 172.21.15.82:0/2424299507 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcc9c064ee0 msgr2=0x7fcc9c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:29.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.660+0000 7fccb508e700 1 --2- 172.21.15.82:0/2424299507 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcc9c064ee0 0x7fcc9c067390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcca0000c00 tx=0x7fcca0008030 comp rx=0 tx=0).stop 2023-11-28T13:00:29.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.660+0000 7fccb508e700 1 -- 172.21.15.82:0/2424299507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb0070070 msgr2=0x7fccb00c5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:29.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.660+0000 7fccb508e700 1 --2- 172.21.15.82:0/2424299507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb0070070 0x7fccb00c5940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcca400d800 tx=0x7fcca400db10 comp rx=0 tx=0).stop 2023-11-28T13:00:29.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.664+0000 7fccb508e700 1 -- 172.21.15.82:0/2424299507 shutdown_connections 2023-11-28T13:00:29.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.664+0000 7fccb508e700 1 --2- 172.21.15.82:0/2424299507 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcc9c064ee0 0x7fcc9c067390 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.664+0000 7fccb508e700 1 --2- 172.21.15.82:0/2424299507 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fccb00c7f20 0x7fccb00c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.664+0000 7fccb508e700 1 --2- 172.21.15.82:0/2424299507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccb00c32b0 0x7fccb00c3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.664+0000 7fccb508e700 1 --2- 172.21.15.82:0/2424299507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb0070070 0x7fccb00c5940 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.664+0000 7fccb508e700 1 -- 172.21.15.82:0/2424299507 >> 172.21.15.82:0/2424299507 conn(0x7fccb00ce600 msgr2=0x7fccb00b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:29.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.664+0000 7fccb508e700 1 -- 172.21.15.82:0/2424299507 shutdown_connections 2023-11-28T13:00:29.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.664+0000 7fccb508e700 1 -- 172.21.15.82:0/2424299507 wait complete. 2023-11-28T13:00:29.679 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T13:00:29.679 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:00:29.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.784+0000 7f17d742f700 1 Processor -- start 2023-11-28T13:00:29.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.784+0000 7f17d742f700 1 -- start start 2023-11-28T13:00:29.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.784+0000 7f17d742f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f17d00b3910 0x7f17d006b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:29.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.784+0000 7f17d742f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17d006c910 0x7f17d006d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:29.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.784+0000 7f17d742f700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d006c480 con 0x7f17d0070070 2023-11-28T13:00:29.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.784+0000 7f17d742f700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d006dbe0 con 0x7f17d006c910 2023-11-28T13:00:29.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.784+0000 7f17d742f700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d006dec0 con 0x7f17d00b3910 2023-11-28T13:00:29.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.784+0000 7f17d642d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f17d00b3910 0x7f17d006b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:29.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.784+0000 7f17d5c2c700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17d006c910 0x7f17d006d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:29.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.784+0000 7f17d5c2c700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17d006c910 0x7f17d006d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:50804/0 (socket says 172.21.15.82:50804) 2023-11-28T13:00:29.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.784+0000 7f17d5c2c700 1 -- 172.21.15.82:0/808632919 learned_addr learned my addr 172.21.15.82:0/808632919 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:29.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.784+0000 7f17d5c2c700 1 -- 172.21.15.82:0/808632919 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f17d00b3910 msgr2=0x7f17d006b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:29.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.784+0000 7f17d5c2c700 1 --2- 172.21.15.82:0/808632919 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f17d00b3910 0x7f17d006b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.784+0000 7f17d5c2c700 1 -- 172.21.15.82:0/808632919 >> v1:172.21.15.114:6789/0 conn(0x7f17d0070070 legacy=0x7f17d015db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:29.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.784+0000 7f17d5c2c700 1 -- 172.21.15.82:0/808632919 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d006c110 con 0x7f17d006c910 2023-11-28T13:00:29.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.788+0000 7f17d5c2c700 1 --2- 172.21.15.82:0/808632919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17d006c910 0x7f17d006d320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f17c0009910 tx=0x7f17c0009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fce1660d70643dee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:29.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.788+0000 7f17d542b700 1 -- 172.21.15.82:0/808632919 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c0011830 con 0x7f17d006c910 2023-11-28T13:00:29.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.788+0000 7f17d542b700 1 -- 172.21.15.82:0/808632919 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c0011990 con 0x7f17d006c910 2023-11-28T13:00:29.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.788+0000 7f17d542b700 1 -- 172.21.15.82:0/808632919 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c0011d40 con 0x7f17d006c910 2023-11-28T13:00:29.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.788+0000 7f17d742f700 1 -- 172.21.15.82:0/808632919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17d006c910 msgr2=0x7f17d006d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:29.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.788+0000 7f17d742f700 1 --2- 172.21.15.82:0/808632919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17d006c910 0x7f17d006d320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f17c0009910 tx=0x7f17c0009c20 comp rx=0 tx=0).stop 2023-11-28T13:00:29.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.788+0000 7f17d742f700 1 -- 172.21.15.82:0/808632919 shutdown_connections 2023-11-28T13:00:29.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.788+0000 7f17d742f700 1 --2- 172.21.15.82:0/808632919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17d006c910 0x7f17d006d320 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.788+0000 7f17d742f700 1 --2- 172.21.15.82:0/808632919 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f17d00b3910 0x7f17d006b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.788+0000 7f17d742f700 1 -- 172.21.15.82:0/808632919 >> 172.21.15.82:0/808632919 conn(0x7f17d00ce600 msgr2=0x7f17d00ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:29.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.788+0000 7f17d742f700 1 -- 172.21.15.82:0/808632919 shutdown_connections 2023-11-28T13:00:29.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.788+0000 7f17d742f700 1 -- 172.21.15.82:0/808632919 wait complete. 2023-11-28T13:00:29.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.788+0000 7f17d742f700 1 Processor -- start 2023-11-28T13:00:29.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.788+0000 7f17d742f700 1 -- start start 2023-11-28T13:00:29.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17d742f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17d006c910 0x7f17d01466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:29.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17d742f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17d0070070 0x7f17d01f11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:29.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17d742f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f17d00b3910 0x7f17d00acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:29.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17d742f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d01f16e0 con 0x7f17d006c910 2023-11-28T13:00:29.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17d742f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d00ad2a0 con 0x7f17d0070070 2023-11-28T13:00:29.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17d742f700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d0148a80 con 0x7f17d00b3910 2023-11-28T13:00:29.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17d642d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17d006c910 0x7f17d01466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:29.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17d642d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17d006c910 0x7f17d01466a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57308/0 (socket says 172.21.15.82:57308) 2023-11-28T13:00:29.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17d642d700 1 -- 172.21.15.82:0/1165868632 learned_addr learned my addr 172.21.15.82:0/1165868632 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:29.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17d5c2c700 1 --2- 172.21.15.82:0/1165868632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17d0070070 0x7f17d01f11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:29.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17d6c2e700 1 --2- 172.21.15.82:0/1165868632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f17d00b3910 0x7f17d00acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:29.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17d642d700 1 -- 172.21.15.82:0/1165868632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f17d00b3910 msgr2=0x7f17d00acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:29.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17d642d700 1 --2- 172.21.15.82:0/1165868632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f17d00b3910 0x7f17d00acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17d642d700 1 -- 172.21.15.82:0/1165868632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17d0070070 msgr2=0x7f17d01f11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:29.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17d642d700 1 --2- 172.21.15.82:0/1165868632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17d0070070 0x7f17d01f11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17d642d700 1 -- 172.21.15.82:0/1165868632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c0009570 con 0x7f17d006c910 2023-11-28T13:00:29.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17d642d700 1 --2- 172.21.15.82:0/1165868632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17d006c910 0x7f17d01466a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f17cc00e9d0 tx=0x7f17cc00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:29.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17c6ffd700 1 -- 172.21.15.82:0/1165868632 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc009720 con 0x7f17d006c910 2023-11-28T13:00:29.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17c6ffd700 1 -- 172.21.15.82:0/1165868632 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17cc00ee70 con 0x7f17d006c910 2023-11-28T13:00:29.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17d742f700 1 -- 172.21.15.82:0/1165868632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d006d860 con 0x7f17d006c910 2023-11-28T13:00:29.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17c6ffd700 1 -- 172.21.15.82:0/1165868632 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc00ca50 con 0x7f17d006c910 2023-11-28T13:00:29.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17d742f700 1 -- 172.21.15.82:0/1165868632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d00c8f80 con 0x7f17d006c910 2023-11-28T13:00:29.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.792+0000 7f17d742f700 1 -- 172.21.15.82:0/1165868632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d00b3ce0 con 0x7f17d006c910 2023-11-28T13:00:29.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.796+0000 7f17c6ffd700 1 -- 172.21.15.82:0/1165868632 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f17cc019030 con 0x7f17d006c910 2023-11-28T13:00:29.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.796+0000 7f17c6ffd700 1 --2- 172.21.15.82:0/1165868632 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f17b4064f10 0x7f17b40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:29.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.796+0000 7f17c6ffd700 1 -- 172.21.15.82:0/1165868632 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f17cc0825b0 con 0x7f17d006c910 2023-11-28T13:00:29.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.796+0000 7f17d5c2c700 1 --2- 172.21.15.82:0/1165868632 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f17b4064f10 0x7f17b40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:29.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.796+0000 7f17d5c2c700 1 --2- 172.21.15.82:0/1165868632 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f17b4064f10 0x7f17b40673c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f17c0009c60 tx=0x7f17c0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:29.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.800+0000 7f17c6ffd700 1 -- 172.21.15.82:0/1165868632 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f17cc0506e0 con 0x7f17d006c910 2023-11-28T13:00:29.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.960+0000 7f17d742f700 1 -- 172.21.15.82:0/1165868632 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17d0065fc0 con 0x7f17b4064f10 2023-11-28T13:00:29.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.976+0000 7f17c6ffd700 1 -- 172.21.15.82:0/1165868632 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271854 (secure 0 0 0) 0x7f17d0065fc0 con 0x7f17b4064f10 2023-11-28T13:00:29.984 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:29.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.980+0000 7f17d742f700 1 -- 172.21.15.82:0/1165868632 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f17b4064f10 msgr2=0x7f17b40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:29.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.980+0000 7f17d742f700 1 --2- 172.21.15.82:0/1165868632 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f17b4064f10 0x7f17b40673c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f17c0009c60 tx=0x7f17c0008030 comp rx=0 tx=0).stop 2023-11-28T13:00:29.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.980+0000 7f17d742f700 1 -- 172.21.15.82:0/1165868632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17d006c910 msgr2=0x7f17d01466a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:29.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.980+0000 7f17d742f700 1 --2- 172.21.15.82:0/1165868632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17d006c910 0x7f17d01466a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f17cc00e9d0 tx=0x7f17cc00ece0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.980+0000 7f17d742f700 1 -- 172.21.15.82:0/1165868632 shutdown_connections 2023-11-28T13:00:29.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.980+0000 7f17d742f700 1 --2- 172.21.15.82:0/1165868632 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f17b4064f10 0x7f17b40673c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.980+0000 7f17d742f700 1 --2- 172.21.15.82:0/1165868632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f17d00b3910 0x7f17d00acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.980+0000 7f17d742f700 1 --2- 172.21.15.82:0/1165868632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17d0070070 0x7f17d01f11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.980+0000 7f17d742f700 1 --2- 172.21.15.82:0/1165868632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17d006c910 0x7f17d01466a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:29.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.980+0000 7f17d742f700 1 -- 172.21.15.82:0/1165868632 >> 172.21.15.82:0/1165868632 conn(0x7f17d00ce600 msgr2=0x7f17d00b2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:29.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.980+0000 7f17d742f700 1 -- 172.21.15.82:0/1165868632 shutdown_connections 2023-11-28T13:00:29.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:29.980+0000 7f17d742f700 1 -- 172.21.15.82:0/1165868632 wait complete. 2023-11-28T13:00:29.989 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:00:30.000 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-28T13:00:29.156185+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":64776,"kb_used_data":2760,"kb_used_omap":0,"kb_used_meta":61952,"kb_avail":754909944,"statfs":{"total":773094113280,"available":773027782656,"internally_reserved":0,"allocated":2826240,"data_stored":1722328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":63438848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.564047"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T13:00:21.453234+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:00:21.453234+0000","last_peered":"2023-11-28T13:00:21.453234+0000","last_clean":"2023-11-28T13:00:21.453234+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:00:21.453234+0000","last_undegraded":"2023-11-28T13:00:21.453234+0000","last_fullsized":"2023-11-28T13:00:21.453234+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.899658+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:00:22.899658+0000","last_peered":"2023-11-28T13:00:22.899658+0000","last_clean":"2023-11-28T13:00:22.899658+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:00:22.899658+0000","last_undegraded":"2023-11-28T13:00:22.899658+0000","last_fullsized":"2023-11-28T13:00:22.899658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.464037+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:00:22.464037+0000","last_peered":"2023-11-28T13:00:22.464037+0000","last_clean":"2023-11-28T13:00:22.464037+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:00:22.464037+0000","last_undegraded":"2023-11-28T13:00:22.464037+0000","last_fullsized":"2023-11-28T13:00:22.464037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.899243+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:00:22.899243+0000","last_peered":"2023-11-28T13:00:22.899243+0000","last_clean":"2023-11-28T13:00:22.899243+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:00:22.899243+0000","last_undegraded":"2023-11-28T13:00:22.899243+0000","last_fullsized":"2023-11-28T13:00:22.899243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.899571+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:00:22.899571+0000","last_peered":"2023-11-28T13:00:22.899571+0000","last_clean":"2023-11-28T13:00:22.899571+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:00:22.899571+0000","last_undegraded":"2023-11-28T13:00:22.899571+0000","last_fullsized":"2023-11-28T13:00:22.899571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.464971+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:00:22.464971+0000","last_peered":"2023-11-28T13:00:22.464971+0000","last_clean":"2023-11-28T13:00:22.464971+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:00:22.464971+0000","last_undegraded":"2023-11-28T13:00:22.464971+0000","last_fullsized":"2023-11-28T13:00:22.464971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.464073+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:00:22.464073+0000","last_peered":"2023-11-28T13:00:22.464073+0000","last_clean":"2023-11-28T13:00:22.464073+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:00:22.464073+0000","last_undegraded":"2023-11-28T13:00:22.464073+0000","last_fullsized":"2023-11-28T13:00:22.464073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.464971+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:00:22.464971+0000","last_peered":"2023-11-28T13:00:22.464971+0000","last_clean":"2023-11-28T13:00:22.464971+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:00:22.464971+0000","last_undegraded":"2023-11-28T13:00:22.464971+0000","last_fullsized":"2023-11-28T13:00:22.464971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.710246+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:00:22.710246+0000","last_peered":"2023-11-28T13:00:22.710246+0000","last_clean":"2023-11-28T13:00:22.710246+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:00:22.710246+0000","last_undegraded":"2023-11-28T13:00:22.710246+0000","last_fullsized":"2023-11-28T13:00:22.710246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8916,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94362924,"statfs":{"total":96636764160,"available":96627634176,"internally_reserved":0,"allocated":798720,"data_stored":658067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8916,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94362924,"statfs":{"total":96636764160,"available":96627634176,"internally_reserved":0,"allocated":798720,"data_stored":658067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:00:30.007 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:00:30.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.116+0000 7f53e1699700 1 Processor -- start 2023-11-28T13:00:30.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.116+0000 7f53e1699700 1 -- start start 2023-11-28T13:00:30.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53e1699700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f53dc0cca60 0x7f53dc0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:30.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53e1699700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f53dc06a4e0 0x7f53dc06a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:30.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53e1699700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53dc156630 con 0x7f53dc0b1490 2023-11-28T13:00:30.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53e1699700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53dc15cfc0 con 0x7f53dc06a4e0 2023-11-28T13:00:30.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53e1699700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc0cd370 con 0x7f53dc0cca60 2023-11-28T13:00:30.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53e0e98700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f53dc06a4e0 0x7f53dc06a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:30.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53e0e98700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f53dc06a4e0 0x7f53dc06a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57316/0 (socket says 172.21.15.82:57316) 2023-11-28T13:00:30.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53e0e98700 1 -- 172.21.15.82:0/1637339975 learned_addr learned my addr 172.21.15.82:0/1637339975 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:30.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53dbfff700 1 --2- 172.21.15.82:0/1637339975 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f53dc0cca60 0x7f53dc0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:30.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53e0e98700 1 -- 172.21.15.82:0/1637339975 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f53dc0cca60 msgr2=0x7f53dc0cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:30.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53e0e98700 1 --2- 172.21.15.82:0/1637339975 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f53dc0cca60 0x7f53dc0cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53e0e98700 1 -- 172.21.15.82:0/1637339975 >> v1:172.21.15.114:6789/0 conn(0x7f53dc0b1490 legacy=0x7f53dc159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:30.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53e0e98700 1 -- 172.21.15.82:0/1637339975 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc15c340 con 0x7f53dc06a4e0 2023-11-28T13:00:30.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53e0e98700 1 --2- 172.21.15.82:0/1637339975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc06a4e0 0x7f53dc06a930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009e50 tx=0x7f53d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591e9bb46c8886b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:30.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53daffd700 1 -- 172.21.15.82:0/1637339975 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d400e070 con 0x7f53dc06a4e0 2023-11-28T13:00:30.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53daffd700 1 -- 172.21.15.82:0/1637339975 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d400b910 con 0x7f53dc06a4e0 2023-11-28T13:00:30.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53daffd700 1 -- 172.21.15.82:0/1637339975 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d400bcc0 con 0x7f53dc06a4e0 2023-11-28T13:00:30.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53e1699700 1 -- 172.21.15.82:0/1637339975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc06a4e0 msgr2=0x7f53dc06a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:30.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53e1699700 1 --2- 172.21.15.82:0/1637339975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc06a4e0 0x7f53dc06a930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009e50 tx=0x7f53d400b330 comp rx=0 tx=0).stop 2023-11-28T13:00:30.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53e1699700 1 -- 172.21.15.82:0/1637339975 shutdown_connections 2023-11-28T13:00:30.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53e1699700 1 --2- 172.21.15.82:0/1637339975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc06a4e0 0x7f53dc06a930 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53e1699700 1 --2- 172.21.15.82:0/1637339975 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f53dc0cca60 0x7f53dc0cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53e1699700 1 -- 172.21.15.82:0/1637339975 >> 172.21.15.82:0/1637339975 conn(0x7f53dc0cfb20 msgr2=0x7f53dc0b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:30.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53e1699700 1 -- 172.21.15.82:0/1637339975 shutdown_connections 2023-11-28T13:00:30.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.120+0000 7f53e1699700 1 -- 172.21.15.82:0/1637339975 wait complete. 2023-11-28T13:00:30.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53e1699700 1 Processor -- start 2023-11-28T13:00:30.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53e1699700 1 -- start start 2023-11-28T13:00:30.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53e1699700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53dc06a4e0 0x7f53dc148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:30.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53e1699700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc0b1490 0x7f53dc0c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:30.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53e1699700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f53dc0cca60 0x7f53dc06a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:30.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53e1699700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc0c59a0 con 0x7f53dc0b1490 2023-11-28T13:00:30.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53e1699700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc0b3ed0 con 0x7f53dc06a4e0 2023-11-28T13:00:30.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53e1699700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc0b4120 con 0x7f53dc0cca60 2023-11-28T13:00:30.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53db7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc0b1490 0x7f53dc0c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:30.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53db7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc0b1490 0x7f53dc0c5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57324/0 (socket says 172.21.15.82:57324) 2023-11-28T13:00:30.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53db7fe700 1 -- 172.21.15.82:0/136247952 learned_addr learned my addr 172.21.15.82:0/136247952 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:30.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53e0e98700 1 --2- 172.21.15.82:0/136247952 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f53dc0cca60 0x7f53dc06a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:30.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53dbfff700 1 --2- 172.21.15.82:0/136247952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53dc06a4e0 0x7f53dc148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:30.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53db7fe700 1 -- 172.21.15.82:0/136247952 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f53dc0cca60 msgr2=0x7f53dc06a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:30.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53db7fe700 1 --2- 172.21.15.82:0/136247952 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f53dc0cca60 0x7f53dc06a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53db7fe700 1 -- 172.21.15.82:0/136247952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53dc06a4e0 msgr2=0x7f53dc148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:30.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53db7fe700 1 --2- 172.21.15.82:0/136247952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53dc06a4e0 0x7f53dc148550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53db7fe700 1 -- 172.21.15.82:0/136247952 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d4009b30 con 0x7f53dc0b1490 2023-11-28T13:00:30.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53dbfff700 1 --2- 172.21.15.82:0/136247952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53dc06a4e0 0x7f53dc148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53e0e98700 1 --2- 172.21.15.82:0/136247952 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f53dc0cca60 0x7f53dc06a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53db7fe700 1 --2- 172.21.15.82:0/136247952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc0b1490 0x7f53dc0c5460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f53d000c500 tx=0x7f53d000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53d8ff9700 1 -- 172.21.15.82:0/136247952 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d00052d0 con 0x7f53dc0b1490 2023-11-28T13:00:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53d8ff9700 1 -- 172.21.15.82:0/136247952 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d0005430 con 0x7f53dc0b1490 2023-11-28T13:00:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53e1699700 1 -- 172.21.15.82:0/136247952 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53dc15c900 con 0x7f53dc0b1490 2023-11-28T13:00:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53d8ff9700 1 -- 172.21.15.82:0/136247952 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d00055a0 con 0x7f53dc0b1490 2023-11-28T13:00:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53e1699700 1 -- 172.21.15.82:0/136247952 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53dc15c620 con 0x7f53dc0b1490 2023-11-28T13:00:30.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.124+0000 7f53e1699700 1 -- 172.21.15.82:0/136247952 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53dc15cbe0 con 0x7f53dc0b1490 2023-11-28T13:00:30.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.128+0000 7f53d8ff9700 1 -- 172.21.15.82:0/136247952 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f53d0019030 con 0x7f53dc0b1490 2023-11-28T13:00:30.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.128+0000 7f53d8ff9700 1 --2- 172.21.15.82:0/136247952 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f53c8064ee0 0x7f53c8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:30.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.128+0000 7f53dbfff700 1 --2- 172.21.15.82:0/136247952 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f53c8064ee0 0x7f53c8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:30.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.128+0000 7f53d8ff9700 1 -- 172.21.15.82:0/136247952 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53d0081290 con 0x7f53dc0b1490 2023-11-28T13:00:30.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.128+0000 7f53dbfff700 1 --2- 172.21.15.82:0/136247952 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f53c8064ee0 0x7f53c8067390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f53dc0c8ce0 tx=0x7f53cc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:30.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.136+0000 7f53d8ff9700 1 -- 172.21.15.82:0/136247952 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f53d004f430 con 0x7f53dc0b1490 2023-11-28T13:00:30.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.292+0000 7f53e1699700 1 -- 172.21.15.82:0/136247952 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f53dc065fc0 con 0x7f53c8064ee0 2023-11-28T13:00:30.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.308+0000 7f53d8ff9700 1 -- 172.21.15.82:0/136247952 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271854 (secure 0 0 0) 0x7f53dc065fc0 con 0x7f53c8064ee0 2023-11-28T13:00:30.315 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:30.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.312+0000 7f53e1699700 1 -- 172.21.15.82:0/136247952 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f53c8064ee0 msgr2=0x7f53c8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:30.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.312+0000 7f53e1699700 1 --2- 172.21.15.82:0/136247952 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f53c8064ee0 0x7f53c8067390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f53dc0c8ce0 tx=0x7f53cc008040 comp rx=0 tx=0).stop 2023-11-28T13:00:30.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.312+0000 7f53e1699700 1 -- 172.21.15.82:0/136247952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc0b1490 msgr2=0x7f53dc0c5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:30.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.312+0000 7f53e1699700 1 --2- 172.21.15.82:0/136247952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc0b1490 0x7f53dc0c5460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f53d000c500 tx=0x7f53d000c8c0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.312+0000 7f53e1699700 1 -- 172.21.15.82:0/136247952 shutdown_connections 2023-11-28T13:00:30.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.312+0000 7f53e1699700 1 --2- 172.21.15.82:0/136247952 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f53c8064ee0 0x7f53c8067390 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.312+0000 7f53e1699700 1 --2- 172.21.15.82:0/136247952 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f53dc0cca60 0x7f53dc06a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.312+0000 7f53e1699700 1 --2- 172.21.15.82:0/136247952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc0b1490 0x7f53dc0c5460 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.312+0000 7f53e1699700 1 --2- 172.21.15.82:0/136247952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53dc06a4e0 0x7f53dc148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.312+0000 7f53e1699700 1 -- 172.21.15.82:0/136247952 >> 172.21.15.82:0/136247952 conn(0x7f53dc0cfb20 msgr2=0x7f53dc0c9810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:30.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.312+0000 7f53e1699700 1 -- 172.21.15.82:0/136247952 shutdown_connections 2023-11-28T13:00:30.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.312+0000 7f53e1699700 1 -- 172.21.15.82:0/136247952 wait complete. 2023-11-28T13:00:30.318 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:00:30.329 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-28T13:00:29.156185+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":64776,"kb_used_data":2760,"kb_used_omap":0,"kb_used_meta":61952,"kb_avail":754909944,"statfs":{"total":773094113280,"available":773027782656,"internally_reserved":0,"allocated":2826240,"data_stored":1722328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":63438848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.564047"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T13:00:21.453234+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:00:21.453234+0000","last_peered":"2023-11-28T13:00:21.453234+0000","last_clean":"2023-11-28T13:00:21.453234+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:00:21.453234+0000","last_undegraded":"2023-11-28T13:00:21.453234+0000","last_fullsized":"2023-11-28T13:00:21.453234+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.899658+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:00:22.899658+0000","last_peered":"2023-11-28T13:00:22.899658+0000","last_clean":"2023-11-28T13:00:22.899658+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:00:22.899658+0000","last_undegraded":"2023-11-28T13:00:22.899658+0000","last_fullsized":"2023-11-28T13:00:22.899658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.464037+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:00:22.464037+0000","last_peered":"2023-11-28T13:00:22.464037+0000","last_clean":"2023-11-28T13:00:22.464037+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:00:22.464037+0000","last_undegraded":"2023-11-28T13:00:22.464037+0000","last_fullsized":"2023-11-28T13:00:22.464037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.899243+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:00:22.899243+0000","last_peered":"2023-11-28T13:00:22.899243+0000","last_clean":"2023-11-28T13:00:22.899243+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:00:22.899243+0000","last_undegraded":"2023-11-28T13:00:22.899243+0000","last_fullsized":"2023-11-28T13:00:22.899243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.899571+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:00:22.899571+0000","last_peered":"2023-11-28T13:00:22.899571+0000","last_clean":"2023-11-28T13:00:22.899571+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:00:22.899571+0000","last_undegraded":"2023-11-28T13:00:22.899571+0000","last_fullsized":"2023-11-28T13:00:22.899571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.464971+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:00:22.464971+0000","last_peered":"2023-11-28T13:00:22.464971+0000","last_clean":"2023-11-28T13:00:22.464971+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:00:22.464971+0000","last_undegraded":"2023-11-28T13:00:22.464971+0000","last_fullsized":"2023-11-28T13:00:22.464971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.464073+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:00:22.464073+0000","last_peered":"2023-11-28T13:00:22.464073+0000","last_clean":"2023-11-28T13:00:22.464073+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:00:22.464073+0000","last_undegraded":"2023-11-28T13:00:22.464073+0000","last_fullsized":"2023-11-28T13:00:22.464073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.464971+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:00:22.464971+0000","last_peered":"2023-11-28T13:00:22.464971+0000","last_clean":"2023-11-28T13:00:22.464971+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:00:22.464971+0000","last_undegraded":"2023-11-28T13:00:22.464971+0000","last_fullsized":"2023-11-28T13:00:22.464971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.710246+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:00:22.710246+0000","last_peered":"2023-11-28T13:00:22.710246+0000","last_clean":"2023-11-28T13:00:22.710246+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:00:22.710246+0000","last_undegraded":"2023-11-28T13:00:22.710246+0000","last_fullsized":"2023-11-28T13:00:22.710246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8916,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94362924,"statfs":{"total":96636764160,"available":96627634176,"internally_reserved":0,"allocated":798720,"data_stored":658067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8916,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94362924,"statfs":{"total":96636764160,"available":96627634176,"internally_reserved":0,"allocated":798720,"data_stored":658067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:00:30.333 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:00:30.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb1982700 1 Processor -- start 2023-11-28T13:00:30.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb1982700 1 -- start start 2023-11-28T13:00:30.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb1982700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3cac160380 0x7f3cac06d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:30.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb1982700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3cac070e40 0x7f3cac069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:30.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb1982700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cac06d780 con 0x7f3cac160750 2023-11-28T13:00:30.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb1982700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cac0cd070 con 0x7f3cac160380 2023-11-28T13:00:30.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb1982700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac0cec90 con 0x7f3cac070e40 2023-11-28T13:00:30.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb0980700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3cac160380 0x7f3cac06d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:30.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb0980700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3cac160380 0x7f3cac06d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57328/0 (socket says 172.21.15.82:57328) 2023-11-28T13:00:30.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb0980700 1 -- 172.21.15.82:0/885971661 learned_addr learned my addr 172.21.15.82:0/885971661 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:30.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb1181700 1 --2- 172.21.15.82:0/885971661 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3cac070e40 0x7f3cac069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:30.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb0980700 1 -- 172.21.15.82:0/885971661 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3cac070e40 msgr2=0x7f3cac069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:30.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb0980700 1 --2- 172.21.15.82:0/885971661 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3cac070e40 0x7f3cac069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb0980700 1 -- 172.21.15.82:0/885971661 >> v1:172.21.15.114:6789/0 conn(0x7f3cac160750 legacy=0x7f3cac070730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:30.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb0980700 1 -- 172.21.15.82:0/885971661 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac0ccaf0 con 0x7f3cac160380 2023-11-28T13:00:30.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb1181700 1 --2- 172.21.15.82:0/885971661 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3cac070e40 0x7f3cac069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:30.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb0980700 1 --2- 172.21.15.82:0/885971661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cac160380 0x7f3cac06d240 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c009940 tx=0x7f3c9c009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc02bb6bbee67bd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:30.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cab7fe700 1 -- 172.21.15.82:0/885971661 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c00ba20 con 0x7f3cac160380 2023-11-28T13:00:30.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cab7fe700 1 -- 172.21.15.82:0/885971661 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c009e90 con 0x7f3cac160380 2023-11-28T13:00:30.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cab7fe700 1 -- 172.21.15.82:0/885971661 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c00bda0 con 0x7f3cac160380 2023-11-28T13:00:30.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb1982700 1 -- 172.21.15.82:0/885971661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cac160380 msgr2=0x7f3cac06d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:30.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb1982700 1 --2- 172.21.15.82:0/885971661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cac160380 0x7f3cac06d240 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c009940 tx=0x7f3c9c009c50 comp rx=0 tx=0).stop 2023-11-28T13:00:30.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb1982700 1 -- 172.21.15.82:0/885971661 shutdown_connections 2023-11-28T13:00:30.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb1982700 1 --2- 172.21.15.82:0/885971661 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3cac070e40 0x7f3cac069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb1982700 1 --2- 172.21.15.82:0/885971661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cac160380 0x7f3cac06d240 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb1982700 1 -- 172.21.15.82:0/885971661 >> 172.21.15.82:0/885971661 conn(0x7f3cac0cb890 msgr2=0x7f3cac0cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:30.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb1982700 1 -- 172.21.15.82:0/885971661 shutdown_connections 2023-11-28T13:00:30.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.444+0000 7f3cb1982700 1 -- 172.21.15.82:0/885971661 wait complete. 2023-11-28T13:00:30.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.448+0000 7f3cb1982700 1 Processor -- start 2023-11-28T13:00:30.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.448+0000 7f3cb1982700 1 -- start start 2023-11-28T13:00:30.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.448+0000 7f3cb1982700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3cac070e40 0x7f3cac0bd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:30.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.448+0000 7f3cb1982700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cac160380 0x7f3cac15c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:30.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.448+0000 7f3cb1982700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cac160750 0x7f3cac1584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:30.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.448+0000 7f3cb1982700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac0b4180 con 0x7f3cac160750 2023-11-28T13:00:30.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.448+0000 7f3cb1982700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac0b37e0 con 0x7f3cac160380 2023-11-28T13:00:30.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.448+0000 7f3cb1982700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac0b3ac0 con 0x7f3cac070e40 2023-11-28T13:00:30.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.448+0000 7f3cb1181700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cac160750 0x7f3cac1584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:30.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.448+0000 7f3cb1181700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cac160750 0x7f3cac1584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57336/0 (socket says 172.21.15.82:57336) 2023-11-28T13:00:30.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.448+0000 7f3cb1181700 1 -- 172.21.15.82:0/2311415036 learned_addr learned my addr 172.21.15.82:0/2311415036 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:30.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.448+0000 7f3cabfff700 1 --2- 172.21.15.82:0/2311415036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cac160380 0x7f3cac15c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:30.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.448+0000 7f3cb0980700 1 --2- 172.21.15.82:0/2311415036 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3cac070e40 0x7f3cac0bd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:30.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.452+0000 7f3cb1181700 1 -- 172.21.15.82:0/2311415036 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3cac070e40 msgr2=0x7f3cac0bd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:30.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.452+0000 7f3cb1181700 1 --2- 172.21.15.82:0/2311415036 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3cac070e40 0x7f3cac0bd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.452+0000 7f3cb1181700 1 -- 172.21.15.82:0/2311415036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cac160380 msgr2=0x7f3cac15c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:30.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.452+0000 7f3cb1181700 1 --2- 172.21.15.82:0/2311415036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cac160380 0x7f3cac15c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.452+0000 7f3cb1181700 1 -- 172.21.15.82:0/2311415036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9c009570 con 0x7f3cac160750 2023-11-28T13:00:30.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.452+0000 7f3cb1181700 1 --2- 172.21.15.82:0/2311415036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cac160750 0x7f3cac1584d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400e7e0 tx=0x7f3c9400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:30.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.452+0000 7f3ca97fa700 1 -- 172.21.15.82:0/2311415036 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9400c070 con 0x7f3cac160750 2023-11-28T13:00:30.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.452+0000 7f3ca97fa700 1 -- 172.21.15.82:0/2311415036 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c94004230 con 0x7f3cac160750 2023-11-28T13:00:30.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.452+0000 7f3ca97fa700 1 -- 172.21.15.82:0/2311415036 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c940045a0 con 0x7f3cac160750 2023-11-28T13:00:30.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.452+0000 7f3cb1982700 1 -- 172.21.15.82:0/2311415036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cac0ccd90 con 0x7f3cac160750 2023-11-28T13:00:30.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.452+0000 7f3cb1982700 1 -- 172.21.15.82:0/2311415036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cac0ce9b0 con 0x7f3cac160750 2023-11-28T13:00:30.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.452+0000 7f3cb1982700 1 -- 172.21.15.82:0/2311415036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cac0719f0 con 0x7f3cac160750 2023-11-28T13:00:30.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.452+0000 7f3ca97fa700 1 -- 172.21.15.82:0/2311415036 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3c94019020 con 0x7f3cac160750 2023-11-28T13:00:30.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.452+0000 7f3ca97fa700 1 --2- 172.21.15.82:0/2311415036 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3c8c064ee0 0x7f3c8c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:30.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.456+0000 7f3cb0980700 1 --2- 172.21.15.82:0/2311415036 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3c8c064ee0 0x7f3c8c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:30.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.456+0000 7f3ca97fa700 1 -- 172.21.15.82:0/2311415036 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3c94081c00 con 0x7f3cac160750 2023-11-28T13:00:30.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.456+0000 7f3cb0980700 1 --2- 172.21.15.82:0/2311415036 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3c8c064ee0 0x7f3c8c067390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c000c00 tx=0x7f3c9c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:30.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.460+0000 7f3ca97fa700 1 -- 172.21.15.82:0/2311415036 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3c9404fc30 con 0x7f3cac160750 2023-11-28T13:00:30.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.620+0000 7f3cb1982700 1 -- 172.21.15.82:0/2311415036 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3cac0b42c0 con 0x7f3c8c064ee0 2023-11-28T13:00:30.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.636+0000 7f3ca97fa700 1 -- 172.21.15.82:0/2311415036 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271854 (secure 0 0 0) 0x7f3cac0b42c0 con 0x7f3c8c064ee0 2023-11-28T13:00:30.643 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:30.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.640+0000 7f3cb1982700 1 -- 172.21.15.82:0/2311415036 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3c8c064ee0 msgr2=0x7f3c8c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:30.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.640+0000 7f3cb1982700 1 --2- 172.21.15.82:0/2311415036 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3c8c064ee0 0x7f3c8c067390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c000c00 tx=0x7f3c9c008030 comp rx=0 tx=0).stop 2023-11-28T13:00:30.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.640+0000 7f3cb1982700 1 -- 172.21.15.82:0/2311415036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cac160750 msgr2=0x7f3cac1584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:30.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.640+0000 7f3cb1982700 1 --2- 172.21.15.82:0/2311415036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cac160750 0x7f3cac1584d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400e7e0 tx=0x7f3c9400eaf0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.640+0000 7f3cb1982700 1 -- 172.21.15.82:0/2311415036 shutdown_connections 2023-11-28T13:00:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.640+0000 7f3cb1982700 1 --2- 172.21.15.82:0/2311415036 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3c8c064ee0 0x7f3c8c067390 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.640+0000 7f3cb1982700 1 --2- 172.21.15.82:0/2311415036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cac160750 0x7f3cac1584d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.640+0000 7f3cb1982700 1 --2- 172.21.15.82:0/2311415036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cac160380 0x7f3cac15c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.640+0000 7f3cb1982700 1 --2- 172.21.15.82:0/2311415036 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3cac070e40 0x7f3cac0bd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.640+0000 7f3cb1982700 1 -- 172.21.15.82:0/2311415036 >> 172.21.15.82:0/2311415036 conn(0x7f3cac0cb890 msgr2=0x7f3cac1632f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.640+0000 7f3cb1982700 1 -- 172.21.15.82:0/2311415036 shutdown_connections 2023-11-28T13:00:30.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.640+0000 7f3cb1982700 1 -- 172.21.15.82:0/2311415036 wait complete. 2023-11-28T13:00:30.648 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:00:30.663 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-28T13:00:29.156185+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":64776,"kb_used_data":2760,"kb_used_omap":0,"kb_used_meta":61952,"kb_avail":754909944,"statfs":{"total":773094113280,"available":773027782656,"internally_reserved":0,"allocated":2826240,"data_stored":1722328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":63438848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.564047"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T13:00:21.453234+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:00:21.453234+0000","last_peered":"2023-11-28T13:00:21.453234+0000","last_clean":"2023-11-28T13:00:21.453234+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:00:21.453234+0000","last_undegraded":"2023-11-28T13:00:21.453234+0000","last_fullsized":"2023-11-28T13:00:21.453234+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.899658+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:00:22.899658+0000","last_peered":"2023-11-28T13:00:22.899658+0000","last_clean":"2023-11-28T13:00:22.899658+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:00:22.899658+0000","last_undegraded":"2023-11-28T13:00:22.899658+0000","last_fullsized":"2023-11-28T13:00:22.899658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.464037+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:00:22.464037+0000","last_peered":"2023-11-28T13:00:22.464037+0000","last_clean":"2023-11-28T13:00:22.464037+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:00:22.464037+0000","last_undegraded":"2023-11-28T13:00:22.464037+0000","last_fullsized":"2023-11-28T13:00:22.464037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.899243+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:00:22.899243+0000","last_peered":"2023-11-28T13:00:22.899243+0000","last_clean":"2023-11-28T13:00:22.899243+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:00:22.899243+0000","last_undegraded":"2023-11-28T13:00:22.899243+0000","last_fullsized":"2023-11-28T13:00:22.899243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.899571+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:00:22.899571+0000","last_peered":"2023-11-28T13:00:22.899571+0000","last_clean":"2023-11-28T13:00:22.899571+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:00:22.899571+0000","last_undegraded":"2023-11-28T13:00:22.899571+0000","last_fullsized":"2023-11-28T13:00:22.899571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.464971+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:00:22.464971+0000","last_peered":"2023-11-28T13:00:22.464971+0000","last_clean":"2023-11-28T13:00:22.464971+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:00:22.464971+0000","last_undegraded":"2023-11-28T13:00:22.464971+0000","last_fullsized":"2023-11-28T13:00:22.464971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.464073+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:00:22.464073+0000","last_peered":"2023-11-28T13:00:22.464073+0000","last_clean":"2023-11-28T13:00:22.464073+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:00:22.464073+0000","last_undegraded":"2023-11-28T13:00:22.464073+0000","last_fullsized":"2023-11-28T13:00:22.464073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.464971+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:00:22.464971+0000","last_peered":"2023-11-28T13:00:22.464971+0000","last_clean":"2023-11-28T13:00:22.464971+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:00:22.464971+0000","last_undegraded":"2023-11-28T13:00:22.464971+0000","last_fullsized":"2023-11-28T13:00:22.464971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T13:00:22.710246+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:00:22.710246+0000","last_peered":"2023-11-28T13:00:22.710246+0000","last_clean":"2023-11-28T13:00:22.710246+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:00:22.710246+0000","last_undegraded":"2023-11-28T13:00:22.710246+0000","last_fullsized":"2023-11-28T13:00:22.710246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:25.590548+0000","last_change":"2023-11-28T13:00:25.590548+0000","last_active":"2023-11-28T13:00:25.590548+0000","last_peered":"2023-11-28T13:00:25.590548+0000","last_clean":"2023-11-28T13:00:25.590548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:25.590548+0000","last_undegraded":"2023-11-28T13:00:25.590548+0000","last_fullsized":"2023-11-28T13:00:25.590548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:00:24.575857+0000","last_change":"2023-11-28T13:00:24.575857+0000","last_active":"2023-11-28T13:00:24.575857+0000","last_peered":"2023-11-28T13:00:24.575857+0000","last_clean":"2023-11-28T13:00:24.575857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:00:24.575857+0000","last_undegraded":"2023-11-28T13:00:24.575857+0000","last_fullsized":"2023-11-28T13:00:24.575857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8916,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94362924,"statfs":{"total":96636764160,"available":96627634176,"internally_reserved":0,"allocated":798720,"data_stored":658067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7824,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364016,"statfs":{"total":96636764160,"available":96628752384,"internally_reserved":0,"allocated":204800,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8916,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94362924,"statfs":{"total":96636764160,"available":96627634176,"internally_reserved":0,"allocated":798720,"data_stored":658067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:00:30.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2023-11-28T13:00:30.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2023-11-28T13:00:30.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2023-11-28T13:00:30.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2023-11-28T13:00:30.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2023-11-28T13:00:30.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2023-11-28T13:00:30.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2023-11-28T13:00:30.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2023-11-28T13:00:30.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2023-11-28T13:00:30.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2023-11-28T13:00:30.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2023-11-28T13:00:30.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2023-11-28T13:00:30.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2023-11-28T13:00:30.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2023-11-28T13:00:30.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2023-11-28T13:00:30.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2023-11-28T13:00:30.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2023-11-28T13:00:30.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2023-11-28T13:00:30.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2023-11-28T13:00:30.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2023-11-28T13:00:30.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2023-11-28T13:00:30.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2023-11-28T13:00:30.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2023-11-28T13:00:30.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2023-11-28T13:00:30.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2023-11-28T13:00:30.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2023-11-28T13:00:30.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2023-11-28T13:00:30.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2023-11-28T13:00:30.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2023-11-28T13:00:30.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2023-11-28T13:00:30.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2023-11-28T13:00:30.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2023-11-28T13:00:30.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-11-28T13:00:30.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-11-28T13:00:30.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-11-28T13:00:30.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-11-28T13:00:30.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-11-28T13:00:30.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-11-28T13:00:30.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-11-28T13:00:30.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-11-28T13:00:30.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-11-28T13:00:30.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-11-28T13:00:30.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-11-28T13:00:30.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-11-28T13:00:30.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-11-28T13:00:30.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-11-28T13:00:30.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-11-28T13:00:30.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-11-28T13:00:30.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-11-28T13:00:30.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-11-28T13:00:30.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-11-28T13:00:30.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-11-28T13:00:30.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-11-28T13:00:30.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-11-28T13:00:30.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-11-28T13:00:30.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-11-28T13:00:30.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-11-28T13:00:30.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-11-28T13:00:30.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-11-28T13:00:30.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-11-28T13:00:30.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-11-28T13:00:30.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-11-28T13:00:30.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-11-28T13:00:30.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-11-28T13:00:30.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-11-28T13:00:30.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-11-28T13:00:30.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-11-28T13:00:30.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-11-28T13:00:30.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-11-28T13:00:30.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-11-28T13:00:30.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-11-28T13:00:30.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-11-28T13:00:30.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-11-28T13:00:30.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-11-28T13:00:30.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-11-28T13:00:30.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-11-28T13:00:30.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-11-28T13:00:30.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-11-28T13:00:30.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-11-28T13:00:30.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-11-28T13:00:30.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-11-28T13:00:30.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-11-28T13:00:30.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-11-28T13:00:30.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-11-28T13:00:30.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-11-28T13:00:30.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-11-28T13:00:30.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-11-28T13:00:30.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-11-28T13:00:30.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-11-28T13:00:30.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-11-28T13:00:30.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-11-28T13:00:30.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-11-28T13:00:30.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-11-28T13:00:30.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-11-28T13:00:30.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-11-28T13:00:30.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:25.590548+0000', 'last_change': '2023-11-28T13:00:25.590548+0000', 'last_active': '2023-11-28T13:00:25.590548+0000', 'last_peered': '2023-11-28T13:00:25.590548+0000', 'last_clean': '2023-11-28T13:00:25.590548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:25.590548+0000', 'last_undegraded': '2023-11-28T13:00:25.590548+0000', 'last_fullsized': '2023-11-28T13:00:25.590548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:25.590548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-11-28T13:00:30.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:00:24.575857+0000', 'last_change': '2023-11-28T13:00:24.575857+0000', 'last_active': '2023-11-28T13:00:24.575857+0000', 'last_peered': '2023-11-28T13:00:24.575857+0000', 'last_clean': '2023-11-28T13:00:24.575857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:00:24.575857+0000', 'last_undegraded': '2023-11-28T13:00:24.575857+0000', 'last_fullsized': '2023-11-28T13:00:24.575857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'last_clean_scrub_stamp': '2023-11-28T13:00:24.575857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:00:30.693 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T13:00:30.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.800+0000 7f58ba204700 1 Processor -- start 2023-11-28T13:00:30.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.800+0000 7f58ba204700 1 -- start start 2023-11-28T13:00:30.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58ba204700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f58b40b6140 0x7f58b40afb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:30.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58ba204700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f58b415b6e0 0x7f58b40d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:30.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58ba204700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58b415c820 con 0x7f58b415a580 2023-11-28T13:00:30.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58ba204700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b40cb240 con 0x7f58b40b6140 2023-11-28T13:00:30.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58ba204700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b40b0050 con 0x7f58b415b6e0 2023-11-28T13:00:30.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58b9202700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f58b40b6140 0x7f58b40afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:30.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58b9202700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f58b40b6140 0x7f58b40afb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57348/0 (socket says 172.21.15.82:57348) 2023-11-28T13:00:30.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58b9202700 1 -- 172.21.15.82:0/3864600166 learned_addr learned my addr 172.21.15.82:0/3864600166 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:30.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58b8a01700 1 --2- 172.21.15.82:0/3864600166 >> v2:172.21.15.114:3300/0 conn(0x7f58b415b6e0 0x7f58b40d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:30.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58b9202700 1 -- 172.21.15.82:0/3864600166 >> v2:172.21.15.114:3300/0 conn(0x7f58b415b6e0 msgr2=0x7f58b40d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:30.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58b9202700 1 --2- 172.21.15.82:0/3864600166 >> v2:172.21.15.114:3300/0 conn(0x7f58b415b6e0 0x7f58b40d0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58b9202700 1 -- 172.21.15.82:0/3864600166 >> v1:172.21.15.114:6789/0 conn(0x7f58b415a580 legacy=0x7f58b415a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:30.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58b9202700 1 -- 172.21.15.82:0/3864600166 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b40d1480 con 0x7f58b40b6140 2023-11-28T13:00:30.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58b9202700 1 --2- 172.21.15.82:0/3864600166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b40b6140 0x7f58b40afb10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f58a4009910 tx=0x7f58a4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f9113b05d27ceb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:30.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58abfff700 1 -- 172.21.15.82:0/3864600166 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a4011830 con 0x7f58b40b6140 2023-11-28T13:00:30.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58abfff700 1 -- 172.21.15.82:0/3864600166 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a4011990 con 0x7f58b40b6140 2023-11-28T13:00:30.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58abfff700 1 -- 172.21.15.82:0/3864600166 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a4011d40 con 0x7f58b40b6140 2023-11-28T13:00:30.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58ba204700 1 -- 172.21.15.82:0/3864600166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b40b6140 msgr2=0x7f58b40afb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:30.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58ba204700 1 --2- 172.21.15.82:0/3864600166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b40b6140 0x7f58b40afb10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f58a4009910 tx=0x7f58a4009c20 comp rx=0 tx=0).stop 2023-11-28T13:00:30.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58ba204700 1 -- 172.21.15.82:0/3864600166 shutdown_connections 2023-11-28T13:00:30.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58ba204700 1 --2- 172.21.15.82:0/3864600166 >> v2:172.21.15.114:3300/0 conn(0x7f58b415b6e0 0x7f58b40d0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58ba204700 1 --2- 172.21.15.82:0/3864600166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b40b6140 0x7f58b40afb10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58ba204700 1 -- 172.21.15.82:0/3864600166 >> 172.21.15.82:0/3864600166 conn(0x7f58b40cdf40 msgr2=0x7f58b40d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:30.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.804+0000 7f58ba204700 1 -- 172.21.15.82:0/3864600166 shutdown_connections 2023-11-28T13:00:30.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.808+0000 7f58ba204700 1 -- 172.21.15.82:0/3864600166 wait complete. 2023-11-28T13:00:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.808+0000 7f58ba204700 1 Processor -- start 2023-11-28T13:00:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.808+0000 7f58ba204700 1 -- start start 2023-11-28T13:00:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58ba204700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b40b6140 0x7f58b40ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58ba204700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58b415a580 0x7f58b4158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58ba204700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b415b6e0 0x7f58b40c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58ba204700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b40c8150 con 0x7f58b40b6140 2023-11-28T13:00:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58ba204700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b40cfc80 con 0x7f58b415b6e0 2023-11-28T13:00:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58ba204700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b41589a0 con 0x7f58b415a580 2023-11-28T13:00:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58b9202700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b40b6140 0x7f58b40ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58b9202700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b40b6140 0x7f58b40ca450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57362/0 (socket says 172.21.15.82:57362) 2023-11-28T13:00:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58b9202700 1 -- 172.21.15.82:0/3356490326 learned_addr learned my addr 172.21.15.82:0/3356490326 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58b8a01700 1 --2- 172.21.15.82:0/3356490326 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58b415a580 0x7f58b4158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58b9a03700 1 --2- 172.21.15.82:0/3356490326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b415b6e0 0x7f58b40c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:30.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58b9202700 1 -- 172.21.15.82:0/3356490326 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58b415a580 msgr2=0x7f58b4158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58b9202700 1 --2- 172.21.15.82:0/3356490326 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58b415a580 0x7f58b4158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58b9202700 1 -- 172.21.15.82:0/3356490326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b415b6e0 msgr2=0x7f58b40c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58b9202700 1 --2- 172.21.15.82:0/3356490326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b415b6e0 0x7f58b40c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58b9202700 1 -- 172.21.15.82:0/3356490326 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a4009570 con 0x7f58b40b6140 2023-11-28T13:00:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58b9202700 1 --2- 172.21.15.82:0/3356490326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b40b6140 0x7f58b40ca450 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f58a4014040 tx=0x7f58a4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58a9ffb700 1 -- 172.21.15.82:0/3356490326 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a4004510 con 0x7f58b40b6140 2023-11-28T13:00:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58a9ffb700 1 -- 172.21.15.82:0/3356490326 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a401e070 con 0x7f58b40b6140 2023-11-28T13:00:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58ba204700 1 -- 172.21.15.82:0/3356490326 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b415bef0 con 0x7f58b40b6140 2023-11-28T13:00:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58a9ffb700 1 -- 172.21.15.82:0/3356490326 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a4003900 con 0x7f58b40b6140 2023-11-28T13:00:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58ba204700 1 -- 172.21.15.82:0/3356490326 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b415bc10 con 0x7f58b40b6140 2023-11-28T13:00:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.812+0000 7f58ba204700 1 -- 172.21.15.82:0/3356490326 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b415c1d0 con 0x7f58b40b6140 2023-11-28T13:00:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.816+0000 7f58a9ffb700 1 -- 172.21.15.82:0/3356490326 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f58a402a020 con 0x7f58b40b6140 2023-11-28T13:00:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.816+0000 7f58a9ffb700 1 --2- 172.21.15.82:0/3356490326 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5898064ee0 0x7f5898067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.816+0000 7f58b8a01700 1 --2- 172.21.15.82:0/3356490326 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5898064ee0 0x7f5898067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.816+0000 7f58a9ffb700 1 -- 172.21.15.82:0/3356490326 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f58a4082d90 con 0x7f58b40b6140 2023-11-28T13:00:30.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.816+0000 7f58b8a01700 1 --2- 172.21.15.82:0/3356490326 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5898064ee0 0x7f5898067390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f58b40b57c0 tx=0x7f58b0009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:30.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:30.824+0000 7f58a9ffb700 1 -- 172.21.15.82:0/3356490326 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f58a4050ff0 con 0x7f58b40b6140 2023-11-28T13:00:31.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.044+0000 7f58ba204700 1 -- 172.21.15.82:0/3356490326 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f58b4065fc0 con 0x7f58b40b6140 2023-11-28T13:00:31.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.048+0000 7f58a9ffb700 1 -- 172.21.15.82:0/3356490326 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1020 (secure 0 0 0) 0x7f58a4054610 con 0x7f58b40b6140 2023-11-28T13:00:31.050 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:31.050 INFO:teuthology.orchestra.run.smithi082.stdout:{"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":24,"num_osds":8,"num_up_osds":8,"osd_up_since":1701176413,"num_in_osds":8,"osd_in_since":1701176404,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":66330624,"bytes_avail":773027782656,"bytes_total":773094113280,"unknown_pgs_ratio":0.91428571939468384},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4314}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-11-28T13:00:01.868374+0000","services":{}},"progress_events":{}} 2023-11-28T13:00:31.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.048+0000 7f58ba204700 1 -- 172.21.15.82:0/3356490326 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5898064ee0 msgr2=0x7f5898067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:31.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.048+0000 7f58ba204700 1 --2- 172.21.15.82:0/3356490326 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5898064ee0 0x7f5898067390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f58b40b57c0 tx=0x7f58b0009240 comp rx=0 tx=0).stop 2023-11-28T13:00:31.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.048+0000 7f58ba204700 1 -- 172.21.15.82:0/3356490326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b40b6140 msgr2=0x7f58b40ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:31.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.048+0000 7f58ba204700 1 --2- 172.21.15.82:0/3356490326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b40b6140 0x7f58b40ca450 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f58a4014040 tx=0x7f58a4004770 comp rx=0 tx=0).stop 2023-11-28T13:00:31.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.048+0000 7f58ba204700 1 -- 172.21.15.82:0/3356490326 shutdown_connections 2023-11-28T13:00:31.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.048+0000 7f58ba204700 1 --2- 172.21.15.82:0/3356490326 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5898064ee0 0x7f5898067390 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:31.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.048+0000 7f58ba204700 1 --2- 172.21.15.82:0/3356490326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b415b6e0 0x7f58b40c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:31.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.048+0000 7f58ba204700 1 --2- 172.21.15.82:0/3356490326 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58b415a580 0x7f58b4158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:31.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.048+0000 7f58ba204700 1 --2- 172.21.15.82:0/3356490326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58b40b6140 0x7f58b40ca450 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:31.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.048+0000 7f58ba204700 1 -- 172.21.15.82:0/3356490326 >> 172.21.15.82:0/3356490326 conn(0x7f58b40cdf40 msgr2=0x7f58b41591b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:31.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.048+0000 7f58ba204700 1 -- 172.21.15.82:0/3356490326 shutdown_connections 2023-11-28T13:00:31.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.052+0000 7f58ba204700 1 -- 172.21.15.82:0/3356490326 wait complete. 2023-11-28T13:00:31.071 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T13:00:31.072 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:00:31.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.176+0000 7fe05dd8f700 1 Processor -- start 2023-11-28T13:00:31.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.176+0000 7fe05dd8f700 1 -- start start 2023-11-28T13:00:31.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05dd8f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0580c93d0 0x7fe058070730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:31.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05dd8f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe058070c70 0x7fe05806ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:31.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05dd8f700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05806a9d0 con 0x7fe058158760 2023-11-28T13:00:31.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05dd8f700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe058071110 con 0x7fe058070c70 2023-11-28T13:00:31.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05dd8f700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05806a450 con 0x7fe0580c93d0 2023-11-28T13:00:31.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05d58e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe058070c70 0x7fe05806ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:31.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05d58e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe058070c70 0x7fe05806ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:50858/0 (socket says 172.21.15.82:50858) 2023-11-28T13:00:31.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05d58e700 1 -- 172.21.15.82:0/2235784649 learned_addr learned my addr 172.21.15.82:0/2235784649 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:31.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05cd8d700 1 --1- 172.21.15.82:0/2235784649 >> v1:172.21.15.114:6789/0 conn(0x7fe058158760 0x7fe05815c1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:35006/0 (socket says 172.21.15.82:35006) 2023-11-28T13:00:31.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe04ffff700 1 --2- 172.21.15.82:0/2235784649 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0580c93d0 0x7fe058070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:31.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05d58e700 1 -- 172.21.15.82:0/2235784649 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0580c93d0 msgr2=0x7fe058070730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:31.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05d58e700 1 --2- 172.21.15.82:0/2235784649 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0580c93d0 0x7fe058070730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:31.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05d58e700 1 -- 172.21.15.82:0/2235784649 >> v1:172.21.15.114:6789/0 conn(0x7fe058158760 legacy=0x7fe05815c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:31.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05d58e700 1 -- 172.21.15.82:0/2235784649 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05815cc50 con 0x7fe058070c70 2023-11-28T13:00:31.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe04f7fe700 1 -- 172.21.15.82:0/2235784649 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749024018 0 0) 0x7fe05806a9d0 con 0x7fe058158760 2023-11-28T13:00:31.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05d58e700 1 --2- 172.21.15.82:0/2235784649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe058070c70 0x7fe05806ae60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe05000d150 tx=0x7fe05000d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dadce91e4f3c27b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:31.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe04f7fe700 1 -- 172.21.15.82:0/2235784649 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe050010070 con 0x7fe058070c70 2023-11-28T13:00:31.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe04f7fe700 1 -- 172.21.15.82:0/2235784649 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05000db00 con 0x7fe058070c70 2023-11-28T13:00:31.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe04f7fe700 1 -- 172.21.15.82:0/2235784649 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe050016400 con 0x7fe058070c70 2023-11-28T13:00:31.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05dd8f700 1 -- 172.21.15.82:0/2235784649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe058070c70 msgr2=0x7fe05806ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:31.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05dd8f700 1 --2- 172.21.15.82:0/2235784649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe058070c70 0x7fe05806ae60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe05000d150 tx=0x7fe05000d460 comp rx=0 tx=0).stop 2023-11-28T13:00:31.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05dd8f700 1 -- 172.21.15.82:0/2235784649 shutdown_connections 2023-11-28T13:00:31.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05dd8f700 1 --2- 172.21.15.82:0/2235784649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe058070c70 0x7fe05806ae60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:31.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05dd8f700 1 --2- 172.21.15.82:0/2235784649 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0580c93d0 0x7fe058070730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:31.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05dd8f700 1 -- 172.21.15.82:0/2235784649 >> 172.21.15.82:0/2235784649 conn(0x7fe0580cb890 msgr2=0x7fe0580cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:31.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05dd8f700 1 -- 172.21.15.82:0/2235784649 shutdown_connections 2023-11-28T13:00:31.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.180+0000 7fe05dd8f700 1 -- 172.21.15.82:0/2235784649 wait complete. 2023-11-28T13:00:31.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.184+0000 7fe05dd8f700 1 Processor -- start 2023-11-28T13:00:31.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.184+0000 7fe05dd8f700 1 -- start start 2023-11-28T13:00:31.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.184+0000 7fe05dd8f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe058070c70 0x7fe05814b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:31.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.184+0000 7fe05dd8f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0580c93d0 0x7fe058156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.184+0000 7fe05dd8f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe058158760 0x7fe058156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.184+0000 7fe05dd8f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0581e28c0 con 0x7fe058158760 2023-11-28T13:00:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.184+0000 7fe05dd8f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0580adc80 con 0x7fe058070c70 2023-11-28T13:00:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.184+0000 7fe05dd8f700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0581e1f20 con 0x7fe0580c93d0 2023-11-28T13:00:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.184+0000 7fe05d58e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe058158760 0x7fe058156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.184+0000 7fe05d58e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe058158760 0x7fe058156c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57374/0 (socket says 172.21.15.82:57374) 2023-11-28T13:00:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.184+0000 7fe05d58e700 1 -- 172.21.15.82:0/1192161870 learned_addr learned my addr 172.21.15.82:0/1192161870 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.184+0000 7fe04ffff700 1 --2- 172.21.15.82:0/1192161870 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0580c93d0 0x7fe058156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.184+0000 7fe05cd8d700 1 --2- 172.21.15.82:0/1192161870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe058070c70 0x7fe05814b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:31.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.184+0000 7fe05d58e700 1 -- 172.21.15.82:0/1192161870 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0580c93d0 msgr2=0x7fe058156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:31.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.184+0000 7fe05d58e700 1 --2- 172.21.15.82:0/1192161870 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0580c93d0 0x7fe058156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:31.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.184+0000 7fe05d58e700 1 -- 172.21.15.82:0/1192161870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe058070c70 msgr2=0x7fe05814b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:31.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.184+0000 7fe05d58e700 1 --2- 172.21.15.82:0/1192161870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe058070c70 0x7fe05814b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:31.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.184+0000 7fe05d58e700 1 -- 172.21.15.82:0/1192161870 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05000bd40 con 0x7fe058158760 2023-11-28T13:00:31.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.184+0000 7fe05cd8d700 1 --2- 172.21.15.82:0/1192161870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe058070c70 0x7fe05814b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:31.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.184+0000 7fe05d58e700 1 --2- 172.21.15.82:0/1192161870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe058158760 0x7fe058156c50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe05806ff60 tx=0x7fe050004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:31.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.188+0000 7fe04d7fa700 1 -- 172.21.15.82:0/1192161870 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe050017640 con 0x7fe058158760 2023-11-28T13:00:31.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.188+0000 7fe04d7fa700 1 -- 172.21.15.82:0/1192161870 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0500177c0 con 0x7fe058158760 2023-11-28T13:00:31.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.188+0000 7fe04d7fa700 1 -- 172.21.15.82:0/1192161870 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe050017b70 con 0x7fe058158760 2023-11-28T13:00:31.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.188+0000 7fe05dd8f700 1 -- 172.21.15.82:0/1192161870 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05806a660 con 0x7fe058158760 2023-11-28T13:00:31.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.188+0000 7fe05dd8f700 1 -- 172.21.15.82:0/1192161870 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05815cf30 con 0x7fe058158760 2023-11-28T13:00:31.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.188+0000 7fe05dd8f700 1 -- 172.21.15.82:0/1192161870 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0580cb510 con 0x7fe058158760 2023-11-28T13:00:31.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.188+0000 7fe04d7fa700 1 -- 172.21.15.82:0/1192161870 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe050014070 con 0x7fe058158760 2023-11-28T13:00:31.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.188+0000 7fe04d7fa700 1 --2- 172.21.15.82:0/1192161870 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe044064ee0 0x7fe044067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:31.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.188+0000 7fe04d7fa700 1 -- 172.21.15.82:0/1192161870 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe050083720 con 0x7fe058158760 2023-11-28T13:00:31.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.188+0000 7fe05cd8d700 1 --2- 172.21.15.82:0/1192161870 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe044064ee0 0x7fe044067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:31.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.188+0000 7fe05cd8d700 1 --2- 172.21.15.82:0/1192161870 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe044064ee0 0x7fe044067390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe054000f60 tx=0x7fe054007cc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:31.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.196+0000 7fe04d7fa700 1 -- 172.21.15.82:0/1192161870 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe050051840 con 0x7fe058158760 2023-11-28T13:00:31.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.352+0000 7fe05dd8f700 1 -- 172.21.15.82:0/1192161870 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0581e2a00 con 0x7fe044064ee0 2023-11-28T13:00:31.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.368+0000 7fe04d7fa700 1 -- 172.21.15.82:0/1192161870 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286494 (secure 0 0 0) 0x7fe0581e2a00 con 0x7fe044064ee0 2023-11-28T13:00:31.376 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:31.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.372+0000 7fe05dd8f700 1 -- 172.21.15.82:0/1192161870 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe044064ee0 msgr2=0x7fe044067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:31.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.372+0000 7fe05dd8f700 1 --2- 172.21.15.82:0/1192161870 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe044064ee0 0x7fe044067390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe054000f60 tx=0x7fe054007cc0 comp rx=0 tx=0).stop 2023-11-28T13:00:31.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.372+0000 7fe05dd8f700 1 -- 172.21.15.82:0/1192161870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe058158760 msgr2=0x7fe058156c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:31.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.372+0000 7fe05dd8f700 1 --2- 172.21.15.82:0/1192161870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe058158760 0x7fe058156c50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe05806ff60 tx=0x7fe050004af0 comp rx=0 tx=0).stop 2023-11-28T13:00:31.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.376+0000 7fe05dd8f700 1 -- 172.21.15.82:0/1192161870 shutdown_connections 2023-11-28T13:00:31.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.376+0000 7fe05dd8f700 1 --2- 172.21.15.82:0/1192161870 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe044064ee0 0x7fe044067390 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:31.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.376+0000 7fe05dd8f700 1 --2- 172.21.15.82:0/1192161870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe058158760 0x7fe058156c50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:31.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.376+0000 7fe05dd8f700 1 --2- 172.21.15.82:0/1192161870 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0580c93d0 0x7fe058156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:31.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.376+0000 7fe05dd8f700 1 --2- 172.21.15.82:0/1192161870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe058070c70 0x7fe05814b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:31.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.376+0000 7fe05dd8f700 1 -- 172.21.15.82:0/1192161870 >> 172.21.15.82:0/1192161870 conn(0x7fe0580cb890 msgr2=0x7fe058152620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:31.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.376+0000 7fe05dd8f700 1 -- 172.21.15.82:0/1192161870 shutdown_connections 2023-11-28T13:00:31.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:31.376+0000 7fe05dd8f700 1 -- 172.21.15.82:0/1192161870 wait complete. 2023-11-28T13:00:31.381 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:00:31.393 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-11-28T13:00:31.156637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66440,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":63168,"kb_avail":754908280,"statfs":{"total":773094113280,"available":773026078720,"internally_reserved":0,"allocated":3284992,"data_stored":1939556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64684032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001603"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.987630+0000","last_change":"2023-11-28T13:00:26.016426+0000","last_active":"2023-11-28T13:00:26.987630+0000","last_peered":"2023-11-28T13:00:26.987630+0000","last_clean":"2023-11-28T13:00:26.987630+0000","last_became_active":"2023-11-28T13:00:26.016109+0000","last_became_peered":"2023-11-28T13:00:26.016109+0000","last_unstale":"2023-11-28T13:00:26.987630+0000","last_undegraded":"2023-11-28T13:00:26.987630+0000","last_fullsized":"2023-11-28T13:00:26.987630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:16.748872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229500+0000","last_change":"2023-11-28T13:00:26.000097+0000","last_active":"2023-11-28T13:00:27.229500+0000","last_peered":"2023-11-28T13:00:27.229500+0000","last_clean":"2023-11-28T13:00:27.229500+0000","last_became_active":"2023-11-28T13:00:25.999819+0000","last_became_peered":"2023-11-28T13:00:25.999819+0000","last_unstale":"2023-11-28T13:00:27.229500+0000","last_undegraded":"2023-11-28T13:00:27.229500+0000","last_fullsized":"2023-11-28T13:00:27.229500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:12:32.057680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503805+0000","last_change":"2023-11-28T13:00:26.005315+0000","last_active":"2023-11-28T13:00:27.503805+0000","last_peered":"2023-11-28T13:00:27.503805+0000","last_clean":"2023-11-28T13:00:27.503805+0000","last_became_active":"2023-11-28T13:00:26.005022+0000","last_became_peered":"2023-11-28T13:00:26.005022+0000","last_unstale":"2023-11-28T13:00:27.503805+0000","last_undegraded":"2023-11-28T13:00:27.503805+0000","last_fullsized":"2023-11-28T13:00:27.503805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:21.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.993695+0000","last_change":"2023-11-28T13:00:26.009786+0000","last_active":"2023-11-28T13:00:26.993695+0000","last_peered":"2023-11-28T13:00:26.993695+0000","last_clean":"2023-11-28T13:00:26.993695+0000","last_became_active":"2023-11-28T13:00:26.008695+0000","last_became_peered":"2023-11-28T13:00:26.008695+0000","last_unstale":"2023-11-28T13:00:26.993695+0000","last_undegraded":"2023-11-28T13:00:26.993695+0000","last_fullsized":"2023-11-28T13:00:26.993695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:10.041488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503641+0000","last_change":"2023-11-28T13:00:26.016418+0000","last_active":"2023-11-28T13:00:27.503641+0000","last_peered":"2023-11-28T13:00:27.503641+0000","last_clean":"2023-11-28T13:00:27.503641+0000","last_became_active":"2023-11-28T13:00:26.016147+0000","last_became_peered":"2023-11-28T13:00:26.016147+0000","last_unstale":"2023-11-28T13:00:27.503641+0000","last_undegraded":"2023-11-28T13:00:27.503641+0000","last_fullsized":"2023-11-28T13:00:27.503641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502901+0000","last_change":"2023-11-28T13:00:26.006186+0000","last_active":"2023-11-28T13:00:27.502901+0000","last_peered":"2023-11-28T13:00:27.502901+0000","last_clean":"2023-11-28T13:00:27.502901+0000","last_became_active":"2023-11-28T13:00:26.005834+0000","last_became_peered":"2023-11-28T13:00:26.005834+0000","last_unstale":"2023-11-28T13:00:27.502901+0000","last_undegraded":"2023-11-28T13:00:27.502901+0000","last_fullsized":"2023-11-28T13:00:27.502901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:58.267291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991447+0000","last_change":"2023-11-28T13:00:26.012909+0000","last_active":"2023-11-28T13:00:26.991447+0000","last_peered":"2023-11-28T13:00:26.991447+0000","last_clean":"2023-11-28T13:00:26.991447+0000","last_became_active":"2023-11-28T13:00:26.012340+0000","last_became_peered":"2023-11-28T13:00:26.012340+0000","last_unstale":"2023-11-28T13:00:26.991447+0000","last_undegraded":"2023-11-28T13:00:26.991447+0000","last_fullsized":"2023-11-28T13:00:26.991447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.228880+0000","last_change":"2023-11-28T13:00:26.011119+0000","last_active":"2023-11-28T13:00:27.228880+0000","last_peered":"2023-11-28T13:00:27.228880+0000","last_clean":"2023-11-28T13:00:27.228880+0000","last_became_active":"2023-11-28T13:00:26.010841+0000","last_became_peered":"2023-11-28T13:00:26.010841+0000","last_unstale":"2023-11-28T13:00:27.228880+0000","last_undegraded":"2023-11-28T13:00:27.228880+0000","last_fullsized":"2023-11-28T13:00:27.228880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:39.083550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503676+0000","last_change":"2023-11-28T13:00:26.016674+0000","last_active":"2023-11-28T13:00:27.503676+0000","last_peered":"2023-11-28T13:00:27.503676+0000","last_clean":"2023-11-28T13:00:27.503676+0000","last_became_active":"2023-11-28T13:00:26.016188+0000","last_became_peered":"2023-11-28T13:00:26.016188+0000","last_unstale":"2023-11-28T13:00:27.503676+0000","last_undegraded":"2023-11-28T13:00:27.503676+0000","last_fullsized":"2023-11-28T13:00:27.503676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229491+0000","last_change":"2023-11-28T13:00:26.002162+0000","last_active":"2023-11-28T13:00:27.229491+0000","last_peered":"2023-11-28T13:00:27.229491+0000","last_clean":"2023-11-28T13:00:27.229491+0000","last_became_active":"2023-11-28T13:00:26.001726+0000","last_became_peered":"2023-11-28T13:00:26.001726+0000","last_unstale":"2023-11-28T13:00:27.229491+0000","last_undegraded":"2023-11-28T13:00:27.229491+0000","last_fullsized":"2023-11-28T13:00:27.229491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503832+0000","last_change":"2023-11-28T13:00:26.005292+0000","last_active":"2023-11-28T13:00:27.503832+0000","last_peered":"2023-11-28T13:00:27.503832+0000","last_clean":"2023-11-28T13:00:27.503832+0000","last_became_active":"2023-11-28T13:00:26.004797+0000","last_became_peered":"2023-11-28T13:00:26.004797+0000","last_unstale":"2023-11-28T13:00:27.503832+0000","last_undegraded":"2023-11-28T13:00:27.503832+0000","last_fullsized":"2023-11-28T13:00:27.503832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:27:02.277619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.987674+0000","last_change":"2023-11-28T13:00:26.007946+0000","last_active":"2023-11-28T13:00:26.987674+0000","last_peered":"2023-11-28T13:00:26.987674+0000","last_clean":"2023-11-28T13:00:26.987674+0000","last_became_active":"2023-11-28T13:00:26.007680+0000","last_became_peered":"2023-11-28T13:00:26.007680+0000","last_unstale":"2023-11-28T13:00:26.987674+0000","last_undegraded":"2023-11-28T13:00:26.987674+0000","last_fullsized":"2023-11-28T13:00:26.987674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:56:22.863111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.987252+0000","last_change":"2023-11-28T13:00:26.016340+0000","last_active":"2023-11-28T13:00:26.987252+0000","last_peered":"2023-11-28T13:00:26.987252+0000","last_clean":"2023-11-28T13:00:26.987252+0000","last_became_active":"2023-11-28T13:00:26.016050+0000","last_became_peered":"2023-11-28T13:00:26.016050+0000","last_unstale":"2023-11-28T13:00:26.987252+0000","last_undegraded":"2023-11-28T13:00:26.987252+0000","last_fullsized":"2023-11-28T13:00:26.987252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:06:48.016881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229021+0000","last_change":"2023-11-28T13:00:26.002242+0000","last_active":"2023-11-28T13:00:27.229021+0000","last_peered":"2023-11-28T13:00:27.229021+0000","last_clean":"2023-11-28T13:00:27.229021+0000","last_became_active":"2023-11-28T13:00:26.001119+0000","last_became_peered":"2023-11-28T13:00:26.001119+0000","last_unstale":"2023-11-28T13:00:27.229021+0000","last_undegraded":"2023-11-28T13:00:27.229021+0000","last_fullsized":"2023-11-28T13:00:27.229021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:21.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991681+0000","last_change":"2023-11-28T13:00:26.013151+0000","last_active":"2023-11-28T13:00:26.991681+0000","last_peered":"2023-11-28T13:00:26.991681+0000","last_clean":"2023-11-28T13:00:26.991681+0000","last_became_active":"2023-11-28T13:00:26.012729+0000","last_became_peered":"2023-11-28T13:00:26.012729+0000","last_unstale":"2023-11-28T13:00:26.991681+0000","last_undegraded":"2023-11-28T13:00:26.991681+0000","last_fullsized":"2023-11-28T13:00:26.991681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502676+0000","last_change":"2023-11-28T13:00:26.006151+0000","last_active":"2023-11-28T13:00:27.502676+0000","last_peered":"2023-11-28T13:00:27.502676+0000","last_clean":"2023-11-28T13:00:27.502676+0000","last_became_active":"2023-11-28T13:00:26.005850+0000","last_became_peered":"2023-11-28T13:00:26.005850+0000","last_unstale":"2023-11-28T13:00:27.502676+0000","last_undegraded":"2023-11-28T13:00:27.502676+0000","last_fullsized":"2023-11-28T13:00:27.502676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:18:46.140210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503909+0000","last_change":"2023-11-28T13:00:26.016811+0000","last_active":"2023-11-28T13:00:27.503909+0000","last_peered":"2023-11-28T13:00:27.503909+0000","last_clean":"2023-11-28T13:00:27.503909+0000","last_became_active":"2023-11-28T13:00:26.016486+0000","last_became_peered":"2023-11-28T13:00:26.016486+0000","last_unstale":"2023-11-28T13:00:27.503909+0000","last_undegraded":"2023-11-28T13:00:27.503909+0000","last_fullsized":"2023-11-28T13:00:27.503909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:47.321386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503787+0000","last_change":"2023-11-28T13:00:26.004579+0000","last_active":"2023-11-28T13:00:27.503787+0000","last_peered":"2023-11-28T13:00:27.503787+0000","last_clean":"2023-11-28T13:00:27.503787+0000","last_became_active":"2023-11-28T13:00:26.004222+0000","last_became_peered":"2023-11-28T13:00:26.004222+0000","last_unstale":"2023-11-28T13:00:27.503787+0000","last_undegraded":"2023-11-28T13:00:27.503787+0000","last_fullsized":"2023-11-28T13:00:27.503787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.987435+0000","last_change":"2023-11-28T13:00:26.009984+0000","last_active":"2023-11-28T13:00:26.987435+0000","last_peered":"2023-11-28T13:00:26.987435+0000","last_clean":"2023-11-28T13:00:26.987435+0000","last_became_active":"2023-11-28T13:00:26.009719+0000","last_became_peered":"2023-11-28T13:00:26.009719+0000","last_unstale":"2023-11-28T13:00:26.987435+0000","last_undegraded":"2023-11-28T13:00:26.987435+0000","last_fullsized":"2023-11-28T13:00:26.987435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:32:20.224728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503408+0000","last_change":"2023-11-28T13:00:26.015275+0000","last_active":"2023-11-28T13:00:27.503408+0000","last_peered":"2023-11-28T13:00:27.503408+0000","last_clean":"2023-11-28T13:00:27.503408+0000","last_became_active":"2023-11-28T13:00:26.014423+0000","last_became_peered":"2023-11-28T13:00:26.014423+0000","last_unstale":"2023-11-28T13:00:27.503408+0000","last_undegraded":"2023-11-28T13:00:27.503408+0000","last_fullsized":"2023-11-28T13:00:27.503408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:18:51.214695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991515+0000","last_change":"2023-11-28T13:00:26.015493+0000","last_active":"2023-11-28T13:00:26.991515+0000","last_peered":"2023-11-28T13:00:26.991515+0000","last_clean":"2023-11-28T13:00:26.991515+0000","last_became_active":"2023-11-28T13:00:26.015224+0000","last_became_peered":"2023-11-28T13:00:26.015224+0000","last_unstale":"2023-11-28T13:00:26.991515+0000","last_undegraded":"2023-11-28T13:00:26.991515+0000","last_fullsized":"2023-11-28T13:00:26.991515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:48.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503142+0000","last_change":"2023-11-28T13:00:26.004946+0000","last_active":"2023-11-28T13:00:27.503142+0000","last_peered":"2023-11-28T13:00:27.503142+0000","last_clean":"2023-11-28T13:00:27.503142+0000","last_became_active":"2023-11-28T13:00:26.004689+0000","last_became_peered":"2023-11-28T13:00:26.004689+0000","last_unstale":"2023-11-28T13:00:27.503142+0000","last_undegraded":"2023-11-28T13:00:27.503142+0000","last_fullsized":"2023-11-28T13:00:27.503142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:12:32.057680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402655+0000","last_change":"2023-11-28T13:00:26.003184+0000","last_active":"2023-11-28T13:00:27.402655+0000","last_peered":"2023-11-28T13:00:27.402655+0000","last_clean":"2023-11-28T13:00:27.402655+0000","last_became_active":"2023-11-28T13:00:25.997059+0000","last_became_peered":"2023-11-28T13:00:25.997059+0000","last_unstale":"2023-11-28T13:00:27.402655+0000","last_undegraded":"2023-11-28T13:00:27.402655+0000","last_fullsized":"2023-11-28T13:00:27.402655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991146+0000","last_change":"2023-11-28T13:00:26.015820+0000","last_active":"2023-11-28T13:00:26.991146+0000","last_peered":"2023-11-28T13:00:26.991146+0000","last_clean":"2023-11-28T13:00:26.991146+0000","last_became_active":"2023-11-28T13:00:26.015570+0000","last_became_peered":"2023-11-28T13:00:26.015570+0000","last_unstale":"2023-11-28T13:00:26.991146+0000","last_undegraded":"2023-11-28T13:00:26.991146+0000","last_fullsized":"2023-11-28T13:00:26.991146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:12:32.057680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505383+0000","last_change":"2023-11-28T13:00:26.010807+0000","last_active":"2023-11-28T13:00:27.505383+0000","last_peered":"2023-11-28T13:00:27.505383+0000","last_clean":"2023-11-28T13:00:27.505383+0000","last_became_active":"2023-11-28T13:00:26.010530+0000","last_became_peered":"2023-11-28T13:00:26.010530+0000","last_unstale":"2023-11-28T13:00:27.505383+0000","last_undegraded":"2023-11-28T13:00:27.505383+0000","last_fullsized":"2023-11-28T13:00:27.505383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:39.083550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505576+0000","last_change":"2023-11-28T13:00:26.002933+0000","last_active":"2023-11-28T13:00:27.505576+0000","last_peered":"2023-11-28T13:00:27.505576+0000","last_clean":"2023-11-28T13:00:27.505576+0000","last_became_active":"2023-11-28T13:00:26.002663+0000","last_became_peered":"2023-11-28T13:00:26.002663+0000","last_unstale":"2023-11-28T13:00:27.505576+0000","last_undegraded":"2023-11-28T13:00:27.505576+0000","last_fullsized":"2023-11-28T13:00:27.505576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:47.321386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229310+0000","last_change":"2023-11-28T13:00:26.012470+0000","last_active":"2023-11-28T13:00:27.229310+0000","last_peered":"2023-11-28T13:00:27.229310+0000","last_clean":"2023-11-28T13:00:27.229310+0000","last_became_active":"2023-11-28T13:00:26.012130+0000","last_became_peered":"2023-11-28T13:00:26.012130+0000","last_unstale":"2023-11-28T13:00:27.229310+0000","last_undegraded":"2023-11-28T13:00:27.229310+0000","last_fullsized":"2023-11-28T13:00:27.229310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:48.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504421+0000","last_change":"2023-11-28T13:00:26.014609+0000","last_active":"2023-11-28T13:00:27.504421+0000","last_peered":"2023-11-28T13:00:27.504421+0000","last_clean":"2023-11-28T13:00:27.504421+0000","last_became_active":"2023-11-28T13:00:26.014274+0000","last_became_peered":"2023-11-28T13:00:26.014274+0000","last_unstale":"2023-11-28T13:00:27.504421+0000","last_undegraded":"2023-11-28T13:00:27.504421+0000","last_fullsized":"2023-11-28T13:00:27.504421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:50.093176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403447+0000","last_change":"2023-11-28T13:00:26.015284+0000","last_active":"2023-11-28T13:00:27.403447+0000","last_peered":"2023-11-28T13:00:27.403447+0000","last_clean":"2023-11-28T13:00:27.403447+0000","last_became_active":"2023-11-28T13:00:26.015015+0000","last_became_peered":"2023-11-28T13:00:26.015015+0000","last_unstale":"2023-11-28T13:00:27.403447+0000","last_undegraded":"2023-11-28T13:00:27.403447+0000","last_fullsized":"2023-11-28T13:00:27.403447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:21.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503148+0000","last_change":"2023-11-28T13:00:26.016028+0000","last_active":"2023-11-28T13:00:27.503148+0000","last_peered":"2023-11-28T13:00:27.503148+0000","last_clean":"2023-11-28T13:00:27.503148+0000","last_became_active":"2023-11-28T13:00:26.014453+0000","last_became_peered":"2023-11-28T13:00:26.014453+0000","last_unstale":"2023-11-28T13:00:27.503148+0000","last_undegraded":"2023-11-28T13:00:27.503148+0000","last_fullsized":"2023-11-28T13:00:27.503148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402712+0000","last_change":"2023-11-28T13:00:26.010119+0000","last_active":"2023-11-28T13:00:27.402712+0000","last_peered":"2023-11-28T13:00:27.402712+0000","last_clean":"2023-11-28T13:00:27.402712+0000","last_became_active":"2023-11-28T13:00:26.006633+0000","last_became_peered":"2023-11-28T13:00:26.006633+0000","last_unstale":"2023-11-28T13:00:27.402712+0000","last_undegraded":"2023-11-28T13:00:27.402712+0000","last_fullsized":"2023-11-28T13:00:27.402712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:50.521471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992755+0000","last_change":"2023-11-28T13:00:26.009650+0000","last_active":"2023-11-28T13:00:26.992755+0000","last_peered":"2023-11-28T13:00:26.992755+0000","last_clean":"2023-11-28T13:00:26.992755+0000","last_became_active":"2023-11-28T13:00:26.008418+0000","last_became_peered":"2023-11-28T13:00:26.008418+0000","last_unstale":"2023-11-28T13:00:26.992755+0000","last_undegraded":"2023-11-28T13:00:26.992755+0000","last_fullsized":"2023-11-28T13:00:26.992755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:45:08.692115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403371+0000","last_change":"2023-11-28T13:00:26.006501+0000","last_active":"2023-11-28T13:00:27.403371+0000","last_peered":"2023-11-28T13:00:27.403371+0000","last_clean":"2023-11-28T13:00:27.403371+0000","last_became_active":"2023-11-28T13:00:26.005960+0000","last_became_peered":"2023-11-28T13:00:26.005960+0000","last_unstale":"2023-11-28T13:00:27.403371+0000","last_undegraded":"2023-11-28T13:00:27.403371+0000","last_fullsized":"2023-11-28T13:00:27.403371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:59.727409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991606+0000","last_change":"2023-11-28T13:00:25.625750+0000","last_active":"2023-11-28T13:00:26.991606+0000","last_peered":"2023-11-28T13:00:26.991606+0000","last_clean":"2023-11-28T13:00:26.991606+0000","last_became_active":"2023-11-28T13:00:25.625184+0000","last_became_peered":"2023-11-28T13:00:25.625184+0000","last_unstale":"2023-11-28T13:00:26.991606+0000","last_undegraded":"2023-11-28T13:00:26.991606+0000","last_fullsized":"2023-11-28T13:00:26.991606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:45:07.677424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229505+0000","last_change":"2023-11-28T13:00:26.006359+0000","last_active":"2023-11-28T13:00:27.229505+0000","last_peered":"2023-11-28T13:00:27.229505+0000","last_clean":"2023-11-28T13:00:27.229505+0000","last_became_active":"2023-11-28T13:00:26.006083+0000","last_became_peered":"2023-11-28T13:00:26.006083+0000","last_unstale":"2023-11-28T13:00:27.229505+0000","last_undegraded":"2023-11-28T13:00:27.229505+0000","last_fullsized":"2023-11-28T13:00:27.229505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503356+0000","last_change":"2023-11-28T13:00:25.623980+0000","last_active":"2023-11-28T13:00:27.503356+0000","last_peered":"2023-11-28T13:00:27.503356+0000","last_clean":"2023-11-28T13:00:27.503356+0000","last_became_active":"2023-11-28T13:00:25.623650+0000","last_became_peered":"2023-11-28T13:00:25.623650+0000","last_unstale":"2023-11-28T13:00:27.503356+0000","last_undegraded":"2023-11-28T13:00:27.503356+0000","last_fullsized":"2023-11-28T13:00:27.503356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:03.287202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504291+0000","last_change":"2023-11-28T13:00:26.015774+0000","last_active":"2023-11-28T13:00:27.504291+0000","last_peered":"2023-11-28T13:00:27.504291+0000","last_clean":"2023-11-28T13:00:27.504291+0000","last_became_active":"2023-11-28T13:00:26.015516+0000","last_became_peered":"2023-11-28T13:00:26.015516+0000","last_unstale":"2023-11-28T13:00:27.504291+0000","last_undegraded":"2023-11-28T13:00:27.504291+0000","last_fullsized":"2023-11-28T13:00:27.504291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:10.041488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991867+0000","last_change":"2023-11-28T13:00:25.628452+0000","last_active":"2023-11-28T13:00:26.991867+0000","last_peered":"2023-11-28T13:00:26.991867+0000","last_clean":"2023-11-28T13:00:26.991867+0000","last_became_active":"2023-11-28T13:00:25.628113+0000","last_became_peered":"2023-11-28T13:00:25.628113+0000","last_unstale":"2023-11-28T13:00:26.991867+0000","last_undegraded":"2023-11-28T13:00:26.991867+0000","last_fullsized":"2023-11-28T13:00:26.991867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:34:17.734156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403850+0000","last_change":"2023-11-28T13:00:26.004164+0000","last_active":"2023-11-28T13:00:27.403850+0000","last_peered":"2023-11-28T13:00:27.403850+0000","last_clean":"2023-11-28T13:00:27.403850+0000","last_became_active":"2023-11-28T13:00:26.003908+0000","last_became_peered":"2023-11-28T13:00:26.003908+0000","last_unstale":"2023-11-28T13:00:27.403850+0000","last_undegraded":"2023-11-28T13:00:27.403850+0000","last_fullsized":"2023-11-28T13:00:27.403850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:48.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992957+0000","last_change":"2023-11-28T13:00:25.623824+0000","last_active":"2023-11-28T13:00:26.992957+0000","last_peered":"2023-11-28T13:00:26.992957+0000","last_clean":"2023-11-28T13:00:26.992957+0000","last_became_active":"2023-11-28T13:00:25.623463+0000","last_became_peered":"2023-11-28T13:00:25.623463+0000","last_unstale":"2023-11-28T13:00:26.992957+0000","last_undegraded":"2023-11-28T13:00:26.992957+0000","last_fullsized":"2023-11-28T13:00:26.992957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:23.365345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992736+0000","last_change":"2023-11-28T13:00:25.626091+0000","last_active":"2023-11-28T13:00:26.992736+0000","last_peered":"2023-11-28T13:00:26.992736+0000","last_clean":"2023-11-28T13:00:26.992736+0000","last_became_active":"2023-11-28T13:00:25.625286+0000","last_became_peered":"2023-11-28T13:00:25.625286+0000","last_unstale":"2023-11-28T13:00:26.992736+0000","last_undegraded":"2023-11-28T13:00:26.992736+0000","last_fullsized":"2023-11-28T13:00:26.992736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:58.712719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.228893+0000","last_change":"2023-11-28T13:00:26.006094+0000","last_active":"2023-11-28T13:00:27.228893+0000","last_peered":"2023-11-28T13:00:27.228893+0000","last_clean":"2023-11-28T13:00:27.228893+0000","last_became_active":"2023-11-28T13:00:26.005812+0000","last_became_peered":"2023-11-28T13:00:26.005812+0000","last_unstale":"2023-11-28T13:00:27.228893+0000","last_undegraded":"2023-11-28T13:00:27.228893+0000","last_fullsized":"2023-11-28T13:00:27.228893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:50.093176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.993196+0000","last_change":"2023-11-28T13:00:25.628566+0000","last_active":"2023-11-28T13:00:26.993196+0000","last_peered":"2023-11-28T13:00:26.993196+0000","last_clean":"2023-11-28T13:00:26.993196+0000","last_became_active":"2023-11-28T13:00:25.628266+0000","last_became_peered":"2023-11-28T13:00:25.628266+0000","last_unstale":"2023-11-28T13:00:26.993196+0000","last_undegraded":"2023-11-28T13:00:26.993196+0000","last_fullsized":"2023-11-28T13:00:26.993196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:05.115882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502747+0000","last_change":"2023-11-28T13:00:26.006002+0000","last_active":"2023-11-28T13:00:27.502747+0000","last_peered":"2023-11-28T13:00:27.502747+0000","last_clean":"2023-11-28T13:00:27.502747+0000","last_became_active":"2023-11-28T13:00:26.005728+0000","last_became_peered":"2023-11-28T13:00:26.005728+0000","last_unstale":"2023-11-28T13:00:27.502747+0000","last_undegraded":"2023-11-28T13:00:27.502747+0000","last_fullsized":"2023-11-28T13:00:27.502747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:45:51.690938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992306+0000","last_change":"2023-11-28T13:00:25.627709+0000","last_active":"2023-11-28T13:00:26.992306+0000","last_peered":"2023-11-28T13:00:26.992306+0000","last_clean":"2023-11-28T13:00:26.992306+0000","last_became_active":"2023-11-28T13:00:25.627384+0000","last_became_peered":"2023-11-28T13:00:25.627384+0000","last_unstale":"2023-11-28T13:00:26.992306+0000","last_undegraded":"2023-11-28T13:00:26.992306+0000","last_fullsized":"2023-11-28T13:00:26.992306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:09.026798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992896+0000","last_change":"2023-11-28T13:00:26.008865+0000","last_active":"2023-11-28T13:00:26.992896+0000","last_peered":"2023-11-28T13:00:26.992896+0000","last_clean":"2023-11-28T13:00:26.992896+0000","last_became_active":"2023-11-28T13:00:26.008154+0000","last_became_peered":"2023-11-28T13:00:26.008154+0000","last_unstale":"2023-11-28T13:00:26.992896+0000","last_undegraded":"2023-11-28T13:00:26.992896+0000","last_fullsized":"2023-11-28T13:00:26.992896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:35:46.604719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229235+0000","last_change":"2023-11-28T13:00:25.630262+0000","last_active":"2023-11-28T13:00:27.229235+0000","last_peered":"2023-11-28T13:00:27.229235+0000","last_clean":"2023-11-28T13:00:27.229235+0000","last_became_active":"2023-11-28T13:00:25.629929+0000","last_became_peered":"2023-11-28T13:00:25.629929+0000","last_unstale":"2023-11-28T13:00:27.229235+0000","last_undegraded":"2023-11-28T13:00:27.229235+0000","last_fullsized":"2023-11-28T13:00:27.229235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:56:21.848420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503222+0000","last_change":"2023-11-28T13:00:26.002295+0000","last_active":"2023-11-28T13:00:27.503222+0000","last_peered":"2023-11-28T13:00:27.503222+0000","last_clean":"2023-11-28T13:00:27.503222+0000","last_became_active":"2023-11-28T13:00:26.002035+0000","last_became_peered":"2023-11-28T13:00:26.002035+0000","last_unstale":"2023-11-28T13:00:27.503222+0000","last_undegraded":"2023-11-28T13:00:27.503222+0000","last_fullsized":"2023-11-28T13:00:27.503222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:48.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403625+0000","last_change":"2023-11-28T13:00:25.631075+0000","last_active":"2023-11-28T13:00:27.403625+0000","last_peered":"2023-11-28T13:00:27.403625+0000","last_clean":"2023-11-28T13:00:27.403625+0000","last_became_active":"2023-11-28T13:00:25.630790+0000","last_became_peered":"2023-11-28T13:00:25.630790+0000","last_unstale":"2023-11-28T13:00:27.403625+0000","last_undegraded":"2023-11-28T13:00:27.403625+0000","last_fullsized":"2023-11-28T13:00:27.403625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:03.287202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503723+0000","last_change":"2023-11-28T13:00:26.015247+0000","last_active":"2023-11-28T13:00:27.503723+0000","last_peered":"2023-11-28T13:00:27.503723+0000","last_clean":"2023-11-28T13:00:27.503723+0000","last_became_active":"2023-11-28T13:00:26.014933+0000","last_became_peered":"2023-11-28T13:00:26.014933+0000","last_unstale":"2023-11-28T13:00:27.503723+0000","last_undegraded":"2023-11-28T13:00:27.503723+0000","last_fullsized":"2023-11-28T13:00:27.503723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:39:23.566274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.993202+0000","last_change":"2023-11-28T13:00:25.625442+0000","last_active":"2023-11-28T13:00:26.993202+0000","last_peered":"2023-11-28T13:00:26.993202+0000","last_clean":"2023-11-28T13:00:26.993202+0000","last_became_active":"2023-11-28T13:00:25.625167+0000","last_became_peered":"2023-11-28T13:00:25.625167+0000","last_unstale":"2023-11-28T13:00:26.993202+0000","last_undegraded":"2023-11-28T13:00:26.993202+0000","last_fullsized":"2023-11-28T13:00:26.993202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:57.620680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503939+0000","last_change":"2023-11-28T13:00:26.005117+0000","last_active":"2023-11-28T13:00:27.503939+0000","last_peered":"2023-11-28T13:00:27.503939+0000","last_clean":"2023-11-28T13:00:27.503939+0000","last_became_active":"2023-11-28T13:00:26.004706+0000","last_became_peered":"2023-11-28T13:00:26.004706+0000","last_unstale":"2023-11-28T13:00:27.503939+0000","last_undegraded":"2023-11-28T13:00:27.503939+0000","last_fullsized":"2023-11-28T13:00:27.503939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:12:32.057680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502983+0000","last_change":"2023-11-28T13:00:25.620940+0000","last_active":"2023-11-28T13:00:27.502983+0000","last_peered":"2023-11-28T13:00:27.502983+0000","last_clean":"2023-11-28T13:00:27.502983+0000","last_became_active":"2023-11-28T13:00:25.620569+0000","last_became_peered":"2023-11-28T13:00:25.620569+0000","last_unstale":"2023-11-28T13:00:27.502983+0000","last_undegraded":"2023-11-28T13:00:27.502983+0000","last_fullsized":"2023-11-28T13:00:27.502983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:52.456316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503912+0000","last_change":"2023-11-28T13:00:26.014474+0000","last_active":"2023-11-28T13:00:27.503912+0000","last_peered":"2023-11-28T13:00:27.503912+0000","last_clean":"2023-11-28T13:00:27.503912+0000","last_became_active":"2023-11-28T13:00:26.014153+0000","last_became_peered":"2023-11-28T13:00:26.014153+0000","last_unstale":"2023-11-28T13:00:27.503912+0000","last_undegraded":"2023-11-28T13:00:27.503912+0000","last_fullsized":"2023-11-28T13:00:27.503912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:48.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402906+0000","last_change":"2023-11-28T13:00:25.632474+0000","last_active":"2023-11-28T13:00:27.402906+0000","last_peered":"2023-11-28T13:00:27.402906+0000","last_clean":"2023-11-28T13:00:27.402906+0000","last_became_active":"2023-11-28T13:00:25.632080+0000","last_became_peered":"2023-11-28T13:00:25.632080+0000","last_unstale":"2023-11-28T13:00:27.402906+0000","last_undegraded":"2023-11-28T13:00:27.402906+0000","last_fullsized":"2023-11-28T13:00:27.402906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:56:21.848420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505385+0000","last_change":"2023-11-28T13:00:26.011716+0000","last_active":"2023-11-28T13:00:27.505385+0000","last_peered":"2023-11-28T13:00:27.505385+0000","last_clean":"2023-11-28T13:00:27.505385+0000","last_became_active":"2023-11-28T13:00:26.011453+0000","last_became_peered":"2023-11-28T13:00:26.011453+0000","last_unstale":"2023-11-28T13:00:27.505385+0000","last_undegraded":"2023-11-28T13:00:27.505385+0000","last_fullsized":"2023-11-28T13:00:27.505385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.995720+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:00:25.995720+0000","last_peered":"2023-11-28T13:00:25.995720+0000","last_clean":"2023-11-28T13:00:25.995720+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:00:25.995720+0000","last_undegraded":"2023-11-28T13:00:25.995720+0000","last_fullsized":"2023-11-28T13:00:25.995720+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.990032+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:00:25.990032+0000","last_peered":"2023-11-28T13:00:25.990032+0000","last_clean":"2023-11-28T13:00:25.990032+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:00:25.990032+0000","last_undegraded":"2023-11-28T13:00:25.990032+0000","last_fullsized":"2023-11-28T13:00:25.990032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403785+0000","last_change":"2023-11-28T13:00:25.627086+0000","last_active":"2023-11-28T13:00:27.403785+0000","last_peered":"2023-11-28T13:00:27.403785+0000","last_clean":"2023-11-28T13:00:27.403785+0000","last_became_active":"2023-11-28T13:00:25.626755+0000","last_became_peered":"2023-11-28T13:00:25.626755+0000","last_unstale":"2023-11-28T13:00:27.403785+0000","last_undegraded":"2023-11-28T13:00:27.403785+0000","last_fullsized":"2023-11-28T13:00:27.403785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:32:19.210037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.993350+0000","last_change":"2023-11-28T13:00:26.009618+0000","last_active":"2023-11-28T13:00:26.993350+0000","last_peered":"2023-11-28T13:00:26.993350+0000","last_clean":"2023-11-28T13:00:26.993350+0000","last_became_active":"2023-11-28T13:00:26.008633+0000","last_became_peered":"2023-11-28T13:00:26.008633+0000","last_unstale":"2023-11-28T13:00:26.993350+0000","last_undegraded":"2023-11-28T13:00:26.993350+0000","last_fullsized":"2023-11-28T13:00:26.993350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:21:39.677078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.995631+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:00:25.995631+0000","last_peered":"2023-11-28T13:00:25.995631+0000","last_clean":"2023-11-28T13:00:25.995631+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:00:25.995631+0000","last_undegraded":"2023-11-28T13:00:25.995631+0000","last_fullsized":"2023-11-28T13:00:25.995631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502951+0000","last_change":"2023-11-28T13:00:25.629873+0000","last_active":"2023-11-28T13:00:27.502951+0000","last_peered":"2023-11-28T13:00:27.502951+0000","last_clean":"2023-11-28T13:00:27.502951+0000","last_became_active":"2023-11-28T13:00:25.629457+0000","last_became_peered":"2023-11-28T13:00:25.629457+0000","last_unstale":"2023-11-28T13:00:27.502951+0000","last_undegraded":"2023-11-28T13:00:27.502951+0000","last_fullsized":"2023-11-28T13:00:27.502951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:52.456316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504069+0000","last_change":"2023-11-28T13:00:26.002978+0000","last_active":"2023-11-28T13:00:27.504069+0000","last_peered":"2023-11-28T13:00:27.504069+0000","last_clean":"2023-11-28T13:00:27.504069+0000","last_became_active":"2023-11-28T13:00:26.002741+0000","last_became_peered":"2023-11-28T13:00:26.002741+0000","last_unstale":"2023-11-28T13:00:27.504069+0000","last_undegraded":"2023-11-28T13:00:27.504069+0000","last_fullsized":"2023-11-28T13:00:27.504069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:21.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.997886+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:00:25.997886+0000","last_peered":"2023-11-28T13:00:25.997886+0000","last_clean":"2023-11-28T13:00:25.997886+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:00:25.997886+0000","last_undegraded":"2023-11-28T13:00:25.997886+0000","last_fullsized":"2023-11-28T13:00:25.997886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504850+0000","last_change":"2023-11-28T13:00:25.621539+0000","last_active":"2023-11-28T13:00:27.504850+0000","last_peered":"2023-11-28T13:00:27.504850+0000","last_clean":"2023-11-28T13:00:27.504850+0000","last_became_active":"2023-11-28T13:00:25.621220+0000","last_became_peered":"2023-11-28T13:00:25.621220+0000","last_unstale":"2023-11-28T13:00:27.504850+0000","last_undegraded":"2023-11-28T13:00:27.504850+0000","last_fullsized":"2023-11-28T13:00:27.504850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:03.287202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505586+0000","last_change":"2023-11-28T13:00:26.001811+0000","last_active":"2023-11-28T13:00:27.505586+0000","last_peered":"2023-11-28T13:00:27.505586+0000","last_clean":"2023-11-28T13:00:27.505586+0000","last_became_active":"2023-11-28T13:00:26.001553+0000","last_became_peered":"2023-11-28T13:00:26.001553+0000","last_unstale":"2023-11-28T13:00:27.505586+0000","last_undegraded":"2023-11-28T13:00:27.505586+0000","last_fullsized":"2023-11-28T13:00:27.505586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:06.130572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.990083+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:00:25.990083+0000","last_peered":"2023-11-28T13:00:25.990083+0000","last_clean":"2023-11-28T13:00:25.990083+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:00:25.990083+0000","last_undegraded":"2023-11-28T13:00:25.990083+0000","last_fullsized":"2023-11-28T13:00:25.990083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503523+0000","last_change":"2023-11-28T13:00:25.629807+0000","last_active":"2023-11-28T13:00:27.503523+0000","last_peered":"2023-11-28T13:00:27.503523+0000","last_clean":"2023-11-28T13:00:27.503523+0000","last_became_active":"2023-11-28T13:00:25.629543+0000","last_became_peered":"2023-11-28T13:00:25.629543+0000","last_unstale":"2023-11-28T13:00:27.503523+0000","last_undegraded":"2023-11-28T13:00:27.503523+0000","last_fullsized":"2023-11-28T13:00:27.503523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:23.365345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504188+0000","last_change":"2023-11-28T13:00:26.003695+0000","last_active":"2023-11-28T13:00:27.504188+0000","last_peered":"2023-11-28T13:00:27.504188+0000","last_clean":"2023-11-28T13:00:27.504188+0000","last_became_active":"2023-11-28T13:00:26.002498+0000","last_became_peered":"2023-11-28T13:00:26.002498+0000","last_unstale":"2023-11-28T13:00:27.504188+0000","last_undegraded":"2023-11-28T13:00:27.504188+0000","last_fullsized":"2023-11-28T13:00:27.504188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229716+0000","last_change":"2023-11-28T13:00:25.630163+0000","last_active":"2023-11-28T13:00:27.229716+0000","last_peered":"2023-11-28T13:00:27.229716+0000","last_clean":"2023-11-28T13:00:27.229716+0000","last_became_active":"2023-11-28T13:00:25.629892+0000","last_became_peered":"2023-11-28T13:00:25.629892+0000","last_unstale":"2023-11-28T13:00:27.229716+0000","last_undegraded":"2023-11-28T13:00:27.229716+0000","last_fullsized":"2023-11-28T13:00:27.229716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:34:17.734156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.992840+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:00:25.992840+0000","last_peered":"2023-11-28T13:00:25.992840+0000","last_clean":"2023-11-28T13:00:25.992840+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:00:25.992840+0000","last_undegraded":"2023-11-28T13:00:25.992840+0000","last_fullsized":"2023-11-28T13:00:25.992840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505455+0000","last_change":"2023-11-28T13:00:26.002290+0000","last_active":"2023-11-28T13:00:27.505455+0000","last_peered":"2023-11-28T13:00:27.505455+0000","last_clean":"2023-11-28T13:00:27.505455+0000","last_became_active":"2023-11-28T13:00:26.002028+0000","last_became_peered":"2023-11-28T13:00:26.002028+0000","last_unstale":"2023-11-28T13:00:27.505455+0000","last_undegraded":"2023-11-28T13:00:27.505455+0000","last_fullsized":"2023-11-28T13:00:27.505455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:54.006637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504302+0000","last_change":"2023-11-28T13:00:25.631032+0000","last_active":"2023-11-28T13:00:27.504302+0000","last_peered":"2023-11-28T13:00:27.504302+0000","last_clean":"2023-11-28T13:00:27.504302+0000","last_became_active":"2023-11-28T13:00:25.630748+0000","last_became_peered":"2023-11-28T13:00:25.630748+0000","last_unstale":"2023-11-28T13:00:27.504302+0000","last_undegraded":"2023-11-28T13:00:27.504302+0000","last_fullsized":"2023-11-28T13:00:27.504302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:52.456316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.997737+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:00:25.997737+0000","last_peered":"2023-11-28T13:00:25.997737+0000","last_clean":"2023-11-28T13:00:25.997737+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:00:25.997737+0000","last_undegraded":"2023-11-28T13:00:25.997737+0000","last_fullsized":"2023-11-28T13:00:25.997737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503588+0000","last_change":"2023-11-28T13:00:25.999551+0000","last_active":"2023-11-28T13:00:27.503588+0000","last_peered":"2023-11-28T13:00:27.503588+0000","last_clean":"2023-11-28T13:00:27.503588+0000","last_became_active":"2023-11-28T13:00:25.999290+0000","last_became_peered":"2023-11-28T13:00:25.999290+0000","last_unstale":"2023-11-28T13:00:27.503588+0000","last_undegraded":"2023-11-28T13:00:27.503588+0000","last_fullsized":"2023-11-28T13:00:27.503588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:21:39.677078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403966+0000","last_change":"2023-11-28T13:00:25.631577+0000","last_active":"2023-11-28T13:00:27.403966+0000","last_peered":"2023-11-28T13:00:27.403966+0000","last_clean":"2023-11-28T13:00:27.403966+0000","last_became_active":"2023-11-28T13:00:25.631270+0000","last_became_peered":"2023-11-28T13:00:25.631270+0000","last_unstale":"2023-11-28T13:00:27.403966+0000","last_undegraded":"2023-11-28T13:00:27.403966+0000","last_fullsized":"2023-11-28T13:00:27.403966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:34:17.734156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.993702+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:00:25.993702+0000","last_peered":"2023-11-28T13:00:25.993702+0000","last_clean":"2023-11-28T13:00:25.993702+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:00:25.993702+0000","last_undegraded":"2023-11-28T13:00:25.993702+0000","last_fullsized":"2023-11-28T13:00:25.993702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402698+0000","last_change":"2023-11-28T13:00:26.009259+0000","last_active":"2023-11-28T13:00:27.402698+0000","last_peered":"2023-11-28T13:00:27.402698+0000","last_clean":"2023-11-28T13:00:27.402698+0000","last_became_active":"2023-11-28T13:00:26.007917+0000","last_became_peered":"2023-11-28T13:00:26.007917+0000","last_unstale":"2023-11-28T13:00:27.402698+0000","last_undegraded":"2023-11-28T13:00:27.402698+0000","last_fullsized":"2023-11-28T13:00:27.402698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504340+0000","last_change":"2023-11-28T13:00:25.633467+0000","last_active":"2023-11-28T13:00:27.504340+0000","last_peered":"2023-11-28T13:00:27.504340+0000","last_clean":"2023-11-28T13:00:27.504340+0000","last_became_active":"2023-11-28T13:00:25.633133+0000","last_became_peered":"2023-11-28T13:00:25.633133+0000","last_unstale":"2023-11-28T13:00:27.504340+0000","last_undegraded":"2023-11-28T13:00:27.504340+0000","last_fullsized":"2023-11-28T13:00:27.504340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:15.734182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.993588+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:00:25.993588+0000","last_peered":"2023-11-28T13:00:25.993588+0000","last_clean":"2023-11-28T13:00:25.993588+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:00:25.993588+0000","last_undegraded":"2023-11-28T13:00:25.993588+0000","last_fullsized":"2023-11-28T13:00:25.993588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502968+0000","last_change":"2023-11-28T13:00:26.007959+0000","last_active":"2023-11-28T13:00:27.502968+0000","last_peered":"2023-11-28T13:00:27.502968+0000","last_clean":"2023-11-28T13:00:27.502968+0000","last_became_active":"2023-11-28T13:00:26.006990+0000","last_became_peered":"2023-11-28T13:00:26.006990+0000","last_unstale":"2023-11-28T13:00:27.502968+0000","last_undegraded":"2023-11-28T13:00:27.502968+0000","last_fullsized":"2023-11-28T13:00:27.502968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:50.521471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503474+0000","last_change":"2023-11-28T13:00:26.014623+0000","last_active":"2023-11-28T13:00:27.503474+0000","last_peered":"2023-11-28T13:00:27.503474+0000","last_clean":"2023-11-28T13:00:27.503474+0000","last_became_active":"2023-11-28T13:00:26.014249+0000","last_became_peered":"2023-11-28T13:00:26.014249+0000","last_unstale":"2023-11-28T13:00:27.503474+0000","last_undegraded":"2023-11-28T13:00:27.503474+0000","last_fullsized":"2023-11-28T13:00:27.503474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:28:40.766436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503686+0000","last_change":"2023-11-28T13:00:25.617793+0000","last_active":"2023-11-28T13:00:27.503686+0000","last_peered":"2023-11-28T13:00:27.503686+0000","last_clean":"2023-11-28T13:00:27.503686+0000","last_became_active":"2023-11-28T13:00:25.616865+0000","last_became_peered":"2023-11-28T13:00:25.616865+0000","last_unstale":"2023-11-28T13:00:27.503686+0000","last_undegraded":"2023-11-28T13:00:27.503686+0000","last_fullsized":"2023-11-28T13:00:27.503686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:57.620680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505139+0000","last_change":"2023-11-28T13:00:26.011957+0000","last_active":"2023-11-28T13:00:27.505139+0000","last_peered":"2023-11-28T13:00:27.505139+0000","last_clean":"2023-11-28T13:00:27.505139+0000","last_became_active":"2023-11-28T13:00:26.011673+0000","last_became_peered":"2023-11-28T13:00:26.011673+0000","last_unstale":"2023-11-28T13:00:27.505139+0000","last_undegraded":"2023-11-28T13:00:27.505139+0000","last_fullsized":"2023-11-28T13:00:27.505139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:19.044875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992231+0000","last_change":"2023-11-28T13:00:25.630855+0000","last_active":"2023-11-28T13:00:26.992231+0000","last_peered":"2023-11-28T13:00:26.992231+0000","last_clean":"2023-11-28T13:00:26.992231+0000","last_became_active":"2023-11-28T13:00:25.630456+0000","last_became_peered":"2023-11-28T13:00:25.630456+0000","last_unstale":"2023-11-28T13:00:26.992231+0000","last_undegraded":"2023-11-28T13:00:26.992231+0000","last_fullsized":"2023-11-28T13:00:26.992231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:21:38.662388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229731+0000","last_change":"2023-11-28T13:00:25.624834+0000","last_active":"2023-11-28T13:00:27.229731+0000","last_peered":"2023-11-28T13:00:27.229731+0000","last_clean":"2023-11-28T13:00:27.229731+0000","last_became_active":"2023-11-28T13:00:25.624567+0000","last_became_peered":"2023-11-28T13:00:25.624567+0000","last_unstale":"2023-11-28T13:00:27.229731+0000","last_undegraded":"2023-11-28T13:00:27.229731+0000","last_fullsized":"2023-11-28T13:00:27.229731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:45:07.677424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402974+0000","last_change":"2023-11-28T13:00:26.010470+0000","last_active":"2023-11-28T13:00:27.402974+0000","last_peered":"2023-11-28T13:00:27.402974+0000","last_clean":"2023-11-28T13:00:27.402974+0000","last_became_active":"2023-11-28T13:00:26.009766+0000","last_became_peered":"2023-11-28T13:00:26.009766+0000","last_unstale":"2023-11-28T13:00:27.402974+0000","last_undegraded":"2023-11-28T13:00:27.402974+0000","last_fullsized":"2023-11-28T13:00:27.402974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:12:32.057680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504129+0000","last_change":"2023-11-28T13:00:25.629269+0000","last_active":"2023-11-28T13:00:27.504129+0000","last_peered":"2023-11-28T13:00:27.504129+0000","last_clean":"2023-11-28T13:00:27.504129+0000","last_became_active":"2023-11-28T13:00:25.628831+0000","last_became_peered":"2023-11-28T13:00:25.628831+0000","last_unstale":"2023-11-28T13:00:27.504129+0000","last_undegraded":"2023-11-28T13:00:27.504129+0000","last_fullsized":"2023-11-28T13:00:27.504129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:32:19.210037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402564+0000","last_change":"2023-11-28T13:00:26.015219+0000","last_active":"2023-11-28T13:00:27.402564+0000","last_peered":"2023-11-28T13:00:27.402564+0000","last_clean":"2023-11-28T13:00:27.402564+0000","last_became_active":"2023-11-28T13:00:26.014925+0000","last_became_peered":"2023-11-28T13:00:26.014925+0000","last_unstale":"2023-11-28T13:00:27.402564+0000","last_undegraded":"2023-11-28T13:00:27.402564+0000","last_fullsized":"2023-11-28T13:00:27.402564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:18:51.214695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.993563+0000","last_change":"2023-11-28T13:00:26.008486+0000","last_active":"2023-11-28T13:00:26.993563+0000","last_peered":"2023-11-28T13:00:26.993563+0000","last_clean":"2023-11-28T13:00:26.993563+0000","last_became_active":"2023-11-28T13:00:26.008210+0000","last_became_peered":"2023-11-28T13:00:26.008210+0000","last_unstale":"2023-11-28T13:00:26.993563+0000","last_undegraded":"2023-11-28T13:00:26.993563+0000","last_fullsized":"2023-11-28T13:00:26.993563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:53.611895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402778+0000","last_change":"2023-11-28T13:00:25.630302+0000","last_active":"2023-11-28T13:00:27.402778+0000","last_peered":"2023-11-28T13:00:27.402778+0000","last_clean":"2023-11-28T13:00:27.402778+0000","last_became_active":"2023-11-28T13:00:25.629349+0000","last_became_peered":"2023-11-28T13:00:25.629349+0000","last_unstale":"2023-11-28T13:00:27.402778+0000","last_undegraded":"2023-11-28T13:00:27.402778+0000","last_fullsized":"2023-11-28T13:00:27.402778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:15.734182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504240+0000","last_change":"2023-11-28T13:00:26.013956+0000","last_active":"2023-11-28T13:00:27.504240+0000","last_peered":"2023-11-28T13:00:27.504240+0000","last_clean":"2023-11-28T13:00:27.504240+0000","last_became_active":"2023-11-28T13:00:26.013605+0000","last_became_peered":"2023-11-28T13:00:26.013605+0000","last_unstale":"2023-11-28T13:00:27.504240+0000","last_undegraded":"2023-11-28T13:00:27.504240+0000","last_fullsized":"2023-11-28T13:00:27.504240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:54.006637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504825+0000","last_change":"2023-11-28T13:00:25.631060+0000","last_active":"2023-11-28T13:00:27.504825+0000","last_peered":"2023-11-28T13:00:27.504825+0000","last_clean":"2023-11-28T13:00:27.504825+0000","last_became_active":"2023-11-28T13:00:25.630788+0000","last_became_peered":"2023-11-28T13:00:25.630788+0000","last_unstale":"2023-11-28T13:00:27.504825+0000","last_undegraded":"2023-11-28T13:00:27.504825+0000","last_fullsized":"2023-11-28T13:00:27.504825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:32:19.210037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403416+0000","last_change":"2023-11-28T13:00:26.006323+0000","last_active":"2023-11-28T13:00:27.403416+0000","last_peered":"2023-11-28T13:00:27.403416+0000","last_clean":"2023-11-28T13:00:27.403416+0000","last_became_active":"2023-11-28T13:00:26.004227+0000","last_became_peered":"2023-11-28T13:00:26.004227+0000","last_unstale":"2023-11-28T13:00:27.403416+0000","last_undegraded":"2023-11-28T13:00:27.403416+0000","last_fullsized":"2023-11-28T13:00:27.403416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:28:40.766436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503349+0000","last_change":"2023-11-28T13:00:25.631107+0000","last_active":"2023-11-28T13:00:27.503349+0000","last_peered":"2023-11-28T13:00:27.503349+0000","last_clean":"2023-11-28T13:00:27.503349+0000","last_became_active":"2023-11-28T13:00:25.630796+0000","last_became_peered":"2023-11-28T13:00:25.630796+0000","last_unstale":"2023-11-28T13:00:27.503349+0000","last_undegraded":"2023-11-28T13:00:27.503349+0000","last_fullsized":"2023-11-28T13:00:27.503349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:00:19.501393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.987768+0000","last_change":"2023-11-28T13:00:26.003801+0000","last_active":"2023-11-28T13:00:26.987768+0000","last_peered":"2023-11-28T13:00:26.987768+0000","last_clean":"2023-11-28T13:00:26.987768+0000","last_became_active":"2023-11-28T13:00:26.003286+0000","last_became_peered":"2023-11-28T13:00:26.003286+0000","last_unstale":"2023-11-28T13:00:26.987768+0000","last_undegraded":"2023-11-28T13:00:26.987768+0000","last_fullsized":"2023-11-28T13:00:26.987768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:34:18.748847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503812+0000","last_change":"2023-11-28T13:00:25.630853+0000","last_active":"2023-11-28T13:00:27.503812+0000","last_peered":"2023-11-28T13:00:27.503812+0000","last_clean":"2023-11-28T13:00:27.503812+0000","last_became_active":"2023-11-28T13:00:25.630524+0000","last_became_peered":"2023-11-28T13:00:25.630524+0000","last_unstale":"2023-11-28T13:00:27.503812+0000","last_undegraded":"2023-11-28T13:00:27.503812+0000","last_fullsized":"2023-11-28T13:00:27.503812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:57.620680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503291+0000","last_change":"2023-11-28T13:00:26.015790+0000","last_active":"2023-11-28T13:00:27.503291+0000","last_peered":"2023-11-28T13:00:27.503291+0000","last_clean":"2023-11-28T13:00:27.503291+0000","last_became_active":"2023-11-28T13:00:26.015455+0000","last_became_peered":"2023-11-28T13:00:26.015455+0000","last_unstale":"2023-11-28T13:00:27.503291+0000","last_undegraded":"2023-11-28T13:00:27.503291+0000","last_fullsized":"2023-11-28T13:00:27.503291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:14.020668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229251+0000","last_change":"2023-11-28T13:00:25.628221+0000","last_active":"2023-11-28T13:00:27.229251+0000","last_peered":"2023-11-28T13:00:27.229251+0000","last_clean":"2023-11-28T13:00:27.229251+0000","last_became_active":"2023-11-28T13:00:25.627937+0000","last_became_peered":"2023-11-28T13:00:25.627937+0000","last_unstale":"2023-11-28T13:00:27.229251+0000","last_undegraded":"2023-11-28T13:00:27.229251+0000","last_fullsized":"2023-11-28T13:00:27.229251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:06:47.002190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503100+0000","last_change":"2023-11-28T13:00:26.016462+0000","last_active":"2023-11-28T13:00:27.503100+0000","last_peered":"2023-11-28T13:00:27.503100+0000","last_clean":"2023-11-28T13:00:27.503100+0000","last_became_active":"2023-11-28T13:00:26.016156+0000","last_became_peered":"2023-11-28T13:00:26.016156+0000","last_unstale":"2023-11-28T13:00:27.503100+0000","last_undegraded":"2023-11-28T13:00:27.503100+0000","last_fullsized":"2023-11-28T13:00:27.503100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:13:57.056758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229580+0000","last_change":"2023-11-28T13:00:25.629372+0000","last_active":"2023-11-28T13:00:27.229580+0000","last_peered":"2023-11-28T13:00:27.229580+0000","last_clean":"2023-11-28T13:00:27.229580+0000","last_became_active":"2023-11-28T13:00:25.629083+0000","last_became_peered":"2023-11-28T13:00:25.629083+0000","last_unstale":"2023-11-28T13:00:27.229580+0000","last_undegraded":"2023-11-28T13:00:27.229580+0000","last_fullsized":"2023-11-28T13:00:27.229580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:52.597204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403082+0000","last_change":"2023-11-28T13:00:26.006858+0000","last_active":"2023-11-28T13:00:27.403082+0000","last_peered":"2023-11-28T13:00:27.403082+0000","last_clean":"2023-11-28T13:00:27.403082+0000","last_became_active":"2023-11-28T13:00:26.006232+0000","last_became_peered":"2023-11-28T13:00:26.006232+0000","last_unstale":"2023-11-28T13:00:27.403082+0000","last_undegraded":"2023-11-28T13:00:27.403082+0000","last_fullsized":"2023-11-28T13:00:27.403082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:47.321386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403725+0000","last_change":"2023-11-28T13:00:25.628879+0000","last_active":"2023-11-28T13:00:27.403725+0000","last_peered":"2023-11-28T13:00:27.403725+0000","last_clean":"2023-11-28T13:00:27.403725+0000","last_became_active":"2023-11-28T13:00:25.628575+0000","last_became_peered":"2023-11-28T13:00:25.628575+0000","last_unstale":"2023-11-28T13:00:27.403725+0000","last_undegraded":"2023-11-28T13:00:27.403725+0000","last_fullsized":"2023-11-28T13:00:27.403725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:52.456316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502869+0000","last_change":"2023-11-28T13:00:26.014792+0000","last_active":"2023-11-28T13:00:27.502869+0000","last_peered":"2023-11-28T13:00:27.502869+0000","last_clean":"2023-11-28T13:00:27.502869+0000","last_became_active":"2023-11-28T13:00:26.014392+0000","last_became_peered":"2023-11-28T13:00:26.014392+0000","last_unstale":"2023-11-28T13:00:27.502869+0000","last_undegraded":"2023-11-28T13:00:27.502869+0000","last_fullsized":"2023-11-28T13:00:27.502869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:47.321386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504024+0000","last_change":"2023-11-28T13:00:25.630162+0000","last_active":"2023-11-28T13:00:27.504024+0000","last_peered":"2023-11-28T13:00:27.504024+0000","last_clean":"2023-11-28T13:00:27.504024+0000","last_became_active":"2023-11-28T13:00:25.629159+0000","last_became_peered":"2023-11-28T13:00:25.629159+0000","last_unstale":"2023-11-28T13:00:27.504024+0000","last_undegraded":"2023-11-28T13:00:27.504024+0000","last_fullsized":"2023-11-28T13:00:27.504024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:56:21.848420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9120,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362720,"statfs":{"total":96636764160,"available":96627425280,"internally_reserved":0,"allocated":876544,"data_stored":686402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8008,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363832,"statfs":{"total":96636764160,"available":96628563968,"internally_reserved":0,"allocated":262144,"data_stored":94906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":95874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8068,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363772,"statfs":{"total":96636764160,"available":96628502528,"internally_reserved":0,"allocated":258048,"data_stored":94360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8064,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363776,"statfs":{"total":96636764160,"available":96628506624,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9096,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362744,"statfs":{"total":96636764160,"available":96627449856,"internally_reserved":0,"allocated":851968,"data_stored":685204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:00:34.399 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:00:34.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.516+0000 7f0576fca700 1 Processor -- start 2023-11-28T13:00:34.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.516+0000 7f0576fca700 1 -- start start 2023-11-28T13:00:34.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.516+0000 7f0576fca700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f057015c1c0 0x7f05700c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:34.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.516+0000 7f0576fca700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f05700ca4b0 0x7f057006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:34.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.516+0000 7f0576fca700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05700cd2e0 con 0x7f057006d910 2023-11-28T13:00:34.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.516+0000 7f0576fca700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057006ddb0 con 0x7f05700ca4b0 2023-11-28T13:00:34.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.516+0000 7f0576fca700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05700ca9c0 con 0x7f057015c1c0 2023-11-28T13:00:34.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.516+0000 7f05767c9700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f057006d910 0x7f05700710b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:37040/0 (socket says 172.21.15.82:37040) 2023-11-28T13:00:34.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.516+0000 7f05767c9700 1 -- 172.21.15.82:0/1869293484 learned_addr learned my addr 172.21.15.82:0/1869293484 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:34.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.516+0000 7f0575fc8700 1 --2- 172.21.15.82:0/1869293484 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f057015c1c0 0x7f05700c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:34.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.516+0000 7f05757c7700 1 --2- 172.21.15.82:0/1869293484 >> v2:172.21.15.114:3300/0 conn(0x7f05700ca4b0 0x7f057006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:34.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.516+0000 7f0574fc6700 1 -- 172.21.15.82:0/1869293484 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213382154 0 0) 0x7f05700cd2e0 con 0x7f057006d910 2023-11-28T13:00:34.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.516+0000 7f0574fc6700 1 -- 172.21.15.82:0/1869293484 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f055c0035d0 con 0x7f057006d910 2023-11-28T13:00:34.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.516+0000 7f0575fc8700 1 -- 172.21.15.82:0/1869293484 >> v2:172.21.15.114:3300/0 conn(0x7f05700ca4b0 msgr2=0x7f057006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:34.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.516+0000 7f0575fc8700 1 --2- 172.21.15.82:0/1869293484 >> v2:172.21.15.114:3300/0 conn(0x7f05700ca4b0 0x7f057006d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:34.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.516+0000 7f0575fc8700 1 -- 172.21.15.82:0/1869293484 >> v1:172.21.15.82:6789/0 conn(0x7f057006d910 legacy=0x7f05700710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:34.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.516+0000 7f0574fc6700 1 -- 172.21.15.82:0/1869293484 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3080557303 0 0) 0x7f055c0035d0 con 0x7f057006d910 2023-11-28T13:00:34.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.516+0000 7f0575fc8700 1 -- 172.21.15.82:0/1869293484 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05700cd530 con 0x7f057015c1c0 2023-11-28T13:00:34.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.516+0000 7f05757c7700 1 --2- 172.21.15.82:0/1869293484 >> v2:172.21.15.114:3300/0 conn(0x7f05700ca4b0 0x7f057006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:34.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.516+0000 7f0575fc8700 1 --2- 172.21.15.82:0/1869293484 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f057015c1c0 0x7f05700c9f70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0564009850 tx=0x7f0564009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93f3d3af89d06289 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:34.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.520+0000 7f0574fc6700 1 -- 172.21.15.82:0/1869293484 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568001670 con 0x7f057015c1c0 2023-11-28T13:00:34.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.520+0000 7f0574fc6700 1 -- 172.21.15.82:0/1869293484 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0564004030 con 0x7f057015c1c0 2023-11-28T13:00:34.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.520+0000 7f0574fc6700 1 -- 172.21.15.82:0/1869293484 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05640043a0 con 0x7f057015c1c0 2023-11-28T13:00:34.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.520+0000 7f0576fca700 1 -- 172.21.15.82:0/1869293484 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f057015c1c0 msgr2=0x7f05700c9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:34.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.520+0000 7f0576fca700 1 --2- 172.21.15.82:0/1869293484 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f057015c1c0 0x7f05700c9f70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0564009850 tx=0x7f0564009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:34.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.520+0000 7f0576fca700 1 -- 172.21.15.82:0/1869293484 shutdown_connections 2023-11-28T13:00:34.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.520+0000 7f0576fca700 1 --2- 172.21.15.82:0/1869293484 >> v2:172.21.15.114:3300/0 conn(0x7f05700ca4b0 0x7f057006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:34.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.520+0000 7f0576fca700 1 --2- 172.21.15.82:0/1869293484 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f057015c1c0 0x7f05700c9f70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:34.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.520+0000 7f0576fca700 1 -- 172.21.15.82:0/1869293484 >> 172.21.15.82:0/1869293484 conn(0x7f05700cf710 msgr2=0x7f05700cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:34.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.520+0000 7f0576fca700 1 -- 172.21.15.82:0/1869293484 shutdown_connections 2023-11-28T13:00:34.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.520+0000 7f0576fca700 1 -- 172.21.15.82:0/1869293484 wait complete. 2023-11-28T13:00:34.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.520+0000 7f0576fca700 1 Processor -- start 2023-11-28T13:00:34.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.520+0000 7f0576fca700 1 -- start start 2023-11-28T13:00:34.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f0576fca700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f057006d910 0x7f05700c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:34.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f0576fca700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05700ca4b0 0x7f05701f10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:34.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f0576fca700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f057015c1c0 0x7f05700adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:34.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f0576fca700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05700b4f10 con 0x7f05700ca4b0 2023-11-28T13:00:34.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f0576fca700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05700acaa0 con 0x7f057006d910 2023-11-28T13:00:34.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f0576fca700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05700acd80 con 0x7f057015c1c0 2023-11-28T13:00:34.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f05757c7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05700ca4b0 0x7f05701f10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:34.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f05757c7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05700ca4b0 0x7f05701f10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57386/0 (socket says 172.21.15.82:57386) 2023-11-28T13:00:34.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f05757c7700 1 -- 172.21.15.82:0/2548301868 learned_addr learned my addr 172.21.15.82:0/2548301868 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:34.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f05767c9700 1 --2- 172.21.15.82:0/2548301868 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f057015c1c0 0x7f05700adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:34.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f0575fc8700 1 --2- 172.21.15.82:0/2548301868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f057006d910 0x7f05700c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:34.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f05757c7700 1 -- 172.21.15.82:0/2548301868 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f057015c1c0 msgr2=0x7f05700adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:34.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f05757c7700 1 --2- 172.21.15.82:0/2548301868 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f057015c1c0 0x7f05700adb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:34.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f05757c7700 1 -- 172.21.15.82:0/2548301868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f057006d910 msgr2=0x7f05700c5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:34.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f05757c7700 1 --2- 172.21.15.82:0/2548301868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f057006d910 0x7f05700c5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:34.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f05757c7700 1 -- 172.21.15.82:0/2548301868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c009a70 con 0x7f05700ca4b0 2023-11-28T13:00:34.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f05757c7700 1 --2- 172.21.15.82:0/2548301868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05700ca4b0 0x7f05701f10e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f056c00efc0 tx=0x7f056c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:34.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f05627fc700 1 -- 172.21.15.82:0/2548301868 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c00cd10 con 0x7f05700ca4b0 2023-11-28T13:00:34.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f05627fc700 1 -- 172.21.15.82:0/2548301868 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c00f040 con 0x7f05700ca4b0 2023-11-28T13:00:34.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f0576fca700 1 -- 172.21.15.82:0/2548301868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05640094b0 con 0x7f05700ca4b0 2023-11-28T13:00:34.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f05627fc700 1 -- 172.21.15.82:0/2548301868 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c0146a0 con 0x7f05700ca4b0 2023-11-28T13:00:34.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.524+0000 7f0576fca700 1 -- 172.21.15.82:0/2548301868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05700cdaf0 con 0x7f05700ca4b0 2023-11-28T13:00:34.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.528+0000 7f0576fca700 1 -- 172.21.15.82:0/2548301868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05700cd810 con 0x7f05700ca4b0 2023-11-28T13:00:34.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.528+0000 7f05627fc700 1 -- 172.21.15.82:0/2548301868 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f056c014800 con 0x7f05700ca4b0 2023-11-28T13:00:34.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.528+0000 7f05627fc700 1 --2- 172.21.15.82:0/2548301868 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0554064ee0 0x7f0554067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:34.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.528+0000 7f05627fc700 1 -- 172.21.15.82:0/2548301868 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f056c082c60 con 0x7f05700ca4b0 2023-11-28T13:00:34.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.528+0000 7f0575fc8700 1 --2- 172.21.15.82:0/2548301868 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0554064ee0 0x7f0554067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:34.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.528+0000 7f0575fc8700 1 --2- 172.21.15.82:0/2548301868 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0554064ee0 0x7f0554067390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f05640090b0 tx=0x7f0564008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:34.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.536+0000 7f05627fc700 1 -- 172.21.15.82:0/2548301868 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f056c050e00 con 0x7f05700ca4b0 2023-11-28T13:00:34.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.696+0000 7f0576fca700 1 -- 172.21.15.82:0/2548301868 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f057015c590 con 0x7f0554064ee0 2023-11-28T13:00:34.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.704+0000 7f05627fc700 1 -- 172.21.15.82:0/2548301868 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286494 (secure 0 0 0) 0x7f057015c590 con 0x7f0554064ee0 2023-11-28T13:00:34.712 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:34.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.708+0000 7f0576fca700 1 -- 172.21.15.82:0/2548301868 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0554064ee0 msgr2=0x7f0554067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:34.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.708+0000 7f0576fca700 1 --2- 172.21.15.82:0/2548301868 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0554064ee0 0x7f0554067390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f05640090b0 tx=0x7f0564008030 comp rx=0 tx=0).stop 2023-11-28T13:00:34.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.708+0000 7f0576fca700 1 -- 172.21.15.82:0/2548301868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05700ca4b0 msgr2=0x7f05701f10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:34.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.708+0000 7f0576fca700 1 --2- 172.21.15.82:0/2548301868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05700ca4b0 0x7f05701f10e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f056c00efc0 tx=0x7f056c00c3a0 comp rx=0 tx=0).stop 2023-11-28T13:00:34.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.708+0000 7f0576fca700 1 -- 172.21.15.82:0/2548301868 shutdown_connections 2023-11-28T13:00:34.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.708+0000 7f0576fca700 1 --2- 172.21.15.82:0/2548301868 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0554064ee0 0x7f0554067390 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:34.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.708+0000 7f0576fca700 1 --2- 172.21.15.82:0/2548301868 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f057015c1c0 0x7f05700adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:34.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.708+0000 7f0576fca700 1 --2- 172.21.15.82:0/2548301868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05700ca4b0 0x7f05701f10e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:34.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.708+0000 7f0576fca700 1 --2- 172.21.15.82:0/2548301868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f057006d910 0x7f05700c5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:34.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.712+0000 7f0576fca700 1 -- 172.21.15.82:0/2548301868 >> 172.21.15.82:0/2548301868 conn(0x7f05700cf710 msgr2=0x7f057006c460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:34.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.712+0000 7f0576fca700 1 -- 172.21.15.82:0/2548301868 shutdown_connections 2023-11-28T13:00:34.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.712+0000 7f0576fca700 1 -- 172.21.15.82:0/2548301868 wait complete. 2023-11-28T13:00:34.716 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:00:34.726 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-11-28T13:00:33.157603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66440,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":63168,"kb_avail":754908280,"statfs":{"total":773094113280,"available":773026078720,"internally_reserved":0,"allocated":3284992,"data_stored":1939556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64684032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.554136"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.987630+0000","last_change":"2023-11-28T13:00:26.016426+0000","last_active":"2023-11-28T13:00:26.987630+0000","last_peered":"2023-11-28T13:00:26.987630+0000","last_clean":"2023-11-28T13:00:26.987630+0000","last_became_active":"2023-11-28T13:00:26.016109+0000","last_became_peered":"2023-11-28T13:00:26.016109+0000","last_unstale":"2023-11-28T13:00:26.987630+0000","last_undegraded":"2023-11-28T13:00:26.987630+0000","last_fullsized":"2023-11-28T13:00:26.987630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:16.748872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229500+0000","last_change":"2023-11-28T13:00:26.000097+0000","last_active":"2023-11-28T13:00:27.229500+0000","last_peered":"2023-11-28T13:00:27.229500+0000","last_clean":"2023-11-28T13:00:27.229500+0000","last_became_active":"2023-11-28T13:00:25.999819+0000","last_became_peered":"2023-11-28T13:00:25.999819+0000","last_unstale":"2023-11-28T13:00:27.229500+0000","last_undegraded":"2023-11-28T13:00:27.229500+0000","last_fullsized":"2023-11-28T13:00:27.229500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:12:32.057680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503805+0000","last_change":"2023-11-28T13:00:26.005315+0000","last_active":"2023-11-28T13:00:27.503805+0000","last_peered":"2023-11-28T13:00:27.503805+0000","last_clean":"2023-11-28T13:00:27.503805+0000","last_became_active":"2023-11-28T13:00:26.005022+0000","last_became_peered":"2023-11-28T13:00:26.005022+0000","last_unstale":"2023-11-28T13:00:27.503805+0000","last_undegraded":"2023-11-28T13:00:27.503805+0000","last_fullsized":"2023-11-28T13:00:27.503805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:21.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.993695+0000","last_change":"2023-11-28T13:00:26.009786+0000","last_active":"2023-11-28T13:00:26.993695+0000","last_peered":"2023-11-28T13:00:26.993695+0000","last_clean":"2023-11-28T13:00:26.993695+0000","last_became_active":"2023-11-28T13:00:26.008695+0000","last_became_peered":"2023-11-28T13:00:26.008695+0000","last_unstale":"2023-11-28T13:00:26.993695+0000","last_undegraded":"2023-11-28T13:00:26.993695+0000","last_fullsized":"2023-11-28T13:00:26.993695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:10.041488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503641+0000","last_change":"2023-11-28T13:00:26.016418+0000","last_active":"2023-11-28T13:00:27.503641+0000","last_peered":"2023-11-28T13:00:27.503641+0000","last_clean":"2023-11-28T13:00:27.503641+0000","last_became_active":"2023-11-28T13:00:26.016147+0000","last_became_peered":"2023-11-28T13:00:26.016147+0000","last_unstale":"2023-11-28T13:00:27.503641+0000","last_undegraded":"2023-11-28T13:00:27.503641+0000","last_fullsized":"2023-11-28T13:00:27.503641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502901+0000","last_change":"2023-11-28T13:00:26.006186+0000","last_active":"2023-11-28T13:00:27.502901+0000","last_peered":"2023-11-28T13:00:27.502901+0000","last_clean":"2023-11-28T13:00:27.502901+0000","last_became_active":"2023-11-28T13:00:26.005834+0000","last_became_peered":"2023-11-28T13:00:26.005834+0000","last_unstale":"2023-11-28T13:00:27.502901+0000","last_undegraded":"2023-11-28T13:00:27.502901+0000","last_fullsized":"2023-11-28T13:00:27.502901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:58.267291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991447+0000","last_change":"2023-11-28T13:00:26.012909+0000","last_active":"2023-11-28T13:00:26.991447+0000","last_peered":"2023-11-28T13:00:26.991447+0000","last_clean":"2023-11-28T13:00:26.991447+0000","last_became_active":"2023-11-28T13:00:26.012340+0000","last_became_peered":"2023-11-28T13:00:26.012340+0000","last_unstale":"2023-11-28T13:00:26.991447+0000","last_undegraded":"2023-11-28T13:00:26.991447+0000","last_fullsized":"2023-11-28T13:00:26.991447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.228880+0000","last_change":"2023-11-28T13:00:26.011119+0000","last_active":"2023-11-28T13:00:27.228880+0000","last_peered":"2023-11-28T13:00:27.228880+0000","last_clean":"2023-11-28T13:00:27.228880+0000","last_became_active":"2023-11-28T13:00:26.010841+0000","last_became_peered":"2023-11-28T13:00:26.010841+0000","last_unstale":"2023-11-28T13:00:27.228880+0000","last_undegraded":"2023-11-28T13:00:27.228880+0000","last_fullsized":"2023-11-28T13:00:27.228880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:39.083550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503676+0000","last_change":"2023-11-28T13:00:26.016674+0000","last_active":"2023-11-28T13:00:27.503676+0000","last_peered":"2023-11-28T13:00:27.503676+0000","last_clean":"2023-11-28T13:00:27.503676+0000","last_became_active":"2023-11-28T13:00:26.016188+0000","last_became_peered":"2023-11-28T13:00:26.016188+0000","last_unstale":"2023-11-28T13:00:27.503676+0000","last_undegraded":"2023-11-28T13:00:27.503676+0000","last_fullsized":"2023-11-28T13:00:27.503676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229491+0000","last_change":"2023-11-28T13:00:26.002162+0000","last_active":"2023-11-28T13:00:27.229491+0000","last_peered":"2023-11-28T13:00:27.229491+0000","last_clean":"2023-11-28T13:00:27.229491+0000","last_became_active":"2023-11-28T13:00:26.001726+0000","last_became_peered":"2023-11-28T13:00:26.001726+0000","last_unstale":"2023-11-28T13:00:27.229491+0000","last_undegraded":"2023-11-28T13:00:27.229491+0000","last_fullsized":"2023-11-28T13:00:27.229491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503832+0000","last_change":"2023-11-28T13:00:26.005292+0000","last_active":"2023-11-28T13:00:27.503832+0000","last_peered":"2023-11-28T13:00:27.503832+0000","last_clean":"2023-11-28T13:00:27.503832+0000","last_became_active":"2023-11-28T13:00:26.004797+0000","last_became_peered":"2023-11-28T13:00:26.004797+0000","last_unstale":"2023-11-28T13:00:27.503832+0000","last_undegraded":"2023-11-28T13:00:27.503832+0000","last_fullsized":"2023-11-28T13:00:27.503832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:27:02.277619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.987674+0000","last_change":"2023-11-28T13:00:26.007946+0000","last_active":"2023-11-28T13:00:26.987674+0000","last_peered":"2023-11-28T13:00:26.987674+0000","last_clean":"2023-11-28T13:00:26.987674+0000","last_became_active":"2023-11-28T13:00:26.007680+0000","last_became_peered":"2023-11-28T13:00:26.007680+0000","last_unstale":"2023-11-28T13:00:26.987674+0000","last_undegraded":"2023-11-28T13:00:26.987674+0000","last_fullsized":"2023-11-28T13:00:26.987674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:56:22.863111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.987252+0000","last_change":"2023-11-28T13:00:26.016340+0000","last_active":"2023-11-28T13:00:26.987252+0000","last_peered":"2023-11-28T13:00:26.987252+0000","last_clean":"2023-11-28T13:00:26.987252+0000","last_became_active":"2023-11-28T13:00:26.016050+0000","last_became_peered":"2023-11-28T13:00:26.016050+0000","last_unstale":"2023-11-28T13:00:26.987252+0000","last_undegraded":"2023-11-28T13:00:26.987252+0000","last_fullsized":"2023-11-28T13:00:26.987252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:06:48.016881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229021+0000","last_change":"2023-11-28T13:00:26.002242+0000","last_active":"2023-11-28T13:00:27.229021+0000","last_peered":"2023-11-28T13:00:27.229021+0000","last_clean":"2023-11-28T13:00:27.229021+0000","last_became_active":"2023-11-28T13:00:26.001119+0000","last_became_peered":"2023-11-28T13:00:26.001119+0000","last_unstale":"2023-11-28T13:00:27.229021+0000","last_undegraded":"2023-11-28T13:00:27.229021+0000","last_fullsized":"2023-11-28T13:00:27.229021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:21.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991681+0000","last_change":"2023-11-28T13:00:26.013151+0000","last_active":"2023-11-28T13:00:26.991681+0000","last_peered":"2023-11-28T13:00:26.991681+0000","last_clean":"2023-11-28T13:00:26.991681+0000","last_became_active":"2023-11-28T13:00:26.012729+0000","last_became_peered":"2023-11-28T13:00:26.012729+0000","last_unstale":"2023-11-28T13:00:26.991681+0000","last_undegraded":"2023-11-28T13:00:26.991681+0000","last_fullsized":"2023-11-28T13:00:26.991681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502676+0000","last_change":"2023-11-28T13:00:26.006151+0000","last_active":"2023-11-28T13:00:27.502676+0000","last_peered":"2023-11-28T13:00:27.502676+0000","last_clean":"2023-11-28T13:00:27.502676+0000","last_became_active":"2023-11-28T13:00:26.005850+0000","last_became_peered":"2023-11-28T13:00:26.005850+0000","last_unstale":"2023-11-28T13:00:27.502676+0000","last_undegraded":"2023-11-28T13:00:27.502676+0000","last_fullsized":"2023-11-28T13:00:27.502676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:18:46.140210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503909+0000","last_change":"2023-11-28T13:00:26.016811+0000","last_active":"2023-11-28T13:00:27.503909+0000","last_peered":"2023-11-28T13:00:27.503909+0000","last_clean":"2023-11-28T13:00:27.503909+0000","last_became_active":"2023-11-28T13:00:26.016486+0000","last_became_peered":"2023-11-28T13:00:26.016486+0000","last_unstale":"2023-11-28T13:00:27.503909+0000","last_undegraded":"2023-11-28T13:00:27.503909+0000","last_fullsized":"2023-11-28T13:00:27.503909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:47.321386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503787+0000","last_change":"2023-11-28T13:00:26.004579+0000","last_active":"2023-11-28T13:00:27.503787+0000","last_peered":"2023-11-28T13:00:27.503787+0000","last_clean":"2023-11-28T13:00:27.503787+0000","last_became_active":"2023-11-28T13:00:26.004222+0000","last_became_peered":"2023-11-28T13:00:26.004222+0000","last_unstale":"2023-11-28T13:00:27.503787+0000","last_undegraded":"2023-11-28T13:00:27.503787+0000","last_fullsized":"2023-11-28T13:00:27.503787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.987435+0000","last_change":"2023-11-28T13:00:26.009984+0000","last_active":"2023-11-28T13:00:26.987435+0000","last_peered":"2023-11-28T13:00:26.987435+0000","last_clean":"2023-11-28T13:00:26.987435+0000","last_became_active":"2023-11-28T13:00:26.009719+0000","last_became_peered":"2023-11-28T13:00:26.009719+0000","last_unstale":"2023-11-28T13:00:26.987435+0000","last_undegraded":"2023-11-28T13:00:26.987435+0000","last_fullsized":"2023-11-28T13:00:26.987435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:32:20.224728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503408+0000","last_change":"2023-11-28T13:00:26.015275+0000","last_active":"2023-11-28T13:00:27.503408+0000","last_peered":"2023-11-28T13:00:27.503408+0000","last_clean":"2023-11-28T13:00:27.503408+0000","last_became_active":"2023-11-28T13:00:26.014423+0000","last_became_peered":"2023-11-28T13:00:26.014423+0000","last_unstale":"2023-11-28T13:00:27.503408+0000","last_undegraded":"2023-11-28T13:00:27.503408+0000","last_fullsized":"2023-11-28T13:00:27.503408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:18:51.214695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991515+0000","last_change":"2023-11-28T13:00:26.015493+0000","last_active":"2023-11-28T13:00:26.991515+0000","last_peered":"2023-11-28T13:00:26.991515+0000","last_clean":"2023-11-28T13:00:26.991515+0000","last_became_active":"2023-11-28T13:00:26.015224+0000","last_became_peered":"2023-11-28T13:00:26.015224+0000","last_unstale":"2023-11-28T13:00:26.991515+0000","last_undegraded":"2023-11-28T13:00:26.991515+0000","last_fullsized":"2023-11-28T13:00:26.991515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:48.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503142+0000","last_change":"2023-11-28T13:00:26.004946+0000","last_active":"2023-11-28T13:00:27.503142+0000","last_peered":"2023-11-28T13:00:27.503142+0000","last_clean":"2023-11-28T13:00:27.503142+0000","last_became_active":"2023-11-28T13:00:26.004689+0000","last_became_peered":"2023-11-28T13:00:26.004689+0000","last_unstale":"2023-11-28T13:00:27.503142+0000","last_undegraded":"2023-11-28T13:00:27.503142+0000","last_fullsized":"2023-11-28T13:00:27.503142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:12:32.057680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402655+0000","last_change":"2023-11-28T13:00:26.003184+0000","last_active":"2023-11-28T13:00:27.402655+0000","last_peered":"2023-11-28T13:00:27.402655+0000","last_clean":"2023-11-28T13:00:27.402655+0000","last_became_active":"2023-11-28T13:00:25.997059+0000","last_became_peered":"2023-11-28T13:00:25.997059+0000","last_unstale":"2023-11-28T13:00:27.402655+0000","last_undegraded":"2023-11-28T13:00:27.402655+0000","last_fullsized":"2023-11-28T13:00:27.402655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991146+0000","last_change":"2023-11-28T13:00:26.015820+0000","last_active":"2023-11-28T13:00:26.991146+0000","last_peered":"2023-11-28T13:00:26.991146+0000","last_clean":"2023-11-28T13:00:26.991146+0000","last_became_active":"2023-11-28T13:00:26.015570+0000","last_became_peered":"2023-11-28T13:00:26.015570+0000","last_unstale":"2023-11-28T13:00:26.991146+0000","last_undegraded":"2023-11-28T13:00:26.991146+0000","last_fullsized":"2023-11-28T13:00:26.991146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:12:32.057680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505383+0000","last_change":"2023-11-28T13:00:26.010807+0000","last_active":"2023-11-28T13:00:27.505383+0000","last_peered":"2023-11-28T13:00:27.505383+0000","last_clean":"2023-11-28T13:00:27.505383+0000","last_became_active":"2023-11-28T13:00:26.010530+0000","last_became_peered":"2023-11-28T13:00:26.010530+0000","last_unstale":"2023-11-28T13:00:27.505383+0000","last_undegraded":"2023-11-28T13:00:27.505383+0000","last_fullsized":"2023-11-28T13:00:27.505383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:39.083550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505576+0000","last_change":"2023-11-28T13:00:26.002933+0000","last_active":"2023-11-28T13:00:27.505576+0000","last_peered":"2023-11-28T13:00:27.505576+0000","last_clean":"2023-11-28T13:00:27.505576+0000","last_became_active":"2023-11-28T13:00:26.002663+0000","last_became_peered":"2023-11-28T13:00:26.002663+0000","last_unstale":"2023-11-28T13:00:27.505576+0000","last_undegraded":"2023-11-28T13:00:27.505576+0000","last_fullsized":"2023-11-28T13:00:27.505576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:47.321386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229310+0000","last_change":"2023-11-28T13:00:26.012470+0000","last_active":"2023-11-28T13:00:27.229310+0000","last_peered":"2023-11-28T13:00:27.229310+0000","last_clean":"2023-11-28T13:00:27.229310+0000","last_became_active":"2023-11-28T13:00:26.012130+0000","last_became_peered":"2023-11-28T13:00:26.012130+0000","last_unstale":"2023-11-28T13:00:27.229310+0000","last_undegraded":"2023-11-28T13:00:27.229310+0000","last_fullsized":"2023-11-28T13:00:27.229310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:48.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504421+0000","last_change":"2023-11-28T13:00:26.014609+0000","last_active":"2023-11-28T13:00:27.504421+0000","last_peered":"2023-11-28T13:00:27.504421+0000","last_clean":"2023-11-28T13:00:27.504421+0000","last_became_active":"2023-11-28T13:00:26.014274+0000","last_became_peered":"2023-11-28T13:00:26.014274+0000","last_unstale":"2023-11-28T13:00:27.504421+0000","last_undegraded":"2023-11-28T13:00:27.504421+0000","last_fullsized":"2023-11-28T13:00:27.504421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:50.093176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403447+0000","last_change":"2023-11-28T13:00:26.015284+0000","last_active":"2023-11-28T13:00:27.403447+0000","last_peered":"2023-11-28T13:00:27.403447+0000","last_clean":"2023-11-28T13:00:27.403447+0000","last_became_active":"2023-11-28T13:00:26.015015+0000","last_became_peered":"2023-11-28T13:00:26.015015+0000","last_unstale":"2023-11-28T13:00:27.403447+0000","last_undegraded":"2023-11-28T13:00:27.403447+0000","last_fullsized":"2023-11-28T13:00:27.403447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:21.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503148+0000","last_change":"2023-11-28T13:00:26.016028+0000","last_active":"2023-11-28T13:00:27.503148+0000","last_peered":"2023-11-28T13:00:27.503148+0000","last_clean":"2023-11-28T13:00:27.503148+0000","last_became_active":"2023-11-28T13:00:26.014453+0000","last_became_peered":"2023-11-28T13:00:26.014453+0000","last_unstale":"2023-11-28T13:00:27.503148+0000","last_undegraded":"2023-11-28T13:00:27.503148+0000","last_fullsized":"2023-11-28T13:00:27.503148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402712+0000","last_change":"2023-11-28T13:00:26.010119+0000","last_active":"2023-11-28T13:00:27.402712+0000","last_peered":"2023-11-28T13:00:27.402712+0000","last_clean":"2023-11-28T13:00:27.402712+0000","last_became_active":"2023-11-28T13:00:26.006633+0000","last_became_peered":"2023-11-28T13:00:26.006633+0000","last_unstale":"2023-11-28T13:00:27.402712+0000","last_undegraded":"2023-11-28T13:00:27.402712+0000","last_fullsized":"2023-11-28T13:00:27.402712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:50.521471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992755+0000","last_change":"2023-11-28T13:00:26.009650+0000","last_active":"2023-11-28T13:00:26.992755+0000","last_peered":"2023-11-28T13:00:26.992755+0000","last_clean":"2023-11-28T13:00:26.992755+0000","last_became_active":"2023-11-28T13:00:26.008418+0000","last_became_peered":"2023-11-28T13:00:26.008418+0000","last_unstale":"2023-11-28T13:00:26.992755+0000","last_undegraded":"2023-11-28T13:00:26.992755+0000","last_fullsized":"2023-11-28T13:00:26.992755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:45:08.692115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403371+0000","last_change":"2023-11-28T13:00:26.006501+0000","last_active":"2023-11-28T13:00:27.403371+0000","last_peered":"2023-11-28T13:00:27.403371+0000","last_clean":"2023-11-28T13:00:27.403371+0000","last_became_active":"2023-11-28T13:00:26.005960+0000","last_became_peered":"2023-11-28T13:00:26.005960+0000","last_unstale":"2023-11-28T13:00:27.403371+0000","last_undegraded":"2023-11-28T13:00:27.403371+0000","last_fullsized":"2023-11-28T13:00:27.403371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:59.727409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991606+0000","last_change":"2023-11-28T13:00:25.625750+0000","last_active":"2023-11-28T13:00:26.991606+0000","last_peered":"2023-11-28T13:00:26.991606+0000","last_clean":"2023-11-28T13:00:26.991606+0000","last_became_active":"2023-11-28T13:00:25.625184+0000","last_became_peered":"2023-11-28T13:00:25.625184+0000","last_unstale":"2023-11-28T13:00:26.991606+0000","last_undegraded":"2023-11-28T13:00:26.991606+0000","last_fullsized":"2023-11-28T13:00:26.991606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:45:07.677424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229505+0000","last_change":"2023-11-28T13:00:26.006359+0000","last_active":"2023-11-28T13:00:27.229505+0000","last_peered":"2023-11-28T13:00:27.229505+0000","last_clean":"2023-11-28T13:00:27.229505+0000","last_became_active":"2023-11-28T13:00:26.006083+0000","last_became_peered":"2023-11-28T13:00:26.006083+0000","last_unstale":"2023-11-28T13:00:27.229505+0000","last_undegraded":"2023-11-28T13:00:27.229505+0000","last_fullsized":"2023-11-28T13:00:27.229505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503356+0000","last_change":"2023-11-28T13:00:25.623980+0000","last_active":"2023-11-28T13:00:27.503356+0000","last_peered":"2023-11-28T13:00:27.503356+0000","last_clean":"2023-11-28T13:00:27.503356+0000","last_became_active":"2023-11-28T13:00:25.623650+0000","last_became_peered":"2023-11-28T13:00:25.623650+0000","last_unstale":"2023-11-28T13:00:27.503356+0000","last_undegraded":"2023-11-28T13:00:27.503356+0000","last_fullsized":"2023-11-28T13:00:27.503356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:03.287202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504291+0000","last_change":"2023-11-28T13:00:26.015774+0000","last_active":"2023-11-28T13:00:27.504291+0000","last_peered":"2023-11-28T13:00:27.504291+0000","last_clean":"2023-11-28T13:00:27.504291+0000","last_became_active":"2023-11-28T13:00:26.015516+0000","last_became_peered":"2023-11-28T13:00:26.015516+0000","last_unstale":"2023-11-28T13:00:27.504291+0000","last_undegraded":"2023-11-28T13:00:27.504291+0000","last_fullsized":"2023-11-28T13:00:27.504291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:10.041488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991867+0000","last_change":"2023-11-28T13:00:25.628452+0000","last_active":"2023-11-28T13:00:26.991867+0000","last_peered":"2023-11-28T13:00:26.991867+0000","last_clean":"2023-11-28T13:00:26.991867+0000","last_became_active":"2023-11-28T13:00:25.628113+0000","last_became_peered":"2023-11-28T13:00:25.628113+0000","last_unstale":"2023-11-28T13:00:26.991867+0000","last_undegraded":"2023-11-28T13:00:26.991867+0000","last_fullsized":"2023-11-28T13:00:26.991867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:34:17.734156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403850+0000","last_change":"2023-11-28T13:00:26.004164+0000","last_active":"2023-11-28T13:00:27.403850+0000","last_peered":"2023-11-28T13:00:27.403850+0000","last_clean":"2023-11-28T13:00:27.403850+0000","last_became_active":"2023-11-28T13:00:26.003908+0000","last_became_peered":"2023-11-28T13:00:26.003908+0000","last_unstale":"2023-11-28T13:00:27.403850+0000","last_undegraded":"2023-11-28T13:00:27.403850+0000","last_fullsized":"2023-11-28T13:00:27.403850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:48.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992957+0000","last_change":"2023-11-28T13:00:25.623824+0000","last_active":"2023-11-28T13:00:26.992957+0000","last_peered":"2023-11-28T13:00:26.992957+0000","last_clean":"2023-11-28T13:00:26.992957+0000","last_became_active":"2023-11-28T13:00:25.623463+0000","last_became_peered":"2023-11-28T13:00:25.623463+0000","last_unstale":"2023-11-28T13:00:26.992957+0000","last_undegraded":"2023-11-28T13:00:26.992957+0000","last_fullsized":"2023-11-28T13:00:26.992957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:23.365345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992736+0000","last_change":"2023-11-28T13:00:25.626091+0000","last_active":"2023-11-28T13:00:26.992736+0000","last_peered":"2023-11-28T13:00:26.992736+0000","last_clean":"2023-11-28T13:00:26.992736+0000","last_became_active":"2023-11-28T13:00:25.625286+0000","last_became_peered":"2023-11-28T13:00:25.625286+0000","last_unstale":"2023-11-28T13:00:26.992736+0000","last_undegraded":"2023-11-28T13:00:26.992736+0000","last_fullsized":"2023-11-28T13:00:26.992736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:58.712719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.228893+0000","last_change":"2023-11-28T13:00:26.006094+0000","last_active":"2023-11-28T13:00:27.228893+0000","last_peered":"2023-11-28T13:00:27.228893+0000","last_clean":"2023-11-28T13:00:27.228893+0000","last_became_active":"2023-11-28T13:00:26.005812+0000","last_became_peered":"2023-11-28T13:00:26.005812+0000","last_unstale":"2023-11-28T13:00:27.228893+0000","last_undegraded":"2023-11-28T13:00:27.228893+0000","last_fullsized":"2023-11-28T13:00:27.228893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:50.093176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.993196+0000","last_change":"2023-11-28T13:00:25.628566+0000","last_active":"2023-11-28T13:00:26.993196+0000","last_peered":"2023-11-28T13:00:26.993196+0000","last_clean":"2023-11-28T13:00:26.993196+0000","last_became_active":"2023-11-28T13:00:25.628266+0000","last_became_peered":"2023-11-28T13:00:25.628266+0000","last_unstale":"2023-11-28T13:00:26.993196+0000","last_undegraded":"2023-11-28T13:00:26.993196+0000","last_fullsized":"2023-11-28T13:00:26.993196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:05.115882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502747+0000","last_change":"2023-11-28T13:00:26.006002+0000","last_active":"2023-11-28T13:00:27.502747+0000","last_peered":"2023-11-28T13:00:27.502747+0000","last_clean":"2023-11-28T13:00:27.502747+0000","last_became_active":"2023-11-28T13:00:26.005728+0000","last_became_peered":"2023-11-28T13:00:26.005728+0000","last_unstale":"2023-11-28T13:00:27.502747+0000","last_undegraded":"2023-11-28T13:00:27.502747+0000","last_fullsized":"2023-11-28T13:00:27.502747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:45:51.690938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992306+0000","last_change":"2023-11-28T13:00:25.627709+0000","last_active":"2023-11-28T13:00:26.992306+0000","last_peered":"2023-11-28T13:00:26.992306+0000","last_clean":"2023-11-28T13:00:26.992306+0000","last_became_active":"2023-11-28T13:00:25.627384+0000","last_became_peered":"2023-11-28T13:00:25.627384+0000","last_unstale":"2023-11-28T13:00:26.992306+0000","last_undegraded":"2023-11-28T13:00:26.992306+0000","last_fullsized":"2023-11-28T13:00:26.992306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:09.026798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992896+0000","last_change":"2023-11-28T13:00:26.008865+0000","last_active":"2023-11-28T13:00:26.992896+0000","last_peered":"2023-11-28T13:00:26.992896+0000","last_clean":"2023-11-28T13:00:26.992896+0000","last_became_active":"2023-11-28T13:00:26.008154+0000","last_became_peered":"2023-11-28T13:00:26.008154+0000","last_unstale":"2023-11-28T13:00:26.992896+0000","last_undegraded":"2023-11-28T13:00:26.992896+0000","last_fullsized":"2023-11-28T13:00:26.992896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:35:46.604719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229235+0000","last_change":"2023-11-28T13:00:25.630262+0000","last_active":"2023-11-28T13:00:27.229235+0000","last_peered":"2023-11-28T13:00:27.229235+0000","last_clean":"2023-11-28T13:00:27.229235+0000","last_became_active":"2023-11-28T13:00:25.629929+0000","last_became_peered":"2023-11-28T13:00:25.629929+0000","last_unstale":"2023-11-28T13:00:27.229235+0000","last_undegraded":"2023-11-28T13:00:27.229235+0000","last_fullsized":"2023-11-28T13:00:27.229235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:56:21.848420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503222+0000","last_change":"2023-11-28T13:00:26.002295+0000","last_active":"2023-11-28T13:00:27.503222+0000","last_peered":"2023-11-28T13:00:27.503222+0000","last_clean":"2023-11-28T13:00:27.503222+0000","last_became_active":"2023-11-28T13:00:26.002035+0000","last_became_peered":"2023-11-28T13:00:26.002035+0000","last_unstale":"2023-11-28T13:00:27.503222+0000","last_undegraded":"2023-11-28T13:00:27.503222+0000","last_fullsized":"2023-11-28T13:00:27.503222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:48.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403625+0000","last_change":"2023-11-28T13:00:25.631075+0000","last_active":"2023-11-28T13:00:27.403625+0000","last_peered":"2023-11-28T13:00:27.403625+0000","last_clean":"2023-11-28T13:00:27.403625+0000","last_became_active":"2023-11-28T13:00:25.630790+0000","last_became_peered":"2023-11-28T13:00:25.630790+0000","last_unstale":"2023-11-28T13:00:27.403625+0000","last_undegraded":"2023-11-28T13:00:27.403625+0000","last_fullsized":"2023-11-28T13:00:27.403625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:03.287202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503723+0000","last_change":"2023-11-28T13:00:26.015247+0000","last_active":"2023-11-28T13:00:27.503723+0000","last_peered":"2023-11-28T13:00:27.503723+0000","last_clean":"2023-11-28T13:00:27.503723+0000","last_became_active":"2023-11-28T13:00:26.014933+0000","last_became_peered":"2023-11-28T13:00:26.014933+0000","last_unstale":"2023-11-28T13:00:27.503723+0000","last_undegraded":"2023-11-28T13:00:27.503723+0000","last_fullsized":"2023-11-28T13:00:27.503723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:39:23.566274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.993202+0000","last_change":"2023-11-28T13:00:25.625442+0000","last_active":"2023-11-28T13:00:26.993202+0000","last_peered":"2023-11-28T13:00:26.993202+0000","last_clean":"2023-11-28T13:00:26.993202+0000","last_became_active":"2023-11-28T13:00:25.625167+0000","last_became_peered":"2023-11-28T13:00:25.625167+0000","last_unstale":"2023-11-28T13:00:26.993202+0000","last_undegraded":"2023-11-28T13:00:26.993202+0000","last_fullsized":"2023-11-28T13:00:26.993202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:57.620680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503939+0000","last_change":"2023-11-28T13:00:26.005117+0000","last_active":"2023-11-28T13:00:27.503939+0000","last_peered":"2023-11-28T13:00:27.503939+0000","last_clean":"2023-11-28T13:00:27.503939+0000","last_became_active":"2023-11-28T13:00:26.004706+0000","last_became_peered":"2023-11-28T13:00:26.004706+0000","last_unstale":"2023-11-28T13:00:27.503939+0000","last_undegraded":"2023-11-28T13:00:27.503939+0000","last_fullsized":"2023-11-28T13:00:27.503939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:12:32.057680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502983+0000","last_change":"2023-11-28T13:00:25.620940+0000","last_active":"2023-11-28T13:00:27.502983+0000","last_peered":"2023-11-28T13:00:27.502983+0000","last_clean":"2023-11-28T13:00:27.502983+0000","last_became_active":"2023-11-28T13:00:25.620569+0000","last_became_peered":"2023-11-28T13:00:25.620569+0000","last_unstale":"2023-11-28T13:00:27.502983+0000","last_undegraded":"2023-11-28T13:00:27.502983+0000","last_fullsized":"2023-11-28T13:00:27.502983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:52.456316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503912+0000","last_change":"2023-11-28T13:00:26.014474+0000","last_active":"2023-11-28T13:00:27.503912+0000","last_peered":"2023-11-28T13:00:27.503912+0000","last_clean":"2023-11-28T13:00:27.503912+0000","last_became_active":"2023-11-28T13:00:26.014153+0000","last_became_peered":"2023-11-28T13:00:26.014153+0000","last_unstale":"2023-11-28T13:00:27.503912+0000","last_undegraded":"2023-11-28T13:00:27.503912+0000","last_fullsized":"2023-11-28T13:00:27.503912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:48.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402906+0000","last_change":"2023-11-28T13:00:25.632474+0000","last_active":"2023-11-28T13:00:27.402906+0000","last_peered":"2023-11-28T13:00:27.402906+0000","last_clean":"2023-11-28T13:00:27.402906+0000","last_became_active":"2023-11-28T13:00:25.632080+0000","last_became_peered":"2023-11-28T13:00:25.632080+0000","last_unstale":"2023-11-28T13:00:27.402906+0000","last_undegraded":"2023-11-28T13:00:27.402906+0000","last_fullsized":"2023-11-28T13:00:27.402906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:56:21.848420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505385+0000","last_change":"2023-11-28T13:00:26.011716+0000","last_active":"2023-11-28T13:00:27.505385+0000","last_peered":"2023-11-28T13:00:27.505385+0000","last_clean":"2023-11-28T13:00:27.505385+0000","last_became_active":"2023-11-28T13:00:26.011453+0000","last_became_peered":"2023-11-28T13:00:26.011453+0000","last_unstale":"2023-11-28T13:00:27.505385+0000","last_undegraded":"2023-11-28T13:00:27.505385+0000","last_fullsized":"2023-11-28T13:00:27.505385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.995720+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:00:25.995720+0000","last_peered":"2023-11-28T13:00:25.995720+0000","last_clean":"2023-11-28T13:00:25.995720+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:00:25.995720+0000","last_undegraded":"2023-11-28T13:00:25.995720+0000","last_fullsized":"2023-11-28T13:00:25.995720+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.990032+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:00:25.990032+0000","last_peered":"2023-11-28T13:00:25.990032+0000","last_clean":"2023-11-28T13:00:25.990032+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:00:25.990032+0000","last_undegraded":"2023-11-28T13:00:25.990032+0000","last_fullsized":"2023-11-28T13:00:25.990032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403785+0000","last_change":"2023-11-28T13:00:25.627086+0000","last_active":"2023-11-28T13:00:27.403785+0000","last_peered":"2023-11-28T13:00:27.403785+0000","last_clean":"2023-11-28T13:00:27.403785+0000","last_became_active":"2023-11-28T13:00:25.626755+0000","last_became_peered":"2023-11-28T13:00:25.626755+0000","last_unstale":"2023-11-28T13:00:27.403785+0000","last_undegraded":"2023-11-28T13:00:27.403785+0000","last_fullsized":"2023-11-28T13:00:27.403785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:32:19.210037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.993350+0000","last_change":"2023-11-28T13:00:26.009618+0000","last_active":"2023-11-28T13:00:26.993350+0000","last_peered":"2023-11-28T13:00:26.993350+0000","last_clean":"2023-11-28T13:00:26.993350+0000","last_became_active":"2023-11-28T13:00:26.008633+0000","last_became_peered":"2023-11-28T13:00:26.008633+0000","last_unstale":"2023-11-28T13:00:26.993350+0000","last_undegraded":"2023-11-28T13:00:26.993350+0000","last_fullsized":"2023-11-28T13:00:26.993350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:21:39.677078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.995631+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:00:25.995631+0000","last_peered":"2023-11-28T13:00:25.995631+0000","last_clean":"2023-11-28T13:00:25.995631+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:00:25.995631+0000","last_undegraded":"2023-11-28T13:00:25.995631+0000","last_fullsized":"2023-11-28T13:00:25.995631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502951+0000","last_change":"2023-11-28T13:00:25.629873+0000","last_active":"2023-11-28T13:00:27.502951+0000","last_peered":"2023-11-28T13:00:27.502951+0000","last_clean":"2023-11-28T13:00:27.502951+0000","last_became_active":"2023-11-28T13:00:25.629457+0000","last_became_peered":"2023-11-28T13:00:25.629457+0000","last_unstale":"2023-11-28T13:00:27.502951+0000","last_undegraded":"2023-11-28T13:00:27.502951+0000","last_fullsized":"2023-11-28T13:00:27.502951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:52.456316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504069+0000","last_change":"2023-11-28T13:00:26.002978+0000","last_active":"2023-11-28T13:00:27.504069+0000","last_peered":"2023-11-28T13:00:27.504069+0000","last_clean":"2023-11-28T13:00:27.504069+0000","last_became_active":"2023-11-28T13:00:26.002741+0000","last_became_peered":"2023-11-28T13:00:26.002741+0000","last_unstale":"2023-11-28T13:00:27.504069+0000","last_undegraded":"2023-11-28T13:00:27.504069+0000","last_fullsized":"2023-11-28T13:00:27.504069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:21.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.997886+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:00:25.997886+0000","last_peered":"2023-11-28T13:00:25.997886+0000","last_clean":"2023-11-28T13:00:25.997886+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:00:25.997886+0000","last_undegraded":"2023-11-28T13:00:25.997886+0000","last_fullsized":"2023-11-28T13:00:25.997886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504850+0000","last_change":"2023-11-28T13:00:25.621539+0000","last_active":"2023-11-28T13:00:27.504850+0000","last_peered":"2023-11-28T13:00:27.504850+0000","last_clean":"2023-11-28T13:00:27.504850+0000","last_became_active":"2023-11-28T13:00:25.621220+0000","last_became_peered":"2023-11-28T13:00:25.621220+0000","last_unstale":"2023-11-28T13:00:27.504850+0000","last_undegraded":"2023-11-28T13:00:27.504850+0000","last_fullsized":"2023-11-28T13:00:27.504850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:03.287202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505586+0000","last_change":"2023-11-28T13:00:26.001811+0000","last_active":"2023-11-28T13:00:27.505586+0000","last_peered":"2023-11-28T13:00:27.505586+0000","last_clean":"2023-11-28T13:00:27.505586+0000","last_became_active":"2023-11-28T13:00:26.001553+0000","last_became_peered":"2023-11-28T13:00:26.001553+0000","last_unstale":"2023-11-28T13:00:27.505586+0000","last_undegraded":"2023-11-28T13:00:27.505586+0000","last_fullsized":"2023-11-28T13:00:27.505586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:06.130572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.990083+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:00:25.990083+0000","last_peered":"2023-11-28T13:00:25.990083+0000","last_clean":"2023-11-28T13:00:25.990083+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:00:25.990083+0000","last_undegraded":"2023-11-28T13:00:25.990083+0000","last_fullsized":"2023-11-28T13:00:25.990083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503523+0000","last_change":"2023-11-28T13:00:25.629807+0000","last_active":"2023-11-28T13:00:27.503523+0000","last_peered":"2023-11-28T13:00:27.503523+0000","last_clean":"2023-11-28T13:00:27.503523+0000","last_became_active":"2023-11-28T13:00:25.629543+0000","last_became_peered":"2023-11-28T13:00:25.629543+0000","last_unstale":"2023-11-28T13:00:27.503523+0000","last_undegraded":"2023-11-28T13:00:27.503523+0000","last_fullsized":"2023-11-28T13:00:27.503523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:23.365345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504188+0000","last_change":"2023-11-28T13:00:26.003695+0000","last_active":"2023-11-28T13:00:27.504188+0000","last_peered":"2023-11-28T13:00:27.504188+0000","last_clean":"2023-11-28T13:00:27.504188+0000","last_became_active":"2023-11-28T13:00:26.002498+0000","last_became_peered":"2023-11-28T13:00:26.002498+0000","last_unstale":"2023-11-28T13:00:27.504188+0000","last_undegraded":"2023-11-28T13:00:27.504188+0000","last_fullsized":"2023-11-28T13:00:27.504188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229716+0000","last_change":"2023-11-28T13:00:25.630163+0000","last_active":"2023-11-28T13:00:27.229716+0000","last_peered":"2023-11-28T13:00:27.229716+0000","last_clean":"2023-11-28T13:00:27.229716+0000","last_became_active":"2023-11-28T13:00:25.629892+0000","last_became_peered":"2023-11-28T13:00:25.629892+0000","last_unstale":"2023-11-28T13:00:27.229716+0000","last_undegraded":"2023-11-28T13:00:27.229716+0000","last_fullsized":"2023-11-28T13:00:27.229716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:34:17.734156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.992840+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:00:25.992840+0000","last_peered":"2023-11-28T13:00:25.992840+0000","last_clean":"2023-11-28T13:00:25.992840+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:00:25.992840+0000","last_undegraded":"2023-11-28T13:00:25.992840+0000","last_fullsized":"2023-11-28T13:00:25.992840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505455+0000","last_change":"2023-11-28T13:00:26.002290+0000","last_active":"2023-11-28T13:00:27.505455+0000","last_peered":"2023-11-28T13:00:27.505455+0000","last_clean":"2023-11-28T13:00:27.505455+0000","last_became_active":"2023-11-28T13:00:26.002028+0000","last_became_peered":"2023-11-28T13:00:26.002028+0000","last_unstale":"2023-11-28T13:00:27.505455+0000","last_undegraded":"2023-11-28T13:00:27.505455+0000","last_fullsized":"2023-11-28T13:00:27.505455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:54.006637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504302+0000","last_change":"2023-11-28T13:00:25.631032+0000","last_active":"2023-11-28T13:00:27.504302+0000","last_peered":"2023-11-28T13:00:27.504302+0000","last_clean":"2023-11-28T13:00:27.504302+0000","last_became_active":"2023-11-28T13:00:25.630748+0000","last_became_peered":"2023-11-28T13:00:25.630748+0000","last_unstale":"2023-11-28T13:00:27.504302+0000","last_undegraded":"2023-11-28T13:00:27.504302+0000","last_fullsized":"2023-11-28T13:00:27.504302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:52.456316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.997737+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:00:25.997737+0000","last_peered":"2023-11-28T13:00:25.997737+0000","last_clean":"2023-11-28T13:00:25.997737+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:00:25.997737+0000","last_undegraded":"2023-11-28T13:00:25.997737+0000","last_fullsized":"2023-11-28T13:00:25.997737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503588+0000","last_change":"2023-11-28T13:00:25.999551+0000","last_active":"2023-11-28T13:00:27.503588+0000","last_peered":"2023-11-28T13:00:27.503588+0000","last_clean":"2023-11-28T13:00:27.503588+0000","last_became_active":"2023-11-28T13:00:25.999290+0000","last_became_peered":"2023-11-28T13:00:25.999290+0000","last_unstale":"2023-11-28T13:00:27.503588+0000","last_undegraded":"2023-11-28T13:00:27.503588+0000","last_fullsized":"2023-11-28T13:00:27.503588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:21:39.677078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403966+0000","last_change":"2023-11-28T13:00:25.631577+0000","last_active":"2023-11-28T13:00:27.403966+0000","last_peered":"2023-11-28T13:00:27.403966+0000","last_clean":"2023-11-28T13:00:27.403966+0000","last_became_active":"2023-11-28T13:00:25.631270+0000","last_became_peered":"2023-11-28T13:00:25.631270+0000","last_unstale":"2023-11-28T13:00:27.403966+0000","last_undegraded":"2023-11-28T13:00:27.403966+0000","last_fullsized":"2023-11-28T13:00:27.403966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:34:17.734156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.993702+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:00:25.993702+0000","last_peered":"2023-11-28T13:00:25.993702+0000","last_clean":"2023-11-28T13:00:25.993702+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:00:25.993702+0000","last_undegraded":"2023-11-28T13:00:25.993702+0000","last_fullsized":"2023-11-28T13:00:25.993702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402698+0000","last_change":"2023-11-28T13:00:26.009259+0000","last_active":"2023-11-28T13:00:27.402698+0000","last_peered":"2023-11-28T13:00:27.402698+0000","last_clean":"2023-11-28T13:00:27.402698+0000","last_became_active":"2023-11-28T13:00:26.007917+0000","last_became_peered":"2023-11-28T13:00:26.007917+0000","last_unstale":"2023-11-28T13:00:27.402698+0000","last_undegraded":"2023-11-28T13:00:27.402698+0000","last_fullsized":"2023-11-28T13:00:27.402698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504340+0000","last_change":"2023-11-28T13:00:25.633467+0000","last_active":"2023-11-28T13:00:27.504340+0000","last_peered":"2023-11-28T13:00:27.504340+0000","last_clean":"2023-11-28T13:00:27.504340+0000","last_became_active":"2023-11-28T13:00:25.633133+0000","last_became_peered":"2023-11-28T13:00:25.633133+0000","last_unstale":"2023-11-28T13:00:27.504340+0000","last_undegraded":"2023-11-28T13:00:27.504340+0000","last_fullsized":"2023-11-28T13:00:27.504340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:15.734182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.993588+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:00:25.993588+0000","last_peered":"2023-11-28T13:00:25.993588+0000","last_clean":"2023-11-28T13:00:25.993588+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:00:25.993588+0000","last_undegraded":"2023-11-28T13:00:25.993588+0000","last_fullsized":"2023-11-28T13:00:25.993588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502968+0000","last_change":"2023-11-28T13:00:26.007959+0000","last_active":"2023-11-28T13:00:27.502968+0000","last_peered":"2023-11-28T13:00:27.502968+0000","last_clean":"2023-11-28T13:00:27.502968+0000","last_became_active":"2023-11-28T13:00:26.006990+0000","last_became_peered":"2023-11-28T13:00:26.006990+0000","last_unstale":"2023-11-28T13:00:27.502968+0000","last_undegraded":"2023-11-28T13:00:27.502968+0000","last_fullsized":"2023-11-28T13:00:27.502968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:50.521471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503474+0000","last_change":"2023-11-28T13:00:26.014623+0000","last_active":"2023-11-28T13:00:27.503474+0000","last_peered":"2023-11-28T13:00:27.503474+0000","last_clean":"2023-11-28T13:00:27.503474+0000","last_became_active":"2023-11-28T13:00:26.014249+0000","last_became_peered":"2023-11-28T13:00:26.014249+0000","last_unstale":"2023-11-28T13:00:27.503474+0000","last_undegraded":"2023-11-28T13:00:27.503474+0000","last_fullsized":"2023-11-28T13:00:27.503474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:28:40.766436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503686+0000","last_change":"2023-11-28T13:00:25.617793+0000","last_active":"2023-11-28T13:00:27.503686+0000","last_peered":"2023-11-28T13:00:27.503686+0000","last_clean":"2023-11-28T13:00:27.503686+0000","last_became_active":"2023-11-28T13:00:25.616865+0000","last_became_peered":"2023-11-28T13:00:25.616865+0000","last_unstale":"2023-11-28T13:00:27.503686+0000","last_undegraded":"2023-11-28T13:00:27.503686+0000","last_fullsized":"2023-11-28T13:00:27.503686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:57.620680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505139+0000","last_change":"2023-11-28T13:00:26.011957+0000","last_active":"2023-11-28T13:00:27.505139+0000","last_peered":"2023-11-28T13:00:27.505139+0000","last_clean":"2023-11-28T13:00:27.505139+0000","last_became_active":"2023-11-28T13:00:26.011673+0000","last_became_peered":"2023-11-28T13:00:26.011673+0000","last_unstale":"2023-11-28T13:00:27.505139+0000","last_undegraded":"2023-11-28T13:00:27.505139+0000","last_fullsized":"2023-11-28T13:00:27.505139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:19.044875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992231+0000","last_change":"2023-11-28T13:00:25.630855+0000","last_active":"2023-11-28T13:00:26.992231+0000","last_peered":"2023-11-28T13:00:26.992231+0000","last_clean":"2023-11-28T13:00:26.992231+0000","last_became_active":"2023-11-28T13:00:25.630456+0000","last_became_peered":"2023-11-28T13:00:25.630456+0000","last_unstale":"2023-11-28T13:00:26.992231+0000","last_undegraded":"2023-11-28T13:00:26.992231+0000","last_fullsized":"2023-11-28T13:00:26.992231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:21:38.662388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229731+0000","last_change":"2023-11-28T13:00:25.624834+0000","last_active":"2023-11-28T13:00:27.229731+0000","last_peered":"2023-11-28T13:00:27.229731+0000","last_clean":"2023-11-28T13:00:27.229731+0000","last_became_active":"2023-11-28T13:00:25.624567+0000","last_became_peered":"2023-11-28T13:00:25.624567+0000","last_unstale":"2023-11-28T13:00:27.229731+0000","last_undegraded":"2023-11-28T13:00:27.229731+0000","last_fullsized":"2023-11-28T13:00:27.229731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:45:07.677424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402974+0000","last_change":"2023-11-28T13:00:26.010470+0000","last_active":"2023-11-28T13:00:27.402974+0000","last_peered":"2023-11-28T13:00:27.402974+0000","last_clean":"2023-11-28T13:00:27.402974+0000","last_became_active":"2023-11-28T13:00:26.009766+0000","last_became_peered":"2023-11-28T13:00:26.009766+0000","last_unstale":"2023-11-28T13:00:27.402974+0000","last_undegraded":"2023-11-28T13:00:27.402974+0000","last_fullsized":"2023-11-28T13:00:27.402974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:12:32.057680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504129+0000","last_change":"2023-11-28T13:00:25.629269+0000","last_active":"2023-11-28T13:00:27.504129+0000","last_peered":"2023-11-28T13:00:27.504129+0000","last_clean":"2023-11-28T13:00:27.504129+0000","last_became_active":"2023-11-28T13:00:25.628831+0000","last_became_peered":"2023-11-28T13:00:25.628831+0000","last_unstale":"2023-11-28T13:00:27.504129+0000","last_undegraded":"2023-11-28T13:00:27.504129+0000","last_fullsized":"2023-11-28T13:00:27.504129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:32:19.210037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402564+0000","last_change":"2023-11-28T13:00:26.015219+0000","last_active":"2023-11-28T13:00:27.402564+0000","last_peered":"2023-11-28T13:00:27.402564+0000","last_clean":"2023-11-28T13:00:27.402564+0000","last_became_active":"2023-11-28T13:00:26.014925+0000","last_became_peered":"2023-11-28T13:00:26.014925+0000","last_unstale":"2023-11-28T13:00:27.402564+0000","last_undegraded":"2023-11-28T13:00:27.402564+0000","last_fullsized":"2023-11-28T13:00:27.402564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:18:51.214695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.993563+0000","last_change":"2023-11-28T13:00:26.008486+0000","last_active":"2023-11-28T13:00:26.993563+0000","last_peered":"2023-11-28T13:00:26.993563+0000","last_clean":"2023-11-28T13:00:26.993563+0000","last_became_active":"2023-11-28T13:00:26.008210+0000","last_became_peered":"2023-11-28T13:00:26.008210+0000","last_unstale":"2023-11-28T13:00:26.993563+0000","last_undegraded":"2023-11-28T13:00:26.993563+0000","last_fullsized":"2023-11-28T13:00:26.993563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:53.611895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402778+0000","last_change":"2023-11-28T13:00:25.630302+0000","last_active":"2023-11-28T13:00:27.402778+0000","last_peered":"2023-11-28T13:00:27.402778+0000","last_clean":"2023-11-28T13:00:27.402778+0000","last_became_active":"2023-11-28T13:00:25.629349+0000","last_became_peered":"2023-11-28T13:00:25.629349+0000","last_unstale":"2023-11-28T13:00:27.402778+0000","last_undegraded":"2023-11-28T13:00:27.402778+0000","last_fullsized":"2023-11-28T13:00:27.402778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:15.734182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504240+0000","last_change":"2023-11-28T13:00:26.013956+0000","last_active":"2023-11-28T13:00:27.504240+0000","last_peered":"2023-11-28T13:00:27.504240+0000","last_clean":"2023-11-28T13:00:27.504240+0000","last_became_active":"2023-11-28T13:00:26.013605+0000","last_became_peered":"2023-11-28T13:00:26.013605+0000","last_unstale":"2023-11-28T13:00:27.504240+0000","last_undegraded":"2023-11-28T13:00:27.504240+0000","last_fullsized":"2023-11-28T13:00:27.504240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:54.006637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504825+0000","last_change":"2023-11-28T13:00:25.631060+0000","last_active":"2023-11-28T13:00:27.504825+0000","last_peered":"2023-11-28T13:00:27.504825+0000","last_clean":"2023-11-28T13:00:27.504825+0000","last_became_active":"2023-11-28T13:00:25.630788+0000","last_became_peered":"2023-11-28T13:00:25.630788+0000","last_unstale":"2023-11-28T13:00:27.504825+0000","last_undegraded":"2023-11-28T13:00:27.504825+0000","last_fullsized":"2023-11-28T13:00:27.504825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:32:19.210037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403416+0000","last_change":"2023-11-28T13:00:26.006323+0000","last_active":"2023-11-28T13:00:27.403416+0000","last_peered":"2023-11-28T13:00:27.403416+0000","last_clean":"2023-11-28T13:00:27.403416+0000","last_became_active":"2023-11-28T13:00:26.004227+0000","last_became_peered":"2023-11-28T13:00:26.004227+0000","last_unstale":"2023-11-28T13:00:27.403416+0000","last_undegraded":"2023-11-28T13:00:27.403416+0000","last_fullsized":"2023-11-28T13:00:27.403416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:28:40.766436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503349+0000","last_change":"2023-11-28T13:00:25.631107+0000","last_active":"2023-11-28T13:00:27.503349+0000","last_peered":"2023-11-28T13:00:27.503349+0000","last_clean":"2023-11-28T13:00:27.503349+0000","last_became_active":"2023-11-28T13:00:25.630796+0000","last_became_peered":"2023-11-28T13:00:25.630796+0000","last_unstale":"2023-11-28T13:00:27.503349+0000","last_undegraded":"2023-11-28T13:00:27.503349+0000","last_fullsized":"2023-11-28T13:00:27.503349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:00:19.501393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.987768+0000","last_change":"2023-11-28T13:00:26.003801+0000","last_active":"2023-11-28T13:00:26.987768+0000","last_peered":"2023-11-28T13:00:26.987768+0000","last_clean":"2023-11-28T13:00:26.987768+0000","last_became_active":"2023-11-28T13:00:26.003286+0000","last_became_peered":"2023-11-28T13:00:26.003286+0000","last_unstale":"2023-11-28T13:00:26.987768+0000","last_undegraded":"2023-11-28T13:00:26.987768+0000","last_fullsized":"2023-11-28T13:00:26.987768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:34:18.748847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503812+0000","last_change":"2023-11-28T13:00:25.630853+0000","last_active":"2023-11-28T13:00:27.503812+0000","last_peered":"2023-11-28T13:00:27.503812+0000","last_clean":"2023-11-28T13:00:27.503812+0000","last_became_active":"2023-11-28T13:00:25.630524+0000","last_became_peered":"2023-11-28T13:00:25.630524+0000","last_unstale":"2023-11-28T13:00:27.503812+0000","last_undegraded":"2023-11-28T13:00:27.503812+0000","last_fullsized":"2023-11-28T13:00:27.503812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:57.620680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503291+0000","last_change":"2023-11-28T13:00:26.015790+0000","last_active":"2023-11-28T13:00:27.503291+0000","last_peered":"2023-11-28T13:00:27.503291+0000","last_clean":"2023-11-28T13:00:27.503291+0000","last_became_active":"2023-11-28T13:00:26.015455+0000","last_became_peered":"2023-11-28T13:00:26.015455+0000","last_unstale":"2023-11-28T13:00:27.503291+0000","last_undegraded":"2023-11-28T13:00:27.503291+0000","last_fullsized":"2023-11-28T13:00:27.503291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:14.020668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229251+0000","last_change":"2023-11-28T13:00:25.628221+0000","last_active":"2023-11-28T13:00:27.229251+0000","last_peered":"2023-11-28T13:00:27.229251+0000","last_clean":"2023-11-28T13:00:27.229251+0000","last_became_active":"2023-11-28T13:00:25.627937+0000","last_became_peered":"2023-11-28T13:00:25.627937+0000","last_unstale":"2023-11-28T13:00:27.229251+0000","last_undegraded":"2023-11-28T13:00:27.229251+0000","last_fullsized":"2023-11-28T13:00:27.229251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:06:47.002190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503100+0000","last_change":"2023-11-28T13:00:26.016462+0000","last_active":"2023-11-28T13:00:27.503100+0000","last_peered":"2023-11-28T13:00:27.503100+0000","last_clean":"2023-11-28T13:00:27.503100+0000","last_became_active":"2023-11-28T13:00:26.016156+0000","last_became_peered":"2023-11-28T13:00:26.016156+0000","last_unstale":"2023-11-28T13:00:27.503100+0000","last_undegraded":"2023-11-28T13:00:27.503100+0000","last_fullsized":"2023-11-28T13:00:27.503100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:13:57.056758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229580+0000","last_change":"2023-11-28T13:00:25.629372+0000","last_active":"2023-11-28T13:00:27.229580+0000","last_peered":"2023-11-28T13:00:27.229580+0000","last_clean":"2023-11-28T13:00:27.229580+0000","last_became_active":"2023-11-28T13:00:25.629083+0000","last_became_peered":"2023-11-28T13:00:25.629083+0000","last_unstale":"2023-11-28T13:00:27.229580+0000","last_undegraded":"2023-11-28T13:00:27.229580+0000","last_fullsized":"2023-11-28T13:00:27.229580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:52.597204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403082+0000","last_change":"2023-11-28T13:00:26.006858+0000","last_active":"2023-11-28T13:00:27.403082+0000","last_peered":"2023-11-28T13:00:27.403082+0000","last_clean":"2023-11-28T13:00:27.403082+0000","last_became_active":"2023-11-28T13:00:26.006232+0000","last_became_peered":"2023-11-28T13:00:26.006232+0000","last_unstale":"2023-11-28T13:00:27.403082+0000","last_undegraded":"2023-11-28T13:00:27.403082+0000","last_fullsized":"2023-11-28T13:00:27.403082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:47.321386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403725+0000","last_change":"2023-11-28T13:00:25.628879+0000","last_active":"2023-11-28T13:00:27.403725+0000","last_peered":"2023-11-28T13:00:27.403725+0000","last_clean":"2023-11-28T13:00:27.403725+0000","last_became_active":"2023-11-28T13:00:25.628575+0000","last_became_peered":"2023-11-28T13:00:25.628575+0000","last_unstale":"2023-11-28T13:00:27.403725+0000","last_undegraded":"2023-11-28T13:00:27.403725+0000","last_fullsized":"2023-11-28T13:00:27.403725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:52.456316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502869+0000","last_change":"2023-11-28T13:00:26.014792+0000","last_active":"2023-11-28T13:00:27.502869+0000","last_peered":"2023-11-28T13:00:27.502869+0000","last_clean":"2023-11-28T13:00:27.502869+0000","last_became_active":"2023-11-28T13:00:26.014392+0000","last_became_peered":"2023-11-28T13:00:26.014392+0000","last_unstale":"2023-11-28T13:00:27.502869+0000","last_undegraded":"2023-11-28T13:00:27.502869+0000","last_fullsized":"2023-11-28T13:00:27.502869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:47.321386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504024+0000","last_change":"2023-11-28T13:00:25.630162+0000","last_active":"2023-11-28T13:00:27.504024+0000","last_peered":"2023-11-28T13:00:27.504024+0000","last_clean":"2023-11-28T13:00:27.504024+0000","last_became_active":"2023-11-28T13:00:25.629159+0000","last_became_peered":"2023-11-28T13:00:25.629159+0000","last_unstale":"2023-11-28T13:00:27.504024+0000","last_undegraded":"2023-11-28T13:00:27.504024+0000","last_fullsized":"2023-11-28T13:00:27.504024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:56:21.848420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9120,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362720,"statfs":{"total":96636764160,"available":96627425280,"internally_reserved":0,"allocated":876544,"data_stored":686402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8008,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363832,"statfs":{"total":96636764160,"available":96628563968,"internally_reserved":0,"allocated":262144,"data_stored":94906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":95874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8068,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363772,"statfs":{"total":96636764160,"available":96628502528,"internally_reserved":0,"allocated":258048,"data_stored":94360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8064,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363776,"statfs":{"total":96636764160,"available":96628506624,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9096,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362744,"statfs":{"total":96636764160,"available":96627449856,"internally_reserved":0,"allocated":851968,"data_stored":685204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:00:34.730 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T13:00:34.731 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-28T13:00:34.731 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-28T13:00:34.731 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-28T13:00:34.731 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-28T13:00:34.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.840+0000 7f9e171e7700 1 Processor -- start 2023-11-28T13:00:34.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.840+0000 7f9e171e7700 1 -- start start 2023-11-28T13:00:34.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.840+0000 7f9e171e7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9e100b3910 0x7f9e1006b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:34.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.840+0000 7f9e171e7700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9e1006c910 0x7f9e1006d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:34.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.840+0000 7f9e171e7700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e1006c480 con 0x7f9e10070070 2023-11-28T13:00:34.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.840+0000 7f9e171e7700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e1006dbe0 con 0x7f9e100b3910 2023-11-28T13:00:34.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.840+0000 7f9e171e7700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1006dec0 con 0x7f9e1006c910 2023-11-28T13:00:34.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.840+0000 7f9e169e6700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9e10070070 0x7f9e1015db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:37042/0 (socket says 172.21.15.82:37042) 2023-11-28T13:00:34.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.840+0000 7f9e169e6700 1 -- 172.21.15.82:0/1619138044 learned_addr learned my addr 172.21.15.82:0/1619138044 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:34.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.840+0000 7f9e161e5700 1 --2- 172.21.15.82:0/1619138044 >> v2:172.21.15.82:3300/0 conn(0x7f9e100b3910 0x7f9e1006b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:34.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.840+0000 7f9e159e4700 1 --2- 172.21.15.82:0/1619138044 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9e1006c910 0x7f9e1006d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:34.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.840+0000 7f9e151e3700 1 -- 172.21.15.82:0/1619138044 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817976366 0 0) 0x7f9e1006c480 con 0x7f9e10070070 2023-11-28T13:00:34.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.840+0000 7f9e151e3700 1 -- 172.21.15.82:0/1619138044 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dfc0035d0 con 0x7f9e10070070 2023-11-28T13:00:34.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.840+0000 7f9e161e5700 1 -- 172.21.15.82:0/1619138044 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9e1006c910 msgr2=0x7f9e1006d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:34.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.840+0000 7f9e161e5700 1 --2- 172.21.15.82:0/1619138044 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9e1006c910 0x7f9e1006d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:34.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.840+0000 7f9e161e5700 1 -- 172.21.15.82:0/1619138044 >> v1:172.21.15.82:6789/0 conn(0x7f9e10070070 legacy=0x7f9e1015db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:34.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.840+0000 7f9e161e5700 1 -- 172.21.15.82:0/1619138044 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1006c110 con 0x7f9e100b3910 2023-11-28T13:00:34.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.840+0000 7f9e161e5700 1 --2- 172.21.15.82:0/1619138044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e100b3910 0x7f9e1006b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9e00009850 tx=0x7f9e00009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5cc212aa223e6d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:34.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.840+0000 7f9e151e3700 1 -- 172.21.15.82:0/1619138044 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e00011830 con 0x7f9e100b3910 2023-11-28T13:00:34.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.840+0000 7f9e151e3700 1 -- 172.21.15.82:0/1619138044 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e00011990 con 0x7f9e100b3910 2023-11-28T13:00:34.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.840+0000 7f9e151e3700 1 -- 172.21.15.82:0/1619138044 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e00011d00 con 0x7f9e100b3910 2023-11-28T13:00:34.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e171e7700 1 -- 172.21.15.82:0/1619138044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e100b3910 msgr2=0x7f9e1006b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:34.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e171e7700 1 --2- 172.21.15.82:0/1619138044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e100b3910 0x7f9e1006b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9e00009850 tx=0x7f9e00009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:34.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e171e7700 1 -- 172.21.15.82:0/1619138044 shutdown_connections 2023-11-28T13:00:34.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e171e7700 1 --2- 172.21.15.82:0/1619138044 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9e1006c910 0x7f9e1006d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:34.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e171e7700 1 --2- 172.21.15.82:0/1619138044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e100b3910 0x7f9e1006b0a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:34.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e171e7700 1 -- 172.21.15.82:0/1619138044 >> 172.21.15.82:0/1619138044 conn(0x7f9e100ce600 msgr2=0x7f9e100ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:34.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e171e7700 1 -- 172.21.15.82:0/1619138044 shutdown_connections 2023-11-28T13:00:34.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e171e7700 1 -- 172.21.15.82:0/1619138044 wait complete. 2023-11-28T13:00:34.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e171e7700 1 Processor -- start 2023-11-28T13:00:34.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e171e7700 1 -- start start 2023-11-28T13:00:34.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e171e7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e1006c910 0x7f9e10158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:34.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e171e7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e10070070 0x7f9e101f7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:34.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e171e7700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9e100b3910 0x7f9e101f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:34.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e171e7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e101f8540 con 0x7f9e10070070 2023-11-28T13:00:34.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e171e7700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e10159160 con 0x7f9e1006c910 2023-11-28T13:00:34.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e171e7700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e101f7930 con 0x7f9e100b3910 2023-11-28T13:00:34.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e159e4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e10070070 0x7f9e101f7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:34.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e159e4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e10070070 0x7f9e101f7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57400/0 (socket says 172.21.15.82:57400) 2023-11-28T13:00:34.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e159e4700 1 -- 172.21.15.82:0/3326326416 learned_addr learned my addr 172.21.15.82:0/3326326416 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:34.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e169e6700 1 --2- 172.21.15.82:0/3326326416 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9e100b3910 0x7f9e101f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:34.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e161e5700 1 --2- 172.21.15.82:0/3326326416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e1006c910 0x7f9e10158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:34.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e159e4700 1 -- 172.21.15.82:0/3326326416 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9e100b3910 msgr2=0x7f9e101f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:34.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e159e4700 1 --2- 172.21.15.82:0/3326326416 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9e100b3910 0x7f9e101f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:34.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e159e4700 1 -- 172.21.15.82:0/3326326416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e1006c910 msgr2=0x7f9e10158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:34.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e159e4700 1 --2- 172.21.15.82:0/3326326416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e1006c910 0x7f9e10158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:34.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e159e4700 1 -- 172.21.15.82:0/3326326416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e000094b0 con 0x7f9e10070070 2023-11-28T13:00:34.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e161e5700 1 --2- 172.21.15.82:0/3326326416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e1006c910 0x7f9e10158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:34.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.844+0000 7f9e159e4700 1 --2- 172.21.15.82:0/3326326416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e10070070 0x7f9e101f7030 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c00efc0 tx=0x7f9e0c00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:34.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.848+0000 7f9e06ffd700 1 -- 172.21.15.82:0/3326326416 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c00cc00 con 0x7f9e10070070 2023-11-28T13:00:34.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.848+0000 7f9e171e7700 1 -- 172.21.15.82:0/3326326416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e1006d860 con 0x7f9e10070070 2023-11-28T13:00:34.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.848+0000 7f9e06ffd700 1 -- 172.21.15.82:0/3326326416 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0c00f040 con 0x7f9e10070070 2023-11-28T13:00:34.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.848+0000 7f9e06ffd700 1 -- 172.21.15.82:0/3326326416 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c014480 con 0x7f9e10070070 2023-11-28T13:00:34.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.848+0000 7f9e171e7700 1 -- 172.21.15.82:0/3326326416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e100c8f80 con 0x7f9e10070070 2023-11-28T13:00:34.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.848+0000 7f9e171e7700 1 -- 172.21.15.82:0/3326326416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e100b3ce0 con 0x7f9e10070070 2023-11-28T13:00:34.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.848+0000 7f9e06ffd700 1 -- 172.21.15.82:0/3326326416 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9e0c0145e0 con 0x7f9e10070070 2023-11-28T13:00:34.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.848+0000 7f9e06ffd700 1 --2- 172.21.15.82:0/3326326416 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9df4064ee0 0x7f9df4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:34.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.848+0000 7f9e06ffd700 1 -- 172.21.15.82:0/3326326416 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9e0c0830c0 con 0x7f9e10070070 2023-11-28T13:00:34.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.848+0000 7f9e161e5700 1 --2- 172.21.15.82:0/3326326416 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9df4064ee0 0x7f9df4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:34.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.848+0000 7f9e161e5700 1 --2- 172.21.15.82:0/3326326416 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9df4064ee0 0x7f9df4067390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9e000090b0 tx=0x7f9e00008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:34.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:34.856+0000 7f9e06ffd700 1 -- 172.21.15.82:0/3326326416 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9e0c051260 con 0x7f9e10070070 2023-11-28T13:00:35.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.060+0000 7f9e171e7700 1 -- 172.21.15.82:0/3326326416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f9e10065fc0 con 0x7f9e10070070 2023-11-28T13:00:35.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.068+0000 7f9e06ffd700 1 -- 172.21.15.82:0/3326326416 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+161629 (secure 0 0 0) 0x7f9e0c054880 con 0x7f9e10070070 2023-11-28T13:00:35.073 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:35.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.072+0000 7f9e171e7700 1 -- 172.21.15.82:0/3326326416 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9df4064ee0 msgr2=0x7f9df4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.072+0000 7f9e171e7700 1 --2- 172.21.15.82:0/3326326416 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9df4064ee0 0x7f9df4067390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9e000090b0 tx=0x7f9e00008030 comp rx=0 tx=0).stop 2023-11-28T13:00:35.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.072+0000 7f9e171e7700 1 -- 172.21.15.82:0/3326326416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e10070070 msgr2=0x7f9e101f7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.072+0000 7f9e171e7700 1 --2- 172.21.15.82:0/3326326416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e10070070 0x7f9e101f7030 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c00efc0 tx=0x7f9e0c00c0c0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.072+0000 7f9e171e7700 1 -- 172.21.15.82:0/3326326416 shutdown_connections 2023-11-28T13:00:35.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.072+0000 7f9e171e7700 1 --2- 172.21.15.82:0/3326326416 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9df4064ee0 0x7f9df4067390 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.072+0000 7f9e171e7700 1 --2- 172.21.15.82:0/3326326416 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9e100b3910 0x7f9e101f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.072+0000 7f9e171e7700 1 --2- 172.21.15.82:0/3326326416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e10070070 0x7f9e101f7030 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.072+0000 7f9e171e7700 1 --2- 172.21.15.82:0/3326326416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e1006c910 0x7f9e10158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.072+0000 7f9e171e7700 1 -- 172.21.15.82:0/3326326416 >> 172.21.15.82:0/3326326416 conn(0x7f9e100ce600 msgr2=0x7f9e100704b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:35.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.072+0000 7f9e171e7700 1 -- 172.21.15.82:0/3326326416 shutdown_connections 2023-11-28T13:00:35.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.072+0000 7f9e171e7700 1 -- 172.21.15.82:0/3326326416 wait complete. 2023-11-28T13:00:35.089 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":5,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":36500},{"type":"v1","addr":"172.21.15.82:6833","nonce":36500}]},"active_addr":"172.21.15.82:6833/36500","active_change":"2023-11-28T13:00:07.140197+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4099,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":1444149427}]},{"addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":1886953548}]},{"addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2830475205}]},{"addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":592534607}]}]} 2023-11-28T13:00:35.092 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-28T13:00:35.092 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-28T13:00:35.092 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:00:35.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.200+0000 7f2431661700 1 Processor -- start 2023-11-28T13:00:35.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.200+0000 7f2431661700 1 -- start start 2023-11-28T13:00:35.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.200+0000 7f2431661700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f242c1591c0 0x7f242c15d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.200+0000 7f2431661700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f242c070070 0x7f242c0704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.200+0000 7f2431661700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242c070a10 con 0x7f242c158df0 2023-11-28T13:00:35.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.200+0000 7f2431661700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f242c15da50 con 0x7f242c070070 2023-11-28T13:00:35.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.200+0000 7f2431661700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f242c0c9e20 con 0x7f242c1591c0 2023-11-28T13:00:35.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.200+0000 7f2430e60700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f242c070070 0x7f242c0704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.204+0000 7f2430e60700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f242c070070 0x7f242c0704d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57414/0 (socket says 172.21.15.82:57414) 2023-11-28T13:00:35.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.204+0000 7f2430e60700 1 -- 172.21.15.82:0/1937300077 learned_addr learned my addr 172.21.15.82:0/1937300077 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:35.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.204+0000 7f242b7fe700 1 --2- 172.21.15.82:0/1937300077 >> v2:172.21.15.114:3300/0 conn(0x7f242c1591c0 0x7f242c15d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.204+0000 7f2430e60700 1 -- 172.21.15.82:0/1937300077 >> v2:172.21.15.114:3300/0 conn(0x7f242c1591c0 msgr2=0x7f242c15d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:35.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.204+0000 7f2430e60700 1 --2- 172.21.15.82:0/1937300077 >> v2:172.21.15.114:3300/0 conn(0x7f242c1591c0 0x7f242c15d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.204+0000 7f2430e60700 1 -- 172.21.15.82:0/1937300077 >> v1:172.21.15.114:6789/0 conn(0x7f242c158df0 legacy=0x7f242c06c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.204+0000 7f2430e60700 1 -- 172.21.15.82:0/1937300077 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c0cc640 con 0x7f242c070070 2023-11-28T13:00:35.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.204+0000 7f2430e60700 1 --2- 172.21.15.82:0/1937300077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f242c070070 0x7f242c0704d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f242c0b11a0 tx=0x7f242400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef70a83a5caa5827 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.204+0000 7f242affd700 1 -- 172.21.15.82:0/1937300077 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242400e070 con 0x7f242c070070 2023-11-28T13:00:35.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.204+0000 7f242affd700 1 -- 172.21.15.82:0/1937300077 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242400b910 con 0x7f242c070070 2023-11-28T13:00:35.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.204+0000 7f242affd700 1 -- 172.21.15.82:0/1937300077 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242400bcc0 con 0x7f242c070070 2023-11-28T13:00:35.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.204+0000 7f2431661700 1 -- 172.21.15.82:0/1937300077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f242c070070 msgr2=0x7f242c0704d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.204+0000 7f2431661700 1 --2- 172.21.15.82:0/1937300077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f242c070070 0x7f242c0704d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f242c0b11a0 tx=0x7f242400b330 comp rx=0 tx=0).stop 2023-11-28T13:00:35.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.204+0000 7f2431661700 1 -- 172.21.15.82:0/1937300077 shutdown_connections 2023-11-28T13:00:35.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.204+0000 7f2431661700 1 --2- 172.21.15.82:0/1937300077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f242c070070 0x7f242c0704d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.204+0000 7f2431661700 1 --2- 172.21.15.82:0/1937300077 >> v2:172.21.15.114:3300/0 conn(0x7f242c1591c0 0x7f242c15d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.204+0000 7f2431661700 1 -- 172.21.15.82:0/1937300077 >> 172.21.15.82:0/1937300077 conn(0x7f242c0ce600 msgr2=0x7f242c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:35.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.204+0000 7f2431661700 1 -- 172.21.15.82:0/1937300077 shutdown_connections 2023-11-28T13:00:35.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.204+0000 7f2431661700 1 -- 172.21.15.82:0/1937300077 wait complete. 2023-11-28T13:00:35.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.208+0000 7f2431661700 1 Processor -- start 2023-11-28T13:00:35.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.208+0000 7f2431661700 1 -- start start 2023-11-28T13:00:35.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.208+0000 7f2431661700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f242c070070 0x7f242c0c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.208+0000 7f2431661700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f242c158df0 0x7f242c152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.208+0000 7f2431661700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f242c1591c0 0x7f242c15b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.208+0000 7f2431661700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c0c56d0 con 0x7f242c1591c0 2023-11-28T13:00:35.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.208+0000 7f2431661700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c158190 con 0x7f242c158df0 2023-11-28T13:00:35.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.208+0000 7f2431661700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242c0c8310 con 0x7f242c070070 2023-11-28T13:00:35.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.208+0000 7f2430e60700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f242c1591c0 0x7f242c15b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.208+0000 7f2430e60700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f242c1591c0 0x7f242c15b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57416/0 (socket says 172.21.15.82:57416) 2023-11-28T13:00:35.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.208+0000 7f2430e60700 1 -- 172.21.15.82:0/410937911 learned_addr learned my addr 172.21.15.82:0/410937911 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:35.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.208+0000 7f242bfff700 1 --2- 172.21.15.82:0/410937911 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f242c070070 0x7f242c0c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.208+0000 7f242b7fe700 1 --2- 172.21.15.82:0/410937911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f242c158df0 0x7f242c152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.208+0000 7f2430e60700 1 -- 172.21.15.82:0/410937911 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f242c070070 msgr2=0x7f242c0c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.208+0000 7f2430e60700 1 --2- 172.21.15.82:0/410937911 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f242c070070 0x7f242c0c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.208+0000 7f2430e60700 1 -- 172.21.15.82:0/410937911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f242c158df0 msgr2=0x7f242c152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.208+0000 7f2430e60700 1 --2- 172.21.15.82:0/410937911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f242c158df0 0x7f242c152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.208+0000 7f2430e60700 1 -- 172.21.15.82:0/410937911 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2424009b30 con 0x7f242c1591c0 2023-11-28T13:00:35.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.212+0000 7f2430e60700 1 --2- 172.21.15.82:0/410937911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f242c1591c0 0x7f242c15b7d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f242c071980 tx=0x7f2424004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.212+0000 7f2428ff9700 1 -- 172.21.15.82:0/410937911 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2424004880 con 0x7f242c1591c0 2023-11-28T13:00:35.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.212+0000 7f2428ff9700 1 -- 172.21.15.82:0/410937911 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24240099b0 con 0x7f242c1591c0 2023-11-28T13:00:35.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.212+0000 7f2431661700 1 -- 172.21.15.82:0/410937911 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f242c0c9ab0 con 0x7f242c1591c0 2023-11-28T13:00:35.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.212+0000 7f2428ff9700 1 -- 172.21.15.82:0/410937911 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242401b670 con 0x7f242c1591c0 2023-11-28T13:00:35.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.212+0000 7f2431661700 1 -- 172.21.15.82:0/410937911 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f242c0c97d0 con 0x7f242c1591c0 2023-11-28T13:00:35.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.212+0000 7f2431661700 1 -- 172.21.15.82:0/410937911 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f242c0c9480 con 0x7f242c1591c0 2023-11-28T13:00:35.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.212+0000 7f2428ff9700 1 -- 172.21.15.82:0/410937911 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f242402b070 con 0x7f242c1591c0 2023-11-28T13:00:35.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.216+0000 7f2428ff9700 1 --2- 172.21.15.82:0/410937911 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2418064ee0 0x7f2418067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.216+0000 7f242bfff700 1 --2- 172.21.15.82:0/410937911 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2418064ee0 0x7f2418067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.216+0000 7f2428ff9700 1 -- 172.21.15.82:0/410937911 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2424083990 con 0x7f242c1591c0 2023-11-28T13:00:35.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.216+0000 7f242bfff700 1 --2- 172.21.15.82:0/410937911 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2418064ee0 0x7f2418067390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f241c000f60 tx=0x7f241c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.220+0000 7f2428ff9700 1 -- 172.21.15.82:0/410937911 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2424051bd0 con 0x7f242c1591c0 2023-11-28T13:00:35.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.380+0000 7f2431661700 1 -- 172.21.15.82:0/410937911 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f242c065fc0 con 0x7f242c1591c0 2023-11-28T13:00:35.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.384+0000 7f2428ff9700 1 -- 172.21.15.82:0/410937911 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17811 (secure 0 0 0) 0x7f24240551f0 con 0x7f242c1591c0 2023-11-28T13:00:35.388 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:35.388 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:00:26.981345+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:00:24.360641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T13:00:24.960863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:00:35.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.384+0000 7f2431661700 1 -- 172.21.15.82:0/410937911 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2418064ee0 msgr2=0x7f2418067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.384+0000 7f2431661700 1 --2- 172.21.15.82:0/410937911 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2418064ee0 0x7f2418067390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f241c000f60 tx=0x7f241c009040 comp rx=0 tx=0).stop 2023-11-28T13:00:35.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.388+0000 7f2431661700 1 -- 172.21.15.82:0/410937911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f242c1591c0 msgr2=0x7f242c15b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.388+0000 7f2431661700 1 --2- 172.21.15.82:0/410937911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f242c1591c0 0x7f242c15b7d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f242c071980 tx=0x7f2424004af0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.388+0000 7f2431661700 1 -- 172.21.15.82:0/410937911 shutdown_connections 2023-11-28T13:00:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.388+0000 7f2431661700 1 --2- 172.21.15.82:0/410937911 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2418064ee0 0x7f2418067390 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.388+0000 7f2431661700 1 --2- 172.21.15.82:0/410937911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f242c1591c0 0x7f242c15b7d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.388+0000 7f2431661700 1 --2- 172.21.15.82:0/410937911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f242c158df0 0x7f242c152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.388+0000 7f2431661700 1 --2- 172.21.15.82:0/410937911 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f242c070070 0x7f242c0c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.388+0000 7f2431661700 1 -- 172.21.15.82:0/410937911 >> 172.21.15.82:0/410937911 conn(0x7f242c0ce600 msgr2=0x7f242c0ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.388+0000 7f2431661700 1 -- 172.21.15.82:0/410937911 shutdown_connections 2023-11-28T13:00:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.388+0000 7f2431661700 1 -- 172.21.15.82:0/410937911 wait complete. 2023-11-28T13:00:35.404 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-28T13:00:35.405 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:00:35.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.516+0000 7f1768f03700 1 Processor -- start 2023-11-28T13:00:35.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.516+0000 7f1768f03700 1 -- start start 2023-11-28T13:00:35.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.516+0000 7f1768f03700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f176406dae0 0x7f176406b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.516+0000 7f1768f03700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f17640ae940 0x7f176406baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.516+0000 7f1768f03700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176415d5b0 con 0x7f1764158ed0 2023-11-28T13:00:35.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.516+0000 7f1768f03700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17640aee90 con 0x7f17640ae940 2023-11-28T13:00:35.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.516+0000 7f1768f03700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176415da40 con 0x7f176406dae0 2023-11-28T13:00:35.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.516+0000 7f1763fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f17640ae940 0x7f176406baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.516+0000 7f1763fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f17640ae940 0x7f176406baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57426/0 (socket says 172.21.15.82:57426) 2023-11-28T13:00:35.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.516+0000 7f1763fff700 1 -- 172.21.15.82:0/1021359864 learned_addr learned my addr 172.21.15.82:0/1021359864 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:35.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.520+0000 7f175affd700 1 --2- 172.21.15.82:0/1021359864 >> v2:172.21.15.114:3300/0 conn(0x7f176406dae0 0x7f176406b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.520+0000 7f1763fff700 1 -- 172.21.15.82:0/1021359864 >> v2:172.21.15.114:3300/0 conn(0x7f176406dae0 msgr2=0x7f176406b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:35.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.520+0000 7f1763fff700 1 --2- 172.21.15.82:0/1021359864 >> v2:172.21.15.114:3300/0 conn(0x7f176406dae0 0x7f176406b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.520+0000 7f1763fff700 1 -- 172.21.15.82:0/1021359864 >> v1:172.21.15.114:6789/0 conn(0x7f1764158ed0 legacy=0x7f176406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:35.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.520+0000 7f1763fff700 1 -- 172.21.15.82:0/1021359864 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176415cc80 con 0x7f17640ae940 2023-11-28T13:00:35.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.520+0000 7f1763fff700 1 --2- 172.21.15.82:0/1021359864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17640ae940 0x7f176406baa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f17640b2300 tx=0x7f175c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39354ba64f1ecf9c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.520+0000 7f1762ffd700 1 -- 172.21.15.82:0/1021359864 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c00e070 con 0x7f17640ae940 2023-11-28T13:00:35.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.520+0000 7f1762ffd700 1 -- 172.21.15.82:0/1021359864 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c003a40 con 0x7f17640ae940 2023-11-28T13:00:35.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.520+0000 7f1762ffd700 1 -- 172.21.15.82:0/1021359864 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c003df0 con 0x7f17640ae940 2023-11-28T13:00:35.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.520+0000 7f1768f03700 1 -- 172.21.15.82:0/1021359864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17640ae940 msgr2=0x7f176406baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.520+0000 7f1768f03700 1 --2- 172.21.15.82:0/1021359864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17640ae940 0x7f176406baa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f17640b2300 tx=0x7f175c00b330 comp rx=0 tx=0).stop 2023-11-28T13:00:35.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.520+0000 7f1768f03700 1 -- 172.21.15.82:0/1021359864 shutdown_connections 2023-11-28T13:00:35.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.520+0000 7f1768f03700 1 --2- 172.21.15.82:0/1021359864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17640ae940 0x7f176406baa0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.520+0000 7f1768f03700 1 --2- 172.21.15.82:0/1021359864 >> v2:172.21.15.114:3300/0 conn(0x7f176406dae0 0x7f176406b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.520+0000 7f1768f03700 1 -- 172.21.15.82:0/1021359864 >> 172.21.15.82:0/1021359864 conn(0x7f17640cf710 msgr2=0x7f17640cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:35.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.520+0000 7f1768f03700 1 -- 172.21.15.82:0/1021359864 shutdown_connections 2023-11-28T13:00:35.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.520+0000 7f1768f03700 1 -- 172.21.15.82:0/1021359864 wait complete. 2023-11-28T13:00:35.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.520+0000 7f1768f03700 1 Processor -- start 2023-11-28T13:00:35.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.520+0000 7f1768f03700 1 -- start start 2023-11-28T13:00:35.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f1768f03700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f176406dae0 0x7f17640c2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f1768f03700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17640ae940 0x7f176414d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f1768f03700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1764158ed0 0x7f176414dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f1768f03700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17640c4980 con 0x7f17640ae940 2023-11-28T13:00:35.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f1768f03700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17640c4c60 con 0x7f1764158ed0 2023-11-28T13:00:35.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f1768f03700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17640c4f40 con 0x7f176406dae0 2023-11-28T13:00:35.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f175affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17640ae940 0x7f176414d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f175affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17640ae940 0x7f176414d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57428/0 (socket says 172.21.15.82:57428) 2023-11-28T13:00:35.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f175affd700 1 -- 172.21.15.82:0/1178210804 learned_addr learned my addr 172.21.15.82:0/1178210804 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:35.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f1763fff700 1 --2- 172.21.15.82:0/1178210804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1764158ed0 0x7f176414dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f17637fe700 1 --2- 172.21.15.82:0/1178210804 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f176406dae0 0x7f17640c2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f175affd700 1 -- 172.21.15.82:0/1178210804 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f176406dae0 msgr2=0x7f17640c2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f175affd700 1 --2- 172.21.15.82:0/1178210804 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f176406dae0 0x7f17640c2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f175affd700 1 -- 172.21.15.82:0/1178210804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1764158ed0 msgr2=0x7f176414dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f175affd700 1 --2- 172.21.15.82:0/1178210804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1764158ed0 0x7f176414dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f175affd700 1 -- 172.21.15.82:0/1178210804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c009b30 con 0x7f17640ae940 2023-11-28T13:00:35.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f175affd700 1 --2- 172.21.15.82:0/1178210804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17640ae940 0x7f176414d660 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f174c00e730 tx=0x7f174c00eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f1760ff9700 1 -- 172.21.15.82:0/1178210804 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c013610 con 0x7f17640ae940 2023-11-28T13:00:35.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f1760ff9700 1 -- 172.21.15.82:0/1178210804 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c013770 con 0x7f17640ae940 2023-11-28T13:00:35.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f1768f03700 1 -- 172.21.15.82:0/1178210804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176415d240 con 0x7f17640ae940 2023-11-28T13:00:35.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f1760ff9700 1 -- 172.21.15.82:0/1178210804 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c013b20 con 0x7f17640ae940 2023-11-28T13:00:35.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.524+0000 7f1768f03700 1 -- 172.21.15.82:0/1178210804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176415cf60 con 0x7f17640ae940 2023-11-28T13:00:35.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.528+0000 7f1768f03700 1 -- 172.21.15.82:0/1178210804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17641592a0 con 0x7f17640ae940 2023-11-28T13:00:35.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.528+0000 7f1760ff9700 1 -- 172.21.15.82:0/1178210804 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f174c023070 con 0x7f17640ae940 2023-11-28T13:00:35.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.528+0000 7f1760ff9700 1 --2- 172.21.15.82:0/1178210804 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1744064ee0 0x7f1744067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.528+0000 7f17637fe700 1 --2- 172.21.15.82:0/1178210804 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1744064ee0 0x7f1744067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.528+0000 7f1760ff9700 1 -- 172.21.15.82:0/1178210804 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f174c081b10 con 0x7f17640ae940 2023-11-28T13:00:35.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.528+0000 7f17637fe700 1 --2- 172.21.15.82:0/1178210804 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1744064ee0 0x7f1744067390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1754009890 tx=0x7f1754008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.536+0000 7f1760ff9700 1 -- 172.21.15.82:0/1178210804 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f174c04fcb0 con 0x7f17640ae940 2023-11-28T13:00:35.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.700+0000 7f1768f03700 1 -- 172.21.15.82:0/1178210804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1764065fc0 con 0x7f17640ae940 2023-11-28T13:00:35.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.700+0000 7f1760ff9700 1 -- 172.21.15.82:0/1178210804 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17811 (secure 0 0 0) 0x7f174c0532d0 con 0x7f17640ae940 2023-11-28T13:00:35.706 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:35.706 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:00:26.981345+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:00:24.360641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T13:00:24.960863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:00:35.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.704+0000 7f1768f03700 1 -- 172.21.15.82:0/1178210804 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1744064ee0 msgr2=0x7f1744067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.704+0000 7f1768f03700 1 --2- 172.21.15.82:0/1178210804 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1744064ee0 0x7f1744067390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1754009890 tx=0x7f1754008040 comp rx=0 tx=0).stop 2023-11-28T13:00:35.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.704+0000 7f1768f03700 1 -- 172.21.15.82:0/1178210804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17640ae940 msgr2=0x7f176414d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.704+0000 7f1768f03700 1 --2- 172.21.15.82:0/1178210804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17640ae940 0x7f176414d660 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f174c00e730 tx=0x7f174c00eaf0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.704+0000 7f1768f03700 1 -- 172.21.15.82:0/1178210804 shutdown_connections 2023-11-28T13:00:35.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.704+0000 7f1768f03700 1 --2- 172.21.15.82:0/1178210804 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1744064ee0 0x7f1744067390 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.704+0000 7f1768f03700 1 --2- 172.21.15.82:0/1178210804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1764158ed0 0x7f176414dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.704+0000 7f1768f03700 1 --2- 172.21.15.82:0/1178210804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17640ae940 0x7f176414d660 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.704+0000 7f1768f03700 1 --2- 172.21.15.82:0/1178210804 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f176406dae0 0x7f17640c2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.704+0000 7f1768f03700 1 -- 172.21.15.82:0/1178210804 >> 172.21.15.82:0/1178210804 conn(0x7f17640cf710 msgr2=0x7f17640affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:35.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.704+0000 7f1768f03700 1 -- 172.21.15.82:0/1178210804 shutdown_connections 2023-11-28T13:00:35.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.704+0000 7f1768f03700 1 -- 172.21.15.82:0/1178210804 wait complete. 2023-11-28T13:00:35.722 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-28T13:00:35.722 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-28T13:00:35.723 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-28T13:00:35.723 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-28T13:00:35.723 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-28T13:00:35.724 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-28T13:00:35.724 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-28T13:00:35.724 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-28T13:00:35.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.868+0000 7f8450a46700 1 Processor -- start 2023-11-28T13:00:35.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.868+0000 7f8450a46700 1 -- start start 2023-11-28T13:00:35.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.868+0000 7f8450a46700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f844c070070 0x7f844c070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.868+0000 7f8450a46700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f844c0ced10 0x7f844c163070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.868+0000 7f8450a46700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f844c1585f0 con 0x7f844c141500 2023-11-28T13:00:35.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.868+0000 7f8450a46700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f844c15ca00 con 0x7f844c070070 2023-11-28T13:00:35.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.868+0000 7f8450a46700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844c070980 con 0x7f844c0ced10 2023-11-28T13:00:35.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.868+0000 7f844a59c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f844c141500 0x7f844c069bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:37054/0 (socket says 172.21.15.82:37054) 2023-11-28T13:00:35.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.868+0000 7f844a59c700 1 -- 172.21.15.82:0/4013276692 learned_addr learned my addr 172.21.15.82:0/4013276692 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:35.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.868+0000 7f844ad9d700 1 --2- 172.21.15.82:0/4013276692 >> v2:172.21.15.82:3300/0 conn(0x7f844c070070 0x7f844c070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.868+0000 7f844b59e700 1 --2- 172.21.15.82:0/4013276692 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f844c0ced10 0x7f844c163070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.868+0000 7f8449d9b700 1 -- 172.21.15.82:0/4013276692 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104612165 0 0) 0x7f844c1585f0 con 0x7f844c141500 2023-11-28T13:00:35.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.868+0000 7f8449d9b700 1 -- 172.21.15.82:0/4013276692 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84340035d0 con 0x7f844c141500 2023-11-28T13:00:35.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f844b59e700 1 -- 172.21.15.82:0/4013276692 >> v2:172.21.15.82:3300/0 conn(0x7f844c070070 msgr2=0x7f844c070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:35.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f844b59e700 1 --2- 172.21.15.82:0/4013276692 >> v2:172.21.15.82:3300/0 conn(0x7f844c070070 0x7f844c070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f844b59e700 1 -- 172.21.15.82:0/4013276692 >> v1:172.21.15.82:6789/0 conn(0x7f844c141500 legacy=0x7f844c069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f844b59e700 1 -- 172.21.15.82:0/4013276692 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c15bd80 con 0x7f844c0ced10 2023-11-28T13:00:35.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f844ad9d700 1 --2- 172.21.15.82:0/4013276692 >> v2:172.21.15.82:3300/0 conn(0x7f844c070070 0x7f844c070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:35.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f844b59e700 1 --2- 172.21.15.82:0/4013276692 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f844c0ced10 0x7f844c163070 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f843c009850 tx=0x7f843c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d396df9d5e32515 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7fa489483700 1 Processor -- start 2023-11-28T13:00:35.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7fa489483700 1 -- start start 2023-11-28T13:00:35.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f8449d9b700 1 -- 172.21.15.82:0/4013276692 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c010a90 con 0x7f844c0ced10 2023-11-28T13:00:35.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f8449d9b700 1 -- 172.21.15.82:0/4013276692 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843c010bf0 con 0x7f844c0ced10 2023-11-28T13:00:35.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f8449d9b700 1 -- 172.21.15.82:0/4013276692 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c018440 con 0x7f844c0ced10 2023-11-28T13:00:35.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7fa489483700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa484070070 0x7fa4840cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7fa489483700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa4840cc1d0 0x7fa484069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7fa489483700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48406de00 con 0x7fa48406d430 2023-11-28T13:00:35.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7fa489483700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48406b520 con 0x7fa4840cc1d0 2023-11-28T13:00:35.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7fa489483700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4840ce420 con 0x7fa484070070 2023-11-28T13:00:35.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f50ae872700 1 Processor -- start 2023-11-28T13:00:35.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f50ae872700 1 -- start start 2023-11-28T13:00:35.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f8450a46700 1 -- 172.21.15.82:0/4013276692 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f844c0ced10 msgr2=0x7f844c163070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f8450a46700 1 --2- 172.21.15.82:0/4013276692 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f844c0ced10 0x7f844c163070 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f843c009850 tx=0x7f843c009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:35.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f8450a46700 1 -- 172.21.15.82:0/4013276692 shutdown_connections 2023-11-28T13:00:35.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f8450a46700 1 --2- 172.21.15.82:0/4013276692 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f844c0ced10 0x7f844c163070 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f8450a46700 1 --2- 172.21.15.82:0/4013276692 >> v2:172.21.15.82:3300/0 conn(0x7f844c070070 0x7f844c070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f8450a46700 1 -- 172.21.15.82:0/4013276692 >> 172.21.15.82:0/4013276692 conn(0x7f844c0cbd10 msgr2=0x7f844c0ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:35.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f8450a46700 1 -- 172.21.15.82:0/4013276692 shutdown_connections 2023-11-28T13:00:35.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7fa488c82700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa4840cc1d0 0x7fa484069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f8450a46700 1 -- 172.21.15.82:0/4013276692 wait complete. 2023-11-28T13:00:35.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7fa488c82700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa4840cc1d0 0x7fa484069bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57446/0 (socket says 172.21.15.82:57446) 2023-11-28T13:00:35.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7fa488c82700 1 -- 172.21.15.82:0/193555655 learned_addr learned my addr 172.21.15.82:0/193555655 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:35.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f50ae872700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f50a8070070 0x7f50a8070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f50ae872700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50a80c1910 0x7f50a806c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f50ae872700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a8070980 con 0x7f50a8160900 2023-11-28T13:00:35.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f50ae872700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a80ce030 con 0x7f50a8070070 2023-11-28T13:00:35.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f50ae872700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a80ce310 con 0x7f50a80c1910 2023-11-28T13:00:35.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f50ad870700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f50a8070070 0x7f50a8070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f50ad870700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f50a8070070 0x7f50a8070440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:50938/0 (socket says 172.21.15.82:50938) 2023-11-28T13:00:35.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f50ad06f700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f50a8160900 0x7f50a80cc1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:35042/0 (socket says 172.21.15.82:35042) 2023-11-28T13:00:35.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f50ad870700 1 -- 172.21.15.82:0/3044061963 learned_addr learned my addr 172.21.15.82:0/3044061963 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:35.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7fa488c82700 1 -- 172.21.15.82:0/193555655 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa484070070 msgr2=0x7fa4840cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:35.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7fa483fff700 1 --2- 172.21.15.82:0/193555655 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa484070070 0x7fa4840cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f50ae071700 1 --2- 172.21.15.82:0/3044061963 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50a80c1910 0x7f50a806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7fa488c82700 1 --2- 172.21.15.82:0/193555655 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa484070070 0x7fa4840cdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7fa488c82700 1 -- 172.21.15.82:0/193555655 >> v1:172.21.15.114:6789/0 conn(0x7fa48406d430 legacy=0x7fa484070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7fa488c82700 1 -- 172.21.15.82:0/193555655 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48406cb20 con 0x7fa4840cc1d0 2023-11-28T13:00:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7fa483fff700 1 --2- 172.21.15.82:0/193555655 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa484070070 0x7fa4840cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:00:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7fa488c82700 1 --2- 172.21.15.82:0/193555655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4840cc1d0 0x7fa484069bc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa474009b70 tx=0x7fa474009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe1de33cc003ffb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f50ad870700 1 -- 172.21.15.82:0/3044061963 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50a80c1910 msgr2=0x7f50a806c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:35.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f50ad870700 1 --2- 172.21.15.82:0/3044061963 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50a80c1910 0x7f50a806c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f50ad870700 1 -- 172.21.15.82:0/3044061963 >> v1:172.21.15.114:6789/0 conn(0x7f50a8160900 legacy=0x7f50a80cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f50ad870700 1 -- 172.21.15.82:0/3044061963 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a806a5d0 con 0x7f50a8070070 2023-11-28T13:00:35.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7fa482ffd700 1 -- 172.21.15.82:0/193555655 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa474004230 con 0x7fa4840cc1d0 2023-11-28T13:00:35.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7fa482ffd700 1 -- 172.21.15.82:0/193555655 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa474004390 con 0x7fa4840cc1d0 2023-11-28T13:00:35.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7fa482ffd700 1 -- 172.21.15.82:0/193555655 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa474004230 con 0x7fa4840cc1d0 2023-11-28T13:00:35.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f8450a46700 1 Processor -- start 2023-11-28T13:00:35.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f50ad870700 1 --2- 172.21.15.82:0/3044061963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50a8070070 0x7f50a8070440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009910 tx=0x7f50a4009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3994d949d0386bc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.872+0000 7f8450a46700 1 -- start start 2023-11-28T13:00:35.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f50ac86e700 1 -- 172.21.15.82:0/3044061963 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a4011830 con 0x7f50a8070070 2023-11-28T13:00:35.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f50ac86e700 1 -- 172.21.15.82:0/3044061963 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a4011990 con 0x7f50a8070070 2023-11-28T13:00:35.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f0d47089700 1 Processor -- start 2023-11-28T13:00:35.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fa489483700 1 -- 172.21.15.82:0/193555655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4840cc1d0 msgr2=0x7fa484069bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fa489483700 1 --2- 172.21.15.82:0/193555655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4840cc1d0 0x7fa484069bc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa474009b70 tx=0x7fa474009e80 comp rx=0 tx=0).stop 2023-11-28T13:00:35.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fca0dba5700 1 Processor -- start 2023-11-28T13:00:35.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f0d47089700 1 -- start start 2023-11-28T13:00:35.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f3a62bc1700 1 Processor -- start 2023-11-28T13:00:35.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f3a62bc1700 1 -- start start 2023-11-28T13:00:35.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f50ae872700 1 -- 172.21.15.82:0/3044061963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50a8070070 msgr2=0x7f50a8070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f50ae872700 1 --2- 172.21.15.82:0/3044061963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50a8070070 0x7f50a8070440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009910 tx=0x7f50a4009c20 comp rx=0 tx=0).stop 2023-11-28T13:00:35.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f50ae872700 1 -- 172.21.15.82:0/3044061963 shutdown_connections 2023-11-28T13:00:35.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f50ae872700 1 --2- 172.21.15.82:0/3044061963 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50a80c1910 0x7f50a806c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f50ae872700 1 --2- 172.21.15.82:0/3044061963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50a8070070 0x7f50a8070440 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f50ae872700 1 -- 172.21.15.82:0/3044061963 >> 172.21.15.82:0/3044061963 conn(0x7f50a80ce600 msgr2=0x7f50a80ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:35.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f8450a46700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f844c070070 0x7f844c0b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f8450a46700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f844c0ced10 0x7f844c0c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f8450a46700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f844c141500 0x7f844c0b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f8450a46700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c0b3c00 con 0x7f844c141500 2023-11-28T13:00:35.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f8450a46700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c0c1450 con 0x7f844c070070 2023-11-28T13:00:35.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f8450a46700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844c0b2ff0 con 0x7f844c0ced10 2023-11-28T13:00:35.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f844b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f844c141500 0x7f844c0b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f844b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f844c141500 0x7f844c0b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57454/0 (socket says 172.21.15.82:57454) 2023-11-28T13:00:35.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f844b59e700 1 -- 172.21.15.82:0/1871820947 learned_addr learned my addr 172.21.15.82:0/1871820947 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:35.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f844ad9d700 1 --2- 172.21.15.82:0/1871820947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f844c070070 0x7f844c0b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f0d47089700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0d400b1490 0x7f0d40159650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fefbdc12700 1 Processor -- start 2023-11-28T13:00:35.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f0d47089700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d40156630 con 0x7f0d400cca60 2023-11-28T13:00:35.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f0d47089700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d40159b90 con 0x7f0d4006a4e0 2023-11-28T13:00:35.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f0d47089700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4015cfc0 con 0x7f0d400b1490 2023-11-28T13:00:35.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f50ae872700 1 -- 172.21.15.82:0/3044061963 shutdown_connections 2023-11-28T13:00:35.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f50ae872700 1 -- 172.21.15.82:0/3044061963 wait complete. 2023-11-28T13:00:35.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f0d45886700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0d400b1490 0x7f0d40159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f0d46888700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0d4006a4e0 0x7f0d4006a930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:35058/0 (socket says 172.21.15.82:35058) 2023-11-28T13:00:35.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f0d45886700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0d400b1490 0x7f0d40159650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:47276/0 (socket says 172.21.15.82:47276) 2023-11-28T13:00:35.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f0d45886700 1 -- 172.21.15.82:0/1960457944 learned_addr learned my addr 172.21.15.82:0/1960457944 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:35.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fa489483700 1 -- 172.21.15.82:0/193555655 shutdown_connections 2023-11-28T13:00:35.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fa489483700 1 --2- 172.21.15.82:0/193555655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4840cc1d0 0x7fa484069bc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fa489483700 1 --2- 172.21.15.82:0/193555655 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa484070070 0x7fa4840cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fa489483700 1 -- 172.21.15.82:0/193555655 >> 172.21.15.82:0/193555655 conn(0x7fa4840cbd10 msgr2=0x7fa4840ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:35.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fca0dba5700 1 -- start start 2023-11-28T13:00:35.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fca0dba5700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca080cad10 0x7fca080c9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f65a759e700 1 Processor -- start 2023-11-28T13:00:35.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fa489483700 1 -- 172.21.15.82:0/193555655 shutdown_connections 2023-11-28T13:00:35.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fca0dba5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0806c690 con 0x7fca080c9540 2023-11-28T13:00:35.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f65a759e700 1 -- start start 2023-11-28T13:00:35.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fca0dba5700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0806a4f0 con 0x7fca08158870 2023-11-28T13:00:35.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fca0dba5700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca080ae2f0 con 0x7fca080cad10 2023-11-28T13:00:35.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fca077fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fca08158870 0x7fca08069bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:35074/0 (socket says 172.21.15.82:35074) 2023-11-28T13:00:35.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fca077fe700 1 -- 172.21.15.82:0/2524031394 learned_addr learned my addr 172.21.15.82:0/2524031394 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:35.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fca06ffd700 1 --2- 172.21.15.82:0/2524031394 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca080cad10 0x7fca080c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f0d45085700 1 -- 172.21.15.82:0/1960457944 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964228430 0 0) 0x7f0d40159b90 con 0x7f0d4006a4e0 2023-11-28T13:00:35.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fa489483700 1 -- 172.21.15.82:0/193555655 wait complete. 2023-11-28T13:00:35.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fca06ffd700 1 -- 172.21.15.82:0/2524031394 >> v1:172.21.15.114:6789/0 conn(0x7fca08158870 legacy=0x7fca08069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fca06ffd700 1 -- 172.21.15.82:0/2524031394 >> v1:172.21.15.82:6789/0 conn(0x7fca080c9540 legacy=0x7fca0806ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fca06ffd700 1 -- 172.21.15.82:0/2524031394 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0806a7d0 con 0x7fca080cad10 2023-11-28T13:00:35.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f50ae872700 1 Processor -- start 2023-11-28T13:00:35.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f50ae872700 1 -- start start 2023-11-28T13:00:35.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f844b59e700 1 -- 172.21.15.82:0/1871820947 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f844c0ced10 msgr2=0x7f844c0c0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f844a59c700 1 --2- 172.21.15.82:0/1871820947 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f844c0ced10 0x7f844c0c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f844b59e700 1 --2- 172.21.15.82:0/1871820947 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f844c0ced10 0x7f844c0c0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f844b59e700 1 -- 172.21.15.82:0/1871820947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f844c070070 msgr2=0x7f844c0b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f844b59e700 1 --2- 172.21.15.82:0/1871820947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f844c070070 0x7f844c0b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f844b59e700 1 -- 172.21.15.82:0/1871820947 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8444009a70 con 0x7f844c141500 2023-11-28T13:00:35.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f844a59c700 1 --2- 172.21.15.82:0/1871820947 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f844c0ced10 0x7f844c0c0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:00:35.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f844b59e700 1 --2- 172.21.15.82:0/1871820947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f844c141500 0x7f844c0b2480 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f843c017000 tx=0x7f843c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f84337fe700 1 -- 172.21.15.82:0/1871820947 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c003ad0 con 0x7f844c141500 2023-11-28T13:00:35.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f84337fe700 1 -- 172.21.15.82:0/1871820947 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843c003c30 con 0x7f844c141500 2023-11-28T13:00:35.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f8450a46700 1 -- 172.21.15.82:0/1871820947 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843c0094b0 con 0x7f844c141500 2023-11-28T13:00:35.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f84337fe700 1 -- 172.21.15.82:0/1871820947 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c0185f0 con 0x7f844c141500 2023-11-28T13:00:35.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f8450a46700 1 -- 172.21.15.82:0/1871820947 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f844c15c340 con 0x7f844c141500 2023-11-28T13:00:35.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f65a759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f65a80b6140 0x7f65a80afb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fefbdc12700 1 -- start start 2023-11-28T13:00:35.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fefbdc12700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fefb8070070 0x7fefb8070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fefbdc12700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefb8160900 0x7fefb80cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fefbdc12700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fefb80c1910 0x7fefb81641e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fefbdc12700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb8070980 con 0x7fefb80c1910 2023-11-28T13:00:35.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fefbdc12700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb80ce030 con 0x7fefb8070070 2023-11-28T13:00:35.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fefbdc12700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb80ce310 con 0x7fefb8160900 2023-11-28T13:00:35.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fefb77fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fefb8070070 0x7fefb8070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fefb77fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fefb8070070 0x7fefb8070440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:50954/0 (socket says 172.21.15.82:50954) 2023-11-28T13:00:35.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7fefb77fe700 1 -- 172.21.15.82:0/321444501 learned_addr learned my addr 172.21.15.82:0/321444501 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:35.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f65a759e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f65a815a580 0x7f65a815aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f65a759e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a815c820 con 0x7f65a815b6e0 2023-11-28T13:00:35.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f65a759e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a80cb240 con 0x7f65a815a580 2023-11-28T13:00:35.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.876+0000 7f65a759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a815af40 con 0x7f65a80b6140 2023-11-28T13:00:35.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fefb77fe700 1 -- 172.21.15.82:0/321444501 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefb8160900 msgr2=0x7fefb80cc1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T13:00:35.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fefb77fe700 1 --2- 172.21.15.82:0/321444501 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefb8160900 0x7fefb80cc1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fefb77fe700 1 -- 172.21.15.82:0/321444501 >> v2:172.21.15.82:3300/0 conn(0x7fefb80c1910 msgr2=0x7fefb81641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:35.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fefb77fe700 1 --2- 172.21.15.82:0/321444501 >> v2:172.21.15.82:3300/0 conn(0x7fefb80c1910 0x7fefb81641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fefb77fe700 1 -- 172.21.15.82:0/321444501 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb806a5d0 con 0x7fefb8070070 2023-11-28T13:00:35.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f0d45085700 1 -- 172.21.15.82:0/1960457944 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d2c0035d0 con 0x7f0d4006a4e0 2023-11-28T13:00:35.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f0d45085700 1 -- 172.21.15.82:0/1960457944 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2938801552 0 0) 0x7f0d40156630 con 0x7f0d400cca60 2023-11-28T13:00:35.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f0d45886700 1 -- 172.21.15.82:0/1960457944 >> v1:172.21.15.114:6789/0 conn(0x7f0d4006a4e0 legacy=0x7f0d4006a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f0d45886700 1 -- 172.21.15.82:0/1960457944 >> v1:172.21.15.82:6789/0 conn(0x7f0d400cca60 legacy=0x7f0d400cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f0d45886700 1 -- 172.21.15.82:0/1960457944 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4015c340 con 0x7f0d400b1490 2023-11-28T13:00:35.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f65a5d9b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f65a815b6e0 0x7f65a80d0f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:37080/0 (socket says 172.21.15.82:37080) 2023-11-28T13:00:35.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f65a5d9b700 1 -- 172.21.15.82:0/768760251 learned_addr learned my addr 172.21.15.82:0/768760251 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:35.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f65a6d9d700 1 --2- 172.21.15.82:0/768760251 >> v2:172.21.15.82:3300/0 conn(0x7f65a815a580 0x7f65a815aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fefb77fe700 1 --2- 172.21.15.82:0/321444501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb8070070 0x7fefb8070440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fefb806bf40 tx=0x7fefb000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9179c9f8df912dbe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f0d45886700 1 --2- 172.21.15.82:0/1960457944 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0d400b1490 0x7f0d40159650 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0d38009e80 tx=0x7f0d3800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88a902267cf6aa5a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f65a6d9d700 1 -- 172.21.15.82:0/768760251 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f65a80b6140 msgr2=0x7f65a80afb10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T13:00:35.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f65a6d9d700 1 --2- 172.21.15.82:0/768760251 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f65a80b6140 0x7f65a80afb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f65a559a700 1 -- 172.21.15.82:0/768760251 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538081852 0 0) 0x7f65a815c820 con 0x7f65a815b6e0 2023-11-28T13:00:35.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f65a6d9d700 1 -- 172.21.15.82:0/768760251 >> v1:172.21.15.82:6789/0 conn(0x7f65a815b6e0 legacy=0x7f65a80d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f65a6d9d700 1 -- 172.21.15.82:0/768760251 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a80b0050 con 0x7f65a815a580 2023-11-28T13:00:35.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f50ae872700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50a8070070 0x7f50a80c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f50ae872700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50a80c8490 0x7f50a8160ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f50ae872700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50a8161220 0x7f50a80c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f50ae872700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a80c4330 con 0x7f50a80c8490 2023-11-28T13:00:35.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f50ae872700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a80c36b0 con 0x7f50a8070070 2023-11-28T13:00:35.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f50ae872700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a80c3990 con 0x7f50a8161220 2023-11-28T13:00:35.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f0d45085700 1 -- 172.21.15.82:0/1960457944 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3800e070 con 0x7f0d400b1490 2023-11-28T13:00:35.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fefb67fc700 1 -- 172.21.15.82:0/321444501 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb000e070 con 0x7fefb8070070 2023-11-28T13:00:35.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fefb67fc700 1 -- 172.21.15.82:0/321444501 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb000b9c0 con 0x7fefb8070070 2023-11-28T13:00:35.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fefb67fc700 1 -- 172.21.15.82:0/321444501 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb000bd50 con 0x7fefb8070070 2023-11-28T13:00:35.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f50ad06f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50a80c8490 0x7f50a8160ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f50ad870700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50a8070070 0x7f50a80c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f0d45085700 1 -- 172.21.15.82:0/1960457944 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3800b910 con 0x7f0d400b1490 2023-11-28T13:00:35.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f50ad870700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50a8070070 0x7f50a80c7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:50970/0 (socket says 172.21.15.82:50970) 2023-11-28T13:00:35.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f50ad06f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50a80c8490 0x7f50a8160ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57494/0 (socket says 172.21.15.82:57494) 2023-11-28T13:00:35.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f50ad870700 1 -- 172.21.15.82:0/2769003510 learned_addr learned my addr 172.21.15.82:0/2769003510 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:35.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f0d45085700 1 -- 172.21.15.82:0/1960457944 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3800bc80 con 0x7f0d400b1490 2023-11-28T13:00:35.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f50ae071700 1 --2- 172.21.15.82:0/2769003510 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50a8161220 0x7f50a80c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f65a6d9d700 1 --2- 172.21.15.82:0/768760251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65a815a580 0x7f65a815aa00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6598009850 tx=0x7f6598009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc979c6618e8781 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f84337fe700 1 -- 172.21.15.82:0/1871820947 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f843c018750 con 0x7f844c141500 2023-11-28T13:00:35.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f8450a46700 1 -- 172.21.15.82:0/1871820947 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f844c15c060 con 0x7f844c141500 2023-11-28T13:00:35.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f84337fe700 1 --2- 172.21.15.82:0/1871820947 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8438064f70 0x7f8438067420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f84337fe700 1 -- 172.21.15.82:0/1871820947 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f843c083180 con 0x7f844c141500 2023-11-28T13:00:35.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f844ad9d700 1 --2- 172.21.15.82:0/1871820947 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8438064f70 0x7f8438067420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f84337fe700 1 --2- 172.21.15.82:0/1871820947 >> [v2:172.21.15.82:6800/36627,v1:172.21.15.82:6801/36627] conn(0x7f843806d7a0 0x7f843806fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f84337fe700 1 -- 172.21.15.82:0/1871820947 --> [v2:172.21.15.82:6800/36627,v1:172.21.15.82:6801/36627] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8438070260 con 0x7f843806d7a0 2023-11-28T13:00:35.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f50ad06f700 1 -- 172.21.15.82:0/2769003510 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50a8161220 msgr2=0x7f50a80c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f50ad06f700 1 --2- 172.21.15.82:0/2769003510 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50a8161220 0x7f50a80c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f50ad06f700 1 -- 172.21.15.82:0/2769003510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50a8070070 msgr2=0x7f50a80c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f50ad06f700 1 --2- 172.21.15.82:0/2769003510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50a8070070 0x7f50a80c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f50ad06f700 1 -- 172.21.15.82:0/2769003510 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a4009570 con 0x7f50a80c8490 2023-11-28T13:00:35.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fca06ffd700 1 --2- 172.21.15.82:0/2524031394 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca080cad10 0x7fca080c9000 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00b290 tx=0x7fc9fc00b5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2db6ffbbdbc3d289 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fefbdc12700 1 -- 172.21.15.82:0/321444501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb8070070 msgr2=0x7fefb8070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fefbdc12700 1 --2- 172.21.15.82:0/321444501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb8070070 0x7fefb8070440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fefb806bf40 tx=0x7fefb000b330 comp rx=0 tx=0).stop 2023-11-28T13:00:35.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fefbdc12700 1 -- 172.21.15.82:0/321444501 shutdown_connections 2023-11-28T13:00:35.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fefbdc12700 1 --2- 172.21.15.82:0/321444501 >> v2:172.21.15.82:3300/0 conn(0x7fefb80c1910 0x7fefb81641e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fefbdc12700 1 --2- 172.21.15.82:0/321444501 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefb8160900 0x7fefb80cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fefbdc12700 1 --2- 172.21.15.82:0/321444501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb8070070 0x7fefb8070440 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fefbdc12700 1 -- 172.21.15.82:0/321444501 >> 172.21.15.82:0/321444501 conn(0x7fefb80ce600 msgr2=0x7fefb80ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:35.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f84337fe700 1 -- 172.21.15.82:0/1871820947 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f843c0513c0 con 0x7f844c141500 2023-11-28T13:00:35.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fefbdc12700 1 -- 172.21.15.82:0/321444501 shutdown_connections 2023-11-28T13:00:35.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f3a62bc1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3a5c0b5870 0x7f3a5c0b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f3a62bc1700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3a5c0b5c80 0x7f3a5c0b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f3a62bc1700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5c0d0c70 con 0x7f3a5c0b1c70 2023-11-28T13:00:35.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f3a62bc1700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a5c0cd090 con 0x7f3a5c0b5870 2023-11-28T13:00:35.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f3a62bc1700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a5c0cd8a0 con 0x7f3a5c0b5c80 2023-11-28T13:00:35.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f3a623c0700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3a5c0b5c80 0x7f3a5c0b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f3a623c0700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3a5c0b5c80 0x7f3a5c0b4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:50980/0 (socket says 172.21.15.82:50980) 2023-11-28T13:00:35.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f3a623c0700 1 -- 172.21.15.82:0/1957931075 learned_addr learned my addr 172.21.15.82:0/1957931075 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:35.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f50ad06f700 1 --2- 172.21.15.82:0/2769003510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50a80c8490 0x7f50a8160ce0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f509800c430 tx=0x7f509800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f0d47089700 1 -- 172.21.15.82:0/1960457944 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0d400b1490 msgr2=0x7f0d40159650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f0d47089700 1 --2- 172.21.15.82:0/1960457944 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0d400b1490 0x7f0d40159650 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0d38009e80 tx=0x7f0d3800b330 comp rx=0 tx=0).stop 2023-11-28T13:00:35.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f65a559a700 1 -- 172.21.15.82:0/768760251 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6598011830 con 0x7f65a815a580 2023-11-28T13:00:35.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f65a559a700 1 -- 172.21.15.82:0/768760251 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6598011990 con 0x7f65a815a580 2023-11-28T13:00:35.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fefbdc12700 1 -- 172.21.15.82:0/321444501 wait complete. 2023-11-28T13:00:35.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f65a559a700 1 -- 172.21.15.82:0/768760251 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6598011d20 con 0x7f65a815a580 2023-11-28T13:00:35.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fca067fc700 1 -- 172.21.15.82:0/2524031394 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc004030 con 0x7fca080cad10 2023-11-28T13:00:35.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fca067fc700 1 -- 172.21.15.82:0/2524031394 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc004190 con 0x7fca080cad10 2023-11-28T13:00:35.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fca067fc700 1 -- 172.21.15.82:0/2524031394 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc004520 con 0x7fca080cad10 2023-11-28T13:00:35.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f3a623c0700 1 -- 172.21.15.82:0/1957931075 >> v2:172.21.15.82:3300/0 conn(0x7f3a5c0b5870 msgr2=0x7f3a5c0b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:35.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f3a613be700 1 --2- 172.21.15.82:0/1957931075 >> v2:172.21.15.82:3300/0 conn(0x7f3a5c0b5870 0x7f3a5c0b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f3a623c0700 1 --2- 172.21.15.82:0/1957931075 >> v2:172.21.15.82:3300/0 conn(0x7f3a5c0b5870 0x7f3a5c0b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f3a623c0700 1 -- 172.21.15.82:0/1957931075 >> v1:172.21.15.114:6789/0 conn(0x7f3a5c0b1c70 legacy=0x7f3a5c06a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f3a623c0700 1 -- 172.21.15.82:0/1957931075 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c0cd2e0 con 0x7f3a5c0b5c80 2023-11-28T13:00:35.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f3a613be700 1 --2- 172.21.15.82:0/1957931075 >> v2:172.21.15.82:3300/0 conn(0x7f3a5c0b5870 0x7f3a5c0b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:00:35.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f65a759e700 1 -- 172.21.15.82:0/768760251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65a815a580 msgr2=0x7f65a815aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f65a759e700 1 --2- 172.21.15.82:0/768760251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65a815a580 0x7f65a815aa00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6598009850 tx=0x7f6598009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:35.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f844ad9d700 1 --2- 172.21.15.82:0/1871820947 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8438064f70 0x7f8438067420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f84440114e0 tx=0x7f844400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f844a59c700 1 --2- 172.21.15.82:0/1871820947 >> [v2:172.21.15.82:6800/36627,v1:172.21.15.82:6801/36627] conn(0x7f843806d7a0 0x7f843806fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f844a59c700 1 --2- 172.21.15.82:0/1871820947 >> [v2:172.21.15.82:6800/36627,v1:172.21.15.82:6801/36627] conn(0x7f843806d7a0 0x7f843806fbb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fa489483700 1 Processor -- start 2023-11-28T13:00:35.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f3a623c0700 1 --2- 172.21.15.82:0/1957931075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a5c0b5c80 0x7f3a5c0b4a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0b8b30 tx=0x7f3a4c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4436f4e9d761e49 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fa489483700 1 -- start start 2023-11-28T13:00:35.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fca0dba5700 1 -- 172.21.15.82:0/2524031394 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca080cad10 msgr2=0x7fca080c9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fca0dba5700 1 --2- 172.21.15.82:0/2524031394 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca080cad10 0x7fca080c9000 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00b290 tx=0x7fc9fc00b5a0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f3a60bbd700 1 -- 172.21.15.82:0/1957931075 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c00e070 con 0x7f3a5c0b5c80 2023-11-28T13:00:35.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fca0dba5700 1 -- 172.21.15.82:0/2524031394 shutdown_connections 2023-11-28T13:00:35.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fca0dba5700 1 --2- 172.21.15.82:0/2524031394 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca080cad10 0x7fca080c9000 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7fca0dba5700 1 -- 172.21.15.82:0/2524031394 >> 172.21.15.82:0/2524031394 conn(0x7fca080ce9b0 msgr2=0x7fca080ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:35.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f509e7fc700 1 -- 172.21.15.82:0/2769003510 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5098004a90 con 0x7f50a80c8490 2023-11-28T13:00:35.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f509e7fc700 1 -- 172.21.15.82:0/2769003510 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5098004bf0 con 0x7f50a80c8490 2023-11-28T13:00:35.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f509e7fc700 1 -- 172.21.15.82:0/2769003510 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50980070d0 con 0x7f50a80c8490 2023-11-28T13:00:35.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f3a60bbd700 1 -- 172.21.15.82:0/1957931075 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4c00b9c0 con 0x7f3a5c0b5c80 2023-11-28T13:00:35.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.880+0000 7f3a60bbd700 1 -- 172.21.15.82:0/1957931075 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c00bd70 con 0x7f3a5c0b5c80 2023-11-28T13:00:35.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f0d47089700 1 -- 172.21.15.82:0/1960457944 shutdown_connections 2023-11-28T13:00:35.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f0d47089700 1 --2- 172.21.15.82:0/1960457944 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0d400b1490 0x7f0d40159650 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f0d47089700 1 -- 172.21.15.82:0/1960457944 >> 172.21.15.82:0/1960457944 conn(0x7f0d400cfb20 msgr2=0x7f0d400b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:35.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fefbdc12700 1 Processor -- start 2023-11-28T13:00:35.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f65a759e700 1 -- 172.21.15.82:0/768760251 shutdown_connections 2023-11-28T13:00:35.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f65a759e700 1 --2- 172.21.15.82:0/768760251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65a815a580 0x7f65a815aa00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f65a759e700 1 --2- 172.21.15.82:0/768760251 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f65a80b6140 0x7f65a80afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f65a759e700 1 -- 172.21.15.82:0/768760251 >> 172.21.15.82:0/768760251 conn(0x7f65a80cdf40 msgr2=0x7f65a80d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:35.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fefbdc12700 1 -- start start 2023-11-28T13:00:35.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f0d47089700 1 -- 172.21.15.82:0/1960457944 shutdown_connections 2023-11-28T13:00:35.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f0d47089700 1 -- 172.21.15.82:0/1960457944 wait complete. 2023-11-28T13:00:35.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f65a759e700 1 -- 172.21.15.82:0/768760251 shutdown_connections 2023-11-28T13:00:35.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f50ae872700 1 -- 172.21.15.82:0/2769003510 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a806ab90 con 0x7f50a80c8490 2023-11-28T13:00:35.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f50ae872700 1 -- 172.21.15.82:0/2769003510 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a806a8b0 con 0x7f50a80c8490 2023-11-28T13:00:35.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fa489483700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa48406d430 0x7fa484158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fa489483700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa484070070 0x7fa48415e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fa489483700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4840cc1d0 0x7fa4840adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fa489483700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48415d990 con 0x7fa48406d430 2023-11-28T13:00:35.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fa489483700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4840aece0 con 0x7fa484070070 2023-11-28T13:00:35.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f3a62bc1700 1 -- 172.21.15.82:0/1957931075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a5c0b5c80 msgr2=0x7f3a5c0b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f3a62bc1700 1 --2- 172.21.15.82:0/1957931075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a5c0b5c80 0x7f3a5c0b4a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0b8b30 tx=0x7f3a4c00b330 comp rx=0 tx=0).stop 2023-11-28T13:00:35.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fa489483700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4840aea00 con 0x7fa4840cc1d0 2023-11-28T13:00:35.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fa4837fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa484070070 0x7fa48415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fa488c82700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4840cc1d0 0x7fa4840adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fa4837fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa484070070 0x7fa48415e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:50988/0 (socket says 172.21.15.82:50988) 2023-11-28T13:00:35.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fa4837fe700 1 -- 172.21.15.82:0/1128102722 learned_addr learned my addr 172.21.15.82:0/1128102722 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:35.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fefbdc12700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefb8070070 0x7fefb80b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fefbdc12700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb80c74f0 0x7fefb80b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fefbdc12700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefb80c3c80 0x7fefb80c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fefbdc12700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb80c2130 con 0x7fefb8070070 2023-11-28T13:00:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fefbdc12700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb80c4630 con 0x7fefb80c74f0 2023-11-28T13:00:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fefbdc12700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb80c0fb0 con 0x7fefb80c3c80 2023-11-28T13:00:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f84337fe700 1 -- 172.21.15.82:0/1871820947 <== osd.3 v2:172.21.15.82:6800/36627 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8438070260 con 0x7f843806d7a0 2023-11-28T13:00:35.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fca0dba5700 1 -- 172.21.15.82:0/2524031394 shutdown_connections 2023-11-28T13:00:35.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fca0dba5700 1 -- 172.21.15.82:0/2524031394 wait complete. 2023-11-28T13:00:35.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f50ae872700 1 -- 172.21.15.82:0/2769003510 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f50a80cdc50 con 0x7f50a80c8490 2023-11-28T13:00:35.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f0d47089700 1 Processor -- start 2023-11-28T13:00:35.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f0d47089700 1 -- start start 2023-11-28T13:00:35.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fefb7fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefb80c3c80 0x7fefb80c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fefb7fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefb80c3c80 0x7fefb80c40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:47330/0 (socket says 172.21.15.82:47330) 2023-11-28T13:00:35.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fefb7fff700 1 -- 172.21.15.82:0/1982250879 learned_addr learned my addr 172.21.15.82:0/1982250879 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:35.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f509e7fc700 1 -- 172.21.15.82:0/2769003510 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5098010070 con 0x7f50a80c8490 2023-11-28T13:00:35.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fefb7fff700 1 -- 172.21.15.82:0/1982250879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb80c74f0 msgr2=0x7fefb80b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fefb6ffd700 1 --2- 172.21.15.82:0/1982250879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb80c74f0 0x7fefb80b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fefb7fff700 1 --2- 172.21.15.82:0/1982250879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb80c74f0 0x7fefb80b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fefb7fff700 1 -- 172.21.15.82:0/1982250879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefb8070070 msgr2=0x7fefb80b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fefb7fff700 1 --2- 172.21.15.82:0/1982250879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefb8070070 0x7fefb80b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fefb7fff700 1 -- 172.21.15.82:0/1982250879 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb0009b30 con 0x7fefb80c3c80 2023-11-28T13:00:35.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fefb6ffd700 1 --2- 172.21.15.82:0/1982250879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb80c74f0 0x7fefb80b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:00:35.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fca0dba5700 1 Processor -- start 2023-11-28T13:00:35.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f3a62bc1700 1 -- 172.21.15.82:0/1957931075 shutdown_connections 2023-11-28T13:00:35.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f3a62bc1700 1 --2- 172.21.15.82:0/1957931075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a5c0b5c80 0x7f3a5c0b4a00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f3a62bc1700 1 --2- 172.21.15.82:0/1957931075 >> v2:172.21.15.82:3300/0 conn(0x7f3a5c0b5870 0x7f3a5c0b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f3a62bc1700 1 -- 172.21.15.82:0/1957931075 >> 172.21.15.82:0/1957931075 conn(0x7f3a5c0cf4c0 msgr2=0x7f3a5c0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:35.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f3a62bc1700 1 -- 172.21.15.82:0/1957931075 shutdown_connections 2023-11-28T13:00:35.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f3a62bc1700 1 -- 172.21.15.82:0/1957931075 wait complete. 2023-11-28T13:00:35.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fca0dba5700 1 -- start start 2023-11-28T13:00:35.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f509e7fc700 1 --2- 172.21.15.82:0/2769003510 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f508c064f10 0x7f508c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f3a62bc1700 1 Processor -- start 2023-11-28T13:00:35.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f509e7fc700 1 -- 172.21.15.82:0/2769003510 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5098081430 con 0x7f50a80c8490 2023-11-28T13:00:35.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f3a62bc1700 1 -- start start 2023-11-28T13:00:35.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f509e7fc700 1 --2- 172.21.15.82:0/2769003510 >> [v2:172.21.15.82:6824/36636,v1:172.21.15.82:6825/36636] conn(0x7f508c06d6c0 0x7f508c06fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f509e7fc700 1 -- 172.21.15.82:0/2769003510 --> [v2:172.21.15.82:6824/36636,v1:172.21.15.82:6825/36636] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f508c070180 con 0x7f508c06d6c0 2023-11-28T13:00:35.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f0d47089700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0d4006a4e0 0x7f0d40156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f0d47089700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d400b1490 0x7f0d4006b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f0d47089700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d400cca60 0x7f0d400ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f0d46888700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d400cca60 0x7f0d400ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f0d46888700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d400cca60 0x7f0d400ca5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57534/0 (socket says 172.21.15.82:57534) 2023-11-28T13:00:35.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f0d47089700 1 -- 172.21.15.82:0/1916200691 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d401528c0 con 0x7f0d400cca60 2023-11-28T13:00:35.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f0d46888700 1 -- 172.21.15.82:0/1916200691 learned_addr learned my addr 172.21.15.82:0/1916200691 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:35.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f0d47089700 1 -- 172.21.15.82:0/1916200691 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d401519c0 con 0x7f0d400b1490 2023-11-28T13:00:35.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f0d47089700 1 -- 172.21.15.82:0/1916200691 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d40151c40 con 0x7f0d4006a4e0 2023-11-28T13:00:35.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f50ad870700 1 --2- 172.21.15.82:0/2769003510 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f508c064f10 0x7f508c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f65a759e700 1 -- 172.21.15.82:0/768760251 wait complete. 2023-11-28T13:00:35.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7f50ae071700 1 --2- 172.21.15.82:0/2769003510 >> [v2:172.21.15.82:6824/36636,v1:172.21.15.82:6825/36636] conn(0x7f508c06d6c0 0x7f508c06fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fca0dba5700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca080c9540 0x7fca080c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fca0dba5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca080cad10 0x7fca0814fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fca0dba5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca08158870 0x7fca080c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fca0dba5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca080c68e0 con 0x7fca08158870 2023-11-28T13:00:35.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fca0dba5700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca080c7bf0 con 0x7fca080cad10 2023-11-28T13:00:35.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fca0dba5700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca080c83e0 con 0x7fca080c9540 2023-11-28T13:00:35.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f509e7fc700 1 -- 172.21.15.82:0/2769003510 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f509804f5d0 con 0x7f50a80c8490 2023-11-28T13:00:35.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f50ae071700 1 --2- 172.21.15.82:0/2769003510 >> [v2:172.21.15.82:6824/36636,v1:172.21.15.82:6825/36636] conn(0x7f508c06d6c0 0x7f508c06fad0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f0d46087700 1 --2- 172.21.15.82:0/1916200691 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0d4006a4e0 0x7f0d40156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f0d46888700 1 -- 172.21.15.82:0/1916200691 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0d4006a4e0 msgr2=0x7f0d40156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f0d46888700 1 --2- 172.21.15.82:0/1916200691 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0d4006a4e0 0x7f0d40156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f0d46888700 1 -- 172.21.15.82:0/1916200691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d400b1490 msgr2=0x7f0d4006b470 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T13:00:35.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f0d46888700 1 --2- 172.21.15.82:0/1916200691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d400b1490 0x7f0d4006b470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f0d46888700 1 -- 172.21.15.82:0/1916200691 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d38009b30 con 0x7f0d400cca60 2023-11-28T13:00:35.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fca07fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca08158870 0x7fca080c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fca07fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca08158870 0x7fca080c5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57544/0 (socket says 172.21.15.82:57544) 2023-11-28T13:00:35.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fca07fff700 1 -- 172.21.15.82:0/2395033429 learned_addr learned my addr 172.21.15.82:0/2395033429 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:35.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fefb7fff700 1 --2- 172.21.15.82:0/1982250879 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefb80c3c80 0x7fefb80c40f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fefac00b4d0 tx=0x7fefac00b890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fca077fe700 1 --2- 172.21.15.82:0/2395033429 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca080c9540 0x7fca080c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f50ad870700 1 --2- 172.21.15.82:0/2769003510 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f508c064f10 0x7f508c0673c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009c60 tx=0x7f50a4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f0d46888700 1 --2- 172.21.15.82:0/1916200691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d400cca60 0x7f0d400ca5c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000c4d0 tx=0x7f0d3000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fef9ffff700 1 -- 172.21.15.82:0/1982250879 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac011830 con 0x7fefb80c3c80 2023-11-28T13:00:35.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fefbdc12700 1 -- 172.21.15.82:0/1982250879 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb806ab90 con 0x7fefb80c3c80 2023-11-28T13:00:35.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f0d36ffd700 1 -- 172.21.15.82:0/1916200691 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30005cd0 con 0x7f0d400cca60 2023-11-28T13:00:35.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fca077fe700 1 -- 172.21.15.82:0/2395033429 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca080cad10 msgr2=0x7fca0814fdf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T13:00:35.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fca077fe700 1 --2- 172.21.15.82:0/2395033429 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca080cad10 0x7fca0814fdf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fca077fe700 1 -- 172.21.15.82:0/2395033429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca08158870 msgr2=0x7fca080c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fca077fe700 1 --2- 172.21.15.82:0/2395033429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca08158870 0x7fca080c5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fca077fe700 1 -- 172.21.15.82:0/2395033429 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc009d40 con 0x7fca080c9540 2023-11-28T13:00:35.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f65a759e700 1 Processor -- start 2023-11-28T13:00:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f0d36ffd700 1 -- 172.21.15.82:0/1916200691 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d30005e30 con 0x7f0d400cca60 2023-11-28T13:00:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f0d36ffd700 1 -- 172.21.15.82:0/1916200691 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d300072d0 con 0x7f0d400cca60 2023-11-28T13:00:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f0d47089700 1 -- 172.21.15.82:0/1916200691 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4015c900 con 0x7f0d400cca60 2023-11-28T13:00:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f0d47089700 1 -- 172.21.15.82:0/1916200691 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4015c620 con 0x7f0d400cca60 2023-11-28T13:00:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fefbdc12700 1 -- 172.21.15.82:0/1982250879 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb806a8b0 con 0x7fefb80c3c80 2023-11-28T13:00:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fef9ffff700 1 -- 172.21.15.82:0/1982250879 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefac011990 con 0x7fefb80c3c80 2023-11-28T13:00:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fef9ffff700 1 -- 172.21.15.82:0/1982250879 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac011d40 con 0x7fefb80c3c80 2023-11-28T13:00:35.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f3a62bc1700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a5c0b1c70 0x7f3a5c15f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f3a62bc1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a5c0b5870 0x7f3a5c0cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f3a62bc1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a5c0b5c80 0x7f3a5c1f01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f3a62bc1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c0c75a0 con 0x7f3a5c0b5870 2023-11-28T13:00:35.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f3a62bc1700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c0cc6e0 con 0x7f3a5c0b5c80 2023-11-28T13:00:35.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f3a62bc1700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c0cc9c0 con 0x7f3a5c0b1c70 2023-11-28T13:00:35.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f0d47089700 1 -- 172.21.15.82:0/1916200691 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d28000fc0 con 0x7f0d400cca60 2023-11-28T13:00:35.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f65a759e700 1 -- start start 2023-11-28T13:00:35.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f65a759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f65a80b6140 0x7f65a806b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f65a759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65a815a580 0x7f65a8200db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f65a759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65a815b6e0 0x7f65a806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f65a759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a806f5e0 con 0x7f65a815a580 2023-11-28T13:00:35.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f65a759e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a806baa0 con 0x7f65a815b6e0 2023-11-28T13:00:35.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f65a759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a80cf0f0 con 0x7f65a80b6140 2023-11-28T13:00:35.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fefbdc12700 1 -- 172.21.15.82:0/1982250879 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fefb80cc710 con 0x7fefb80c3c80 2023-11-28T13:00:35.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f3a623c0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a5c0b5c80 0x7f3a5c1f01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f3a623c0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a5c0b5c80 0x7f3a5c1f01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:51010/0 (socket says 172.21.15.82:51010) 2023-11-28T13:00:35.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f3a623c0700 1 -- 172.21.15.82:0/536510409 learned_addr learned my addr 172.21.15.82:0/536510409 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:35.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f65a659c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f65a80b6140 0x7f65a806b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f65a659c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f65a80b6140 0x7f65a806b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:47362/0 (socket says 172.21.15.82:47362) 2023-11-28T13:00:35.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f65a659c700 1 -- 172.21.15.82:0/2844815459 learned_addr learned my addr 172.21.15.82:0/2844815459 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:35.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f3a623c0700 1 -- 172.21.15.82:0/536510409 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a5c0b1c70 msgr2=0x7f3a5c15f180 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T13:00:35.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f3a623c0700 1 --2- 172.21.15.82:0/536510409 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a5c0b1c70 0x7f3a5c15f180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f3a623c0700 1 -- 172.21.15.82:0/536510409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a5c0b5870 msgr2=0x7f3a5c0cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f3a623c0700 1 --2- 172.21.15.82:0/536510409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a5c0b5870 0x7f3a5c0cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f3a623c0700 1 -- 172.21.15.82:0/536510409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c009b30 con 0x7f3a5c0b5c80 2023-11-28T13:00:35.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f509e7fc700 1 -- 172.21.15.82:0/2769003510 <== osd.2 v2:172.21.15.82:6824/36636 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f508c070180 con 0x7f508c06d6c0 2023-11-28T13:00:35.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fca077fe700 1 --2- 172.21.15.82:0/2395033429 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca080c9540 0x7fca080c76b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800c430 tx=0x7fc9f800c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fef9ffff700 1 -- 172.21.15.82:0/1982250879 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fefac021070 con 0x7fefb80c3c80 2023-11-28T13:00:35.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fc9effff700 1 -- 172.21.15.82:0/2395033429 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8005d90 con 0x7fca080c9540 2023-11-28T13:00:35.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f3a623c0700 1 --2- 172.21.15.82:0/536510409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a5c0b5c80 0x7f3a5c1f01a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c00b370 tx=0x7f3a4c004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fef9ffff700 1 --2- 172.21.15.82:0/1982250879 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fefa4064ee0 0x7fefa4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fa483fff700 1 --2- 172.21.15.82:0/1128102722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa48406d430 0x7fa484158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fa4837fe700 1 -- 172.21.15.82:0/1128102722 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4840cc1d0 msgr2=0x7fa4840adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fa4837fe700 1 --2- 172.21.15.82:0/1128102722 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4840cc1d0 0x7fa4840adf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fa4837fe700 1 -- 172.21.15.82:0/1128102722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa48406d430 msgr2=0x7fa484158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fa4837fe700 1 --2- 172.21.15.82:0/1128102722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa48406d430 0x7fa484158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fa4837fe700 1 -- 172.21.15.82:0/1128102722 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa474009570 con 0x7fa484070070 2023-11-28T13:00:35.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fa483fff700 1 --2- 172.21.15.82:0/1128102722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa48406d430 0x7fa484158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:35.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fa4837fe700 1 --2- 172.21.15.82:0/1128102722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa484070070 0x7fa48415e430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00cc50 tx=0x7fa47c00cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fa480ff9700 1 -- 172.21.15.82:0/1128102722 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00ab80 con 0x7fa484070070 2023-11-28T13:00:35.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fa480ff9700 1 -- 172.21.15.82:0/1128102722 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c00ace0 con 0x7fa484070070 2023-11-28T13:00:35.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fca0dba5700 1 -- 172.21.15.82:0/2395033429 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0806aab0 con 0x7fca080c9540 2023-11-28T13:00:35.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fca0dba5700 1 -- 172.21.15.82:0/2395033429 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0806c900 con 0x7fca080c9540 2023-11-28T13:00:35.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fc9effff700 1 -- 172.21.15.82:0/2395033429 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f80070d0 con 0x7fca080c9540 2023-11-28T13:00:35.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.884+0000 7fa480ff9700 1 -- 172.21.15.82:0/1128102722 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c012640 con 0x7fa484070070 2023-11-28T13:00:35.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fa489483700 1 -- 172.21.15.82:0/1128102722 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48406da90 con 0x7fa484070070 2023-11-28T13:00:35.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fa489483700 1 -- 172.21.15.82:0/1128102722 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48406ce00 con 0x7fa484070070 2023-11-28T13:00:35.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fa489483700 1 -- 172.21.15.82:0/1128102722 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa48415c500 con 0x7fa484070070 2023-11-28T13:00:35.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fa480ff9700 1 -- 172.21.15.82:0/1128102722 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa47c022070 con 0x7fa484070070 2023-11-28T13:00:35.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7fa480ff9700 1 --2- 172.21.15.82:0/1128102722 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa470064f30 0x7fa4700673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fa480ff9700 1 -- 172.21.15.82:0/1128102722 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa47c0829b0 con 0x7fa484070070 2023-11-28T13:00:35.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fc9effff700 1 -- 172.21.15.82:0/2395033429 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8007440 con 0x7fca080c9540 2023-11-28T13:00:35.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fa480ff9700 1 --2- 172.21.15.82:0/1128102722 >> [v2:172.21.15.82:6816/36629,v1:172.21.15.82:6817/36629] conn(0x7fa47006d7e0 0x7fa47006fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fa480ff9700 1 -- 172.21.15.82:0/1128102722 --> [v2:172.21.15.82:6816/36629,v1:172.21.15.82:6817/36629] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa4700702a0 con 0x7fa47006d7e0 2023-11-28T13:00:35.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fef9ffff700 1 -- 172.21.15.82:0/1982250879 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fefac081d50 con 0x7fefb80c3c80 2023-11-28T13:00:35.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fa480ff9700 1 -- 172.21.15.82:0/1128102722 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa47c082e30 con 0x7fa484070070 2023-11-28T13:00:35.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fef9ffff700 1 --2- 172.21.15.82:0/1982250879 >> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] conn(0x7fefa406d710 0x7fefa406fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fef9ffff700 1 -- 172.21.15.82:0/1982250879 --> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fefa40701d0 con 0x7fefa406d710 2023-11-28T13:00:35.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fef9ffff700 1 -- 172.21.15.82:0/1982250879 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefac087430 con 0x7fefb80c3c80 2023-11-28T13:00:35.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fa483fff700 1 --2- 172.21.15.82:0/1128102722 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa470064f30 0x7fa4700673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7f0d36ffd700 1 -- 172.21.15.82:0/1916200691 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0d30019030 con 0x7f0d400cca60 2023-11-28T13:00:35.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fefb6ffd700 1 --2- 172.21.15.82:0/1982250879 >> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] conn(0x7fefa406d710 0x7fefa406fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fefb77fe700 1 --2- 172.21.15.82:0/1982250879 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fefa4064ee0 0x7fefa4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7f0d36ffd700 1 --2- 172.21.15.82:0/1916200691 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0d24064fb0 0x7f0d24067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7f0d36ffd700 1 -- 172.21.15.82:0/1916200691 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0d30081190 con 0x7f0d400cca60 2023-11-28T13:00:35.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fa483fff700 1 --2- 172.21.15.82:0/1128102722 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa470064f30 0x7fa4700673e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa478006fd0 tx=0x7fa478008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fa488c82700 1 --2- 172.21.15.82:0/1128102722 >> [v2:172.21.15.82:6816/36629,v1:172.21.15.82:6817/36629] conn(0x7fa47006d7e0 0x7fa47006fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fca0dba5700 1 -- 172.21.15.82:0/2395033429 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc9e8000fc0 con 0x7fca080c9540 2023-11-28T13:00:35.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7f0d36ffd700 1 --2- 172.21.15.82:0/1916200691 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x7f0d2406d7e0 0x7f0d2406fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7f0d36ffd700 1 -- 172.21.15.82:0/1916200691 --> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d240702a0 con 0x7f0d2406d7e0 2023-11-28T13:00:35.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7f0d36ffd700 1 -- 172.21.15.82:0/1916200691 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d3004f390 con 0x7f0d400cca60 2023-11-28T13:00:35.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fefb77fe700 1 --2- 172.21.15.82:0/1982250879 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fefa4064ee0 0x7fefa4067390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fefb80c5490 tx=0x7fefb0010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fefb6ffd700 1 --2- 172.21.15.82:0/1982250879 >> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] conn(0x7fefa406d710 0x7fefa406fb20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7f0d45886700 1 --2- 172.21.15.82:0/1916200691 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x7f0d2406d7e0 0x7f0d2406fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f65a659c700 1 -- 172.21.15.82:0/2844815459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65a815b6e0 msgr2=0x7f65a806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f65a659c700 1 --2- 172.21.15.82:0/2844815459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65a815b6e0 0x7f65a806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f65a659c700 1 -- 172.21.15.82:0/2844815459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65a815a580 msgr2=0x7f65a8200db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f65a659c700 1 --2- 172.21.15.82:0/2844815459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65a815a580 0x7f65a8200db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.888+0000 7f65a659c700 1 -- 172.21.15.82:0/2844815459 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65980094b0 con 0x7f65a80b6140 2023-11-28T13:00:35.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7f65a659c700 1 --2- 172.21.15.82:0/2844815459 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f65a80b6140 0x7f65a806b560 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f659c00b550 tx=0x7f659c00b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fa488c82700 1 --2- 172.21.15.82:0/1128102722 >> [v2:172.21.15.82:6816/36629,v1:172.21.15.82:6817/36629] conn(0x7fa47006d7e0 0x7fa47006fbf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fc9effff700 1 -- 172.21.15.82:0/2395033429 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc9f8019030 con 0x7fca080c9540 2023-11-28T13:00:35.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7f6596ffd700 1 -- 172.21.15.82:0/2844815459 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c011830 con 0x7f65a80b6140 2023-11-28T13:00:35.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7f6596ffd700 1 -- 172.21.15.82:0/2844815459 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c011990 con 0x7f65a80b6140 2023-11-28T13:00:35.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7f65a759e700 1 -- 172.21.15.82:0/2844815459 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a815bef0 con 0x7f65a80b6140 2023-11-28T13:00:35.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7f0d45886700 1 --2- 172.21.15.82:0/1916200691 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x7f0d2406d7e0 0x7f0d2406fbf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7f6596ffd700 1 -- 172.21.15.82:0/2844815459 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c011d20 con 0x7f65a80b6140 2023-11-28T13:00:35.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7f65a759e700 1 -- 172.21.15.82:0/2844815459 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a815bc10 con 0x7f65a80b6140 2023-11-28T13:00:35.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fc9effff700 1 --2- 172.21.15.82:0/2395033429 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc9f4064f30 0x7fc9f40673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fca06ffd700 1 --2- 172.21.15.82:0/2395033429 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc9f4064f30 0x7fc9f40673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fc9effff700 1 -- 172.21.15.82:0/2395033429 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc9f8080ee0 con 0x7fca080c9540 2023-11-28T13:00:35.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fc9effff700 1 --2- 172.21.15.82:0/2395033429 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x7fc9f406d7e0 0x7fc9f406fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fa480ff9700 1 -- 172.21.15.82:0/1128102722 <== osd.0 v2:172.21.15.82:6816/36629 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa4700702a0 con 0x7fa47006d7e0 2023-11-28T13:00:35.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fc9effff700 1 -- 172.21.15.82:0/2395033429 --> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc9f40702a0 con 0x7fc9f406d7e0 2023-11-28T13:00:35.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fc9effff700 1 -- 172.21.15.82:0/2395033429 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9f80835d0 con 0x7fca080c9540 2023-11-28T13:00:35.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fca07fff700 1 --2- 172.21.15.82:0/2395033429 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x7fc9f406d7e0 0x7fc9f406fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fca06ffd700 1 --2- 172.21.15.82:0/2395033429 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc9f4064f30 0x7fc9f40673e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fca080cb0e0 tx=0x7fc9fc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fef9ffff700 1 -- 172.21.15.82:0/1982250879 <== osd.6 v2:172.21.15.114:6824/36805 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fefa40701d0 con 0x7fefa406d710 2023-11-28T13:00:35.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.892+0000 7fca07fff700 1 --2- 172.21.15.82:0/2395033429 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x7fc9f406d7e0 0x7fc9f406fbf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.896+0000 7f3a5a7fc700 1 -- 172.21.15.82:0/536510409 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c0099b0 con 0x7f3a5c0b5c80 2023-11-28T13:00:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.896+0000 7f0d46087700 1 --2- 172.21.15.82:0/1916200691 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0d24064fb0 0x7f0d24067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.896+0000 7f3a5a7fc700 1 -- 172.21.15.82:0/536510409 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4c0092e0 con 0x7f3a5c0b5c80 2023-11-28T13:00:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.896+0000 7f3a5a7fc700 1 -- 172.21.15.82:0/536510409 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c01c640 con 0x7f3a5c0b5c80 2023-11-28T13:00:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.896+0000 7fc9effff700 1 -- 172.21.15.82:0/2395033429 <== osd.1 v2:172.21.15.82:6808/36628 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc9f40702a0 con 0x7fc9f406d7e0 2023-11-28T13:00:35.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.896+0000 7f6596ffd700 1 -- 172.21.15.82:0/2844815459 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f659c021070 con 0x7f65a80b6140 2023-11-28T13:00:35.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.896+0000 7f6596ffd700 1 --2- 172.21.15.82:0/2844815459 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6588064f30 0x7f65880673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.896+0000 7f6596ffd700 1 -- 172.21.15.82:0/2844815459 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f659c081d40 con 0x7f65a80b6140 2023-11-28T13:00:35.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.896+0000 7f65a5d9b700 1 --2- 172.21.15.82:0/2844815459 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6588064f30 0x7f65880673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.896+0000 7f65a5d9b700 1 --2- 172.21.15.82:0/2844815459 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6588064f30 0x7f65880673e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f65a0000f80 tx=0x7f65a0001680 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.896+0000 7f0d46087700 1 --2- 172.21.15.82:0/1916200691 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0d24064fb0 0x7f0d24067460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c000f60 tx=0x7f0d3c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.900+0000 7f0d36ffd700 1 -- 172.21.15.82:0/1916200691 <== osd.5 v2:172.21.15.114:6808/36804 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0d240702a0 con 0x7f0d2406d7e0 2023-11-28T13:00:35.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.900+0000 7f3a62bc1700 1 -- 172.21.15.82:0/536510409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5c0d0900 con 0x7f3a5c0b5c80 2023-11-28T13:00:35.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.900+0000 7f3a62bc1700 1 -- 172.21.15.82:0/536510409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5c0cd5c0 con 0x7f3a5c0b5c80 2023-11-28T13:00:35.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.900+0000 7f3a5a7fc700 1 -- 172.21.15.82:0/536510409 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3a4c02c070 con 0x7f3a5c0b5c80 2023-11-28T13:00:35.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.900+0000 7f3a5a7fc700 1 --2- 172.21.15.82:0/536510409 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3a48064f60 0x7f3a48067410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.900+0000 7f3a5a7fc700 1 -- 172.21.15.82:0/536510409 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3a4c083780 con 0x7f3a5c0b5c80 2023-11-28T13:00:35.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.900+0000 7f3a61bbf700 1 --2- 172.21.15.82:0/536510409 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3a48064f60 0x7f3a48067410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.900+0000 7f3a61bbf700 1 --2- 172.21.15.82:0/536510409 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3a48064f60 0x7f3a48067410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0c9330 tx=0x7f3a50007a80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.904+0000 7f65a759e700 1 --2- 172.21.15.82:0/2844815459 >> [v2:172.21.15.114:6800/36803,v1:172.21.15.114:6801/36803] conn(0x7f658c0015e0 0x7f658c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.904+0000 7f65a759e700 1 -- 172.21.15.82:0/2844815459 --> [v2:172.21.15.114:6800/36803,v1:172.21.15.114:6801/36803] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f658c006be0 con 0x7f658c0015e0 2023-11-28T13:00:35.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.904+0000 7f3a62bc1700 1 --2- 172.21.15.82:0/536510409 >> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] conn(0x7f3a5c1ee110 0x7f3a5c069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:35.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.904+0000 7f3a62bc1700 1 -- 172.21.15.82:0/536510409 --> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a5c065fc0 con 0x7f3a5c1ee110 2023-11-28T13:00:35.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.904+0000 7f65a6d9d700 1 --2- 172.21.15.82:0/2844815459 >> [v2:172.21.15.114:6800/36803,v1:172.21.15.114:6801/36803] conn(0x7f658c0015e0 0x7f658c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.904+0000 7f3a613be700 1 --2- 172.21.15.82:0/536510409 >> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] conn(0x7f3a5c1ee110 0x7f3a5c069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:35.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.904+0000 7f65a6d9d700 1 --2- 172.21.15.82:0/2844815459 >> [v2:172.21.15.114:6800/36803,v1:172.21.15.114:6801/36803] conn(0x7f658c0015e0 0x7f658c003a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.904+0000 7f3a613be700 1 --2- 172.21.15.82:0/536510409 >> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] conn(0x7f3a5c1ee110 0x7f3a5c069bc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:35.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.908+0000 7f3a5a7fc700 1 -- 172.21.15.82:0/536510409 <== osd.7 v2:172.21.15.114:6816/36806 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3a5c065fc0 con 0x7f3a5c1ee110 2023-11-28T13:00:35.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.908+0000 7f8450a46700 1 -- 172.21.15.82:0/1871820947 --> [v2:172.21.15.82:6800/36627,v1:172.21.15.82:6801/36627] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f844c15c620 con 0x7f843806d7a0 2023-11-28T13:00:35.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.912+0000 7f84337fe700 1 -- 172.21.15.82:0/1871820947 <== osd.3 v2:172.21.15.82:6800/36627 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f844c15c620 con 0x7f843806d7a0 2023-11-28T13:00:35.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.912+0000 7fa489483700 1 -- 172.21.15.82:0/1128102722 --> [v2:172.21.15.82:6816/36629,v1:172.21.15.82:6817/36629] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa484070970 con 0x7fa47006d7e0 2023-11-28T13:00:35.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.912+0000 7f8450a46700 1 -- 172.21.15.82:0/1871820947 >> [v2:172.21.15.82:6800/36627,v1:172.21.15.82:6801/36627] conn(0x7f843806d7a0 msgr2=0x7f843806fbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.912+0000 7f8450a46700 1 --2- 172.21.15.82:0/1871820947 >> [v2:172.21.15.82:6800/36627,v1:172.21.15.82:6801/36627] conn(0x7f843806d7a0 0x7f843806fbb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.912+0000 7f8450a46700 1 -- 172.21.15.82:0/1871820947 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8438064f70 msgr2=0x7f8438067420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.912+0000 7f8450a46700 1 --2- 172.21.15.82:0/1871820947 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8438064f70 0x7f8438067420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f84440114e0 tx=0x7f844400b040 comp rx=0 tx=0).stop 2023-11-28T13:00:35.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.912+0000 7f8450a46700 1 -- 172.21.15.82:0/1871820947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f844c141500 msgr2=0x7f844c0b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.912+0000 7f8450a46700 1 --2- 172.21.15.82:0/1871820947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f844c141500 0x7f844c0b2480 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f843c017000 tx=0x7f843c004770 comp rx=0 tx=0).stop 2023-11-28T13:00:35.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.912+0000 7f50ae872700 1 -- 172.21.15.82:0/2769003510 --> [v2:172.21.15.82:6824/36636,v1:172.21.15.82:6825/36636] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f50a80c4470 con 0x7f508c06d6c0 2023-11-28T13:00:35.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.916+0000 7fa480ff9700 1 -- 172.21.15.82:0/1128102722 <== osd.0 v2:172.21.15.82:6816/36629 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa484070970 con 0x7fa47006d7e0 2023-11-28T13:00:35.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.916+0000 7f6596ffd700 1 -- 172.21.15.82:0/2844815459 <== osd.4 v2:172.21.15.114:6800/36803 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f658c006be0 con 0x7f658c0015e0 2023-11-28T13:00:35.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.916+0000 7f844b59e700 1 -- 172.21.15.82:0/1871820947 reap_dead start 2023-11-28T13:00:35.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.916+0000 7f509e7fc700 1 -- 172.21.15.82:0/2769003510 <== osd.2 v2:172.21.15.82:6824/36636 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f50a80c4470 con 0x7f508c06d6c0 2023-11-28T13:00:35.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.916+0000 7f8450a46700 1 -- 172.21.15.82:0/1871820947 shutdown_connections 2023-11-28T13:00:35.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.916+0000 7f8450a46700 1 -- 172.21.15.82:0/1871820947 >> 172.21.15.82:0/1871820947 conn(0x7f844c0cbd10 msgr2=0x7f844c0ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:35.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.916+0000 7f8450a46700 1 -- 172.21.15.82:0/1871820947 shutdown_connections 2023-11-28T13:00:35.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.916+0000 7f8450a46700 1 -- 172.21.15.82:0/1871820947 wait complete. 2023-11-28T13:00:35.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.916+0000 7fa489483700 1 -- 172.21.15.82:0/1128102722 >> [v2:172.21.15.82:6816/36629,v1:172.21.15.82:6817/36629] conn(0x7fa47006d7e0 msgr2=0x7fa47006fbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.916+0000 7fa489483700 1 --2- 172.21.15.82:0/1128102722 >> [v2:172.21.15.82:6816/36629,v1:172.21.15.82:6817/36629] conn(0x7fa47006d7e0 0x7fa47006fbf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.916+0000 7fa489483700 1 -- 172.21.15.82:0/1128102722 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa470064f30 msgr2=0x7fa4700673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.916+0000 7fa489483700 1 --2- 172.21.15.82:0/1128102722 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa470064f30 0x7fa4700673e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa478006fd0 tx=0x7fa478008040 comp rx=0 tx=0).stop 2023-11-28T13:00:35.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.916+0000 7fa489483700 1 -- 172.21.15.82:0/1128102722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa484070070 msgr2=0x7fa48415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.916+0000 7fa489483700 1 --2- 172.21.15.82:0/1128102722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa484070070 0x7fa48415e430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00cc50 tx=0x7fa47c00cf60 comp rx=0 tx=0).stop 2023-11-28T13:00:35.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.916+0000 7fa488c82700 1 -- 172.21.15.82:0/1128102722 reap_dead start 2023-11-28T13:00:35.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.916+0000 7fa489483700 1 -- 172.21.15.82:0/1128102722 shutdown_connections 2023-11-28T13:00:35.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.916+0000 7fa489483700 1 -- 172.21.15.82:0/1128102722 >> 172.21.15.82:0/1128102722 conn(0x7fa4840cbd10 msgr2=0x7fa48406c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:35.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.916+0000 7fa489483700 1 -- 172.21.15.82:0/1128102722 shutdown_connections 2023-11-28T13:00:35.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.916+0000 7fa489483700 1 -- 172.21.15.82:0/1128102722 wait complete. 2023-11-28T13:00:35.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.920+0000 7fefbdc12700 1 -- 172.21.15.82:0/1982250879 --> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fefb8065fc0 con 0x7fefa406d710 2023-11-28T13:00:35.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.920+0000 7fef9ffff700 1 -- 172.21.15.82:0/1982250879 <== osd.6 v2:172.21.15.114:6824/36805 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fefb8065fc0 con 0x7fefa406d710 2023-11-28T13:00:35.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7f0d47089700 1 -- 172.21.15.82:0/1916200691 --> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0d28002d60 con 0x7f0d2406d7e0 2023-11-28T13:00:35.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.920+0000 7fca0dba5700 1 -- 172.21.15.82:0/2395033429 --> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc9e8002d60 con 0x7fc9f406d7e0 2023-11-28T13:00:35.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7fefbdc12700 1 -- 172.21.15.82:0/1982250879 >> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] conn(0x7fefa406d710 msgr2=0x7fefa406fb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7fefbdc12700 1 --2- 172.21.15.82:0/1982250879 >> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] conn(0x7fefa406d710 0x7fefa406fb20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7fefbdc12700 1 -- 172.21.15.82:0/1982250879 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fefa4064ee0 msgr2=0x7fefa4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7fefbdc12700 1 --2- 172.21.15.82:0/1982250879 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fefa4064ee0 0x7fefa4067390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fefb80c5490 tx=0x7fefb0010000 comp rx=0 tx=0).stop 2023-11-28T13:00:35.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7fefbdc12700 1 -- 172.21.15.82:0/1982250879 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefb80c3c80 msgr2=0x7fefb80c40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7fefbdc12700 1 --2- 172.21.15.82:0/1982250879 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefb80c3c80 0x7fefb80c40f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fefac00b4d0 tx=0x7fefac00b890 comp rx=0 tx=0).stop 2023-11-28T13:00:35.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7fefb7fff700 1 -- 172.21.15.82:0/1982250879 reap_dead start 2023-11-28T13:00:35.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7fc9effff700 1 -- 172.21.15.82:0/2395033429 <== osd.1 v2:172.21.15.82:6808/36628 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc9e8002d60 con 0x7fc9f406d7e0 2023-11-28T13:00:35.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7f50ae872700 1 -- 172.21.15.82:0/2769003510 >> [v2:172.21.15.82:6824/36636,v1:172.21.15.82:6825/36636] conn(0x7f508c06d6c0 msgr2=0x7f508c06fad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7f50ae872700 1 --2- 172.21.15.82:0/2769003510 >> [v2:172.21.15.82:6824/36636,v1:172.21.15.82:6825/36636] conn(0x7f508c06d6c0 0x7f508c06fad0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7f0d36ffd700 1 -- 172.21.15.82:0/1916200691 <== osd.5 v2:172.21.15.114:6808/36804 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0d28002d60 con 0x7f0d2406d7e0 2023-11-28T13:00:35.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7f50ae872700 1 -- 172.21.15.82:0/2769003510 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f508c064f10 msgr2=0x7f508c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7f50ae872700 1 --2- 172.21.15.82:0/2769003510 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f508c064f10 0x7f508c0673c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009c60 tx=0x7f50a4008030 comp rx=0 tx=0).stop 2023-11-28T13:00:35.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7f50ae872700 1 -- 172.21.15.82:0/2769003510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50a80c8490 msgr2=0x7f50a8160ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7f50ae872700 1 --2- 172.21.15.82:0/2769003510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50a80c8490 0x7f50a8160ce0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f509800c430 tx=0x7f509800c740 comp rx=0 tx=0).stop 2023-11-28T13:00:35.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7f50ae071700 1 -- 172.21.15.82:0/2769003510 reap_dead start 2023-11-28T13:00:35.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7fefbdc12700 1 -- 172.21.15.82:0/1982250879 shutdown_connections 2023-11-28T13:00:35.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7fefbdc12700 1 -- 172.21.15.82:0/1982250879 >> 172.21.15.82:0/1982250879 conn(0x7fefb80ce600 msgr2=0x7fefb80b3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:35.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7f50ae872700 1 -- 172.21.15.82:0/2769003510 shutdown_connections 2023-11-28T13:00:35.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7f50ae872700 1 -- 172.21.15.82:0/2769003510 >> 172.21.15.82:0/2769003510 conn(0x7f50a80ce600 msgr2=0x7f50a80aee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:35.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7fefbdc12700 1 -- 172.21.15.82:0/1982250879 shutdown_connections 2023-11-28T13:00:35.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7fefbdc12700 1 -- 172.21.15.82:0/1982250879 wait complete. 2023-11-28T13:00:35.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7f3a62bc1700 1 -- 172.21.15.82:0/536510409 --> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3a5c06afc0 con 0x7f3a5c1ee110 2023-11-28T13:00:35.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7f50ae872700 1 -- 172.21.15.82:0/2769003510 shutdown_connections 2023-11-28T13:00:35.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7f50ae872700 1 -- 172.21.15.82:0/2769003510 wait complete. 2023-11-28T13:00:35.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7f0d47089700 1 -- 172.21.15.82:0/1916200691 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x7f0d2406d7e0 msgr2=0x7f0d2406fbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7f0d47089700 1 --2- 172.21.15.82:0/1916200691 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x7f0d2406d7e0 0x7f0d2406fbf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7f0d47089700 1 -- 172.21.15.82:0/1916200691 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0d24064fb0 msgr2=0x7f0d24067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7f0d47089700 1 --2- 172.21.15.82:0/1916200691 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0d24064fb0 0x7f0d24067460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c000f60 tx=0x7f0d3c009040 comp rx=0 tx=0).stop 2023-11-28T13:00:35.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7f0d47089700 1 -- 172.21.15.82:0/1916200691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d400cca60 msgr2=0x7f0d400ca5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7f0d47089700 1 --2- 172.21.15.82:0/1916200691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d400cca60 0x7f0d400ca5c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000c4d0 tx=0x7f0d3000c890 comp rx=0 tx=0).stop 2023-11-28T13:00:35.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.924+0000 7f0d46888700 1 -- 172.21.15.82:0/1916200691 reap_dead start 2023-11-28T13:00:35.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.928+0000 7f0d47089700 1 -- 172.21.15.82:0/1916200691 shutdown_connections 2023-11-28T13:00:35.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.928+0000 7f0d47089700 1 -- 172.21.15.82:0/1916200691 >> 172.21.15.82:0/1916200691 conn(0x7f0d400cfb20 msgr2=0x7f0d40159d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:35.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.928+0000 7fca0dba5700 1 -- 172.21.15.82:0/2395033429 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x7fc9f406d7e0 msgr2=0x7fc9f406fbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.928+0000 7fca0dba5700 1 --2- 172.21.15.82:0/2395033429 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x7fc9f406d7e0 0x7fc9f406fbf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.928+0000 7f0d47089700 1 -- 172.21.15.82:0/1916200691 shutdown_connections 2023-11-28T13:00:35.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.928+0000 7fca0dba5700 1 -- 172.21.15.82:0/2395033429 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc9f4064f30 msgr2=0x7fc9f40673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.928+0000 7f0d47089700 1 -- 172.21.15.82:0/1916200691 wait complete. 2023-11-28T13:00:35.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.928+0000 7fca0dba5700 1 --2- 172.21.15.82:0/2395033429 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc9f4064f30 0x7fc9f40673e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fca080cb0e0 tx=0x7fc9fc008030 comp rx=0 tx=0).stop 2023-11-28T13:00:35.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.928+0000 7fca0dba5700 1 -- 172.21.15.82:0/2395033429 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca080c9540 msgr2=0x7fca080c76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.928+0000 7fca0dba5700 1 --2- 172.21.15.82:0/2395033429 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca080c9540 0x7fca080c76b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800c430 tx=0x7fc9f800c740 comp rx=0 tx=0).stop 2023-11-28T13:00:35.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.928+0000 7fca07fff700 1 -- 172.21.15.82:0/2395033429 reap_dead start 2023-11-28T13:00:35.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.928+0000 7f3a5a7fc700 1 -- 172.21.15.82:0/536510409 <== osd.7 v2:172.21.15.114:6816/36806 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3a5c06afc0 con 0x7f3a5c1ee110 2023-11-28T13:00:35.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.928+0000 7fca0dba5700 1 -- 172.21.15.82:0/2395033429 shutdown_connections 2023-11-28T13:00:35.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.928+0000 7fca0dba5700 1 -- 172.21.15.82:0/2395033429 >> 172.21.15.82:0/2395033429 conn(0x7fca080ce9b0 msgr2=0x7fca080702e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:35.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.928+0000 7fca0dba5700 1 -- 172.21.15.82:0/2395033429 shutdown_connections 2023-11-28T13:00:35.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.928+0000 7fca0dba5700 1 -- 172.21.15.82:0/2395033429 wait complete. 2023-11-28T13:00:35.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.928+0000 7f3a62bc1700 1 -- 172.21.15.82:0/536510409 >> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] conn(0x7f3a5c1ee110 msgr2=0x7f3a5c069bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.928+0000 7f3a62bc1700 1 --2- 172.21.15.82:0/536510409 >> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] conn(0x7f3a5c1ee110 0x7f3a5c069bc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.932+0000 7f3a62bc1700 1 -- 172.21.15.82:0/536510409 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3a48064f60 msgr2=0x7f3a48067410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.932+0000 7f3a62bc1700 1 --2- 172.21.15.82:0/536510409 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3a48064f60 0x7f3a48067410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0c9330 tx=0x7f3a50007a80 comp rx=0 tx=0).stop 2023-11-28T13:00:35.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.932+0000 7f3a62bc1700 1 -- 172.21.15.82:0/536510409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a5c0b5c80 msgr2=0x7f3a5c1f01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.932+0000 7f3a62bc1700 1 --2- 172.21.15.82:0/536510409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a5c0b5c80 0x7f3a5c1f01a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c00b370 tx=0x7f3a4c004af0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.982 INFO:teuthology.orchestra.run.smithi082.stdout:55834574855 2023-11-28T13:00:35.982 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T13:00:35.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.932+0000 7f3a623c0700 1 -- 172.21.15.82:0/536510409 reap_dead start 2023-11-28T13:00:35.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.932+0000 7f3a62bc1700 1 -- 172.21.15.82:0/536510409 shutdown_connections 2023-11-28T13:00:35.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.932+0000 7f3a62bc1700 1 -- 172.21.15.82:0/536510409 >> 172.21.15.82:0/536510409 conn(0x7f3a5c0cf4c0 msgr2=0x7f3a5c0b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:35.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.932+0000 7f3a62bc1700 1 -- 172.21.15.82:0/536510409 shutdown_connections 2023-11-28T13:00:35.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.932+0000 7f3a62bc1700 1 -- 172.21.15.82:0/536510409 wait complete. 2023-11-28T13:00:35.984 INFO:teuthology.orchestra.run.smithi082.stdout:55834574857 2023-11-28T13:00:35.984 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T13:00:35.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.936+0000 7f65a759e700 1 -- 172.21.15.82:0/2844815459 --> [v2:172.21.15.114:6800/36803,v1:172.21.15.114:6801/36803] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f658c005c60 con 0x7f658c0015e0 2023-11-28T13:00:35.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.936+0000 7f6596ffd700 1 -- 172.21.15.82:0/2844815459 <== osd.4 v2:172.21.15.114:6800/36803 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f658c005c60 con 0x7f658c0015e0 2023-11-28T13:00:35.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.936+0000 7f65a759e700 1 -- 172.21.15.82:0/2844815459 >> [v2:172.21.15.114:6800/36803,v1:172.21.15.114:6801/36803] conn(0x7f658c0015e0 msgr2=0x7f658c003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.936+0000 7f65a759e700 1 --2- 172.21.15.82:0/2844815459 >> [v2:172.21.15.114:6800/36803,v1:172.21.15.114:6801/36803] conn(0x7f658c0015e0 0x7f658c003a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:35.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.936+0000 7f65a759e700 1 -- 172.21.15.82:0/2844815459 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6588064f30 msgr2=0x7f65880673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.936+0000 7f65a759e700 1 --2- 172.21.15.82:0/2844815459 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6588064f30 0x7f65880673e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f65a0000f80 tx=0x7f65a0001680 comp rx=0 tx=0).stop 2023-11-28T13:00:35.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.936+0000 7f65a759e700 1 -- 172.21.15.82:0/2844815459 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f65a80b6140 msgr2=0x7f65a806b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:35.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.936+0000 7f65a759e700 1 --2- 172.21.15.82:0/2844815459 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f65a80b6140 0x7f65a806b560 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f659c00b550 tx=0x7f659c00b910 comp rx=0 tx=0).stop 2023-11-28T13:00:35.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.936+0000 7f65a6d9d700 1 -- 172.21.15.82:0/2844815459 reap_dead start 2023-11-28T13:00:35.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.936+0000 7f65a759e700 1 -- 172.21.15.82:0/2844815459 shutdown_connections 2023-11-28T13:00:35.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.936+0000 7f65a759e700 1 -- 172.21.15.82:0/2844815459 >> 172.21.15.82:0/2844815459 conn(0x7f65a80cdf40 msgr2=0x7f65a815dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:35.987 INFO:teuthology.orchestra.run.smithi082.stdout:55834574857 2023-11-28T13:00:35.987 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T13:00:35.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.940+0000 7f65a759e700 1 -- 172.21.15.82:0/2844815459 shutdown_connections 2023-11-28T13:00:35.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:35.940+0000 7f65a759e700 1 -- 172.21.15.82:0/2844815459 wait complete. 2023-11-28T13:00:35.989 INFO:teuthology.orchestra.run.smithi082.stdout:55834574856 2023-11-28T13:00:35.989 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T13:00:35.989 INFO:teuthology.orchestra.run.smithi082.stdout:55834574857 2023-11-28T13:00:35.990 INFO:teuthology.orchestra.run.smithi082.stdout:55834574856 2023-11-28T13:00:35.990 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T13:00:35.991 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T13:00:35.992 INFO:teuthology.orchestra.run.smithi082.stdout:55834574855 2023-11-28T13:00:35.992 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T13:00:35.993 INFO:teuthology.orchestra.run.smithi082.stdout:55834574856 2023-11-28T13:00:35.994 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T13:00:36.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a2aaf5700 1 Processor -- start 2023-11-28T13:00:36.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a2aaf5700 1 -- start start 2023-11-28T13:00:36.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a2aaf5700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a24168f10 0x7f7a240cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a2aaf5700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7a24089570 0x7f7a2406a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a2aaf5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7a2406aae0 0x7f7a24070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a2aaf5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a240cc710 con 0x7f7a2406aae0 2023-11-28T13:00:36.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a2aaf5700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a240ce160 con 0x7f7a24089570 2023-11-28T13:00:36.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a2aaf5700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a240ad810 con 0x7f7a24168f10 2023-11-28T13:00:36.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a23fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7a24089570 0x7f7a2406a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a28891700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a24168f10 0x7f7a240cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a23fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7a24089570 0x7f7a2406a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:51034/0 (socket says 172.21.15.82:51034) 2023-11-28T13:00:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a28891700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a24168f10 0x7f7a240cc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:47372/0 (socket says 172.21.15.82:47372) 2023-11-28T13:00:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a23fff700 1 -- 172.21.15.82:0/4184303884 learned_addr learned my addr 172.21.15.82:0/4184303884 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a29092700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7a2406aae0 0x7f7a24070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a29092700 1 -- 172.21.15.82:0/4184303884 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a24168f10 msgr2=0x7f7a240cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a29092700 1 --2- 172.21.15.82:0/4184303884 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a24168f10 0x7f7a240cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a29092700 1 -- 172.21.15.82:0/4184303884 >> v2:172.21.15.114:3300/0 conn(0x7f7a24089570 msgr2=0x7f7a2406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a29092700 1 --2- 172.21.15.82:0/4184303884 >> v2:172.21.15.114:3300/0 conn(0x7f7a24089570 0x7f7a2406a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a29092700 1 -- 172.21.15.82:0/4184303884 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a240adaf0 con 0x7f7a2406aae0 2023-11-28T13:00:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a23fff700 1 --2- 172.21.15.82:0/4184303884 >> v2:172.21.15.114:3300/0 conn(0x7f7a24089570 0x7f7a2406a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a29092700 1 --2- 172.21.15.82:0/4184303884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2406aae0 0x7f7a24070070 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7a2406bdf0 tx=0x7f7a18009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72166aa3f30e7cad server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a237fe700 1 -- 172.21.15.82:0/4184303884 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a18022640 con 0x7f7a2406aae0 2023-11-28T13:00:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a237fe700 1 -- 172.21.15.82:0/4184303884 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a180227a0 con 0x7f7a2406aae0 2023-11-28T13:00:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.120+0000 7f7a237fe700 1 -- 172.21.15.82:0/4184303884 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a18022b30 con 0x7f7a2406aae0 2023-11-28T13:00:36.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.124+0000 7f7a2aaf5700 1 -- 172.21.15.82:0/4184303884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2406aae0 msgr2=0x7f7a24070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.124+0000 7f7a2aaf5700 1 --2- 172.21.15.82:0/4184303884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2406aae0 0x7f7a24070070 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7a2406bdf0 tx=0x7f7a18009b30 comp rx=0 tx=0).stop 2023-11-28T13:00:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.124+0000 7f7a2aaf5700 1 -- 172.21.15.82:0/4184303884 shutdown_connections 2023-11-28T13:00:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.124+0000 7f7a2aaf5700 1 --2- 172.21.15.82:0/4184303884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2406aae0 0x7f7a24070070 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.124+0000 7f7a2aaf5700 1 --2- 172.21.15.82:0/4184303884 >> v2:172.21.15.114:3300/0 conn(0x7f7a24089570 0x7f7a2406a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.124+0000 7f7a2aaf5700 1 --2- 172.21.15.82:0/4184303884 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a24168f10 0x7f7a240cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.124+0000 7f7a2aaf5700 1 -- 172.21.15.82:0/4184303884 >> 172.21.15.82:0/4184303884 conn(0x7f7a240cbd10 msgr2=0x7f7a240ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.124+0000 7f7a2aaf5700 1 -- 172.21.15.82:0/4184303884 shutdown_connections 2023-11-28T13:00:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.124+0000 7f7a2aaf5700 1 -- 172.21.15.82:0/4184303884 wait complete. 2023-11-28T13:00:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.124+0000 7f7a2aaf5700 1 Processor -- start 2023-11-28T13:00:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.124+0000 7f7a2aaf5700 1 -- start start 2023-11-28T13:00:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a2aaf5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2406aae0 0x7f7a240adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a2aaf5700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a24089570 0x7f7a241fe230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a2aaf5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a24168f10 0x7f7a240b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a28891700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2406aae0 0x7f7a240adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a28891700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2406aae0 0x7f7a240adff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57574/0 (socket says 172.21.15.82:57574) 2023-11-28T13:00:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a28891700 1 -- 172.21.15.82:0/3523206408 learned_addr learned my addr 172.21.15.82:0/3523206408 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a23fff700 1 --2- 172.21.15.82:0/3523206408 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a24089570 0x7f7a241fe230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a2aaf5700 1 -- 172.21.15.82:0/3523206408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a240c2130 con 0x7f7a2406aae0 2023-11-28T13:00:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a2aaf5700 1 -- 172.21.15.82:0/3523206408 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a241fe770 con 0x7f7a24168f10 2023-11-28T13:00:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a29092700 1 --2- 172.21.15.82:0/3523206408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a24168f10 0x7f7a240b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a2aaf5700 1 -- 172.21.15.82:0/3523206408 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a240c2380 con 0x7f7a24089570 2023-11-28T13:00:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a28891700 1 -- 172.21.15.82:0/3523206408 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a24089570 msgr2=0x7f7a241fe230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a28891700 1 --2- 172.21.15.82:0/3523206408 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a24089570 0x7f7a241fe230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a28891700 1 -- 172.21.15.82:0/3523206408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a24168f10 msgr2=0x7f7a240b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a28891700 1 --2- 172.21.15.82:0/3523206408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a24168f10 0x7f7a240b2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a28891700 1 -- 172.21.15.82:0/3523206408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1400b630 con 0x7f7a2406aae0 2023-11-28T13:00:36.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a28891700 1 --2- 172.21.15.82:0/3523206408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2406aae0 0x7f7a240adff0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c008580 tx=0x7f7a1c008890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a217fa700 1 -- 172.21.15.82:0/3523206408 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c00d2d0 con 0x7f7a2406aae0 2023-11-28T13:00:36.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a217fa700 1 -- 172.21.15.82:0/3523206408 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c00d430 con 0x7f7a2406aae0 2023-11-28T13:00:36.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a2aaf5700 1 -- 172.21.15.82:0/3523206408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a180094b0 con 0x7f7a2406aae0 2023-11-28T13:00:36.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a2aaf5700 1 -- 172.21.15.82:0/3523206408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a240cddf0 con 0x7f7a2406aae0 2023-11-28T13:00:36.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.128+0000 7f7a217fa700 1 -- 172.21.15.82:0/3523206408 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c00b940 con 0x7f7a2406aae0 2023-11-28T13:00:36.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.132+0000 7f7a217fa700 1 -- 172.21.15.82:0/3523206408 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7a1c01d030 con 0x7f7a2406aae0 2023-11-28T13:00:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.132+0000 7f7a217fa700 1 --2- 172.21.15.82:0/3523206408 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a0c0650c0 0x7f7a0c067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.132+0000 7f7a23fff700 1 --2- 172.21.15.82:0/3523206408 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a0c0650c0 0x7f7a0c067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.132+0000 7f7a217fa700 1 -- 172.21.15.82:0/3523206408 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a1c082580 con 0x7f7a2406aae0 2023-11-28T13:00:36.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.132+0000 7f7a23fff700 1 --2- 172.21.15.82:0/3523206408 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a0c0650c0 0x7f7a0c067570 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7a240c5130 tx=0x7f7a1400f040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.132+0000 7f7a2aaf5700 1 -- 172.21.15.82:0/3523206408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a04005310 con 0x7f7a2406aae0 2023-11-28T13:00:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.140+0000 7f7a217fa700 1 -- 172.21.15.82:0/3523206408 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7a1c01b070 con 0x7f7a2406aae0 2023-11-28T13:00:36.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.140+0000 7fb0e7fff700 1 Processor -- start 2023-11-28T13:00:36.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.140+0000 7fb0e7fff700 1 -- start start 2023-11-28T13:00:36.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.140+0000 7f6dbf59e700 1 Processor -- start 2023-11-28T13:00:36.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.140+0000 7f6dbf59e700 1 -- start start 2023-11-28T13:00:36.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.140+0000 7fcee892d700 1 Processor -- start 2023-11-28T13:00:36.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.140+0000 7fcee892d700 1 -- start start 2023-11-28T13:00:36.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.140+0000 7f6dbf59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6dc00ced10 0x7f6dc0070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.140+0000 7f6dbf59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dc01585f0 con 0x7f6dc0141500 2023-11-28T13:00:36.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.140+0000 7f6dbf59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dc006a9e0 con 0x7f6dc00c9c60 2023-11-28T13:00:36.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.140+0000 7f6dbf59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc015ca00 con 0x7f6dc00ced10 2023-11-28T13:00:36.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7f6dbe59c700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6dc00ced10 0x7f6dc0070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7f6dbe59c700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6dc00ced10 0x7f6dc0070070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:51058/0 (socket says 172.21.15.82:51058) 2023-11-28T13:00:36.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7f6dbe59c700 1 -- 172.21.15.82:0/509265790 learned_addr learned my addr 172.21.15.82:0/509265790 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:36.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fcee892d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcee415a1d0 0x7fcee415c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fcee892d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcee415cf30 0x7fcee40703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7f6dbe59c700 1 -- 172.21.15.82:0/509265790 >> v1:172.21.15.114:6789/0 conn(0x7f6dc00c9c60 legacy=0x7f6dc006a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fcee892d700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee4069bc0 con 0x7fcee4159e00 2023-11-28T13:00:36.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fcee892d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee415d3d0 con 0x7fcee415a1d0 2023-11-28T13:00:36.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fcee892d700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee40ce6b0 con 0x7fcee415cf30 2023-11-28T13:00:36.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.140+0000 7fb0e7fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb0e80cc1d0 0x7fb0e806a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.140+0000 7fb0e7fff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e80ce160 con 0x7fb0e8089570 2023-11-28T13:00:36.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.140+0000 7fb0e7fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e81693b0 con 0x7fb0e806aae0 2023-11-28T13:00:36.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.140+0000 7fb0e7fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e8089940 con 0x7fb0e80cc1d0 2023-11-28T13:00:36.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.140+0000 7fb0e6ffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb0e8089570 0x7fb0e8168ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:37082/0 (socket says 172.21.15.82:37082) 2023-11-28T13:00:36.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.140+0000 7fb0e6ffd700 1 -- 172.21.15.82:0/3955884769 learned_addr learned my addr 172.21.15.82:0/3955884769 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:36.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.140+0000 7fb0e67fc700 1 --2- 172.21.15.82:0/3955884769 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb0e80cc1d0 0x7fb0e806a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fb0e67fc700 1 -- 172.21.15.82:0/3955884769 >> v1:172.21.15.114:6789/0 conn(0x7fb0e806aae0 legacy=0x7fb0e8070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fb0e67fc700 1 -- 172.21.15.82:0/3955884769 >> v1:172.21.15.82:6789/0 conn(0x7fb0e8089570 legacy=0x7fb0e8168ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fb0e67fc700 1 -- 172.21.15.82:0/3955884769 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e80adaf0 con 0x7fb0e80cc1d0 2023-11-28T13:00:36.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fb0e67fc700 1 --2- 172.21.15.82:0/3955884769 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb0e80cc1d0 0x7fb0e806a5a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8014470 tx=0x7fb0d8014780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7452654d49a9b077 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7f6dbe59c700 1 -- 172.21.15.82:0/509265790 >> v1:172.21.15.82:6789/0 conn(0x7f6dc0141500 legacy=0x7f6dc0069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7f6dbe59c700 1 -- 172.21.15.82:0/509265790 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc015f060 con 0x7f6dc00ced10 2023-11-28T13:00:36.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fcee1d9b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcee415a1d0 0x7fcee415c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fcee2d9d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcee415cf30 0x7fcee40703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fb0e5ffb700 1 -- 172.21.15.82:0/3955884769 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d8004230 con 0x7fb0e80cc1d0 2023-11-28T13:00:36.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fcee1d9b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcee415a1d0 0x7fcee415c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:51060/0 (socket says 172.21.15.82:51060) 2023-11-28T13:00:36.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fcee1d9b700 1 -- 172.21.15.82:0/2568647957 learned_addr learned my addr 172.21.15.82:0/2568647957 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:36.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fb0e5ffb700 1 -- 172.21.15.82:0/3955884769 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d8004390 con 0x7fb0e80cc1d0 2023-11-28T13:00:36.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7f6dbe59c700 1 --2- 172.21.15.82:0/509265790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc00ced10 0x7f6dc0070070 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6db0009910 tx=0x7f6db0009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dcdf354e10e2bfa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7f6dbd59a700 1 -- 172.21.15.82:0/509265790 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db000ba60 con 0x7f6dc00ced10 2023-11-28T13:00:36.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fcee1d9b700 1 -- 172.21.15.82:0/2568647957 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcee415cf30 msgr2=0x7fcee40703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:36.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fcee1d9b700 1 --2- 172.21.15.82:0/2568647957 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcee415cf30 0x7fcee40703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fcee1d9b700 1 -- 172.21.15.82:0/2568647957 >> v1:172.21.15.114:6789/0 conn(0x7fcee4159e00 legacy=0x7fcee406a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:36.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7f6dbd59a700 1 -- 172.21.15.82:0/509265790 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db000bbc0 con 0x7f6dc00ced10 2023-11-28T13:00:36.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7f6dbd59a700 1 -- 172.21.15.82:0/509265790 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db0009e60 con 0x7f6dc00ced10 2023-11-28T13:00:36.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fb0e7fff700 1 -- 172.21.15.82:0/3955884769 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb0e80cc1d0 msgr2=0x7fb0e806a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fb0e7fff700 1 --2- 172.21.15.82:0/3955884769 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb0e80cc1d0 0x7fb0e806a5a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8014470 tx=0x7fb0d8014780 comp rx=0 tx=0).stop 2023-11-28T13:00:36.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fb0e7fff700 1 -- 172.21.15.82:0/3955884769 shutdown_connections 2023-11-28T13:00:36.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fb0e7fff700 1 --2- 172.21.15.82:0/3955884769 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb0e80cc1d0 0x7fb0e806a5a0 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8014470 tx=0x7fb0d8014780 comp rx=0 tx=0).stop 2023-11-28T13:00:36.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fb0e7fff700 1 -- 172.21.15.82:0/3955884769 >> 172.21.15.82:0/3955884769 conn(0x7fb0e80cbd10 msgr2=0x7fb0e80ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:36.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fb0e7fff700 1 -- 172.21.15.82:0/3955884769 shutdown_connections 2023-11-28T13:00:36.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fb0e7fff700 1 -- 172.21.15.82:0/3955884769 wait complete. 2023-11-28T13:00:36.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7f6dbf59e700 1 -- 172.21.15.82:0/509265790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc00ced10 msgr2=0x7f6dc0070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7f6dbf59e700 1 --2- 172.21.15.82:0/509265790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc00ced10 0x7f6dc0070070 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6db0009910 tx=0x7f6db0009c20 comp rx=0 tx=0).stop 2023-11-28T13:00:36.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7f6dbf59e700 1 -- 172.21.15.82:0/509265790 shutdown_connections 2023-11-28T13:00:36.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7f6dbf59e700 1 --2- 172.21.15.82:0/509265790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc00ced10 0x7f6dc0070070 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7f6dbf59e700 1 -- 172.21.15.82:0/509265790 >> 172.21.15.82:0/509265790 conn(0x7f6dc00cbd10 msgr2=0x7f6dc00ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:36.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7f6dbf59e700 1 -- 172.21.15.82:0/509265790 shutdown_connections 2023-11-28T13:00:36.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fcee1d9b700 1 -- 172.21.15.82:0/2568647957 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee415d5b0 con 0x7fcee415a1d0 2023-11-28T13:00:36.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7f13cbfff700 1 Processor -- start 2023-11-28T13:00:36.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7f13cbfff700 1 -- start start 2023-11-28T13:00:36.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7f6dbf59e700 1 -- 172.21.15.82:0/509265790 wait complete. 2023-11-28T13:00:36.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.144+0000 7fcee1d9b700 1 --2- 172.21.15.82:0/2568647957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcee415a1d0 0x7fcee415c9f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009e50 tx=0x7fcedc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbde896d4ea9e21d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fcee159a700 1 -- 172.21.15.82:0/2568647957 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc00e070 con 0x7fcee415a1d0 2023-11-28T13:00:36.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fcee159a700 1 -- 172.21.15.82:0/2568647957 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcedc003a40 con 0x7fcee415a1d0 2023-11-28T13:00:36.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fcee159a700 1 -- 172.21.15.82:0/2568647957 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc003df0 con 0x7fcee415a1d0 2023-11-28T13:00:36.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fb0e7fff700 1 Processor -- start 2023-11-28T13:00:36.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f6dbf59e700 1 Processor -- start 2023-11-28T13:00:36.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f13cbfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13cc06d430 0x7f13cc070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f13cbfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f13cc0cc1d0 0x7f13cc069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f13cbfff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13cc06de00 con 0x7f13cc070070 2023-11-28T13:00:36.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f13cbfff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13cc06b520 con 0x7f13cc0cc1d0 2023-11-28T13:00:36.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f13cbfff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc070980 con 0x7f13cc06d430 2023-11-28T13:00:36.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fcee892d700 1 -- 172.21.15.82:0/2568647957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcee415a1d0 msgr2=0x7fcee415c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fcee892d700 1 --2- 172.21.15.82:0/2568647957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcee415a1d0 0x7fcee415c9f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009e50 tx=0x7fcedc00b330 comp rx=0 tx=0).stop 2023-11-28T13:00:36.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f6dbf59e700 1 -- start start 2023-11-28T13:00:36.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fb0e7fff700 1 -- start start 2023-11-28T13:00:36.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f13cb7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f13cc0cc1d0 0x7f13cc069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f13cb7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f13cc0cc1d0 0x7f13cc069bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57590/0 (socket says 172.21.15.82:57590) 2023-11-28T13:00:36.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f13cb7fe700 1 -- 172.21.15.82:0/3578023395 learned_addr learned my addr 172.21.15.82:0/3578023395 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:36.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f13ca7fc700 1 --2- 172.21.15.82:0/3578023395 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13cc06d430 0x7f13cc070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f7034bae700 1 Processor -- start 2023-11-28T13:00:36.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f6dbf59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc00c9c60 0x7f6dc00b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f6dbf59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6dc00ced10 0x7f6dc00b1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f6dbf59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6dc0141500 0x7f6dc006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f6dbf59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc0156280 con 0x7f6dc00ced10 2023-11-28T13:00:36.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f6dbf59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc0155c70 con 0x7f6dc00c9c60 2023-11-28T13:00:36.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f6dbf59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc00b4200 con 0x7f6dc0141500 2023-11-28T13:00:36.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fb0e7fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb0e806aae0 0x7fb0e8202ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fb0e7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0e8089570 0x7fb0e80c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fb0e7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0e80c9c80 0x7fb0e8165be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fb0e7fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e8200630 con 0x7fb0e80c9c80 2023-11-28T13:00:36.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fb0e7fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e80c1df0 con 0x7fb0e8089570 2023-11-28T13:00:36.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fb0e7fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e80ca460 con 0x7fb0e806aae0 2023-11-28T13:00:36.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fb0e77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0e80c9c80 0x7fb0e8165be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fb0e77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0e80c9c80 0x7fb0e8165be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57596/0 (socket says 172.21.15.82:57596) 2023-11-28T13:00:36.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fb0e77fe700 1 -- 172.21.15.82:0/3058549945 learned_addr learned my addr 172.21.15.82:0/3058549945 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:36.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f6dbdd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6dc00ced10 0x7f6dc00b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f6dbdd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6dc00ced10 0x7f6dc00b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57600/0 (socket says 172.21.15.82:57600) 2023-11-28T13:00:36.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f6dbdd9b700 1 -- 172.21.15.82:0/1197934069 learned_addr learned my addr 172.21.15.82:0/1197934069 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:36.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fcee892d700 1 -- 172.21.15.82:0/2568647957 shutdown_connections 2023-11-28T13:00:36.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fcee892d700 1 --2- 172.21.15.82:0/2568647957 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcee415cf30 0x7fcee40703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fcee892d700 1 --2- 172.21.15.82:0/2568647957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcee415a1d0 0x7fcee415c9f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fcee892d700 1 -- 172.21.15.82:0/2568647957 >> 172.21.15.82:0/2568647957 conn(0x7fcee40ce9b0 msgr2=0x7fcee40ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:36.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f13cb7fe700 1 -- 172.21.15.82:0/3578023395 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13cc06d430 msgr2=0x7f13cc070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:36.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f13cb7fe700 1 --2- 172.21.15.82:0/3578023395 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13cc06d430 0x7f13cc070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f13cb7fe700 1 -- 172.21.15.82:0/3578023395 >> v1:172.21.15.114:6789/0 conn(0x7f13cc070070 legacy=0x7f13cc0cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f13cb7fe700 1 -- 172.21.15.82:0/3578023395 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13cc06cb20 con 0x7f13cc0cc1d0 2023-11-28T13:00:36.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f13cb7fe700 1 --2- 172.21.15.82:0/3578023395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13cc0cc1d0 0x7f13cc069bc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f13bc009910 tx=0x7f13bc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9031416fe2bb99d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f13c9ffb700 1 -- 172.21.15.82:0/3578023395 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc011830 con 0x7f13cc0cc1d0 2023-11-28T13:00:36.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f13c9ffb700 1 -- 172.21.15.82:0/3578023395 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc011990 con 0x7f13cc0cc1d0 2023-11-28T13:00:36.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f13c9ffb700 1 -- 172.21.15.82:0/3578023395 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc011d40 con 0x7f13cc0cc1d0 2023-11-28T13:00:36.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f7034bae700 1 -- start start 2023-11-28T13:00:36.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f7034bae700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7030070070 0x7f7030070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f7034bae700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7030160900 0x7f70300cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f7034bae700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7030070980 con 0x7f70300c1910 2023-11-28T13:00:36.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f7034bae700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70300ce030 con 0x7f7030070070 2023-11-28T13:00:36.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f7034bae700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70300ce310 con 0x7f7030160900 2023-11-28T13:00:36.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fb0e67fc700 1 --2- 172.21.15.82:0/3058549945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0e8089570 0x7fb0e80c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fb0e6ffd700 1 --2- 172.21.15.82:0/3058549945 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb0e806aae0 0x7fb0e8202ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f702f7fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7030070070 0x7f7030070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fcee892d700 1 -- 172.21.15.82:0/2568647957 shutdown_connections 2023-11-28T13:00:36.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fb0e77fe700 1 -- 172.21.15.82:0/3058549945 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb0e806aae0 msgr2=0x7fb0e8202ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fb0e77fe700 1 --2- 172.21.15.82:0/3058549945 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb0e806aae0 0x7fb0e8202ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fb0e77fe700 1 -- 172.21.15.82:0/3058549945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0e8089570 msgr2=0x7fb0e80c18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f702f7fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7030070070 0x7f7030070440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:51082/0 (socket says 172.21.15.82:51082) 2023-11-28T13:00:36.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f702f7fe700 1 -- 172.21.15.82:0/1173111150 learned_addr learned my addr 172.21.15.82:0/1173111150 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:36.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fb0e77fe700 1 --2- 172.21.15.82:0/3058549945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0e8089570 0x7fb0e80c18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7fb0e77fe700 1 -- 172.21.15.82:0/3058549945 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d800fcf0 con 0x7fb0e80c9c80 2023-11-28T13:00:36.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7fcee892d700 1 -- 172.21.15.82:0/2568647957 wait complete. 2023-11-28T13:00:36.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f6dbed9d700 1 --2- 172.21.15.82:0/1197934069 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6dc0141500 0x7f6dc006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.148+0000 7f6dbe59c700 1 --2- 172.21.15.82:0/1197934069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc00c9c60 0x7f6dc00b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f6dbdd9b700 1 -- 172.21.15.82:0/1197934069 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6dc0141500 msgr2=0x7f6dc006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f6dbdd9b700 1 --2- 172.21.15.82:0/1197934069 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6dc0141500 0x7f6dc006cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f6dbdd9b700 1 -- 172.21.15.82:0/1197934069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc00c9c60 msgr2=0x7f6dc00b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f6dbdd9b700 1 --2- 172.21.15.82:0/1197934069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc00c9c60 0x7f6dc00b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f6dbdd9b700 1 -- 172.21.15.82:0/1197934069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db0009570 con 0x7f6dc00ced10 2023-11-28T13:00:36.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f702effd700 1 --2- 172.21.15.82:0/1173111150 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7030160900 0x7f70300cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f6dbdd9b700 1 --2- 172.21.15.82:0/1197934069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6dc00ced10 0x7f6dc00b1660 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6db400c4d0 tx=0x7f6db400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7fb0e77fe700 1 --2- 172.21.15.82:0/3058549945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0e80c9c80 0x7fb0e8165be0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0001ff0 tx=0x7fb0e000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f6daeffd700 1 -- 172.21.15.82:0/1197934069 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db40052d0 con 0x7f6dc00ced10 2023-11-28T13:00:36.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7fb0cf7fe700 1 -- 172.21.15.82:0/3058549945 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0003e50 con 0x7fb0e80c9c80 2023-11-28T13:00:36.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f702effd700 1 -- 172.21.15.82:0/1173111150 >> v2:172.21.15.114:3300/0 conn(0x7f7030070070 msgr2=0x7f7030070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:36.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f702effd700 1 --2- 172.21.15.82:0/1173111150 >> v2:172.21.15.114:3300/0 conn(0x7f7030070070 0x7f7030070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f702effd700 1 -- 172.21.15.82:0/1173111150 >> v1:172.21.15.114:6789/0 conn(0x7f70300c1910 legacy=0x7f70301641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f702effd700 1 -- 172.21.15.82:0/1173111150 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703006a5d0 con 0x7f7030160900 2023-11-28T13:00:36.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f6daeffd700 1 -- 172.21.15.82:0/1197934069 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db4005430 con 0x7f6dc00ced10 2023-11-28T13:00:36.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f6daeffd700 1 -- 172.21.15.82:0/1197934069 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db40055a0 con 0x7f6dc00ced10 2023-11-28T13:00:36.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7fb0e7fff700 1 -- 172.21.15.82:0/3058549945 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e80cddf0 con 0x7fb0e80c9c80 2023-11-28T13:00:36.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7fb0e7fff700 1 -- 172.21.15.82:0/3058549945 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e80addd0 con 0x7fb0e80c9c80 2023-11-28T13:00:36.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f13cbfff700 1 -- 172.21.15.82:0/3578023395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13cc0cc1d0 msgr2=0x7f13cc069bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f13cbfff700 1 --2- 172.21.15.82:0/3578023395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13cc0cc1d0 0x7f13cc069bc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f13bc009910 tx=0x7f13bc009c20 comp rx=0 tx=0).stop 2023-11-28T13:00:36.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f13cbfff700 1 -- 172.21.15.82:0/3578023395 shutdown_connections 2023-11-28T13:00:36.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f13cbfff700 1 --2- 172.21.15.82:0/3578023395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13cc0cc1d0 0x7f13cc069bc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f13cbfff700 1 --2- 172.21.15.82:0/3578023395 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13cc06d430 0x7f13cc070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f13cbfff700 1 -- 172.21.15.82:0/3578023395 >> 172.21.15.82:0/3578023395 conn(0x7f13cc0cbd10 msgr2=0x7f13cc0ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:36.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f13cbfff700 1 -- 172.21.15.82:0/3578023395 shutdown_connections 2023-11-28T13:00:36.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f13cbfff700 1 -- 172.21.15.82:0/3578023395 wait complete. 2023-11-28T13:00:36.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f702effd700 1 --2- 172.21.15.82:0/1173111150 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7030160900 0x7f70300cc1d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7020009850 tx=0x7f7020009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=508c512016142c78 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f6dbf59e700 1 -- 172.21.15.82:0/1197934069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc015c340 con 0x7f6dc00ced10 2023-11-28T13:00:36.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f6dbf59e700 1 -- 172.21.15.82:0/1197934069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc015c060 con 0x7f6dc00ced10 2023-11-28T13:00:36.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7fcee892d700 1 Processor -- start 2023-11-28T13:00:36.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7fb0cf7fe700 1 -- 172.21.15.82:0/3058549945 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e000a930 con 0x7fb0e80c9c80 2023-11-28T13:00:36.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7fb0cf7fe700 1 -- 172.21.15.82:0/3058549945 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e000ace0 con 0x7fb0e80c9c80 2023-11-28T13:00:36.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f6dbf59e700 1 -- 172.21.15.82:0/1197934069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da4005310 con 0x7f6dc00ced10 2023-11-28T13:00:36.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f702e7fc700 1 -- 172.21.15.82:0/1173111150 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7020004230 con 0x7f7030160900 2023-11-28T13:00:36.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f702e7fc700 1 -- 172.21.15.82:0/1173111150 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7020004390 con 0x7f7030160900 2023-11-28T13:00:36.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f702e7fc700 1 -- 172.21.15.82:0/1173111150 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70200036c0 con 0x7f7030160900 2023-11-28T13:00:36.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f13cbfff700 1 Processor -- start 2023-11-28T13:00:36.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f544b893700 1 Processor -- start 2023-11-28T13:00:36.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f13cbfff700 1 -- start start 2023-11-28T13:00:36.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7fb0cf7fe700 1 -- 172.21.15.82:0/3058549945 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb0e0019030 con 0x7fb0e80c9c80 2023-11-28T13:00:36.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f7034bae700 1 -- 172.21.15.82:0/1173111150 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7030160900 msgr2=0x7f70300cc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7f7034bae700 1 --2- 172.21.15.82:0/1173111150 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7030160900 0x7f70300cc1d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7020009850 tx=0x7f7020009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:36.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.152+0000 7fcee892d700 1 -- start start 2023-11-28T13:00:36.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f7034bae700 1 -- 172.21.15.82:0/1173111150 shutdown_connections 2023-11-28T13:00:36.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f7034bae700 1 --2- 172.21.15.82:0/1173111150 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7030160900 0x7f70300cc1d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f7034bae700 1 --2- 172.21.15.82:0/1173111150 >> v2:172.21.15.114:3300/0 conn(0x7f7030070070 0x7f7030070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f7034bae700 1 -- 172.21.15.82:0/1173111150 >> 172.21.15.82:0/1173111150 conn(0x7f70300ce600 msgr2=0x7f70300ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:36.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fcee892d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcee4159e00 0x7fcee415afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fcee892d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcee415a1d0 0x7fcee41f9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fcee892d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcee415cf30 0x7fcee4156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fcee892d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee40c4cf0 con 0x7fcee415cf30 2023-11-28T13:00:36.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fcee892d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee40c2680 con 0x7fcee4159e00 2023-11-28T13:00:36.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fcee892d700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee415bf00 con 0x7fcee415a1d0 2023-11-28T13:00:36.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f544b893700 1 -- start start 2023-11-28T13:00:36.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f7034bae700 1 -- 172.21.15.82:0/1173111150 shutdown_connections 2023-11-28T13:00:36.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fb0cf7fe700 1 --2- 172.21.15.82:0/3058549945 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb0d4064fb0 0x7fb0d4067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fcee259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcee4159e00 0x7fcee415afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fcee259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcee4159e00 0x7fcee415afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:51084/0 (socket says 172.21.15.82:51084) 2023-11-28T13:00:36.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fcee259c700 1 -- 172.21.15.82:0/1333516310 learned_addr learned my addr 172.21.15.82:0/1333516310 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:36.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f7034bae700 1 -- 172.21.15.82:0/1173111150 wait complete. 2023-11-28T13:00:36.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fcee2d9d700 1 --2- 172.21.15.82:0/1333516310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcee415cf30 0x7fcee4156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fb0e6ffd700 1 --2- 172.21.15.82:0/3058549945 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb0d4064fb0 0x7fb0d4067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f13cbfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13cc06d430 0x7f13cc156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f13cbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13cc070070 0x7f13cc155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f13cbfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13cc0cc1d0 0x7f13cc0b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f13cbfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc0c2130 con 0x7f13cc070070 2023-11-28T13:00:36.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f13cbfff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc0c2380 con 0x7f13cc0cc1d0 2023-11-28T13:00:36.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f13cbfff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc0c49e0 con 0x7f13cc06d430 2023-11-28T13:00:36.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f13ca7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13cc070070 0x7f13cc155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f13ca7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13cc070070 0x7f13cc155da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57608/0 (socket says 172.21.15.82:57608) 2023-11-28T13:00:36.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f13ca7fc700 1 -- 172.21.15.82:0/4104065424 learned_addr learned my addr 172.21.15.82:0/4104065424 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:36.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fb0cf7fe700 1 -- 172.21.15.82:0/3058549945 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb0e00819c0 con 0x7fb0e80c9c80 2023-11-28T13:00:36.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fcee259c700 1 -- 172.21.15.82:0/1333516310 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcee415a1d0 msgr2=0x7fcee41f9c20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T13:00:36.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fcee259c700 1 --2- 172.21.15.82:0/1333516310 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcee415a1d0 0x7fcee41f9c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fcee259c700 1 -- 172.21.15.82:0/1333516310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcee415cf30 msgr2=0x7fcee4156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fcee259c700 1 --2- 172.21.15.82:0/1333516310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcee415cf30 0x7fcee4156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fcee259c700 1 -- 172.21.15.82:0/1333516310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc009b30 con 0x7fcee4159e00 2023-11-28T13:00:36.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fcee2d9d700 1 --2- 172.21.15.82:0/1333516310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcee415cf30 0x7fcee4156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:36.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fb0e7fff700 1 -- 172.21.15.82:0/3058549945 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e80cc600 con 0x7fb0e80c9c80 2023-11-28T13:00:36.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f544b893700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f54440704e0 0x7f5444070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f13ca7fc700 1 -- 172.21.15.82:0/4104065424 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13cc06d430 msgr2=0x7f13cc156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f13ca7fc700 1 --2- 172.21.15.82:0/4104065424 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13cc06d430 0x7f13cc156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f13ca7fc700 1 -- 172.21.15.82:0/4104065424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13cc0cc1d0 msgr2=0x7f13cc0b0140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T13:00:36.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f13ca7fc700 1 --2- 172.21.15.82:0/4104065424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13cc0cc1d0 0x7f13cc0b0140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f13ca7fc700 1 -- 172.21.15.82:0/4104065424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc009570 con 0x7f13cc070070 2023-11-28T13:00:36.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f544b893700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54440ae070 con 0x7f54440c16d0 2023-11-28T13:00:36.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fcee259c700 1 --2- 172.21.15.82:0/1333516310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcee4159e00 0x7fcee415afe0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fced400c4e0 tx=0x7fced400c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f13ca7fc700 1 --2- 172.21.15.82:0/4104065424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13cc070070 0x7f13cc155da0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f13c000e9d0 tx=0x7f13c000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f544b893700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5444160bb0 con 0x7f54440adca0 2023-11-28T13:00:36.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f544b893700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5444070ec0 con 0x7f54440704e0 2023-11-28T13:00:36.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f544962f700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f54440adca0 0x7f5444164c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:35108/0 (socket says 172.21.15.82:35108) 2023-11-28T13:00:36.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f544962f700 1 -- 172.21.15.82:0/3949572069 learned_addr learned my addr 172.21.15.82:0/3949572069 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:36.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fb0e6ffd700 1 --2- 172.21.15.82:0/3058549945 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb0d4064fb0 0x7fb0d4067460 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc000f60 tx=0x7fb0dc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f7034bae700 1 Processor -- start 2023-11-28T13:00:36.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fced2ffd700 1 -- 172.21.15.82:0/1333516310 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced4011790 con 0x7fcee4159e00 2023-11-28T13:00:36.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f5448e2e700 1 --2- 172.21.15.82:0/3949572069 >> v2:172.21.15.114:3300/0 conn(0x7f54440704e0 0x7f5444070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fced2ffd700 1 -- 172.21.15.82:0/1333516310 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced4011910 con 0x7fcee4159e00 2023-11-28T13:00:36.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fcee892d700 1 -- 172.21.15.82:0/1333516310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee4069e80 con 0x7fcee4159e00 2023-11-28T13:00:36.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fced2ffd700 1 -- 172.21.15.82:0/1333516310 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced4011cc0 con 0x7fcee4159e00 2023-11-28T13:00:36.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f7034bae700 1 -- start start 2023-11-28T13:00:36.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f6daeffd700 1 -- 172.21.15.82:0/1197934069 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6db4019030 con 0x7f6dc00ced10 2023-11-28T13:00:36.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7fcee892d700 1 -- 172.21.15.82:0/1333516310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee415d890 con 0x7fcee4159e00 2023-11-28T13:00:36.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f543bfff700 1 -- 172.21.15.82:0/3949572069 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730720127 0 0) 0x7f5444160bb0 con 0x7f54440adca0 2023-11-28T13:00:36.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f543bfff700 1 -- 172.21.15.82:0/3949572069 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54300035d0 con 0x7f54440adca0 2023-11-28T13:00:36.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f6daeffd700 1 --2- 172.21.15.82:0/1197934069 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6da0064f10 0x7f6da00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f6daeffd700 1 -- 172.21.15.82:0/1197934069 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6db4081160 con 0x7f6dc00ced10 2023-11-28T13:00:36.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.156+0000 7f6dbe59c700 1 --2- 172.21.15.82:0/1197934069 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6da0064f10 0x7f6da00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f5448e2e700 1 -- 172.21.15.82:0/3949572069 >> v1:172.21.15.114:6789/0 conn(0x7f54440adca0 legacy=0x7f5444164c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f5448e2e700 1 -- 172.21.15.82:0/3949572069 >> v1:172.21.15.82:6789/0 conn(0x7f54440c16d0 legacy=0x7f54440c1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f5448e2e700 1 -- 172.21.15.82:0/3949572069 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54440cca20 con 0x7f54440704e0 2023-11-28T13:00:36.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f6dbe59c700 1 --2- 172.21.15.82:0/1197934069 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6da0064f10 0x7f6da00673c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6db0006f80 tx=0x7f6db0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f7034bae700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7030070070 0x7f70300c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f7034bae700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f70300c4690 0x7f703015a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f5448e2e700 1 --2- 172.21.15.82:0/3949572069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54440704e0 0x7f5444070980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f543c009d90 tx=0x7f543c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=840563cb6ba20ca4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f7034bae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70300b3800 0x7f70300b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f7034bae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70300c4e00 con 0x7f70300b3800 2023-11-28T13:00:36.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f7034bae700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70300b41b0 con 0x7f7030070070 2023-11-28T13:00:36.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f7034bae700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703015abc0 con 0x7f70300c4690 2023-11-28T13:00:36.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7fcee892d700 1 -- 172.21.15.82:0/1333516310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec8005310 con 0x7fcee4159e00 2023-11-28T13:00:36.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f702f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7030070070 0x7f70300c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f702ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70300b3800 0x7f70300b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f702f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7030070070 0x7f70300c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:51098/0 (socket says 172.21.15.82:51098) 2023-11-28T13:00:36.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f702f7fe700 1 -- 172.21.15.82:0/3673766059 learned_addr learned my addr 172.21.15.82:0/3673766059 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:36.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f543bfff700 1 -- 172.21.15.82:0/3949572069 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c00e070 con 0x7f54440704e0 2023-11-28T13:00:36.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f543bfff700 1 -- 172.21.15.82:0/3949572069 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543c003a40 con 0x7f54440704e0 2023-11-28T13:00:36.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f702effd700 1 --2- 172.21.15.82:0/3673766059 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f70300c4690 0x7f703015a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f543bfff700 1 -- 172.21.15.82:0/3949572069 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440001670 con 0x7f54440704e0 2023-11-28T13:00:36.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7fced2ffd700 1 -- 172.21.15.82:0/1333516310 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fced4010050 con 0x7fcee4159e00 2023-11-28T13:00:36.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f6daeffd700 1 -- 172.21.15.82:0/1197934069 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6db404f230 con 0x7f6dc00ced10 2023-11-28T13:00:36.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f702ffff700 1 -- 172.21.15.82:0/3673766059 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f70300c4690 msgr2=0x7f703015a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f702ffff700 1 --2- 172.21.15.82:0/3673766059 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f70300c4690 0x7f703015a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f702ffff700 1 -- 172.21.15.82:0/3673766059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7030070070 msgr2=0x7f70300c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f702ffff700 1 --2- 172.21.15.82:0/3673766059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7030070070 0x7f70300c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f702ffff700 1 -- 172.21.15.82:0/3673766059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70200094b0 con 0x7f70300b3800 2023-11-28T13:00:36.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f702f7fe700 1 --2- 172.21.15.82:0/3673766059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7030070070 0x7f70300c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:36.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f13b37fe700 1 -- 172.21.15.82:0/4104065424 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c000c850 con 0x7f13cc070070 2023-11-28T13:00:36.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f13cbfff700 1 -- 172.21.15.82:0/4104065424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13cc06da90 con 0x7f13cc070070 2023-11-28T13:00:36.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f13cbfff700 1 -- 172.21.15.82:0/4104065424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13cc06ce00 con 0x7f13cc070070 2023-11-28T13:00:36.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7fced2ffd700 1 --2- 172.21.15.82:0/1333516310 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcec4064f30 0x7fcec40673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7fced2ffd700 1 -- 172.21.15.82:0/1333516310 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fced4081c20 con 0x7fcee4159e00 2023-11-28T13:00:36.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f702ffff700 1 --2- 172.21.15.82:0/3673766059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70300b3800 0x7f70300b3c70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f702800cc10 tx=0x7f702800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f544b893700 1 -- 172.21.15.82:0/3949572069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54440704e0 msgr2=0x7f5444070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f544b893700 1 --2- 172.21.15.82:0/3949572069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54440704e0 0x7f5444070980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f543c009d90 tx=0x7f543c00b330 comp rx=0 tx=0).stop 2023-11-28T13:00:36.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7fcee1d9b700 1 --2- 172.21.15.82:0/1333516310 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcec4064f30 0x7fcec40673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7fcee1d9b700 1 --2- 172.21.15.82:0/1333516310 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcec4064f30 0x7fcec40673e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcee415c2c0 tx=0x7fcedc009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f544b893700 1 -- 172.21.15.82:0/3949572069 shutdown_connections 2023-11-28T13:00:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f544b893700 1 --2- 172.21.15.82:0/3949572069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54440704e0 0x7f5444070980 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f544b893700 1 -- 172.21.15.82:0/3949572069 >> 172.21.15.82:0/3949572069 conn(0x7f54440b1310 msgr2=0x7f54440cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f544b893700 1 -- 172.21.15.82:0/3949572069 shutdown_connections 2023-11-28T13:00:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f544b893700 1 -- 172.21.15.82:0/3949572069 wait complete. 2023-11-28T13:00:36.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.160+0000 7f13cbfff700 1 -- 172.21.15.82:0/4104065424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13cc15c500 con 0x7f13cc070070 2023-11-28T13:00:36.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.164+0000 7f544b893700 1 Processor -- start 2023-11-28T13:00:36.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.164+0000 7f544b893700 1 -- start start 2023-11-28T13:00:36.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.164+0000 7f544b893700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54440704e0 0x7f54440c1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.164+0000 7f544b893700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54440adca0 0x7f544415d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.164+0000 7f544b893700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54440c16d0 0x7f544415d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.164+0000 7f544b893700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544415cfd0 con 0x7f54440adca0 2023-11-28T13:00:36.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.164+0000 7f544b893700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54440b4310 con 0x7f54440704e0 2023-11-28T13:00:36.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.164+0000 7f544b893700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54440b45f0 con 0x7f54440c16d0 2023-11-28T13:00:36.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.164+0000 7f5448e2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54440adca0 0x7f544415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.164+0000 7f5448e2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54440adca0 0x7f544415d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57626/0 (socket says 172.21.15.82:57626) 2023-11-28T13:00:36.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.164+0000 7f5448e2e700 1 -- 172.21.15.82:0/1469751612 learned_addr learned my addr 172.21.15.82:0/1469751612 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:36.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.164+0000 7f544962f700 1 --2- 172.21.15.82:0/1469751612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54440704e0 0x7f54440c1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.164+0000 7f5449e30700 1 --2- 172.21.15.82:0/1469751612 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54440c16d0 0x7f544415d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.164+0000 7f5448e2e700 1 -- 172.21.15.82:0/1469751612 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54440c16d0 msgr2=0x7f544415d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.164+0000 7f5448e2e700 1 --2- 172.21.15.82:0/1469751612 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54440c16d0 0x7f544415d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.164+0000 7f5448e2e700 1 -- 172.21.15.82:0/1469751612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54440704e0 msgr2=0x7f54440c1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.164+0000 7f5448e2e700 1 --2- 172.21.15.82:0/1469751612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54440704e0 0x7f54440c1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.164+0000 7f5448e2e700 1 -- 172.21.15.82:0/1469751612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c009a70 con 0x7f54440adca0 2023-11-28T13:00:36.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.164+0000 7f5448e2e700 1 --2- 172.21.15.82:0/1469751612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54440adca0 0x7f544415d460 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f543c000f80 tx=0x7f543c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.168+0000 7f13b37fe700 1 -- 172.21.15.82:0/4104065424 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c0005a40 con 0x7f13cc070070 2023-11-28T13:00:36.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.168+0000 7f13b37fe700 1 -- 172.21.15.82:0/4104065424 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c0005dd0 con 0x7f13cc070070 2023-11-28T13:00:36.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.168+0000 7f7017fff700 1 -- 172.21.15.82:0/3673766059 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7028003e50 con 0x7f70300b3800 2023-11-28T13:00:36.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.168+0000 7fb0cf7fe700 1 -- 172.21.15.82:0/3058549945 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb0e004fa90 con 0x7fb0e80c9c80 2023-11-28T13:00:36.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.172+0000 7fced2ffd700 1 -- 172.21.15.82:0/1333516310 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fced404fd50 con 0x7fcee4159e00 2023-11-28T13:00:36.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.176+0000 7f13b37fe700 1 -- 172.21.15.82:0/4104065424 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f13c0019030 con 0x7f13cc070070 2023-11-28T13:00:36.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.176+0000 7f13b37fe700 1 --2- 172.21.15.82:0/4104065424 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f13b8064ee0 0x7f13b8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.176+0000 7f13b37fe700 1 -- 172.21.15.82:0/4104065424 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f13c0082810 con 0x7f13cc070070 2023-11-28T13:00:36.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.176+0000 7f13caffd700 1 --2- 172.21.15.82:0/4104065424 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f13b8064ee0 0x7f13b8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.168+0000 7f7034bae700 1 -- 172.21.15.82:0/3673766059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703006ab90 con 0x7f70300b3800 2023-11-28T13:00:36.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.168+0000 7f7034bae700 1 -- 172.21.15.82:0/3673766059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703006a8b0 con 0x7f70300b3800 2023-11-28T13:00:36.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.168+0000 7f7017fff700 1 -- 172.21.15.82:0/3673766059 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7028005070 con 0x7f70300b3800 2023-11-28T13:00:36.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.168+0000 7f7017fff700 1 -- 172.21.15.82:0/3673766059 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7028005400 con 0x7f70300b3800 2023-11-28T13:00:36.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.172+0000 7f7017fff700 1 -- 172.21.15.82:0/3673766059 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7028019030 con 0x7f70300b3800 2023-11-28T13:00:36.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.172+0000 7f7017fff700 1 --2- 172.21.15.82:0/3673766059 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f701c064ee0 0x7f701c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.168+0000 7f5439ffb700 1 -- 172.21.15.82:0/1469751612 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c0047a0 con 0x7f54440adca0 2023-11-28T13:00:36.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.168+0000 7f544b893700 1 -- 172.21.15.82:0/1469751612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54440ce690 con 0x7f54440adca0 2023-11-28T13:00:36.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.168+0000 7f544b893700 1 -- 172.21.15.82:0/1469751612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54440ce3b0 con 0x7f54440adca0 2023-11-28T13:00:36.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.172+0000 7f5439ffb700 1 -- 172.21.15.82:0/1469751612 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543c004900 con 0x7f54440adca0 2023-11-28T13:00:36.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.172+0000 7f5439ffb700 1 -- 172.21.15.82:0/1469751612 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c026650 con 0x7f54440adca0 2023-11-28T13:00:36.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.176+0000 7f13caffd700 1 --2- 172.21.15.82:0/4104065424 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f13b8064ee0 0x7f13b8067390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f13c40012e0 tx=0x7f13c4001780 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.176+0000 7f13b37fe700 1 -- 172.21.15.82:0/4104065424 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f13c0050850 con 0x7f13cc070070 2023-11-28T13:00:36.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.176+0000 7f7017fff700 1 -- 172.21.15.82:0/3673766059 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f702805b5b0 con 0x7f70300b3800 2023-11-28T13:00:36.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.176+0000 7f544b893700 1 -- 172.21.15.82:0/1469751612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5424005310 con 0x7f54440adca0 2023-11-28T13:00:36.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.176+0000 7f7034bae700 1 -- 172.21.15.82:0/3673766059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7010005310 con 0x7f70300b3800 2023-11-28T13:00:36.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.180+0000 7f702f7fe700 1 --2- 172.21.15.82:0/3673766059 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f701c064ee0 0x7f701c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.184+0000 7f702f7fe700 1 --2- 172.21.15.82:0/3673766059 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f701c064ee0 0x7f701c067390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f70300c4610 tx=0x7f7024008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.184+0000 7f5439ffb700 1 -- 172.21.15.82:0/1469751612 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f543c023030 con 0x7f54440adca0 2023-11-28T13:00:36.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.184+0000 7f5439ffb700 1 --2- 172.21.15.82:0/1469751612 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5428064ee0 0x7f5428067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.184+0000 7f5439ffb700 1 -- 172.21.15.82:0/1469751612 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f543c083530 con 0x7f54440adca0 2023-11-28T13:00:36.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.184+0000 7f544962f700 1 --2- 172.21.15.82:0/1469751612 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5428064ee0 0x7f5428067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.184+0000 7f544962f700 1 --2- 172.21.15.82:0/1469751612 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5428064ee0 0x7f5428067390 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f54400017a0 tx=0x7f5440001650 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.188+0000 7f5439ffb700 1 -- 172.21.15.82:0/1469751612 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f543c0515b0 con 0x7f54440adca0 2023-11-28T13:00:36.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.188+0000 7f7017fff700 1 -- 172.21.15.82:0/3673766059 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7028017080 con 0x7f70300b3800 2023-11-28T13:00:36.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.204+0000 7fdd2ffff700 1 Processor -- start 2023-11-28T13:00:36.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.204+0000 7fdd2ffff700 1 -- start start 2023-11-28T13:00:36.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.204+0000 7fdd2ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd30070780 0x7fdd300cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.204+0000 7fdd2ffff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdd300c1850 0x7fdd3006c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.204+0000 7fdd2ffff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3006a5d0 con 0x7fdd30160890 2023-11-28T13:00:36.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.204+0000 7fdd2ffff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3006b490 con 0x7fdd30070780 2023-11-28T13:00:36.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.204+0000 7fdd2ffff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3006ad40 con 0x7fdd300c1850 2023-11-28T13:00:36.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.204+0000 7fdd2e7fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd30070780 0x7fdd300cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.204+0000 7fdd2f7fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdd300c1850 0x7fdd3006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.204+0000 7fdd2f7fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdd300c1850 0x7fdd3006c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:51114/0 (socket says 172.21.15.82:51114) 2023-11-28T13:00:36.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.204+0000 7fdd2f7fe700 1 -- 172.21.15.82:0/2770848976 learned_addr learned my addr 172.21.15.82:0/2770848976 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:36.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.204+0000 7fdd2f7fe700 1 -- 172.21.15.82:0/2770848976 >> v2:172.21.15.82:3300/0 conn(0x7fdd30070780 msgr2=0x7fdd300cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:36.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.204+0000 7fdd2f7fe700 1 --2- 172.21.15.82:0/2770848976 >> v2:172.21.15.82:3300/0 conn(0x7fdd30070780 0x7fdd300cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.204+0000 7fdd2f7fe700 1 -- 172.21.15.82:0/2770848976 >> v1:172.21.15.114:6789/0 conn(0x7fdd30160890 legacy=0x7fdd30070070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T13:00:36.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.204+0000 7fdd2f7fe700 1 -- 172.21.15.82:0/2770848976 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd300cdfa0 con 0x7fdd300c1850 2023-11-28T13:00:36.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.204+0000 7fdd2e7fc700 1 --2- 172.21.15.82:0/2770848976 >> v2:172.21.15.82:3300/0 conn(0x7fdd30070780 0x7fdd300cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:36.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.208+0000 7fdd2f7fe700 1 --2- 172.21.15.82:0/2770848976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd300c1850 0x7fdd3006c070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdd300adff0 tx=0x7fdd2800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98cc9fdce0f6739 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.208+0000 7fdd2dffb700 1 -- 172.21.15.82:0/2770848976 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2800e070 con 0x7fdd300c1850 2023-11-28T13:00:36.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.208+0000 7fdd2dffb700 1 -- 172.21.15.82:0/2770848976 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd28003a40 con 0x7fdd300c1850 2023-11-28T13:00:36.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.208+0000 7fdd2ffff700 1 -- 172.21.15.82:0/2770848976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd300c1850 msgr2=0x7fdd3006c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.208+0000 7fdd2ffff700 1 --2- 172.21.15.82:0/2770848976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd300c1850 0x7fdd3006c070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdd300adff0 tx=0x7fdd2800b330 comp rx=0 tx=0).stop 2023-11-28T13:00:36.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.208+0000 7fdd2ffff700 1 -- 172.21.15.82:0/2770848976 shutdown_connections 2023-11-28T13:00:36.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.208+0000 7fdd2ffff700 1 --2- 172.21.15.82:0/2770848976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd300c1850 0x7fdd3006c070 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.208+0000 7fdd2ffff700 1 --2- 172.21.15.82:0/2770848976 >> v2:172.21.15.82:3300/0 conn(0x7fdd30070780 0x7fdd300cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.208+0000 7fdd2ffff700 1 -- 172.21.15.82:0/2770848976 >> 172.21.15.82:0/2770848976 conn(0x7fdd300cbd10 msgr2=0x7fdd300ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:36.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.208+0000 7fdd2ffff700 1 -- 172.21.15.82:0/2770848976 shutdown_connections 2023-11-28T13:00:36.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.208+0000 7fdd2ffff700 1 -- 172.21.15.82:0/2770848976 wait complete. 2023-11-28T13:00:36.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.208+0000 7fdd2ffff700 1 Processor -- start 2023-11-28T13:00:36.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.208+0000 7fdd2ffff700 1 -- start start 2023-11-28T13:00:36.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.212+0000 7fdd2ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd30070780 0x7fdd300c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.212+0000 7fdd2ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd300c1850 0x7fdd301622d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.212+0000 7fdd2ffff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd30160890 0x7fdd30153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.212+0000 7fdd2ffff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd300c4770 con 0x7fdd30070780 2023-11-28T13:00:36.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.212+0000 7fdd2ffff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd30162d00 con 0x7fdd300c1850 2023-11-28T13:00:36.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.212+0000 7fdd2ffff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd300c3e40 con 0x7fdd30160890 2023-11-28T13:00:36.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.212+0000 7fdd2effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd30070780 0x7fdd300c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.212+0000 7fdd2effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd30070780 0x7fdd300c4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57644/0 (socket says 172.21.15.82:57644) 2023-11-28T13:00:36.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.212+0000 7fdd2effd700 1 -- 172.21.15.82:0/1569007305 learned_addr learned my addr 172.21.15.82:0/1569007305 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:36.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.212+0000 7fdd2f7fe700 1 --2- 172.21.15.82:0/1569007305 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd30160890 0x7fdd30153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.212+0000 7fdd2e7fc700 1 --2- 172.21.15.82:0/1569007305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd300c1850 0x7fdd301622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.212+0000 7fdd2effd700 1 -- 172.21.15.82:0/1569007305 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd30160890 msgr2=0x7fdd30153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.212+0000 7fdd2effd700 1 --2- 172.21.15.82:0/1569007305 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd30160890 0x7fdd30153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.212+0000 7fdd2effd700 1 -- 172.21.15.82:0/1569007305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd300c1850 msgr2=0x7fdd301622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.212+0000 7fdd2effd700 1 --2- 172.21.15.82:0/1569007305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd300c1850 0x7fdd301622d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.212+0000 7fdd2effd700 1 -- 172.21.15.82:0/1569007305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd200094b0 con 0x7fdd30070780 2023-11-28T13:00:36.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.212+0000 7fdd2effd700 1 --2- 172.21.15.82:0/1569007305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd30070780 0x7fdd300c4c00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400b4a0 tx=0x7fdd2400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.212+0000 7fdd17fff700 1 -- 172.21.15.82:0/1569007305 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd24011830 con 0x7fdd30070780 2023-11-28T13:00:36.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.212+0000 7fdd2ffff700 1 -- 172.21.15.82:0/1569007305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd28009b30 con 0x7fdd30070780 2023-11-28T13:00:36.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.212+0000 7fdd2ffff700 1 -- 172.21.15.82:0/1569007305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3006a820 con 0x7fdd30070780 2023-11-28T13:00:36.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.216+0000 7fdd17fff700 1 -- 172.21.15.82:0/1569007305 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd240119b0 con 0x7fdd30070780 2023-11-28T13:00:36.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.216+0000 7fdd17fff700 1 -- 172.21.15.82:0/1569007305 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd24011d60 con 0x7fdd30070780 2023-11-28T13:00:36.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.216+0000 7fdd17fff700 1 -- 172.21.15.82:0/1569007305 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdd24021070 con 0x7fdd30070780 2023-11-28T13:00:36.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.216+0000 7fdd17fff700 1 --2- 172.21.15.82:0/1569007305 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdd1c064f30 0x7fdd1c0673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:36.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.216+0000 7fdd17fff700 1 -- 172.21.15.82:0/1569007305 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdd24081c10 con 0x7fdd30070780 2023-11-28T13:00:36.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.216+0000 7fdd2e7fc700 1 --2- 172.21.15.82:0/1569007305 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdd1c064f30 0x7fdd1c0673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:36.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.216+0000 7fdd2e7fc700 1 --2- 172.21.15.82:0/1569007305 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdd1c064f30 0x7fdd1c0673e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdd300cae10 tx=0x7fdd20009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:36.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.220+0000 7fdd2ffff700 1 -- 172.21.15.82:0/1569007305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd10005310 con 0x7fdd30070780 2023-11-28T13:00:36.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.228+0000 7fdd17fff700 1 -- 172.21.15.82:0/1569007305 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdd2404ff10 con 0x7fdd30070780 2023-11-28T13:00:36.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.444+0000 7f7a2aaf5700 1 -- 172.21.15.82:0/3523206408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7a040055c0 con 0x7f7a2406aae0 2023-11-28T13:00:36.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.448+0000 7f7a217fa700 1 -- 172.21.15.82:0/3523206408 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7a1c0507c0 con 0x7f7a2406aae0 2023-11-28T13:00:36.452 INFO:teuthology.orchestra.run.smithi082.stdout:55834574856 2023-11-28T13:00:36.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.452+0000 7f7a0affd700 1 -- 172.21.15.82:0/3523206408 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a0c0650c0 msgr2=0x7f7a0c067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.452+0000 7f7a0affd700 1 --2- 172.21.15.82:0/3523206408 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a0c0650c0 0x7f7a0c067570 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7a240c5130 tx=0x7f7a1400f040 comp rx=0 tx=0).stop 2023-11-28T13:00:36.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.452+0000 7f7a0affd700 1 -- 172.21.15.82:0/3523206408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2406aae0 msgr2=0x7f7a240adff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.452+0000 7f7a0affd700 1 --2- 172.21.15.82:0/3523206408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2406aae0 0x7f7a240adff0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c008580 tx=0x7f7a1c008890 comp rx=0 tx=0).stop 2023-11-28T13:00:36.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.452+0000 7f7a0affd700 1 -- 172.21.15.82:0/3523206408 shutdown_connections 2023-11-28T13:00:36.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.452+0000 7f7a0affd700 1 --2- 172.21.15.82:0/3523206408 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a0c0650c0 0x7f7a0c067570 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.452+0000 7f7a0affd700 1 --2- 172.21.15.82:0/3523206408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a24168f10 0x7f7a240b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.452+0000 7f7a0affd700 1 --2- 172.21.15.82:0/3523206408 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a24089570 0x7f7a241fe230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.452+0000 7f7a0affd700 1 --2- 172.21.15.82:0/3523206408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2406aae0 0x7f7a240adff0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.452+0000 7f7a0affd700 1 -- 172.21.15.82:0/3523206408 >> 172.21.15.82:0/3523206408 conn(0x7f7a240cbd10 msgr2=0x7f7a240704c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:36.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.452+0000 7f7a0affd700 1 -- 172.21.15.82:0/3523206408 shutdown_connections 2023-11-28T13:00:36.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.452+0000 7f7a0affd700 1 -- 172.21.15.82:0/3523206408 wait complete. 2023-11-28T13:00:36.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.452+0000 7f6dbf59e700 1 -- 172.21.15.82:0/1197934069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6da4005890 con 0x7f6dc00ced10 2023-11-28T13:00:36.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.460+0000 7f6daeffd700 1 -- 172.21.15.82:0/1197934069 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6db4052850 con 0x7f6dc00ced10 2023-11-28T13:00:36.466 INFO:teuthology.orchestra.run.smithi082.stdout:55834574855 2023-11-28T13:00:36.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.464+0000 7f6dacff9700 1 -- 172.21.15.82:0/1197934069 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6da0064f10 msgr2=0x7f6da00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.464+0000 7f6dacff9700 1 --2- 172.21.15.82:0/1197934069 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6da0064f10 0x7f6da00673c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6db0006f80 tx=0x7f6db0008030 comp rx=0 tx=0).stop 2023-11-28T13:00:36.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.464+0000 7f6dacff9700 1 -- 172.21.15.82:0/1197934069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6dc00ced10 msgr2=0x7f6dc00b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.464+0000 7f6dacff9700 1 --2- 172.21.15.82:0/1197934069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6dc00ced10 0x7f6dc00b1660 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6db400c4d0 tx=0x7f6db400c7e0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.464+0000 7f6dacff9700 1 -- 172.21.15.82:0/1197934069 shutdown_connections 2023-11-28T13:00:36.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.464+0000 7f6dacff9700 1 --2- 172.21.15.82:0/1197934069 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6da0064f10 0x7f6da00673c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.464+0000 7f6dacff9700 1 --2- 172.21.15.82:0/1197934069 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6dc0141500 0x7f6dc006cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.464+0000 7f6dacff9700 1 --2- 172.21.15.82:0/1197934069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6dc00ced10 0x7f6dc00b1660 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.464+0000 7f6dacff9700 1 --2- 172.21.15.82:0/1197934069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dc00c9c60 0x7f6dc00b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.464+0000 7f6dacff9700 1 -- 172.21.15.82:0/1197934069 >> 172.21.15.82:0/1197934069 conn(0x7f6dc00cbd10 msgr2=0x7f6dc006c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:36.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.464+0000 7f6dacff9700 1 -- 172.21.15.82:0/1197934069 shutdown_connections 2023-11-28T13:00:36.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.464+0000 7f6dacff9700 1 -- 172.21.15.82:0/1197934069 wait complete. 2023-11-28T13:00:36.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2023-11-28T13:00:36.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.476+0000 7fcee892d700 1 -- 172.21.15.82:0/1333516310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcec80055c0 con 0x7fcee4159e00 2023-11-28T13:00:36.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.476+0000 7fb0e7fff700 1 -- 172.21.15.82:0/3058549945 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb0e8065fc0 con 0x7fb0e80c9c80 2023-11-28T13:00:36.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.476+0000 7fced2ffd700 1 -- 172.21.15.82:0/1333516310 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fced4053370 con 0x7fcee4159e00 2023-11-28T13:00:36.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.476+0000 7fb0cf7fe700 1 -- 172.21.15.82:0/3058549945 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb0e0017070 con 0x7fb0e80c9c80 2023-11-28T13:00:36.481 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2023-11-28T13:00:36.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2023-11-28T13:00:36.482 INFO:teuthology.orchestra.run.smithi082.stdout:55834574856 2023-11-28T13:00:36.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fcee892d700 1 -- 172.21.15.82:0/1333516310 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcec4064f30 msgr2=0x7fcec40673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fcee892d700 1 --2- 172.21.15.82:0/1333516310 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcec4064f30 0x7fcec40673e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcee415c2c0 tx=0x7fcedc009000 comp rx=0 tx=0).stop 2023-11-28T13:00:36.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fcee892d700 1 -- 172.21.15.82:0/1333516310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcee4159e00 msgr2=0x7fcee415afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fcee892d700 1 --2- 172.21.15.82:0/1333516310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcee4159e00 0x7fcee415afe0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fced400c4e0 tx=0x7fced400c8a0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fcee892d700 1 -- 172.21.15.82:0/1333516310 shutdown_connections 2023-11-28T13:00:36.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fcee892d700 1 --2- 172.21.15.82:0/1333516310 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcec4064f30 0x7fcec40673e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fcee892d700 1 --2- 172.21.15.82:0/1333516310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcee415cf30 0x7fcee4156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fcee892d700 1 --2- 172.21.15.82:0/1333516310 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcee415a1d0 0x7fcee41f9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fcee892d700 1 --2- 172.21.15.82:0/1333516310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcee4159e00 0x7fcee415afe0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fcee892d700 1 -- 172.21.15.82:0/1333516310 >> 172.21.15.82:0/1333516310 conn(0x7fcee40ce9b0 msgr2=0x7fcee4160670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:36.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fcee892d700 1 -- 172.21.15.82:0/1333516310 shutdown_connections 2023-11-28T13:00:36.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fcee892d700 1 -- 172.21.15.82:0/1333516310 wait complete. 2023-11-28T13:00:36.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fb0e7fff700 1 -- 172.21.15.82:0/3058549945 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb0d4064fb0 msgr2=0x7fb0d4067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fb0e7fff700 1 --2- 172.21.15.82:0/3058549945 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb0d4064fb0 0x7fb0d4067460 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc000f60 tx=0x7fb0dc009040 comp rx=0 tx=0).stop 2023-11-28T13:00:36.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fb0e7fff700 1 -- 172.21.15.82:0/3058549945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0e80c9c80 msgr2=0x7fb0e8165be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fb0e7fff700 1 --2- 172.21.15.82:0/3058549945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0e80c9c80 0x7fb0e8165be0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0001ff0 tx=0x7fb0e000a340 comp rx=0 tx=0).stop 2023-11-28T13:00:36.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fb0e7fff700 1 -- 172.21.15.82:0/3058549945 shutdown_connections 2023-11-28T13:00:36.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fb0e7fff700 1 --2- 172.21.15.82:0/3058549945 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb0d4064fb0 0x7fb0d4067460 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fb0e7fff700 1 --2- 172.21.15.82:0/3058549945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0e80c9c80 0x7fb0e8165be0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fb0e7fff700 1 --2- 172.21.15.82:0/3058549945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0e8089570 0x7fb0e80c18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fb0e7fff700 1 --2- 172.21.15.82:0/3058549945 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb0e806aae0 0x7fb0e8202ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fb0e7fff700 1 -- 172.21.15.82:0/3058549945 >> 172.21.15.82:0/3058549945 conn(0x7fb0e80cbd10 msgr2=0x7fb0e80ae5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:36.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fb0e7fff700 1 -- 172.21.15.82:0/3058549945 shutdown_connections 2023-11-28T13:00:36.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7fb0e7fff700 1 -- 172.21.15.82:0/3058549945 wait complete. 2023-11-28T13:00:36.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7f544b893700 1 -- 172.21.15.82:0/1469751612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f54240055c0 con 0x7f54440adca0 2023-11-28T13:00:36.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.480+0000 7f5439ffb700 1 -- 172.21.15.82:0/1469751612 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f543c054bd0 con 0x7f54440adca0 2023-11-28T13:00:36.487 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2023-11-28T13:00:36.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.484+0000 7f13cbfff700 1 -- 172.21.15.82:0/4104065424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f13cc065fc0 con 0x7f13cc070070 2023-11-28T13:00:36.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.484+0000 7f13b37fe700 1 -- 172.21.15.82:0/4104065424 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f13c0017020 con 0x7f13cc070070 2023-11-28T13:00:36.488 INFO:teuthology.orchestra.run.smithi082.stdout:55834574856 2023-11-28T13:00:36.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.484+0000 7f544b893700 1 -- 172.21.15.82:0/1469751612 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5428064ee0 msgr2=0x7f5428067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.484+0000 7f544b893700 1 --2- 172.21.15.82:0/1469751612 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5428064ee0 0x7f5428067390 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f54400017a0 tx=0x7f5440001650 comp rx=0 tx=0).stop 2023-11-28T13:00:36.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.484+0000 7f544b893700 1 -- 172.21.15.82:0/1469751612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54440adca0 msgr2=0x7f544415d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.484+0000 7f544b893700 1 --2- 172.21.15.82:0/1469751612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54440adca0 0x7f544415d460 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f543c000f80 tx=0x7f543c004af0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.484+0000 7f544b893700 1 -- 172.21.15.82:0/1469751612 shutdown_connections 2023-11-28T13:00:36.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.484+0000 7f544b893700 1 --2- 172.21.15.82:0/1469751612 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5428064ee0 0x7f5428067390 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.484+0000 7f544b893700 1 --2- 172.21.15.82:0/1469751612 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54440c16d0 0x7f544415d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.484+0000 7f544b893700 1 --2- 172.21.15.82:0/1469751612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54440adca0 0x7f544415d460 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.484+0000 7f544b893700 1 --2- 172.21.15.82:0/1469751612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54440704e0 0x7f54440c1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.484+0000 7f544b893700 1 -- 172.21.15.82:0/1469751612 >> 172.21.15.82:0/1469751612 conn(0x7f54440b1310 msgr2=0x7f54440ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:36.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.484+0000 7f544b893700 1 -- 172.21.15.82:0/1469751612 shutdown_connections 2023-11-28T13:00:36.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.484+0000 7f544b893700 1 -- 172.21.15.82:0/1469751612 wait complete. 2023-11-28T13:00:36.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.488+0000 7f13cbfff700 1 -- 172.21.15.82:0/4104065424 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f13b8064ee0 msgr2=0x7f13b8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.488+0000 7f13cbfff700 1 --2- 172.21.15.82:0/4104065424 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f13b8064ee0 0x7f13b8067390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f13c40012e0 tx=0x7f13c4001780 comp rx=0 tx=0).stop 2023-11-28T13:00:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.488+0000 7f13cbfff700 1 -- 172.21.15.82:0/4104065424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13cc070070 msgr2=0x7f13cc155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.488+0000 7f13cbfff700 1 --2- 172.21.15.82:0/4104065424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13cc070070 0x7f13cc155da0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f13c000e9d0 tx=0x7f13c000ed90 comp rx=0 tx=0).stop 2023-11-28T13:00:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.488+0000 7f13cbfff700 1 -- 172.21.15.82:0/4104065424 shutdown_connections 2023-11-28T13:00:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.488+0000 7f13cbfff700 1 --2- 172.21.15.82:0/4104065424 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f13b8064ee0 0x7f13b8067390 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.488+0000 7f13cbfff700 1 --2- 172.21.15.82:0/4104065424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13cc0cc1d0 0x7f13cc0b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.488+0000 7f13cbfff700 1 --2- 172.21.15.82:0/4104065424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13cc070070 0x7f13cc155da0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.488+0000 7f13cbfff700 1 --2- 172.21.15.82:0/4104065424 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13cc06d430 0x7f13cc156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.488+0000 7f13cbfff700 1 -- 172.21.15.82:0/4104065424 >> 172.21.15.82:0/4104065424 conn(0x7f13cc0cbd10 msgr2=0x7f13cc0ae040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.488+0000 7f13cbfff700 1 -- 172.21.15.82:0/4104065424 shutdown_connections 2023-11-28T13:00:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.488+0000 7f13cbfff700 1 -- 172.21.15.82:0/4104065424 wait complete. 2023-11-28T13:00:36.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2023-11-28T13:00:36.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-11-28T13:00:36.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-11-28T13:00:36.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.500+0000 7f7034bae700 1 -- 172.21.15.82:0/3673766059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f70100055c0 con 0x7f70300b3800 2023-11-28T13:00:36.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.500+0000 7f7017fff700 1 -- 172.21.15.82:0/3673766059 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7028053000 con 0x7f70300b3800 2023-11-28T13:00:36.505 INFO:teuthology.orchestra.run.smithi082.stdout:55834574855 2023-11-28T13:00:36.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2023-11-28T13:00:36.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.504+0000 7f7034bae700 1 -- 172.21.15.82:0/3673766059 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f701c064ee0 msgr2=0x7f701c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.504+0000 7f7034bae700 1 --2- 172.21.15.82:0/3673766059 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f701c064ee0 0x7f701c067390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f70300c4610 tx=0x7f7024008040 comp rx=0 tx=0).stop 2023-11-28T13:00:36.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.504+0000 7f7034bae700 1 -- 172.21.15.82:0/3673766059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70300b3800 msgr2=0x7f70300b3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.504+0000 7f7034bae700 1 --2- 172.21.15.82:0/3673766059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70300b3800 0x7f70300b3c70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f702800cc10 tx=0x7f702800cf20 comp rx=0 tx=0).stop 2023-11-28T13:00:36.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.504+0000 7f7034bae700 1 -- 172.21.15.82:0/3673766059 shutdown_connections 2023-11-28T13:00:36.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.504+0000 7f7034bae700 1 --2- 172.21.15.82:0/3673766059 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f701c064ee0 0x7f701c067390 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.504+0000 7f7034bae700 1 --2- 172.21.15.82:0/3673766059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70300b3800 0x7f70300b3c70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.504+0000 7f7034bae700 1 --2- 172.21.15.82:0/3673766059 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f70300c4690 0x7f703015a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.504+0000 7f7034bae700 1 --2- 172.21.15.82:0/3673766059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7030070070 0x7f70300c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.504+0000 7f7034bae700 1 -- 172.21.15.82:0/3673766059 >> 172.21.15.82:0/3673766059 conn(0x7f70300ce600 msgr2=0x7f70300b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:36.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.504+0000 7f7034bae700 1 -- 172.21.15.82:0/3673766059 shutdown_connections 2023-11-28T13:00:36.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.504+0000 7f7034bae700 1 -- 172.21.15.82:0/3673766059 wait complete. 2023-11-28T13:00:36.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.512+0000 7fdd2ffff700 1 -- 172.21.15.82:0/1569007305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fdd100055c0 con 0x7fdd30070780 2023-11-28T13:00:36.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.512+0000 7fdd17fff700 1 -- 172.21.15.82:0/1569007305 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd24015020 con 0x7fdd30070780 2023-11-28T13:00:36.515 INFO:teuthology.orchestra.run.smithi082.stdout:55834574855 2023-11-28T13:00:36.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2023-11-28T13:00:36.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.512+0000 7fdd2ffff700 1 -- 172.21.15.82:0/1569007305 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdd1c064f30 msgr2=0x7fdd1c0673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.512+0000 7fdd2ffff700 1 --2- 172.21.15.82:0/1569007305 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdd1c064f30 0x7fdd1c0673e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdd300cae10 tx=0x7fdd20009240 comp rx=0 tx=0).stop 2023-11-28T13:00:36.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.512+0000 7fdd2ffff700 1 -- 172.21.15.82:0/1569007305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd30070780 msgr2=0x7fdd300c4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:36.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.512+0000 7fdd2ffff700 1 --2- 172.21.15.82:0/1569007305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd30070780 0x7fdd300c4c00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400b4a0 tx=0x7fdd2400b7b0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.512+0000 7fdd2ffff700 1 -- 172.21.15.82:0/1569007305 shutdown_connections 2023-11-28T13:00:36.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.512+0000 7fdd2ffff700 1 --2- 172.21.15.82:0/1569007305 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdd1c064f30 0x7fdd1c0673e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.512+0000 7fdd2ffff700 1 --2- 172.21.15.82:0/1569007305 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd30160890 0x7fdd30153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.512+0000 7fdd2ffff700 1 --2- 172.21.15.82:0/1569007305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd300c1850 0x7fdd301622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.512+0000 7fdd2ffff700 1 --2- 172.21.15.82:0/1569007305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd30070780 0x7fdd300c4c00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:36.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.512+0000 7fdd2ffff700 1 -- 172.21.15.82:0/1569007305 >> 172.21.15.82:0/1569007305 conn(0x7fdd300cbd10 msgr2=0x7fdd300ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:36.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.512+0000 7fdd2ffff700 1 -- 172.21.15.82:0/1569007305 shutdown_connections 2023-11-28T13:00:36.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:36.512+0000 7fdd2ffff700 1 -- 172.21.15.82:0/1569007305 wait complete. 2023-11-28T13:00:36.526 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2023-11-28T13:00:37.472 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T13:00:37.482 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T13:00:37.497 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T13:00:37.503 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T13:00:37.503 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T13:00:37.508 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T13:00:37.518 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T13:00:37.527 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T13:00:37.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.628+0000 7fec614ba700 1 Processor -- start 2023-11-28T13:00:37.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.628+0000 7fec614ba700 1 -- start start 2023-11-28T13:00:37.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec614ba700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fec5c070070 0x7fec5c070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec614ba700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fec5c141500 0x7fec5c069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec614ba700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5c1585f0 con 0x7fec5c141a50 2023-11-28T13:00:37.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec614ba700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5c15ca00 con 0x7fec5c070070 2023-11-28T13:00:37.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec614ba700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c070980 con 0x7fec5c141500 2023-11-28T13:00:37.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec5b7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fec5c141a50 0x7fec5c06a100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60478/0 (socket says 172.21.15.82:60478) 2023-11-28T13:00:37.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec5affd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fec5c070070 0x7fec5c070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec5affd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fec5c070070 0x7fec5c070440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:51878/0 (socket says 172.21.15.82:51878) 2023-11-28T13:00:37.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec5affd700 1 -- 172.21.15.82:0/1034263000 learned_addr learned my addr 172.21.15.82:0/1034263000 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:37.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec5a7fc700 1 --2- 172.21.15.82:0/1034263000 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fec5c141500 0x7fec5c069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec59ffb700 1 -- 172.21.15.82:0/1034263000 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317765195 0 0) 0x7fec5c1585f0 con 0x7fec5c141a50 2023-11-28T13:00:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec59ffb700 1 -- 172.21.15.82:0/1034263000 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec440035d0 con 0x7fec5c141a50 2023-11-28T13:00:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec5affd700 1 -- 172.21.15.82:0/1034263000 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fec5c141500 msgr2=0x7fec5c069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec5affd700 1 --2- 172.21.15.82:0/1034263000 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fec5c141500 0x7fec5c069bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec5affd700 1 -- 172.21.15.82:0/1034263000 >> v1:172.21.15.82:6789/0 conn(0x7fec5c141a50 legacy=0x7fec5c06a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec5affd700 1 -- 172.21.15.82:0/1034263000 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c15bd80 con 0x7fec5c070070 2023-11-28T13:00:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec5a7fc700 1 --2- 172.21.15.82:0/1034263000 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fec5c141500 0x7fec5c069bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec5affd700 1 --2- 172.21.15.82:0/1034263000 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec5c070070 0x7fec5c070440 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fec54009a50 tx=0x7fec54009a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dd91cd3ba853ebd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec59ffb700 1 -- 172.21.15.82:0/1034263000 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5400c850 con 0x7fec5c070070 2023-11-28T13:00:37.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec59ffb700 1 -- 172.21.15.82:0/1034263000 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5400c9b0 con 0x7fec5c070070 2023-11-28T13:00:37.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec59ffb700 1 -- 172.21.15.82:0/1034263000 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5400cd60 con 0x7fec5c070070 2023-11-28T13:00:37.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7f3b1f959700 1 Processor -- start 2023-11-28T13:00:37.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7f3b1f959700 1 -- start start 2023-11-28T13:00:37.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec614ba700 1 -- 172.21.15.82:0/1034263000 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec5c070070 msgr2=0x7fec5c070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.632+0000 7fec614ba700 1 --2- 172.21.15.82:0/1034263000 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec5c070070 0x7fec5c070440 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fec54009a50 tx=0x7fec54009a80 comp rx=0 tx=0).stop 2023-11-28T13:00:37.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1f959700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3b181607b0 0x7f3b1806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1f959700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b1806b080 0x7f3b180ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1f959700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b18069bc0 con 0x7f3b180b44c0 2023-11-28T13:00:37.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1f959700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b18160b80 con 0x7f3b181607b0 2023-11-28T13:00:37.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1f959700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b180cee40 con 0x7f3b1806b080 2023-11-28T13:00:37.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7fec614ba700 1 -- 172.21.15.82:0/1034263000 shutdown_connections 2023-11-28T13:00:37.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7fec614ba700 1 --2- 172.21.15.82:0/1034263000 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fec5c141500 0x7fec5c069bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7fec614ba700 1 --2- 172.21.15.82:0/1034263000 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec5c070070 0x7fec5c070440 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7fec614ba700 1 -- 172.21.15.82:0/1034263000 >> 172.21.15.82:0/1034263000 conn(0x7fec5c0cbd10 msgr2=0x7fec5c0ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:37.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7fec614ba700 1 -- 172.21.15.82:0/1034263000 shutdown_connections 2023-11-28T13:00:37.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7fec614ba700 1 -- 172.21.15.82:0/1034263000 wait complete. 2023-11-28T13:00:37.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1def6700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3b180b44c0 0x7f3b18164280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60480/0 (socket says 172.21.15.82:60480) 2023-11-28T13:00:37.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7fec614ba700 1 Processor -- start 2023-11-28T13:00:37.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7fec614ba700 1 -- start start 2023-11-28T13:00:37.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1def6700 1 -- 172.21.15.82:0/972756485 learned_addr learned my addr 172.21.15.82:0/972756485 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:37.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1d6f5700 1 --2- 172.21.15.82:0/972756485 >> v2:172.21.15.114:3300/0 conn(0x7f3b181607b0 0x7f3b1806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1cef4700 1 --2- 172.21.15.82:0/972756485 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b1806b080 0x7f3b180ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b0ffff700 1 -- 172.21.15.82:0/972756485 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051707829 0 0) 0x7f3b18069bc0 con 0x7f3b180b44c0 2023-11-28T13:00:37.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b0ffff700 1 -- 172.21.15.82:0/972756485 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b040035d0 con 0x7f3b180b44c0 2023-11-28T13:00:37.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1d6f5700 1 -- 172.21.15.82:0/972756485 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b1806b080 msgr2=0x7f3b180ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:37.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b0ffff700 1 -- 172.21.15.82:0/972756485 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 153782511 0 0) 0x7f3b040035d0 con 0x7f3b180b44c0 2023-11-28T13:00:37.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1d6f5700 1 --2- 172.21.15.82:0/972756485 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b1806b080 0x7f3b180ce560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1d6f5700 1 -- 172.21.15.82:0/972756485 >> v1:172.21.15.82:6789/0 conn(0x7f3b180b44c0 legacy=0x7f3b18164280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1d6f5700 1 -- 172.21.15.82:0/972756485 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b180cf120 con 0x7f3b181607b0 2023-11-28T13:00:37.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1d6f5700 1 --2- 172.21.15.82:0/972756485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b181607b0 0x7f3b1806a610 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009850 tx=0x7f3b08009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe74c0a5cc587921 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b0ffff700 1 -- 172.21.15.82:0/972756485 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b100019f0 con 0x7f3b181607b0 2023-11-28T13:00:37.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b0ffff700 1 -- 172.21.15.82:0/972756485 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b08004030 con 0x7f3b181607b0 2023-11-28T13:00:37.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b0ffff700 1 -- 172.21.15.82:0/972756485 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b080043a0 con 0x7f3b181607b0 2023-11-28T13:00:37.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1f959700 1 -- 172.21.15.82:0/972756485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b181607b0 msgr2=0x7f3b1806a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1f959700 1 --2- 172.21.15.82:0/972756485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b181607b0 0x7f3b1806a610 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009850 tx=0x7f3b08009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:37.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1f959700 1 -- 172.21.15.82:0/972756485 shutdown_connections 2023-11-28T13:00:37.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1f959700 1 --2- 172.21.15.82:0/972756485 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b1806b080 0x7f3b180ce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1f959700 1 --2- 172.21.15.82:0/972756485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b181607b0 0x7f3b1806a610 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1f959700 1 -- 172.21.15.82:0/972756485 >> 172.21.15.82:0/972756485 conn(0x7f3b180cf4c0 msgr2=0x7f3b180cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:37.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7fec614ba700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fec5c070070 0x7fec5c0c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7fec614ba700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec5c141500 0x7fec5c1548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7fec614ba700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec5c141a50 0x7fec5c0b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7fec614ba700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c158830 con 0x7fec5c141500 2023-11-28T13:00:37.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7fec614ba700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c154df0 con 0x7fec5c141a50 2023-11-28T13:00:37.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7fec614ba700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0c81b0 con 0x7fec5c070070 2023-11-28T13:00:37.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1f959700 1 -- 172.21.15.82:0/972756485 shutdown_connections 2023-11-28T13:00:37.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7f3b1f959700 1 -- 172.21.15.82:0/972756485 wait complete. 2023-11-28T13:00:37.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7fec5a7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec5c141500 0x7fec5c1548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7fec5a7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec5c141500 0x7fec5c1548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50730/0 (socket says 172.21.15.82:50730) 2023-11-28T13:00:37.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.636+0000 7fec5a7fc700 1 -- 172.21.15.82:0/1703702783 learned_addr learned my addr 172.21.15.82:0/1703702783 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:37.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7fec5a7fc700 1 -- 172.21.15.82:0/1703702783 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fec5c070070 msgr2=0x7fec5c0c6e40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T13:00:37.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7fec5a7fc700 1 --2- 172.21.15.82:0/1703702783 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fec5c070070 0x7fec5c0c6e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7fec5a7fc700 1 -- 172.21.15.82:0/1703702783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec5c141a50 msgr2=0x7fec5c0b35e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T13:00:37.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7fec5a7fc700 1 --2- 172.21.15.82:0/1703702783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec5c141a50 0x7fec5c0b35e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7fec5a7fc700 1 -- 172.21.15.82:0/1703702783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c0094b0 con 0x7fec5c141500 2023-11-28T13:00:37.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7fec5a7fc700 1 --2- 172.21.15.82:0/1703702783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec5c141500 0x7fec5c1548b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00fcf0 tx=0x7fec4c00d540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7fec437fe700 1 -- 172.21.15.82:0/1703702783 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c00c070 con 0x7fec5c141500 2023-11-28T13:00:37.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7fec437fe700 1 -- 172.21.15.82:0/1703702783 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c00dd50 con 0x7fec5c141500 2023-11-28T13:00:37.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7fec437fe700 1 -- 172.21.15.82:0/1703702783 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c012660 con 0x7fec5c141500 2023-11-28T13:00:37.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7f3b1f959700 1 Processor -- start 2023-11-28T13:00:37.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7f3b1f959700 1 -- start start 2023-11-28T13:00:37.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7f3b1f959700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b1806b080 0x7f3b181f5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7f3b1f959700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b180b44c0 0x7f3b180c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7f3b1f959700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b181607b0 0x7f3b180d26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7f3b1f959700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b181f8ed0 con 0x7f3b181607b0 2023-11-28T13:00:37.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7f3b1f959700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b180cab00 con 0x7f3b1806b080 2023-11-28T13:00:37.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7f3b1f959700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b180c9ef0 con 0x7f3b180b44c0 2023-11-28T13:00:37.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7f3b1def6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b181607b0 0x7f3b180d26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7f3b1def6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b181607b0 0x7f3b180d26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50744/0 (socket says 172.21.15.82:50744) 2023-11-28T13:00:37.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7f3b1def6700 1 -- 172.21.15.82:0/1620324441 learned_addr learned my addr 172.21.15.82:0/1620324441 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:37.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7f3b1d6f5700 1 --2- 172.21.15.82:0/1620324441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b1806b080 0x7f3b181f5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7f3b1cef4700 1 --2- 172.21.15.82:0/1620324441 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b180b44c0 0x7f3b180c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7fec614ba700 1 -- 172.21.15.82:0/1703702783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec540096b0 con 0x7fec5c141500 2023-11-28T13:00:37.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7fec614ba700 1 -- 172.21.15.82:0/1703702783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5c15c340 con 0x7fec5c141500 2023-11-28T13:00:37.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7fec614ba700 1 -- 172.21.15.82:0/1703702783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5c15c060 con 0x7fec5c141500 2023-11-28T13:00:37.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.640+0000 7fec437fe700 1 -- 172.21.15.82:0/1703702783 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fec4c019030 con 0x7fec5c141500 2023-11-28T13:00:37.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.644+0000 7fec437fe700 1 --2- 172.21.15.82:0/1703702783 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fec48064ee0 0x7fec48067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.644+0000 7fec437fe700 1 -- 172.21.15.82:0/1703702783 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fec4c081fe0 con 0x7fec5c141500 2023-11-28T13:00:37.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.644+0000 7fec5affd700 1 --2- 172.21.15.82:0/1703702783 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fec48064ee0 0x7fec48067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.644+0000 7fec5affd700 1 --2- 172.21.15.82:0/1703702783 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fec48064ee0 0x7fec48067390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fec54009ac0 tx=0x7fec54009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.648+0000 7f3b1def6700 1 -- 172.21.15.82:0/1620324441 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b180b44c0 msgr2=0x7f3b180c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.648+0000 7f3b1def6700 1 --2- 172.21.15.82:0/1620324441 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b180b44c0 0x7f3b180c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.648+0000 7f3b1def6700 1 -- 172.21.15.82:0/1620324441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b1806b080 msgr2=0x7f3b181f5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.648+0000 7f3b1def6700 1 --2- 172.21.15.82:0/1620324441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b1806b080 0x7f3b181f5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.648+0000 7f3b1def6700 1 -- 172.21.15.82:0/1620324441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b080094b0 con 0x7f3b181607b0 2023-11-28T13:00:37.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.648+0000 7fec437fe700 1 -- 172.21.15.82:0/1703702783 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fec4c0500f0 con 0x7fec5c141500 2023-11-28T13:00:37.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.648+0000 7f3b1def6700 1 --2- 172.21.15.82:0/1620324441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b181607b0 0x7f3b180d26a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000cc80 tx=0x7f3b1000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.652+0000 7f3b0dffb700 1 -- 172.21.15.82:0/1620324441 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1000ada0 con 0x7f3b181607b0 2023-11-28T13:00:37.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.652+0000 7f3b0dffb700 1 -- 172.21.15.82:0/1620324441 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1000ce80 con 0x7f3b181607b0 2023-11-28T13:00:37.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.652+0000 7f3b1f959700 1 -- 172.21.15.82:0/1620324441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b1806a0f0 con 0x7f3b181607b0 2023-11-28T13:00:37.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.652+0000 7f3b1f959700 1 -- 172.21.15.82:0/1620324441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b18069e10 con 0x7f3b181607b0 2023-11-28T13:00:37.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.652+0000 7f3b0dffb700 1 -- 172.21.15.82:0/1620324441 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b10007310 con 0x7f3b181607b0 2023-11-28T13:00:37.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.656+0000 7f3b0dffb700 1 -- 172.21.15.82:0/1620324441 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3b1001a030 con 0x7f3b181607b0 2023-11-28T13:00:37.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.656+0000 7f3b0dffb700 1 --2- 172.21.15.82:0/1620324441 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3afc064f60 0x7f3afc067410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.656+0000 7f3b0dffb700 1 -- 172.21.15.82:0/1620324441 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3b10081d30 con 0x7f3b181607b0 2023-11-28T13:00:37.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.656+0000 7f3b1d6f5700 1 --2- 172.21.15.82:0/1620324441 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3afc064f60 0x7f3afc067410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.656+0000 7f3b1d6f5700 1 --2- 172.21.15.82:0/1620324441 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3afc064f60 0x7f3afc067410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3b080090b0 tx=0x7f3b08013040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.660+0000 7f3b1f959700 1 -- 172.21.15.82:0/1620324441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af8005310 con 0x7f3b181607b0 2023-11-28T13:00:37.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.668+0000 7f3b0dffb700 1 -- 172.21.15.82:0/1620324441 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3b10018080 con 0x7f3b181607b0 2023-11-28T13:00:37.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.668+0000 7f25ac21f700 1 Processor -- start 2023-11-28T13:00:37.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.672+0000 7fd4c7fff700 1 Processor -- start 2023-11-28T13:00:37.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.672+0000 7fd4c7fff700 1 -- start start 2023-11-28T13:00:37.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.672+0000 7fcf5bfff700 1 Processor -- start 2023-11-28T13:00:37.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.672+0000 7fcf5bfff700 1 -- start start 2023-11-28T13:00:37.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.672+0000 7fd4c7fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd4c8070070 0x7fd4c80cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c7fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd4c806d430 0x7fd4c8070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c7fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd4c80cc1d0 0x7fd4c8069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c7fff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c806b520 con 0x7fd4c8070070 2023-11-28T13:00:37.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c7fff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c806de00 con 0x7fd4c806d430 2023-11-28T13:00:37.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c7fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c80ce420 con 0x7fd4c80cc1d0 2023-11-28T13:00:37.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf5bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcf5c0706b0 0x7fcf5c0cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf5bfff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c0ca700 con 0x7fcf5c0702e0 2023-11-28T13:00:37.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf5bfff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c169380 con 0x7fcf5c06db40 2023-11-28T13:00:37.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf5bfff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c0cc860 con 0x7fcf5c0706b0 2023-11-28T13:00:37.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c67fc700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd4c806d430 0x7fd4c8070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf5a7fc700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fcf5c06db40 0x7fcf5c171dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:35656/0 (socket says 172.21.15.82:35656) 2023-11-28T13:00:37.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c67fc700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd4c806d430 0x7fd4c8070440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:51922/0 (socket says 172.21.15.82:51922) 2023-11-28T13:00:37.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c67fc700 1 -- 172.21.15.82:0/2994768632 learned_addr learned my addr 172.21.15.82:0/2994768632 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:37.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf5a7fc700 1 -- 172.21.15.82:0/1581089196 learned_addr learned my addr 172.21.15.82:0/1581089196 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:37.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf5b7fe700 1 --2- 172.21.15.82:0/1581089196 >> v2:172.21.15.82:3300/0 conn(0x7fcf5c0706b0 0x7fcf5c0cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c6ffd700 1 --2- 172.21.15.82:0/2994768632 >> v2:172.21.15.82:3300/0 conn(0x7fd4c8070070 0x7fd4c80cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c6ffd700 1 -- 172.21.15.82:0/2994768632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd4c80cc1d0 msgr2=0x7fd4c8069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:37.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf59ffb700 1 -- 172.21.15.82:0/1581089196 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655486028 0 0) 0x7fcf5c0ca700 con 0x7fcf5c0702e0 2023-11-28T13:00:37.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf59ffb700 1 -- 172.21.15.82:0/1581089196 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf440035d0 con 0x7fcf5c0702e0 2023-11-28T13:00:37.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c6ffd700 1 --2- 172.21.15.82:0/2994768632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd4c80cc1d0 0x7fd4c8069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c6ffd700 1 -- 172.21.15.82:0/2994768632 >> v2:172.21.15.114:3300/0 conn(0x7fd4c806d430 msgr2=0x7fd4c8070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:37.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf59ffb700 1 -- 172.21.15.82:0/1581089196 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300261605 0 0) 0x7fcf5c169380 con 0x7fcf5c06db40 2023-11-28T13:00:37.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf59ffb700 1 -- 172.21.15.82:0/1581089196 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf5c0ca700 con 0x7fcf5c06db40 2023-11-28T13:00:37.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c6ffd700 1 --2- 172.21.15.82:0/2994768632 >> v2:172.21.15.114:3300/0 conn(0x7fd4c806d430 0x7fd4c8070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c6ffd700 1 -- 172.21.15.82:0/2994768632 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c8070980 con 0x7fd4c8070070 2023-11-28T13:00:37.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c6ffd700 1 --2- 172.21.15.82:0/2994768632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c8070070 0x7fd4c80cdee0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80cd400 tx=0x7fd4b8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643af9df26ee5c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c5ffb700 1 -- 172.21.15.82:0/2994768632 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8011830 con 0x7fd4c8070070 2023-11-28T13:00:37.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf59ffb700 1 -- 172.21.15.82:0/1581089196 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2702319788 0 0) 0x7fcf440035d0 con 0x7fcf5c0702e0 2023-11-28T13:00:37.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf59ffb700 1 -- 172.21.15.82:0/1581089196 >> v2:172.21.15.82:3300/0 conn(0x7fcf5c0706b0 msgr2=0x7fcf5c0cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:37.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf59ffb700 1 --2- 172.21.15.82:0/1581089196 >> v2:172.21.15.82:3300/0 conn(0x7fcf5c0706b0 0x7fcf5c0cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf59ffb700 1 -- 172.21.15.82:0/1581089196 >> v1:172.21.15.114:6789/0 conn(0x7fcf5c06db40 legacy=0x7fcf5c171dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf59ffb700 1 -- 172.21.15.82:0/1581089196 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c0ada20 con 0x7fcf5c0702e0 2023-11-28T13:00:37.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf59ffb700 1 -- 172.21.15.82:0/1581089196 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7fcf54001970 con 0x7fcf5c0702e0 2023-11-28T13:00:37.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf59ffb700 1 -- 172.21.15.82:0/1581089196 >> v1:172.21.15.82:6789/0 conn(0x7fcf5c0702e0 legacy=0x7fcf5c06a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf59ffb700 1 --2- 172.21.15.82:0/1581089196 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf44003c00 0x7fcf44003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf59ffb700 1 --2- 172.21.15.82:0/1581089196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf44004870 0x7fcf44004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf59ffb700 1 --2- 172.21.15.82:0/1581089196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf44005220 0x7fcf44014240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c5ffb700 1 -- 172.21.15.82:0/2994768632 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b8011990 con 0x7fd4c8070070 2023-11-28T13:00:37.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf59ffb700 1 -- 172.21.15.82:0/1581089196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0cc860 con 0x7fcf44004870 2023-11-28T13:00:37.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf59ffb700 1 -- 172.21.15.82:0/1581089196 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44014860 con 0x7fcf44005220 2023-11-28T13:00:37.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf59ffb700 1 -- 172.21.15.82:0/1581089196 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44014a20 con 0x7fcf44003c00 2023-11-28T13:00:37.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf5b7fe700 1 --2- 172.21.15.82:0/1581089196 >> v2:172.21.15.82:3300/0 conn(0x7fcf5c0706b0 0x7fcf5c0cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:37.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf5a7fc700 1 --2- 172.21.15.82:0/1581089196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf44004870 0x7fcf44004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf5affd700 1 --2- 172.21.15.82:0/1581089196 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf44003c00 0x7fcf44003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf5b7fe700 1 --2- 172.21.15.82:0/1581089196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf44005220 0x7fcf44014240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf5a7fc700 1 -- 172.21.15.82:0/1581089196 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf44003c00 msgr2=0x7fcf44003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:37.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf5a7fc700 1 --2- 172.21.15.82:0/1581089196 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf44003c00 0x7fcf44003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf5a7fc700 1 -- 172.21.15.82:0/1581089196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf44005220 msgr2=0x7fcf44014240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:37.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf5a7fc700 1 --2- 172.21.15.82:0/1581089196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf44005220 0x7fcf44014240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf5a7fc700 1 -- 172.21.15.82:0/1581089196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf440035d0 con 0x7fcf44004870 2023-11-28T13:00:37.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf5b7fe700 1 -- 172.21.15.82:0/1581089196 reap_dead start 2023-11-28T13:00:37.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf5a7fc700 1 --2- 172.21.15.82:0/1581089196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf44004870 0x7fcf44004ce0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcf50001a40 tx=0x7fcf440058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a730f3e8610c6f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c5ffb700 1 -- 172.21.15.82:0/2994768632 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8011d20 con 0x7fd4c8070070 2023-11-28T13:00:37.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf59ffb700 1 -- 172.21.15.82:0/1581089196 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf50004b50 con 0x7fcf44004870 2023-11-28T13:00:37.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf59ffb700 1 -- 172.21.15.82:0/1581089196 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf50004cb0 con 0x7fcf44004870 2023-11-28T13:00:37.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fcf59ffb700 1 -- 172.21.15.82:0/1581089196 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf50007310 con 0x7fcf44004870 2023-11-28T13:00:37.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c7fff700 1 -- 172.21.15.82:0/2994768632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c8070070 msgr2=0x7fd4c80cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c7fff700 1 --2- 172.21.15.82:0/2994768632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c8070070 0x7fd4c80cdee0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80cd400 tx=0x7fd4b8009b30 comp rx=0 tx=0).stop 2023-11-28T13:00:37.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c7fff700 1 -- 172.21.15.82:0/2994768632 shutdown_connections 2023-11-28T13:00:37.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c7fff700 1 --2- 172.21.15.82:0/2994768632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd4c80cc1d0 0x7fd4c8069bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c7fff700 1 --2- 172.21.15.82:0/2994768632 >> v2:172.21.15.114:3300/0 conn(0x7fd4c806d430 0x7fd4c8070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c7fff700 1 --2- 172.21.15.82:0/2994768632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c8070070 0x7fd4c80cdee0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7fd4c7fff700 1 -- 172.21.15.82:0/2994768632 >> 172.21.15.82:0/2994768632 conn(0x7fd4c80cbd10 msgr2=0x7fd4c80ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:37.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5bfff700 1 -- 172.21.15.82:0/1581089196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf44004870 msgr2=0x7fcf44004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5bfff700 1 --2- 172.21.15.82:0/1581089196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf44004870 0x7fcf44004ce0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcf50001a40 tx=0x7fcf440058a0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5bfff700 1 -- 172.21.15.82:0/1581089196 shutdown_connections 2023-11-28T13:00:37.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5bfff700 1 --2- 172.21.15.82:0/1581089196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf44004870 0x7fcf44004ce0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5bfff700 1 -- 172.21.15.82:0/1581089196 >> 172.21.15.82:0/1581089196 conn(0x7fcf5c0cbd10 msgr2=0x7fcf5c0ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:37.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5bfff700 1 -- 172.21.15.82:0/1581089196 shutdown_connections 2023-11-28T13:00:37.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5bfff700 1 -- 172.21.15.82:0/1581089196 wait complete. 2023-11-28T13:00:37.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5bfff700 1 Processor -- start 2023-11-28T13:00:37.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5bfff700 1 -- start start 2023-11-28T13:00:37.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7f8c7e386700 1 Processor -- start 2023-11-28T13:00:37.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fd4c7fff700 1 -- 172.21.15.82:0/2994768632 shutdown_connections 2023-11-28T13:00:37.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fd4c7fff700 1 -- 172.21.15.82:0/2994768632 wait complete. 2023-11-28T13:00:37.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7f8c7e386700 1 -- start start 2023-11-28T13:00:37.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf44004870 0x7fcf5c0c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf5c0b06f0 0x7fcf5c0afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5bfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf5c0c8c90 0x7fcf5c0c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5bfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0afb10 con 0x7fcf44004870 2023-11-28T13:00:37.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5bfff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0c4c40 con 0x7fcf5c0b06f0 2023-11-28T13:00:37.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5bfff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0aed50 con 0x7fcf5c0c8c90 2023-11-28T13:00:37.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf44004870 0x7fcf5c0c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf44004870 0x7fcf5c0c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50768/0 (socket says 172.21.15.82:50768) 2023-11-28T13:00:37.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5affd700 1 -- 172.21.15.82:0/1732187852 learned_addr learned my addr 172.21.15.82:0/1732187852 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:37.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5b7fe700 1 --2- 172.21.15.82:0/1732187852 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf5c0c8c90 0x7fcf5c0c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5affd700 1 -- 172.21.15.82:0/1732187852 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf5c0c8c90 msgr2=0x7fcf5c0c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5affd700 1 --2- 172.21.15.82:0/1732187852 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf5c0c8c90 0x7fcf5c0c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5affd700 1 -- 172.21.15.82:0/1732187852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf5c0b06f0 msgr2=0x7fcf5c0afe20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T13:00:37.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5affd700 1 --2- 172.21.15.82:0/1732187852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf5c0b06f0 0x7fcf5c0afe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5affd700 1 -- 172.21.15.82:0/1732187852 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c0cdfa0 con 0x7fcf44004870 2023-11-28T13:00:37.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7f8c7e386700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c780b3ef0 0x7f8c7806b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7f8c7e386700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7815a400 con 0x7f8c780c8c50 2023-11-28T13:00:37.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7f8c7e386700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7806d5e0 con 0x7f8c78070070 2023-11-28T13:00:37.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7f8c7e386700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7815dc40 con 0x7f8c780b3ef0 2023-11-28T13:00:37.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fcf5affd700 1 --2- 172.21.15.82:0/1732187852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf44004870 0x7fcf5c0c73f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcf54005990 tx=0x7fcf5400a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7f8c7cb83700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8c780c8c50 0x7f8c7806c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60510/0 (socket says 172.21.15.82:60510) 2023-11-28T13:00:37.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7f8c7cb83700 1 -- 172.21.15.82:0/2088663052 learned_addr learned my addr 172.21.15.82:0/2088663052 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:37.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7f8c7d384700 1 --2- 172.21.15.82:0/2088663052 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c780b3ef0 0x7f8c7806b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7fd4c7fff700 1 Processor -- start 2023-11-28T13:00:37.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.672+0000 7f25ac21f700 1 -- start start 2023-11-28T13:00:37.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7f25ac21f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f25a4141500 0x7f25a40c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7f25ac21f700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a41585f0 con 0x7f25a4070070 2023-11-28T13:00:37.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7f25ac21f700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a415bd80 con 0x7f25a4141a50 2023-11-28T13:00:37.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7f25ac21f700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a415ca00 con 0x7f25a4141500 2023-11-28T13:00:37.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7f25a97ba700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f25a4141500 0x7f25a40c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7f25a9fbb700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f25a4070070 0x7f25a4070440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60494/0 (socket says 172.21.15.82:60494) 2023-11-28T13:00:37.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7f25a9fbb700 1 -- 172.21.15.82:0/3804730307 learned_addr learned my addr 172.21.15.82:0/3804730307 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:37.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7f25a97ba700 1 -- 172.21.15.82:0/3804730307 >> v1:172.21.15.114:6789/0 conn(0x7f25a4141a50 legacy=0x7f25a40c9190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T13:00:37.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7fd4c7fff700 1 -- start start 2023-11-28T13:00:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7f25a97ba700 1 -- 172.21.15.82:0/3804730307 >> v1:172.21.15.82:6789/0 conn(0x7f25a4070070 legacy=0x7f25a4070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7f25a97ba700 1 -- 172.21.15.82:0/3804730307 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a415c060 con 0x7f25a4141500 2023-11-28T13:00:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.676+0000 7f25a97ba700 1 --2- 172.21.15.82:0/3804730307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a4141500 0x7f25a40c8c50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2594009850 tx=0x7f2594009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ed63cb7cb2c113 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7f25a8fb9700 1 -- 172.21.15.82:0/3804730307 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2594004230 con 0x7f25a4141500 2023-11-28T13:00:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7f25a8fb9700 1 -- 172.21.15.82:0/3804730307 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2594004390 con 0x7f25a4141500 2023-11-28T13:00:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7f25a8fb9700 1 -- 172.21.15.82:0/3804730307 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25940036c0 con 0x7f25a4141500 2023-11-28T13:00:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7f25ac21f700 1 -- 172.21.15.82:0/3804730307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a4141500 msgr2=0x7f25a40c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.680+0000 7f25ac21f700 1 --2- 172.21.15.82:0/3804730307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a4141500 0x7f25a40c8c50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2594009850 tx=0x7f2594009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7d384700 1 -- 172.21.15.82:0/2088663052 >> v1:172.21.15.114:6789/0 conn(0x7f8c78070070 legacy=0x7f8c7815e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7d384700 1 -- 172.21.15.82:0/2088663052 >> v1:172.21.15.82:6789/0 conn(0x7f8c780c8c50 legacy=0x7f8c7806c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7d384700 1 -- 172.21.15.82:0/2088663052 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7806d8c0 con 0x7f8c780b3ef0 2023-11-28T13:00:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7d384700 1 --2- 172.21.15.82:0/2088663052 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c780b3ef0 0x7f8c7806b0a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009880 tx=0x7f8c68009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=457cb18a64e63dc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c6ffff700 1 -- 172.21.15.82:0/2088663052 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68011830 con 0x7f8c780b3ef0 2023-11-28T13:00:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c6ffff700 1 -- 172.21.15.82:0/2088663052 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c68011990 con 0x7f8c780b3ef0 2023-11-28T13:00:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c6ffff700 1 -- 172.21.15.82:0/2088663052 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68011d20 con 0x7f8c780b3ef0 2023-11-28T13:00:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7e386700 1 -- 172.21.15.82:0/2088663052 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c780b3ef0 msgr2=0x7f8c7806b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7e386700 1 --2- 172.21.15.82:0/2088663052 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c780b3ef0 0x7f8c7806b0a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009880 tx=0x7f8c68009b90 comp rx=0 tx=0).stop 2023-11-28T13:00:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7e386700 1 -- 172.21.15.82:0/2088663052 shutdown_connections 2023-11-28T13:00:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7e386700 1 --2- 172.21.15.82:0/2088663052 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c780b3ef0 0x7f8c7806b0a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7e386700 1 -- 172.21.15.82:0/2088663052 >> 172.21.15.82:0/2088663052 conn(0x7f8c780cbd10 msgr2=0x7f8c780ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7fd4c7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4c806d430 0x7fd4c80c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7fd4c7fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd4c8070070 0x7fd4c8157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7fd4c7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c80cc1d0 0x7fd4c8156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7fd4c7fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c80c5340 con 0x7fd4c80cc1d0 2023-11-28T13:00:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7fd4c7fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c8158270 con 0x7fd4c806d430 2023-11-28T13:00:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7fd4c7fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c8158530 con 0x7fd4c8070070 2023-11-28T13:00:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7fd4c77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c80cc1d0 0x7fd4c8156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7fd4c77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c80cc1d0 0x7fd4c8156e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50776/0 (socket says 172.21.15.82:50776) 2023-11-28T13:00:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7fd4c77fe700 1 -- 172.21.15.82:0/79663740 learned_addr learned my addr 172.21.15.82:0/79663740 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7fd4c67fc700 1 --2- 172.21.15.82:0/79663740 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd4c8070070 0x7fd4c8157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7fd4c6ffd700 1 --2- 172.21.15.82:0/79663740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4c806d430 0x7fd4c80c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7fd4c77fe700 1 -- 172.21.15.82:0/79663740 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd4c8070070 msgr2=0x7fd4c8157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7fd4c77fe700 1 --2- 172.21.15.82:0/79663740 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd4c8070070 0x7fd4c8157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7fd4c77fe700 1 -- 172.21.15.82:0/79663740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4c806d430 msgr2=0x7fd4c80c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7fd4c77fe700 1 --2- 172.21.15.82:0/79663740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4c806d430 0x7fd4c80c4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7fd4c77fe700 1 -- 172.21.15.82:0/79663740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b80094b0 con 0x7fd4c80cc1d0 2023-11-28T13:00:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7fd4c77fe700 1 --2- 172.21.15.82:0/79663740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c80cc1d0 0x7fd4c8156e40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00b430 tx=0x7fd4bc00b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7e386700 1 -- 172.21.15.82:0/2088663052 shutdown_connections 2023-11-28T13:00:37.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7e386700 1 -- 172.21.15.82:0/2088663052 wait complete. 2023-11-28T13:00:37.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7e386700 1 Processor -- start 2023-11-28T13:00:37.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7e386700 1 -- start start 2023-11-28T13:00:37.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7e386700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c78070070 0x7f8c780c2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7e386700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c780b3ef0 0x7f8c781511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7e386700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c780c8c50 0x7f8c780c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7e386700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780aec70 con 0x7f8c78070070 2023-11-28T13:00:37.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7e386700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780c3f90 con 0x7f8c780b3ef0 2023-11-28T13:00:37.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7e386700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780c4270 con 0x7f8c780c8c50 2023-11-28T13:00:37.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7d384700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c78070070 0x7f8c780c2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7d384700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c78070070 0x7f8c780c2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50792/0 (socket says 172.21.15.82:50792) 2023-11-28T13:00:37.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.684+0000 7f8c7d384700 1 -- 172.21.15.82:0/2306578223 learned_addr learned my addr 172.21.15.82:0/2306578223 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:37.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f8c7cb83700 1 --2- 172.21.15.82:0/2306578223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c780b3ef0 0x7f8c781511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f8c7db85700 1 --2- 172.21.15.82:0/2306578223 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c780c8c50 0x7f8c780c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f8c7d384700 1 -- 172.21.15.82:0/2306578223 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c780c8c50 msgr2=0x7f8c780c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f8c7d384700 1 --2- 172.21.15.82:0/2306578223 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c780c8c50 0x7f8c780c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f8c7d384700 1 -- 172.21.15.82:0/2306578223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c780b3ef0 msgr2=0x7f8c781511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f8c7d384700 1 --2- 172.21.15.82:0/2306578223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c780b3ef0 0x7f8c781511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25ac21f700 1 -- 172.21.15.82:0/3804730307 shutdown_connections 2023-11-28T13:00:37.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25ac21f700 1 --2- 172.21.15.82:0/3804730307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a4141500 0x7f25a40c8c50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25ac21f700 1 -- 172.21.15.82:0/3804730307 >> 172.21.15.82:0/3804730307 conn(0x7f25a40cbd10 msgr2=0x7f25a40ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:37.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25ac21f700 1 -- 172.21.15.82:0/3804730307 shutdown_connections 2023-11-28T13:00:37.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25ac21f700 1 -- 172.21.15.82:0/3804730307 wait complete. 2023-11-28T13:00:37.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f8c7d384700 1 -- 172.21.15.82:0/2306578223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c680094b0 con 0x7f8c78070070 2023-11-28T13:00:37.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f8c7d384700 1 --2- 172.21.15.82:0/2306578223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c78070070 0x7f8c780c2110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8c680090b0 tx=0x7f8c68004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f8c6dffb700 1 -- 172.21.15.82:0/2306578223 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68006ea0 con 0x7f8c78070070 2023-11-28T13:00:37.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f8c6dffb700 1 -- 172.21.15.82:0/2306578223 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6801f070 con 0x7f8c78070070 2023-11-28T13:00:37.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f8c7e386700 1 -- 172.21.15.82:0/2306578223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7806c780 con 0x7f8c78070070 2023-11-28T13:00:37.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f8c6dffb700 1 -- 172.21.15.82:0/2306578223 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68003ae0 con 0x7f8c78070070 2023-11-28T13:00:37.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f8c7e386700 1 -- 172.21.15.82:0/2306578223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7806dba0 con 0x7f8c78070070 2023-11-28T13:00:37.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25ac21f700 1 Processor -- start 2023-11-28T13:00:37.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25ac21f700 1 -- start start 2023-11-28T13:00:37.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f8c7e386700 1 -- 172.21.15.82:0/2306578223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7806de80 con 0x7f8c78070070 2023-11-28T13:00:37.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25ac21f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25a4070070 0x7f25a4088cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25ac21f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25a4141500 0x7f25a40c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f8c6dffb700 1 -- 172.21.15.82:0/2306578223 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8c6800f050 con 0x7f8c78070070 2023-11-28T13:00:37.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25ac21f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a4141a50 0x7f25a40862a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25ac21f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a40867e0 con 0x7f25a4141a50 2023-11-28T13:00:37.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25ac21f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a40c8940 con 0x7f25a4141500 2023-11-28T13:00:37.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25ac21f700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a40c5d40 con 0x7f25a4070070 2023-11-28T13:00:37.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25aa7bc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a4141a50 0x7f25a40862a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25aa7bc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a4141a50 0x7f25a40862a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50802/0 (socket says 172.21.15.82:50802) 2023-11-28T13:00:37.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25aa7bc700 1 -- 172.21.15.82:0/2569905354 learned_addr learned my addr 172.21.15.82:0/2569905354 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:37.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25a9fbb700 1 --2- 172.21.15.82:0/2569905354 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25a4070070 0x7f25a4088cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25a97ba700 1 --2- 172.21.15.82:0/2569905354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25a4141500 0x7f25a40c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25aa7bc700 1 -- 172.21.15.82:0/2569905354 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25a4070070 msgr2=0x7f25a4088cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25aa7bc700 1 --2- 172.21.15.82:0/2569905354 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25a4070070 0x7f25a4088cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25aa7bc700 1 -- 172.21.15.82:0/2569905354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25a4141500 msgr2=0x7f25a40c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25aa7bc700 1 --2- 172.21.15.82:0/2569905354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25a4141500 0x7f25a40c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25aa7bc700 1 -- 172.21.15.82:0/2569905354 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25940094b0 con 0x7f25a4141a50 2023-11-28T13:00:37.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f8c6dffb700 1 --2- 172.21.15.82:0/2306578223 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8c5c064ee0 0x7f8c5c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f8c6dffb700 1 -- 172.21.15.82:0/2306578223 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c68021070 con 0x7f8c78070070 2023-11-28T13:00:37.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.688+0000 7f25aa7bc700 1 --2- 172.21.15.82:0/2569905354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a4141a50 0x7f25a40862a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f25a000b4a0 tx=0x7f25a000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.692+0000 7fcf437fe700 1 -- 172.21.15.82:0/1732187852 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5400acb0 con 0x7fcf44004870 2023-11-28T13:00:37.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.692+0000 7fcf437fe700 1 -- 172.21.15.82:0/1732187852 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5400ae10 con 0x7fcf44004870 2023-11-28T13:00:37.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.692+0000 7fcf437fe700 1 -- 172.21.15.82:0/1732187852 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf540135f0 con 0x7fcf44004870 2023-11-28T13:00:37.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.692+0000 7fcf5bfff700 1 -- 172.21.15.82:0/1732187852 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c0add00 con 0x7fcf44004870 2023-11-28T13:00:37.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.692+0000 7fcf5bfff700 1 -- 172.21.15.82:0/1732187852 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c06b420 con 0x7fcf44004870 2023-11-28T13:00:37.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.692+0000 7f8c7cb83700 1 --2- 172.21.15.82:0/2306578223 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8c5c064ee0 0x7f8c5c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.692+0000 7f8c7cb83700 1 --2- 172.21.15.82:0/2306578223 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8c5c064ee0 0x7f8c5c067390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8c780ce310 tx=0x7f8c70009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.696+0000 7fd4af7fe700 1 -- 172.21.15.82:0/79663740 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc011830 con 0x7fd4c80cc1d0 2023-11-28T13:00:37.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.696+0000 7fd4c7fff700 1 -- 172.21.15.82:0/79663740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c806ce00 con 0x7fd4c80cc1d0 2023-11-28T13:00:37.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.696+0000 7f259a7fc700 1 -- 172.21.15.82:0/2569905354 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0011830 con 0x7f25a4141a50 2023-11-28T13:00:37.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.696+0000 7fd4c7fff700 1 -- 172.21.15.82:0/79663740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c806cb20 con 0x7fd4c80cc1d0 2023-11-28T13:00:37.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.696+0000 7f25ac21f700 1 -- 172.21.15.82:0/2569905354 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a415c620 con 0x7f25a4141a50 2023-11-28T13:00:37.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.696+0000 7f25ac21f700 1 -- 172.21.15.82:0/2569905354 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a415c340 con 0x7f25a4141a50 2023-11-28T13:00:37.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.696+0000 7f8c6dffb700 1 -- 172.21.15.82:0/2306578223 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8c68051a50 con 0x7f8c78070070 2023-11-28T13:00:37.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.696+0000 7fd4af7fe700 1 -- 172.21.15.82:0/79663740 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc011990 con 0x7fd4c80cc1d0 2023-11-28T13:00:37.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.696+0000 7fd4af7fe700 1 -- 172.21.15.82:0/79663740 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc011d40 con 0x7fd4c80cc1d0 2023-11-28T13:00:37.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.696+0000 7f25ac21f700 1 -- 172.21.15.82:0/2569905354 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a40caaa0 con 0x7f25a4141a50 2023-11-28T13:00:37.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.696+0000 7fcf437fe700 1 -- 172.21.15.82:0/1732187852 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcf54023070 con 0x7fcf44004870 2023-11-28T13:00:37.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.696+0000 7f259a7fc700 1 -- 172.21.15.82:0/2569905354 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a00092d0 con 0x7f25a4141a50 2023-11-28T13:00:37.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.696+0000 7f259a7fc700 1 -- 172.21.15.82:0/2569905354 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0011bb0 con 0x7f25a4141a50 2023-11-28T13:00:37.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.696+0000 7fd4af7fe700 1 -- 172.21.15.82:0/79663740 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd4bc021070 con 0x7fd4c80cc1d0 2023-11-28T13:00:37.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.696+0000 7fcf437fe700 1 --2- 172.21.15.82:0/1732187852 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcf48064f30 0x7fcf480673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.696+0000 7f259a7fc700 1 -- 172.21.15.82:0/2569905354 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f25a0021070 con 0x7f25a4141a50 2023-11-28T13:00:37.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.696+0000 7fcf437fe700 1 -- 172.21.15.82:0/1732187852 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcf54082890 con 0x7fcf44004870 2023-11-28T13:00:37.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fcf5a7fc700 1 --2- 172.21.15.82:0/1732187852 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcf48064f30 0x7fcf480673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7f259a7fc700 1 --2- 172.21.15.82:0/2569905354 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2590087090 0x7f2590089540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fd4af7fe700 1 --2- 172.21.15.82:0/79663740 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd4b00650c0 0x7fd4b0067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fd4af7fe700 1 -- 172.21.15.82:0/79663740 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd4bc081b50 con 0x7fd4c80cc1d0 2023-11-28T13:00:37.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fb3834a0700 1 Processor -- start 2023-11-28T13:00:37.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fd4c6ffd700 1 --2- 172.21.15.82:0/79663740 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd4b00650c0 0x7fd4b0067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fb3834a0700 1 -- start start 2023-11-28T13:00:37.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7f25a9fbb700 1 --2- 172.21.15.82:0/2569905354 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2590087090 0x7f2590089540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7f259a7fc700 1 -- 172.21.15.82:0/2569905354 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f25a0082380 con 0x7f25a4141a50 2023-11-28T13:00:37.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fd4c6ffd700 1 --2- 172.21.15.82:0/79663740 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd4b00650c0 0x7fd4b0067570 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd4b80090b0 tx=0x7fd4b8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7f25a9fbb700 1 --2- 172.21.15.82:0/2569905354 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2590087090 0x7f2590089540 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f259c001dc0 tx=0x7f259c001d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fb3834a0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb37c070070 0x7fb37c0cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fb3834a0700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb37c06d430 0x7fb37c070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fcf5a7fc700 1 --2- 172.21.15.82:0/1732187852 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcf48064f30 0x7fcf480673e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c0cc3b0 tx=0x7fcf50007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fb3834a0700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb37c06de00 con 0x7fb37c0cc1d0 2023-11-28T13:00:37.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fb3834a0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb37c06b520 con 0x7fb37c070070 2023-11-28T13:00:37.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fb3834a0700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c0ce420 con 0x7fb37c06d430 2023-11-28T13:00:37.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fb38249e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb37c070070 0x7fb37c0cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fb38249e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb37c070070 0x7fb37c0cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50816/0 (socket says 172.21.15.82:50816) 2023-11-28T13:00:37.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fb38249e700 1 -- 172.21.15.82:0/2317594559 learned_addr learned my addr 172.21.15.82:0/2317594559 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:37.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fcf5bfff700 1 -- 172.21.15.82:0/1732187852 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5c065fc0 con 0x7fcf44004870 2023-11-28T13:00:37.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fb381c9d700 1 --2- 172.21.15.82:0/2317594559 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb37c06d430 0x7fb37c070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fb38249e700 1 -- 172.21.15.82:0/2317594559 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb37c06d430 msgr2=0x7fb37c070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:37.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fb38249e700 1 --2- 172.21.15.82:0/2317594559 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb37c06d430 0x7fb37c070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fb38249e700 1 -- 172.21.15.82:0/2317594559 >> v1:172.21.15.114:6789/0 conn(0x7fb37c0cc1d0 legacy=0x7fb37c069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:37.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fb38249e700 1 -- 172.21.15.82:0/2317594559 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37c070980 con 0x7fb37c070070 2023-11-28T13:00:37.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fb381c9d700 1 --2- 172.21.15.82:0/2317594559 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb37c06d430 0x7fb37c070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:37.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.700+0000 7fb38249e700 1 --2- 172.21.15.82:0/2317594559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb37c070070 0x7fb37c0cdee0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb378009910 tx=0x7fb378009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9210ebdb6197e152 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.704+0000 7fd4c7fff700 1 -- 172.21.15.82:0/79663740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a8005310 con 0x7fd4c80cc1d0 2023-11-28T13:00:37.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.704+0000 7f259a7fc700 1 -- 172.21.15.82:0/2569905354 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f25a00504b0 con 0x7f25a4141a50 2023-11-28T13:00:37.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.712+0000 7fc04ce5d700 1 Processor -- start 2023-11-28T13:00:37.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.712+0000 7fc04ce5d700 1 -- start start 2023-11-28T13:00:37.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.712+0000 7fcf437fe700 1 -- 172.21.15.82:0/1732187852 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcf54050a70 con 0x7fcf44004870 2023-11-28T13:00:37.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.712+0000 7fc04ce5d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc04806d430 0x7fc048070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.712+0000 7fc04ce5d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc0480cc1d0 0x7fc048069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.712+0000 7fc04ce5d700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04806de00 con 0x7fc048070070 2023-11-28T13:00:37.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.712+0000 7fc04ce5d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04806b520 con 0x7fc0480cc1d0 2023-11-28T13:00:37.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.712+0000 7fc04ce5d700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc048070980 con 0x7fc04806d430 2023-11-28T13:00:37.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.712+0000 7fc0477fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc048070070 0x7fc0480cdee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60524/0 (socket says 172.21.15.82:60524) 2023-11-28T13:00:37.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.712+0000 7fc0477fe700 1 -- 172.21.15.82:0/1933282442 learned_addr learned my addr 172.21.15.82:0/1933282442 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:37.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.712+0000 7fc047fff700 1 --2- 172.21.15.82:0/1933282442 >> v2:172.21.15.114:3300/0 conn(0x7fc0480cc1d0 0x7fc048069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.712+0000 7fc046ffd700 1 --2- 172.21.15.82:0/1933282442 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc04806d430 0x7fc048070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.712+0000 7fc046ffd700 1 -- 172.21.15.82:0/1933282442 >> v2:172.21.15.114:3300/0 conn(0x7fc0480cc1d0 msgr2=0x7fc048069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:37.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.712+0000 7fc046ffd700 1 --2- 172.21.15.82:0/1933282442 >> v2:172.21.15.114:3300/0 conn(0x7fc0480cc1d0 0x7fc048069bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.712+0000 7fc046ffd700 1 -- 172.21.15.82:0/1933282442 >> v1:172.21.15.82:6789/0 conn(0x7fc048070070 legacy=0x7fc0480cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.712+0000 7fc046ffd700 1 -- 172.21.15.82:0/1933282442 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04806cb20 con 0x7fc04806d430 2023-11-28T13:00:37.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.712+0000 7fc046ffd700 1 --2- 172.21.15.82:0/1933282442 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc04806d430 0x7fc048070440 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009850 tx=0x7fc03c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec35bc8fc709b468 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.716+0000 7fc0467fc700 1 -- 172.21.15.82:0/1933282442 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c011830 con 0x7fc04806d430 2023-11-28T13:00:37.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.716+0000 7fc0467fc700 1 -- 172.21.15.82:0/1933282442 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c011990 con 0x7fc04806d430 2023-11-28T13:00:37.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.716+0000 7fc0467fc700 1 -- 172.21.15.82:0/1933282442 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c011d40 con 0x7fc04806d430 2023-11-28T13:00:37.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.716+0000 7fc04ce5d700 1 -- 172.21.15.82:0/1933282442 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc04806d430 msgr2=0x7fc048070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.716+0000 7fc04ce5d700 1 --2- 172.21.15.82:0/1933282442 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc04806d430 0x7fc048070440 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009850 tx=0x7fc03c009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:37.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.716+0000 7fc04ce5d700 1 -- 172.21.15.82:0/1933282442 shutdown_connections 2023-11-28T13:00:37.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.716+0000 7fc04ce5d700 1 --2- 172.21.15.82:0/1933282442 >> v2:172.21.15.114:3300/0 conn(0x7fc0480cc1d0 0x7fc048069bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.716+0000 7fc04ce5d700 1 --2- 172.21.15.82:0/1933282442 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc04806d430 0x7fc048070440 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.716+0000 7fc04ce5d700 1 -- 172.21.15.82:0/1933282442 >> 172.21.15.82:0/1933282442 conn(0x7fc0480cbd10 msgr2=0x7fc0480ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:37.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.716+0000 7fc04ce5d700 1 -- 172.21.15.82:0/1933282442 shutdown_connections 2023-11-28T13:00:37.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.716+0000 7fc04ce5d700 1 -- 172.21.15.82:0/1933282442 wait complete. 2023-11-28T13:00:37.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.716+0000 7fc04ce5d700 1 Processor -- start 2023-11-28T13:00:37.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.716+0000 7fc04ce5d700 1 -- start start 2023-11-28T13:00:37.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fc04ce5d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc04806d430 0x7fc048159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fc04ce5d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc048070070 0x7fc0480b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fc04ce5d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0480cc1d0 0x7fc0480b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fc04ce5d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0481f3250 con 0x7fc0480cc1d0 2023-11-28T13:00:37.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fc04ce5d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0481f25d0 con 0x7fc048070070 2023-11-28T13:00:37.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fc04ce5d700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0481f28b0 con 0x7fc04806d430 2023-11-28T13:00:37.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fc047fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0480cc1d0 0x7fc0480b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fc047fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0480cc1d0 0x7fc0480b3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50832/0 (socket says 172.21.15.82:50832) 2023-11-28T13:00:37.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fc047fff700 1 -- 172.21.15.82:0/2608322208 learned_addr learned my addr 172.21.15.82:0/2608322208 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:37.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fc0477fe700 1 --2- 172.21.15.82:0/2608322208 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc04806d430 0x7fc048159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fc046ffd700 1 --2- 172.21.15.82:0/2608322208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc048070070 0x7fc0480b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fc047fff700 1 -- 172.21.15.82:0/2608322208 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc04806d430 msgr2=0x7fc048159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fc047fff700 1 --2- 172.21.15.82:0/2608322208 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc04806d430 0x7fc048159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fc047fff700 1 -- 172.21.15.82:0/2608322208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc048070070 msgr2=0x7fc0480b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fc047fff700 1 --2- 172.21.15.82:0/2608322208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc048070070 0x7fc0480b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fc047fff700 1 -- 172.21.15.82:0/2608322208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03c0094b0 con 0x7fc0480cc1d0 2023-11-28T13:00:37.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fc047fff700 1 --2- 172.21.15.82:0/2608322208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0480cc1d0 0x7fc0480b3730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc04000efc0 tx=0x7fc04000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fb38149c700 1 -- 172.21.15.82:0/2317594559 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb378004230 con 0x7fb37c070070 2023-11-28T13:00:37.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fd4af7fe700 1 -- 172.21.15.82:0/79663740 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd4bc04fd90 con 0x7fd4c80cc1d0 2023-11-28T13:00:37.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fc02ffff700 1 -- 172.21.15.82:0/2608322208 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04000cad0 con 0x7fc0480cc1d0 2023-11-28T13:00:37.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fb38149c700 1 -- 172.21.15.82:0/2317594559 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb378004390 con 0x7fb37c070070 2023-11-28T13:00:37.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fb38149c700 1 -- 172.21.15.82:0/2317594559 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb378009e60 con 0x7fb37c070070 2023-11-28T13:00:37.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.720+0000 7fc02ffff700 1 -- 172.21.15.82:0/2608322208 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04000f040 con 0x7fc0480cc1d0 2023-11-28T13:00:37.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.724+0000 7fc02ffff700 1 -- 172.21.15.82:0/2608322208 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04000ce70 con 0x7fc0480cc1d0 2023-11-28T13:00:37.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.724+0000 7fc04ce5d700 1 -- 172.21.15.82:0/2608322208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc04806da90 con 0x7fc0480cc1d0 2023-11-28T13:00:37.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.724+0000 7fc04ce5d700 1 -- 172.21.15.82:0/2608322208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04806ce00 con 0x7fc0480cc1d0 2023-11-28T13:00:37.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fc02ffff700 1 -- 172.21.15.82:0/2608322208 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc040014480 con 0x7fc0480cc1d0 2023-11-28T13:00:37.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fc02ffff700 1 --2- 172.21.15.82:0/2608322208 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc034064ee0 0x7fc034067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fc02ffff700 1 -- 172.21.15.82:0/2608322208 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc040082730 con 0x7fc0480cc1d0 2023-11-28T13:00:37.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fc0477fe700 1 --2- 172.21.15.82:0/2608322208 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc034064ee0 0x7fc034067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fc0477fe700 1 --2- 172.21.15.82:0/2608322208 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc034064ee0 0x7fc034067390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc038000f60 tx=0x7fc038007f30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.724+0000 7fb3834a0700 1 -- 172.21.15.82:0/2317594559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb37c070070 msgr2=0x7fb37c0cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.724+0000 7fb3834a0700 1 --2- 172.21.15.82:0/2317594559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb37c070070 0x7fb37c0cdee0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb378009910 tx=0x7fb378009c20 comp rx=0 tx=0).stop 2023-11-28T13:00:37.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.724+0000 7fb3834a0700 1 -- 172.21.15.82:0/2317594559 shutdown_connections 2023-11-28T13:00:37.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.724+0000 7fb3834a0700 1 --2- 172.21.15.82:0/2317594559 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb37c06d430 0x7fb37c070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.724+0000 7fb3834a0700 1 --2- 172.21.15.82:0/2317594559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb37c070070 0x7fb37c0cdee0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.724+0000 7fb3834a0700 1 -- 172.21.15.82:0/2317594559 >> 172.21.15.82:0/2317594559 conn(0x7fb37c0cbd10 msgr2=0x7fb37c0ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:37.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.724+0000 7fb3834a0700 1 -- 172.21.15.82:0/2317594559 shutdown_connections 2023-11-28T13:00:37.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.724+0000 7fb3834a0700 1 -- 172.21.15.82:0/2317594559 wait complete. 2023-11-28T13:00:37.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.724+0000 7fb3834a0700 1 Processor -- start 2023-11-28T13:00:37.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fb3834a0700 1 -- start start 2023-11-28T13:00:37.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fb3834a0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb37c06d430 0x7fb37c0c3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fb3834a0700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb37c070070 0x7fb37c0c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fb3834a0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb37c0cc1d0 0x7fb37c155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fb3834a0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c0c2260 con 0x7fb37c06d430 2023-11-28T13:00:37.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fb3834a0700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c0c2540 con 0x7fb37c0cc1d0 2023-11-28T13:00:37.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fb3834a0700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c0c2820 con 0x7fb37c070070 2023-11-28T13:00:37.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fb38249e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb37c06d430 0x7fb37c0c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fb38249e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb37c06d430 0x7fb37c0c3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50842/0 (socket says 172.21.15.82:50842) 2023-11-28T13:00:37.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fb38249e700 1 -- 172.21.15.82:0/2012233018 learned_addr learned my addr 172.21.15.82:0/2012233018 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:37.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fb381c9d700 1 --2- 172.21.15.82:0/2012233018 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb37c070070 0x7fb37c0c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fb382c9f700 1 --2- 172.21.15.82:0/2012233018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb37c0cc1d0 0x7fb37c155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fb38249e700 1 -- 172.21.15.82:0/2012233018 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb37c070070 msgr2=0x7fb37c0c43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fb38249e700 1 --2- 172.21.15.82:0/2012233018 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb37c070070 0x7fb37c0c43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fb38249e700 1 -- 172.21.15.82:0/2012233018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb37c0cc1d0 msgr2=0x7fb37c155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fb38249e700 1 --2- 172.21.15.82:0/2012233018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb37c0cc1d0 0x7fb37c155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fb38249e700 1 -- 172.21.15.82:0/2012233018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb378009570 con 0x7fb37c06d430 2023-11-28T13:00:37.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fb381c9d700 1 --2- 172.21.15.82:0/2012233018 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb37c070070 0x7fb37c0c43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:37.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.728+0000 7fb38249e700 1 --2- 172.21.15.82:0/2012233018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb37c06d430 0x7fb37c0c3300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb378004000 tx=0x7fb378004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.736+0000 7fb372ffd700 1 -- 172.21.15.82:0/2012233018 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37800bcd0 con 0x7fb37c06d430 2023-11-28T13:00:37.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.736+0000 7fb372ffd700 1 -- 172.21.15.82:0/2012233018 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb378063070 con 0x7fb37c06d430 2023-11-28T13:00:37.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.736+0000 7fb372ffd700 1 -- 172.21.15.82:0/2012233018 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb378004580 con 0x7fb37c06d430 2023-11-28T13:00:37.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.736+0000 7fb3834a0700 1 -- 172.21.15.82:0/2012233018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37c06ce00 con 0x7fb37c06d430 2023-11-28T13:00:37.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.736+0000 7fb3834a0700 1 -- 172.21.15.82:0/2012233018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37c06cb20 con 0x7fb37c06d430 2023-11-28T13:00:37.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.736+0000 7fb372ffd700 1 -- 172.21.15.82:0/2012233018 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb37806e020 con 0x7fb37c06d430 2023-11-28T13:00:37.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.736+0000 7fb372ffd700 1 --2- 172.21.15.82:0/2012233018 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb360064f30 0x7fb3600673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.736+0000 7fb372ffd700 1 -- 172.21.15.82:0/2012233018 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb3780c74e0 con 0x7fb37c06d430 2023-11-28T13:00:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.736+0000 7fb381c9d700 1 --2- 172.21.15.82:0/2012233018 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb360064f30 0x7fb3600673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:37.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.740+0000 7fb381c9d700 1 --2- 172.21.15.82:0/2012233018 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb360064f30 0x7fb3600673e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0c9fc0 tx=0x7fb36c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:37.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.744+0000 7fc04ce5d700 1 -- 172.21.15.82:0/2608322208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04815c500 con 0x7fc0480cc1d0 2023-11-28T13:00:37.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.752+0000 7fb3834a0700 1 -- 172.21.15.82:0/2012233018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb364005310 con 0x7fb37c06d430 2023-11-28T13:00:37.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.752+0000 7fc02ffff700 1 -- 172.21.15.82:0/2608322208 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc040050870 con 0x7fc0480cc1d0 2023-11-28T13:00:37.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.760+0000 7fb372ffd700 1 -- 172.21.15.82:0/2012233018 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb378095680 con 0x7fb37c06d430 2023-11-28T13:00:37.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.948+0000 7fec614ba700 1 -- 172.21.15.82:0/1703702783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fec5c15c620 con 0x7fec5c141500 2023-11-28T13:00:37.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.948+0000 7fec437fe700 1 -- 172.21.15.82:0/1703702783 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec4c053710 con 0x7fec5c141500 2023-11-28T13:00:37.955 INFO:teuthology.orchestra.run.smithi082.stdout:55834574856 2023-11-28T13:00:37.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.956+0000 7fec417fa700 1 -- 172.21.15.82:0/1703702783 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fec48064ee0 msgr2=0x7fec48067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.956+0000 7fec417fa700 1 --2- 172.21.15.82:0/1703702783 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fec48064ee0 0x7fec48067390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fec54009ac0 tx=0x7fec54009000 comp rx=0 tx=0).stop 2023-11-28T13:00:37.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.956+0000 7fec417fa700 1 -- 172.21.15.82:0/1703702783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec5c141500 msgr2=0x7fec5c1548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.956+0000 7fec417fa700 1 --2- 172.21.15.82:0/1703702783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec5c141500 0x7fec5c1548b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00fcf0 tx=0x7fec4c00d540 comp rx=0 tx=0).stop 2023-11-28T13:00:37.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.956+0000 7fec417fa700 1 -- 172.21.15.82:0/1703702783 shutdown_connections 2023-11-28T13:00:37.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.956+0000 7fec417fa700 1 --2- 172.21.15.82:0/1703702783 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fec48064ee0 0x7fec48067390 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.956+0000 7fec417fa700 1 --2- 172.21.15.82:0/1703702783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec5c141a50 0x7fec5c0b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.956+0000 7fec417fa700 1 --2- 172.21.15.82:0/1703702783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec5c141500 0x7fec5c1548b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.956+0000 7fec417fa700 1 --2- 172.21.15.82:0/1703702783 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fec5c070070 0x7fec5c0c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.956+0000 7fec417fa700 1 -- 172.21.15.82:0/1703702783 >> 172.21.15.82:0/1703702783 conn(0x7fec5c0cbd10 msgr2=0x7fec5c0ae040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:37.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.956+0000 7fec417fa700 1 -- 172.21.15.82:0/1703702783 shutdown_connections 2023-11-28T13:00:37.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.956+0000 7fec417fa700 1 -- 172.21.15.82:0/1703702783 wait complete. 2023-11-28T13:00:37.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.968+0000 7f8c7e386700 1 -- 172.21.15.82:0/2306578223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8c78065ff0 con 0x7f8c78070070 2023-11-28T13:00:37.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.968+0000 7f8c6dffb700 1 -- 172.21.15.82:0/2306578223 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8c68015090 con 0x7f8c78070070 2023-11-28T13:00:37.972 INFO:teuthology.orchestra.run.smithi082.stdout:55834574855 2023-11-28T13:00:37.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.968+0000 7f3b1f959700 1 -- 172.21.15.82:0/1620324441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3af80055c0 con 0x7f3b181607b0 2023-11-28T13:00:37.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.968+0000 7f3b0dffb700 1 -- 172.21.15.82:0/1620324441 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3b1004ff70 con 0x7f3b181607b0 2023-11-28T13:00:37.974 INFO:teuthology.orchestra.run.smithi082.stdout:55834574857 2023-11-28T13:00:37.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f8c7e386700 1 -- 172.21.15.82:0/2306578223 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8c5c064ee0 msgr2=0x7f8c5c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f8c7e386700 1 --2- 172.21.15.82:0/2306578223 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8c5c064ee0 0x7f8c5c067390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8c780ce310 tx=0x7f8c70009040 comp rx=0 tx=0).stop 2023-11-28T13:00:37.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f8c7e386700 1 -- 172.21.15.82:0/2306578223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c78070070 msgr2=0x7f8c780c2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f8c7e386700 1 --2- 172.21.15.82:0/2306578223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c78070070 0x7f8c780c2110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8c680090b0 tx=0x7f8c68004770 comp rx=0 tx=0).stop 2023-11-28T13:00:37.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f8c7e386700 1 -- 172.21.15.82:0/2306578223 shutdown_connections 2023-11-28T13:00:37.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f8c7e386700 1 --2- 172.21.15.82:0/2306578223 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8c5c064ee0 0x7f8c5c067390 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f8c7e386700 1 --2- 172.21.15.82:0/2306578223 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c780c8c50 0x7f8c780c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f8c7e386700 1 --2- 172.21.15.82:0/2306578223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c780b3ef0 0x7f8c781511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f8c7e386700 1 --2- 172.21.15.82:0/2306578223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c78070070 0x7f8c780c2110 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f8c7e386700 1 -- 172.21.15.82:0/2306578223 >> 172.21.15.82:0/2306578223 conn(0x7f8c780cbd10 msgr2=0x7f8c7815ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:37.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f8c7e386700 1 -- 172.21.15.82:0/2306578223 shutdown_connections 2023-11-28T13:00:37.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f8c7e386700 1 -- 172.21.15.82:0/2306578223 wait complete. 2023-11-28T13:00:37.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-11-28T13:00:37.979 DEBUG:teuthology.parallel:result is None 2023-11-28T13:00:37.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f3b1f959700 1 -- 172.21.15.82:0/1620324441 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3afc064f60 msgr2=0x7f3afc067410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f3b1f959700 1 --2- 172.21.15.82:0/1620324441 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3afc064f60 0x7f3afc067410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3b080090b0 tx=0x7f3b08013040 comp rx=0 tx=0).stop 2023-11-28T13:00:37.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f3b1f959700 1 -- 172.21.15.82:0/1620324441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b181607b0 msgr2=0x7f3b180d26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f3b1f959700 1 --2- 172.21.15.82:0/1620324441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b181607b0 0x7f3b180d26a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000cc80 tx=0x7f3b1000a340 comp rx=0 tx=0).stop 2023-11-28T13:00:37.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f3b1f959700 1 -- 172.21.15.82:0/1620324441 shutdown_connections 2023-11-28T13:00:37.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f3b1f959700 1 --2- 172.21.15.82:0/1620324441 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3afc064f60 0x7f3afc067410 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f3b1f959700 1 --2- 172.21.15.82:0/1620324441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b181607b0 0x7f3b180d26a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f3b1f959700 1 --2- 172.21.15.82:0/1620324441 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b180b44c0 0x7f3b180c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f3b1f959700 1 --2- 172.21.15.82:0/1620324441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b1806b080 0x7f3b181f5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f3b1f959700 1 -- 172.21.15.82:0/1620324441 >> 172.21.15.82:0/1620324441 conn(0x7f3b180cf4c0 msgr2=0x7f3b180b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:37.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f3b1f959700 1 -- 172.21.15.82:0/1620324441 shutdown_connections 2023-11-28T13:00:37.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.972+0000 7f3b1f959700 1 -- 172.21.15.82:0/1620324441 wait complete. 2023-11-28T13:00:37.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-11-28T13:00:37.989 DEBUG:teuthology.parallel:result is None 2023-11-28T13:00:37.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2023-11-28T13:00:37.991 DEBUG:teuthology.parallel:result is None 2023-11-28T13:00:37.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.988+0000 7f25ac21f700 1 -- 172.21.15.82:0/2569905354 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f25a4065fc0 con 0x7f25a4141a50 2023-11-28T13:00:37.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.988+0000 7f259a7fc700 1 -- 172.21.15.82:0/2569905354 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f25a0053ad0 con 0x7f25a4141a50 2023-11-28T13:00:37.992 INFO:teuthology.orchestra.run.smithi082.stdout:55834574857 2023-11-28T13:00:37.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.988+0000 7f25ac21f700 1 -- 172.21.15.82:0/2569905354 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2590087090 msgr2=0x7f2590089540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.988+0000 7f25ac21f700 1 --2- 172.21.15.82:0/2569905354 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2590087090 0x7f2590089540 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f259c001dc0 tx=0x7f259c001d50 comp rx=0 tx=0).stop 2023-11-28T13:00:37.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.988+0000 7f25ac21f700 1 -- 172.21.15.82:0/2569905354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a4141a50 msgr2=0x7f25a40862a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:37.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.988+0000 7f25ac21f700 1 --2- 172.21.15.82:0/2569905354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a4141a50 0x7f25a40862a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f25a000b4a0 tx=0x7f25a000b7b0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.992+0000 7f25ac21f700 1 -- 172.21.15.82:0/2569905354 shutdown_connections 2023-11-28T13:00:37.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.992+0000 7f25ac21f700 1 --2- 172.21.15.82:0/2569905354 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2590087090 0x7f2590089540 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.992+0000 7f25ac21f700 1 --2- 172.21.15.82:0/2569905354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a4141a50 0x7f25a40862a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.992+0000 7f25ac21f700 1 --2- 172.21.15.82:0/2569905354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25a4141500 0x7f25a40c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.992+0000 7f25ac21f700 1 --2- 172.21.15.82:0/2569905354 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25a4070070 0x7f25a4088cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:37.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.992+0000 7f25ac21f700 1 -- 172.21.15.82:0/2569905354 >> 172.21.15.82:0/2569905354 conn(0x7f25a40cbd10 msgr2=0x7f25a40af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:37.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.992+0000 7f25ac21f700 1 -- 172.21.15.82:0/2569905354 shutdown_connections 2023-11-28T13:00:37.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:37.992+0000 7f25ac21f700 1 -- 172.21.15.82:0/2569905354 wait complete. 2023-11-28T13:00:38.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2023-11-28T13:00:38.004 DEBUG:teuthology.parallel:result is None 2023-11-28T13:00:38.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.008+0000 7fcf5bfff700 1 -- 172.21.15.82:0/1732187852 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcf5c089d80 con 0x7fcf44004870 2023-11-28T13:00:38.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.008+0000 7fcf437fe700 1 -- 172.21.15.82:0/1732187852 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf54054090 con 0x7fcf44004870 2023-11-28T13:00:38.011 INFO:teuthology.orchestra.run.smithi082.stdout:55834574857 2023-11-28T13:00:38.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.008+0000 7fcf5bfff700 1 -- 172.21.15.82:0/1732187852 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcf48064f30 msgr2=0x7fcf480673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.008+0000 7fcf5bfff700 1 --2- 172.21.15.82:0/1732187852 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcf48064f30 0x7fcf480673e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c0cc3b0 tx=0x7fcf50007000 comp rx=0 tx=0).stop 2023-11-28T13:00:38.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.008+0000 7fcf5bfff700 1 -- 172.21.15.82:0/1732187852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf44004870 msgr2=0x7fcf5c0c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.008+0000 7fcf5bfff700 1 --2- 172.21.15.82:0/1732187852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf44004870 0x7fcf5c0c73f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcf54005990 tx=0x7fcf5400a510 comp rx=0 tx=0).stop 2023-11-28T13:00:38.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.008+0000 7fcf5bfff700 1 -- 172.21.15.82:0/1732187852 shutdown_connections 2023-11-28T13:00:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.012+0000 7fcf5bfff700 1 --2- 172.21.15.82:0/1732187852 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcf48064f30 0x7fcf480673e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.012+0000 7fcf5bfff700 1 --2- 172.21.15.82:0/1732187852 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf5c0c8c90 0x7fcf5c0c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.012+0000 7fcf5bfff700 1 --2- 172.21.15.82:0/1732187852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf5c0b06f0 0x7fcf5c0afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.012+0000 7fcf5bfff700 1 --2- 172.21.15.82:0/1732187852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf44004870 0x7fcf5c0c73f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.012+0000 7fcf5bfff700 1 -- 172.21.15.82:0/1732187852 >> 172.21.15.82:0/1732187852 conn(0x7fcf5c0cbd10 msgr2=0x7fcf5c16bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.012+0000 7fcf5bfff700 1 -- 172.21.15.82:0/1732187852 shutdown_connections 2023-11-28T13:00:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.012+0000 7fcf5bfff700 1 -- 172.21.15.82:0/1732187852 wait complete. 2023-11-28T13:00:38.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2023-11-28T13:00:38.027 DEBUG:teuthology.parallel:result is None 2023-11-28T13:00:38.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.024+0000 7fd4c7fff700 1 -- 172.21.15.82:0/79663740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd4a80055c0 con 0x7fd4c80cc1d0 2023-11-28T13:00:38.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.028+0000 7fd4af7fe700 1 -- 172.21.15.82:0/79663740 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd4bc015020 con 0x7fd4c80cc1d0 2023-11-28T13:00:38.030 INFO:teuthology.orchestra.run.smithi082.stdout:55834574855 2023-11-28T13:00:38.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.028+0000 7fd4c7fff700 1 -- 172.21.15.82:0/79663740 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd4b00650c0 msgr2=0x7fd4b0067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.028+0000 7fd4c7fff700 1 --2- 172.21.15.82:0/79663740 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd4b00650c0 0x7fd4b0067570 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd4b80090b0 tx=0x7fd4b8008030 comp rx=0 tx=0).stop 2023-11-28T13:00:38.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.028+0000 7fd4c7fff700 1 -- 172.21.15.82:0/79663740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c80cc1d0 msgr2=0x7fd4c8156e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.028+0000 7fd4c7fff700 1 --2- 172.21.15.82:0/79663740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c80cc1d0 0x7fd4c8156e40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00b430 tx=0x7fd4bc00b740 comp rx=0 tx=0).stop 2023-11-28T13:00:38.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.028+0000 7fd4c7fff700 1 -- 172.21.15.82:0/79663740 shutdown_connections 2023-11-28T13:00:38.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.028+0000 7fd4c7fff700 1 --2- 172.21.15.82:0/79663740 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd4b00650c0 0x7fd4b0067570 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.028+0000 7fd4c7fff700 1 --2- 172.21.15.82:0/79663740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c80cc1d0 0x7fd4c8156e40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.028+0000 7fd4c7fff700 1 --2- 172.21.15.82:0/79663740 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd4c8070070 0x7fd4c8157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.028+0000 7fd4c7fff700 1 --2- 172.21.15.82:0/79663740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4c806d430 0x7fd4c80c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.028+0000 7fd4c7fff700 1 -- 172.21.15.82:0/79663740 >> 172.21.15.82:0/79663740 conn(0x7fd4c80cbd10 msgr2=0x7fd4c806c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:38.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.028+0000 7fd4c7fff700 1 -- 172.21.15.82:0/79663740 shutdown_connections 2023-11-28T13:00:38.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.028+0000 7fd4c7fff700 1 -- 172.21.15.82:0/79663740 wait complete. 2023-11-28T13:00:38.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.036+0000 7fb3834a0700 1 -- 172.21.15.82:0/2012233018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb3640055c0 con 0x7fb37c06d430 2023-11-28T13:00:38.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.036+0000 7fb372ffd700 1 -- 172.21.15.82:0/2012233018 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb378098ca0 con 0x7fb37c06d430 2023-11-28T13:00:38.042 INFO:teuthology.orchestra.run.smithi082.stdout:55834574856 2023-11-28T13:00:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.040+0000 7fb3834a0700 1 -- 172.21.15.82:0/2012233018 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb360064f30 msgr2=0x7fb3600673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.040+0000 7fb3834a0700 1 --2- 172.21.15.82:0/2012233018 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb360064f30 0x7fb3600673e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0c9fc0 tx=0x7fb36c008040 comp rx=0 tx=0).stop 2023-11-28T13:00:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.040+0000 7fb3834a0700 1 -- 172.21.15.82:0/2012233018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb37c06d430 msgr2=0x7fb37c0c3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.040+0000 7fb3834a0700 1 --2- 172.21.15.82:0/2012233018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb37c06d430 0x7fb37c0c3300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb378004000 tx=0x7fb378004770 comp rx=0 tx=0).stop 2023-11-28T13:00:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.040+0000 7fb3834a0700 1 -- 172.21.15.82:0/2012233018 shutdown_connections 2023-11-28T13:00:38.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.040+0000 7fb3834a0700 1 --2- 172.21.15.82:0/2012233018 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb360064f30 0x7fb3600673e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.040+0000 7fb3834a0700 1 --2- 172.21.15.82:0/2012233018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb37c0cc1d0 0x7fb37c155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.040+0000 7fb3834a0700 1 --2- 172.21.15.82:0/2012233018 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb37c070070 0x7fb37c0c43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.040+0000 7fb3834a0700 1 --2- 172.21.15.82:0/2012233018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb37c06d430 0x7fb37c0c3300 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.040+0000 7fb3834a0700 1 -- 172.21.15.82:0/2012233018 >> 172.21.15.82:0/2012233018 conn(0x7fb37c0cbd10 msgr2=0x7fb37c0b3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:38.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.040+0000 7fb3834a0700 1 -- 172.21.15.82:0/2012233018 shutdown_connections 2023-11-28T13:00:38.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.040+0000 7fb3834a0700 1 -- 172.21.15.82:0/2012233018 wait complete. 2023-11-28T13:00:38.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-11-28T13:00:38.048 DEBUG:teuthology.parallel:result is None 2023-11-28T13:00:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.048+0000 7fc04ce5d700 1 -- 172.21.15.82:0/2608322208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc0480add40 con 0x7fc0480cc1d0 2023-11-28T13:00:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.048+0000 7fc02ffff700 1 -- 172.21.15.82:0/2608322208 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc040018090 con 0x7fc0480cc1d0 2023-11-28T13:00:38.053 INFO:teuthology.orchestra.run.smithi082.stdout:55834574856 2023-11-28T13:00:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.052+0000 7fc04ce5d700 1 -- 172.21.15.82:0/2608322208 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc034064ee0 msgr2=0x7fc034067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.052+0000 7fc04ce5d700 1 --2- 172.21.15.82:0/2608322208 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc034064ee0 0x7fc034067390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc038000f60 tx=0x7fc038007f30 comp rx=0 tx=0).stop 2023-11-28T13:00:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.052+0000 7fc04ce5d700 1 -- 172.21.15.82:0/2608322208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0480cc1d0 msgr2=0x7fc0480b3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.052+0000 7fc04ce5d700 1 --2- 172.21.15.82:0/2608322208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0480cc1d0 0x7fc0480b3730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc04000efc0 tx=0x7fc04000c0c0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.052+0000 7fc04ce5d700 1 -- 172.21.15.82:0/2608322208 shutdown_connections 2023-11-28T13:00:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.052+0000 7fc04ce5d700 1 --2- 172.21.15.82:0/2608322208 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc034064ee0 0x7fc034067390 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.052+0000 7fc04ce5d700 1 --2- 172.21.15.82:0/2608322208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0480cc1d0 0x7fc0480b3730 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.052+0000 7fc04ce5d700 1 --2- 172.21.15.82:0/2608322208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc048070070 0x7fc0480b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.052+0000 7fc04ce5d700 1 --2- 172.21.15.82:0/2608322208 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc04806d430 0x7fc048159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.052+0000 7fc04ce5d700 1 -- 172.21.15.82:0/2608322208 >> 172.21.15.82:0/2608322208 conn(0x7fc0480cbd10 msgr2=0x7fc0480b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.052+0000 7fc04ce5d700 1 -- 172.21.15.82:0/2608322208 shutdown_connections 2023-11-28T13:00:38.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.052+0000 7fc04ce5d700 1 -- 172.21.15.82:0/2608322208 wait complete. 2023-11-28T13:00:38.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2023-11-28T13:00:38.059 DEBUG:teuthology.parallel:result is None 2023-11-28T13:00:38.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2023-11-28T13:00:38.065 DEBUG:teuthology.parallel:result is None 2023-11-28T13:00:38.065 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T13:00:38.065 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:00:38.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.164+0000 7fd62759e700 1 Processor -- start 2023-11-28T13:00:38.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.164+0000 7fd62759e700 1 -- start start 2023-11-28T13:00:38.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.164+0000 7fd62759e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd628070070 0x7fd628070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:38.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.164+0000 7fd62759e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6280c1910 0x7fd62806c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:38.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.164+0000 7fd62759e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd628070980 con 0x7fd628160900 2023-11-28T13:00:38.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.164+0000 7fd62759e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6280ce030 con 0x7fd6280c1910 2023-11-28T13:00:38.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.164+0000 7fd62759e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6280ce310 con 0x7fd628070070 2023-11-28T13:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.164+0000 7fd626d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6280c1910 0x7fd62806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.164+0000 7fd626d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6280c1910 0x7fd62806c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50844/0 (socket says 172.21.15.82:50844) 2023-11-28T13:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.164+0000 7fd626d9d700 1 -- 172.21.15.82:0/2792077583 learned_addr learned my addr 172.21.15.82:0/2792077583 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.164+0000 7fd626d9d700 1 -- 172.21.15.82:0/2792077583 >> v2:172.21.15.114:3300/0 conn(0x7fd628070070 msgr2=0x7fd628070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.164+0000 7fd62659c700 1 --2- 172.21.15.82:0/2792077583 >> v2:172.21.15.114:3300/0 conn(0x7fd628070070 0x7fd628070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.164+0000 7fd626d9d700 1 --2- 172.21.15.82:0/2792077583 >> v2:172.21.15.114:3300/0 conn(0x7fd628070070 0x7fd628070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.164+0000 7fd62559a700 1 -- 172.21.15.82:0/2792077583 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882153533 0 0) 0x7fd628070980 con 0x7fd628160900 2023-11-28T13:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.164+0000 7fd626d9d700 1 -- 172.21.15.82:0/2792077583 >> v1:172.21.15.82:6789/0 conn(0x7fd628160900 legacy=0x7fd6280cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.164+0000 7fd626d9d700 1 -- 172.21.15.82:0/2792077583 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62806a5d0 con 0x7fd6280c1910 2023-11-28T13:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.164+0000 7fd62659c700 1 --2- 172.21.15.82:0/2792077583 >> v2:172.21.15.114:3300/0 conn(0x7fd628070070 0x7fd628070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.164+0000 7fd626d9d700 1 --2- 172.21.15.82:0/2792077583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280c1910 0x7fd62806c070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd62806bf40 tx=0x7fd62000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1140fd013e413a49 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.164+0000 7fd62559a700 1 -- 172.21.15.82:0/2792077583 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62000e070 con 0x7fd6280c1910 2023-11-28T13:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.164+0000 7fd62559a700 1 -- 172.21.15.82:0/2792077583 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62000b9c0 con 0x7fd6280c1910 2023-11-28T13:00:38.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.164+0000 7fd62559a700 1 -- 172.21.15.82:0/2792077583 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62000bd70 con 0x7fd6280c1910 2023-11-28T13:00:38.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.168+0000 7fd62759e700 1 -- 172.21.15.82:0/2792077583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280c1910 msgr2=0x7fd62806c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.168+0000 7fd62759e700 1 --2- 172.21.15.82:0/2792077583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280c1910 0x7fd62806c070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd62806bf40 tx=0x7fd62000b330 comp rx=0 tx=0).stop 2023-11-28T13:00:38.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.168+0000 7fd62759e700 1 -- 172.21.15.82:0/2792077583 shutdown_connections 2023-11-28T13:00:38.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.168+0000 7fd62759e700 1 --2- 172.21.15.82:0/2792077583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280c1910 0x7fd62806c070 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.168+0000 7fd62759e700 1 --2- 172.21.15.82:0/2792077583 >> v2:172.21.15.114:3300/0 conn(0x7fd628070070 0x7fd628070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.168+0000 7fd62759e700 1 -- 172.21.15.82:0/2792077583 >> 172.21.15.82:0/2792077583 conn(0x7fd6280ce600 msgr2=0x7fd6280ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:38.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.168+0000 7fd62759e700 1 -- 172.21.15.82:0/2792077583 shutdown_connections 2023-11-28T13:00:38.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.168+0000 7fd62759e700 1 -- 172.21.15.82:0/2792077583 wait complete. 2023-11-28T13:00:38.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.168+0000 7fd62759e700 1 Processor -- start 2023-11-28T13:00:38.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.168+0000 7fd62759e700 1 -- start start 2023-11-28T13:00:38.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd62759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd628070070 0x7fd62815cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:38.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd62759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6280c8620 0x7fd628163320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:38.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd62759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd628161460 0x7fd6281618d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:38.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd62759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd628162ad0 con 0x7fd628070070 2023-11-28T13:00:38.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd62759e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62815d1c0 con 0x7fd628161460 2023-11-28T13:00:38.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd62759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd628161e10 con 0x7fd6280c8620 2023-11-28T13:00:38.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd62659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd628070070 0x7fd62815cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:38.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd62659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd628070070 0x7fd62815cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50846/0 (socket says 172.21.15.82:50846) 2023-11-28T13:00:38.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd62659c700 1 -- 172.21.15.82:0/1302576553 learned_addr learned my addr 172.21.15.82:0/1302576553 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:38.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd625d9b700 1 --2- 172.21.15.82:0/1302576553 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6280c8620 0x7fd628163320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:38.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd626d9d700 1 --2- 172.21.15.82:0/1302576553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd628161460 0x7fd6281618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:38.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd62659c700 1 -- 172.21.15.82:0/1302576553 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6280c8620 msgr2=0x7fd628163320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd62659c700 1 --2- 172.21.15.82:0/1302576553 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6280c8620 0x7fd628163320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd62659c700 1 -- 172.21.15.82:0/1302576553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd628161460 msgr2=0x7fd6281618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd62659c700 1 --2- 172.21.15.82:0/1302576553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd628161460 0x7fd6281618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd62659c700 1 -- 172.21.15.82:0/1302576553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd620009b30 con 0x7fd628070070 2023-11-28T13:00:38.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd62659c700 1 --2- 172.21.15.82:0/1302576553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd628070070 0x7fd62815cc80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd61800c7c0 tx=0x7fd61800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:38.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd616ffd700 1 -- 172.21.15.82:0/1302576553 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd618011800 con 0x7fd628070070 2023-11-28T13:00:38.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd616ffd700 1 -- 172.21.15.82:0/1302576553 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd618011960 con 0x7fd628070070 2023-11-28T13:00:38.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd62759e700 1 -- 172.21.15.82:0/1302576553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62806ab90 con 0x7fd628070070 2023-11-28T13:00:38.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd616ffd700 1 -- 172.21.15.82:0/1302576553 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd618011cf0 con 0x7fd628070070 2023-11-28T13:00:38.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.172+0000 7fd62759e700 1 -- 172.21.15.82:0/1302576553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62806a8b0 con 0x7fd628070070 2023-11-28T13:00:38.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.176+0000 7fd62759e700 1 -- 172.21.15.82:0/1302576553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6280cdc50 con 0x7fd628070070 2023-11-28T13:00:38.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.176+0000 7fd616ffd700 1 -- 172.21.15.82:0/1302576553 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd618020070 con 0x7fd628070070 2023-11-28T13:00:38.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.176+0000 7fd616ffd700 1 --2- 172.21.15.82:0/1302576553 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd608064f10 0x7fd6080673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:38.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.176+0000 7fd616ffd700 1 -- 172.21.15.82:0/1302576553 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd618081f60 con 0x7fd628070070 2023-11-28T13:00:38.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.176+0000 7fd625d9b700 1 --2- 172.21.15.82:0/1302576553 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd608064f10 0x7fd6080673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:38.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.176+0000 7fd625d9b700 1 --2- 172.21.15.82:0/1302576553 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd608064f10 0x7fd6080673c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd61c007fd0 tx=0x7fd61c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:38.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.184+0000 7fd616ffd700 1 -- 172.21.15.82:0/1302576553 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd618050080 con 0x7fd628070070 2023-11-28T13:00:38.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.328+0000 7fd62759e700 1 -- 172.21.15.82:0/1302576553 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd628065fc0 con 0x7fd608064f10 2023-11-28T13:00:38.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.332+0000 7fd616ffd700 1 -- 172.21.15.82:0/1302576553 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286555 (secure 0 0 0) 0x7fd628065fc0 con 0x7fd608064f10 2023-11-28T13:00:38.342 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.340+0000 7fd62759e700 1 -- 172.21.15.82:0/1302576553 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd608064f10 msgr2=0x7fd6080673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.340+0000 7fd62759e700 1 --2- 172.21.15.82:0/1302576553 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd608064f10 0x7fd6080673c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd61c007fd0 tx=0x7fd61c009040 comp rx=0 tx=0).stop 2023-11-28T13:00:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.340+0000 7fd62759e700 1 -- 172.21.15.82:0/1302576553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd628070070 msgr2=0x7fd62815cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.340+0000 7fd62759e700 1 --2- 172.21.15.82:0/1302576553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd628070070 0x7fd62815cc80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd61800c7c0 tx=0x7fd61800cad0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.340+0000 7fd62759e700 1 -- 172.21.15.82:0/1302576553 shutdown_connections 2023-11-28T13:00:38.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.340+0000 7fd62759e700 1 --2- 172.21.15.82:0/1302576553 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd608064f10 0x7fd6080673c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.340+0000 7fd62759e700 1 --2- 172.21.15.82:0/1302576553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd628161460 0x7fd6281618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.340+0000 7fd62759e700 1 --2- 172.21.15.82:0/1302576553 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6280c8620 0x7fd628163320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.340+0000 7fd62759e700 1 --2- 172.21.15.82:0/1302576553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd628070070 0x7fd62815cc80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.340+0000 7fd62759e700 1 -- 172.21.15.82:0/1302576553 >> 172.21.15.82:0/1302576553 conn(0x7fd6280ce600 msgr2=0x7fd6280cc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:38.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.340+0000 7fd62759e700 1 -- 172.21.15.82:0/1302576553 shutdown_connections 2023-11-28T13:00:38.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.340+0000 7fd62759e700 1 -- 172.21.15.82:0/1302576553 wait complete. 2023-11-28T13:00:38.345 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:00:38.356 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-11-28T13:00:37.159172+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66440,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":63168,"kb_avail":754908280,"statfs":{"total":773094113280,"available":773026078720,"internally_reserved":0,"allocated":3284992,"data_stored":1939556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64684032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.174113"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.987630+0000","last_change":"2023-11-28T13:00:26.016426+0000","last_active":"2023-11-28T13:00:26.987630+0000","last_peered":"2023-11-28T13:00:26.987630+0000","last_clean":"2023-11-28T13:00:26.987630+0000","last_became_active":"2023-11-28T13:00:26.016109+0000","last_became_peered":"2023-11-28T13:00:26.016109+0000","last_unstale":"2023-11-28T13:00:26.987630+0000","last_undegraded":"2023-11-28T13:00:26.987630+0000","last_fullsized":"2023-11-28T13:00:26.987630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:16.748872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229500+0000","last_change":"2023-11-28T13:00:26.000097+0000","last_active":"2023-11-28T13:00:27.229500+0000","last_peered":"2023-11-28T13:00:27.229500+0000","last_clean":"2023-11-28T13:00:27.229500+0000","last_became_active":"2023-11-28T13:00:25.999819+0000","last_became_peered":"2023-11-28T13:00:25.999819+0000","last_unstale":"2023-11-28T13:00:27.229500+0000","last_undegraded":"2023-11-28T13:00:27.229500+0000","last_fullsized":"2023-11-28T13:00:27.229500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:12:32.057680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503805+0000","last_change":"2023-11-28T13:00:26.005315+0000","last_active":"2023-11-28T13:00:27.503805+0000","last_peered":"2023-11-28T13:00:27.503805+0000","last_clean":"2023-11-28T13:00:27.503805+0000","last_became_active":"2023-11-28T13:00:26.005022+0000","last_became_peered":"2023-11-28T13:00:26.005022+0000","last_unstale":"2023-11-28T13:00:27.503805+0000","last_undegraded":"2023-11-28T13:00:27.503805+0000","last_fullsized":"2023-11-28T13:00:27.503805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:21.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.993695+0000","last_change":"2023-11-28T13:00:26.009786+0000","last_active":"2023-11-28T13:00:26.993695+0000","last_peered":"2023-11-28T13:00:26.993695+0000","last_clean":"2023-11-28T13:00:26.993695+0000","last_became_active":"2023-11-28T13:00:26.008695+0000","last_became_peered":"2023-11-28T13:00:26.008695+0000","last_unstale":"2023-11-28T13:00:26.993695+0000","last_undegraded":"2023-11-28T13:00:26.993695+0000","last_fullsized":"2023-11-28T13:00:26.993695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:10.041488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503641+0000","last_change":"2023-11-28T13:00:26.016418+0000","last_active":"2023-11-28T13:00:27.503641+0000","last_peered":"2023-11-28T13:00:27.503641+0000","last_clean":"2023-11-28T13:00:27.503641+0000","last_became_active":"2023-11-28T13:00:26.016147+0000","last_became_peered":"2023-11-28T13:00:26.016147+0000","last_unstale":"2023-11-28T13:00:27.503641+0000","last_undegraded":"2023-11-28T13:00:27.503641+0000","last_fullsized":"2023-11-28T13:00:27.503641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502901+0000","last_change":"2023-11-28T13:00:26.006186+0000","last_active":"2023-11-28T13:00:27.502901+0000","last_peered":"2023-11-28T13:00:27.502901+0000","last_clean":"2023-11-28T13:00:27.502901+0000","last_became_active":"2023-11-28T13:00:26.005834+0000","last_became_peered":"2023-11-28T13:00:26.005834+0000","last_unstale":"2023-11-28T13:00:27.502901+0000","last_undegraded":"2023-11-28T13:00:27.502901+0000","last_fullsized":"2023-11-28T13:00:27.502901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:58.267291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991447+0000","last_change":"2023-11-28T13:00:26.012909+0000","last_active":"2023-11-28T13:00:26.991447+0000","last_peered":"2023-11-28T13:00:26.991447+0000","last_clean":"2023-11-28T13:00:26.991447+0000","last_became_active":"2023-11-28T13:00:26.012340+0000","last_became_peered":"2023-11-28T13:00:26.012340+0000","last_unstale":"2023-11-28T13:00:26.991447+0000","last_undegraded":"2023-11-28T13:00:26.991447+0000","last_fullsized":"2023-11-28T13:00:26.991447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.228880+0000","last_change":"2023-11-28T13:00:26.011119+0000","last_active":"2023-11-28T13:00:27.228880+0000","last_peered":"2023-11-28T13:00:27.228880+0000","last_clean":"2023-11-28T13:00:27.228880+0000","last_became_active":"2023-11-28T13:00:26.010841+0000","last_became_peered":"2023-11-28T13:00:26.010841+0000","last_unstale":"2023-11-28T13:00:27.228880+0000","last_undegraded":"2023-11-28T13:00:27.228880+0000","last_fullsized":"2023-11-28T13:00:27.228880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:39.083550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503676+0000","last_change":"2023-11-28T13:00:26.016674+0000","last_active":"2023-11-28T13:00:27.503676+0000","last_peered":"2023-11-28T13:00:27.503676+0000","last_clean":"2023-11-28T13:00:27.503676+0000","last_became_active":"2023-11-28T13:00:26.016188+0000","last_became_peered":"2023-11-28T13:00:26.016188+0000","last_unstale":"2023-11-28T13:00:27.503676+0000","last_undegraded":"2023-11-28T13:00:27.503676+0000","last_fullsized":"2023-11-28T13:00:27.503676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229491+0000","last_change":"2023-11-28T13:00:26.002162+0000","last_active":"2023-11-28T13:00:27.229491+0000","last_peered":"2023-11-28T13:00:27.229491+0000","last_clean":"2023-11-28T13:00:27.229491+0000","last_became_active":"2023-11-28T13:00:26.001726+0000","last_became_peered":"2023-11-28T13:00:26.001726+0000","last_unstale":"2023-11-28T13:00:27.229491+0000","last_undegraded":"2023-11-28T13:00:27.229491+0000","last_fullsized":"2023-11-28T13:00:27.229491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503832+0000","last_change":"2023-11-28T13:00:26.005292+0000","last_active":"2023-11-28T13:00:27.503832+0000","last_peered":"2023-11-28T13:00:27.503832+0000","last_clean":"2023-11-28T13:00:27.503832+0000","last_became_active":"2023-11-28T13:00:26.004797+0000","last_became_peered":"2023-11-28T13:00:26.004797+0000","last_unstale":"2023-11-28T13:00:27.503832+0000","last_undegraded":"2023-11-28T13:00:27.503832+0000","last_fullsized":"2023-11-28T13:00:27.503832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:27:02.277619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.987674+0000","last_change":"2023-11-28T13:00:26.007946+0000","last_active":"2023-11-28T13:00:26.987674+0000","last_peered":"2023-11-28T13:00:26.987674+0000","last_clean":"2023-11-28T13:00:26.987674+0000","last_became_active":"2023-11-28T13:00:26.007680+0000","last_became_peered":"2023-11-28T13:00:26.007680+0000","last_unstale":"2023-11-28T13:00:26.987674+0000","last_undegraded":"2023-11-28T13:00:26.987674+0000","last_fullsized":"2023-11-28T13:00:26.987674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:56:22.863111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.987252+0000","last_change":"2023-11-28T13:00:26.016340+0000","last_active":"2023-11-28T13:00:26.987252+0000","last_peered":"2023-11-28T13:00:26.987252+0000","last_clean":"2023-11-28T13:00:26.987252+0000","last_became_active":"2023-11-28T13:00:26.016050+0000","last_became_peered":"2023-11-28T13:00:26.016050+0000","last_unstale":"2023-11-28T13:00:26.987252+0000","last_undegraded":"2023-11-28T13:00:26.987252+0000","last_fullsized":"2023-11-28T13:00:26.987252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:06:48.016881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229021+0000","last_change":"2023-11-28T13:00:26.002242+0000","last_active":"2023-11-28T13:00:27.229021+0000","last_peered":"2023-11-28T13:00:27.229021+0000","last_clean":"2023-11-28T13:00:27.229021+0000","last_became_active":"2023-11-28T13:00:26.001119+0000","last_became_peered":"2023-11-28T13:00:26.001119+0000","last_unstale":"2023-11-28T13:00:27.229021+0000","last_undegraded":"2023-11-28T13:00:27.229021+0000","last_fullsized":"2023-11-28T13:00:27.229021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:21.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991681+0000","last_change":"2023-11-28T13:00:26.013151+0000","last_active":"2023-11-28T13:00:26.991681+0000","last_peered":"2023-11-28T13:00:26.991681+0000","last_clean":"2023-11-28T13:00:26.991681+0000","last_became_active":"2023-11-28T13:00:26.012729+0000","last_became_peered":"2023-11-28T13:00:26.012729+0000","last_unstale":"2023-11-28T13:00:26.991681+0000","last_undegraded":"2023-11-28T13:00:26.991681+0000","last_fullsized":"2023-11-28T13:00:26.991681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502676+0000","last_change":"2023-11-28T13:00:26.006151+0000","last_active":"2023-11-28T13:00:27.502676+0000","last_peered":"2023-11-28T13:00:27.502676+0000","last_clean":"2023-11-28T13:00:27.502676+0000","last_became_active":"2023-11-28T13:00:26.005850+0000","last_became_peered":"2023-11-28T13:00:26.005850+0000","last_unstale":"2023-11-28T13:00:27.502676+0000","last_undegraded":"2023-11-28T13:00:27.502676+0000","last_fullsized":"2023-11-28T13:00:27.502676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:18:46.140210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503909+0000","last_change":"2023-11-28T13:00:26.016811+0000","last_active":"2023-11-28T13:00:27.503909+0000","last_peered":"2023-11-28T13:00:27.503909+0000","last_clean":"2023-11-28T13:00:27.503909+0000","last_became_active":"2023-11-28T13:00:26.016486+0000","last_became_peered":"2023-11-28T13:00:26.016486+0000","last_unstale":"2023-11-28T13:00:27.503909+0000","last_undegraded":"2023-11-28T13:00:27.503909+0000","last_fullsized":"2023-11-28T13:00:27.503909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:47.321386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503787+0000","last_change":"2023-11-28T13:00:26.004579+0000","last_active":"2023-11-28T13:00:27.503787+0000","last_peered":"2023-11-28T13:00:27.503787+0000","last_clean":"2023-11-28T13:00:27.503787+0000","last_became_active":"2023-11-28T13:00:26.004222+0000","last_became_peered":"2023-11-28T13:00:26.004222+0000","last_unstale":"2023-11-28T13:00:27.503787+0000","last_undegraded":"2023-11-28T13:00:27.503787+0000","last_fullsized":"2023-11-28T13:00:27.503787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.987435+0000","last_change":"2023-11-28T13:00:26.009984+0000","last_active":"2023-11-28T13:00:26.987435+0000","last_peered":"2023-11-28T13:00:26.987435+0000","last_clean":"2023-11-28T13:00:26.987435+0000","last_became_active":"2023-11-28T13:00:26.009719+0000","last_became_peered":"2023-11-28T13:00:26.009719+0000","last_unstale":"2023-11-28T13:00:26.987435+0000","last_undegraded":"2023-11-28T13:00:26.987435+0000","last_fullsized":"2023-11-28T13:00:26.987435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:32:20.224728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503408+0000","last_change":"2023-11-28T13:00:26.015275+0000","last_active":"2023-11-28T13:00:27.503408+0000","last_peered":"2023-11-28T13:00:27.503408+0000","last_clean":"2023-11-28T13:00:27.503408+0000","last_became_active":"2023-11-28T13:00:26.014423+0000","last_became_peered":"2023-11-28T13:00:26.014423+0000","last_unstale":"2023-11-28T13:00:27.503408+0000","last_undegraded":"2023-11-28T13:00:27.503408+0000","last_fullsized":"2023-11-28T13:00:27.503408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:18:51.214695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991515+0000","last_change":"2023-11-28T13:00:26.015493+0000","last_active":"2023-11-28T13:00:26.991515+0000","last_peered":"2023-11-28T13:00:26.991515+0000","last_clean":"2023-11-28T13:00:26.991515+0000","last_became_active":"2023-11-28T13:00:26.015224+0000","last_became_peered":"2023-11-28T13:00:26.015224+0000","last_unstale":"2023-11-28T13:00:26.991515+0000","last_undegraded":"2023-11-28T13:00:26.991515+0000","last_fullsized":"2023-11-28T13:00:26.991515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:48.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503142+0000","last_change":"2023-11-28T13:00:26.004946+0000","last_active":"2023-11-28T13:00:27.503142+0000","last_peered":"2023-11-28T13:00:27.503142+0000","last_clean":"2023-11-28T13:00:27.503142+0000","last_became_active":"2023-11-28T13:00:26.004689+0000","last_became_peered":"2023-11-28T13:00:26.004689+0000","last_unstale":"2023-11-28T13:00:27.503142+0000","last_undegraded":"2023-11-28T13:00:27.503142+0000","last_fullsized":"2023-11-28T13:00:27.503142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:12:32.057680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402655+0000","last_change":"2023-11-28T13:00:26.003184+0000","last_active":"2023-11-28T13:00:27.402655+0000","last_peered":"2023-11-28T13:00:27.402655+0000","last_clean":"2023-11-28T13:00:27.402655+0000","last_became_active":"2023-11-28T13:00:25.997059+0000","last_became_peered":"2023-11-28T13:00:25.997059+0000","last_unstale":"2023-11-28T13:00:27.402655+0000","last_undegraded":"2023-11-28T13:00:27.402655+0000","last_fullsized":"2023-11-28T13:00:27.402655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991146+0000","last_change":"2023-11-28T13:00:26.015820+0000","last_active":"2023-11-28T13:00:26.991146+0000","last_peered":"2023-11-28T13:00:26.991146+0000","last_clean":"2023-11-28T13:00:26.991146+0000","last_became_active":"2023-11-28T13:00:26.015570+0000","last_became_peered":"2023-11-28T13:00:26.015570+0000","last_unstale":"2023-11-28T13:00:26.991146+0000","last_undegraded":"2023-11-28T13:00:26.991146+0000","last_fullsized":"2023-11-28T13:00:26.991146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:12:32.057680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505383+0000","last_change":"2023-11-28T13:00:26.010807+0000","last_active":"2023-11-28T13:00:27.505383+0000","last_peered":"2023-11-28T13:00:27.505383+0000","last_clean":"2023-11-28T13:00:27.505383+0000","last_became_active":"2023-11-28T13:00:26.010530+0000","last_became_peered":"2023-11-28T13:00:26.010530+0000","last_unstale":"2023-11-28T13:00:27.505383+0000","last_undegraded":"2023-11-28T13:00:27.505383+0000","last_fullsized":"2023-11-28T13:00:27.505383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:39.083550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505576+0000","last_change":"2023-11-28T13:00:26.002933+0000","last_active":"2023-11-28T13:00:27.505576+0000","last_peered":"2023-11-28T13:00:27.505576+0000","last_clean":"2023-11-28T13:00:27.505576+0000","last_became_active":"2023-11-28T13:00:26.002663+0000","last_became_peered":"2023-11-28T13:00:26.002663+0000","last_unstale":"2023-11-28T13:00:27.505576+0000","last_undegraded":"2023-11-28T13:00:27.505576+0000","last_fullsized":"2023-11-28T13:00:27.505576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:47.321386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229310+0000","last_change":"2023-11-28T13:00:26.012470+0000","last_active":"2023-11-28T13:00:27.229310+0000","last_peered":"2023-11-28T13:00:27.229310+0000","last_clean":"2023-11-28T13:00:27.229310+0000","last_became_active":"2023-11-28T13:00:26.012130+0000","last_became_peered":"2023-11-28T13:00:26.012130+0000","last_unstale":"2023-11-28T13:00:27.229310+0000","last_undegraded":"2023-11-28T13:00:27.229310+0000","last_fullsized":"2023-11-28T13:00:27.229310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:48.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504421+0000","last_change":"2023-11-28T13:00:26.014609+0000","last_active":"2023-11-28T13:00:27.504421+0000","last_peered":"2023-11-28T13:00:27.504421+0000","last_clean":"2023-11-28T13:00:27.504421+0000","last_became_active":"2023-11-28T13:00:26.014274+0000","last_became_peered":"2023-11-28T13:00:26.014274+0000","last_unstale":"2023-11-28T13:00:27.504421+0000","last_undegraded":"2023-11-28T13:00:27.504421+0000","last_fullsized":"2023-11-28T13:00:27.504421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:50.093176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403447+0000","last_change":"2023-11-28T13:00:26.015284+0000","last_active":"2023-11-28T13:00:27.403447+0000","last_peered":"2023-11-28T13:00:27.403447+0000","last_clean":"2023-11-28T13:00:27.403447+0000","last_became_active":"2023-11-28T13:00:26.015015+0000","last_became_peered":"2023-11-28T13:00:26.015015+0000","last_unstale":"2023-11-28T13:00:27.403447+0000","last_undegraded":"2023-11-28T13:00:27.403447+0000","last_fullsized":"2023-11-28T13:00:27.403447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:21.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503148+0000","last_change":"2023-11-28T13:00:26.016028+0000","last_active":"2023-11-28T13:00:27.503148+0000","last_peered":"2023-11-28T13:00:27.503148+0000","last_clean":"2023-11-28T13:00:27.503148+0000","last_became_active":"2023-11-28T13:00:26.014453+0000","last_became_peered":"2023-11-28T13:00:26.014453+0000","last_unstale":"2023-11-28T13:00:27.503148+0000","last_undegraded":"2023-11-28T13:00:27.503148+0000","last_fullsized":"2023-11-28T13:00:27.503148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402712+0000","last_change":"2023-11-28T13:00:26.010119+0000","last_active":"2023-11-28T13:00:27.402712+0000","last_peered":"2023-11-28T13:00:27.402712+0000","last_clean":"2023-11-28T13:00:27.402712+0000","last_became_active":"2023-11-28T13:00:26.006633+0000","last_became_peered":"2023-11-28T13:00:26.006633+0000","last_unstale":"2023-11-28T13:00:27.402712+0000","last_undegraded":"2023-11-28T13:00:27.402712+0000","last_fullsized":"2023-11-28T13:00:27.402712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:50.521471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992755+0000","last_change":"2023-11-28T13:00:26.009650+0000","last_active":"2023-11-28T13:00:26.992755+0000","last_peered":"2023-11-28T13:00:26.992755+0000","last_clean":"2023-11-28T13:00:26.992755+0000","last_became_active":"2023-11-28T13:00:26.008418+0000","last_became_peered":"2023-11-28T13:00:26.008418+0000","last_unstale":"2023-11-28T13:00:26.992755+0000","last_undegraded":"2023-11-28T13:00:26.992755+0000","last_fullsized":"2023-11-28T13:00:26.992755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:45:08.692115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403371+0000","last_change":"2023-11-28T13:00:26.006501+0000","last_active":"2023-11-28T13:00:27.403371+0000","last_peered":"2023-11-28T13:00:27.403371+0000","last_clean":"2023-11-28T13:00:27.403371+0000","last_became_active":"2023-11-28T13:00:26.005960+0000","last_became_peered":"2023-11-28T13:00:26.005960+0000","last_unstale":"2023-11-28T13:00:27.403371+0000","last_undegraded":"2023-11-28T13:00:27.403371+0000","last_fullsized":"2023-11-28T13:00:27.403371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:59.727409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991606+0000","last_change":"2023-11-28T13:00:25.625750+0000","last_active":"2023-11-28T13:00:26.991606+0000","last_peered":"2023-11-28T13:00:26.991606+0000","last_clean":"2023-11-28T13:00:26.991606+0000","last_became_active":"2023-11-28T13:00:25.625184+0000","last_became_peered":"2023-11-28T13:00:25.625184+0000","last_unstale":"2023-11-28T13:00:26.991606+0000","last_undegraded":"2023-11-28T13:00:26.991606+0000","last_fullsized":"2023-11-28T13:00:26.991606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:45:07.677424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229505+0000","last_change":"2023-11-28T13:00:26.006359+0000","last_active":"2023-11-28T13:00:27.229505+0000","last_peered":"2023-11-28T13:00:27.229505+0000","last_clean":"2023-11-28T13:00:27.229505+0000","last_became_active":"2023-11-28T13:00:26.006083+0000","last_became_peered":"2023-11-28T13:00:26.006083+0000","last_unstale":"2023-11-28T13:00:27.229505+0000","last_undegraded":"2023-11-28T13:00:27.229505+0000","last_fullsized":"2023-11-28T13:00:27.229505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503356+0000","last_change":"2023-11-28T13:00:25.623980+0000","last_active":"2023-11-28T13:00:27.503356+0000","last_peered":"2023-11-28T13:00:27.503356+0000","last_clean":"2023-11-28T13:00:27.503356+0000","last_became_active":"2023-11-28T13:00:25.623650+0000","last_became_peered":"2023-11-28T13:00:25.623650+0000","last_unstale":"2023-11-28T13:00:27.503356+0000","last_undegraded":"2023-11-28T13:00:27.503356+0000","last_fullsized":"2023-11-28T13:00:27.503356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:03.287202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504291+0000","last_change":"2023-11-28T13:00:26.015774+0000","last_active":"2023-11-28T13:00:27.504291+0000","last_peered":"2023-11-28T13:00:27.504291+0000","last_clean":"2023-11-28T13:00:27.504291+0000","last_became_active":"2023-11-28T13:00:26.015516+0000","last_became_peered":"2023-11-28T13:00:26.015516+0000","last_unstale":"2023-11-28T13:00:27.504291+0000","last_undegraded":"2023-11-28T13:00:27.504291+0000","last_fullsized":"2023-11-28T13:00:27.504291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:10.041488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991867+0000","last_change":"2023-11-28T13:00:25.628452+0000","last_active":"2023-11-28T13:00:26.991867+0000","last_peered":"2023-11-28T13:00:26.991867+0000","last_clean":"2023-11-28T13:00:26.991867+0000","last_became_active":"2023-11-28T13:00:25.628113+0000","last_became_peered":"2023-11-28T13:00:25.628113+0000","last_unstale":"2023-11-28T13:00:26.991867+0000","last_undegraded":"2023-11-28T13:00:26.991867+0000","last_fullsized":"2023-11-28T13:00:26.991867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:34:17.734156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403850+0000","last_change":"2023-11-28T13:00:26.004164+0000","last_active":"2023-11-28T13:00:27.403850+0000","last_peered":"2023-11-28T13:00:27.403850+0000","last_clean":"2023-11-28T13:00:27.403850+0000","last_became_active":"2023-11-28T13:00:26.003908+0000","last_became_peered":"2023-11-28T13:00:26.003908+0000","last_unstale":"2023-11-28T13:00:27.403850+0000","last_undegraded":"2023-11-28T13:00:27.403850+0000","last_fullsized":"2023-11-28T13:00:27.403850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:48.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992957+0000","last_change":"2023-11-28T13:00:25.623824+0000","last_active":"2023-11-28T13:00:26.992957+0000","last_peered":"2023-11-28T13:00:26.992957+0000","last_clean":"2023-11-28T13:00:26.992957+0000","last_became_active":"2023-11-28T13:00:25.623463+0000","last_became_peered":"2023-11-28T13:00:25.623463+0000","last_unstale":"2023-11-28T13:00:26.992957+0000","last_undegraded":"2023-11-28T13:00:26.992957+0000","last_fullsized":"2023-11-28T13:00:26.992957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:23.365345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992736+0000","last_change":"2023-11-28T13:00:25.626091+0000","last_active":"2023-11-28T13:00:26.992736+0000","last_peered":"2023-11-28T13:00:26.992736+0000","last_clean":"2023-11-28T13:00:26.992736+0000","last_became_active":"2023-11-28T13:00:25.625286+0000","last_became_peered":"2023-11-28T13:00:25.625286+0000","last_unstale":"2023-11-28T13:00:26.992736+0000","last_undegraded":"2023-11-28T13:00:26.992736+0000","last_fullsized":"2023-11-28T13:00:26.992736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:58.712719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.228893+0000","last_change":"2023-11-28T13:00:26.006094+0000","last_active":"2023-11-28T13:00:27.228893+0000","last_peered":"2023-11-28T13:00:27.228893+0000","last_clean":"2023-11-28T13:00:27.228893+0000","last_became_active":"2023-11-28T13:00:26.005812+0000","last_became_peered":"2023-11-28T13:00:26.005812+0000","last_unstale":"2023-11-28T13:00:27.228893+0000","last_undegraded":"2023-11-28T13:00:27.228893+0000","last_fullsized":"2023-11-28T13:00:27.228893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:50.093176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.993196+0000","last_change":"2023-11-28T13:00:25.628566+0000","last_active":"2023-11-28T13:00:26.993196+0000","last_peered":"2023-11-28T13:00:26.993196+0000","last_clean":"2023-11-28T13:00:26.993196+0000","last_became_active":"2023-11-28T13:00:25.628266+0000","last_became_peered":"2023-11-28T13:00:25.628266+0000","last_unstale":"2023-11-28T13:00:26.993196+0000","last_undegraded":"2023-11-28T13:00:26.993196+0000","last_fullsized":"2023-11-28T13:00:26.993196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:05.115882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502747+0000","last_change":"2023-11-28T13:00:26.006002+0000","last_active":"2023-11-28T13:00:27.502747+0000","last_peered":"2023-11-28T13:00:27.502747+0000","last_clean":"2023-11-28T13:00:27.502747+0000","last_became_active":"2023-11-28T13:00:26.005728+0000","last_became_peered":"2023-11-28T13:00:26.005728+0000","last_unstale":"2023-11-28T13:00:27.502747+0000","last_undegraded":"2023-11-28T13:00:27.502747+0000","last_fullsized":"2023-11-28T13:00:27.502747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:45:51.690938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992306+0000","last_change":"2023-11-28T13:00:25.627709+0000","last_active":"2023-11-28T13:00:26.992306+0000","last_peered":"2023-11-28T13:00:26.992306+0000","last_clean":"2023-11-28T13:00:26.992306+0000","last_became_active":"2023-11-28T13:00:25.627384+0000","last_became_peered":"2023-11-28T13:00:25.627384+0000","last_unstale":"2023-11-28T13:00:26.992306+0000","last_undegraded":"2023-11-28T13:00:26.992306+0000","last_fullsized":"2023-11-28T13:00:26.992306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:09.026798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992896+0000","last_change":"2023-11-28T13:00:26.008865+0000","last_active":"2023-11-28T13:00:26.992896+0000","last_peered":"2023-11-28T13:00:26.992896+0000","last_clean":"2023-11-28T13:00:26.992896+0000","last_became_active":"2023-11-28T13:00:26.008154+0000","last_became_peered":"2023-11-28T13:00:26.008154+0000","last_unstale":"2023-11-28T13:00:26.992896+0000","last_undegraded":"2023-11-28T13:00:26.992896+0000","last_fullsized":"2023-11-28T13:00:26.992896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:35:46.604719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229235+0000","last_change":"2023-11-28T13:00:25.630262+0000","last_active":"2023-11-28T13:00:27.229235+0000","last_peered":"2023-11-28T13:00:27.229235+0000","last_clean":"2023-11-28T13:00:27.229235+0000","last_became_active":"2023-11-28T13:00:25.629929+0000","last_became_peered":"2023-11-28T13:00:25.629929+0000","last_unstale":"2023-11-28T13:00:27.229235+0000","last_undegraded":"2023-11-28T13:00:27.229235+0000","last_fullsized":"2023-11-28T13:00:27.229235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:56:21.848420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503222+0000","last_change":"2023-11-28T13:00:26.002295+0000","last_active":"2023-11-28T13:00:27.503222+0000","last_peered":"2023-11-28T13:00:27.503222+0000","last_clean":"2023-11-28T13:00:27.503222+0000","last_became_active":"2023-11-28T13:00:26.002035+0000","last_became_peered":"2023-11-28T13:00:26.002035+0000","last_unstale":"2023-11-28T13:00:27.503222+0000","last_undegraded":"2023-11-28T13:00:27.503222+0000","last_fullsized":"2023-11-28T13:00:27.503222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:48.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403625+0000","last_change":"2023-11-28T13:00:25.631075+0000","last_active":"2023-11-28T13:00:27.403625+0000","last_peered":"2023-11-28T13:00:27.403625+0000","last_clean":"2023-11-28T13:00:27.403625+0000","last_became_active":"2023-11-28T13:00:25.630790+0000","last_became_peered":"2023-11-28T13:00:25.630790+0000","last_unstale":"2023-11-28T13:00:27.403625+0000","last_undegraded":"2023-11-28T13:00:27.403625+0000","last_fullsized":"2023-11-28T13:00:27.403625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:03.287202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503723+0000","last_change":"2023-11-28T13:00:26.015247+0000","last_active":"2023-11-28T13:00:27.503723+0000","last_peered":"2023-11-28T13:00:27.503723+0000","last_clean":"2023-11-28T13:00:27.503723+0000","last_became_active":"2023-11-28T13:00:26.014933+0000","last_became_peered":"2023-11-28T13:00:26.014933+0000","last_unstale":"2023-11-28T13:00:27.503723+0000","last_undegraded":"2023-11-28T13:00:27.503723+0000","last_fullsized":"2023-11-28T13:00:27.503723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:39:23.566274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.993202+0000","last_change":"2023-11-28T13:00:25.625442+0000","last_active":"2023-11-28T13:00:26.993202+0000","last_peered":"2023-11-28T13:00:26.993202+0000","last_clean":"2023-11-28T13:00:26.993202+0000","last_became_active":"2023-11-28T13:00:25.625167+0000","last_became_peered":"2023-11-28T13:00:25.625167+0000","last_unstale":"2023-11-28T13:00:26.993202+0000","last_undegraded":"2023-11-28T13:00:26.993202+0000","last_fullsized":"2023-11-28T13:00:26.993202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:57.620680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503939+0000","last_change":"2023-11-28T13:00:26.005117+0000","last_active":"2023-11-28T13:00:27.503939+0000","last_peered":"2023-11-28T13:00:27.503939+0000","last_clean":"2023-11-28T13:00:27.503939+0000","last_became_active":"2023-11-28T13:00:26.004706+0000","last_became_peered":"2023-11-28T13:00:26.004706+0000","last_unstale":"2023-11-28T13:00:27.503939+0000","last_undegraded":"2023-11-28T13:00:27.503939+0000","last_fullsized":"2023-11-28T13:00:27.503939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:12:32.057680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502983+0000","last_change":"2023-11-28T13:00:25.620940+0000","last_active":"2023-11-28T13:00:27.502983+0000","last_peered":"2023-11-28T13:00:27.502983+0000","last_clean":"2023-11-28T13:00:27.502983+0000","last_became_active":"2023-11-28T13:00:25.620569+0000","last_became_peered":"2023-11-28T13:00:25.620569+0000","last_unstale":"2023-11-28T13:00:27.502983+0000","last_undegraded":"2023-11-28T13:00:27.502983+0000","last_fullsized":"2023-11-28T13:00:27.502983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:52.456316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503912+0000","last_change":"2023-11-28T13:00:26.014474+0000","last_active":"2023-11-28T13:00:27.503912+0000","last_peered":"2023-11-28T13:00:27.503912+0000","last_clean":"2023-11-28T13:00:27.503912+0000","last_became_active":"2023-11-28T13:00:26.014153+0000","last_became_peered":"2023-11-28T13:00:26.014153+0000","last_unstale":"2023-11-28T13:00:27.503912+0000","last_undegraded":"2023-11-28T13:00:27.503912+0000","last_fullsized":"2023-11-28T13:00:27.503912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:48.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402906+0000","last_change":"2023-11-28T13:00:25.632474+0000","last_active":"2023-11-28T13:00:27.402906+0000","last_peered":"2023-11-28T13:00:27.402906+0000","last_clean":"2023-11-28T13:00:27.402906+0000","last_became_active":"2023-11-28T13:00:25.632080+0000","last_became_peered":"2023-11-28T13:00:25.632080+0000","last_unstale":"2023-11-28T13:00:27.402906+0000","last_undegraded":"2023-11-28T13:00:27.402906+0000","last_fullsized":"2023-11-28T13:00:27.402906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:56:21.848420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505385+0000","last_change":"2023-11-28T13:00:26.011716+0000","last_active":"2023-11-28T13:00:27.505385+0000","last_peered":"2023-11-28T13:00:27.505385+0000","last_clean":"2023-11-28T13:00:27.505385+0000","last_became_active":"2023-11-28T13:00:26.011453+0000","last_became_peered":"2023-11-28T13:00:26.011453+0000","last_unstale":"2023-11-28T13:00:27.505385+0000","last_undegraded":"2023-11-28T13:00:27.505385+0000","last_fullsized":"2023-11-28T13:00:27.505385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.995720+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:00:25.995720+0000","last_peered":"2023-11-28T13:00:25.995720+0000","last_clean":"2023-11-28T13:00:25.995720+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:00:25.995720+0000","last_undegraded":"2023-11-28T13:00:25.995720+0000","last_fullsized":"2023-11-28T13:00:25.995720+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.990032+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:00:25.990032+0000","last_peered":"2023-11-28T13:00:25.990032+0000","last_clean":"2023-11-28T13:00:25.990032+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:00:25.990032+0000","last_undegraded":"2023-11-28T13:00:25.990032+0000","last_fullsized":"2023-11-28T13:00:25.990032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403785+0000","last_change":"2023-11-28T13:00:25.627086+0000","last_active":"2023-11-28T13:00:27.403785+0000","last_peered":"2023-11-28T13:00:27.403785+0000","last_clean":"2023-11-28T13:00:27.403785+0000","last_became_active":"2023-11-28T13:00:25.626755+0000","last_became_peered":"2023-11-28T13:00:25.626755+0000","last_unstale":"2023-11-28T13:00:27.403785+0000","last_undegraded":"2023-11-28T13:00:27.403785+0000","last_fullsized":"2023-11-28T13:00:27.403785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:32:19.210037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.993350+0000","last_change":"2023-11-28T13:00:26.009618+0000","last_active":"2023-11-28T13:00:26.993350+0000","last_peered":"2023-11-28T13:00:26.993350+0000","last_clean":"2023-11-28T13:00:26.993350+0000","last_became_active":"2023-11-28T13:00:26.008633+0000","last_became_peered":"2023-11-28T13:00:26.008633+0000","last_unstale":"2023-11-28T13:00:26.993350+0000","last_undegraded":"2023-11-28T13:00:26.993350+0000","last_fullsized":"2023-11-28T13:00:26.993350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:21:39.677078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.995631+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:00:25.995631+0000","last_peered":"2023-11-28T13:00:25.995631+0000","last_clean":"2023-11-28T13:00:25.995631+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:00:25.995631+0000","last_undegraded":"2023-11-28T13:00:25.995631+0000","last_fullsized":"2023-11-28T13:00:25.995631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502951+0000","last_change":"2023-11-28T13:00:25.629873+0000","last_active":"2023-11-28T13:00:27.502951+0000","last_peered":"2023-11-28T13:00:27.502951+0000","last_clean":"2023-11-28T13:00:27.502951+0000","last_became_active":"2023-11-28T13:00:25.629457+0000","last_became_peered":"2023-11-28T13:00:25.629457+0000","last_unstale":"2023-11-28T13:00:27.502951+0000","last_undegraded":"2023-11-28T13:00:27.502951+0000","last_fullsized":"2023-11-28T13:00:27.502951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:52.456316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504069+0000","last_change":"2023-11-28T13:00:26.002978+0000","last_active":"2023-11-28T13:00:27.504069+0000","last_peered":"2023-11-28T13:00:27.504069+0000","last_clean":"2023-11-28T13:00:27.504069+0000","last_became_active":"2023-11-28T13:00:26.002741+0000","last_became_peered":"2023-11-28T13:00:26.002741+0000","last_unstale":"2023-11-28T13:00:27.504069+0000","last_undegraded":"2023-11-28T13:00:27.504069+0000","last_fullsized":"2023-11-28T13:00:27.504069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:21.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.997886+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:00:25.997886+0000","last_peered":"2023-11-28T13:00:25.997886+0000","last_clean":"2023-11-28T13:00:25.997886+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:00:25.997886+0000","last_undegraded":"2023-11-28T13:00:25.997886+0000","last_fullsized":"2023-11-28T13:00:25.997886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504850+0000","last_change":"2023-11-28T13:00:25.621539+0000","last_active":"2023-11-28T13:00:27.504850+0000","last_peered":"2023-11-28T13:00:27.504850+0000","last_clean":"2023-11-28T13:00:27.504850+0000","last_became_active":"2023-11-28T13:00:25.621220+0000","last_became_peered":"2023-11-28T13:00:25.621220+0000","last_unstale":"2023-11-28T13:00:27.504850+0000","last_undegraded":"2023-11-28T13:00:27.504850+0000","last_fullsized":"2023-11-28T13:00:27.504850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:03.287202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505586+0000","last_change":"2023-11-28T13:00:26.001811+0000","last_active":"2023-11-28T13:00:27.505586+0000","last_peered":"2023-11-28T13:00:27.505586+0000","last_clean":"2023-11-28T13:00:27.505586+0000","last_became_active":"2023-11-28T13:00:26.001553+0000","last_became_peered":"2023-11-28T13:00:26.001553+0000","last_unstale":"2023-11-28T13:00:27.505586+0000","last_undegraded":"2023-11-28T13:00:27.505586+0000","last_fullsized":"2023-11-28T13:00:27.505586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:06.130572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.990083+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:00:25.990083+0000","last_peered":"2023-11-28T13:00:25.990083+0000","last_clean":"2023-11-28T13:00:25.990083+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:00:25.990083+0000","last_undegraded":"2023-11-28T13:00:25.990083+0000","last_fullsized":"2023-11-28T13:00:25.990083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503523+0000","last_change":"2023-11-28T13:00:25.629807+0000","last_active":"2023-11-28T13:00:27.503523+0000","last_peered":"2023-11-28T13:00:27.503523+0000","last_clean":"2023-11-28T13:00:27.503523+0000","last_became_active":"2023-11-28T13:00:25.629543+0000","last_became_peered":"2023-11-28T13:00:25.629543+0000","last_unstale":"2023-11-28T13:00:27.503523+0000","last_undegraded":"2023-11-28T13:00:27.503523+0000","last_fullsized":"2023-11-28T13:00:27.503523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:23.365345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504188+0000","last_change":"2023-11-28T13:00:26.003695+0000","last_active":"2023-11-28T13:00:27.504188+0000","last_peered":"2023-11-28T13:00:27.504188+0000","last_clean":"2023-11-28T13:00:27.504188+0000","last_became_active":"2023-11-28T13:00:26.002498+0000","last_became_peered":"2023-11-28T13:00:26.002498+0000","last_unstale":"2023-11-28T13:00:27.504188+0000","last_undegraded":"2023-11-28T13:00:27.504188+0000","last_fullsized":"2023-11-28T13:00:27.504188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229716+0000","last_change":"2023-11-28T13:00:25.630163+0000","last_active":"2023-11-28T13:00:27.229716+0000","last_peered":"2023-11-28T13:00:27.229716+0000","last_clean":"2023-11-28T13:00:27.229716+0000","last_became_active":"2023-11-28T13:00:25.629892+0000","last_became_peered":"2023-11-28T13:00:25.629892+0000","last_unstale":"2023-11-28T13:00:27.229716+0000","last_undegraded":"2023-11-28T13:00:27.229716+0000","last_fullsized":"2023-11-28T13:00:27.229716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:34:17.734156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.992840+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:00:25.992840+0000","last_peered":"2023-11-28T13:00:25.992840+0000","last_clean":"2023-11-28T13:00:25.992840+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:00:25.992840+0000","last_undegraded":"2023-11-28T13:00:25.992840+0000","last_fullsized":"2023-11-28T13:00:25.992840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505455+0000","last_change":"2023-11-28T13:00:26.002290+0000","last_active":"2023-11-28T13:00:27.505455+0000","last_peered":"2023-11-28T13:00:27.505455+0000","last_clean":"2023-11-28T13:00:27.505455+0000","last_became_active":"2023-11-28T13:00:26.002028+0000","last_became_peered":"2023-11-28T13:00:26.002028+0000","last_unstale":"2023-11-28T13:00:27.505455+0000","last_undegraded":"2023-11-28T13:00:27.505455+0000","last_fullsized":"2023-11-28T13:00:27.505455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:54.006637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504302+0000","last_change":"2023-11-28T13:00:25.631032+0000","last_active":"2023-11-28T13:00:27.504302+0000","last_peered":"2023-11-28T13:00:27.504302+0000","last_clean":"2023-11-28T13:00:27.504302+0000","last_became_active":"2023-11-28T13:00:25.630748+0000","last_became_peered":"2023-11-28T13:00:25.630748+0000","last_unstale":"2023-11-28T13:00:27.504302+0000","last_undegraded":"2023-11-28T13:00:27.504302+0000","last_fullsized":"2023-11-28T13:00:27.504302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:52.456316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.997737+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:00:25.997737+0000","last_peered":"2023-11-28T13:00:25.997737+0000","last_clean":"2023-11-28T13:00:25.997737+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:00:25.997737+0000","last_undegraded":"2023-11-28T13:00:25.997737+0000","last_fullsized":"2023-11-28T13:00:25.997737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503588+0000","last_change":"2023-11-28T13:00:25.999551+0000","last_active":"2023-11-28T13:00:27.503588+0000","last_peered":"2023-11-28T13:00:27.503588+0000","last_clean":"2023-11-28T13:00:27.503588+0000","last_became_active":"2023-11-28T13:00:25.999290+0000","last_became_peered":"2023-11-28T13:00:25.999290+0000","last_unstale":"2023-11-28T13:00:27.503588+0000","last_undegraded":"2023-11-28T13:00:27.503588+0000","last_fullsized":"2023-11-28T13:00:27.503588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:21:39.677078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403966+0000","last_change":"2023-11-28T13:00:25.631577+0000","last_active":"2023-11-28T13:00:27.403966+0000","last_peered":"2023-11-28T13:00:27.403966+0000","last_clean":"2023-11-28T13:00:27.403966+0000","last_became_active":"2023-11-28T13:00:25.631270+0000","last_became_peered":"2023-11-28T13:00:25.631270+0000","last_unstale":"2023-11-28T13:00:27.403966+0000","last_undegraded":"2023-11-28T13:00:27.403966+0000","last_fullsized":"2023-11-28T13:00:27.403966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:34:17.734156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.993702+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:00:25.993702+0000","last_peered":"2023-11-28T13:00:25.993702+0000","last_clean":"2023-11-28T13:00:25.993702+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:00:25.993702+0000","last_undegraded":"2023-11-28T13:00:25.993702+0000","last_fullsized":"2023-11-28T13:00:25.993702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402698+0000","last_change":"2023-11-28T13:00:26.009259+0000","last_active":"2023-11-28T13:00:27.402698+0000","last_peered":"2023-11-28T13:00:27.402698+0000","last_clean":"2023-11-28T13:00:27.402698+0000","last_became_active":"2023-11-28T13:00:26.007917+0000","last_became_peered":"2023-11-28T13:00:26.007917+0000","last_unstale":"2023-11-28T13:00:27.402698+0000","last_undegraded":"2023-11-28T13:00:27.402698+0000","last_fullsized":"2023-11-28T13:00:27.402698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:29.185383+0000","last_change":"2023-11-28T13:00:25.633467+0000","last_active":"2023-11-28T13:00:29.185383+0000","last_peered":"2023-11-28T13:00:29.185383+0000","last_clean":"2023-11-28T13:00:29.185383+0000","last_became_active":"2023-11-28T13:00:25.633133+0000","last_became_peered":"2023-11-28T13:00:25.633133+0000","last_unstale":"2023-11-28T13:00:29.185383+0000","last_undegraded":"2023-11-28T13:00:29.185383+0000","last_fullsized":"2023-11-28T13:00:29.185383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:15.734182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.993588+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:00:25.993588+0000","last_peered":"2023-11-28T13:00:25.993588+0000","last_clean":"2023-11-28T13:00:25.993588+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:00:25.993588+0000","last_undegraded":"2023-11-28T13:00:25.993588+0000","last_fullsized":"2023-11-28T13:00:25.993588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502968+0000","last_change":"2023-11-28T13:00:26.007959+0000","last_active":"2023-11-28T13:00:27.502968+0000","last_peered":"2023-11-28T13:00:27.502968+0000","last_clean":"2023-11-28T13:00:27.502968+0000","last_became_active":"2023-11-28T13:00:26.006990+0000","last_became_peered":"2023-11-28T13:00:26.006990+0000","last_unstale":"2023-11-28T13:00:27.502968+0000","last_undegraded":"2023-11-28T13:00:27.502968+0000","last_fullsized":"2023-11-28T13:00:27.502968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:50.521471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503474+0000","last_change":"2023-11-28T13:00:26.014623+0000","last_active":"2023-11-28T13:00:27.503474+0000","last_peered":"2023-11-28T13:00:27.503474+0000","last_clean":"2023-11-28T13:00:27.503474+0000","last_became_active":"2023-11-28T13:00:26.014249+0000","last_became_peered":"2023-11-28T13:00:26.014249+0000","last_unstale":"2023-11-28T13:00:27.503474+0000","last_undegraded":"2023-11-28T13:00:27.503474+0000","last_fullsized":"2023-11-28T13:00:27.503474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:28:40.766436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503686+0000","last_change":"2023-11-28T13:00:25.617793+0000","last_active":"2023-11-28T13:00:27.503686+0000","last_peered":"2023-11-28T13:00:27.503686+0000","last_clean":"2023-11-28T13:00:27.503686+0000","last_became_active":"2023-11-28T13:00:25.616865+0000","last_became_peered":"2023-11-28T13:00:25.616865+0000","last_unstale":"2023-11-28T13:00:27.503686+0000","last_undegraded":"2023-11-28T13:00:27.503686+0000","last_fullsized":"2023-11-28T13:00:27.503686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:57.620680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505139+0000","last_change":"2023-11-28T13:00:26.011957+0000","last_active":"2023-11-28T13:00:27.505139+0000","last_peered":"2023-11-28T13:00:27.505139+0000","last_clean":"2023-11-28T13:00:27.505139+0000","last_became_active":"2023-11-28T13:00:26.011673+0000","last_became_peered":"2023-11-28T13:00:26.011673+0000","last_unstale":"2023-11-28T13:00:27.505139+0000","last_undegraded":"2023-11-28T13:00:27.505139+0000","last_fullsized":"2023-11-28T13:00:27.505139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:19.044875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992231+0000","last_change":"2023-11-28T13:00:25.630855+0000","last_active":"2023-11-28T13:00:26.992231+0000","last_peered":"2023-11-28T13:00:26.992231+0000","last_clean":"2023-11-28T13:00:26.992231+0000","last_became_active":"2023-11-28T13:00:25.630456+0000","last_became_peered":"2023-11-28T13:00:25.630456+0000","last_unstale":"2023-11-28T13:00:26.992231+0000","last_undegraded":"2023-11-28T13:00:26.992231+0000","last_fullsized":"2023-11-28T13:00:26.992231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:21:38.662388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229731+0000","last_change":"2023-11-28T13:00:25.624834+0000","last_active":"2023-11-28T13:00:27.229731+0000","last_peered":"2023-11-28T13:00:27.229731+0000","last_clean":"2023-11-28T13:00:27.229731+0000","last_became_active":"2023-11-28T13:00:25.624567+0000","last_became_peered":"2023-11-28T13:00:25.624567+0000","last_unstale":"2023-11-28T13:00:27.229731+0000","last_undegraded":"2023-11-28T13:00:27.229731+0000","last_fullsized":"2023-11-28T13:00:27.229731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:45:07.677424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402974+0000","last_change":"2023-11-28T13:00:26.010470+0000","last_active":"2023-11-28T13:00:27.402974+0000","last_peered":"2023-11-28T13:00:27.402974+0000","last_clean":"2023-11-28T13:00:27.402974+0000","last_became_active":"2023-11-28T13:00:26.009766+0000","last_became_peered":"2023-11-28T13:00:26.009766+0000","last_unstale":"2023-11-28T13:00:27.402974+0000","last_undegraded":"2023-11-28T13:00:27.402974+0000","last_fullsized":"2023-11-28T13:00:27.402974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:12:32.057680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504129+0000","last_change":"2023-11-28T13:00:25.629269+0000","last_active":"2023-11-28T13:00:27.504129+0000","last_peered":"2023-11-28T13:00:27.504129+0000","last_clean":"2023-11-28T13:00:27.504129+0000","last_became_active":"2023-11-28T13:00:25.628831+0000","last_became_peered":"2023-11-28T13:00:25.628831+0000","last_unstale":"2023-11-28T13:00:27.504129+0000","last_undegraded":"2023-11-28T13:00:27.504129+0000","last_fullsized":"2023-11-28T13:00:27.504129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:32:19.210037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402564+0000","last_change":"2023-11-28T13:00:26.015219+0000","last_active":"2023-11-28T13:00:27.402564+0000","last_peered":"2023-11-28T13:00:27.402564+0000","last_clean":"2023-11-28T13:00:27.402564+0000","last_became_active":"2023-11-28T13:00:26.014925+0000","last_became_peered":"2023-11-28T13:00:26.014925+0000","last_unstale":"2023-11-28T13:00:27.402564+0000","last_undegraded":"2023-11-28T13:00:27.402564+0000","last_fullsized":"2023-11-28T13:00:27.402564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:18:51.214695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.993563+0000","last_change":"2023-11-28T13:00:26.008486+0000","last_active":"2023-11-28T13:00:26.993563+0000","last_peered":"2023-11-28T13:00:26.993563+0000","last_clean":"2023-11-28T13:00:26.993563+0000","last_became_active":"2023-11-28T13:00:26.008210+0000","last_became_peered":"2023-11-28T13:00:26.008210+0000","last_unstale":"2023-11-28T13:00:26.993563+0000","last_undegraded":"2023-11-28T13:00:26.993563+0000","last_fullsized":"2023-11-28T13:00:26.993563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:53.611895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402778+0000","last_change":"2023-11-28T13:00:25.630302+0000","last_active":"2023-11-28T13:00:27.402778+0000","last_peered":"2023-11-28T13:00:27.402778+0000","last_clean":"2023-11-28T13:00:27.402778+0000","last_became_active":"2023-11-28T13:00:25.629349+0000","last_became_peered":"2023-11-28T13:00:25.629349+0000","last_unstale":"2023-11-28T13:00:27.402778+0000","last_undegraded":"2023-11-28T13:00:27.402778+0000","last_fullsized":"2023-11-28T13:00:27.402778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:15.734182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504240+0000","last_change":"2023-11-28T13:00:26.013956+0000","last_active":"2023-11-28T13:00:27.504240+0000","last_peered":"2023-11-28T13:00:27.504240+0000","last_clean":"2023-11-28T13:00:27.504240+0000","last_became_active":"2023-11-28T13:00:26.013605+0000","last_became_peered":"2023-11-28T13:00:26.013605+0000","last_unstale":"2023-11-28T13:00:27.504240+0000","last_undegraded":"2023-11-28T13:00:27.504240+0000","last_fullsized":"2023-11-28T13:00:27.504240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:54.006637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504825+0000","last_change":"2023-11-28T13:00:25.631060+0000","last_active":"2023-11-28T13:00:27.504825+0000","last_peered":"2023-11-28T13:00:27.504825+0000","last_clean":"2023-11-28T13:00:27.504825+0000","last_became_active":"2023-11-28T13:00:25.630788+0000","last_became_peered":"2023-11-28T13:00:25.630788+0000","last_unstale":"2023-11-28T13:00:27.504825+0000","last_undegraded":"2023-11-28T13:00:27.504825+0000","last_fullsized":"2023-11-28T13:00:27.504825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:32:19.210037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403416+0000","last_change":"2023-11-28T13:00:26.006323+0000","last_active":"2023-11-28T13:00:27.403416+0000","last_peered":"2023-11-28T13:00:27.403416+0000","last_clean":"2023-11-28T13:00:27.403416+0000","last_became_active":"2023-11-28T13:00:26.004227+0000","last_became_peered":"2023-11-28T13:00:26.004227+0000","last_unstale":"2023-11-28T13:00:27.403416+0000","last_undegraded":"2023-11-28T13:00:27.403416+0000","last_fullsized":"2023-11-28T13:00:27.403416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:28:40.766436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503349+0000","last_change":"2023-11-28T13:00:25.631107+0000","last_active":"2023-11-28T13:00:27.503349+0000","last_peered":"2023-11-28T13:00:27.503349+0000","last_clean":"2023-11-28T13:00:27.503349+0000","last_became_active":"2023-11-28T13:00:25.630796+0000","last_became_peered":"2023-11-28T13:00:25.630796+0000","last_unstale":"2023-11-28T13:00:27.503349+0000","last_undegraded":"2023-11-28T13:00:27.503349+0000","last_fullsized":"2023-11-28T13:00:27.503349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:00:19.501393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.987768+0000","last_change":"2023-11-28T13:00:26.003801+0000","last_active":"2023-11-28T13:00:26.987768+0000","last_peered":"2023-11-28T13:00:26.987768+0000","last_clean":"2023-11-28T13:00:26.987768+0000","last_became_active":"2023-11-28T13:00:26.003286+0000","last_became_peered":"2023-11-28T13:00:26.003286+0000","last_unstale":"2023-11-28T13:00:26.987768+0000","last_undegraded":"2023-11-28T13:00:26.987768+0000","last_fullsized":"2023-11-28T13:00:26.987768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:34:18.748847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503812+0000","last_change":"2023-11-28T13:00:25.630853+0000","last_active":"2023-11-28T13:00:27.503812+0000","last_peered":"2023-11-28T13:00:27.503812+0000","last_clean":"2023-11-28T13:00:27.503812+0000","last_became_active":"2023-11-28T13:00:25.630524+0000","last_became_peered":"2023-11-28T13:00:25.630524+0000","last_unstale":"2023-11-28T13:00:27.503812+0000","last_undegraded":"2023-11-28T13:00:27.503812+0000","last_fullsized":"2023-11-28T13:00:27.503812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:57.620680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503291+0000","last_change":"2023-11-28T13:00:26.015790+0000","last_active":"2023-11-28T13:00:27.503291+0000","last_peered":"2023-11-28T13:00:27.503291+0000","last_clean":"2023-11-28T13:00:27.503291+0000","last_became_active":"2023-11-28T13:00:26.015455+0000","last_became_peered":"2023-11-28T13:00:26.015455+0000","last_unstale":"2023-11-28T13:00:27.503291+0000","last_undegraded":"2023-11-28T13:00:27.503291+0000","last_fullsized":"2023-11-28T13:00:27.503291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:14.020668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229251+0000","last_change":"2023-11-28T13:00:25.628221+0000","last_active":"2023-11-28T13:00:27.229251+0000","last_peered":"2023-11-28T13:00:27.229251+0000","last_clean":"2023-11-28T13:00:27.229251+0000","last_became_active":"2023-11-28T13:00:25.627937+0000","last_became_peered":"2023-11-28T13:00:25.627937+0000","last_unstale":"2023-11-28T13:00:27.229251+0000","last_undegraded":"2023-11-28T13:00:27.229251+0000","last_fullsized":"2023-11-28T13:00:27.229251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:06:47.002190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503100+0000","last_change":"2023-11-28T13:00:26.016462+0000","last_active":"2023-11-28T13:00:27.503100+0000","last_peered":"2023-11-28T13:00:27.503100+0000","last_clean":"2023-11-28T13:00:27.503100+0000","last_became_active":"2023-11-28T13:00:26.016156+0000","last_became_peered":"2023-11-28T13:00:26.016156+0000","last_unstale":"2023-11-28T13:00:27.503100+0000","last_undegraded":"2023-11-28T13:00:27.503100+0000","last_fullsized":"2023-11-28T13:00:27.503100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:13:57.056758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229580+0000","last_change":"2023-11-28T13:00:25.629372+0000","last_active":"2023-11-28T13:00:27.229580+0000","last_peered":"2023-11-28T13:00:27.229580+0000","last_clean":"2023-11-28T13:00:27.229580+0000","last_became_active":"2023-11-28T13:00:25.629083+0000","last_became_peered":"2023-11-28T13:00:25.629083+0000","last_unstale":"2023-11-28T13:00:27.229580+0000","last_undegraded":"2023-11-28T13:00:27.229580+0000","last_fullsized":"2023-11-28T13:00:27.229580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:52.597204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403082+0000","last_change":"2023-11-28T13:00:26.006858+0000","last_active":"2023-11-28T13:00:27.403082+0000","last_peered":"2023-11-28T13:00:27.403082+0000","last_clean":"2023-11-28T13:00:27.403082+0000","last_became_active":"2023-11-28T13:00:26.006232+0000","last_became_peered":"2023-11-28T13:00:26.006232+0000","last_unstale":"2023-11-28T13:00:27.403082+0000","last_undegraded":"2023-11-28T13:00:27.403082+0000","last_fullsized":"2023-11-28T13:00:27.403082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:47.321386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403725+0000","last_change":"2023-11-28T13:00:25.628879+0000","last_active":"2023-11-28T13:00:27.403725+0000","last_peered":"2023-11-28T13:00:27.403725+0000","last_clean":"2023-11-28T13:00:27.403725+0000","last_became_active":"2023-11-28T13:00:25.628575+0000","last_became_peered":"2023-11-28T13:00:25.628575+0000","last_unstale":"2023-11-28T13:00:27.403725+0000","last_undegraded":"2023-11-28T13:00:27.403725+0000","last_fullsized":"2023-11-28T13:00:27.403725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:52.456316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502869+0000","last_change":"2023-11-28T13:00:26.014792+0000","last_active":"2023-11-28T13:00:27.502869+0000","last_peered":"2023-11-28T13:00:27.502869+0000","last_clean":"2023-11-28T13:00:27.502869+0000","last_became_active":"2023-11-28T13:00:26.014392+0000","last_became_peered":"2023-11-28T13:00:26.014392+0000","last_unstale":"2023-11-28T13:00:27.502869+0000","last_undegraded":"2023-11-28T13:00:27.502869+0000","last_fullsized":"2023-11-28T13:00:27.502869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:47.321386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504024+0000","last_change":"2023-11-28T13:00:25.630162+0000","last_active":"2023-11-28T13:00:27.504024+0000","last_peered":"2023-11-28T13:00:27.504024+0000","last_clean":"2023-11-28T13:00:27.504024+0000","last_became_active":"2023-11-28T13:00:25.629159+0000","last_became_peered":"2023-11-28T13:00:25.629159+0000","last_unstale":"2023-11-28T13:00:27.504024+0000","last_undegraded":"2023-11-28T13:00:27.504024+0000","last_fullsized":"2023-11-28T13:00:27.504024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:56:21.848420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9120,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362720,"statfs":{"total":96636764160,"available":96627425280,"internally_reserved":0,"allocated":876544,"data_stored":686402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8008,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363832,"statfs":{"total":96636764160,"available":96628563968,"internally_reserved":0,"allocated":262144,"data_stored":94906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":95874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8068,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363772,"statfs":{"total":96636764160,"available":96628502528,"internally_reserved":0,"allocated":258048,"data_stored":94360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8064,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363776,"statfs":{"total":96636764160,"available":96628506624,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4910000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9096,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362744,"statfs":{"total":96636764160,"available":96627449856,"internally_reserved":0,"allocated":851968,"data_stored":685204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:00:38.361 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:00:38.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd9bd0700 1 Processor -- start 2023-11-28T13:00:38.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd9bd0700 1 -- start start 2023-11-28T13:00:38.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd9bd0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0bcc037b40 0x7f0bcc0e4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:38.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd9bd0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc0e0af0 con 0x7f0bcc0e12a0 2023-11-28T13:00:38.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd9bd0700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc050f00 con 0x7f0bcc0e4f50 2023-11-28T13:00:38.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd9bd0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc0e45f0 con 0x7f0bcc037b40 2023-11-28T13:00:38.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd3fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0bcc037b40 0x7f0bcc0e4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:38.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd8bce700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0bcc0e12a0 0x7f0bcc0e1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60544/0 (socket says 172.21.15.82:60544) 2023-11-28T13:00:38.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd8bce700 1 -- 172.21.15.82:0/824017846 learned_addr learned my addr 172.21.15.82:0/824017846 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:38.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd3fff700 1 -- 172.21.15.82:0/824017846 >> v1:172.21.15.114:6789/0 conn(0x7f0bcc0e4f50 legacy=0x7f0bcc036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd3fff700 1 -- 172.21.15.82:0/824017846 >> v1:172.21.15.82:6789/0 conn(0x7f0bcc0e12a0 legacy=0x7f0bcc0e1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd37fe700 1 -- 172.21.15.82:0/824017846 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 253753816 0 0) 0x7f0bc0001110 con 0x7f0bcc0e12a0 2023-11-28T13:00:38.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd3fff700 1 -- 172.21.15.82:0/824017846 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc037fc0 con 0x7f0bcc037b40 2023-11-28T13:00:38.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd3fff700 1 --2- 172.21.15.82:0/824017846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bcc037b40 0x7f0bcc0e4a10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009850 tx=0x7f0bc8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad4ce53b718a74a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:38.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd37fe700 1 -- 172.21.15.82:0/824017846 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8011830 con 0x7f0bcc037b40 2023-11-28T13:00:38.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd37fe700 1 -- 172.21.15.82:0/824017846 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc8011990 con 0x7f0bcc037b40 2023-11-28T13:00:38.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd37fe700 1 -- 172.21.15.82:0/824017846 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8011d20 con 0x7f0bcc037b40 2023-11-28T13:00:38.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd9bd0700 1 -- 172.21.15.82:0/824017846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bcc037b40 msgr2=0x7f0bcc0e4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd9bd0700 1 --2- 172.21.15.82:0/824017846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bcc037b40 0x7f0bcc0e4a10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009850 tx=0x7f0bc8009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:38.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd9bd0700 1 -- 172.21.15.82:0/824017846 shutdown_connections 2023-11-28T13:00:38.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd9bd0700 1 --2- 172.21.15.82:0/824017846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bcc037b40 0x7f0bcc0e4a10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd9bd0700 1 -- 172.21.15.82:0/824017846 >> 172.21.15.82:0/824017846 conn(0x7f0bcc051770 msgr2=0x7f0bcc051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:38.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd9bd0700 1 -- 172.21.15.82:0/824017846 shutdown_connections 2023-11-28T13:00:38.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.464+0000 7f0bd9bd0700 1 -- 172.21.15.82:0/824017846 wait complete. 2023-11-28T13:00:38.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.468+0000 7f0bd9bd0700 1 Processor -- start 2023-11-28T13:00:38.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.468+0000 7f0bd9bd0700 1 -- start start 2023-11-28T13:00:38.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.468+0000 7f0bd9bd0700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0bcc0e12a0 0x7f0bcc0cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:38.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.468+0000 7f0bd9bd0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bcc0e4f50 0x7f0bcc039a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:38.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.468+0000 7f0bd9bd0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bcc039fc0 0x7f0bcc0360a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:38.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.468+0000 7f0bd9bd0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc03a430 con 0x7f0bcc0e4f50 2023-11-28T13:00:38.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.468+0000 7f0bd9bd0700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc16b0a0 con 0x7f0bcc039fc0 2023-11-28T13:00:38.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.468+0000 7f0bd9bd0700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc16b380 con 0x7f0bcc0e12a0 2023-11-28T13:00:38.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.468+0000 7f0bd3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bcc0e4f50 0x7f0bcc039a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:38.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.468+0000 7f0bd3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bcc0e4f50 0x7f0bcc039a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50868/0 (socket says 172.21.15.82:50868) 2023-11-28T13:00:38.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.468+0000 7f0bd3fff700 1 -- 172.21.15.82:0/1047231871 learned_addr learned my addr 172.21.15.82:0/1047231871 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:38.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.468+0000 7f0bd8bce700 1 --2- 172.21.15.82:0/1047231871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0bcc0e12a0 0x7f0bcc0cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:38.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.468+0000 7f0bd93cf700 1 --2- 172.21.15.82:0/1047231871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bcc039fc0 0x7f0bcc0360a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:38.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.468+0000 7f0bd3fff700 1 -- 172.21.15.82:0/1047231871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0bcc0e12a0 msgr2=0x7f0bcc0cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.468+0000 7f0bd3fff700 1 --2- 172.21.15.82:0/1047231871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0bcc0e12a0 0x7f0bcc0cf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.468+0000 7f0bd3fff700 1 -- 172.21.15.82:0/1047231871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bcc039fc0 msgr2=0x7f0bcc0360a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.468+0000 7f0bd3fff700 1 --2- 172.21.15.82:0/1047231871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bcc039fc0 0x7f0bcc0360a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.468+0000 7f0bd3fff700 1 -- 172.21.15.82:0/1047231871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc80094b0 con 0x7f0bcc0e4f50 2023-11-28T13:00:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.468+0000 7f0bd93cf700 1 --2- 172.21.15.82:0/1047231871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bcc039fc0 0x7f0bcc0360a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.468+0000 7f0bd3fff700 1 --2- 172.21.15.82:0/1047231871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bcc0e4f50 0x7f0bcc039a80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80090b0 tx=0x7f0bc8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.472+0000 7f0bd17fa700 1 -- 172.21.15.82:0/1047231871 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc80043c0 con 0x7f0bcc0e4f50 2023-11-28T13:00:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.472+0000 7f0bd17fa700 1 -- 172.21.15.82:0/1047231871 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc801f070 con 0x7f0bcc0e4f50 2023-11-28T13:00:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.472+0000 7f0bd9bd0700 1 -- 172.21.15.82:0/1047231871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bcc051430 con 0x7f0bcc0e4f50 2023-11-28T13:00:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.472+0000 7f0bd17fa700 1 -- 172.21.15.82:0/1047231871 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc80036c0 con 0x7f0bcc0e4f50 2023-11-28T13:00:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.472+0000 7f0bd9bd0700 1 -- 172.21.15.82:0/1047231871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc051150 con 0x7f0bcc0e4f50 2023-11-28T13:00:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.472+0000 7f0bd9bd0700 1 -- 172.21.15.82:0/1047231871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bcc0e4210 con 0x7f0bcc0e4f50 2023-11-28T13:00:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.472+0000 7f0bd17fa700 1 -- 172.21.15.82:0/1047231871 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0bc802a020 con 0x7f0bcc0e4f50 2023-11-28T13:00:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.472+0000 7f0bd17fa700 1 --2- 172.21.15.82:0/1047231871 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0bb8064ee0 0x7f0bb8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.472+0000 7f0bd8bce700 1 --2- 172.21.15.82:0/1047231871 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0bb8064ee0 0x7f0bb8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:38.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.472+0000 7f0bd17fa700 1 -- 172.21.15.82:0/1047231871 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0bc80834d0 con 0x7f0bcc0e4f50 2023-11-28T13:00:38.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.476+0000 7f0bd8bce700 1 --2- 172.21.15.82:0/1047231871 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0bb8064ee0 0x7f0bb8067390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0007fd0 tx=0x7f0bc0007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:38.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.480+0000 7f0bd17fa700 1 -- 172.21.15.82:0/1047231871 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0bc80515f0 con 0x7f0bcc0e4f50 2023-11-28T13:00:38.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.624+0000 7f0bd9bd0700 1 -- 172.21.15.82:0/1047231871 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0bcc005570 con 0x7f0bb8064ee0 2023-11-28T13:00:38.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.640+0000 7f0bd17fa700 1 -- 172.21.15.82:0/1047231871 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286555 (secure 0 0 0) 0x7f0bcc005570 con 0x7f0bb8064ee0 2023-11-28T13:00:38.647 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:38.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.644+0000 7f0bd9bd0700 1 -- 172.21.15.82:0/1047231871 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0bb8064ee0 msgr2=0x7f0bb8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.644+0000 7f0bd9bd0700 1 --2- 172.21.15.82:0/1047231871 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0bb8064ee0 0x7f0bb8067390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0007fd0 tx=0x7f0bc0007e30 comp rx=0 tx=0).stop 2023-11-28T13:00:38.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.644+0000 7f0bd9bd0700 1 -- 172.21.15.82:0/1047231871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bcc0e4f50 msgr2=0x7f0bcc039a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.644+0000 7f0bd9bd0700 1 --2- 172.21.15.82:0/1047231871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bcc0e4f50 0x7f0bcc039a80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80090b0 tx=0x7f0bc8004770 comp rx=0 tx=0).stop 2023-11-28T13:00:38.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.644+0000 7f0bd9bd0700 1 -- 172.21.15.82:0/1047231871 shutdown_connections 2023-11-28T13:00:38.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.644+0000 7f0bd9bd0700 1 --2- 172.21.15.82:0/1047231871 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0bb8064ee0 0x7f0bb8067390 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.644+0000 7f0bd9bd0700 1 --2- 172.21.15.82:0/1047231871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bcc039fc0 0x7f0bcc0360a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.644+0000 7f0bd9bd0700 1 --2- 172.21.15.82:0/1047231871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bcc0e4f50 0x7f0bcc039a80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.644+0000 7f0bd9bd0700 1 --2- 172.21.15.82:0/1047231871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0bcc0e12a0 0x7f0bcc0cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.644+0000 7f0bd9bd0700 1 -- 172.21.15.82:0/1047231871 >> 172.21.15.82:0/1047231871 conn(0x7f0bcc051770 msgr2=0x7f0bcc048dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:38.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.644+0000 7f0bd9bd0700 1 -- 172.21.15.82:0/1047231871 shutdown_connections 2023-11-28T13:00:38.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.644+0000 7f0bd9bd0700 1 -- 172.21.15.82:0/1047231871 wait complete. 2023-11-28T13:00:38.652 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:00:38.661 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-11-28T13:00:37.159172+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66440,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":63168,"kb_avail":754908280,"statfs":{"total":773094113280,"available":773026078720,"internally_reserved":0,"allocated":3284992,"data_stored":1939556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64684032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.174113"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.987630+0000","last_change":"2023-11-28T13:00:26.016426+0000","last_active":"2023-11-28T13:00:26.987630+0000","last_peered":"2023-11-28T13:00:26.987630+0000","last_clean":"2023-11-28T13:00:26.987630+0000","last_became_active":"2023-11-28T13:00:26.016109+0000","last_became_peered":"2023-11-28T13:00:26.016109+0000","last_unstale":"2023-11-28T13:00:26.987630+0000","last_undegraded":"2023-11-28T13:00:26.987630+0000","last_fullsized":"2023-11-28T13:00:26.987630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:16.748872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229500+0000","last_change":"2023-11-28T13:00:26.000097+0000","last_active":"2023-11-28T13:00:27.229500+0000","last_peered":"2023-11-28T13:00:27.229500+0000","last_clean":"2023-11-28T13:00:27.229500+0000","last_became_active":"2023-11-28T13:00:25.999819+0000","last_became_peered":"2023-11-28T13:00:25.999819+0000","last_unstale":"2023-11-28T13:00:27.229500+0000","last_undegraded":"2023-11-28T13:00:27.229500+0000","last_fullsized":"2023-11-28T13:00:27.229500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:12:32.057680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503805+0000","last_change":"2023-11-28T13:00:26.005315+0000","last_active":"2023-11-28T13:00:27.503805+0000","last_peered":"2023-11-28T13:00:27.503805+0000","last_clean":"2023-11-28T13:00:27.503805+0000","last_became_active":"2023-11-28T13:00:26.005022+0000","last_became_peered":"2023-11-28T13:00:26.005022+0000","last_unstale":"2023-11-28T13:00:27.503805+0000","last_undegraded":"2023-11-28T13:00:27.503805+0000","last_fullsized":"2023-11-28T13:00:27.503805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:21.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.993695+0000","last_change":"2023-11-28T13:00:26.009786+0000","last_active":"2023-11-28T13:00:26.993695+0000","last_peered":"2023-11-28T13:00:26.993695+0000","last_clean":"2023-11-28T13:00:26.993695+0000","last_became_active":"2023-11-28T13:00:26.008695+0000","last_became_peered":"2023-11-28T13:00:26.008695+0000","last_unstale":"2023-11-28T13:00:26.993695+0000","last_undegraded":"2023-11-28T13:00:26.993695+0000","last_fullsized":"2023-11-28T13:00:26.993695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:10.041488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503641+0000","last_change":"2023-11-28T13:00:26.016418+0000","last_active":"2023-11-28T13:00:27.503641+0000","last_peered":"2023-11-28T13:00:27.503641+0000","last_clean":"2023-11-28T13:00:27.503641+0000","last_became_active":"2023-11-28T13:00:26.016147+0000","last_became_peered":"2023-11-28T13:00:26.016147+0000","last_unstale":"2023-11-28T13:00:27.503641+0000","last_undegraded":"2023-11-28T13:00:27.503641+0000","last_fullsized":"2023-11-28T13:00:27.503641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502901+0000","last_change":"2023-11-28T13:00:26.006186+0000","last_active":"2023-11-28T13:00:27.502901+0000","last_peered":"2023-11-28T13:00:27.502901+0000","last_clean":"2023-11-28T13:00:27.502901+0000","last_became_active":"2023-11-28T13:00:26.005834+0000","last_became_peered":"2023-11-28T13:00:26.005834+0000","last_unstale":"2023-11-28T13:00:27.502901+0000","last_undegraded":"2023-11-28T13:00:27.502901+0000","last_fullsized":"2023-11-28T13:00:27.502901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:58.267291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991447+0000","last_change":"2023-11-28T13:00:26.012909+0000","last_active":"2023-11-28T13:00:26.991447+0000","last_peered":"2023-11-28T13:00:26.991447+0000","last_clean":"2023-11-28T13:00:26.991447+0000","last_became_active":"2023-11-28T13:00:26.012340+0000","last_became_peered":"2023-11-28T13:00:26.012340+0000","last_unstale":"2023-11-28T13:00:26.991447+0000","last_undegraded":"2023-11-28T13:00:26.991447+0000","last_fullsized":"2023-11-28T13:00:26.991447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.228880+0000","last_change":"2023-11-28T13:00:26.011119+0000","last_active":"2023-11-28T13:00:27.228880+0000","last_peered":"2023-11-28T13:00:27.228880+0000","last_clean":"2023-11-28T13:00:27.228880+0000","last_became_active":"2023-11-28T13:00:26.010841+0000","last_became_peered":"2023-11-28T13:00:26.010841+0000","last_unstale":"2023-11-28T13:00:27.228880+0000","last_undegraded":"2023-11-28T13:00:27.228880+0000","last_fullsized":"2023-11-28T13:00:27.228880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:39.083550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503676+0000","last_change":"2023-11-28T13:00:26.016674+0000","last_active":"2023-11-28T13:00:27.503676+0000","last_peered":"2023-11-28T13:00:27.503676+0000","last_clean":"2023-11-28T13:00:27.503676+0000","last_became_active":"2023-11-28T13:00:26.016188+0000","last_became_peered":"2023-11-28T13:00:26.016188+0000","last_unstale":"2023-11-28T13:00:27.503676+0000","last_undegraded":"2023-11-28T13:00:27.503676+0000","last_fullsized":"2023-11-28T13:00:27.503676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229491+0000","last_change":"2023-11-28T13:00:26.002162+0000","last_active":"2023-11-28T13:00:27.229491+0000","last_peered":"2023-11-28T13:00:27.229491+0000","last_clean":"2023-11-28T13:00:27.229491+0000","last_became_active":"2023-11-28T13:00:26.001726+0000","last_became_peered":"2023-11-28T13:00:26.001726+0000","last_unstale":"2023-11-28T13:00:27.229491+0000","last_undegraded":"2023-11-28T13:00:27.229491+0000","last_fullsized":"2023-11-28T13:00:27.229491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503832+0000","last_change":"2023-11-28T13:00:26.005292+0000","last_active":"2023-11-28T13:00:27.503832+0000","last_peered":"2023-11-28T13:00:27.503832+0000","last_clean":"2023-11-28T13:00:27.503832+0000","last_became_active":"2023-11-28T13:00:26.004797+0000","last_became_peered":"2023-11-28T13:00:26.004797+0000","last_unstale":"2023-11-28T13:00:27.503832+0000","last_undegraded":"2023-11-28T13:00:27.503832+0000","last_fullsized":"2023-11-28T13:00:27.503832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:27:02.277619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.987674+0000","last_change":"2023-11-28T13:00:26.007946+0000","last_active":"2023-11-28T13:00:26.987674+0000","last_peered":"2023-11-28T13:00:26.987674+0000","last_clean":"2023-11-28T13:00:26.987674+0000","last_became_active":"2023-11-28T13:00:26.007680+0000","last_became_peered":"2023-11-28T13:00:26.007680+0000","last_unstale":"2023-11-28T13:00:26.987674+0000","last_undegraded":"2023-11-28T13:00:26.987674+0000","last_fullsized":"2023-11-28T13:00:26.987674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:56:22.863111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.987252+0000","last_change":"2023-11-28T13:00:26.016340+0000","last_active":"2023-11-28T13:00:26.987252+0000","last_peered":"2023-11-28T13:00:26.987252+0000","last_clean":"2023-11-28T13:00:26.987252+0000","last_became_active":"2023-11-28T13:00:26.016050+0000","last_became_peered":"2023-11-28T13:00:26.016050+0000","last_unstale":"2023-11-28T13:00:26.987252+0000","last_undegraded":"2023-11-28T13:00:26.987252+0000","last_fullsized":"2023-11-28T13:00:26.987252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:06:48.016881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229021+0000","last_change":"2023-11-28T13:00:26.002242+0000","last_active":"2023-11-28T13:00:27.229021+0000","last_peered":"2023-11-28T13:00:27.229021+0000","last_clean":"2023-11-28T13:00:27.229021+0000","last_became_active":"2023-11-28T13:00:26.001119+0000","last_became_peered":"2023-11-28T13:00:26.001119+0000","last_unstale":"2023-11-28T13:00:27.229021+0000","last_undegraded":"2023-11-28T13:00:27.229021+0000","last_fullsized":"2023-11-28T13:00:27.229021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:21.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991681+0000","last_change":"2023-11-28T13:00:26.013151+0000","last_active":"2023-11-28T13:00:26.991681+0000","last_peered":"2023-11-28T13:00:26.991681+0000","last_clean":"2023-11-28T13:00:26.991681+0000","last_became_active":"2023-11-28T13:00:26.012729+0000","last_became_peered":"2023-11-28T13:00:26.012729+0000","last_unstale":"2023-11-28T13:00:26.991681+0000","last_undegraded":"2023-11-28T13:00:26.991681+0000","last_fullsized":"2023-11-28T13:00:26.991681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502676+0000","last_change":"2023-11-28T13:00:26.006151+0000","last_active":"2023-11-28T13:00:27.502676+0000","last_peered":"2023-11-28T13:00:27.502676+0000","last_clean":"2023-11-28T13:00:27.502676+0000","last_became_active":"2023-11-28T13:00:26.005850+0000","last_became_peered":"2023-11-28T13:00:26.005850+0000","last_unstale":"2023-11-28T13:00:27.502676+0000","last_undegraded":"2023-11-28T13:00:27.502676+0000","last_fullsized":"2023-11-28T13:00:27.502676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:18:46.140210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503909+0000","last_change":"2023-11-28T13:00:26.016811+0000","last_active":"2023-11-28T13:00:27.503909+0000","last_peered":"2023-11-28T13:00:27.503909+0000","last_clean":"2023-11-28T13:00:27.503909+0000","last_became_active":"2023-11-28T13:00:26.016486+0000","last_became_peered":"2023-11-28T13:00:26.016486+0000","last_unstale":"2023-11-28T13:00:27.503909+0000","last_undegraded":"2023-11-28T13:00:27.503909+0000","last_fullsized":"2023-11-28T13:00:27.503909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:47.321386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503787+0000","last_change":"2023-11-28T13:00:26.004579+0000","last_active":"2023-11-28T13:00:27.503787+0000","last_peered":"2023-11-28T13:00:27.503787+0000","last_clean":"2023-11-28T13:00:27.503787+0000","last_became_active":"2023-11-28T13:00:26.004222+0000","last_became_peered":"2023-11-28T13:00:26.004222+0000","last_unstale":"2023-11-28T13:00:27.503787+0000","last_undegraded":"2023-11-28T13:00:27.503787+0000","last_fullsized":"2023-11-28T13:00:27.503787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.987435+0000","last_change":"2023-11-28T13:00:26.009984+0000","last_active":"2023-11-28T13:00:26.987435+0000","last_peered":"2023-11-28T13:00:26.987435+0000","last_clean":"2023-11-28T13:00:26.987435+0000","last_became_active":"2023-11-28T13:00:26.009719+0000","last_became_peered":"2023-11-28T13:00:26.009719+0000","last_unstale":"2023-11-28T13:00:26.987435+0000","last_undegraded":"2023-11-28T13:00:26.987435+0000","last_fullsized":"2023-11-28T13:00:26.987435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:32:20.224728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503408+0000","last_change":"2023-11-28T13:00:26.015275+0000","last_active":"2023-11-28T13:00:27.503408+0000","last_peered":"2023-11-28T13:00:27.503408+0000","last_clean":"2023-11-28T13:00:27.503408+0000","last_became_active":"2023-11-28T13:00:26.014423+0000","last_became_peered":"2023-11-28T13:00:26.014423+0000","last_unstale":"2023-11-28T13:00:27.503408+0000","last_undegraded":"2023-11-28T13:00:27.503408+0000","last_fullsized":"2023-11-28T13:00:27.503408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:18:51.214695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991515+0000","last_change":"2023-11-28T13:00:26.015493+0000","last_active":"2023-11-28T13:00:26.991515+0000","last_peered":"2023-11-28T13:00:26.991515+0000","last_clean":"2023-11-28T13:00:26.991515+0000","last_became_active":"2023-11-28T13:00:26.015224+0000","last_became_peered":"2023-11-28T13:00:26.015224+0000","last_unstale":"2023-11-28T13:00:26.991515+0000","last_undegraded":"2023-11-28T13:00:26.991515+0000","last_fullsized":"2023-11-28T13:00:26.991515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:48.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503142+0000","last_change":"2023-11-28T13:00:26.004946+0000","last_active":"2023-11-28T13:00:27.503142+0000","last_peered":"2023-11-28T13:00:27.503142+0000","last_clean":"2023-11-28T13:00:27.503142+0000","last_became_active":"2023-11-28T13:00:26.004689+0000","last_became_peered":"2023-11-28T13:00:26.004689+0000","last_unstale":"2023-11-28T13:00:27.503142+0000","last_undegraded":"2023-11-28T13:00:27.503142+0000","last_fullsized":"2023-11-28T13:00:27.503142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:12:32.057680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402655+0000","last_change":"2023-11-28T13:00:26.003184+0000","last_active":"2023-11-28T13:00:27.402655+0000","last_peered":"2023-11-28T13:00:27.402655+0000","last_clean":"2023-11-28T13:00:27.402655+0000","last_became_active":"2023-11-28T13:00:25.997059+0000","last_became_peered":"2023-11-28T13:00:25.997059+0000","last_unstale":"2023-11-28T13:00:27.402655+0000","last_undegraded":"2023-11-28T13:00:27.402655+0000","last_fullsized":"2023-11-28T13:00:27.402655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991146+0000","last_change":"2023-11-28T13:00:26.015820+0000","last_active":"2023-11-28T13:00:26.991146+0000","last_peered":"2023-11-28T13:00:26.991146+0000","last_clean":"2023-11-28T13:00:26.991146+0000","last_became_active":"2023-11-28T13:00:26.015570+0000","last_became_peered":"2023-11-28T13:00:26.015570+0000","last_unstale":"2023-11-28T13:00:26.991146+0000","last_undegraded":"2023-11-28T13:00:26.991146+0000","last_fullsized":"2023-11-28T13:00:26.991146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:12:32.057680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505383+0000","last_change":"2023-11-28T13:00:26.010807+0000","last_active":"2023-11-28T13:00:27.505383+0000","last_peered":"2023-11-28T13:00:27.505383+0000","last_clean":"2023-11-28T13:00:27.505383+0000","last_became_active":"2023-11-28T13:00:26.010530+0000","last_became_peered":"2023-11-28T13:00:26.010530+0000","last_unstale":"2023-11-28T13:00:27.505383+0000","last_undegraded":"2023-11-28T13:00:27.505383+0000","last_fullsized":"2023-11-28T13:00:27.505383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:39.083550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505576+0000","last_change":"2023-11-28T13:00:26.002933+0000","last_active":"2023-11-28T13:00:27.505576+0000","last_peered":"2023-11-28T13:00:27.505576+0000","last_clean":"2023-11-28T13:00:27.505576+0000","last_became_active":"2023-11-28T13:00:26.002663+0000","last_became_peered":"2023-11-28T13:00:26.002663+0000","last_unstale":"2023-11-28T13:00:27.505576+0000","last_undegraded":"2023-11-28T13:00:27.505576+0000","last_fullsized":"2023-11-28T13:00:27.505576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:47.321386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229310+0000","last_change":"2023-11-28T13:00:26.012470+0000","last_active":"2023-11-28T13:00:27.229310+0000","last_peered":"2023-11-28T13:00:27.229310+0000","last_clean":"2023-11-28T13:00:27.229310+0000","last_became_active":"2023-11-28T13:00:26.012130+0000","last_became_peered":"2023-11-28T13:00:26.012130+0000","last_unstale":"2023-11-28T13:00:27.229310+0000","last_undegraded":"2023-11-28T13:00:27.229310+0000","last_fullsized":"2023-11-28T13:00:27.229310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:48.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504421+0000","last_change":"2023-11-28T13:00:26.014609+0000","last_active":"2023-11-28T13:00:27.504421+0000","last_peered":"2023-11-28T13:00:27.504421+0000","last_clean":"2023-11-28T13:00:27.504421+0000","last_became_active":"2023-11-28T13:00:26.014274+0000","last_became_peered":"2023-11-28T13:00:26.014274+0000","last_unstale":"2023-11-28T13:00:27.504421+0000","last_undegraded":"2023-11-28T13:00:27.504421+0000","last_fullsized":"2023-11-28T13:00:27.504421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:50.093176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403447+0000","last_change":"2023-11-28T13:00:26.015284+0000","last_active":"2023-11-28T13:00:27.403447+0000","last_peered":"2023-11-28T13:00:27.403447+0000","last_clean":"2023-11-28T13:00:27.403447+0000","last_became_active":"2023-11-28T13:00:26.015015+0000","last_became_peered":"2023-11-28T13:00:26.015015+0000","last_unstale":"2023-11-28T13:00:27.403447+0000","last_undegraded":"2023-11-28T13:00:27.403447+0000","last_fullsized":"2023-11-28T13:00:27.403447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:21.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503148+0000","last_change":"2023-11-28T13:00:26.016028+0000","last_active":"2023-11-28T13:00:27.503148+0000","last_peered":"2023-11-28T13:00:27.503148+0000","last_clean":"2023-11-28T13:00:27.503148+0000","last_became_active":"2023-11-28T13:00:26.014453+0000","last_became_peered":"2023-11-28T13:00:26.014453+0000","last_unstale":"2023-11-28T13:00:27.503148+0000","last_undegraded":"2023-11-28T13:00:27.503148+0000","last_fullsized":"2023-11-28T13:00:27.503148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402712+0000","last_change":"2023-11-28T13:00:26.010119+0000","last_active":"2023-11-28T13:00:27.402712+0000","last_peered":"2023-11-28T13:00:27.402712+0000","last_clean":"2023-11-28T13:00:27.402712+0000","last_became_active":"2023-11-28T13:00:26.006633+0000","last_became_peered":"2023-11-28T13:00:26.006633+0000","last_unstale":"2023-11-28T13:00:27.402712+0000","last_undegraded":"2023-11-28T13:00:27.402712+0000","last_fullsized":"2023-11-28T13:00:27.402712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:50.521471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992755+0000","last_change":"2023-11-28T13:00:26.009650+0000","last_active":"2023-11-28T13:00:26.992755+0000","last_peered":"2023-11-28T13:00:26.992755+0000","last_clean":"2023-11-28T13:00:26.992755+0000","last_became_active":"2023-11-28T13:00:26.008418+0000","last_became_peered":"2023-11-28T13:00:26.008418+0000","last_unstale":"2023-11-28T13:00:26.992755+0000","last_undegraded":"2023-11-28T13:00:26.992755+0000","last_fullsized":"2023-11-28T13:00:26.992755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:45:08.692115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403371+0000","last_change":"2023-11-28T13:00:26.006501+0000","last_active":"2023-11-28T13:00:27.403371+0000","last_peered":"2023-11-28T13:00:27.403371+0000","last_clean":"2023-11-28T13:00:27.403371+0000","last_became_active":"2023-11-28T13:00:26.005960+0000","last_became_peered":"2023-11-28T13:00:26.005960+0000","last_unstale":"2023-11-28T13:00:27.403371+0000","last_undegraded":"2023-11-28T13:00:27.403371+0000","last_fullsized":"2023-11-28T13:00:27.403371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:59.727409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991606+0000","last_change":"2023-11-28T13:00:25.625750+0000","last_active":"2023-11-28T13:00:26.991606+0000","last_peered":"2023-11-28T13:00:26.991606+0000","last_clean":"2023-11-28T13:00:26.991606+0000","last_became_active":"2023-11-28T13:00:25.625184+0000","last_became_peered":"2023-11-28T13:00:25.625184+0000","last_unstale":"2023-11-28T13:00:26.991606+0000","last_undegraded":"2023-11-28T13:00:26.991606+0000","last_fullsized":"2023-11-28T13:00:26.991606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:45:07.677424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229505+0000","last_change":"2023-11-28T13:00:26.006359+0000","last_active":"2023-11-28T13:00:27.229505+0000","last_peered":"2023-11-28T13:00:27.229505+0000","last_clean":"2023-11-28T13:00:27.229505+0000","last_became_active":"2023-11-28T13:00:26.006083+0000","last_became_peered":"2023-11-28T13:00:26.006083+0000","last_unstale":"2023-11-28T13:00:27.229505+0000","last_undegraded":"2023-11-28T13:00:27.229505+0000","last_fullsized":"2023-11-28T13:00:27.229505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503356+0000","last_change":"2023-11-28T13:00:25.623980+0000","last_active":"2023-11-28T13:00:27.503356+0000","last_peered":"2023-11-28T13:00:27.503356+0000","last_clean":"2023-11-28T13:00:27.503356+0000","last_became_active":"2023-11-28T13:00:25.623650+0000","last_became_peered":"2023-11-28T13:00:25.623650+0000","last_unstale":"2023-11-28T13:00:27.503356+0000","last_undegraded":"2023-11-28T13:00:27.503356+0000","last_fullsized":"2023-11-28T13:00:27.503356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:03.287202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504291+0000","last_change":"2023-11-28T13:00:26.015774+0000","last_active":"2023-11-28T13:00:27.504291+0000","last_peered":"2023-11-28T13:00:27.504291+0000","last_clean":"2023-11-28T13:00:27.504291+0000","last_became_active":"2023-11-28T13:00:26.015516+0000","last_became_peered":"2023-11-28T13:00:26.015516+0000","last_unstale":"2023-11-28T13:00:27.504291+0000","last_undegraded":"2023-11-28T13:00:27.504291+0000","last_fullsized":"2023-11-28T13:00:27.504291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:10.041488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.991867+0000","last_change":"2023-11-28T13:00:25.628452+0000","last_active":"2023-11-28T13:00:26.991867+0000","last_peered":"2023-11-28T13:00:26.991867+0000","last_clean":"2023-11-28T13:00:26.991867+0000","last_became_active":"2023-11-28T13:00:25.628113+0000","last_became_peered":"2023-11-28T13:00:25.628113+0000","last_unstale":"2023-11-28T13:00:26.991867+0000","last_undegraded":"2023-11-28T13:00:26.991867+0000","last_fullsized":"2023-11-28T13:00:26.991867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:34:17.734156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403850+0000","last_change":"2023-11-28T13:00:26.004164+0000","last_active":"2023-11-28T13:00:27.403850+0000","last_peered":"2023-11-28T13:00:27.403850+0000","last_clean":"2023-11-28T13:00:27.403850+0000","last_became_active":"2023-11-28T13:00:26.003908+0000","last_became_peered":"2023-11-28T13:00:26.003908+0000","last_unstale":"2023-11-28T13:00:27.403850+0000","last_undegraded":"2023-11-28T13:00:27.403850+0000","last_fullsized":"2023-11-28T13:00:27.403850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:48.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992957+0000","last_change":"2023-11-28T13:00:25.623824+0000","last_active":"2023-11-28T13:00:26.992957+0000","last_peered":"2023-11-28T13:00:26.992957+0000","last_clean":"2023-11-28T13:00:26.992957+0000","last_became_active":"2023-11-28T13:00:25.623463+0000","last_became_peered":"2023-11-28T13:00:25.623463+0000","last_unstale":"2023-11-28T13:00:26.992957+0000","last_undegraded":"2023-11-28T13:00:26.992957+0000","last_fullsized":"2023-11-28T13:00:26.992957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:23.365345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992736+0000","last_change":"2023-11-28T13:00:25.626091+0000","last_active":"2023-11-28T13:00:26.992736+0000","last_peered":"2023-11-28T13:00:26.992736+0000","last_clean":"2023-11-28T13:00:26.992736+0000","last_became_active":"2023-11-28T13:00:25.625286+0000","last_became_peered":"2023-11-28T13:00:25.625286+0000","last_unstale":"2023-11-28T13:00:26.992736+0000","last_undegraded":"2023-11-28T13:00:26.992736+0000","last_fullsized":"2023-11-28T13:00:26.992736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:58.712719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.228893+0000","last_change":"2023-11-28T13:00:26.006094+0000","last_active":"2023-11-28T13:00:27.228893+0000","last_peered":"2023-11-28T13:00:27.228893+0000","last_clean":"2023-11-28T13:00:27.228893+0000","last_became_active":"2023-11-28T13:00:26.005812+0000","last_became_peered":"2023-11-28T13:00:26.005812+0000","last_unstale":"2023-11-28T13:00:27.228893+0000","last_undegraded":"2023-11-28T13:00:27.228893+0000","last_fullsized":"2023-11-28T13:00:27.228893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:50.093176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.993196+0000","last_change":"2023-11-28T13:00:25.628566+0000","last_active":"2023-11-28T13:00:26.993196+0000","last_peered":"2023-11-28T13:00:26.993196+0000","last_clean":"2023-11-28T13:00:26.993196+0000","last_became_active":"2023-11-28T13:00:25.628266+0000","last_became_peered":"2023-11-28T13:00:25.628266+0000","last_unstale":"2023-11-28T13:00:26.993196+0000","last_undegraded":"2023-11-28T13:00:26.993196+0000","last_fullsized":"2023-11-28T13:00:26.993196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:05.115882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502747+0000","last_change":"2023-11-28T13:00:26.006002+0000","last_active":"2023-11-28T13:00:27.502747+0000","last_peered":"2023-11-28T13:00:27.502747+0000","last_clean":"2023-11-28T13:00:27.502747+0000","last_became_active":"2023-11-28T13:00:26.005728+0000","last_became_peered":"2023-11-28T13:00:26.005728+0000","last_unstale":"2023-11-28T13:00:27.502747+0000","last_undegraded":"2023-11-28T13:00:27.502747+0000","last_fullsized":"2023-11-28T13:00:27.502747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:45:51.690938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992306+0000","last_change":"2023-11-28T13:00:25.627709+0000","last_active":"2023-11-28T13:00:26.992306+0000","last_peered":"2023-11-28T13:00:26.992306+0000","last_clean":"2023-11-28T13:00:26.992306+0000","last_became_active":"2023-11-28T13:00:25.627384+0000","last_became_peered":"2023-11-28T13:00:25.627384+0000","last_unstale":"2023-11-28T13:00:26.992306+0000","last_undegraded":"2023-11-28T13:00:26.992306+0000","last_fullsized":"2023-11-28T13:00:26.992306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:09.026798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992896+0000","last_change":"2023-11-28T13:00:26.008865+0000","last_active":"2023-11-28T13:00:26.992896+0000","last_peered":"2023-11-28T13:00:26.992896+0000","last_clean":"2023-11-28T13:00:26.992896+0000","last_became_active":"2023-11-28T13:00:26.008154+0000","last_became_peered":"2023-11-28T13:00:26.008154+0000","last_unstale":"2023-11-28T13:00:26.992896+0000","last_undegraded":"2023-11-28T13:00:26.992896+0000","last_fullsized":"2023-11-28T13:00:26.992896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:35:46.604719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229235+0000","last_change":"2023-11-28T13:00:25.630262+0000","last_active":"2023-11-28T13:00:27.229235+0000","last_peered":"2023-11-28T13:00:27.229235+0000","last_clean":"2023-11-28T13:00:27.229235+0000","last_became_active":"2023-11-28T13:00:25.629929+0000","last_became_peered":"2023-11-28T13:00:25.629929+0000","last_unstale":"2023-11-28T13:00:27.229235+0000","last_undegraded":"2023-11-28T13:00:27.229235+0000","last_fullsized":"2023-11-28T13:00:27.229235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:56:21.848420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503222+0000","last_change":"2023-11-28T13:00:26.002295+0000","last_active":"2023-11-28T13:00:27.503222+0000","last_peered":"2023-11-28T13:00:27.503222+0000","last_clean":"2023-11-28T13:00:27.503222+0000","last_became_active":"2023-11-28T13:00:26.002035+0000","last_became_peered":"2023-11-28T13:00:26.002035+0000","last_unstale":"2023-11-28T13:00:27.503222+0000","last_undegraded":"2023-11-28T13:00:27.503222+0000","last_fullsized":"2023-11-28T13:00:27.503222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:48.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403625+0000","last_change":"2023-11-28T13:00:25.631075+0000","last_active":"2023-11-28T13:00:27.403625+0000","last_peered":"2023-11-28T13:00:27.403625+0000","last_clean":"2023-11-28T13:00:27.403625+0000","last_became_active":"2023-11-28T13:00:25.630790+0000","last_became_peered":"2023-11-28T13:00:25.630790+0000","last_unstale":"2023-11-28T13:00:27.403625+0000","last_undegraded":"2023-11-28T13:00:27.403625+0000","last_fullsized":"2023-11-28T13:00:27.403625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:03.287202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503723+0000","last_change":"2023-11-28T13:00:26.015247+0000","last_active":"2023-11-28T13:00:27.503723+0000","last_peered":"2023-11-28T13:00:27.503723+0000","last_clean":"2023-11-28T13:00:27.503723+0000","last_became_active":"2023-11-28T13:00:26.014933+0000","last_became_peered":"2023-11-28T13:00:26.014933+0000","last_unstale":"2023-11-28T13:00:27.503723+0000","last_undegraded":"2023-11-28T13:00:27.503723+0000","last_fullsized":"2023-11-28T13:00:27.503723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:39:23.566274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.993202+0000","last_change":"2023-11-28T13:00:25.625442+0000","last_active":"2023-11-28T13:00:26.993202+0000","last_peered":"2023-11-28T13:00:26.993202+0000","last_clean":"2023-11-28T13:00:26.993202+0000","last_became_active":"2023-11-28T13:00:25.625167+0000","last_became_peered":"2023-11-28T13:00:25.625167+0000","last_unstale":"2023-11-28T13:00:26.993202+0000","last_undegraded":"2023-11-28T13:00:26.993202+0000","last_fullsized":"2023-11-28T13:00:26.993202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:57.620680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503939+0000","last_change":"2023-11-28T13:00:26.005117+0000","last_active":"2023-11-28T13:00:27.503939+0000","last_peered":"2023-11-28T13:00:27.503939+0000","last_clean":"2023-11-28T13:00:27.503939+0000","last_became_active":"2023-11-28T13:00:26.004706+0000","last_became_peered":"2023-11-28T13:00:26.004706+0000","last_unstale":"2023-11-28T13:00:27.503939+0000","last_undegraded":"2023-11-28T13:00:27.503939+0000","last_fullsized":"2023-11-28T13:00:27.503939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:12:32.057680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502983+0000","last_change":"2023-11-28T13:00:25.620940+0000","last_active":"2023-11-28T13:00:27.502983+0000","last_peered":"2023-11-28T13:00:27.502983+0000","last_clean":"2023-11-28T13:00:27.502983+0000","last_became_active":"2023-11-28T13:00:25.620569+0000","last_became_peered":"2023-11-28T13:00:25.620569+0000","last_unstale":"2023-11-28T13:00:27.502983+0000","last_undegraded":"2023-11-28T13:00:27.502983+0000","last_fullsized":"2023-11-28T13:00:27.502983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:52.456316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503912+0000","last_change":"2023-11-28T13:00:26.014474+0000","last_active":"2023-11-28T13:00:27.503912+0000","last_peered":"2023-11-28T13:00:27.503912+0000","last_clean":"2023-11-28T13:00:27.503912+0000","last_became_active":"2023-11-28T13:00:26.014153+0000","last_became_peered":"2023-11-28T13:00:26.014153+0000","last_unstale":"2023-11-28T13:00:27.503912+0000","last_undegraded":"2023-11-28T13:00:27.503912+0000","last_fullsized":"2023-11-28T13:00:27.503912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:48.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402906+0000","last_change":"2023-11-28T13:00:25.632474+0000","last_active":"2023-11-28T13:00:27.402906+0000","last_peered":"2023-11-28T13:00:27.402906+0000","last_clean":"2023-11-28T13:00:27.402906+0000","last_became_active":"2023-11-28T13:00:25.632080+0000","last_became_peered":"2023-11-28T13:00:25.632080+0000","last_unstale":"2023-11-28T13:00:27.402906+0000","last_undegraded":"2023-11-28T13:00:27.402906+0000","last_fullsized":"2023-11-28T13:00:27.402906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:56:21.848420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505385+0000","last_change":"2023-11-28T13:00:26.011716+0000","last_active":"2023-11-28T13:00:27.505385+0000","last_peered":"2023-11-28T13:00:27.505385+0000","last_clean":"2023-11-28T13:00:27.505385+0000","last_became_active":"2023-11-28T13:00:26.011453+0000","last_became_peered":"2023-11-28T13:00:26.011453+0000","last_unstale":"2023-11-28T13:00:27.505385+0000","last_undegraded":"2023-11-28T13:00:27.505385+0000","last_fullsized":"2023-11-28T13:00:27.505385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.995720+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:00:25.995720+0000","last_peered":"2023-11-28T13:00:25.995720+0000","last_clean":"2023-11-28T13:00:25.995720+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:00:25.995720+0000","last_undegraded":"2023-11-28T13:00:25.995720+0000","last_fullsized":"2023-11-28T13:00:25.995720+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.990032+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:00:25.990032+0000","last_peered":"2023-11-28T13:00:25.990032+0000","last_clean":"2023-11-28T13:00:25.990032+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:00:25.990032+0000","last_undegraded":"2023-11-28T13:00:25.990032+0000","last_fullsized":"2023-11-28T13:00:25.990032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403785+0000","last_change":"2023-11-28T13:00:25.627086+0000","last_active":"2023-11-28T13:00:27.403785+0000","last_peered":"2023-11-28T13:00:27.403785+0000","last_clean":"2023-11-28T13:00:27.403785+0000","last_became_active":"2023-11-28T13:00:25.626755+0000","last_became_peered":"2023-11-28T13:00:25.626755+0000","last_unstale":"2023-11-28T13:00:27.403785+0000","last_undegraded":"2023-11-28T13:00:27.403785+0000","last_fullsized":"2023-11-28T13:00:27.403785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:32:19.210037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.993350+0000","last_change":"2023-11-28T13:00:26.009618+0000","last_active":"2023-11-28T13:00:26.993350+0000","last_peered":"2023-11-28T13:00:26.993350+0000","last_clean":"2023-11-28T13:00:26.993350+0000","last_became_active":"2023-11-28T13:00:26.008633+0000","last_became_peered":"2023-11-28T13:00:26.008633+0000","last_unstale":"2023-11-28T13:00:26.993350+0000","last_undegraded":"2023-11-28T13:00:26.993350+0000","last_fullsized":"2023-11-28T13:00:26.993350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:21:39.677078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.995631+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:00:25.995631+0000","last_peered":"2023-11-28T13:00:25.995631+0000","last_clean":"2023-11-28T13:00:25.995631+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:00:25.995631+0000","last_undegraded":"2023-11-28T13:00:25.995631+0000","last_fullsized":"2023-11-28T13:00:25.995631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502951+0000","last_change":"2023-11-28T13:00:25.629873+0000","last_active":"2023-11-28T13:00:27.502951+0000","last_peered":"2023-11-28T13:00:27.502951+0000","last_clean":"2023-11-28T13:00:27.502951+0000","last_became_active":"2023-11-28T13:00:25.629457+0000","last_became_peered":"2023-11-28T13:00:25.629457+0000","last_unstale":"2023-11-28T13:00:27.502951+0000","last_undegraded":"2023-11-28T13:00:27.502951+0000","last_fullsized":"2023-11-28T13:00:27.502951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:52.456316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504069+0000","last_change":"2023-11-28T13:00:26.002978+0000","last_active":"2023-11-28T13:00:27.504069+0000","last_peered":"2023-11-28T13:00:27.504069+0000","last_clean":"2023-11-28T13:00:27.504069+0000","last_became_active":"2023-11-28T13:00:26.002741+0000","last_became_peered":"2023-11-28T13:00:26.002741+0000","last_unstale":"2023-11-28T13:00:27.504069+0000","last_undegraded":"2023-11-28T13:00:27.504069+0000","last_fullsized":"2023-11-28T13:00:27.504069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:21.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.997886+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:00:25.997886+0000","last_peered":"2023-11-28T13:00:25.997886+0000","last_clean":"2023-11-28T13:00:25.997886+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:00:25.997886+0000","last_undegraded":"2023-11-28T13:00:25.997886+0000","last_fullsized":"2023-11-28T13:00:25.997886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504850+0000","last_change":"2023-11-28T13:00:25.621539+0000","last_active":"2023-11-28T13:00:27.504850+0000","last_peered":"2023-11-28T13:00:27.504850+0000","last_clean":"2023-11-28T13:00:27.504850+0000","last_became_active":"2023-11-28T13:00:25.621220+0000","last_became_peered":"2023-11-28T13:00:25.621220+0000","last_unstale":"2023-11-28T13:00:27.504850+0000","last_undegraded":"2023-11-28T13:00:27.504850+0000","last_fullsized":"2023-11-28T13:00:27.504850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:03.287202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505586+0000","last_change":"2023-11-28T13:00:26.001811+0000","last_active":"2023-11-28T13:00:27.505586+0000","last_peered":"2023-11-28T13:00:27.505586+0000","last_clean":"2023-11-28T13:00:27.505586+0000","last_became_active":"2023-11-28T13:00:26.001553+0000","last_became_peered":"2023-11-28T13:00:26.001553+0000","last_unstale":"2023-11-28T13:00:27.505586+0000","last_undegraded":"2023-11-28T13:00:27.505586+0000","last_fullsized":"2023-11-28T13:00:27.505586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:06.130572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.990083+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:00:25.990083+0000","last_peered":"2023-11-28T13:00:25.990083+0000","last_clean":"2023-11-28T13:00:25.990083+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:00:25.990083+0000","last_undegraded":"2023-11-28T13:00:25.990083+0000","last_fullsized":"2023-11-28T13:00:25.990083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503523+0000","last_change":"2023-11-28T13:00:25.629807+0000","last_active":"2023-11-28T13:00:27.503523+0000","last_peered":"2023-11-28T13:00:27.503523+0000","last_clean":"2023-11-28T13:00:27.503523+0000","last_became_active":"2023-11-28T13:00:25.629543+0000","last_became_peered":"2023-11-28T13:00:25.629543+0000","last_unstale":"2023-11-28T13:00:27.503523+0000","last_undegraded":"2023-11-28T13:00:27.503523+0000","last_fullsized":"2023-11-28T13:00:27.503523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:23.365345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504188+0000","last_change":"2023-11-28T13:00:26.003695+0000","last_active":"2023-11-28T13:00:27.504188+0000","last_peered":"2023-11-28T13:00:27.504188+0000","last_clean":"2023-11-28T13:00:27.504188+0000","last_became_active":"2023-11-28T13:00:26.002498+0000","last_became_peered":"2023-11-28T13:00:26.002498+0000","last_unstale":"2023-11-28T13:00:27.504188+0000","last_undegraded":"2023-11-28T13:00:27.504188+0000","last_fullsized":"2023-11-28T13:00:27.504188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:45.855825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229716+0000","last_change":"2023-11-28T13:00:25.630163+0000","last_active":"2023-11-28T13:00:27.229716+0000","last_peered":"2023-11-28T13:00:27.229716+0000","last_clean":"2023-11-28T13:00:27.229716+0000","last_became_active":"2023-11-28T13:00:25.629892+0000","last_became_peered":"2023-11-28T13:00:25.629892+0000","last_unstale":"2023-11-28T13:00:27.229716+0000","last_undegraded":"2023-11-28T13:00:27.229716+0000","last_fullsized":"2023-11-28T13:00:27.229716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:34:17.734156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.992840+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:00:25.992840+0000","last_peered":"2023-11-28T13:00:25.992840+0000","last_clean":"2023-11-28T13:00:25.992840+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:00:25.992840+0000","last_undegraded":"2023-11-28T13:00:25.992840+0000","last_fullsized":"2023-11-28T13:00:25.992840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505455+0000","last_change":"2023-11-28T13:00:26.002290+0000","last_active":"2023-11-28T13:00:27.505455+0000","last_peered":"2023-11-28T13:00:27.505455+0000","last_clean":"2023-11-28T13:00:27.505455+0000","last_became_active":"2023-11-28T13:00:26.002028+0000","last_became_peered":"2023-11-28T13:00:26.002028+0000","last_unstale":"2023-11-28T13:00:27.505455+0000","last_undegraded":"2023-11-28T13:00:27.505455+0000","last_fullsized":"2023-11-28T13:00:27.505455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:54.006637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504302+0000","last_change":"2023-11-28T13:00:25.631032+0000","last_active":"2023-11-28T13:00:27.504302+0000","last_peered":"2023-11-28T13:00:27.504302+0000","last_clean":"2023-11-28T13:00:27.504302+0000","last_became_active":"2023-11-28T13:00:25.630748+0000","last_became_peered":"2023-11-28T13:00:25.630748+0000","last_unstale":"2023-11-28T13:00:27.504302+0000","last_undegraded":"2023-11-28T13:00:27.504302+0000","last_fullsized":"2023-11-28T13:00:27.504302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:52.456316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.997737+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:00:25.997737+0000","last_peered":"2023-11-28T13:00:25.997737+0000","last_clean":"2023-11-28T13:00:25.997737+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:00:25.997737+0000","last_undegraded":"2023-11-28T13:00:25.997737+0000","last_fullsized":"2023-11-28T13:00:25.997737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503588+0000","last_change":"2023-11-28T13:00:25.999551+0000","last_active":"2023-11-28T13:00:27.503588+0000","last_peered":"2023-11-28T13:00:27.503588+0000","last_clean":"2023-11-28T13:00:27.503588+0000","last_became_active":"2023-11-28T13:00:25.999290+0000","last_became_peered":"2023-11-28T13:00:25.999290+0000","last_unstale":"2023-11-28T13:00:27.503588+0000","last_undegraded":"2023-11-28T13:00:27.503588+0000","last_fullsized":"2023-11-28T13:00:27.503588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:21:39.677078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403966+0000","last_change":"2023-11-28T13:00:25.631577+0000","last_active":"2023-11-28T13:00:27.403966+0000","last_peered":"2023-11-28T13:00:27.403966+0000","last_clean":"2023-11-28T13:00:27.403966+0000","last_became_active":"2023-11-28T13:00:25.631270+0000","last_became_peered":"2023-11-28T13:00:25.631270+0000","last_unstale":"2023-11-28T13:00:27.403966+0000","last_undegraded":"2023-11-28T13:00:27.403966+0000","last_fullsized":"2023-11-28T13:00:27.403966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:34:17.734156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.993702+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:00:25.993702+0000","last_peered":"2023-11-28T13:00:25.993702+0000","last_clean":"2023-11-28T13:00:25.993702+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:00:25.993702+0000","last_undegraded":"2023-11-28T13:00:25.993702+0000","last_fullsized":"2023-11-28T13:00:25.993702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402698+0000","last_change":"2023-11-28T13:00:26.009259+0000","last_active":"2023-11-28T13:00:27.402698+0000","last_peered":"2023-11-28T13:00:27.402698+0000","last_clean":"2023-11-28T13:00:27.402698+0000","last_became_active":"2023-11-28T13:00:26.007917+0000","last_became_peered":"2023-11-28T13:00:26.007917+0000","last_unstale":"2023-11-28T13:00:27.402698+0000","last_undegraded":"2023-11-28T13:00:27.402698+0000","last_fullsized":"2023-11-28T13:00:27.402698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:29.144541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:29.185383+0000","last_change":"2023-11-28T13:00:25.633467+0000","last_active":"2023-11-28T13:00:29.185383+0000","last_peered":"2023-11-28T13:00:29.185383+0000","last_clean":"2023-11-28T13:00:29.185383+0000","last_became_active":"2023-11-28T13:00:25.633133+0000","last_became_peered":"2023-11-28T13:00:25.633133+0000","last_unstale":"2023-11-28T13:00:29.185383+0000","last_undegraded":"2023-11-28T13:00:29.185383+0000","last_fullsized":"2023-11-28T13:00:29.185383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:15.734182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-28T13:00:25.993588+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:00:25.993588+0000","last_peered":"2023-11-28T13:00:25.993588+0000","last_clean":"2023-11-28T13:00:25.993588+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:00:25.993588+0000","last_undegraded":"2023-11-28T13:00:25.993588+0000","last_fullsized":"2023-11-28T13:00:25.993588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502968+0000","last_change":"2023-11-28T13:00:26.007959+0000","last_active":"2023-11-28T13:00:27.502968+0000","last_peered":"2023-11-28T13:00:27.502968+0000","last_clean":"2023-11-28T13:00:27.502968+0000","last_became_active":"2023-11-28T13:00:26.006990+0000","last_became_peered":"2023-11-28T13:00:26.006990+0000","last_unstale":"2023-11-28T13:00:27.502968+0000","last_undegraded":"2023-11-28T13:00:27.502968+0000","last_fullsized":"2023-11-28T13:00:27.502968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:50.521471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503474+0000","last_change":"2023-11-28T13:00:26.014623+0000","last_active":"2023-11-28T13:00:27.503474+0000","last_peered":"2023-11-28T13:00:27.503474+0000","last_clean":"2023-11-28T13:00:27.503474+0000","last_became_active":"2023-11-28T13:00:26.014249+0000","last_became_peered":"2023-11-28T13:00:26.014249+0000","last_unstale":"2023-11-28T13:00:27.503474+0000","last_undegraded":"2023-11-28T13:00:27.503474+0000","last_fullsized":"2023-11-28T13:00:27.503474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:28:40.766436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503686+0000","last_change":"2023-11-28T13:00:25.617793+0000","last_active":"2023-11-28T13:00:27.503686+0000","last_peered":"2023-11-28T13:00:27.503686+0000","last_clean":"2023-11-28T13:00:27.503686+0000","last_became_active":"2023-11-28T13:00:25.616865+0000","last_became_peered":"2023-11-28T13:00:25.616865+0000","last_unstale":"2023-11-28T13:00:27.503686+0000","last_undegraded":"2023-11-28T13:00:27.503686+0000","last_fullsized":"2023-11-28T13:00:27.503686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:57.620680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.505139+0000","last_change":"2023-11-28T13:00:26.011957+0000","last_active":"2023-11-28T13:00:27.505139+0000","last_peered":"2023-11-28T13:00:27.505139+0000","last_clean":"2023-11-28T13:00:27.505139+0000","last_became_active":"2023-11-28T13:00:26.011673+0000","last_became_peered":"2023-11-28T13:00:26.011673+0000","last_unstale":"2023-11-28T13:00:27.505139+0000","last_undegraded":"2023-11-28T13:00:27.505139+0000","last_fullsized":"2023-11-28T13:00:27.505139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:19.044875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.992231+0000","last_change":"2023-11-28T13:00:25.630855+0000","last_active":"2023-11-28T13:00:26.992231+0000","last_peered":"2023-11-28T13:00:26.992231+0000","last_clean":"2023-11-28T13:00:26.992231+0000","last_became_active":"2023-11-28T13:00:25.630456+0000","last_became_peered":"2023-11-28T13:00:25.630456+0000","last_unstale":"2023-11-28T13:00:26.992231+0000","last_undegraded":"2023-11-28T13:00:26.992231+0000","last_fullsized":"2023-11-28T13:00:26.992231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:21:38.662388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229731+0000","last_change":"2023-11-28T13:00:25.624834+0000","last_active":"2023-11-28T13:00:27.229731+0000","last_peered":"2023-11-28T13:00:27.229731+0000","last_clean":"2023-11-28T13:00:27.229731+0000","last_became_active":"2023-11-28T13:00:25.624567+0000","last_became_peered":"2023-11-28T13:00:25.624567+0000","last_unstale":"2023-11-28T13:00:27.229731+0000","last_undegraded":"2023-11-28T13:00:27.229731+0000","last_fullsized":"2023-11-28T13:00:27.229731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:45:07.677424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402974+0000","last_change":"2023-11-28T13:00:26.010470+0000","last_active":"2023-11-28T13:00:27.402974+0000","last_peered":"2023-11-28T13:00:27.402974+0000","last_clean":"2023-11-28T13:00:27.402974+0000","last_became_active":"2023-11-28T13:00:26.009766+0000","last_became_peered":"2023-11-28T13:00:26.009766+0000","last_unstale":"2023-11-28T13:00:27.402974+0000","last_undegraded":"2023-11-28T13:00:27.402974+0000","last_fullsized":"2023-11-28T13:00:27.402974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:12:32.057680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504129+0000","last_change":"2023-11-28T13:00:25.629269+0000","last_active":"2023-11-28T13:00:27.504129+0000","last_peered":"2023-11-28T13:00:27.504129+0000","last_clean":"2023-11-28T13:00:27.504129+0000","last_became_active":"2023-11-28T13:00:25.628831+0000","last_became_peered":"2023-11-28T13:00:25.628831+0000","last_unstale":"2023-11-28T13:00:27.504129+0000","last_undegraded":"2023-11-28T13:00:27.504129+0000","last_fullsized":"2023-11-28T13:00:27.504129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:32:19.210037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402564+0000","last_change":"2023-11-28T13:00:26.015219+0000","last_active":"2023-11-28T13:00:27.402564+0000","last_peered":"2023-11-28T13:00:27.402564+0000","last_clean":"2023-11-28T13:00:27.402564+0000","last_became_active":"2023-11-28T13:00:26.014925+0000","last_became_peered":"2023-11-28T13:00:26.014925+0000","last_unstale":"2023-11-28T13:00:27.402564+0000","last_undegraded":"2023-11-28T13:00:27.402564+0000","last_fullsized":"2023-11-28T13:00:27.402564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:18:51.214695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.993563+0000","last_change":"2023-11-28T13:00:26.008486+0000","last_active":"2023-11-28T13:00:26.993563+0000","last_peered":"2023-11-28T13:00:26.993563+0000","last_clean":"2023-11-28T13:00:26.993563+0000","last_became_active":"2023-11-28T13:00:26.008210+0000","last_became_peered":"2023-11-28T13:00:26.008210+0000","last_unstale":"2023-11-28T13:00:26.993563+0000","last_undegraded":"2023-11-28T13:00:26.993563+0000","last_fullsized":"2023-11-28T13:00:26.993563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:53.611895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.402778+0000","last_change":"2023-11-28T13:00:25.630302+0000","last_active":"2023-11-28T13:00:27.402778+0000","last_peered":"2023-11-28T13:00:27.402778+0000","last_clean":"2023-11-28T13:00:27.402778+0000","last_became_active":"2023-11-28T13:00:25.629349+0000","last_became_peered":"2023-11-28T13:00:25.629349+0000","last_unstale":"2023-11-28T13:00:27.402778+0000","last_undegraded":"2023-11-28T13:00:27.402778+0000","last_fullsized":"2023-11-28T13:00:27.402778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:15.734182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504240+0000","last_change":"2023-11-28T13:00:26.013956+0000","last_active":"2023-11-28T13:00:27.504240+0000","last_peered":"2023-11-28T13:00:27.504240+0000","last_clean":"2023-11-28T13:00:27.504240+0000","last_became_active":"2023-11-28T13:00:26.013605+0000","last_became_peered":"2023-11-28T13:00:26.013605+0000","last_unstale":"2023-11-28T13:00:27.504240+0000","last_undegraded":"2023-11-28T13:00:27.504240+0000","last_fullsized":"2023-11-28T13:00:27.504240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:54.006637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504825+0000","last_change":"2023-11-28T13:00:25.631060+0000","last_active":"2023-11-28T13:00:27.504825+0000","last_peered":"2023-11-28T13:00:27.504825+0000","last_clean":"2023-11-28T13:00:27.504825+0000","last_became_active":"2023-11-28T13:00:25.630788+0000","last_became_peered":"2023-11-28T13:00:25.630788+0000","last_unstale":"2023-11-28T13:00:27.504825+0000","last_undegraded":"2023-11-28T13:00:27.504825+0000","last_fullsized":"2023-11-28T13:00:27.504825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:32:19.210037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403416+0000","last_change":"2023-11-28T13:00:26.006323+0000","last_active":"2023-11-28T13:00:27.403416+0000","last_peered":"2023-11-28T13:00:27.403416+0000","last_clean":"2023-11-28T13:00:27.403416+0000","last_became_active":"2023-11-28T13:00:26.004227+0000","last_became_peered":"2023-11-28T13:00:26.004227+0000","last_unstale":"2023-11-28T13:00:27.403416+0000","last_undegraded":"2023-11-28T13:00:27.403416+0000","last_fullsized":"2023-11-28T13:00:27.403416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:28:40.766436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503349+0000","last_change":"2023-11-28T13:00:25.631107+0000","last_active":"2023-11-28T13:00:27.503349+0000","last_peered":"2023-11-28T13:00:27.503349+0000","last_clean":"2023-11-28T13:00:27.503349+0000","last_became_active":"2023-11-28T13:00:25.630796+0000","last_became_peered":"2023-11-28T13:00:25.630796+0000","last_unstale":"2023-11-28T13:00:27.503349+0000","last_undegraded":"2023-11-28T13:00:27.503349+0000","last_fullsized":"2023-11-28T13:00:27.503349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:00:19.501393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:26.987768+0000","last_change":"2023-11-28T13:00:26.003801+0000","last_active":"2023-11-28T13:00:26.987768+0000","last_peered":"2023-11-28T13:00:26.987768+0000","last_clean":"2023-11-28T13:00:26.987768+0000","last_became_active":"2023-11-28T13:00:26.003286+0000","last_became_peered":"2023-11-28T13:00:26.003286+0000","last_unstale":"2023-11-28T13:00:26.987768+0000","last_undegraded":"2023-11-28T13:00:26.987768+0000","last_fullsized":"2023-11-28T13:00:26.987768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:34:18.748847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503812+0000","last_change":"2023-11-28T13:00:25.630853+0000","last_active":"2023-11-28T13:00:27.503812+0000","last_peered":"2023-11-28T13:00:27.503812+0000","last_clean":"2023-11-28T13:00:27.503812+0000","last_became_active":"2023-11-28T13:00:25.630524+0000","last_became_peered":"2023-11-28T13:00:25.630524+0000","last_unstale":"2023-11-28T13:00:27.503812+0000","last_undegraded":"2023-11-28T13:00:27.503812+0000","last_fullsized":"2023-11-28T13:00:27.503812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:57.620680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503291+0000","last_change":"2023-11-28T13:00:26.015790+0000","last_active":"2023-11-28T13:00:27.503291+0000","last_peered":"2023-11-28T13:00:27.503291+0000","last_clean":"2023-11-28T13:00:27.503291+0000","last_became_active":"2023-11-28T13:00:26.015455+0000","last_became_peered":"2023-11-28T13:00:26.015455+0000","last_unstale":"2023-11-28T13:00:27.503291+0000","last_undegraded":"2023-11-28T13:00:27.503291+0000","last_fullsized":"2023-11-28T13:00:27.503291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:14.020668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229251+0000","last_change":"2023-11-28T13:00:25.628221+0000","last_active":"2023-11-28T13:00:27.229251+0000","last_peered":"2023-11-28T13:00:27.229251+0000","last_clean":"2023-11-28T13:00:27.229251+0000","last_became_active":"2023-11-28T13:00:25.627937+0000","last_became_peered":"2023-11-28T13:00:25.627937+0000","last_unstale":"2023-11-28T13:00:27.229251+0000","last_undegraded":"2023-11-28T13:00:27.229251+0000","last_fullsized":"2023-11-28T13:00:27.229251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:06:47.002190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.503100+0000","last_change":"2023-11-28T13:00:26.016462+0000","last_active":"2023-11-28T13:00:27.503100+0000","last_peered":"2023-11-28T13:00:27.503100+0000","last_clean":"2023-11-28T13:00:27.503100+0000","last_became_active":"2023-11-28T13:00:26.016156+0000","last_became_peered":"2023-11-28T13:00:26.016156+0000","last_unstale":"2023-11-28T13:00:27.503100+0000","last_undegraded":"2023-11-28T13:00:27.503100+0000","last_fullsized":"2023-11-28T13:00:27.503100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:13:57.056758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.229580+0000","last_change":"2023-11-28T13:00:25.629372+0000","last_active":"2023-11-28T13:00:27.229580+0000","last_peered":"2023-11-28T13:00:27.229580+0000","last_clean":"2023-11-28T13:00:27.229580+0000","last_became_active":"2023-11-28T13:00:25.629083+0000","last_became_peered":"2023-11-28T13:00:25.629083+0000","last_unstale":"2023-11-28T13:00:27.229580+0000","last_undegraded":"2023-11-28T13:00:27.229580+0000","last_fullsized":"2023-11-28T13:00:27.229580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:52.597204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403082+0000","last_change":"2023-11-28T13:00:26.006858+0000","last_active":"2023-11-28T13:00:27.403082+0000","last_peered":"2023-11-28T13:00:27.403082+0000","last_clean":"2023-11-28T13:00:27.403082+0000","last_became_active":"2023-11-28T13:00:26.006232+0000","last_became_peered":"2023-11-28T13:00:26.006232+0000","last_unstale":"2023-11-28T13:00:27.403082+0000","last_undegraded":"2023-11-28T13:00:27.403082+0000","last_fullsized":"2023-11-28T13:00:27.403082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:47.321386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.403725+0000","last_change":"2023-11-28T13:00:25.628879+0000","last_active":"2023-11-28T13:00:27.403725+0000","last_peered":"2023-11-28T13:00:27.403725+0000","last_clean":"2023-11-28T13:00:27.403725+0000","last_became_active":"2023-11-28T13:00:25.628575+0000","last_became_peered":"2023-11-28T13:00:25.628575+0000","last_unstale":"2023-11-28T13:00:27.403725+0000","last_undegraded":"2023-11-28T13:00:27.403725+0000","last_fullsized":"2023-11-28T13:00:27.403725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:52.456316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.502869+0000","last_change":"2023-11-28T13:00:26.014792+0000","last_active":"2023-11-28T13:00:27.502869+0000","last_peered":"2023-11-28T13:00:27.502869+0000","last_clean":"2023-11-28T13:00:27.502869+0000","last_became_active":"2023-11-28T13:00:26.014392+0000","last_became_peered":"2023-11-28T13:00:26.014392+0000","last_unstale":"2023-11-28T13:00:27.502869+0000","last_undegraded":"2023-11-28T13:00:27.502869+0000","last_fullsized":"2023-11-28T13:00:27.502869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:25.590548+0000","last_clean_scrub_stamp":"2023-11-28T13:00:25.590548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:57:47.321386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T13:00:27.504024+0000","last_change":"2023-11-28T13:00:25.630162+0000","last_active":"2023-11-28T13:00:27.504024+0000","last_peered":"2023-11-28T13:00:27.504024+0000","last_clean":"2023-11-28T13:00:27.504024+0000","last_became_active":"2023-11-28T13:00:25.629159+0000","last_became_peered":"2023-11-28T13:00:25.629159+0000","last_unstale":"2023-11-28T13:00:27.504024+0000","last_undegraded":"2023-11-28T13:00:27.504024+0000","last_fullsized":"2023-11-28T13:00:27.504024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:24.575857+0000","last_clean_scrub_stamp":"2023-11-28T13:00:24.575857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:56:21.848420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9120,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362720,"statfs":{"total":96636764160,"available":96627425280,"internally_reserved":0,"allocated":876544,"data_stored":686402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8008,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363832,"statfs":{"total":96636764160,"available":96628563968,"internally_reserved":0,"allocated":262144,"data_stored":94906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":95874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8068,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363772,"statfs":{"total":96636764160,"available":96628502528,"internally_reserved":0,"allocated":258048,"data_stored":94360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8064,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363776,"statfs":{"total":96636764160,"available":96628506624,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4910000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9096,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362744,"statfs":{"total":96636764160,"available":96627449856,"internally_reserved":0,"allocated":851968,"data_stored":685204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:00:38.665 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T13:00:38.666 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-28T13:00:38.666 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-28T13:00:38.666 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:00:38.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.764+0000 7f569e025700 1 Processor -- start 2023-11-28T13:00:38.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.764+0000 7f569e025700 1 -- start start 2023-11-28T13:00:38.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569e025700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f569815a430 0x7f569806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:38.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569e025700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f569806d3d0 0x7f569806d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:38.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569e025700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f56980710b0 0x7f56980714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:38.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569e025700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569806dd60 con 0x7f56980710b0 2023-11-28T13:00:38.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569e025700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569815ddc0 con 0x7f569806d3d0 2023-11-28T13:00:38.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569e025700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569815e010 con 0x7f569815a430 2023-11-28T13:00:38.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569d824700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f56980710b0 0x7f56980714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:38.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569d824700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f56980710b0 0x7f56980714f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50870/0 (socket says 172.21.15.82:50870) 2023-11-28T13:00:38.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569d824700 1 -- 172.21.15.82:0/51981430 learned_addr learned my addr 172.21.15.82:0/51981430 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:38.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569c822700 1 --2- 172.21.15.82:0/51981430 >> v2:172.21.15.114:3300/0 conn(0x7f569806d3d0 0x7f569806d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:38.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569d023700 1 --2- 172.21.15.82:0/51981430 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f569815a430 0x7f569806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:38.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569d824700 1 -- 172.21.15.82:0/51981430 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f569815a430 msgr2=0x7f569806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:38.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569d824700 1 --2- 172.21.15.82:0/51981430 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f569815a430 0x7f569806c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569d824700 1 -- 172.21.15.82:0/51981430 >> v2:172.21.15.114:3300/0 conn(0x7f569806d3d0 msgr2=0x7f569806d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:38.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569d824700 1 --2- 172.21.15.82:0/51981430 >> v2:172.21.15.114:3300/0 conn(0x7f569806d3d0 0x7f569806d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569d824700 1 -- 172.21.15.82:0/51981430 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569815e2f0 con 0x7f56980710b0 2023-11-28T13:00:38.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569d824700 1 --2- 172.21.15.82:0/51981430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56980710b0 0x7f56980714f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f56980cf600 tx=0x7f569000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c540a9311b495ca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:38.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f568ffff700 1 -- 172.21.15.82:0/51981430 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569000e070 con 0x7f56980710b0 2023-11-28T13:00:38.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f568ffff700 1 -- 172.21.15.82:0/51981430 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569000b910 con 0x7f56980710b0 2023-11-28T13:00:38.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f568ffff700 1 -- 172.21.15.82:0/51981430 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569000bcc0 con 0x7f56980710b0 2023-11-28T13:00:38.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569e025700 1 -- 172.21.15.82:0/51981430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56980710b0 msgr2=0x7f56980714f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569e025700 1 --2- 172.21.15.82:0/51981430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56980710b0 0x7f56980714f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f56980cf600 tx=0x7f569000b330 comp rx=0 tx=0).stop 2023-11-28T13:00:38.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569e025700 1 -- 172.21.15.82:0/51981430 shutdown_connections 2023-11-28T13:00:38.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569e025700 1 --2- 172.21.15.82:0/51981430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56980710b0 0x7f56980714f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569e025700 1 --2- 172.21.15.82:0/51981430 >> v2:172.21.15.114:3300/0 conn(0x7f569806d3d0 0x7f569806d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569e025700 1 --2- 172.21.15.82:0/51981430 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f569815a430 0x7f569806c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569e025700 1 -- 172.21.15.82:0/51981430 >> 172.21.15.82:0/51981430 conn(0x7f56980cf710 msgr2=0x7f56980cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:38.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569e025700 1 -- 172.21.15.82:0/51981430 shutdown_connections 2023-11-28T13:00:38.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569e025700 1 -- 172.21.15.82:0/51981430 wait complete. 2023-11-28T13:00:38.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569e025700 1 Processor -- start 2023-11-28T13:00:38.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.768+0000 7f569e025700 1 -- start start 2023-11-28T13:00:38.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569e025700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f569806d3d0 0x7f5698153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:38.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569e025700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56980710b0 0x7f56980c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:38.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569e025700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f56980c80d0 0x7f56980ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:38.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569e025700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5698155f80 con 0x7f56980710b0 2023-11-28T13:00:38.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569e025700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5698158c80 con 0x7f569806d3d0 2023-11-28T13:00:38.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569e025700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56981561f0 con 0x7f56980c80d0 2023-11-28T13:00:38.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569c822700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56980710b0 0x7f56980c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:38.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569c822700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56980710b0 0x7f56980c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50876/0 (socket says 172.21.15.82:50876) 2023-11-28T13:00:38.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569c822700 1 -- 172.21.15.82:0/3004528778 learned_addr learned my addr 172.21.15.82:0/3004528778 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:38.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569d824700 1 --2- 172.21.15.82:0/3004528778 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f56980c80d0 0x7f56980ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:38.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569d023700 1 --2- 172.21.15.82:0/3004528778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f569806d3d0 0x7f5698153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:38.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569c822700 1 -- 172.21.15.82:0/3004528778 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f56980c80d0 msgr2=0x7f56980ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569c822700 1 --2- 172.21.15.82:0/3004528778 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f56980c80d0 0x7f56980ca4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569c822700 1 -- 172.21.15.82:0/3004528778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f569806d3d0 msgr2=0x7f5698153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569c822700 1 --2- 172.21.15.82:0/3004528778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f569806d3d0 0x7f5698153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569c822700 1 -- 172.21.15.82:0/3004528778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5690009b30 con 0x7f56980710b0 2023-11-28T13:00:38.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569d023700 1 --2- 172.21.15.82:0/3004528778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f569806d3d0 0x7f5698153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:38.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569d824700 1 --2- 172.21.15.82:0/3004528778 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f56980c80d0 0x7f56980ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:38.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569c822700 1 --2- 172.21.15.82:0/3004528778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56980710b0 0x7f56980c7b90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f568800e7c0 tx=0x7f568800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:38.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f568dffb700 1 -- 172.21.15.82:0/3004528778 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688013680 con 0x7f56980710b0 2023-11-28T13:00:38.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f568dffb700 1 -- 172.21.15.82:0/3004528778 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56880137e0 con 0x7f56980710b0 2023-11-28T13:00:38.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569e025700 1 -- 172.21.15.82:0/3004528778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569815e8b0 con 0x7f56980710b0 2023-11-28T13:00:38.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f568dffb700 1 -- 172.21.15.82:0/3004528778 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688013b90 con 0x7f56980710b0 2023-11-28T13:00:38.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569e025700 1 -- 172.21.15.82:0/3004528778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569815e5d0 con 0x7f56980710b0 2023-11-28T13:00:38.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.772+0000 7f569e025700 1 -- 172.21.15.82:0/3004528778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569806cd00 con 0x7f56980710b0 2023-11-28T13:00:38.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.776+0000 7f568dffb700 1 -- 172.21.15.82:0/3004528778 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5688019030 con 0x7f56980710b0 2023-11-28T13:00:38.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.776+0000 7f568dffb700 1 --2- 172.21.15.82:0/3004528778 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f567c064f10 0x7f567c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:38.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.776+0000 7f569d023700 1 --2- 172.21.15.82:0/3004528778 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f567c064f10 0x7f567c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:38.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.776+0000 7f568dffb700 1 -- 172.21.15.82:0/3004528778 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f56880824d0 con 0x7f56980710b0 2023-11-28T13:00:38.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.776+0000 7f569d023700 1 --2- 172.21.15.82:0/3004528778 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f567c064f10 0x7f567c0673c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5694009c40 tx=0x7f5694008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:38.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.784+0000 7f568dffb700 1 -- 172.21.15.82:0/3004528778 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5688050600 con 0x7f56980710b0 2023-11-28T13:00:38.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.964+0000 7f569e025700 1 -- 172.21.15.82:0/3004528778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5698065fc0 con 0x7f56980710b0 2023-11-28T13:00:38.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.964+0000 7f568dffb700 1 -- 172.21.15.82:0/3004528778 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f5688053c20 con 0x7f56980710b0 2023-11-28T13:00:38.969 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:38.969 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-28T13:00:38.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.968+0000 7f569e025700 1 -- 172.21.15.82:0/3004528778 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f567c064f10 msgr2=0x7f567c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.968+0000 7f569e025700 1 --2- 172.21.15.82:0/3004528778 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f567c064f10 0x7f567c0673c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5694009c40 tx=0x7f5694008040 comp rx=0 tx=0).stop 2023-11-28T13:00:38.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.968+0000 7f569e025700 1 -- 172.21.15.82:0/3004528778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56980710b0 msgr2=0x7f56980c7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:38.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.968+0000 7f569e025700 1 --2- 172.21.15.82:0/3004528778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56980710b0 0x7f56980c7b90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f568800e7c0 tx=0x7f568800eb80 comp rx=0 tx=0).stop 2023-11-28T13:00:38.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.968+0000 7f569e025700 1 -- 172.21.15.82:0/3004528778 shutdown_connections 2023-11-28T13:00:38.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.968+0000 7f569e025700 1 --2- 172.21.15.82:0/3004528778 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f567c064f10 0x7f567c0673c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.968+0000 7f569e025700 1 --2- 172.21.15.82:0/3004528778 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f56980c80d0 0x7f56980ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.968+0000 7f569e025700 1 --2- 172.21.15.82:0/3004528778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56980710b0 0x7f56980c7b90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.968+0000 7f569e025700 1 --2- 172.21.15.82:0/3004528778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f569806d3d0 0x7f5698153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:38.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.968+0000 7f569e025700 1 -- 172.21.15.82:0/3004528778 >> 172.21.15.82:0/3004528778 conn(0x7f56980cf710 msgr2=0x7f56980afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:38.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.968+0000 7f569e025700 1 -- 172.21.15.82:0/3004528778 shutdown_connections 2023-11-28T13:00:38.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:38.968+0000 7f569e025700 1 -- 172.21.15.82:0/3004528778 wait complete. 2023-11-28T13:00:38.986 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-28T13:00:38.986 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:00:39.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.084+0000 7ff515cbc700 1 Processor -- start 2023-11-28T13:00:39.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.084+0000 7ff515cbc700 1 -- start start 2023-11-28T13:00:39.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.084+0000 7ff515cbc700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff51006b910 0x7ff510160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:39.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.084+0000 7ff515cbc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5100d28e0 con 0x7ff5100d06f0 2023-11-28T13:00:39.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.084+0000 7ff515cbc700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff510160cc0 con 0x7ff5100ced70 2023-11-28T13:00:39.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.084+0000 7ff515cbc700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100cdfe0 con 0x7ff51006b910 2023-11-28T13:00:39.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.084+0000 7ff5154bb700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff5100d06f0 0x7ff5100d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60552/0 (socket says 172.21.15.82:60552) 2023-11-28T13:00:39.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.084+0000 7ff5154bb700 1 -- 172.21.15.82:0/3143072139 learned_addr learned my addr 172.21.15.82:0/3143072139 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:39.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.084+0000 7ff514cba700 1 --2- 172.21.15.82:0/3143072139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff51006b910 0x7ff510160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:39.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.084+0000 7ff50f7fe700 1 -- 172.21.15.82:0/3143072139 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2386338170 0 0) 0x7ff508001490 con 0x7ff5100d06f0 2023-11-28T13:00:39.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.084+0000 7ff50f7fe700 1 -- 172.21.15.82:0/3143072139 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f80035d0 con 0x7ff5100d06f0 2023-11-28T13:00:39.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.084+0000 7ff50f7fe700 1 -- 172.21.15.82:0/3143072139 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838457627 0 0) 0x7ff510160cc0 con 0x7ff5100ced70 2023-11-28T13:00:39.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.084+0000 7ff50f7fe700 1 -- 172.21.15.82:0/3143072139 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff508001490 con 0x7ff5100ced70 2023-11-28T13:00:39.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.084+0000 7ff50f7fe700 1 -- 172.21.15.82:0/3143072139 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 480053407 0 0) 0x7ff4f80035d0 con 0x7ff5100d06f0 2023-11-28T13:00:39.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.084+0000 7ff514cba700 1 -- 172.21.15.82:0/3143072139 >> v1:172.21.15.114:6789/0 conn(0x7ff5100ced70 legacy=0x7ff51006bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:39.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.084+0000 7ff514cba700 1 -- 172.21.15.82:0/3143072139 >> v1:172.21.15.82:6789/0 conn(0x7ff5100d06f0 legacy=0x7ff5100d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:39.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.084+0000 7ff514cba700 1 -- 172.21.15.82:0/3143072139 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5100b2040 con 0x7ff51006b910 2023-11-28T13:00:39.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.084+0000 7ff514cba700 1 --2- 172.21.15.82:0/3143072139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff51006b910 0x7ff510160780 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff500009800 tx=0x7ff500009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9f5543beb086cfe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:39.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.084+0000 7ff50f7fe700 1 -- 172.21.15.82:0/3143072139 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508001b80 con 0x7ff51006b910 2023-11-28T13:00:39.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.084+0000 7ff50f7fe700 1 -- 172.21.15.82:0/3143072139 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff500010590 con 0x7ff51006b910 2023-11-28T13:00:39.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.084+0000 7ff50f7fe700 1 -- 172.21.15.82:0/3143072139 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff504001670 con 0x7ff51006b910 2023-11-28T13:00:39.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff515cbc700 1 -- 172.21.15.82:0/3143072139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff51006b910 msgr2=0x7ff510160780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:39.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff515cbc700 1 --2- 172.21.15.82:0/3143072139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff51006b910 0x7ff510160780 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff500009800 tx=0x7ff500009b90 comp rx=0 tx=0).stop 2023-11-28T13:00:39.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff515cbc700 1 -- 172.21.15.82:0/3143072139 shutdown_connections 2023-11-28T13:00:39.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff515cbc700 1 --2- 172.21.15.82:0/3143072139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff51006b910 0x7ff510160780 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff515cbc700 1 -- 172.21.15.82:0/3143072139 >> 172.21.15.82:0/3143072139 conn(0x7ff5100d2b20 msgr2=0x7ff5100d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:39.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff515cbc700 1 -- 172.21.15.82:0/3143072139 shutdown_connections 2023-11-28T13:00:39.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff515cbc700 1 -- 172.21.15.82:0/3143072139 wait complete. 2023-11-28T13:00:39.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff515cbc700 1 Processor -- start 2023-11-28T13:00:39.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff515cbc700 1 -- start start 2023-11-28T13:00:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff515cbc700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff51006b910 0x7ff5101f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff515cbc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5100ced70 0x7ff5100aa270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff515cbc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5100d06f0 0x7ff5101f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff515cbc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5101f2770 con 0x7ff5100d06f0 2023-11-28T13:00:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff515cbc700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5101f5ca0 con 0x7ff5100ced70 2023-11-28T13:00:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff515cbc700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5101f21b0 con 0x7ff51006b910 2023-11-28T13:00:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff5154bb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5100d06f0 0x7ff5101f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff5154bb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5100d06f0 0x7ff5101f17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50890/0 (socket says 172.21.15.82:50890) 2023-11-28T13:00:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff5154bb700 1 -- 172.21.15.82:0/4256505888 learned_addr learned my addr 172.21.15.82:0/4256505888 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff50ffff700 1 --2- 172.21.15.82:0/4256505888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5100ced70 0x7ff5100aa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff514cba700 1 --2- 172.21.15.82:0/4256505888 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff51006b910 0x7ff5101f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff5154bb700 1 -- 172.21.15.82:0/4256505888 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff51006b910 msgr2=0x7ff5101f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff5154bb700 1 --2- 172.21.15.82:0/4256505888 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff51006b910 0x7ff5101f5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff5154bb700 1 -- 172.21.15.82:0/4256505888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5100ced70 msgr2=0x7ff5100aa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff5154bb700 1 --2- 172.21.15.82:0/4256505888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5100ced70 0x7ff5100aa270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff5154bb700 1 -- 172.21.15.82:0/4256505888 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5000094b0 con 0x7ff5100d06f0 2023-11-28T13:00:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff50ffff700 1 --2- 172.21.15.82:0/4256505888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5100ced70 0x7ff5100aa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff5154bb700 1 --2- 172.21.15.82:0/4256505888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5100d06f0 0x7ff5101f17d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff508001460 tx=0x7ff50800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff50d7fa700 1 -- 172.21.15.82:0/4256505888 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50800ada0 con 0x7ff5100d06f0 2023-11-28T13:00:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff50d7fa700 1 -- 172.21.15.82:0/4256505888 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5080070d0 con 0x7ff5100d06f0 2023-11-28T13:00:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff50d7fa700 1 -- 172.21.15.82:0/4256505888 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508007440 con 0x7ff5100d06f0 2023-11-28T13:00:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff515cbc700 1 -- 172.21.15.82:0/4256505888 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5100d2320 con 0x7ff5100d06f0 2023-11-28T13:00:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.088+0000 7ff515cbc700 1 -- 172.21.15.82:0/4256505888 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5100cf2c0 con 0x7ff5100d06f0 2023-11-28T13:00:39.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.092+0000 7ff515cbc700 1 -- 172.21.15.82:0/4256505888 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5100d2600 con 0x7ff5100d06f0 2023-11-28T13:00:39.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.092+0000 7ff50d7fa700 1 -- 172.21.15.82:0/4256505888 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff508010070 con 0x7ff5100d06f0 2023-11-28T13:00:39.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.092+0000 7ff50d7fa700 1 --2- 172.21.15.82:0/4256505888 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff4fc064ee0 0x7ff4fc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:39.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.092+0000 7ff50d7fa700 1 -- 172.21.15.82:0/4256505888 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff508081910 con 0x7ff5100d06f0 2023-11-28T13:00:39.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.092+0000 7ff514cba700 1 --2- 172.21.15.82:0/4256505888 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff4fc064ee0 0x7ff4fc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:39.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.092+0000 7ff514cba700 1 --2- 172.21.15.82:0/4256505888 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff4fc064ee0 0x7ff4fc067390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff5000097d0 tx=0x7ff500010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:39.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.096+0000 7ff50d7fa700 1 -- 172.21.15.82:0/4256505888 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff50804fab0 con 0x7ff5100d06f0 2023-11-28T13:00:39.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.248+0000 7ff515cbc700 1 -- 172.21.15.82:0/4256505888 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5100d28e0 con 0x7ff5100d06f0 2023-11-28T13:00:39.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.252+0000 7ff50d7fa700 1 -- 172.21.15.82:0/4256505888 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17811 (secure 0 0 0) 0x7ff5100d28e0 con 0x7ff5100d06f0 2023-11-28T13:00:39.256 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:39.257 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:00:26.981345+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:00:24.360641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T13:00:24.960863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:00:39.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.256+0000 7ff515cbc700 1 -- 172.21.15.82:0/4256505888 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff4fc064ee0 msgr2=0x7ff4fc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:39.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.256+0000 7ff515cbc700 1 --2- 172.21.15.82:0/4256505888 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff4fc064ee0 0x7ff4fc067390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff5000097d0 tx=0x7ff500010000 comp rx=0 tx=0).stop 2023-11-28T13:00:39.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.256+0000 7ff515cbc700 1 -- 172.21.15.82:0/4256505888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5100d06f0 msgr2=0x7ff5101f17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:39.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.256+0000 7ff515cbc700 1 --2- 172.21.15.82:0/4256505888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5100d06f0 0x7ff5101f17d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff508001460 tx=0x7ff50800a340 comp rx=0 tx=0).stop 2023-11-28T13:00:39.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.256+0000 7ff515cbc700 1 -- 172.21.15.82:0/4256505888 shutdown_connections 2023-11-28T13:00:39.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.256+0000 7ff515cbc700 1 --2- 172.21.15.82:0/4256505888 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff4fc064ee0 0x7ff4fc067390 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.256+0000 7ff515cbc700 1 --2- 172.21.15.82:0/4256505888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5100d06f0 0x7ff5101f17d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.256+0000 7ff515cbc700 1 --2- 172.21.15.82:0/4256505888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5100ced70 0x7ff5100aa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.256+0000 7ff515cbc700 1 --2- 172.21.15.82:0/4256505888 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff51006b910 0x7ff5101f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.256+0000 7ff515cbc700 1 -- 172.21.15.82:0/4256505888 >> 172.21.15.82:0/4256505888 conn(0x7ff5100d2b20 msgr2=0x7ff5100d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:39.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.256+0000 7ff515cbc700 1 -- 172.21.15.82:0/4256505888 shutdown_connections 2023-11-28T13:00:39.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.256+0000 7ff515cbc700 1 -- 172.21.15.82:0/4256505888 wait complete. 2023-11-28T13:00:39.270 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T13:00:24.360641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T13:00:24.960863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:00:39.271 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:00:39.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.380+0000 7fae70a98700 1 Processor -- start 2023-11-28T13:00:39.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.380+0000 7fae70a98700 1 -- start start 2023-11-28T13:00:39.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.380+0000 7fae70a98700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fae6c156c50 0x7fae6c159f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:39.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.380+0000 7fae70a98700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fae6c06e2d0 0x7fae6c069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:39.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.380+0000 7fae70a98700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae6c0b2330 con 0x7fae6c0b1de0 2023-11-28T13:00:39.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.380+0000 7fae70a98700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae6c0b3400 con 0x7fae6c156c50 2023-11-28T13:00:39.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.380+0000 7fae70a98700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae6c15a480 con 0x7fae6c06e2d0 2023-11-28T13:00:39.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.380+0000 7fae6b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fae6c156c50 0x7fae6c159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:39.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.380+0000 7fae6b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fae6c156c50 0x7fae6c159f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50904/0 (socket says 172.21.15.82:50904) 2023-11-28T13:00:39.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.380+0000 7fae6b7fe700 1 -- 172.21.15.82:0/1316593188 learned_addr learned my addr 172.21.15.82:0/1316593188 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:39.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.380+0000 7fae6bfff700 1 --2- 172.21.15.82:0/1316593188 >> v2:172.21.15.114:3300/0 conn(0x7fae6c06e2d0 0x7fae6c069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:39.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.380+0000 7fae6b7fe700 1 -- 172.21.15.82:0/1316593188 >> v2:172.21.15.114:3300/0 conn(0x7fae6c06e2d0 msgr2=0x7fae6c069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:39.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.380+0000 7fae6b7fe700 1 --2- 172.21.15.82:0/1316593188 >> v2:172.21.15.114:3300/0 conn(0x7fae6c06e2d0 0x7fae6c069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.380+0000 7fae6b7fe700 1 -- 172.21.15.82:0/1316593188 >> v1:172.21.15.114:6789/0 conn(0x7fae6c0b1de0 legacy=0x7fae6c06dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:39.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.380+0000 7fae6b7fe700 1 -- 172.21.15.82:0/1316593188 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c0b2610 con 0x7fae6c156c50 2023-11-28T13:00:39.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.380+0000 7fae6bfff700 1 --2- 172.21.15.82:0/1316593188 >> v2:172.21.15.114:3300/0 conn(0x7fae6c06e2d0 0x7fae6c069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:00:39.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.380+0000 7fae6b7fe700 1 --2- 172.21.15.82:0/1316593188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae6c156c50 0x7fae6c159f40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fae6c06e6a0 tx=0x7fae5c00be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8e81d3f7a269d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:39.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.384+0000 7fae6affd700 1 -- 172.21.15.82:0/1316593188 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c00dd50 con 0x7fae6c156c50 2023-11-28T13:00:39.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.384+0000 7fae6affd700 1 -- 172.21.15.82:0/1316593188 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5c004030 con 0x7fae6c156c50 2023-11-28T13:00:39.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.384+0000 7fae6affd700 1 -- 172.21.15.82:0/1316593188 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c0043c0 con 0x7fae6c156c50 2023-11-28T13:00:39.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.384+0000 7fae70a98700 1 -- 172.21.15.82:0/1316593188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae6c156c50 msgr2=0x7fae6c159f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:39.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.384+0000 7fae70a98700 1 --2- 172.21.15.82:0/1316593188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae6c156c50 0x7fae6c159f40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fae6c06e6a0 tx=0x7fae5c00be90 comp rx=0 tx=0).stop 2023-11-28T13:00:39.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.384+0000 7fae70a98700 1 -- 172.21.15.82:0/1316593188 shutdown_connections 2023-11-28T13:00:39.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.384+0000 7fae70a98700 1 --2- 172.21.15.82:0/1316593188 >> v2:172.21.15.114:3300/0 conn(0x7fae6c06e2d0 0x7fae6c069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.384+0000 7fae70a98700 1 --2- 172.21.15.82:0/1316593188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae6c156c50 0x7fae6c159f40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.384+0000 7fae70a98700 1 -- 172.21.15.82:0/1316593188 >> 172.21.15.82:0/1316593188 conn(0x7fae6c0cee90 msgr2=0x7fae6c0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:39.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.384+0000 7fae70a98700 1 -- 172.21.15.82:0/1316593188 shutdown_connections 2023-11-28T13:00:39.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.384+0000 7fae70a98700 1 -- 172.21.15.82:0/1316593188 wait complete. 2023-11-28T13:00:39.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.384+0000 7fae70a98700 1 Processor -- start 2023-11-28T13:00:39.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.384+0000 7fae70a98700 1 -- start start 2023-11-28T13:00:39.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae70a98700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c06e2d0 0x7fae6c14ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:39.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae70a98700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae6c0b1de0 0x7fae6c1f0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:39.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae70a98700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae6c156c50 0x7fae6c1f5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:39.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae70a98700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c148140 con 0x7fae6c156c50 2023-11-28T13:00:39.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae70a98700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c158fc0 con 0x7fae6c06e2d0 2023-11-28T13:00:39.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae70a98700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c0abb40 con 0x7fae6c0b1de0 2023-11-28T13:00:39.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae6bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae6c156c50 0x7fae6c1f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:39.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae6bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae6c156c50 0x7fae6c1f5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50908/0 (socket says 172.21.15.82:50908) 2023-11-28T13:00:39.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae6bfff700 1 -- 172.21.15.82:0/2359940515 learned_addr learned my addr 172.21.15.82:0/2359940515 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:39.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae63fff700 1 --2- 172.21.15.82:0/2359940515 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae6c0b1de0 0x7fae6c1f0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:39.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae6b7fe700 1 --2- 172.21.15.82:0/2359940515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c06e2d0 0x7fae6c14ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:39.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae6bfff700 1 -- 172.21.15.82:0/2359940515 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae6c0b1de0 msgr2=0x7fae6c1f0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:39.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae6bfff700 1 --2- 172.21.15.82:0/2359940515 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae6c0b1de0 0x7fae6c1f0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae6bfff700 1 -- 172.21.15.82:0/2359940515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c06e2d0 msgr2=0x7fae6c14ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:39.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae6bfff700 1 --2- 172.21.15.82:0/2359940515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c06e2d0 0x7fae6c14ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae6bfff700 1 -- 172.21.15.82:0/2359940515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5c00b810 con 0x7fae6c156c50 2023-11-28T13:00:39.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae6bfff700 1 --2- 172.21.15.82:0/2359940515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae6c156c50 0x7fae6c1f5320 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fae6400ce80 tx=0x7fae6400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:39.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae68ff9700 1 -- 172.21.15.82:0/2359940515 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6400ad40 con 0x7fae6c156c50 2023-11-28T13:00:39.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae68ff9700 1 -- 172.21.15.82:0/2359940515 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae64015440 con 0x7fae6c156c50 2023-11-28T13:00:39.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae70a98700 1 -- 172.21.15.82:0/2359940515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6c0b2bd0 con 0x7fae6c156c50 2023-11-28T13:00:39.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae68ff9700 1 -- 172.21.15.82:0/2359940515 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6400aea0 con 0x7fae6c156c50 2023-11-28T13:00:39.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae70a98700 1 -- 172.21.15.82:0/2359940515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6c0b28f0 con 0x7fae6c156c50 2023-11-28T13:00:39.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.388+0000 7fae70a98700 1 -- 172.21.15.82:0/2359940515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6c06a470 con 0x7fae6c156c50 2023-11-28T13:00:39.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.392+0000 7fae68ff9700 1 -- 172.21.15.82:0/2359940515 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fae6401c030 con 0x7fae6c156c50 2023-11-28T13:00:39.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.392+0000 7fae68ff9700 1 --2- 172.21.15.82:0/2359940515 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fae4c064ee0 0x7fae4c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:39.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.392+0000 7fae6b7fe700 1 --2- 172.21.15.82:0/2359940515 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fae4c064ee0 0x7fae4c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:39.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.392+0000 7fae68ff9700 1 -- 172.21.15.82:0/2359940515 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fae64082260 con 0x7fae6c156c50 2023-11-28T13:00:39.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.392+0000 7fae6b7fe700 1 --2- 172.21.15.82:0/2359940515 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fae4c064ee0 0x7fae4c067390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fae5c000c00 tx=0x7fae5c01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:39.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.400+0000 7fae68ff9700 1 -- 172.21.15.82:0/2359940515 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fae64050310 con 0x7fae6c156c50 2023-11-28T13:00:39.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.564+0000 7fae70a98700 1 -- 172.21.15.82:0/2359940515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fae6c065fc0 con 0x7fae6c156c50 2023-11-28T13:00:39.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.564+0000 7fae68ff9700 1 -- 172.21.15.82:0/2359940515 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fae6401a020 con 0x7fae6c156c50 2023-11-28T13:00:39.569 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:00:39.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.568+0000 7fae70a98700 1 -- 172.21.15.82:0/2359940515 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fae4c064ee0 msgr2=0x7fae4c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:39.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.568+0000 7fae70a98700 1 --2- 172.21.15.82:0/2359940515 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fae4c064ee0 0x7fae4c067390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fae5c000c00 tx=0x7fae5c01c040 comp rx=0 tx=0).stop 2023-11-28T13:00:39.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.568+0000 7fae70a98700 1 -- 172.21.15.82:0/2359940515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae6c156c50 msgr2=0x7fae6c1f5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:39.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.568+0000 7fae70a98700 1 --2- 172.21.15.82:0/2359940515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae6c156c50 0x7fae6c1f5320 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fae6400ce80 tx=0x7fae6400ceb0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.568+0000 7fae70a98700 1 -- 172.21.15.82:0/2359940515 shutdown_connections 2023-11-28T13:00:39.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.568+0000 7fae70a98700 1 --2- 172.21.15.82:0/2359940515 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fae4c064ee0 0x7fae4c067390 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.568+0000 7fae70a98700 1 --2- 172.21.15.82:0/2359940515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae6c156c50 0x7fae6c1f5320 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.568+0000 7fae70a98700 1 --2- 172.21.15.82:0/2359940515 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae6c0b1de0 0x7fae6c1f0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.568+0000 7fae70a98700 1 --2- 172.21.15.82:0/2359940515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c06e2d0 0x7fae6c14ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.568+0000 7fae70a98700 1 -- 172.21.15.82:0/2359940515 >> 172.21.15.82:0/2359940515 conn(0x7fae6c0cee90 msgr2=0x7fae6c153e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:39.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.568+0000 7fae70a98700 1 -- 172.21.15.82:0/2359940515 shutdown_connections 2023-11-28T13:00:39.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.568+0000 7fae70a98700 1 -- 172.21.15.82:0/2359940515 wait complete. 2023-11-28T13:00:39.584 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:00:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13affff700 1 Processor -- start 2023-11-28T13:00:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13affff700 1 -- start start 2023-11-28T13:00:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13affff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13b0158720 0x7f13b00b0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13affff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f13b0071840 0x7f13b006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13affff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b00b0790 con 0x7f13b006a450 2023-11-28T13:00:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13affff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b006ae00 con 0x7f13b0071840 2023-11-28T13:00:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13affff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b0158af0 con 0x7f13b0158720 2023-11-28T13:00:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13af7fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f13b0071840 0x7f13b006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13aeffd700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13b0158720 0x7f13b00b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13ae7fc700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f13b006a450 0x7f13b0071130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:35730/0 (socket says 172.21.15.82:35730) 2023-11-28T13:00:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13ae7fc700 1 -- 172.21.15.82:0/4108056699 learned_addr learned my addr 172.21.15.82:0/4108056699 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13af7fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f13b0071840 0x7f13b006a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:52062/0 (socket says 172.21.15.82:52062) 2023-11-28T13:00:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13adffb700 1 -- 172.21.15.82:0/4108056699 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2837305408 0 0) 0x7f13b00b0790 con 0x7f13b006a450 2023-11-28T13:00:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13adffb700 1 -- 172.21.15.82:0/4108056699 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f139c0035d0 con 0x7f13b006a450 2023-11-28T13:00:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13aeffd700 1 -- 172.21.15.82:0/4108056699 >> v2:172.21.15.114:3300/0 conn(0x7f13b0071840 msgr2=0x7f13b006a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13aeffd700 1 --2- 172.21.15.82:0/4108056699 >> v2:172.21.15.114:3300/0 conn(0x7f13b0071840 0x7f13b006a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13aeffd700 1 -- 172.21.15.82:0/4108056699 >> v1:172.21.15.114:6789/0 conn(0x7f13b006a450 legacy=0x7f13b0071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:39.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13aeffd700 1 -- 172.21.15.82:0/4108056699 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b00af490 con 0x7f13b0158720 2023-11-28T13:00:39.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13af7fe700 1 --2- 172.21.15.82:0/4108056699 >> v2:172.21.15.114:3300/0 conn(0x7f13b0071840 0x7f13b006a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:39.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13aeffd700 1 --2- 172.21.15.82:0/4108056699 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13b0158720 0x7f13b00b0250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f13a000baf0 tx=0x7f13a000be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72ddfd724cde98ab server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:39.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13adffb700 1 -- 172.21.15.82:0/4108056699 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a000dc70 con 0x7f13b0158720 2023-11-28T13:00:39.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13adffb700 1 -- 172.21.15.82:0/4108056699 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a000ddd0 con 0x7f13b0158720 2023-11-28T13:00:39.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.700+0000 7f13adffb700 1 -- 172.21.15.82:0/4108056699 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a0010690 con 0x7f13b0158720 2023-11-28T13:00:39.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.704+0000 7f13affff700 1 -- 172.21.15.82:0/4108056699 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13b0158720 msgr2=0x7f13b00b0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:39.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.704+0000 7f13affff700 1 --2- 172.21.15.82:0/4108056699 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13b0158720 0x7f13b00b0250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f13a000baf0 tx=0x7f13a000be00 comp rx=0 tx=0).stop 2023-11-28T13:00:39.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.704+0000 7f13affff700 1 -- 172.21.15.82:0/4108056699 shutdown_connections 2023-11-28T13:00:39.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.704+0000 7f13affff700 1 --2- 172.21.15.82:0/4108056699 >> v2:172.21.15.114:3300/0 conn(0x7f13b0071840 0x7f13b006a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.704+0000 7f13affff700 1 --2- 172.21.15.82:0/4108056699 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13b0158720 0x7f13b00b0250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.704+0000 7f13affff700 1 -- 172.21.15.82:0/4108056699 >> 172.21.15.82:0/4108056699 conn(0x7f13b00ce630 msgr2=0x7f13b00cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:39.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.704+0000 7f13affff700 1 -- 172.21.15.82:0/4108056699 shutdown_connections 2023-11-28T13:00:39.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.704+0000 7f13affff700 1 -- 172.21.15.82:0/4108056699 wait complete. 2023-11-28T13:00:39.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.704+0000 7f13affff700 1 Processor -- start 2023-11-28T13:00:39.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.704+0000 7f13affff700 1 -- start start 2023-11-28T13:00:39.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.704+0000 7f13affff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13b006a450 0x7f13b01f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:39.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.704+0000 7f13affff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13b0071840 0x7f13b01e0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:39.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.704+0000 7f13affff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13b0158720 0x7f13b00c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:39.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.704+0000 7f13affff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b01f5bf0 con 0x7f13b0071840 2023-11-28T13:00:39.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.704+0000 7f13affff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b01f1670 con 0x7f13b006a450 2023-11-28T13:00:39.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.704+0000 7f13affff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b01e13e0 con 0x7f13b0158720 2023-11-28T13:00:39.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.704+0000 7f13ae7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13b0071840 0x7f13b01e0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:39.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.704+0000 7f13ae7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13b0071840 0x7f13b01e0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50922/0 (socket says 172.21.15.82:50922) 2023-11-28T13:00:39.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.704+0000 7f13ae7fc700 1 -- 172.21.15.82:0/760472017 learned_addr learned my addr 172.21.15.82:0/760472017 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:39.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.704+0000 7f13af7fe700 1 --2- 172.21.15.82:0/760472017 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13b0158720 0x7f13b00c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:39.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.704+0000 7f13aeffd700 1 --2- 172.21.15.82:0/760472017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13b006a450 0x7f13b01f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:39.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.708+0000 7f13ae7fc700 1 -- 172.21.15.82:0/760472017 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13b0158720 msgr2=0x7f13b00c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:39.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.708+0000 7f13ae7fc700 1 --2- 172.21.15.82:0/760472017 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13b0158720 0x7f13b00c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.708+0000 7f13ae7fc700 1 -- 172.21.15.82:0/760472017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13b006a450 msgr2=0x7f13b01f56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:39.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.708+0000 7f13ae7fc700 1 --2- 172.21.15.82:0/760472017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13b006a450 0x7f13b01f56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.708+0000 7f13ae7fc700 1 -- 172.21.15.82:0/760472017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a8009a70 con 0x7f13b0071840 2023-11-28T13:00:39.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.708+0000 7f13ae7fc700 1 --2- 172.21.15.82:0/760472017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13b0071840 0x7f13b01e0ea0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f139800c730 tx=0x7f139800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:39.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.708+0000 7f13a77fe700 1 -- 172.21.15.82:0/760472017 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398005d90 con 0x7f13b0071840 2023-11-28T13:00:39.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.708+0000 7f13a77fe700 1 -- 172.21.15.82:0/760472017 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13980070d0 con 0x7f13b0071840 2023-11-28T13:00:39.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.708+0000 7f13affff700 1 -- 172.21.15.82:0/760472017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a000b750 con 0x7f13b0071840 2023-11-28T13:00:39.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.708+0000 7f13a77fe700 1 -- 172.21.15.82:0/760472017 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398007480 con 0x7f13b0071840 2023-11-28T13:00:39.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.708+0000 7f13affff700 1 -- 172.21.15.82:0/760472017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b00afa50 con 0x7f13b0071840 2023-11-28T13:00:39.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.708+0000 7f13a77fe700 1 -- 172.21.15.82:0/760472017 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1398019030 con 0x7f13b0071840 2023-11-28T13:00:39.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.708+0000 7f13a77fe700 1 --2- 172.21.15.82:0/760472017 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1390064ee0 0x7f1390067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:39.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.708+0000 7f13a77fe700 1 -- 172.21.15.82:0/760472017 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1398081260 con 0x7f13b0071840 2023-11-28T13:00:39.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.708+0000 7f13affff700 1 -- 172.21.15.82:0/760472017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b00af770 con 0x7f13b0071840 2023-11-28T13:00:39.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.708+0000 7f13aeffd700 1 --2- 172.21.15.82:0/760472017 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1390064ee0 0x7f1390067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:39.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.708+0000 7f13aeffd700 1 --2- 172.21.15.82:0/760472017 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1390064ee0 0x7f1390067390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f13a000bfd0 tx=0x7f13a001b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:39.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.716+0000 7f13a77fe700 1 -- 172.21.15.82:0/760472017 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f139804f380 con 0x7f13b0071840 2023-11-28T13:00:39.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.876+0000 7f13affff700 1 -- 172.21.15.82:0/760472017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f13b00afd30 con 0x7f13b0071840 2023-11-28T13:00:39.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.876+0000 7f13a77fe700 1 -- 172.21.15.82:0/760472017 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1398017070 con 0x7f13b0071840 2023-11-28T13:00:39.881 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:00:39.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.880+0000 7f13affff700 1 -- 172.21.15.82:0/760472017 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1390064ee0 msgr2=0x7f1390067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:39.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.880+0000 7f13affff700 1 --2- 172.21.15.82:0/760472017 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1390064ee0 0x7f1390067390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f13a000bfd0 tx=0x7f13a001b040 comp rx=0 tx=0).stop 2023-11-28T13:00:39.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.880+0000 7f13affff700 1 -- 172.21.15.82:0/760472017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13b0071840 msgr2=0x7f13b01e0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:39.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.880+0000 7f13affff700 1 --2- 172.21.15.82:0/760472017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13b0071840 0x7f13b01e0ea0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f139800c730 tx=0x7f139800ca40 comp rx=0 tx=0).stop 2023-11-28T13:00:39.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.880+0000 7f13affff700 1 -- 172.21.15.82:0/760472017 shutdown_connections 2023-11-28T13:00:39.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.880+0000 7f13affff700 1 --2- 172.21.15.82:0/760472017 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1390064ee0 0x7f1390067390 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.880+0000 7f13affff700 1 --2- 172.21.15.82:0/760472017 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13b0158720 0x7f13b00c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.880+0000 7f13affff700 1 --2- 172.21.15.82:0/760472017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13b0071840 0x7f13b01e0ea0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.880+0000 7f13affff700 1 --2- 172.21.15.82:0/760472017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13b006a450 0x7f13b01f56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:39.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.880+0000 7f13affff700 1 -- 172.21.15.82:0/760472017 >> 172.21.15.82:0/760472017 conn(0x7f13b00ce630 msgr2=0x7f13b015ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:39.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.880+0000 7f13affff700 1 -- 172.21.15.82:0/760472017 shutdown_connections 2023-11-28T13:00:39.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:39.880+0000 7f13affff700 1 -- 172.21.15.82:0/760472017 wait complete. 2023-11-28T13:00:39.896 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T13:00:40.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.008+0000 7fba82c64700 1 Processor -- start 2023-11-28T13:00:40.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.008+0000 7fba82c64700 1 -- start start 2023-11-28T13:00:40.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba82c64700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fba7c0cba10 0x7fba7c0ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:40.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba82c64700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fba7c0ce2d0 0x7fba7c0ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:40.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba82c64700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba7c071110 0x7fba7c071590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:40.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba82c64700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c071ad0 con 0x7fba7c0cba10 2023-11-28T13:00:40.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba82c64700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c15a4b0 con 0x7fba7c0ce2d0 2023-11-28T13:00:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba82c64700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c159930 con 0x7fba7c071110 2023-11-28T13:00:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba81c62700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fba7c0cba10 0x7fba7c0ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba81c62700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fba7c0cba10 0x7fba7c0ca6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50932/0 (socket says 172.21.15.82:50932) 2023-11-28T13:00:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba81c62700 1 -- 172.21.15.82:0/1783331997 learned_addr learned my addr 172.21.15.82:0/1783331997 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba81461700 1 --2- 172.21.15.82:0/1783331997 >> v2:172.21.15.114:3300/0 conn(0x7fba7c0ce2d0 0x7fba7c0ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba82463700 1 --2- 172.21.15.82:0/1783331997 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba7c071110 0x7fba7c071590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba81c62700 1 -- 172.21.15.82:0/1783331997 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba7c071110 msgr2=0x7fba7c071590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba81c62700 1 --2- 172.21.15.82:0/1783331997 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba7c071110 0x7fba7c071590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba81c62700 1 -- 172.21.15.82:0/1783331997 >> v2:172.21.15.114:3300/0 conn(0x7fba7c0ce2d0 msgr2=0x7fba7c0ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba81c62700 1 --2- 172.21.15.82:0/1783331997 >> v2:172.21.15.114:3300/0 conn(0x7fba7c0ce2d0 0x7fba7c0ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba81c62700 1 -- 172.21.15.82:0/1783331997 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c159c10 con 0x7fba7c0cba10 2023-11-28T13:00:40.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba81c62700 1 --2- 172.21.15.82:0/1783331997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba7c0cba10 0x7fba7c0ca6c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fba7c070f10 tx=0x7fba78009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b721eb934b6e076 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:40.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba80c60700 1 -- 172.21.15.82:0/1783331997 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7800b8a0 con 0x7fba7c0cba10 2023-11-28T13:00:40.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba80c60700 1 -- 172.21.15.82:0/1783331997 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7800ba00 con 0x7fba7c0cba10 2023-11-28T13:00:40.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba80c60700 1 -- 172.21.15.82:0/1783331997 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7800bd90 con 0x7fba7c0cba10 2023-11-28T13:00:40.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba82c64700 1 -- 172.21.15.82:0/1783331997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba7c0cba10 msgr2=0x7fba7c0ca6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:40.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba82c64700 1 --2- 172.21.15.82:0/1783331997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba7c0cba10 0x7fba7c0ca6c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fba7c070f10 tx=0x7fba78009bf0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba82c64700 1 -- 172.21.15.82:0/1783331997 shutdown_connections 2023-11-28T13:00:40.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba82c64700 1 --2- 172.21.15.82:0/1783331997 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba7c071110 0x7fba7c071590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba82c64700 1 --2- 172.21.15.82:0/1783331997 >> v2:172.21.15.114:3300/0 conn(0x7fba7c0ce2d0 0x7fba7c0ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba82c64700 1 --2- 172.21.15.82:0/1783331997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba7c0cba10 0x7fba7c0ca6c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba82c64700 1 -- 172.21.15.82:0/1783331997 >> 172.21.15.82:0/1783331997 conn(0x7fba7c0b1f50 msgr2=0x7fba7c0cf790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:40.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba82c64700 1 -- 172.21.15.82:0/1783331997 shutdown_connections 2023-11-28T13:00:40.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.012+0000 7fba82c64700 1 -- 172.21.15.82:0/1783331997 wait complete. 2023-11-28T13:00:40.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.016+0000 7fba82c64700 1 Processor -- start 2023-11-28T13:00:40.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.016+0000 7fba82c64700 1 -- start start 2023-11-28T13:00:40.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba82c64700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba7c071110 0x7fba7c155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:40.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba82c64700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba7c0cba10 0x7fba7c1e3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:40.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba82c64700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba7c0ce2d0 0x7fba7c156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:40.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba82c64700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c1e3a60 con 0x7fba7c071110 2023-11-28T13:00:40.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba82c64700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c06a450 con 0x7fba7c0ce2d0 2023-11-28T13:00:40.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba82c64700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c06a730 con 0x7fba7c0cba10 2023-11-28T13:00:40.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba81c62700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba7c071110 0x7fba7c155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:40.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba81c62700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba7c071110 0x7fba7c155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50936/0 (socket says 172.21.15.82:50936) 2023-11-28T13:00:40.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba81c62700 1 -- 172.21.15.82:0/3090032030 learned_addr learned my addr 172.21.15.82:0/3090032030 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:40.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba82463700 1 --2- 172.21.15.82:0/3090032030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba7c0ce2d0 0x7fba7c156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:40.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba81461700 1 --2- 172.21.15.82:0/3090032030 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba7c0cba10 0x7fba7c1e3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:40.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba81c62700 1 -- 172.21.15.82:0/3090032030 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba7c0cba10 msgr2=0x7fba7c1e3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:40.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba81c62700 1 --2- 172.21.15.82:0/3090032030 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba7c0cba10 0x7fba7c1e3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba81c62700 1 -- 172.21.15.82:0/3090032030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba7c0ce2d0 msgr2=0x7fba7c156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:40.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba81c62700 1 --2- 172.21.15.82:0/3090032030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba7c0ce2d0 0x7fba7c156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba81c62700 1 -- 172.21.15.82:0/3090032030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba78009570 con 0x7fba7c071110 2023-11-28T13:00:40.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba81461700 1 --2- 172.21.15.82:0/3090032030 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba7c0cba10 0x7fba7c1e3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:40.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba82463700 1 --2- 172.21.15.82:0/3090032030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba7c0ce2d0 0x7fba7c156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:40.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba81c62700 1 --2- 172.21.15.82:0/3090032030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba7c071110 0x7fba7c155c00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fba7c071ce0 tx=0x7fba78004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:40.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba727fc700 1 -- 172.21.15.82:0/3090032030 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba780036c0 con 0x7fba7c071110 2023-11-28T13:00:40.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba727fc700 1 -- 172.21.15.82:0/3090032030 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7801f070 con 0x7fba7c071110 2023-11-28T13:00:40.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba82c64700 1 -- 172.21.15.82:0/3090032030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7c15a1d0 con 0x7fba7c071110 2023-11-28T13:00:40.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba727fc700 1 -- 172.21.15.82:0/3090032030 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78003a80 con 0x7fba7c071110 2023-11-28T13:00:40.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba82c64700 1 -- 172.21.15.82:0/3090032030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7c159ef0 con 0x7fba7c071110 2023-11-28T13:00:40.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba82c64700 1 -- 172.21.15.82:0/3090032030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7c0cac00 con 0x7fba7c071110 2023-11-28T13:00:40.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.020+0000 7fba727fc700 1 -- 172.21.15.82:0/3090032030 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fba7802a020 con 0x7fba7c071110 2023-11-28T13:00:40.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.024+0000 7fba727fc700 1 --2- 172.21.15.82:0/3090032030 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fba60064ee0 0x7fba60067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:40.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.024+0000 7fba727fc700 1 -- 172.21.15.82:0/3090032030 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba780836d0 con 0x7fba7c071110 2023-11-28T13:00:40.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.024+0000 7fba81461700 1 --2- 172.21.15.82:0/3090032030 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fba60064ee0 0x7fba60067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:40.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.024+0000 7fba81461700 1 --2- 172.21.15.82:0/3090032030 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fba60064ee0 0x7fba60067390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fba7c06cc10 tx=0x7fba6c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:40.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.028+0000 7fba727fc700 1 -- 172.21.15.82:0/3090032030 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fba78051870 con 0x7fba7c071110 2023-11-28T13:00:40.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.188+0000 7fba82c64700 1 -- 172.21.15.82:0/3090032030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fba7c065fc0 con 0x7fba7c071110 2023-11-28T13:00:40.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.188+0000 7fba727fc700 1 -- 172.21.15.82:0/3090032030 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fba78054e90 con 0x7fba7c071110 2023-11-28T13:00:40.194 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-11-28T13:00:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.192+0000 7fba82c64700 1 -- 172.21.15.82:0/3090032030 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fba60064ee0 msgr2=0x7fba60067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.192+0000 7fba82c64700 1 --2- 172.21.15.82:0/3090032030 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fba60064ee0 0x7fba60067390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fba7c06cc10 tx=0x7fba6c008040 comp rx=0 tx=0).stop 2023-11-28T13:00:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.192+0000 7fba82c64700 1 -- 172.21.15.82:0/3090032030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba7c071110 msgr2=0x7fba7c155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.192+0000 7fba82c64700 1 --2- 172.21.15.82:0/3090032030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba7c071110 0x7fba7c155c00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fba7c071ce0 tx=0x7fba78004770 comp rx=0 tx=0).stop 2023-11-28T13:00:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.192+0000 7fba82c64700 1 -- 172.21.15.82:0/3090032030 shutdown_connections 2023-11-28T13:00:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.192+0000 7fba82c64700 1 --2- 172.21.15.82:0/3090032030 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fba60064ee0 0x7fba60067390 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.192+0000 7fba82c64700 1 --2- 172.21.15.82:0/3090032030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba7c0ce2d0 0x7fba7c156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.192+0000 7fba82c64700 1 --2- 172.21.15.82:0/3090032030 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba7c0cba10 0x7fba7c1e3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.192+0000 7fba82c64700 1 --2- 172.21.15.82:0/3090032030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba7c071110 0x7fba7c155c00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.192+0000 7fba82c64700 1 -- 172.21.15.82:0/3090032030 >> 172.21.15.82:0/3090032030 conn(0x7fba7c0b1f50 msgr2=0x7fba7c157980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:40.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.192+0000 7fba82c64700 1 -- 172.21.15.82:0/3090032030 shutdown_connections 2023-11-28T13:00:40.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.192+0000 7fba82c64700 1 -- 172.21.15.82:0/3090032030 wait complete. 2023-11-28T13:00:40.208 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T13:00:40.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.320+0000 7fab7bfff700 1 Processor -- start 2023-11-28T13:00:40.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.324+0000 7fab7bfff700 1 -- start start 2023-11-28T13:00:40.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.324+0000 7fab7bfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fab7c158720 0x7fab7c0b0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:40.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.324+0000 7fab7bfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab7c071840 0x7fab7c06a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:40.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.324+0000 7fab7bfff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab7c0b0790 con 0x7fab7c06a450 2023-11-28T13:00:40.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.324+0000 7fab7bfff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab7c071ca0 con 0x7fab7c158720 2023-11-28T13:00:40.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.324+0000 7fab7bfff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c06ae30 con 0x7fab7c071840 2023-11-28T13:00:40.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.324+0000 7fab7b7fe700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab7c071840 0x7fab7c06a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:40.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.324+0000 7fab7b7fe700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab7c071840 0x7fab7c06a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:47048/0 (socket says 172.21.15.82:47048) 2023-11-28T13:00:40.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.324+0000 7fab7affd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fab7c158720 0x7fab7c0b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:40.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.324+0000 7fab7b7fe700 1 -- 172.21.15.82:0/4067093703 learned_addr learned my addr 172.21.15.82:0/4067093703 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:40.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.324+0000 7fab7a7fc700 1 -- 172.21.15.82:0/4067093703 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518962659 0 0) 0x7fab7c0b0790 con 0x7fab7c06a450 2023-11-28T13:00:40.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.324+0000 7fab7b7fe700 1 -- 172.21.15.82:0/4067093703 >> v2:172.21.15.114:3300/0 conn(0x7fab7c158720 msgr2=0x7fab7c0b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:40.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.324+0000 7fab7b7fe700 1 --2- 172.21.15.82:0/4067093703 >> v2:172.21.15.114:3300/0 conn(0x7fab7c158720 0x7fab7c0b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.324+0000 7fab7b7fe700 1 -- 172.21.15.82:0/4067093703 >> v1:172.21.15.114:6789/0 conn(0x7fab7c06a450 legacy=0x7fab7c071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:40.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.324+0000 7fab7b7fe700 1 -- 172.21.15.82:0/4067093703 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7c158af0 con 0x7fab7c071840 2023-11-28T13:00:40.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.324+0000 7fab7b7fe700 1 --2- 172.21.15.82:0/4067093703 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab7c071840 0x7fab7c06a8f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fab74009e50 tx=0x7fab7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caa4a844d5ba672 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:40.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.324+0000 7fab7a7fc700 1 -- 172.21.15.82:0/4067093703 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7400bb10 con 0x7fab7c071840 2023-11-28T13:00:40.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.324+0000 7fab7a7fc700 1 -- 172.21.15.82:0/4067093703 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7400bc70 con 0x7fab7c071840 2023-11-28T13:00:40.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.324+0000 7fab7a7fc700 1 -- 172.21.15.82:0/4067093703 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74011460 con 0x7fab7c071840 2023-11-28T13:00:40.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.328+0000 7fab7bfff700 1 -- 172.21.15.82:0/4067093703 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab7c071840 msgr2=0x7fab7c06a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:40.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.328+0000 7fab7bfff700 1 --2- 172.21.15.82:0/4067093703 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab7c071840 0x7fab7c06a8f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fab74009e50 tx=0x7fab7400b330 comp rx=0 tx=0).stop 2023-11-28T13:00:40.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.328+0000 7fab7bfff700 1 -- 172.21.15.82:0/4067093703 shutdown_connections 2023-11-28T13:00:40.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.328+0000 7fab7bfff700 1 --2- 172.21.15.82:0/4067093703 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab7c071840 0x7fab7c06a8f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.328+0000 7fab7bfff700 1 --2- 172.21.15.82:0/4067093703 >> v2:172.21.15.114:3300/0 conn(0x7fab7c158720 0x7fab7c0b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.328+0000 7fab7bfff700 1 -- 172.21.15.82:0/4067093703 >> 172.21.15.82:0/4067093703 conn(0x7fab7c0ce630 msgr2=0x7fab7c0cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:40.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.328+0000 7fab7bfff700 1 -- 172.21.15.82:0/4067093703 shutdown_connections 2023-11-28T13:00:40.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.328+0000 7fab7bfff700 1 -- 172.21.15.82:0/4067093703 wait complete. 2023-11-28T13:00:40.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.328+0000 7fab7bfff700 1 Processor -- start 2023-11-28T13:00:40.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.328+0000 7fab7bfff700 1 -- start start 2023-11-28T13:00:40.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab7bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab7c06a450 0x7fab7c143e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:40.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab7bfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab7c071840 0x7fab7c0b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:40.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab7bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab7c158720 0x7fab7c0cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:40.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab7bfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c0b1d00 con 0x7fab7c06a450 2023-11-28T13:00:40.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab7bfff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c159990 con 0x7fab7c158720 2023-11-28T13:00:40.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab7bfff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c158d80 con 0x7fab7c071840 2023-11-28T13:00:40.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab7affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab7c06a450 0x7fab7c143e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:40.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab7affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab7c06a450 0x7fab7c143e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50942/0 (socket says 172.21.15.82:50942) 2023-11-28T13:00:40.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab7affd700 1 -- 172.21.15.82:0/2880838869 learned_addr learned my addr 172.21.15.82:0/2880838869 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:40.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab73fff700 1 --2- 172.21.15.82:0/2880838869 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab7c071840 0x7fab7c0b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:40.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab7b7fe700 1 --2- 172.21.15.82:0/2880838869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab7c158720 0x7fab7c0cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:40.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab7affd700 1 -- 172.21.15.82:0/2880838869 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab7c071840 msgr2=0x7fab7c0b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:40.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab7affd700 1 --2- 172.21.15.82:0/2880838869 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab7c071840 0x7fab7c0b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab7affd700 1 -- 172.21.15.82:0/2880838869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab7c158720 msgr2=0x7fab7c0cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:40.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab7affd700 1 --2- 172.21.15.82:0/2880838869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab7c158720 0x7fab7c0cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab7affd700 1 -- 172.21.15.82:0/2880838869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab74009b30 con 0x7fab7c06a450 2023-11-28T13:00:40.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab7affd700 1 --2- 172.21.15.82:0/2880838869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab7c06a450 0x7fab7c143e30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00e840 tx=0x7fab6c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:40.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab737fe700 1 -- 172.21.15.82:0/2880838869 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c0095a0 con 0x7fab7c06a450 2023-11-28T13:00:40.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab737fe700 1 -- 172.21.15.82:0/2880838869 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6c013680 con 0x7fab7c06a450 2023-11-28T13:00:40.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab7bfff700 1 -- 172.21.15.82:0/2880838869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7c0af770 con 0x7fab7c06a450 2023-11-28T13:00:40.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab737fe700 1 -- 172.21.15.82:0/2880838869 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c0139f0 con 0x7fab7c06a450 2023-11-28T13:00:40.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab7bfff700 1 -- 172.21.15.82:0/2880838869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7c0af490 con 0x7fab7c06a450 2023-11-28T13:00:40.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.332+0000 7fab7bfff700 1 -- 172.21.15.82:0/2880838869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab7c0afa50 con 0x7fab7c06a450 2023-11-28T13:00:40.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.336+0000 7fab737fe700 1 -- 172.21.15.82:0/2880838869 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fab6c019030 con 0x7fab7c06a450 2023-11-28T13:00:40.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.336+0000 7fab737fe700 1 --2- 172.21.15.82:0/2880838869 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fab5c064ee0 0x7fab5c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:40.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.336+0000 7fab737fe700 1 -- 172.21.15.82:0/2880838869 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab6c081d90 con 0x7fab7c06a450 2023-11-28T13:00:40.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.336+0000 7fab73fff700 1 --2- 172.21.15.82:0/2880838869 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fab5c064ee0 0x7fab5c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.336+0000 7fab73fff700 1 --2- 172.21.15.82:0/2880838869 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fab5c064ee0 0x7fab5c067390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0b4160 tx=0x7fab64009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.344+0000 7fab737fe700 1 -- 172.21.15.82:0/2880838869 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fab6c04fd30 con 0x7fab7c06a450 2023-11-28T13:00:40.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.500+0000 7fab7bfff700 1 -- 172.21.15.82:0/2880838869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fab7c073390 con 0x7fab7c06a450 2023-11-28T13:00:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.500+0000 7fab737fe700 1 -- 172.21.15.82:0/2880838869 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fab7c073390 con 0x7fab7c06a450 2023-11-28T13:00:40.506 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-11-28T13:00:40.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.504+0000 7fab7bfff700 1 -- 172.21.15.82:0/2880838869 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fab5c064ee0 msgr2=0x7fab5c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:40.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.504+0000 7fab7bfff700 1 --2- 172.21.15.82:0/2880838869 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fab5c064ee0 0x7fab5c067390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0b4160 tx=0x7fab64009040 comp rx=0 tx=0).stop 2023-11-28T13:00:40.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.504+0000 7fab7bfff700 1 -- 172.21.15.82:0/2880838869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab7c06a450 msgr2=0x7fab7c143e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:40.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.504+0000 7fab7bfff700 1 --2- 172.21.15.82:0/2880838869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab7c06a450 0x7fab7c143e30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00e840 tx=0x7fab6c00eb50 comp rx=0 tx=0).stop 2023-11-28T13:00:40.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.504+0000 7fab7bfff700 1 -- 172.21.15.82:0/2880838869 shutdown_connections 2023-11-28T13:00:40.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.504+0000 7fab7bfff700 1 --2- 172.21.15.82:0/2880838869 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fab5c064ee0 0x7fab5c067390 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.504+0000 7fab7bfff700 1 --2- 172.21.15.82:0/2880838869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab7c158720 0x7fab7c0cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.504+0000 7fab7bfff700 1 --2- 172.21.15.82:0/2880838869 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab7c071840 0x7fab7c0b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.504+0000 7fab7bfff700 1 --2- 172.21.15.82:0/2880838869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab7c06a450 0x7fab7c143e30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.504+0000 7fab7bfff700 1 -- 172.21.15.82:0/2880838869 >> 172.21.15.82:0/2880838869 conn(0x7fab7c0ce630 msgr2=0x7fab7c0c9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:40.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.504+0000 7fab7bfff700 1 -- 172.21.15.82:0/2880838869 shutdown_connections 2023-11-28T13:00:40.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.504+0000 7fab7bfff700 1 -- 172.21.15.82:0/2880838869 wait complete. 2023-11-28T13:00:40.520 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:00:40.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.632+0000 7fae5edfe700 1 Processor -- start 2023-11-28T13:00:40.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.632+0000 7fae5edfe700 1 -- start start 2023-11-28T13:00:40.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.632+0000 7fae5edfe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fae5806d980 0x7fae580cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:40.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.632+0000 7fae5edfe700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae5806cfa0 0x7fae58069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:40.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.632+0000 7fae5edfe700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae5806d780 con 0x7fae58070070 2023-11-28T13:00:40.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.632+0000 7fae5edfe700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae5806cb10 con 0x7fae5806d980 2023-11-28T13:00:40.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.632+0000 7fae5edfe700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5806ddf0 con 0x7fae5806cfa0 2023-11-28T13:00:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.632+0000 7fae5d5fb700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fae5806d980 0x7fae580cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.632+0000 7fae5e5fd700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae5806cfa0 0x7fae58069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.632+0000 7fae5d5fb700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fae5806d980 0x7fae580cc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:52126/0 (socket says 172.21.15.82:52126) 2023-11-28T13:00:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.632+0000 7fae5d5fb700 1 -- 172.21.15.82:0/524512551 learned_addr learned my addr 172.21.15.82:0/524512551 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.632+0000 7fae5e5fd700 1 --2- 172.21.15.82:0/524512551 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae5806cfa0 0x7fae58069bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:47064/0 (socket says 172.21.15.82:47064) 2023-11-28T13:00:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.632+0000 7fae5ddfc700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fae58070070 0x7fae58070440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:35746/0 (socket says 172.21.15.82:35746) 2023-11-28T13:00:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.632+0000 7fae5d5fb700 1 -- 172.21.15.82:0/524512551 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae5806cfa0 msgr2=0x7fae58069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.632+0000 7fae5d5fb700 1 --2- 172.21.15.82:0/524512551 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae5806cfa0 0x7fae58069bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.632+0000 7fae5d5fb700 1 -- 172.21.15.82:0/524512551 >> v1:172.21.15.114:6789/0 conn(0x7fae58070070 legacy=0x7fae58070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.632+0000 7fae5d5fb700 1 -- 172.21.15.82:0/524512551 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae580ce030 con 0x7fae5806d980 2023-11-28T13:00:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.632+0000 7fae5cdfa700 1 -- 172.21.15.82:0/524512551 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269087378 0 0) 0x7fae5806d780 con 0x7fae58070070 2023-11-28T13:00:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.632+0000 7fae5d5fb700 1 --2- 172.21.15.82:0/524512551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae5806d980 0x7fae580cc1d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fae48009e50 tx=0x7fae4800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65d0b88c3cc6ad26 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:40.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.636+0000 7fae5cdfa700 1 -- 172.21.15.82:0/524512551 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4800e070 con 0x7fae5806d980 2023-11-28T13:00:40.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.636+0000 7fae5cdfa700 1 -- 172.21.15.82:0/524512551 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4800b910 con 0x7fae5806d980 2023-11-28T13:00:40.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.636+0000 7fae5cdfa700 1 -- 172.21.15.82:0/524512551 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4800bcc0 con 0x7fae5806d980 2023-11-28T13:00:40.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.636+0000 7fae5edfe700 1 -- 172.21.15.82:0/524512551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae5806d980 msgr2=0x7fae580cc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:40.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.636+0000 7fae5edfe700 1 --2- 172.21.15.82:0/524512551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae5806d980 0x7fae580cc1d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fae48009e50 tx=0x7fae4800b330 comp rx=0 tx=0).stop 2023-11-28T13:00:40.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.636+0000 7fae5edfe700 1 -- 172.21.15.82:0/524512551 shutdown_connections 2023-11-28T13:00:40.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.636+0000 7fae5edfe700 1 --2- 172.21.15.82:0/524512551 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae5806cfa0 0x7fae58069bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.636+0000 7fae5edfe700 1 --2- 172.21.15.82:0/524512551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae5806d980 0x7fae580cc1d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.636+0000 7fae5edfe700 1 -- 172.21.15.82:0/524512551 >> 172.21.15.82:0/524512551 conn(0x7fae580ce600 msgr2=0x7fae580ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:40.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.636+0000 7fae5edfe700 1 -- 172.21.15.82:0/524512551 shutdown_connections 2023-11-28T13:00:40.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.636+0000 7fae5edfe700 1 -- 172.21.15.82:0/524512551 wait complete. 2023-11-28T13:00:40.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5edfe700 1 Processor -- start 2023-11-28T13:00:40.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5edfe700 1 -- start start 2023-11-28T13:00:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5edfe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5806cfa0 0x7fae580c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5edfe700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae5806d980 0x7fae58147c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5edfe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae58070070 0x7fae581481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5edfe700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae580c3c40 con 0x7fae5806cfa0 2023-11-28T13:00:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5edfe700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae580c5fd0 con 0x7fae58070070 2023-11-28T13:00:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5edfe700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae580c3050 con 0x7fae5806d980 2023-11-28T13:00:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5ddfc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5806cfa0 0x7fae580c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5ddfc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5806cfa0 0x7fae580c56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50952/0 (socket says 172.21.15.82:50952) 2023-11-28T13:00:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5d5fb700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae5806d980 0x7fae58147c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5ddfc700 1 -- 172.21.15.82:0/3302057999 learned_addr learned my addr 172.21.15.82:0/3302057999 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:40.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5e5fd700 1 --2- 172.21.15.82:0/3302057999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae58070070 0x7fae581481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:40.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5e5fd700 1 -- 172.21.15.82:0/3302057999 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae5806d980 msgr2=0x7fae58147c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:40.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5e5fd700 1 --2- 172.21.15.82:0/3302057999 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae5806d980 0x7fae58147c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5e5fd700 1 -- 172.21.15.82:0/3302057999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5806cfa0 msgr2=0x7fae580c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:40.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5e5fd700 1 --2- 172.21.15.82:0/3302057999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5806cfa0 0x7fae580c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5e5fd700 1 -- 172.21.15.82:0/3302057999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae48009b30 con 0x7fae58070070 2023-11-28T13:00:40.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5ddfc700 1 --2- 172.21.15.82:0/3302057999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5806cfa0 0x7fae580c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:40.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5d5fb700 1 --2- 172.21.15.82:0/3302057999 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae5806d980 0x7fae58147c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:40.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5e5fd700 1 --2- 172.21.15.82:0/3302057999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae58070070 0x7fae581481c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fae58070020 tx=0x7fae5000eb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:40.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae567fc700 1 -- 172.21.15.82:0/3302057999 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50013680 con 0x7fae58070070 2023-11-28T13:00:40.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae567fc700 1 -- 172.21.15.82:0/3302057999 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae500137e0 con 0x7fae58070070 2023-11-28T13:00:40.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae5edfe700 1 -- 172.21.15.82:0/3302057999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae580cc710 con 0x7fae58070070 2023-11-28T13:00:40.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.640+0000 7fae567fc700 1 -- 172.21.15.82:0/3302057999 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50013b70 con 0x7fae58070070 2023-11-28T13:00:40.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.644+0000 7fae5edfe700 1 -- 172.21.15.82:0/3302057999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae580ce310 con 0x7fae58070070 2023-11-28T13:00:40.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.644+0000 7fae5edfe700 1 -- 172.21.15.82:0/3302057999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae580cdc50 con 0x7fae58070070 2023-11-28T13:00:40.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.644+0000 7fae567fc700 1 -- 172.21.15.82:0/3302057999 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fae50019030 con 0x7fae58070070 2023-11-28T13:00:40.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.644+0000 7fae567fc700 1 --2- 172.21.15.82:0/3302057999 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fae44064ee0 0x7fae44067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:40.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.644+0000 7fae5ddfc700 1 --2- 172.21.15.82:0/3302057999 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fae44064ee0 0x7fae44067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:40.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.644+0000 7fae567fc700 1 -- 172.21.15.82:0/3302057999 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fae50082460 con 0x7fae58070070 2023-11-28T13:00:40.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.644+0000 7fae5ddfc700 1 --2- 172.21.15.82:0/3302057999 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fae44064ee0 0x7fae44067390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fae4c000f60 tx=0x7fae4c007f50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:40.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.656+0000 7fae567fc700 1 -- 172.21.15.82:0/3302057999 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fae50050590 con 0x7fae58070070 2023-11-28T13:00:40.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.860+0000 7fae5edfe700 1 -- 172.21.15.82:0/3302057999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae580c3d80 con 0x7fae58070070 2023-11-28T13:00:40.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.860+0000 7fae567fc700 1 -- 172.21.15.82:0/3302057999 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4648 (secure 0 0 0) 0x7fae580c3d80 con 0x7fae58070070 2023-11-28T13:00:40.864 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:40.865 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2058451312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2058451312},{"type":"v1","addr":"172.21.15.82:6835","nonce":2058451312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/4064345694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":4064345694},{"type":"v1","addr":"172.21.15.114:6833","nonce":4064345694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2802500604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2802500604},{"type":"v1","addr":"172.21.15.114:6835","nonce":2802500604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:00:25.978137+0000","modified":"2023-11-28T13:00:28.990262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2893797521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2893797521},{"type":"v1","addr":"172.21.15.82:6837","nonce":2893797521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T13:00:40.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.864+0000 7fae5edfe700 1 -- 172.21.15.82:0/3302057999 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fae44064ee0 msgr2=0x7fae44067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:40.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.864+0000 7fae5edfe700 1 --2- 172.21.15.82:0/3302057999 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fae44064ee0 0x7fae44067390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fae4c000f60 tx=0x7fae4c007f50 comp rx=0 tx=0).stop 2023-11-28T13:00:40.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.864+0000 7fae5edfe700 1 -- 172.21.15.82:0/3302057999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae58070070 msgr2=0x7fae581481c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:40.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.864+0000 7fae5edfe700 1 --2- 172.21.15.82:0/3302057999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae58070070 0x7fae581481c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fae58070020 tx=0x7fae5000eb10 comp rx=0 tx=0).stop 2023-11-28T13:00:40.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.864+0000 7fae5edfe700 1 -- 172.21.15.82:0/3302057999 shutdown_connections 2023-11-28T13:00:40.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.864+0000 7fae5edfe700 1 --2- 172.21.15.82:0/3302057999 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fae44064ee0 0x7fae44067390 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.864+0000 7fae5edfe700 1 --2- 172.21.15.82:0/3302057999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae58070070 0x7fae581481c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.864+0000 7fae5edfe700 1 --2- 172.21.15.82:0/3302057999 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae5806d980 0x7fae58147c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.864+0000 7fae5edfe700 1 --2- 172.21.15.82:0/3302057999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5806cfa0 0x7fae580c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:40.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.864+0000 7fae5edfe700 1 -- 172.21.15.82:0/3302057999 >> 172.21.15.82:0/3302057999 conn(0x7fae580ce600 msgr2=0x7fae58070440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:40.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.864+0000 7fae5edfe700 1 -- 172.21.15.82:0/3302057999 shutdown_connections 2023-11-28T13:00:40.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:40.864+0000 7fae5edfe700 1 -- 172.21.15.82:0/3302057999 wait complete. 2023-11-28T13:00:40.870 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 7 2023-11-28T13:00:41.289 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T13:00:25.978137+0000', 'modified': '2023-11-28T13:00:28.990262+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4314}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4314': {'gid': 4314, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6837/2893797521', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6836', 'nonce': 2893797521}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 2893797521}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T13:00:41.289 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T13:00:41.289 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-28T13:00:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f710aa63700 1 Processor -- start 2023-11-28T13:00:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f710aa63700 1 -- start start 2023-11-28T13:00:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f710aa63700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f710406b910 0x7f7104160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f710aa63700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f71040d06f0 0x7f71040d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f710aa63700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71040d28e0 con 0x7f71040ced70 2023-11-28T13:00:41.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f710aa63700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71040cdfe0 con 0x7f71040d06f0 2023-11-28T13:00:41.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f710aa63700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7104160cc0 con 0x7f710406b910 2023-11-28T13:00:41.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f7109260700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f71040ced70 0x7f710406bce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60562/0 (socket says 172.21.15.82:60562) 2023-11-28T13:00:41.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f7109260700 1 -- 172.21.15.82:0/1318896758 learned_addr learned my addr 172.21.15.82:0/1318896758 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:41.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f7109a61700 1 --2- 172.21.15.82:0/1318896758 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f710406b910 0x7f7104160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f710a262700 1 --2- 172.21.15.82:0/1318896758 >> v2:172.21.15.114:3300/0 conn(0x7f71040d06f0 0x7f71040d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f7108a5f700 1 -- 172.21.15.82:0/1318896758 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892791483 0 0) 0x7f70f4001110 con 0x7f71040ced70 2023-11-28T13:00:41.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f7108a5f700 1 -- 172.21.15.82:0/1318896758 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70f00035d0 con 0x7f71040ced70 2023-11-28T13:00:41.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f710a262700 1 -- 172.21.15.82:0/1318896758 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f710406b910 msgr2=0x7f7104160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:41.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f710a262700 1 --2- 172.21.15.82:0/1318896758 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f710406b910 0x7f7104160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f710a262700 1 -- 172.21.15.82:0/1318896758 >> v1:172.21.15.82:6789/0 conn(0x7f71040ced70 legacy=0x7f710406bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f7108a5f700 1 -- 172.21.15.82:0/1318896758 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3275643439 0 0) 0x7f70f00035d0 con 0x7f71040ced70 2023-11-28T13:00:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f710a262700 1 -- 172.21.15.82:0/1318896758 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71040b2040 con 0x7f71040d06f0 2023-11-28T13:00:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f710a262700 1 --2- 172.21.15.82:0/1318896758 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71040d06f0 0x7f71040d0b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009d90 tx=0x7f70fc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=165ad67e720514a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f7108a5f700 1 -- 172.21.15.82:0/1318896758 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc00e070 con 0x7f71040d06f0 2023-11-28T13:00:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f7108a5f700 1 -- 172.21.15.82:0/1318896758 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70fc003a40 con 0x7f71040d06f0 2023-11-28T13:00:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.412+0000 7f7108a5f700 1 -- 172.21.15.82:0/1318896758 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4001800 con 0x7f71040d06f0 2023-11-28T13:00:41.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.416+0000 7f710aa63700 1 -- 172.21.15.82:0/1318896758 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71040d06f0 msgr2=0x7f71040d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:41.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.416+0000 7f710aa63700 1 --2- 172.21.15.82:0/1318896758 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71040d06f0 0x7f71040d0b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009d90 tx=0x7f70fc00b330 comp rx=0 tx=0).stop 2023-11-28T13:00:41.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.416+0000 7f710aa63700 1 -- 172.21.15.82:0/1318896758 shutdown_connections 2023-11-28T13:00:41.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.416+0000 7f710aa63700 1 --2- 172.21.15.82:0/1318896758 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71040d06f0 0x7f71040d0b10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.416+0000 7f710aa63700 1 --2- 172.21.15.82:0/1318896758 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f710406b910 0x7f7104160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.416+0000 7f710aa63700 1 -- 172.21.15.82:0/1318896758 >> 172.21.15.82:0/1318896758 conn(0x7f71040d2b20 msgr2=0x7f71040d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:41.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.416+0000 7f710aa63700 1 -- 172.21.15.82:0/1318896758 shutdown_connections 2023-11-28T13:00:41.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.416+0000 7f710aa63700 1 -- 172.21.15.82:0/1318896758 wait complete. 2023-11-28T13:00:41.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.416+0000 7f710aa63700 1 Processor -- start 2023-11-28T13:00:41.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.416+0000 7f710aa63700 1 -- start start 2023-11-28T13:00:41.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f710aa63700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f710406b910 0x7f71040c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f710aa63700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71040ced70 0x7f71040c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f710aa63700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71040d06f0 0x7f71040ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f710aa63700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71040b2c20 con 0x7f710406b910 2023-11-28T13:00:41.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f710aa63700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71040b2fb0 con 0x7f71040ced70 2023-11-28T13:00:41.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f710aa63700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710415a9c0 con 0x7f71040d06f0 2023-11-28T13:00:41.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f7109a61700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f710406b910 0x7f71040c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f7109a61700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f710406b910 0x7f71040c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50958/0 (socket says 172.21.15.82:50958) 2023-11-28T13:00:41.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f7109a61700 1 -- 172.21.15.82:0/2704463871 learned_addr learned my addr 172.21.15.82:0/2704463871 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:41.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f7109260700 1 --2- 172.21.15.82:0/2704463871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71040ced70 0x7f71040c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f710a262700 1 --2- 172.21.15.82:0/2704463871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71040d06f0 0x7f71040ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f7109a61700 1 -- 172.21.15.82:0/2704463871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71040d06f0 msgr2=0x7f71040ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:41.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f7109a61700 1 --2- 172.21.15.82:0/2704463871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71040d06f0 0x7f71040ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f7109a61700 1 -- 172.21.15.82:0/2704463871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71040ced70 msgr2=0x7f71040c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:41.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f7109a61700 1 --2- 172.21.15.82:0/2704463871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71040ced70 0x7f71040c9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f7109a61700 1 -- 172.21.15.82:0/2704463871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc009a70 con 0x7f710406b910 2023-11-28T13:00:41.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f7109260700 1 --2- 172.21.15.82:0/2704463871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71040ced70 0x7f71040c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:41.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f710a262700 1 --2- 172.21.15.82:0/2704463871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71040d06f0 0x7f71040ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:41.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f7109a61700 1 --2- 172.21.15.82:0/2704463871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f710406b910 0x7f71040c8f70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f710000e840 tx=0x7f710000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:41.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f70fa7fc700 1 -- 172.21.15.82:0/2704463871 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71000095a0 con 0x7f710406b910 2023-11-28T13:00:41.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f70fa7fc700 1 -- 172.21.15.82:0/2704463871 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710000c690 con 0x7f710406b910 2023-11-28T13:00:41.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f710aa63700 1 -- 172.21.15.82:0/2704463871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71040d2320 con 0x7f710406b910 2023-11-28T13:00:41.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f70fa7fc700 1 -- 172.21.15.82:0/2704463871 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710000ca00 con 0x7f710406b910 2023-11-28T13:00:41.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.420+0000 7f710aa63700 1 -- 172.21.15.82:0/2704463871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71040cf2c0 con 0x7f710406b910 2023-11-28T13:00:41.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.424+0000 7f70fa7fc700 1 -- 172.21.15.82:0/2704463871 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7100019030 con 0x7f710406b910 2023-11-28T13:00:41.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.424+0000 7f70fa7fc700 1 --2- 172.21.15.82:0/2704463871 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f70e8064ee0 0x7f70e8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.424+0000 7f70fa7fc700 1 -- 172.21.15.82:0/2704463871 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7100081cf0 con 0x7f710406b910 2023-11-28T13:00:41.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.424+0000 7f7109260700 1 --2- 172.21.15.82:0/2704463871 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f70e8064ee0 0x7f70e8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.424+0000 7f7109260700 1 --2- 172.21.15.82:0/2704463871 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f70e8064ee0 0x7f70e8067390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f70f4001eb0 tx=0x7f70f40016c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:41.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.424+0000 7f710ef45740 1 Processor -- start 2023-11-28T13:00:41.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.424+0000 7f710ef45740 1 -- start start 2023-11-28T13:00:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.424+0000 7f710ef45740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54ae0 0x1004e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.424+0000 7f710ef45740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd54710 0x1005340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.424+0000 7f710ef45740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xd9f790 0x1005880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.424+0000 7f710ef45740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0xec3ae0 con 0xd54ae0 2023-11-28T13:00:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.424+0000 7f710ef45740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0xf33bd0 con 0xd9f790 2023-11-28T13:00:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.424+0000 7f710ef45740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0xf2ced0 con 0xd54710 2023-11-28T13:00:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f7109a61700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54ae0 0x1004e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f7109a61700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54ae0 0x1004e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50968/0 (socket says 172.21.15.82:50968) 2023-11-28T13:00:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f7109a61700 1 -- 172.21.15.82:0/1913370195 learned_addr learned my addr 172.21.15.82:0/1913370195 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f7109260700 1 --2- 172.21.15.82:0/1913370195 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd54710 0x1005340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f710a262700 1 --2- 172.21.15.82:0/1913370195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xd9f790 0x1005880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f7109a61700 1 -- 172.21.15.82:0/1913370195 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd54710 msgr2=0x1005340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f7109a61700 1 --2- 172.21.15.82:0/1913370195 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd54710 0x1005340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f7109a61700 1 -- 172.21.15.82:0/1913370195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xd9f790 msgr2=0x1005880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f7109a61700 1 --2- 172.21.15.82:0/1913370195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xd9f790 0x1005880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f7109a61700 1 -- 172.21.15.82:0/1913370195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xf52cc0 con 0xd54ae0 2023-11-28T13:00:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f7109a61700 1 --2- 172.21.15.82:0/1913370195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54ae0 0x1004e00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f710005bda0 tx=0x7f7100051c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff3c8a9bc2ad7d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f70e77fe700 1 -- 172.21.15.82:0/1913370195 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710005b750 con 0xd54ae0 2023-11-28T13:00:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f70e77fe700 1 -- 172.21.15.82:0/1913370195 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710005b8b0 con 0xd54ae0 2023-11-28T13:00:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f70e77fe700 1 -- 172.21.15.82:0/1913370195 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710005ba20 con 0xd54ae0 2023-11-28T13:00:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f710ef45740 1 -- 172.21.15.82:0/1913370195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54ae0 msgr2=0x1004e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f710ef45740 1 --2- 172.21.15.82:0/1913370195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54ae0 0x1004e00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f710005bda0 tx=0x7f7100051c30 comp rx=0 tx=0).stop 2023-11-28T13:00:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f710ef45740 1 -- 172.21.15.82:0/1913370195 shutdown_connections 2023-11-28T13:00:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f710ef45740 1 --2- 172.21.15.82:0/1913370195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xd9f790 0x1005880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f710ef45740 1 --2- 172.21.15.82:0/1913370195 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd54710 0x1005340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f710ef45740 1 --2- 172.21.15.82:0/1913370195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54ae0 0x1004e00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f710ef45740 1 -- 172.21.15.82:0/1913370195 >> 172.21.15.82:0/1913370195 conn(0xd54eb0 msgr2=0xfed700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f710ef45740 1 -- 172.21.15.82:0/1913370195 shutdown_connections 2023-11-28T13:00:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f710ef45740 1 -- 172.21.15.82:0/1913370195 wait complete. 2023-11-28T13:00:41.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f710ef45740 1 -- start start 2023-11-28T13:00:41.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.428+0000 7f710ef45740 1 Processor -- start 2023-11-28T13:00:41.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f710ef45740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54710 0xfdd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f710ef45740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xd54ae0 0x1002760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f710ef45740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd9f790 0xfdbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f710ef45740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0xdd9b20 con 0xd54710 2023-11-28T13:00:41.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f710ef45740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1002ca0 con 0xd54ae0 2023-11-28T13:00:41.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f710ef45740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0xfec150 con 0xd9f790 2023-11-28T13:00:41.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f710ef45740 10 client.0 _ll_register_callbacks cb 0xf890d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:00:41.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f7109a61700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54710 0xfdd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f7109a61700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54710 0xfdd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50984/0 (socket says 172.21.15.82:50984) 2023-11-28T13:00:41.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f7109a61700 1 -- 172.21.15.82:0/2593221487 learned_addr learned my addr 172.21.15.82:0/2593221487 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:41.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f7109260700 1 --2- 172.21.15.82:0/2593221487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xd54ae0 0x1002760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f710a262700 1 --2- 172.21.15.82:0/2593221487 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd9f790 0xfdbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f7109a61700 1 -- 172.21.15.82:0/2593221487 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd9f790 msgr2=0xfdbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:41.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f7109a61700 1 --2- 172.21.15.82:0/2593221487 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd9f790 0xfdbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f7109a61700 1 -- 172.21.15.82:0/2593221487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xd54ae0 msgr2=0x1002760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:41.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f7109a61700 1 --2- 172.21.15.82:0/2593221487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xd54ae0 0x1002760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f7109a61700 1 -- 172.21.15.82:0/2593221487 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71040cf2c0 con 0xd54710 2023-11-28T13:00:41.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f710a262700 1 --2- 172.21.15.82:0/2593221487 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd9f790 0xfdbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:41.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f7109260700 1 --2- 172.21.15.82:0/2593221487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xd54ae0 0x1002760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:41.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f7109a61700 1 --2- 172.21.15.82:0/2593221487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54710 0xfdd0b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f710000c390 tx=0x7f7100004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d8244e7d0ec5ba3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:41.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f70e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-11-28T13:00:41.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f70e4ff9700 1 -- 172.21.15.82:0/2593221487 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710004f8e0 con 0xd54710 2023-11-28T13:00:41.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f70e4ff9700 1 -- 172.21.15.82:0/2593221487 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f710004fa40 con 0xd54710 2023-11-28T13:00:41.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f710ef45740 1 -- 172.21.15.82:0/2593221487 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xf25f50 con 0xd54710 2023-11-28T13:00:41.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f70e4ff9700 1 -- 172.21.15.82:0/2593221487 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f710004fc00 con 0xd54710 2023-11-28T13:00:41.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f710ef45740 10 client.4662 fetch_fsmap learned FSMap version 7 2023-11-28T13:00:41.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f710ef45740 1 -- 172.21.15.82:0/2593221487 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0xda09e0 con 0xd54710 2023-11-28T13:00:41.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f70e4ff9700 1 -- 172.21.15.82:0/2593221487 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xf25f50 con 0xd54710 2023-11-28T13:00:41.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f70e4ff9700 1 -- 172.21.15.82:0/2593221487 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 7) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f7100057ab0 con 0xd54710 2023-11-28T13:00:41.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f710ef45740 10 client.4662 fetch_fsmap finished waiting for FSMap version 7 2023-11-28T13:00:41.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f710ef45740 10 client.4662 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T13:00:41.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f710ef45740 20 client.4662 populate_metadata read hostname 'smithi082' 2023-11-28T13:00:41.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f710ef45740 1 --2- 172.21.15.82:0/2593221487 >> [v2:172.21.15.82:6836/2893797521,v1:172.21.15.82:6837/2893797521] conn(0xfdec70 0xfdf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f710ef45740 4 client.4662 mds_command: new command op to 4314 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T13:00:41.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f710ef45740 1 -- 172.21.15.82:0/2593221487 --> [v2:172.21.15.82:6836/2893797521,v1:172.21.15.82:6837/2893797521] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xf25c70 con 0xfdec70 2023-11-28T13:00:41.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f7109260700 1 --2- 172.21.15.82:0/2593221487 >> [v2:172.21.15.82:6836/2893797521,v1:172.21.15.82:6837/2893797521] conn(0xfdec70 0xfdf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f70e4ff9700 10 client.4662 ms_handle_connect on v2:172.21.15.82:6836/2893797521 2023-11-28T13:00:41.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.432+0000 7f7109260700 1 --2- 172.21.15.82:0/2593221487 >> [v2:172.21.15.82:6836/2893797521,v1:172.21.15.82:6837/2893797521] conn(0xfdec70 0xfdf040 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60e60e1f3bbb9d99 server_cookie=1fc0092ff2369a18 in_seq=0 out_seq=0 2023-11-28T13:00:41.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.436+0000 7f70e4ff9700 1 -- 172.21.15.82:0/2593221487 <== mds.0 v2:172.21.15.82:6836/2893797521 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0xf25c70 con 0xfdec70 2023-11-28T13:00:41.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.436+0000 7f70e4ff9700 10 client.4662 handle_command_reply: tid=0 2023-11-28T13:00:41.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.436+0000 7f710ef45740 1 client.4662 shutdown 2023-11-28T13:00:41.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.436+0000 7f710ef45740 1 -- 172.21.15.82:0/2593221487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54710 msgr2=0xfdd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:41.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.436+0000 7f710ef45740 1 --2- 172.21.15.82:0/2593221487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54710 0xfdd0b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f710000c390 tx=0x7f7100004770 comp rx=0 tx=0).stop 2023-11-28T13:00:41.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.436+0000 7f710ef45740 1 -- 172.21.15.82:0/2593221487 shutdown_connections 2023-11-28T13:00:41.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.436+0000 7f710ef45740 1 --2- 172.21.15.82:0/2593221487 >> [v2:172.21.15.82:6836/2893797521,v1:172.21.15.82:6837/2893797521] conn(0xfdec70 0xfdf040 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.436+0000 7f710ef45740 1 --2- 172.21.15.82:0/2593221487 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd9f790 0xfdbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.436+0000 7f70e4ff9700 0 client.4662 ms_handle_reset on v2:172.21.15.82:6836/2893797521 2023-11-28T13:00:41.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.436+0000 7f710ef45740 1 --2- 172.21.15.82:0/2593221487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xd54ae0 0x1002760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.436+0000 7f710ef45740 1 --2- 172.21.15.82:0/2593221487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54710 0xfdd0b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.436+0000 7f710ef45740 1 -- 172.21.15.82:0/2593221487 >> 172.21.15.82:0/2593221487 conn(0xd54eb0 msgr2=0x10063c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:41.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.436+0000 7f710ef45740 1 -- 172.21.15.82:0/2593221487 shutdown_connections 2023-11-28T13:00:41.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.436+0000 7f710ef45740 1 -- 172.21.15.82:0/2593221487 wait complete. 2023-11-28T13:00:41.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.436+0000 7f710ef45740 20 client.4662 trim_cache size 0 max 16384 2023-11-28T13:00:41.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f710ef45740 1 Processor -- start 2023-11-28T13:00:41.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f710ef45740 1 -- start start 2023-11-28T13:00:41.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f710ef45740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xd54710 0xfc5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f710ef45740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54ae0 0xfc63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f710ef45740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd9f790 0x1013870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f710ef45740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0xf31040 con 0xd54ae0 2023-11-28T13:00:41.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f710ef45740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0xee2a40 con 0xd54710 2023-11-28T13:00:41.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f710ef45740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0xed3750 con 0xd9f790 2023-11-28T13:00:41.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f7109260700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54ae0 0xfc63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f7109260700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54ae0 0xfc63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50986/0 (socket says 172.21.15.82:50986) 2023-11-28T13:00:41.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f7109260700 1 -- 172.21.15.82:0/2020572109 learned_addr learned my addr 172.21.15.82:0/2020572109 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:41.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f7109a61700 1 --2- 172.21.15.82:0/2020572109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xd54710 0xfc5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f710a262700 1 --2- 172.21.15.82:0/2020572109 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd9f790 0x1013870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f7109260700 1 -- 172.21.15.82:0/2020572109 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd9f790 msgr2=0x1013870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:41.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f7109260700 1 --2- 172.21.15.82:0/2020572109 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd9f790 0x1013870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f7109260700 1 -- 172.21.15.82:0/2020572109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xd54710 msgr2=0xfc5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:41.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f7109260700 1 --2- 172.21.15.82:0/2020572109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xd54710 0xfc5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f7109260700 1 -- 172.21.15.82:0/2020572109 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71040ca9d0 con 0xd54ae0 2023-11-28T13:00:41.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f710a262700 1 --2- 172.21.15.82:0/2020572109 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd9f790 0x1013870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:00:41.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f7109260700 1 --2- 172.21.15.82:0/2020572109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54ae0 0xfc63f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f70f4001360 tx=0x7f70f4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e180a75a84d7691b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:41.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f70e7fff700 1 -- 172.21.15.82:0/2020572109 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4024420 con 0xd54ae0 2023-11-28T13:00:41.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f70e7fff700 1 -- 172.21.15.82:0/2020572109 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f400ed70 con 0xd54ae0 2023-11-28T13:00:41.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f70e7fff700 1 -- 172.21.15.82:0/2020572109 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f400eee0 con 0xd54ae0 2023-11-28T13:00:41.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f710ef45740 1 -- 172.21.15.82:0/2020572109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54ae0 msgr2=0xfc63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:41.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f710ef45740 1 --2- 172.21.15.82:0/2020572109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54ae0 0xfc63f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f70f4001360 tx=0x7f70f4012000 comp rx=0 tx=0).stop 2023-11-28T13:00:41.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f710ef45740 1 -- 172.21.15.82:0/2020572109 shutdown_connections 2023-11-28T13:00:41.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f710ef45740 1 --2- 172.21.15.82:0/2020572109 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd9f790 0x1013870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f710ef45740 1 --2- 172.21.15.82:0/2020572109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54ae0 0xfc63f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f710ef45740 1 --2- 172.21.15.82:0/2020572109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xd54710 0xfc5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f710ef45740 1 -- 172.21.15.82:0/2020572109 >> 172.21.15.82:0/2020572109 conn(0xd54eb0 msgr2=0xfdb900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:41.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f710ef45740 1 -- 172.21.15.82:0/2020572109 shutdown_connections 2023-11-28T13:00:41.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.456+0000 7f710ef45740 1 -- 172.21.15.82:0/2020572109 wait complete. 2023-11-28T13:00:41.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f710ef45740 1 -- start start 2023-11-28T13:00:41.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f710ef45740 1 Processor -- start 2023-11-28T13:00:41.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f710ef45740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd54710 0x10677d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f710ef45740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54ae0 0x10163e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f710ef45740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xd9f790 0x1016920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f710ef45740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1015760 con 0xd54ae0 2023-11-28T13:00:41.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f710ef45740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1015a00 con 0xd9f790 2023-11-28T13:00:41.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f710ef45740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x1015ca0 con 0xd54710 2023-11-28T13:00:41.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f710ef45740 10 client.0 _ll_register_callbacks cb 0xed92d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:00:41.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f7109260700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54ae0 0x10163e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f7109260700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54ae0 0x10163e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50990/0 (socket says 172.21.15.82:50990) 2023-11-28T13:00:41.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f7109260700 1 -- 172.21.15.82:0/225835755 learned_addr learned my addr 172.21.15.82:0/225835755 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:41.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f7109a61700 1 --2- 172.21.15.82:0/225835755 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd54710 0x10677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f710a262700 1 --2- 172.21.15.82:0/225835755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xd9f790 0x1016920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f7109260700 1 -- 172.21.15.82:0/225835755 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd54710 msgr2=0x10677d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:41.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f7109260700 1 --2- 172.21.15.82:0/225835755 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd54710 0x10677d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f7109260700 1 -- 172.21.15.82:0/225835755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xd9f790 msgr2=0x1016920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:41.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f7109260700 1 --2- 172.21.15.82:0/225835755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xd9f790 0x1016920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f7109260700 1 -- 172.21.15.82:0/225835755 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f400f040 con 0xd54ae0 2023-11-28T13:00:41.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f70e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-11-28T13:00:41.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f7109260700 1 --2- 172.21.15.82:0/225835755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54ae0 0x10163e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x1023400 tx=0x7f70f4001400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d57e6374e3710a4d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:41.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f70e4ff9700 1 -- 172.21.15.82:0/225835755 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4024e90 con 0xd54ae0 2023-11-28T13:00:41.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f70e4ff9700 1 -- 172.21.15.82:0/225835755 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f70f4013420 con 0xd54ae0 2023-11-28T13:00:41.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f710ef45740 1 -- 172.21.15.82:0/225835755 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f710005b8b0 con 0xd54ae0 2023-11-28T13:00:41.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.460+0000 7f70e4ff9700 1 -- 172.21.15.82:0/225835755 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70f40135e0 con 0xd54ae0 2023-11-28T13:00:41.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710ef45740 10 client.4668 fetch_fsmap learned FSMap version 7 2023-11-28T13:00:41.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710ef45740 1 -- 172.21.15.82:0/225835755 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0xed9a20 con 0xd54ae0 2023-11-28T13:00:41.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f70e4ff9700 1 -- 172.21.15.82:0/225835755 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710005b8b0 con 0xd54ae0 2023-11-28T13:00:41.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f70e4ff9700 1 -- 172.21.15.82:0/225835755 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 7) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f70f4020070 con 0xd54ae0 2023-11-28T13:00:41.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710ef45740 10 client.4668 fetch_fsmap finished waiting for FSMap version 7 2023-11-28T13:00:41.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710ef45740 10 client.4668 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T13:00:41.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710ef45740 20 client.4668 populate_metadata read hostname 'smithi082' 2023-11-28T13:00:41.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710ef45740 1 --2- 172.21.15.82:0/225835755 >> [v2:172.21.15.82:6836/2893797521,v1:172.21.15.82:6837/2893797521] conn(0x10173d0 0x1019030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710ef45740 4 client.4668 mds_command: new command op to 4314 tid=0[{"prefix": "status"}] 2023-11-28T13:00:41.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710ef45740 1 -- 172.21.15.82:0/225835755 --> [v2:172.21.15.82:6836/2893797521,v1:172.21.15.82:6837/2893797521] -- command(tid 0: {"prefix": "status"}) v1 -- 0xdd1260 con 0x10173d0 2023-11-28T13:00:41.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f7109a61700 1 --2- 172.21.15.82:0/225835755 >> [v2:172.21.15.82:6836/2893797521,v1:172.21.15.82:6837/2893797521] conn(0x10173d0 0x1019030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f7109a61700 1 --2- 172.21.15.82:0/225835755 >> [v2:172.21.15.82:6836/2893797521,v1:172.21.15.82:6837/2893797521] conn(0x10173d0 0x1019030 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7eee488aa039896 server_cookie=899d76695b1e8fb3 in_seq=0 out_seq=0 2023-11-28T13:00:41.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f70e4ff9700 10 client.4668 ms_handle_connect on v2:172.21.15.82:6836/2893797521 2023-11-28T13:00:41.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f70e4ff9700 1 -- 172.21.15.82:0/225835755 <== mds.0 v2:172.21.15.82:6836/2893797521 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0xdd1260 con 0x10173d0 2023-11-28T13:00:41.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f70e4ff9700 10 client.4668 handle_command_reply: tid=0 2023-11-28T13:00:41.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710ef45740 1 client.4668 shutdown 2023-11-28T13:00:41.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710ef45740 1 -- 172.21.15.82:0/225835755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54ae0 msgr2=0x10163e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:41.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710ef45740 1 --2- 172.21.15.82:0/225835755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54ae0 0x10163e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x1023400 tx=0x7f70f4001400 comp rx=0 tx=0).stop 2023-11-28T13:00:41.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710ef45740 1 -- 172.21.15.82:0/225835755 shutdown_connections 2023-11-28T13:00:41.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710ef45740 1 --2- 172.21.15.82:0/225835755 >> [v2:172.21.15.82:6836/2893797521,v1:172.21.15.82:6837/2893797521] conn(0x10173d0 0x1019030 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710ef45740 1 --2- 172.21.15.82:0/225835755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xd9f790 0x1016920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710ef45740 1 --2- 172.21.15.82:0/225835755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xd54ae0 0x10163e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f70e4ff9700 0 client.4668 ms_handle_reset on v2:172.21.15.82:6836/2893797521 2023-11-28T13:00:41.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710ef45740 1 --2- 172.21.15.82:0/225835755 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xd54710 0x10677d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710ef45740 1 -- 172.21.15.82:0/225835755 >> 172.21.15.82:0/225835755 conn(0xd54eb0 msgr2=0x1005b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:41.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710ef45740 1 -- 172.21.15.82:0/225835755 shutdown_connections 2023-11-28T13:00:41.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710ef45740 1 -- 172.21.15.82:0/225835755 wait complete. 2023-11-28T13:00:41.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710ef45740 20 client.4668 trim_cache size 0 max 16384 2023-11-28T13:00:41.472 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:00:41.472 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "aef8a97f-1d6c-4a2b-9410-16861b3e9e35", 2023-11-28T13:00:41.472 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-11-28T13:00:41.472 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4314, 2023-11-28T13:00:41.472 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-11-28T13:00:41.472 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-11-28T13:00:41.472 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-11-28T13:00:41.472 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 15.485651024999999, 2023-11-28T13:00:41.473 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 7, 2023-11-28T13:00:41.473 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 24, 2023-11-28T13:00:41.473 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 24, 2023-11-28T13:00:41.473 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 19.905459008000001 2023-11-28T13:00:41.473 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:00:41.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710aa63700 1 -- 172.21.15.82:0/2704463871 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f70e8064ee0 msgr2=0x7f70e8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:41.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710aa63700 1 --2- 172.21.15.82:0/2704463871 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f70e8064ee0 0x7f70e8067390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f70f4001eb0 tx=0x7f70f40016c0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710aa63700 1 -- 172.21.15.82:0/2704463871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f710406b910 msgr2=0x7f71040c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:41.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710aa63700 1 --2- 172.21.15.82:0/2704463871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f710406b910 0x7f71040c8f70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f710000e840 tx=0x7f710000ec00 comp rx=0 tx=0).stop 2023-11-28T13:00:41.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710aa63700 1 -- 172.21.15.82:0/2704463871 shutdown_connections 2023-11-28T13:00:41.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710aa63700 1 --2- 172.21.15.82:0/2704463871 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f70e8064ee0 0x7f70e8067390 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710aa63700 1 --2- 172.21.15.82:0/2704463871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71040d06f0 0x7f71040ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710aa63700 1 --2- 172.21.15.82:0/2704463871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71040ced70 0x7f71040c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710aa63700 1 --2- 172.21.15.82:0/2704463871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f710406b910 0x7f71040c8f70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710aa63700 1 -- 172.21.15.82:0/2704463871 >> 172.21.15.82:0/2704463871 conn(0x7f71040d2b20 msgr2=0x7f7104160350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:41.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710aa63700 1 -- 172.21.15.82:0/2704463871 shutdown_connections 2023-11-28T13:00:41.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.464+0000 7f710aa63700 1 -- 172.21.15.82:0/2704463871 wait complete. 2023-11-28T13:00:41.483 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-28T13:00:41.521 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-28T13:00:41.522 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-28T13:00:41.522 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-28T13:00:41.522 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T13:00:41.522 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T13:00:41.522 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-28T13:00:41.522 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T13:00:41.522 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-28T13:00:41.522 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-28T13:00:41.523 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T13:00:41.523 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T13:00:41.523 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-28T13:00:41.523 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T13:00:41.523 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-28T13:00:41.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:41.523 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-11-28T13:00:41.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:41.531 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2023-11-28T13:00:41.592 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2023-11-28T13:00:41.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T13:00:41.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:41.594 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-11-28T13:00:41.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:41.602 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2023-11-28T13:00:41.621 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2023-11-28T13:00:41.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T13:00:41.622 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-28T13:00:41.622 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T13:00:41.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.740+0000 7fc45a6bd700 1 Processor -- start 2023-11-28T13:00:41.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.740+0000 7fc45a6bd700 1 -- start start 2023-11-28T13:00:41.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.740+0000 7fc45a6bd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc45406b910 0x7fc454160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.740+0000 7fc45a6bd700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4540ced70 0x7fc45406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.740+0000 7fc45a6bd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4540d28e0 con 0x7fc454069bc0 2023-11-28T13:00:41.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.740+0000 7fc45a6bd700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4540cdfe0 con 0x7fc45406b910 2023-11-28T13:00:41.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.740+0000 7fc45a6bd700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc454160cc0 con 0x7fc4540ced70 2023-11-28T13:00:41.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.740+0000 7fc459ebc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc454069bc0 0x7fc454069fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60568/0 (socket says 172.21.15.82:60568) 2023-11-28T13:00:41.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.740+0000 7fc459ebc700 1 -- 172.21.15.82:0/3408030910 learned_addr learned my addr 172.21.15.82:0/3408030910 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:41.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.740+0000 7fc458eba700 1 --2- 172.21.15.82:0/3408030910 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4540ced70 0x7fc45406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.740+0000 7fc4596bb700 1 --2- 172.21.15.82:0/3408030910 >> v2:172.21.15.114:3300/0 conn(0x7fc45406b910 0x7fc454160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.744+0000 7fc44bfff700 1 -- 172.21.15.82:0/3408030910 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214717986 0 0) 0x7fc44c001490 con 0x7fc454069bc0 2023-11-28T13:00:41.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.744+0000 7fc44bfff700 1 -- 172.21.15.82:0/3408030910 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4400035d0 con 0x7fc454069bc0 2023-11-28T13:00:41.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.744+0000 7fc458eba700 1 -- 172.21.15.82:0/3408030910 >> v2:172.21.15.114:3300/0 conn(0x7fc45406b910 msgr2=0x7fc454160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:41.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.744+0000 7fc458eba700 1 --2- 172.21.15.82:0/3408030910 >> v2:172.21.15.114:3300/0 conn(0x7fc45406b910 0x7fc454160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.744+0000 7fc458eba700 1 -- 172.21.15.82:0/3408030910 >> v1:172.21.15.82:6789/0 conn(0x7fc454069bc0 legacy=0x7fc454069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:41.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.744+0000 7fc458eba700 1 -- 172.21.15.82:0/3408030910 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45406c220 con 0x7fc4540ced70 2023-11-28T13:00:41.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.744+0000 7fc458eba700 1 --2- 172.21.15.82:0/3408030910 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4540ced70 0x7fc45406bce0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc444009850 tx=0x7fc444009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8e854bfb68a3ee5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:41.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.744+0000 7fc44bfff700 1 -- 172.21.15.82:0/3408030910 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc444011830 con 0x7fc4540ced70 2023-11-28T13:00:41.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.744+0000 7fc44bfff700 1 -- 172.21.15.82:0/3408030910 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc444011990 con 0x7fc4540ced70 2023-11-28T13:00:41.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.744+0000 7fc44bfff700 1 -- 172.21.15.82:0/3408030910 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc444011d00 con 0x7fc4540ced70 2023-11-28T13:00:41.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.744+0000 7fc45a6bd700 1 -- 172.21.15.82:0/3408030910 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4540ced70 msgr2=0x7fc45406bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:41.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.744+0000 7fc45a6bd700 1 --2- 172.21.15.82:0/3408030910 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4540ced70 0x7fc45406bce0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc444009850 tx=0x7fc444009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:41.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.744+0000 7fc45a6bd700 1 -- 172.21.15.82:0/3408030910 shutdown_connections 2023-11-28T13:00:41.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.744+0000 7fc45a6bd700 1 --2- 172.21.15.82:0/3408030910 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4540ced70 0x7fc45406bce0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.744+0000 7fc45a6bd700 1 --2- 172.21.15.82:0/3408030910 >> v2:172.21.15.114:3300/0 conn(0x7fc45406b910 0x7fc454160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.744+0000 7fc45a6bd700 1 -- 172.21.15.82:0/3408030910 >> 172.21.15.82:0/3408030910 conn(0x7fc4540d2b20 msgr2=0x7fc4540d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:41.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.744+0000 7fc45a6bd700 1 -- 172.21.15.82:0/3408030910 shutdown_connections 2023-11-28T13:00:41.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.744+0000 7fc45a6bd700 1 -- 172.21.15.82:0/3408030910 wait complete. 2023-11-28T13:00:41.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.748+0000 7fc45a6bd700 1 Processor -- start 2023-11-28T13:00:41.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.748+0000 7fc45a6bd700 1 -- start start 2023-11-28T13:00:41.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.748+0000 7fc45a6bd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc454069bc0 0x7fc454144f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.748+0000 7fc45a6bd700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc45406b910 0x7fc4541f2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.748+0000 7fc45a6bd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4540ced70 0x7fc4540d2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.748+0000 7fc45a6bd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4541457c0 con 0x7fc454069bc0 2023-11-28T13:00:41.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.748+0000 7fc45a6bd700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc454145aa0 con 0x7fc4540ced70 2023-11-28T13:00:41.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.748+0000 7fc45a6bd700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc454145d80 con 0x7fc45406b910 2023-11-28T13:00:41.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.748+0000 7fc4596bb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc454069bc0 0x7fc454144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.748+0000 7fc4596bb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc454069bc0 0x7fc454144f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51004/0 (socket says 172.21.15.82:51004) 2023-11-28T13:00:41.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.748+0000 7fc4596bb700 1 -- 172.21.15.82:0/3771710808 learned_addr learned my addr 172.21.15.82:0/3771710808 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:41.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.752+0000 7fc458eba700 1 --2- 172.21.15.82:0/3771710808 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc45406b910 0x7fc4541f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.752+0000 7fc459ebc700 1 --2- 172.21.15.82:0/3771710808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4540ced70 0x7fc4540d2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.752+0000 7fc4596bb700 1 -- 172.21.15.82:0/3771710808 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc45406b910 msgr2=0x7fc4541f2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:41.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.752+0000 7fc4596bb700 1 --2- 172.21.15.82:0/3771710808 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc45406b910 0x7fc4541f2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.752+0000 7fc4596bb700 1 -- 172.21.15.82:0/3771710808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4540ced70 msgr2=0x7fc4540d2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:41.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.752+0000 7fc4596bb700 1 --2- 172.21.15.82:0/3771710808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4540ced70 0x7fc4540d2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.752+0000 7fc4596bb700 1 -- 172.21.15.82:0/3771710808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4440094b0 con 0x7fc454069bc0 2023-11-28T13:00:41.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.752+0000 7fc4596bb700 1 --2- 172.21.15.82:0/3771710808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc454069bc0 0x7fc454144f70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc45000e840 tx=0x7fc45000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:41.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.752+0000 7fc449ffb700 1 -- 172.21.15.82:0/3771710808 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4500095a0 con 0x7fc454069bc0 2023-11-28T13:00:41.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.752+0000 7fc449ffb700 1 -- 172.21.15.82:0/3771710808 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc450013680 con 0x7fc454069bc0 2023-11-28T13:00:41.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.752+0000 7fc449ffb700 1 -- 172.21.15.82:0/3771710808 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4500139f0 con 0x7fc454069bc0 2023-11-28T13:00:41.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.752+0000 7fc45a6bd700 1 -- 172.21.15.82:0/3771710808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4540d1700 con 0x7fc454069bc0 2023-11-28T13:00:41.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.752+0000 7fc45a6bd700 1 -- 172.21.15.82:0/3771710808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4540b2040 con 0x7fc454069bc0 2023-11-28T13:00:41.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.752+0000 7fc45a6bd700 1 -- 172.21.15.82:0/3771710808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4540cf2c0 con 0x7fc454069bc0 2023-11-28T13:00:41.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.752+0000 7fc449ffb700 1 -- 172.21.15.82:0/3771710808 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc450019030 con 0x7fc454069bc0 2023-11-28T13:00:41.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.752+0000 7fc449ffb700 1 --2- 172.21.15.82:0/3771710808 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc438064ee0 0x7fc438067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:41.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.756+0000 7fc449ffb700 1 -- 172.21.15.82:0/3771710808 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc450081d20 con 0x7fc454069bc0 2023-11-28T13:00:41.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.756+0000 7fc458eba700 1 --2- 172.21.15.82:0/3771710808 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc438064ee0 0x7fc438067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:41.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.756+0000 7fc458eba700 1 --2- 172.21.15.82:0/3771710808 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc438064ee0 0x7fc438067390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc4440090b0 tx=0x7fc444008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:41.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.760+0000 7fc449ffb700 1 -- 172.21.15.82:0/3771710808 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc450087020 con 0x7fc454069bc0 2023-11-28T13:00:41.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.960+0000 7fc45a6bd700 1 -- 172.21.15.82:0/3771710808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc454065fc0 con 0x7fc454069bc0 2023-11-28T13:00:41.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.960+0000 7fc449ffb700 1 -- 172.21.15.82:0/3771710808 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc45004fd50 con 0x7fc454069bc0 2023-11-28T13:00:41.966 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T13:00:41.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.964+0000 7fc45a6bd700 1 -- 172.21.15.82:0/3771710808 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc438064ee0 msgr2=0x7fc438067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:41.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.964+0000 7fc45a6bd700 1 --2- 172.21.15.82:0/3771710808 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc438064ee0 0x7fc438067390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc4440090b0 tx=0x7fc444008030 comp rx=0 tx=0).stop 2023-11-28T13:00:41.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.964+0000 7fc45a6bd700 1 -- 172.21.15.82:0/3771710808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc454069bc0 msgr2=0x7fc454144f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:41.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.964+0000 7fc45a6bd700 1 --2- 172.21.15.82:0/3771710808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc454069bc0 0x7fc454144f70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc45000e840 tx=0x7fc45000eb50 comp rx=0 tx=0).stop 2023-11-28T13:00:41.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.964+0000 7fc45a6bd700 1 -- 172.21.15.82:0/3771710808 shutdown_connections 2023-11-28T13:00:41.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.964+0000 7fc45a6bd700 1 --2- 172.21.15.82:0/3771710808 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc438064ee0 0x7fc438067390 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.964+0000 7fc45a6bd700 1 --2- 172.21.15.82:0/3771710808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4540ced70 0x7fc4540d2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.964+0000 7fc45a6bd700 1 --2- 172.21.15.82:0/3771710808 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc45406b910 0x7fc4541f2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.964+0000 7fc45a6bd700 1 --2- 172.21.15.82:0/3771710808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc454069bc0 0x7fc454144f70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:41.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.964+0000 7fc45a6bd700 1 -- 172.21.15.82:0/3771710808 >> 172.21.15.82:0/3771710808 conn(0x7fc4540d2b20 msgr2=0x7fc45415f080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:41.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.964+0000 7fc45a6bd700 1 -- 172.21.15.82:0/3771710808 shutdown_connections 2023-11-28T13:00:41.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:41.964+0000 7fc45a6bd700 1 -- 172.21.15.82:0/3771710808 wait complete. 2023-11-28T13:00:41.984 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T13:00:41.984 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T13:00:41.984 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-11-28T13:00:41.984 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T13:00:41.985 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T13:00:41.985 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T13:00:41.985 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T13:00:41.985 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T13:00:41.985 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T13:00:41.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:41.985 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-11-28T13:00:41.993 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T13:00:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T13:00:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T13:00:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-11-28T13:00:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:41.994 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T13:00:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:41.994 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T13:00:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:41.994 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T13:00:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:41.995 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T13:00:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T13:00:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42540sec preferred_lft 42540sec 2023-11-28T13:00:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-11-28T13:00:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:41.995 INFO:teuthology.orchestra.run.smithi082.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T13:00:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:42:02:22:90:39 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T13:00:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:41.996 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T13:00:41.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:41.996 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-11-28T13:00:41.996 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-11-28T13:00:41.996 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2023-11-28T13:00:41.996 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2023-11-28T13:00:41.996 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2023-11-28T13:00:41.996 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T13:00:41.997 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-11-28T13:00:42.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:42.089 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T13:00:42.099 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-11-28T13:00:42.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:42.101 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-11-28T13:00:42.118 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-11-28T13:00:42.118 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T13:00:42.118 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T13:00:42.118 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T13:00:42.118 INFO:teuthology.orchestra.run.smithi082.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T13:00:42.118 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-28T13:00:42.118 INFO:teuthology.orchestra.run.smithi082.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T13:00:42.119 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T13:00:42.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:42.119 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-11-28T13:00:42.119 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-11-28T13:00:42.119 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T13:00:42.119 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T13:00:42.119 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T13:00:42.119 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-11-28T13:00:42.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:42.202 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-11-28T13:00:42.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:42.208 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2023-11-28T13:00:42.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:42.257 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-11-28T13:00:42.257 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-11-28T13:00:42.257 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T13:00:42.257 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-28T13:00:42.257 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-11-28T13:00:42.289 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-28T13:00:42.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:42.290 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-11-28T13:00:42.290 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-11-28T13:00:42.290 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-28T13:00:42.290 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T13:00:42.290 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-28T13:00:42.290 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-28T13:00:42.290 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-28T13:00:42.291 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-11-28T13:00:42.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:42.364 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-11-28T13:00:42.365 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-11-28T13:00:42.365 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-11-28T13:00:42.365 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T13:00:42.365 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-11-28T13:00:42.394 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T13:00:42.395 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T13:00:42.395 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T13:00:42.402 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T13:00:42.403 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T13:00:42.403 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T13:00:42.408 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2023-11-28T13:00:42.421 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T13:00:42.421 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T13:00:42.435 INFO:teuthology.orchestra.run.smithi082.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T13:00:42.436 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T13:00:42.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:42.437 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2023-11-28T13:00:42.484 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T13:00:42.484 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-28T13:00:42.486 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2023-11-28T13:00:42.502 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T13:00:42.502 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T13:00:42.518 INFO:teuthology.orchestra.run.smithi082.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T13:00:42.519 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T13:00:42.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:42.520 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2023-11-28T13:00:42.572 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:2023-11-28T13:00:42.568+0000 7fc0bff7c640 -1 init, newargv = 0x5589f9e6ab60 newargc=15 2023-11-28T13:00:42.573 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[44497]: starting ceph client 2023-11-28T13:00:42.582 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[44497]: starting fuse 2023-11-28T13:00:43.627 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2023-11-28T13:00:43.645 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T13:00:43.646 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T13:00:43.662 INFO:teuthology.orchestra.run.smithi082.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T13:00:43.662 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T13:00:43.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:43.663 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2023-11-28T13:00:43.712 INFO:teuthology.orchestra.run.smithi082.stdout:52 2023-11-28T13:00:43.712 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-28T13:00:43.712 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T13:00:43.713 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2023-11-28T13:00:43.713 DEBUG:teuthology.orchestra.run.smithi082:> import re 2023-11-28T13:00:43.713 DEBUG:teuthology.orchestra.run.smithi082:> import os 2023-11-28T13:00:43.713 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2023-11-28T13:00:43.713 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:00:43.713 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2023-11-28T13:00:43.713 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T13:00:43.713 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2023-11-28T13:00:43.713 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T13:00:43.713 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:00:43.713 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2023-11-28T13:00:43.713 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2023-11-28T13:00:43.713 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2023-11-28T13:00:43.714 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2023-11-28T13:00:43.714 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:00:43.714 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2023-11-28T13:00:43.714 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T13:00:43.714 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T13:00:43.714 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T13:00:43.714 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2023-11-28T13:00:43.714 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2023-11-28T13:00:43.714 DEBUG:teuthology.orchestra.run.smithi082:> return f 2023-11-28T13:00:43.714 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T13:00:43.714 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:00:43.714 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.0")) 2023-11-28T13:00:43.714 DEBUG:teuthology.orchestra.run.smithi082:> ' 2023-11-28T13:00:43.797 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.0.44497.asok 2023-11-28T13:00:43.982 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44497.asok 2023-11-28T13:00:43.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:43.983 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44497.asok status 2023-11-28T13:00:44.083 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:00:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2023-11-28T13:00:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T13:00:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T13:00:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "0", 2023-11-28T13:00:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2023-11-28T13:00:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T13:00:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "44497", 2023-11-28T13:00:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/" 2023-11-28T13:00:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:00:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2023-11-28T13:00:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2023-11-28T13:00:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4680, 2023-11-28T13:00:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2023-11-28T13:00:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2023-11-28T13:00:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2023-11-28T13:00:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 4680 2023-11-28T13:00:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:00:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2023-11-28T13:00:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2023-11-28T13:00:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2023-11-28T13:00:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 6553623 2023-11-28T13:00:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:00:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:00:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2023-11-28T13:00:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2023-11-28T13:00:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2023-11-28T13:00:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 6553623 2023-11-28T13:00:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:00:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.4680 192.168.0.1:0/6553623", 2023-11-28T13:00:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "192.168.0.1:0/6553623", 2023-11-28T13:00:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 1, 2023-11-28T13:00:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 7, 2023-11-28T13:00:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 24, 2023-11-28T13:00:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2023-11-28T13:00:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2023-11-28T13:00:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2023-11-28T13:00:44.086 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:00:44.093 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T13:00:44.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.204+0000 7fb4ba054700 1 Processor -- start 2023-11-28T13:00:44.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.204+0000 7fb4ba054700 1 -- start start 2023-11-28T13:00:44.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.204+0000 7fb4ba054700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4b406b910 0x7fb4b4160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:44.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.204+0000 7fb4ba054700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b40d28e0 con 0x7fb4b40ced70 2023-11-28T13:00:44.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.204+0000 7fb4ba054700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b4160cc0 con 0x7fb4b40d06f0 2023-11-28T13:00:44.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.204+0000 7fb4ba054700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b40cdfe0 con 0x7fb4b406b910 2023-11-28T13:00:44.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.204+0000 7fb4b8851700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb4b40ced70 0x7fb4b406bce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60572/0 (socket says 172.21.15.82:60572) 2023-11-28T13:00:44.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.204+0000 7fb4b8851700 1 -- 172.21.15.82:0/242084709 learned_addr learned my addr 172.21.15.82:0/242084709 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:44.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.204+0000 7fb4b9052700 1 --2- 172.21.15.82:0/242084709 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4b406b910 0x7fb4b4160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:44.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.204+0000 7fb4abfff700 1 -- 172.21.15.82:0/242084709 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141540050 0 0) 0x7fb4b0001490 con 0x7fb4b40ced70 2023-11-28T13:00:44.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.204+0000 7fb4abfff700 1 -- 172.21.15.82:0/242084709 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb49c0035d0 con 0x7fb4b40ced70 2023-11-28T13:00:44.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.204+0000 7fb4b9052700 1 -- 172.21.15.82:0/242084709 >> v1:172.21.15.114:6789/0 conn(0x7fb4b40d06f0 legacy=0x7fb4b40d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:44.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.204+0000 7fb4abfff700 1 -- 172.21.15.82:0/242084709 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129893123 0 0) 0x7fb4b4160cc0 con 0x7fb4b40d06f0 2023-11-28T13:00:44.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.204+0000 7fb4b9052700 1 -- 172.21.15.82:0/242084709 >> v1:172.21.15.82:6789/0 conn(0x7fb4b40ced70 legacy=0x7fb4b406bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:44.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.204+0000 7fb4b9052700 1 -- 172.21.15.82:0/242084709 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b40b2040 con 0x7fb4b406b910 2023-11-28T13:00:44.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.204+0000 7fb4b9052700 1 --2- 172.21.15.82:0/242084709 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4b406b910 0x7fb4b4160780 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4009880 tx=0x7fb4a4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf0426ab56ffc133 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:44.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.204+0000 7fb4abfff700 1 -- 172.21.15.82:0/242084709 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a4011830 con 0x7fb4b406b910 2023-11-28T13:00:44.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.204+0000 7fb4abfff700 1 -- 172.21.15.82:0/242084709 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a4011990 con 0x7fb4b406b910 2023-11-28T13:00:44.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.204+0000 7fb4abfff700 1 -- 172.21.15.82:0/242084709 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a4011d00 con 0x7fb4b406b910 2023-11-28T13:00:44.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.208+0000 7fb4ba054700 1 -- 172.21.15.82:0/242084709 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4b406b910 msgr2=0x7fb4b4160780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:44.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.208+0000 7fb4ba054700 1 --2- 172.21.15.82:0/242084709 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4b406b910 0x7fb4b4160780 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4009880 tx=0x7fb4a4009b90 comp rx=0 tx=0).stop 2023-11-28T13:00:44.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.208+0000 7fb4ba054700 1 -- 172.21.15.82:0/242084709 shutdown_connections 2023-11-28T13:00:44.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.208+0000 7fb4ba054700 1 --2- 172.21.15.82:0/242084709 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4b406b910 0x7fb4b4160780 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:44.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.208+0000 7fb4ba054700 1 -- 172.21.15.82:0/242084709 >> 172.21.15.82:0/242084709 conn(0x7fb4b40d2b20 msgr2=0x7fb4b40d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:44.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.208+0000 7fb4ba054700 1 -- 172.21.15.82:0/242084709 shutdown_connections 2023-11-28T13:00:44.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.208+0000 7fb4ba054700 1 -- 172.21.15.82:0/242084709 wait complete. 2023-11-28T13:00:44.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.208+0000 7fb4ba054700 1 Processor -- start 2023-11-28T13:00:44.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.208+0000 7fb4ba054700 1 -- start start 2023-11-28T13:00:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4ba054700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4b406b910 0x7fb4b415c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4ba054700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4b40ced70 0x7fb4b40b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4ba054700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4b40d06f0 0x7fb4b40b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4ba054700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b40c9f40 con 0x7fb4b40d06f0 2023-11-28T13:00:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4ba054700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b40cb5d0 con 0x7fb4b40ced70 2023-11-28T13:00:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4ba054700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b40b3850 con 0x7fb4b406b910 2023-11-28T13:00:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4b9853700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4b40d06f0 0x7fb4b40b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4b9853700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4b40d06f0 0x7fb4b40b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51006/0 (socket says 172.21.15.82:51006) 2023-11-28T13:00:44.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4b9853700 1 -- 172.21.15.82:0/1593407017 learned_addr learned my addr 172.21.15.82:0/1593407017 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:44.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4b9052700 1 --2- 172.21.15.82:0/1593407017 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4b406b910 0x7fb4b415c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:44.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4b8851700 1 --2- 172.21.15.82:0/1593407017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4b40ced70 0x7fb4b40b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:44.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4b9853700 1 -- 172.21.15.82:0/1593407017 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4b406b910 msgr2=0x7fb4b415c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:44.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4b9853700 1 --2- 172.21.15.82:0/1593407017 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4b406b910 0x7fb4b415c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:44.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4b9853700 1 -- 172.21.15.82:0/1593407017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4b40ced70 msgr2=0x7fb4b40b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:44.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4b9853700 1 --2- 172.21.15.82:0/1593407017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4b40ced70 0x7fb4b40b2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:44.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4b9853700 1 -- 172.21.15.82:0/1593407017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a40094b0 con 0x7fb4b40d06f0 2023-11-28T13:00:44.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4b8851700 1 --2- 172.21.15.82:0/1593407017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4b40ced70 0x7fb4b40b2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:44.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4b9052700 1 --2- 172.21.15.82:0/1593407017 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4b406b910 0x7fb4b415c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:44.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4b9853700 1 --2- 172.21.15.82:0/1593407017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4b40d06f0 0x7fb4b40b31b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0011e0 tx=0x7fb4ac00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:44.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4a9ffb700 1 -- 172.21.15.82:0/1593407017 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac0054e0 con 0x7fb4b40d06f0 2023-11-28T13:00:44.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4a9ffb700 1 -- 172.21.15.82:0/1593407017 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ac0036a0 con 0x7fb4b40d06f0 2023-11-28T13:00:44.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4a9ffb700 1 -- 172.21.15.82:0/1593407017 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac003a50 con 0x7fb4b40d06f0 2023-11-28T13:00:44.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4ba054700 1 -- 172.21.15.82:0/1593407017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b40d2320 con 0x7fb4b40d06f0 2023-11-28T13:00:44.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.212+0000 7fb4ba054700 1 -- 172.21.15.82:0/1593407017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b40cf2c0 con 0x7fb4b40d06f0 2023-11-28T13:00:44.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.216+0000 7fb4ba054700 1 -- 172.21.15.82:0/1593407017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b40d2600 con 0x7fb4b40d06f0 2023-11-28T13:00:44.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.216+0000 7fb4a9ffb700 1 -- 172.21.15.82:0/1593407017 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb4ac019030 con 0x7fb4b40d06f0 2023-11-28T13:00:44.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.216+0000 7fb4a9ffb700 1 --2- 172.21.15.82:0/1593407017 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb4a0064ee0 0x7fb4a0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:44.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.216+0000 7fb4a9ffb700 1 -- 172.21.15.82:0/1593407017 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb4ac0812b0 con 0x7fb4b40d06f0 2023-11-28T13:00:44.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.216+0000 7fb4b9052700 1 --2- 172.21.15.82:0/1593407017 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb4a0064ee0 0x7fb4a0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:44.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.216+0000 7fb4b9052700 1 --2- 172.21.15.82:0/1593407017 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb4a0064ee0 0x7fb4a0067390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb4a40090b0 tx=0x7fb4a4010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:44.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.224+0000 7fb4a9ffb700 1 -- 172.21.15.82:0/1593407017 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb4ac04f450 con 0x7fb4b40d06f0 2023-11-28T13:00:44.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.420+0000 7fb4ba054700 1 -- 172.21.15.82:0/1593407017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb4b40c9510 con 0x7fb4b40d06f0 2023-11-28T13:00:44.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.420+0000 7fb4a9ffb700 1 -- 172.21.15.82:0/1593407017 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb4ac017070 con 0x7fb4b40d06f0 2023-11-28T13:00:44.423 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T13:00:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.420+0000 7fb4ba054700 1 -- 172.21.15.82:0/1593407017 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb4a0064ee0 msgr2=0x7fb4a0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.420+0000 7fb4ba054700 1 --2- 172.21.15.82:0/1593407017 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb4a0064ee0 0x7fb4a0067390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb4a40090b0 tx=0x7fb4a4010000 comp rx=0 tx=0).stop 2023-11-28T13:00:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.420+0000 7fb4ba054700 1 -- 172.21.15.82:0/1593407017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4b40d06f0 msgr2=0x7fb4b40b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.420+0000 7fb4ba054700 1 --2- 172.21.15.82:0/1593407017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4b40d06f0 0x7fb4b40b31b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0011e0 tx=0x7fb4ac00c8b0 comp rx=0 tx=0).stop 2023-11-28T13:00:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.420+0000 7fb4ba054700 1 -- 172.21.15.82:0/1593407017 shutdown_connections 2023-11-28T13:00:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.420+0000 7fb4ba054700 1 --2- 172.21.15.82:0/1593407017 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb4a0064ee0 0x7fb4a0067390 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:44.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.420+0000 7fb4ba054700 1 --2- 172.21.15.82:0/1593407017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4b40d06f0 0x7fb4b40b31b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:44.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.420+0000 7fb4ba054700 1 --2- 172.21.15.82:0/1593407017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4b40ced70 0x7fb4b40b2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:44.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.420+0000 7fb4ba054700 1 --2- 172.21.15.82:0/1593407017 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4b406b910 0x7fb4b415c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:44.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.420+0000 7fb4ba054700 1 -- 172.21.15.82:0/1593407017 >> 172.21.15.82:0/1593407017 conn(0x7fb4b40d2b20 msgr2=0x7fb4b40b7230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:44.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.420+0000 7fb4ba054700 1 -- 172.21.15.82:0/1593407017 shutdown_connections 2023-11-28T13:00:44.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:44.420+0000 7fb4ba054700 1 -- 172.21.15.82:0/1593407017 wait complete. 2023-11-28T13:00:44.437 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T13:00:44.437 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T13:00:44.437 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-11-28T13:00:44.438 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-28T13:00:44.438 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-28T13:00:44.438 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T13:00:44.438 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T13:00:44.438 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T13:00:44.438 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-28T13:00:44.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:44.438 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-11-28T13:00:44.446 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T13:00:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T13:00:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T13:00:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-11-28T13:00:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:44.447 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T13:00:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:44.447 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T13:00:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:44.447 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T13:00:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:44.447 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T13:00:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T13:00:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42537sec preferred_lft 42537sec 2023-11-28T13:00:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-11-28T13:00:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:44.448 INFO:teuthology.orchestra.run.smithi082.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T13:00:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:42:02:22:90:39 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T13:00:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:44.448 INFO:teuthology.orchestra.run.smithi082.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T13:00:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether f2:23:62:63:4a:4e brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T13:00:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::78c5:d7ff:fe17:75c8/64 scope link 2023-11-28T13:00:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:44.448 INFO:teuthology.orchestra.run.smithi082.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T13:00:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether f2:23:62:63:4a:4e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T13:00:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::f023:62ff:fe63:4a4e/64 scope link 2023-11-28T13:00:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:44.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:44.449 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T13:00:44.463 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-11-28T13:00:44.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:44.465 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-11-28T13:00:44.514 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-11-28T13:00:44.514 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T13:00:44.515 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T13:00:44.515 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T13:00:44.515 INFO:teuthology.orchestra.run.smithi082.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T13:00:44.515 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-28T13:00:44.515 INFO:teuthology.orchestra.run.smithi082.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T13:00:44.515 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T13:00:44.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:44.515 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-11-28T13:00:44.516 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-11-28T13:00:44.516 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T13:00:44.516 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T13:00:44.516 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T13:00:44.516 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-11-28T13:00:44.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:44.555 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-11-28T13:00:44.561 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T13:00:44.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:44.562 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2023-11-28T13:00:44.569 INFO:teuthology.orchestra.run.smithi082.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-28T13:00:44.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:44.570 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-11-28T13:00:44.570 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-11-28T13:00:44.570 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T13:00:44.571 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-28T13:00:44.571 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-11-28T13:00:44.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:44.645 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-28T13:00:44.659 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T13:00:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T13:00:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T13:00:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-11-28T13:00:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:44.659 INFO:teuthology.orchestra.run.smithi082.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T13:00:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 3a:a2:1f:ee:18:f8 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T13:00:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T13:00:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::38a2:1fff:feee:18f8/64 scope link 2023-11-28T13:00:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:44.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:44.661 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-28T13:00:44.673 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T13:00:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T13:00:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T13:00:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-11-28T13:00:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:44.674 INFO:teuthology.orchestra.run.smithi082.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T13:00:44.674 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 3a:a2:1f:ee:18:f8 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T13:00:44.674 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T13:00:44.674 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:44.674 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::38a2:1fff:feee:18f8/64 scope link 2023-11-28T13:00:44.674 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:44.675 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-28T13:00:44.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:44.675 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-11-28T13:00:44.675 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-11-28T13:00:44.675 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-28T13:00:44.676 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-28T13:00:44.676 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-28T13:00:44.676 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-28T13:00:44.676 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-28T13:00:44.676 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-11-28T13:00:44.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:44.783 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-11-28T13:00:44.783 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-11-28T13:00:44.783 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.1 up 2023-11-28T13:00:44.783 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.1 master ceph-brx 2023-11-28T13:00:44.783 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-11-28T13:00:44.810 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-28T13:00:44.810 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T13:00:44.810 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-28T13:00:44.816 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-28T13:00:44.816 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T13:00:44.816 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-28T13:00:44.864 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2023-11-28T13:00:44.880 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T13:00:44.880 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T13:00:44.890 INFO:teuthology.orchestra.run.smithi082.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T13:00:44.891 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T13:00:44.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:44.892 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2023-11-28T13:00:44.899 INFO:teuthology.orchestra.run.smithi082.stdout:52 2023-11-28T13:00:44.899 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2023-11-28T13:00:44.899 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2 --client_mountpoint=/) 2023-11-28T13:00:44.901 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2023-11-28T13:00:44.916 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T13:00:44.917 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T13:00:44.932 INFO:teuthology.orchestra.run.smithi082.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T13:00:44.933 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T13:00:44.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:44.933 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2023-11-28T13:00:44.985 INFO:teuthology.orchestra.run.smithi082.stdout:52 2023-11-28T13:00:44.986 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi082.stderr:2023-11-28T13:00:44.984+0000 7f8a2947f640 -1 init, newargv = 0x55a3d94b6b10 newargc=15 2023-11-28T13:00:44.986 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi082.stderr:ceph-fuse[44637]: starting ceph client 2023-11-28T13:00:44.995 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi082.stderr:ceph-fuse[44637]: starting fuse 2023-11-28T13:00:46.087 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2023-11-28T13:00:46.106 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T13:00:46.107 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T13:00:46.165 INFO:teuthology.orchestra.run.smithi082.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T13:00:46.166 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T13:00:46.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:46.167 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2023-11-28T13:00:46.174 INFO:teuthology.orchestra.run.smithi082.stdout:52 2023-11-28T13:00:46.174 INFO:teuthology.orchestra.run.smithi082.stdout:53 2023-11-28T13:00:46.174 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2023-11-28T13:00:46.174 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T13:00:46.174 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2023-11-28T13:00:46.174 DEBUG:teuthology.orchestra.run.smithi082:> import re 2023-11-28T13:00:46.175 DEBUG:teuthology.orchestra.run.smithi082:> import os 2023-11-28T13:00:46.175 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2023-11-28T13:00:46.175 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:00:46.175 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2023-11-28T13:00:46.175 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-28T13:00:46.175 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2023-11-28T13:00:46.175 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-28T13:00:46.175 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:00:46.175 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2023-11-28T13:00:46.175 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2023-11-28T13:00:46.175 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2023-11-28T13:00:46.176 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2023-11-28T13:00:46.176 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:00:46.176 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2023-11-28T13:00:46.176 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T13:00:46.176 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T13:00:46.176 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T13:00:46.176 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2023-11-28T13:00:46.177 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2023-11-28T13:00:46.177 DEBUG:teuthology.orchestra.run.smithi082:> return f 2023-11-28T13:00:46.177 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T13:00:46.177 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:00:46.177 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.2")) 2023-11-28T13:00:46.177 DEBUG:teuthology.orchestra.run.smithi082:> ' 2023-11-28T13:00:46.257 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.2.44637.asok 2023-11-28T13:00:46.446 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.44637.asok 2023-11-28T13:00:46.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:46.446 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.44637.asok status 2023-11-28T13:00:46.549 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:00:46.549 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2023-11-28T13:00:46.549 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T13:00:46.549 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T13:00:46.549 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "2", 2023-11-28T13:00:46.549 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2023-11-28T13:00:46.549 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-28T13:00:46.549 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "44637", 2023-11-28T13:00:46.549 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/" 2023-11-28T13:00:46.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:00:46.550 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2023-11-28T13:00:46.550 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2023-11-28T13:00:46.550 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4692, 2023-11-28T13:00:46.550 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2023-11-28T13:00:46.550 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2023-11-28T13:00:46.550 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2023-11-28T13:00:46.550 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 4692 2023-11-28T13:00:46.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:00:46.550 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2023-11-28T13:00:46.550 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2023-11-28T13:00:46.550 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.2:0", 2023-11-28T13:00:46.551 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 709997919 2023-11-28T13:00:46.551 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:00:46.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:00:46.551 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2023-11-28T13:00:46.551 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2023-11-28T13:00:46.551 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.2:0", 2023-11-28T13:00:46.551 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 709997919 2023-11-28T13:00:46.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:00:46.551 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.4692 192.168.0.2:0/709997919", 2023-11-28T13:00:46.551 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "192.168.0.2:0/709997919", 2023-11-28T13:00:46.551 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 1, 2023-11-28T13:00:46.551 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 7, 2023-11-28T13:00:46.552 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 24, 2023-11-28T13:00:46.552 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2023-11-28T13:00:46.552 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2023-11-28T13:00:46.552 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2023-11-28T13:00:46.552 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:00:46.558 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T13:00:46.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.664+0000 7f6c61c8b700 1 Processor -- start 2023-11-28T13:00:46.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.664+0000 7f6c61c8b700 1 -- start start 2023-11-28T13:00:46.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.664+0000 7f6c61c8b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6c5c158aa0 0x7f6c5c06dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:46.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.664+0000 7f6c61c8b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6c5c0c92e0 0x7f6c5c0c9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:46.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.664+0000 7f6c61c8b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c5c06cbb0 con 0x7f6c5c0cd440 2023-11-28T13:00:46.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.664+0000 7f6c61c8b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c5c158f00 con 0x7f6c5c158aa0 2023-11-28T13:00:46.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.664+0000 7f6c61c8b700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c5c06ce90 con 0x7f6c5c0c92e0 2023-11-28T13:00:46.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.664+0000 7f6c5affd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6c5c158aa0 0x7f6c5c06dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:46.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.664+0000 7f6c5affd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6c5c158aa0 0x7f6c5c06dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44220/0 (socket says 172.21.15.82:44220) 2023-11-28T13:00:46.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.664+0000 7f6c5b7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6c5c0cd440 0x7f6c5c06a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53216/0 (socket says 172.21.15.82:53216) 2023-11-28T13:00:46.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.664+0000 7f6c5affd700 1 -- 172.21.15.82:0/1984734004 learned_addr learned my addr 172.21.15.82:0/1984734004 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:46.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.664+0000 7f6c5bfff700 1 --2- 172.21.15.82:0/1984734004 >> v2:172.21.15.114:3300/0 conn(0x7f6c5c0c92e0 0x7f6c5c0c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:46.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.664+0000 7f6c5affd700 1 -- 172.21.15.82:0/1984734004 >> v2:172.21.15.114:3300/0 conn(0x7f6c5c0c92e0 msgr2=0x7f6c5c0c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:46.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.664+0000 7f6c5affd700 1 --2- 172.21.15.82:0/1984734004 >> v2:172.21.15.114:3300/0 conn(0x7f6c5c0c92e0 0x7f6c5c0c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:46.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.664+0000 7f6c5affd700 1 -- 172.21.15.82:0/1984734004 >> v1:172.21.15.82:6789/0 conn(0x7f6c5c0cd440 legacy=0x7f6c5c06a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:46.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.664+0000 7f6c5affd700 1 -- 172.21.15.82:0/1984734004 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5c06d170 con 0x7f6c5c158aa0 2023-11-28T13:00:46.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.664+0000 7f6c5affd700 1 --2- 172.21.15.82:0/1984734004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c5c158aa0 0x7f6c5c06dc50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0adfa0 tx=0x7f6c4c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d63156192af06f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:46.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.668+0000 7f6c5a7fc700 1 -- 172.21.15.82:0/1984734004 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c004230 con 0x7f6c5c158aa0 2023-11-28T13:00:46.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.668+0000 7f6c5a7fc700 1 -- 172.21.15.82:0/1984734004 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c004390 con 0x7f6c5c158aa0 2023-11-28T13:00:46.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.668+0000 7f6c5a7fc700 1 -- 172.21.15.82:0/1984734004 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0036c0 con 0x7f6c5c158aa0 2023-11-28T13:00:46.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.668+0000 7f6c61c8b700 1 -- 172.21.15.82:0/1984734004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c5c158aa0 msgr2=0x7f6c5c06dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:46.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.668+0000 7f6c61c8b700 1 --2- 172.21.15.82:0/1984734004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c5c158aa0 0x7f6c5c06dc50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0adfa0 tx=0x7f6c4c009bf0 comp rx=0 tx=0).stop 2023-11-28T13:00:46.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.668+0000 7f6c61c8b700 1 -- 172.21.15.82:0/1984734004 shutdown_connections 2023-11-28T13:00:46.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.668+0000 7f6c61c8b700 1 --2- 172.21.15.82:0/1984734004 >> v2:172.21.15.114:3300/0 conn(0x7f6c5c0c92e0 0x7f6c5c0c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:46.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.668+0000 7f6c61c8b700 1 --2- 172.21.15.82:0/1984734004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c5c158aa0 0x7f6c5c06dc50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:46.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.668+0000 7f6c61c8b700 1 -- 172.21.15.82:0/1984734004 >> 172.21.15.82:0/1984734004 conn(0x7f6c5c0ce9b0 msgr2=0x7f6c5c0ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:46.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.668+0000 7f6c61c8b700 1 -- 172.21.15.82:0/1984734004 shutdown_connections 2023-11-28T13:00:46.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.668+0000 7f6c61c8b700 1 -- 172.21.15.82:0/1984734004 wait complete. 2023-11-28T13:00:46.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.668+0000 7f6c61c8b700 1 Processor -- start 2023-11-28T13:00:46.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.668+0000 7f6c61c8b700 1 -- start start 2023-11-28T13:00:46.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c61c8b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c5c0c92e0 0x7f6c5c14b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:46.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c61c8b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c5c0cd440 0x7f6c5c14f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:46.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c61c8b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c5c158aa0 0x7f6c5c0b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:46.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c61c8b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c0b47b0 con 0x7f6c5c0c92e0 2023-11-28T13:00:46.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c61c8b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c0aeb40 con 0x7f6c5c158aa0 2023-11-28T13:00:46.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c61c8b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c1501f0 con 0x7f6c5c0cd440 2023-11-28T13:00:46.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c5b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c5c0c92e0 0x7f6c5c14b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:46.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c5b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c5c0c92e0 0x7f6c5c14b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44228/0 (socket says 172.21.15.82:44228) 2023-11-28T13:00:46.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c5b7fe700 1 -- 172.21.15.82:0/637893702 learned_addr learned my addr 172.21.15.82:0/637893702 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:46.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c5affd700 1 --2- 172.21.15.82:0/637893702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c5c0cd440 0x7f6c5c14f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:46.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c5bfff700 1 --2- 172.21.15.82:0/637893702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c5c158aa0 0x7f6c5c0b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:46.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c5affd700 1 -- 172.21.15.82:0/637893702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c5c158aa0 msgr2=0x7f6c5c0b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:46.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c5affd700 1 --2- 172.21.15.82:0/637893702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c5c158aa0 0x7f6c5c0b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:46.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c5affd700 1 -- 172.21.15.82:0/637893702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c5c0c92e0 msgr2=0x7f6c5c14b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:46.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c5affd700 1 --2- 172.21.15.82:0/637893702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c5c0c92e0 0x7f6c5c14b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:46.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c5affd700 1 -- 172.21.15.82:0/637893702 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c009570 con 0x7f6c5c0cd440 2023-11-28T13:00:46.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c5b7fe700 1 --2- 172.21.15.82:0/637893702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c5c0c92e0 0x7f6c5c14b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:46.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c5affd700 1 --2- 172.21.15.82:0/637893702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c5c0cd440 0x7f6c5c14f900 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0cf970 tx=0x7f6c4c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:46.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c43fff700 1 -- 172.21.15.82:0/637893702 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c011630 con 0x7f6c5c0cd440 2023-11-28T13:00:46.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c61c8b700 1 -- 172.21.15.82:0/637893702 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c5c06d730 con 0x7f6c5c0cd440 2023-11-28T13:00:46.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c43fff700 1 -- 172.21.15.82:0/637893702 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c011790 con 0x7f6c5c0cd440 2023-11-28T13:00:46.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c43fff700 1 -- 172.21.15.82:0/637893702 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c011b40 con 0x7f6c5c0cd440 2023-11-28T13:00:46.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.672+0000 7f6c61c8b700 1 -- 172.21.15.82:0/637893702 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c5c06d450 con 0x7f6c5c0cd440 2023-11-28T13:00:46.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.676+0000 7f6c61c8b700 1 -- 172.21.15.82:0/637893702 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c5c06e190 con 0x7f6c5c0cd440 2023-11-28T13:00:46.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.676+0000 7f6c43fff700 1 -- 172.21.15.82:0/637893702 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6c4c017020 con 0x7f6c5c0cd440 2023-11-28T13:00:46.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.676+0000 7f6c43fff700 1 --2- 172.21.15.82:0/637893702 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c48064ee0 0x7f6c48067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:46.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.676+0000 7f6c43fff700 1 -- 172.21.15.82:0/637893702 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6c4c083690 con 0x7f6c5c0cd440 2023-11-28T13:00:46.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.676+0000 7f6c5b7fe700 1 --2- 172.21.15.82:0/637893702 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c48064ee0 0x7f6c48067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:46.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.676+0000 7f6c5b7fe700 1 --2- 172.21.15.82:0/637893702 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c48064ee0 0x7f6c48067390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6c50007d00 tx=0x7f6c50007c50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:46.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.688+0000 7f6c43fff700 1 -- 172.21.15.82:0/637893702 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6c4c0517b0 con 0x7f6c5c0cd440 2023-11-28T13:00:46.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.888+0000 7f6c61c8b700 1 -- 172.21.15.82:0/637893702 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6c5c073e20 con 0x7f6c5c0cd440 2023-11-28T13:00:46.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.892+0000 7f6c43fff700 1 -- 172.21.15.82:0/637893702 <== mon.2 v2:172.21.15.114:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6c4c029070 con 0x7f6c5c0cd440 2023-11-28T13:00:46.894 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T13:00:46.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.896+0000 7f6c61c8b700 1 -- 172.21.15.82:0/637893702 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c48064ee0 msgr2=0x7f6c48067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:46.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.896+0000 7f6c61c8b700 1 --2- 172.21.15.82:0/637893702 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c48064ee0 0x7f6c48067390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6c50007d00 tx=0x7f6c50007c50 comp rx=0 tx=0).stop 2023-11-28T13:00:46.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.896+0000 7f6c61c8b700 1 -- 172.21.15.82:0/637893702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c5c0cd440 msgr2=0x7f6c5c14f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:46.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.896+0000 7f6c61c8b700 1 --2- 172.21.15.82:0/637893702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c5c0cd440 0x7f6c5c14f900 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0cf970 tx=0x7f6c4c004770 comp rx=0 tx=0).stop 2023-11-28T13:00:46.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.896+0000 7f6c61c8b700 1 -- 172.21.15.82:0/637893702 shutdown_connections 2023-11-28T13:00:46.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.896+0000 7f6c61c8b700 1 --2- 172.21.15.82:0/637893702 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c48064ee0 0x7f6c48067390 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:46.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.896+0000 7f6c61c8b700 1 --2- 172.21.15.82:0/637893702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c5c158aa0 0x7f6c5c0b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:46.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.896+0000 7f6c61c8b700 1 --2- 172.21.15.82:0/637893702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c5c0cd440 0x7f6c5c14f900 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:46.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.896+0000 7f6c61c8b700 1 --2- 172.21.15.82:0/637893702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c5c0c92e0 0x7f6c5c14b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:46.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.896+0000 7f6c61c8b700 1 -- 172.21.15.82:0/637893702 >> 172.21.15.82:0/637893702 conn(0x7f6c5c0ce9b0 msgr2=0x7f6c5c06a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:46.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.896+0000 7f6c61c8b700 1 -- 172.21.15.82:0/637893702 shutdown_connections 2023-11-28T13:00:46.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:46.896+0000 7f6c61c8b700 1 -- 172.21.15.82:0/637893702 wait complete. 2023-11-28T13:00:46.914 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T13:00:46.914 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T13:00:46.914 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-11-28T13:00:46.915 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T13:00:46.915 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T13:00:46.915 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T13:00:46.915 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T13:00:46.915 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T13:00:46.915 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T13:00:46.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:46.915 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-11-28T13:00:46.923 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T13:00:46.923 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T13:00:46.923 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-11-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:46.924 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T13:00:46.925 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:46.925 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T13:00:46.925 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42536sec preferred_lft 42536sec 2023-11-28T13:00:46.925 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-11-28T13:00:46.925 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:46.925 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T13:00:46.925 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:d3:29:2d:e4 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:46.925 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T13:00:46.925 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:46.925 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T13:00:46.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:46.926 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-28T13:00:46.926 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-28T13:00:46.926 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add name ceph-brx type bridge 2023-11-28T13:00:46.926 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr flush dev ceph-brx 2023-11-28T13:00:46.926 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set ceph-brx up 2023-11-28T13:00:46.926 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T13:00:46.926 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-28T13:00:47.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:47.006 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T13:00:47.015 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-11-28T13:00:47.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:47.017 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-11-28T13:00:47.045 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-11-28T13:00:47.045 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T13:00:47.045 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T13:00:47.046 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T13:00:47.046 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T13:00:47.046 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-28T13:00:47.046 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T13:00:47.046 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T13:00:47.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:47.046 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-28T13:00:47.046 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-28T13:00:47.046 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T13:00:47.047 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T13:00:47.048 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T13:00:47.048 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-28T13:00:47.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:47.134 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-11-28T13:00:47.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:47.142 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2023-11-28T13:00:47.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:47.192 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-28T13:00:47.192 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-28T13:00:47.192 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T13:00:47.192 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-28T13:00:47.192 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-28T13:00:47.224 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-28T13:00:47.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:47.224 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-28T13:00:47.224 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-28T13:00:47.224 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-28T13:00:47.224 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T13:00:47.224 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-28T13:00:47.224 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-28T13:00:47.224 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-28T13:00:47.225 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-28T13:00:47.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:47.288 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-28T13:00:47.288 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-28T13:00:47.288 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-11-28T13:00:47.288 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T13:00:47.288 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-28T13:00:47.314 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-28T13:00:47.314 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T13:00:47.314 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T13:00:47.364 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T13:00:47.364 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T13:00:47.364 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T13:00:47.370 DEBUG:teuthology.orchestra.run.smithi114:> sudo modprobe fuse 2023-11-28T13:00:47.384 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T13:00:47.384 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T13:00:47.442 INFO:teuthology.orchestra.run.smithi114.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T13:00:47.443 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T13:00:47.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:47.444 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-28T13:00:47.448 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T13:00:47.448 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_mountpoint=/) 2023-11-28T13:00:47.451 DEBUG:teuthology.orchestra.run.smithi114:> sudo modprobe fuse 2023-11-28T13:00:47.466 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T13:00:47.466 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T13:00:47.522 INFO:teuthology.orchestra.run.smithi114.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T13:00:47.523 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T13:00:47.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:47.524 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-28T13:00:47.539 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi114.stderr:2023-11-28T13:00:47.533+0000 7fc25a5eb640 -1 init, newargv = 0x55e1bdf23a60 newargc=15 2023-11-28T13:00:47.539 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi114.stderr:ceph-fuse[42832]: starting ceph client 2023-11-28T13:00:47.547 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi114.stderr:ceph-fuse[42832]: starting fuse 2023-11-28T13:00:48.632 DEBUG:teuthology.orchestra.run.smithi114:> sudo modprobe fuse 2023-11-28T13:00:48.652 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T13:00:48.652 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T13:00:48.709 INFO:teuthology.orchestra.run.smithi114.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T13:00:48.710 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T13:00:48.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:48.710 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-28T13:00:48.717 INFO:teuthology.orchestra.run.smithi114.stdout:52 2023-11-28T13:00:48.718 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-28T13:00:48.718 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T13:00:48.718 DEBUG:teuthology.orchestra.run.smithi114:> import glob 2023-11-28T13:00:48.718 DEBUG:teuthology.orchestra.run.smithi114:> import re 2023-11-28T13:00:48.718 DEBUG:teuthology.orchestra.run.smithi114:> import os 2023-11-28T13:00:48.718 DEBUG:teuthology.orchestra.run.smithi114:> import subprocess 2023-11-28T13:00:48.718 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-28T13:00:48.718 DEBUG:teuthology.orchestra.run.smithi114:> def _find_admin_socket(client_name): 2023-11-28T13:00:48.719 DEBUG:teuthology.orchestra.run.smithi114:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-28T13:00:48.719 DEBUG:teuthology.orchestra.run.smithi114:> files = glob.glob(asok_path) 2023-11-28T13:00:48.719 DEBUG:teuthology.orchestra.run.smithi114:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-28T13:00:48.719 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-28T13:00:48.719 DEBUG:teuthology.orchestra.run.smithi114:> # Given a non-glob path, it better be there 2023-11-28T13:00:48.719 DEBUG:teuthology.orchestra.run.smithi114:> if "*" not in asok_path: 2023-11-28T13:00:48.719 DEBUG:teuthology.orchestra.run.smithi114:> assert(len(files) == 1) 2023-11-28T13:00:48.719 DEBUG:teuthology.orchestra.run.smithi114:> return files[0] 2023-11-28T13:00:48.719 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-28T13:00:48.719 DEBUG:teuthology.orchestra.run.smithi114:> for f in files: 2023-11-28T13:00:48.719 DEBUG:teuthology.orchestra.run.smithi114:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T13:00:48.721 DEBUG:teuthology.orchestra.run.smithi114:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T13:00:48.721 DEBUG:teuthology.orchestra.run.smithi114:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T13:00:48.721 DEBUG:teuthology.orchestra.run.smithi114:> contents = proc_f.read() 2023-11-28T13:00:48.721 DEBUG:teuthology.orchestra.run.smithi114:> if mountpoint in contents: 2023-11-28T13:00:48.721 DEBUG:teuthology.orchestra.run.smithi114:> return f 2023-11-28T13:00:48.721 DEBUG:teuthology.orchestra.run.smithi114:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T13:00:48.721 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-28T13:00:48.721 DEBUG:teuthology.orchestra.run.smithi114:> print(_find_admin_socket("client.1")) 2023-11-28T13:00:48.721 DEBUG:teuthology.orchestra.run.smithi114:> ' 2023-11-28T13:00:48.807 INFO:teuthology.orchestra.run.smithi114.stdout:/var/run/ceph/ceph-client.1.42832.asok 2023-11-28T13:00:48.991 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.42832.asok 2023-11-28T13:00:48.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:48.991 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.42832.asok status 2023-11-28T13:00:49.143 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-28T13:00:49.143 INFO:teuthology.orchestra.run.smithi114.stdout: "metadata": { 2023-11-28T13:00:49.143 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T13:00:49.144 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T13:00:49.144 INFO:teuthology.orchestra.run.smithi114.stdout: "entity_id": "1", 2023-11-28T13:00:49.144 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": "smithi114", 2023-11-28T13:00:49.144 INFO:teuthology.orchestra.run.smithi114.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-28T13:00:49.144 INFO:teuthology.orchestra.run.smithi114.stdout: "pid": "42832", 2023-11-28T13:00:49.144 INFO:teuthology.orchestra.run.smithi114.stdout: "root": "/" 2023-11-28T13:00:49.144 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-28T13:00:49.145 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_count": 0, 2023-11-28T13:00:49.145 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_pinned_count": 0, 2023-11-28T13:00:49.145 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4684, 2023-11-28T13:00:49.145 INFO:teuthology.orchestra.run.smithi114.stdout: "inst": { 2023-11-28T13:00:49.145 INFO:teuthology.orchestra.run.smithi114.stdout: "name": { 2023-11-28T13:00:49.145 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "client", 2023-11-28T13:00:49.146 INFO:teuthology.orchestra.run.smithi114.stdout: "num": 4684 2023-11-28T13:00:49.146 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-28T13:00:49.146 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-28T13:00:49.146 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-28T13:00:49.146 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-28T13:00:49.146 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 2145414037 2023-11-28T13:00:49.146 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-28T13:00:49.147 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-28T13:00:49.147 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-28T13:00:49.147 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-28T13:00:49.147 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-28T13:00:49.147 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 2145414037 2023-11-28T13:00:49.147 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-28T13:00:49.148 INFO:teuthology.orchestra.run.smithi114.stdout: "inst_str": "client.4684 192.168.0.1:0/2145414037", 2023-11-28T13:00:49.148 INFO:teuthology.orchestra.run.smithi114.stdout: "addr_str": "192.168.0.1:0/2145414037", 2023-11-28T13:00:49.148 INFO:teuthology.orchestra.run.smithi114.stdout: "inode_count": 1, 2023-11-28T13:00:49.148 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_epoch": 7, 2023-11-28T13:00:49.148 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch": 24, 2023-11-28T13:00:49.148 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch_barrier": 0, 2023-11-28T13:00:49.148 INFO:teuthology.orchestra.run.smithi114.stdout: "blocklisted": false, 2023-11-28T13:00:49.149 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs" 2023-11-28T13:00:49.149 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-28T13:00:49.153 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T13:00:49.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.272+0000 7f4956797700 1 Processor -- start 2023-11-28T13:00:49.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4956797700 1 -- start start 2023-11-28T13:00:49.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4956797700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f495006b910 0x7f4950160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:49.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4956797700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49500d06f0 0x7f49500d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:49.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4956797700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49500d28e0 con 0x7f49500ced70 2023-11-28T13:00:49.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4956797700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49500cdfe0 con 0x7f495006b910 2023-11-28T13:00:49.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4956797700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4950160cc0 con 0x7f49500d06f0 2023-11-28T13:00:49.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4954f94700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f49500ced70 0x7f495006bce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53222/0 (socket says 172.21.15.82:53222) 2023-11-28T13:00:49.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4954f94700 1 -- 172.21.15.82:0/4203937024 learned_addr learned my addr 172.21.15.82:0/4203937024 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:49.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4955795700 1 --2- 172.21.15.82:0/4203937024 >> v2:172.21.15.114:3300/0 conn(0x7f495006b910 0x7f4950160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:49.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4955f96700 1 --2- 172.21.15.82:0/4203937024 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49500d06f0 0x7f49500d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:49.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4947fff700 1 -- 172.21.15.82:0/4203937024 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249209684 0 0) 0x7f4940001110 con 0x7f49500ced70 2023-11-28T13:00:49.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4947fff700 1 -- 172.21.15.82:0/4203937024 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f493c0035d0 con 0x7f49500ced70 2023-11-28T13:00:49.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4947fff700 1 -- 172.21.15.82:0/4203937024 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 255409907 0 0) 0x7f493c0035d0 con 0x7f49500ced70 2023-11-28T13:00:49.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4955795700 1 -- 172.21.15.82:0/4203937024 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49500d06f0 msgr2=0x7f49500d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:49.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4955795700 1 --2- 172.21.15.82:0/4203937024 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49500d06f0 0x7f49500d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:49.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4955795700 1 -- 172.21.15.82:0/4203937024 >> v1:172.21.15.82:6789/0 conn(0x7f49500ced70 legacy=0x7f495006bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:49.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4955795700 1 -- 172.21.15.82:0/4203937024 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49500b2040 con 0x7f495006b910 2023-11-28T13:00:49.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4955f96700 1 --2- 172.21.15.82:0/4203937024 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49500d06f0 0x7f49500d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:49.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4955795700 1 --2- 172.21.15.82:0/4203937024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f495006b910 0x7f4950160780 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f494c009850 tx=0x7f494c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6ca4303d6c63a70 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:49.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4947fff700 1 -- 172.21.15.82:0/4203937024 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940001800 con 0x7f495006b910 2023-11-28T13:00:49.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4947fff700 1 -- 172.21.15.82:0/4203937024 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494c004030 con 0x7f495006b910 2023-11-28T13:00:49.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.276+0000 7f4947fff700 1 -- 172.21.15.82:0/4203937024 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c0043a0 con 0x7f495006b910 2023-11-28T13:00:49.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.280+0000 7f4956797700 1 -- 172.21.15.82:0/4203937024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f495006b910 msgr2=0x7f4950160780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:49.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.280+0000 7f4956797700 1 --2- 172.21.15.82:0/4203937024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f495006b910 0x7f4950160780 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f494c009850 tx=0x7f494c009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:49.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.280+0000 7f4956797700 1 -- 172.21.15.82:0/4203937024 shutdown_connections 2023-11-28T13:00:49.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.280+0000 7f4956797700 1 --2- 172.21.15.82:0/4203937024 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49500d06f0 0x7f49500d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:49.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.280+0000 7f4956797700 1 --2- 172.21.15.82:0/4203937024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f495006b910 0x7f4950160780 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:49.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.280+0000 7f4956797700 1 -- 172.21.15.82:0/4203937024 >> 172.21.15.82:0/4203937024 conn(0x7f49500d2b20 msgr2=0x7f49500d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:49.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.280+0000 7f4956797700 1 -- 172.21.15.82:0/4203937024 shutdown_connections 2023-11-28T13:00:49.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.280+0000 7f4956797700 1 -- 172.21.15.82:0/4203937024 wait complete. 2023-11-28T13:00:49.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.280+0000 7f4956797700 1 Processor -- start 2023-11-28T13:00:49.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.280+0000 7f4956797700 1 -- start start 2023-11-28T13:00:49.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.280+0000 7f4956797700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f495006b910 0x7f49501f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:49.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.280+0000 7f4956797700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49500ced70 0x7f495015da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:49.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.280+0000 7f4956797700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49500d06f0 0x7f495015df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:49.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.280+0000 7f4956797700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49501f5a60 con 0x7f49500d06f0 2023-11-28T13:00:49.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.280+0000 7f4956797700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49500c7300 con 0x7f49500ced70 2023-11-28T13:00:49.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.280+0000 7f4956797700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49500c66f0 con 0x7f495006b910 2023-11-28T13:00:49.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.280+0000 7f4955f96700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49500d06f0 0x7f495015df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:49.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.284+0000 7f4955795700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f495006b910 0x7f49501f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:49.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.284+0000 7f4955f96700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49500d06f0 0x7f495015df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44238/0 (socket says 172.21.15.82:44238) 2023-11-28T13:00:49.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.284+0000 7f4955f96700 1 -- 172.21.15.82:0/896497075 learned_addr learned my addr 172.21.15.82:0/896497075 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:49.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.284+0000 7f4954f94700 1 --2- 172.21.15.82:0/896497075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49500ced70 0x7f495015da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:49.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.284+0000 7f4955f96700 1 -- 172.21.15.82:0/896497075 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f495006b910 msgr2=0x7f49501f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:49.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.284+0000 7f4955f96700 1 --2- 172.21.15.82:0/896497075 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f495006b910 0x7f49501f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:49.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.284+0000 7f4955f96700 1 -- 172.21.15.82:0/896497075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49500ced70 msgr2=0x7f495015da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:49.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.284+0000 7f4955f96700 1 --2- 172.21.15.82:0/896497075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49500ced70 0x7f495015da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:49.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.284+0000 7f4955f96700 1 -- 172.21.15.82:0/896497075 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4948009a70 con 0x7f49500d06f0 2023-11-28T13:00:49.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.284+0000 7f4955f96700 1 --2- 172.21.15.82:0/896497075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49500d06f0 0x7f495015df40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f494800efc0 tx=0x7f494800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:49.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.284+0000 7f4945ffb700 1 -- 172.21.15.82:0/896497075 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494800ca90 con 0x7f49500d06f0 2023-11-28T13:00:49.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.284+0000 7f4956797700 1 -- 172.21.15.82:0/896497075 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494c0094b0 con 0x7f49500d06f0 2023-11-28T13:00:49.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.284+0000 7f4945ffb700 1 -- 172.21.15.82:0/896497075 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494800f040 con 0x7f49500d06f0 2023-11-28T13:00:49.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.284+0000 7f4945ffb700 1 -- 172.21.15.82:0/896497075 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494800cdf0 con 0x7f49500d06f0 2023-11-28T13:00:49.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.284+0000 7f4956797700 1 -- 172.21.15.82:0/896497075 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49500d2320 con 0x7f49500d06f0 2023-11-28T13:00:49.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.284+0000 7f4956797700 1 -- 172.21.15.82:0/896497075 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49500cf2c0 con 0x7f49500d06f0 2023-11-28T13:00:49.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.284+0000 7f4945ffb700 1 -- 172.21.15.82:0/896497075 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4948014480 con 0x7f49500d06f0 2023-11-28T13:00:49.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.284+0000 7f4945ffb700 1 --2- 172.21.15.82:0/896497075 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4934064ee0 0x7f4934067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:49.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.288+0000 7f4945ffb700 1 -- 172.21.15.82:0/896497075 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f49480829a0 con 0x7f49500d06f0 2023-11-28T13:00:49.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.288+0000 7f4955795700 1 --2- 172.21.15.82:0/896497075 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4934064ee0 0x7f4934067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:49.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.288+0000 7f4955795700 1 --2- 172.21.15.82:0/896497075 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4934064ee0 0x7f4934067390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f494c0090b0 tx=0x7f494c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:49.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.292+0000 7f4945ffb700 1 -- 172.21.15.82:0/896497075 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4948050a60 con 0x7f49500d06f0 2023-11-28T13:00:49.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.488+0000 7f4956797700 1 -- 172.21.15.82:0/896497075 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f49500d2600 con 0x7f49500d06f0 2023-11-28T13:00:49.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.488+0000 7f4945ffb700 1 -- 172.21.15.82:0/896497075 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4948054080 con 0x7f49500d06f0 2023-11-28T13:00:49.492 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T13:00:49.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.488+0000 7f4956797700 1 -- 172.21.15.82:0/896497075 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4934064ee0 msgr2=0x7f4934067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:49.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.488+0000 7f4956797700 1 --2- 172.21.15.82:0/896497075 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4934064ee0 0x7f4934067390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f494c0090b0 tx=0x7f494c008030 comp rx=0 tx=0).stop 2023-11-28T13:00:49.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.488+0000 7f4956797700 1 -- 172.21.15.82:0/896497075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49500d06f0 msgr2=0x7f495015df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:49.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.488+0000 7f4956797700 1 --2- 172.21.15.82:0/896497075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49500d06f0 0x7f495015df40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f494800efc0 tx=0x7f494800c3a0 comp rx=0 tx=0).stop 2023-11-28T13:00:49.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.488+0000 7f4956797700 1 -- 172.21.15.82:0/896497075 shutdown_connections 2023-11-28T13:00:49.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.488+0000 7f4956797700 1 --2- 172.21.15.82:0/896497075 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4934064ee0 0x7f4934067390 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:49.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.488+0000 7f4956797700 1 --2- 172.21.15.82:0/896497075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49500d06f0 0x7f495015df40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:49.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.488+0000 7f4956797700 1 --2- 172.21.15.82:0/896497075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49500ced70 0x7f495015da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:49.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.488+0000 7f4956797700 1 --2- 172.21.15.82:0/896497075 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f495006b910 0x7f49501f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:49.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.488+0000 7f4956797700 1 -- 172.21.15.82:0/896497075 >> 172.21.15.82:0/896497075 conn(0x7f49500d2b20 msgr2=0x7f4950160350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:49.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.488+0000 7f4956797700 1 -- 172.21.15.82:0/896497075 shutdown_connections 2023-11-28T13:00:49.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:49.488+0000 7f4956797700 1 -- 172.21.15.82:0/896497075 wait complete. 2023-11-28T13:00:49.506 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T13:00:49.506 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T13:00:49.506 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-11-28T13:00:49.506 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-28T13:00:49.507 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-28T13:00:49.507 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T13:00:49.507 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T13:00:49.507 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T13:00:49.507 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-28T13:00:49.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:49.508 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-11-28T13:00:49.516 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T13:00:49.516 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T13:00:49.516 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T13:00:49.516 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:49.516 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-11-28T13:00:49.516 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:49.516 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T13:00:49.516 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:49.517 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T13:00:49.517 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:49.517 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T13:00:49.517 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:49.517 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T13:00:49.517 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:49.517 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T13:00:49.517 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42534sec preferred_lft 42534sec 2023-11-28T13:00:49.517 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-11-28T13:00:49.517 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:49.517 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T13:00:49.517 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:d3:29:2d:e4 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:49.517 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T13:00:49.517 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:49.518 INFO:teuthology.orchestra.run.smithi114.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T13:00:49.518 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether ce:4d:b6:bc:30:3d brd ff:ff:ff:ff:ff:ff 2023-11-28T13:00:49.518 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T13:00:49.518 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:49.518 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::7c50:97ff:fe09:d232/64 scope link 2023-11-28T13:00:49.518 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:49.518 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T13:00:49.518 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether ce:4d:b6:bc:30:3d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T13:00:49.518 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::cc4d:b6ff:febc:303d/64 scope link 2023-11-28T13:00:49.518 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:49.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:49.519 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T13:00:49.572 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-11-28T13:00:49.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:49.574 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-11-28T13:00:49.580 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-11-28T13:00:49.581 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T13:00:49.581 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T13:00:49.581 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T13:00:49.581 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T13:00:49.581 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-28T13:00:49.581 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T13:00:49.581 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T13:00:49.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:49.581 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-28T13:00:49.582 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-28T13:00:49.582 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T13:00:49.582 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T13:00:49.582 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T13:00:49.582 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-28T13:00:49.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:49.616 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-11-28T13:00:49.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T13:00:49.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:49.664 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2023-11-28T13:00:49.672 INFO:teuthology.orchestra.run.smithi114.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-28T13:00:49.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:49.672 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-28T13:00:49.672 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-28T13:00:49.672 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T13:00:49.673 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-28T13:00:49.673 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-28T13:00:49.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:49.704 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-28T13:00:49.762 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T13:00:49.762 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T13:00:49.762 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T13:00:49.762 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:49.762 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-11-28T13:00:49.762 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:49.762 INFO:teuthology.orchestra.run.smithi114.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T13:00:49.762 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 16:f5:c2:75:6c:89 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T13:00:49.763 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T13:00:49.763 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:49.763 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::14f5:c2ff:fe75:6c89/64 scope link 2023-11-28T13:00:49.763 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:49.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:49.764 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-28T13:00:49.776 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T13:00:49.776 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T13:00:49.776 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T13:00:49.777 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:49.777 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-11-28T13:00:49.777 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:49.777 INFO:teuthology.orchestra.run.smithi114.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T13:00:49.777 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 16:f5:c2:75:6c:89 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T13:00:49.777 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T13:00:49.777 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:49.777 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::14f5:c2ff:fe75:6c89/64 scope link 2023-11-28T13:00:49.777 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:00:49.778 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-28T13:00:49.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:49.779 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-28T13:00:49.779 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-28T13:00:49.779 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-28T13:00:49.779 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-28T13:00:49.779 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-28T13:00:49.779 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-28T13:00:49.779 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-28T13:00:49.779 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-28T13:00:49.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:49.837 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-28T13:00:49.838 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-28T13:00:49.838 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.1 up 2023-11-28T13:00:49.838 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.1 master ceph-brx 2023-11-28T13:00:49.838 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-28T13:00:49.864 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-28T13:00:49.864 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T13:00:49.864 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-28T13:00:49.912 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-28T13:00:49.912 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T13:00:49.913 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-28T13:00:49.919 DEBUG:teuthology.orchestra.run.smithi114:> sudo modprobe fuse 2023-11-28T13:00:49.932 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T13:00:49.932 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T13:00:49.943 INFO:teuthology.orchestra.run.smithi114.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T13:00:49.944 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T13:00:49.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:49.944 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-28T13:00:49.994 INFO:teuthology.orchestra.run.smithi114.stdout:52 2023-11-28T13:00:49.994 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2023-11-28T13:00:49.994 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3 --client_mountpoint=/) 2023-11-28T13:00:49.996 DEBUG:teuthology.orchestra.run.smithi114:> sudo modprobe fuse 2023-11-28T13:00:50.013 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T13:00:50.013 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T13:00:50.074 INFO:teuthology.orchestra.run.smithi114.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T13:00:50.075 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T13:00:50.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:50.076 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-28T13:00:50.078 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi114.stderr:2023-11-28T13:00:50.073+0000 7f1c0b75e640 -1 init, newargv = 0x5584ee487ab0 newargc=15 2023-11-28T13:00:50.079 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi114.stderr:ceph-fuse[42946]: starting ceph client 2023-11-28T13:00:50.081 INFO:teuthology.orchestra.run.smithi114.stdout:52 2023-11-28T13:00:50.086 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi114.stderr:ceph-fuse[42946]: starting fuse 2023-11-28T13:00:51.183 DEBUG:teuthology.orchestra.run.smithi114:> sudo modprobe fuse 2023-11-28T13:00:51.202 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T13:00:51.202 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T13:00:51.260 INFO:teuthology.orchestra.run.smithi114.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T13:00:51.261 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T13:00:51.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:51.262 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-28T13:00:51.269 INFO:teuthology.orchestra.run.smithi114.stdout:52 2023-11-28T13:00:51.269 INFO:teuthology.orchestra.run.smithi114.stdout:53 2023-11-28T13:00:51.269 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2023-11-28T13:00:51.270 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T13:00:51.270 DEBUG:teuthology.orchestra.run.smithi114:> import glob 2023-11-28T13:00:51.270 DEBUG:teuthology.orchestra.run.smithi114:> import re 2023-11-28T13:00:51.270 DEBUG:teuthology.orchestra.run.smithi114:> import os 2023-11-28T13:00:51.270 DEBUG:teuthology.orchestra.run.smithi114:> import subprocess 2023-11-28T13:00:51.270 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-28T13:00:51.270 DEBUG:teuthology.orchestra.run.smithi114:> def _find_admin_socket(client_name): 2023-11-28T13:00:51.271 DEBUG:teuthology.orchestra.run.smithi114:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-28T13:00:51.271 DEBUG:teuthology.orchestra.run.smithi114:> files = glob.glob(asok_path) 2023-11-28T13:00:51.271 DEBUG:teuthology.orchestra.run.smithi114:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-28T13:00:51.271 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-28T13:00:51.271 DEBUG:teuthology.orchestra.run.smithi114:> # Given a non-glob path, it better be there 2023-11-28T13:00:51.271 DEBUG:teuthology.orchestra.run.smithi114:> if "*" not in asok_path: 2023-11-28T13:00:51.271 DEBUG:teuthology.orchestra.run.smithi114:> assert(len(files) == 1) 2023-11-28T13:00:51.271 DEBUG:teuthology.orchestra.run.smithi114:> return files[0] 2023-11-28T13:00:51.271 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-28T13:00:51.271 DEBUG:teuthology.orchestra.run.smithi114:> for f in files: 2023-11-28T13:00:51.272 DEBUG:teuthology.orchestra.run.smithi114:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T13:00:51.272 DEBUG:teuthology.orchestra.run.smithi114:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T13:00:51.272 DEBUG:teuthology.orchestra.run.smithi114:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T13:00:51.272 DEBUG:teuthology.orchestra.run.smithi114:> contents = proc_f.read() 2023-11-28T13:00:51.272 DEBUG:teuthology.orchestra.run.smithi114:> if mountpoint in contents: 2023-11-28T13:00:51.272 DEBUG:teuthology.orchestra.run.smithi114:> return f 2023-11-28T13:00:51.273 DEBUG:teuthology.orchestra.run.smithi114:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T13:00:51.273 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-28T13:00:51.273 DEBUG:teuthology.orchestra.run.smithi114:> print(_find_admin_socket("client.3")) 2023-11-28T13:00:51.273 DEBUG:teuthology.orchestra.run.smithi114:> ' 2023-11-28T13:00:51.355 INFO:teuthology.orchestra.run.smithi114.stdout:/var/run/ceph/ceph-client.3.42946.asok 2023-11-28T13:00:51.538 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.42946.asok 2023-11-28T13:00:51.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:51.538 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.42946.asok status 2023-11-28T13:00:51.686 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-28T13:00:51.686 INFO:teuthology.orchestra.run.smithi114.stdout: "metadata": { 2023-11-28T13:00:51.686 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T13:00:51.686 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T13:00:51.687 INFO:teuthology.orchestra.run.smithi114.stdout: "entity_id": "3", 2023-11-28T13:00:51.687 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": "smithi114", 2023-11-28T13:00:51.687 INFO:teuthology.orchestra.run.smithi114.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-28T13:00:51.687 INFO:teuthology.orchestra.run.smithi114.stdout: "pid": "42946", 2023-11-28T13:00:51.687 INFO:teuthology.orchestra.run.smithi114.stdout: "root": "/" 2023-11-28T13:00:51.687 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-28T13:00:51.688 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_count": 0, 2023-11-28T13:00:51.688 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_pinned_count": 0, 2023-11-28T13:00:51.688 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4696, 2023-11-28T13:00:51.688 INFO:teuthology.orchestra.run.smithi114.stdout: "inst": { 2023-11-28T13:00:51.688 INFO:teuthology.orchestra.run.smithi114.stdout: "name": { 2023-11-28T13:00:51.688 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "client", 2023-11-28T13:00:51.688 INFO:teuthology.orchestra.run.smithi114.stdout: "num": 4696 2023-11-28T13:00:51.689 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-28T13:00:51.689 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-28T13:00:51.689 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-28T13:00:51.689 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.2:0", 2023-11-28T13:00:51.689 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 589804452 2023-11-28T13:00:51.689 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-28T13:00:51.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-28T13:00:51.690 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-28T13:00:51.690 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-28T13:00:51.690 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.2:0", 2023-11-28T13:00:51.690 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 589804452 2023-11-28T13:00:51.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-28T13:00:51.691 INFO:teuthology.orchestra.run.smithi114.stdout: "inst_str": "client.4696 192.168.0.2:0/589804452", 2023-11-28T13:00:51.691 INFO:teuthology.orchestra.run.smithi114.stdout: "addr_str": "192.168.0.2:0/589804452", 2023-11-28T13:00:51.691 INFO:teuthology.orchestra.run.smithi114.stdout: "inode_count": 1, 2023-11-28T13:00:51.691 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_epoch": 7, 2023-11-28T13:00:51.691 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch": 24, 2023-11-28T13:00:51.691 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch_barrier": 0, 2023-11-28T13:00:51.692 INFO:teuthology.orchestra.run.smithi114.stdout: "blocklisted": false, 2023-11-28T13:00:51.692 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs" 2023-11-28T13:00:51.692 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-28T13:00:51.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:51.696 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2023-11-28T13:00:51.696 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T13:00:51.705 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2023-11-28T13:00:51.706 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T13:00:51.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:51.706 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T13:00:51.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:51.768 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2023-11-28T13:00:51.768 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-28T13:00:51.776 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2023-11-28T13:00:51.776 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-28T13:00:51.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:51.776 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-28T13:00:51.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:51.799 DEBUG:teuthology.orchestra.run.smithi114:> stat --file-system '--printf=%T 2023-11-28T13:00:51.800 DEBUG:teuthology.orchestra.run.smithi114:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-28T13:00:51.808 INFO:teuthology.orchestra.run.smithi114.stdout:fuseblk 2023-11-28T13:00:51.808 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-28T13:00:51.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:51.809 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T13:00:51.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:51.865 DEBUG:teuthology.orchestra.run.smithi114:> stat --file-system '--printf=%T 2023-11-28T13:00:51.866 DEBUG:teuthology.orchestra.run.smithi114:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-28T13:00:51.871 INFO:teuthology.orchestra.run.smithi114.stdout:fuseblk 2023-11-28T13:00:51.872 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-28T13:00:51.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:00:51.872 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-28T13:00:51.930 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-28T13:00:51.954 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:00:52.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.075+0000 7f5d07fff700 1 Processor -- start 2023-11-28T13:00:52.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.075+0000 7f5d07fff700 1 -- start start 2023-11-28T13:00:52.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.075+0000 7f5d07fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5d000530c0 0x7f5d000504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:52.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.075+0000 7f5d07fff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d00054360 con 0x7f5d00007460 2023-11-28T13:00:52.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.075+0000 7f5d07fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d000534f0 con 0x7f5d000df890 2023-11-28T13:00:52.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.075+0000 7f5d07fff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d00050a20 con 0x7f5d000530c0 2023-11-28T13:00:52.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.075+0000 7f5d067fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5d000530c0 0x7f5d000504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:52.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.075+0000 7f5d077fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5d00007460 0x7f5d00007880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53234/0 (socket says 172.21.15.82:53234) 2023-11-28T13:00:52.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.075+0000 7f5d077fe700 1 -- 172.21.15.82:0/2188458112 learned_addr learned my addr 172.21.15.82:0/2188458112 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:52.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.079+0000 7f5d067fc700 1 -- 172.21.15.82:0/2188458112 >> v1:172.21.15.114:6789/0 conn(0x7f5d000df890 legacy=0x7f5d000384d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:52.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.079+0000 7f5d067fc700 1 -- 172.21.15.82:0/2188458112 >> v1:172.21.15.82:6789/0 conn(0x7f5d00007460 legacy=0x7f5d00007880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:52.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.079+0000 7f5d05ffb700 1 -- 172.21.15.82:0/2188458112 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894329409 0 0) 0x7f5d000534f0 con 0x7f5d000df890 2023-11-28T13:00:52.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.079+0000 7f5d067fc700 1 -- 172.21.15.82:0/2188458112 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d00053750 con 0x7f5d000530c0 2023-11-28T13:00:52.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.079+0000 7f5d067fc700 1 --2- 172.21.15.82:0/2188458112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d000530c0 0x7f5d000504e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009850 tx=0x7f5cfc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b3382c9d8e5dca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:52.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.079+0000 7f5d05ffb700 1 -- 172.21.15.82:0/2188458112 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc004230 con 0x7f5d000530c0 2023-11-28T13:00:52.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.079+0000 7f5d05ffb700 1 -- 172.21.15.82:0/2188458112 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cfc004390 con 0x7f5d000530c0 2023-11-28T13:00:52.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.079+0000 7f5d05ffb700 1 -- 172.21.15.82:0/2188458112 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc0036c0 con 0x7f5d000530c0 2023-11-28T13:00:52.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.079+0000 7f5d07fff700 1 -- 172.21.15.82:0/2188458112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d000530c0 msgr2=0x7f5d000504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:52.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.079+0000 7f5d07fff700 1 --2- 172.21.15.82:0/2188458112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d000530c0 0x7f5d000504e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009850 tx=0x7f5cfc009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:52.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.079+0000 7f5d07fff700 1 -- 172.21.15.82:0/2188458112 shutdown_connections 2023-11-28T13:00:52.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.079+0000 7f5d07fff700 1 --2- 172.21.15.82:0/2188458112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d000530c0 0x7f5d000504e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.079+0000 7f5d07fff700 1 -- 172.21.15.82:0/2188458112 >> 172.21.15.82:0/2188458112 conn(0x7f5d00052000 msgr2=0x7f5d00052400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:52.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.079+0000 7f5d07fff700 1 -- 172.21.15.82:0/2188458112 shutdown_connections 2023-11-28T13:00:52.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.079+0000 7f5d07fff700 1 -- 172.21.15.82:0/2188458112 wait complete. 2023-11-28T13:00:52.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5d07fff700 1 Processor -- start 2023-11-28T13:00:52.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5d07fff700 1 -- start start 2023-11-28T13:00:52.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5d07fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5d00007460 0x7f5d000dcc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:52.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5d07fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d000530c0 0x7f5d0004b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:52.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5d07fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d000df890 0x7f5d0004b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:52.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5d07fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d00037b60 con 0x7f5d000df890 2023-11-28T13:00:52.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5d07fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000dd160 con 0x7f5d000530c0 2023-11-28T13:00:52.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5d07fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d00036f50 con 0x7f5d00007460 2023-11-28T13:00:52.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5d077fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d000df890 0x7f5d0004b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:52.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5d067fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d000530c0 0x7f5d0004b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:52.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5d06ffd700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5d00007460 0x7f5d000dcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:52.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5d077fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d000df890 0x7f5d0004b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44268/0 (socket says 172.21.15.82:44268) 2023-11-28T13:00:52.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5d077fe700 1 -- 172.21.15.82:0/584203369 learned_addr learned my addr 172.21.15.82:0/584203369 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:52.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5d077fe700 1 -- 172.21.15.82:0/584203369 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5d00007460 msgr2=0x7f5d000dcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:52.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5d077fe700 1 --2- 172.21.15.82:0/584203369 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5d00007460 0x7f5d000dcc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5d077fe700 1 -- 172.21.15.82:0/584203369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d000530c0 msgr2=0x7f5d0004b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:52.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5d077fe700 1 --2- 172.21.15.82:0/584203369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d000530c0 0x7f5d0004b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5d077fe700 1 -- 172.21.15.82:0/584203369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc0094b0 con 0x7f5d000df890 2023-11-28T13:00:52.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5d077fe700 1 --2- 172.21.15.82:0/584203369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d000df890 0x7f5d0004b850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5d080680c0 tx=0x7f5d08072430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:52.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5cef7fe700 1 -- 172.21.15.82:0/584203369 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d08066640 con 0x7f5d000df890 2023-11-28T13:00:52.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5cef7fe700 1 -- 172.21.15.82:0/584203369 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0808d070 con 0x7f5d000df890 2023-11-28T13:00:52.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5d07fff700 1 -- 172.21.15.82:0/584203369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d00053d10 con 0x7f5d000df890 2023-11-28T13:00:52.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5cef7fe700 1 -- 172.21.15.82:0/584203369 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d08066dc0 con 0x7f5d000df890 2023-11-28T13:00:52.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.083+0000 7f5d07fff700 1 -- 172.21.15.82:0/584203369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d00053a30 con 0x7f5d000df890 2023-11-28T13:00:52.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.087+0000 7f5d07fff700 1 -- 172.21.15.82:0/584203369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d00053ff0 con 0x7f5d000df890 2023-11-28T13:00:52.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.087+0000 7f5cef7fe700 1 -- 172.21.15.82:0/584203369 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5d0809a070 con 0x7f5d000df890 2023-11-28T13:00:52.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.087+0000 7f5cef7fe700 1 --2- 172.21.15.82:0/584203369 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5cf4064ee0 0x7f5cf4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:52.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.087+0000 7f5cef7fe700 1 -- 172.21.15.82:0/584203369 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5d080fb530 con 0x7f5d000df890 2023-11-28T13:00:52.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.087+0000 7f5d06ffd700 1 --2- 172.21.15.82:0/584203369 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5cf4064ee0 0x7f5cf4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:52.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.087+0000 7f5d06ffd700 1 --2- 172.21.15.82:0/584203369 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5cf4064ee0 0x7f5cf4067390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8007fd0 tx=0x7f5cf8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:52.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.091+0000 7f5cef7fe700 1 -- 172.21.15.82:0/584203369 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5d080c9650 con 0x7f5d000df890 2023-11-28T13:00:52.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.247+0000 7f5d07fff700 1 -- 172.21.15.82:0/584203369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d000059c0 con 0x7f5d000df890 2023-11-28T13:00:52.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.247+0000 7f5cef7fe700 1 -- 172.21.15.82:0/584203369 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17811 (secure 0 0 0) 0x7f5d08098020 con 0x7f5d000df890 2023-11-28T13:00:52.254 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:52.255 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:00:26.981345+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:00:24.360641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T13:00:24.960863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:00:52.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.251+0000 7f5d07fff700 1 -- 172.21.15.82:0/584203369 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5cf4064ee0 msgr2=0x7f5cf4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:52.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.251+0000 7f5d07fff700 1 --2- 172.21.15.82:0/584203369 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5cf4064ee0 0x7f5cf4067390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8007fd0 tx=0x7f5cf8009040 comp rx=0 tx=0).stop 2023-11-28T13:00:52.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.251+0000 7f5d07fff700 1 -- 172.21.15.82:0/584203369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d000df890 msgr2=0x7f5d0004b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:52.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.251+0000 7f5d07fff700 1 --2- 172.21.15.82:0/584203369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d000df890 0x7f5d0004b850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5d080680c0 tx=0x7f5d08072430 comp rx=0 tx=0).stop 2023-11-28T13:00:52.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.251+0000 7f5d07fff700 1 -- 172.21.15.82:0/584203369 shutdown_connections 2023-11-28T13:00:52.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.251+0000 7f5d07fff700 1 --2- 172.21.15.82:0/584203369 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5cf4064ee0 0x7f5cf4067390 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.251+0000 7f5d07fff700 1 --2- 172.21.15.82:0/584203369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d000df890 0x7f5d0004b850 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.251+0000 7f5d07fff700 1 --2- 172.21.15.82:0/584203369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d000530c0 0x7f5d0004b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.251+0000 7f5d07fff700 1 --2- 172.21.15.82:0/584203369 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5d00007460 0x7f5d000dcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.251+0000 7f5d07fff700 1 -- 172.21.15.82:0/584203369 >> 172.21.15.82:0/584203369 conn(0x7f5d00052000 msgr2=0x7f5d000343e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:52.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.255+0000 7f5d07fff700 1 -- 172.21.15.82:0/584203369 shutdown_connections 2023-11-28T13:00:52.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.255+0000 7f5d07fff700 1 -- 172.21.15.82:0/584203369 wait complete. 2023-11-28T13:00:52.276 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T13:00:24.360641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T13:00:24.960863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:00:52.276 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:00:52.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.387+0000 7fb8bdf59700 1 Processor -- start 2023-11-28T13:00:52.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.387+0000 7fb8bdf59700 1 -- start start 2023-11-28T13:00:52.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8bdf59700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb8b80b1d10 0x7fb8b80cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:52.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8bdf59700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb8b80d25b0 0x7fb8b806ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:52.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8bdf59700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b8069bc0 con 0x7fb8b80b5940 2023-11-28T13:00:52.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8bdf59700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b80d1480 con 0x7fb8b80b1d10 2023-11-28T13:00:52.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8bdf59700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b80cd280 con 0x7fb8b80d25b0 2023-11-28T13:00:52.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8bcf57700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb8b80b1d10 0x7fb8b80cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:52.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8b7fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb8b80d25b0 0x7fb8b806ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:52.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8bd758700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb8b80b5940 0x7fb8b806a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:46844/0 (socket says 172.21.15.82:46844) 2023-11-28T13:00:52.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8bd758700 1 -- 172.21.15.82:0/288710924 learned_addr learned my addr 172.21.15.82:0/288710924 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:52.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8bcf57700 1 -- 172.21.15.82:0/288710924 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb8b80d25b0 msgr2=0x7fb8b806ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:52.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8bcf57700 1 --2- 172.21.15.82:0/288710924 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb8b80d25b0 0x7fb8b806ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8bcf57700 1 -- 172.21.15.82:0/288710924 >> v1:172.21.15.114:6789/0 conn(0x7fb8b80b5940 legacy=0x7fb8b806a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:52.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8bcf57700 1 -- 172.21.15.82:0/288710924 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b80cd560 con 0x7fb8b80b1d10 2023-11-28T13:00:52.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8b77fe700 1 -- 172.21.15.82:0/288710924 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680622166 0 0) 0x7fb8b8069bc0 con 0x7fb8b80b5940 2023-11-28T13:00:52.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8bcf57700 1 --2- 172.21.15.82:0/288710924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8b80b1d10 0x7fb8b80cec20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009880 tx=0x7fb8a8009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d395331a826bd36 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:52.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8b77fe700 1 -- 172.21.15.82:0/288710924 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8011830 con 0x7fb8b80b1d10 2023-11-28T13:00:52.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8b77fe700 1 -- 172.21.15.82:0/288710924 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a8011990 con 0x7fb8b80b1d10 2023-11-28T13:00:52.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8b77fe700 1 -- 172.21.15.82:0/288710924 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8011d20 con 0x7fb8b80b1d10 2023-11-28T13:00:52.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8bdf59700 1 -- 172.21.15.82:0/288710924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8b80b1d10 msgr2=0x7fb8b80cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:52.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8bdf59700 1 --2- 172.21.15.82:0/288710924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8b80b1d10 0x7fb8b80cec20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009880 tx=0x7fb8a8009b90 comp rx=0 tx=0).stop 2023-11-28T13:00:52.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8bdf59700 1 -- 172.21.15.82:0/288710924 shutdown_connections 2023-11-28T13:00:52.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8bdf59700 1 --2- 172.21.15.82:0/288710924 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb8b80d25b0 0x7fb8b806ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8bdf59700 1 --2- 172.21.15.82:0/288710924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8b80b1d10 0x7fb8b80cec20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8bdf59700 1 -- 172.21.15.82:0/288710924 >> 172.21.15.82:0/288710924 conn(0x7fb8b80b52a0 msgr2=0x7fb8b80d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:52.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8bdf59700 1 -- 172.21.15.82:0/288710924 shutdown_connections 2023-11-28T13:00:52.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.391+0000 7fb8bdf59700 1 -- 172.21.15.82:0/288710924 wait complete. 2023-11-28T13:00:52.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.395+0000 7fb8bdf59700 1 Processor -- start 2023-11-28T13:00:52.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.395+0000 7fb8bdf59700 1 -- start start 2023-11-28T13:00:52.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.395+0000 7fb8bdf59700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8b80b1d10 0x7fb8b8149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:52.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.395+0000 7fb8bdf59700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb8b80b5940 0x7fb8b815f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:52.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.395+0000 7fb8bdf59700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8b80d25b0 0x7fb8b80b2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:52.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.395+0000 7fb8bdf59700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b815f6a0 con 0x7fb8b80b1d10 2023-11-28T13:00:52.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.395+0000 7fb8bdf59700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b815bd10 con 0x7fb8b80d25b0 2023-11-28T13:00:52.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.395+0000 7fb8bdf59700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b815bff0 con 0x7fb8b80b5940 2023-11-28T13:00:52.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.395+0000 7fb8bcf57700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8b80b1d10 0x7fb8b8149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:52.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.395+0000 7fb8bcf57700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8b80b1d10 0x7fb8b8149f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44278/0 (socket says 172.21.15.82:44278) 2023-11-28T13:00:52.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.395+0000 7fb8b7fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb8b80b5940 0x7fb8b815f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:52.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.395+0000 7fb8bcf57700 1 -- 172.21.15.82:0/1991526009 learned_addr learned my addr 172.21.15.82:0/1991526009 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:52.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.395+0000 7fb8bd758700 1 --2- 172.21.15.82:0/1991526009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8b80d25b0 0x7fb8b80b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:52.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.395+0000 7fb8bcf57700 1 -- 172.21.15.82:0/1991526009 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb8b80b5940 msgr2=0x7fb8b815f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:52.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.395+0000 7fb8bcf57700 1 --2- 172.21.15.82:0/1991526009 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb8b80b5940 0x7fb8b815f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.395+0000 7fb8bcf57700 1 -- 172.21.15.82:0/1991526009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8b80d25b0 msgr2=0x7fb8b80b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:52.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.395+0000 7fb8bcf57700 1 --2- 172.21.15.82:0/1991526009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8b80d25b0 0x7fb8b80b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.395+0000 7fb8bcf57700 1 -- 172.21.15.82:0/1991526009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a80094b0 con 0x7fb8b80b1d10 2023-11-28T13:00:52.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.399+0000 7fb8bcf57700 1 --2- 172.21.15.82:0/1991526009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8b80b1d10 0x7fb8b8149f80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80090b0 tx=0x7fb8a8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:52.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.399+0000 7fb8b57fa700 1 -- 172.21.15.82:0/1991526009 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a801aa10 con 0x7fb8b80b1d10 2023-11-28T13:00:52.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.399+0000 7fb8b57fa700 1 -- 172.21.15.82:0/1991526009 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a801f070 con 0x7fb8b80b1d10 2023-11-28T13:00:52.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.399+0000 7fb8bdf59700 1 -- 172.21.15.82:0/1991526009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b80d1050 con 0x7fb8b80b1d10 2023-11-28T13:00:52.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.399+0000 7fb8b57fa700 1 -- 172.21.15.82:0/1991526009 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a801ad90 con 0x7fb8b80b1d10 2023-11-28T13:00:52.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.399+0000 7fb8bdf59700 1 -- 172.21.15.82:0/1991526009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b80b20e0 con 0x7fb8b80b1d10 2023-11-28T13:00:52.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.399+0000 7fb8bdf59700 1 -- 172.21.15.82:0/1991526009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b80d11e0 con 0x7fb8b80b1d10 2023-11-28T13:00:52.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.399+0000 7fb8b57fa700 1 -- 172.21.15.82:0/1991526009 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb8a800f050 con 0x7fb8b80b1d10 2023-11-28T13:00:52.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.399+0000 7fb8b57fa700 1 --2- 172.21.15.82:0/1991526009 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb8a4064ee0 0x7fb8a4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:52.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.399+0000 7fb8b7fff700 1 --2- 172.21.15.82:0/1991526009 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb8a4064ee0 0x7fb8a4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:52.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.399+0000 7fb8b57fa700 1 -- 172.21.15.82:0/1991526009 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb8a8083330 con 0x7fb8b80b1d10 2023-11-28T13:00:52.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.403+0000 7fb8b7fff700 1 --2- 172.21.15.82:0/1991526009 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb8a4064ee0 0x7fb8a4067390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb8b814d430 tx=0x7fb8ac009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:52.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.407+0000 7fb8b57fa700 1 -- 172.21.15.82:0/1991526009 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb8a8051460 con 0x7fb8b80b1d10 2023-11-28T13:00:52.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.567+0000 7fb8bdf59700 1 -- 172.21.15.82:0/1991526009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8b8065fc0 con 0x7fb8b80b1d10 2023-11-28T13:00:52.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.567+0000 7fb8b57fa700 1 -- 172.21.15.82:0/1991526009 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb8a800b360 con 0x7fb8b80b1d10 2023-11-28T13:00:52.574 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:00:52.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.571+0000 7fb8bdf59700 1 -- 172.21.15.82:0/1991526009 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb8a4064ee0 msgr2=0x7fb8a4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:52.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.571+0000 7fb8bdf59700 1 --2- 172.21.15.82:0/1991526009 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb8a4064ee0 0x7fb8a4067390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb8b814d430 tx=0x7fb8ac009240 comp rx=0 tx=0).stop 2023-11-28T13:00:52.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.571+0000 7fb8bdf59700 1 -- 172.21.15.82:0/1991526009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8b80b1d10 msgr2=0x7fb8b8149f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:52.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.571+0000 7fb8bdf59700 1 --2- 172.21.15.82:0/1991526009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8b80b1d10 0x7fb8b8149f80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80090b0 tx=0x7fb8a8004770 comp rx=0 tx=0).stop 2023-11-28T13:00:52.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.571+0000 7fb8bdf59700 1 -- 172.21.15.82:0/1991526009 shutdown_connections 2023-11-28T13:00:52.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.571+0000 7fb8bdf59700 1 --2- 172.21.15.82:0/1991526009 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb8a4064ee0 0x7fb8a4067390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.571+0000 7fb8bdf59700 1 --2- 172.21.15.82:0/1991526009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8b80d25b0 0x7fb8b80b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.571+0000 7fb8bdf59700 1 --2- 172.21.15.82:0/1991526009 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb8b80b5940 0x7fb8b815f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.571+0000 7fb8bdf59700 1 --2- 172.21.15.82:0/1991526009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8b80b1d10 0x7fb8b8149f80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.571+0000 7fb8bdf59700 1 -- 172.21.15.82:0/1991526009 >> 172.21.15.82:0/1991526009 conn(0x7fb8b80b52a0 msgr2=0x7fb8b80d1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:52.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.571+0000 7fb8bdf59700 1 -- 172.21.15.82:0/1991526009 shutdown_connections 2023-11-28T13:00:52.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.571+0000 7fb8bdf59700 1 -- 172.21.15.82:0/1991526009 wait complete. 2023-11-28T13:00:52.588 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:00:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.703+0000 7f911ffff700 1 Processor -- start 2023-11-28T13:00:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.703+0000 7f911ffff700 1 -- start start 2023-11-28T13:00:52.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.703+0000 7f911ffff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f91200d25b0 0x7f91200cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:52.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.703+0000 7f911ffff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9120069bc0 con 0x7f912006c140 2023-11-28T13:00:52.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.703+0000 7f911ffff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91200d1480 con 0x7f91200b1d10 2023-11-28T13:00:52.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.703+0000 7f911ffff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91200cd280 con 0x7f91200d25b0 2023-11-28T13:00:52.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.703+0000 7f911e7fc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f912006c140 0x7f912006a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53248/0 (socket says 172.21.15.82:53248) 2023-11-28T13:00:52.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.703+0000 7f911e7fc700 1 -- 172.21.15.82:0/1064734980 learned_addr learned my addr 172.21.15.82:0/1064734980 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:52.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.703+0000 7f911f7fe700 1 --2- 172.21.15.82:0/1064734980 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f91200d25b0 0x7f91200cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.707+0000 7f911dffb700 1 -- 172.21.15.82:0/1064734980 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789195039 0 0) 0x7f9120069bc0 con 0x7f912006c140 2023-11-28T13:00:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.707+0000 7f911dffb700 1 -- 172.21.15.82:0/1064734980 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91080035d0 con 0x7f912006c140 2023-11-28T13:00:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.707+0000 7f911dffb700 1 -- 172.21.15.82:0/1064734980 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198341813 0 0) 0x7f91200d1480 con 0x7f91200b1d10 2023-11-28T13:00:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.707+0000 7f911f7fe700 1 -- 172.21.15.82:0/1064734980 >> v1:172.21.15.114:6789/0 conn(0x7f91200b1d10 legacy=0x7f912006ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.707+0000 7f911f7fe700 1 -- 172.21.15.82:0/1064734980 >> v1:172.21.15.82:6789/0 conn(0x7f912006c140 legacy=0x7f912006a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.707+0000 7f911f7fe700 1 -- 172.21.15.82:0/1064734980 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91200cd560 con 0x7f91200d25b0 2023-11-28T13:00:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.707+0000 7f911f7fe700 1 --2- 172.21.15.82:0/1064734980 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f91200d25b0 0x7f91200cec20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9118009dc0 tx=0x7f911800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d920765e5ff80206 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.707+0000 7f911dffb700 1 -- 172.21.15.82:0/1064734980 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911800e070 con 0x7f91200d25b0 2023-11-28T13:00:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.707+0000 7f911dffb700 1 -- 172.21.15.82:0/1064734980 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9118003a40 con 0x7f91200d25b0 2023-11-28T13:00:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.707+0000 7f911dffb700 1 -- 172.21.15.82:0/1064734980 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118003dd0 con 0x7f91200d25b0 2023-11-28T13:00:52.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.707+0000 7f911ffff700 1 -- 172.21.15.82:0/1064734980 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f91200d25b0 msgr2=0x7f91200cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:52.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.707+0000 7f911ffff700 1 --2- 172.21.15.82:0/1064734980 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f91200d25b0 0x7f91200cec20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9118009dc0 tx=0x7f911800b330 comp rx=0 tx=0).stop 2023-11-28T13:00:52.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.707+0000 7f911ffff700 1 -- 172.21.15.82:0/1064734980 shutdown_connections 2023-11-28T13:00:52.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.707+0000 7f911ffff700 1 --2- 172.21.15.82:0/1064734980 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f91200d25b0 0x7f91200cec20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.707+0000 7f911ffff700 1 -- 172.21.15.82:0/1064734980 >> 172.21.15.82:0/1064734980 conn(0x7f91200b52a0 msgr2=0x7f91200d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:52.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.707+0000 7f911ffff700 1 -- 172.21.15.82:0/1064734980 shutdown_connections 2023-11-28T13:00:52.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.707+0000 7f911ffff700 1 -- 172.21.15.82:0/1064734980 wait complete. 2023-11-28T13:00:52.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.711+0000 7f911ffff700 1 Processor -- start 2023-11-28T13:00:52.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.711+0000 7f911ffff700 1 -- start start 2023-11-28T13:00:52.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.711+0000 7f911ffff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f912006c140 0x7f91201f4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:52.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.711+0000 7f911ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91200b1d10 0x7f91201602e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:52.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.711+0000 7f911ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91200d25b0 0x7f9120160820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:52.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.711+0000 7f911ffff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91201f4b90 con 0x7f91200b1d10 2023-11-28T13:00:52.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.711+0000 7f911ffff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912015bf50 con 0x7f91200d25b0 2023-11-28T13:00:52.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.711+0000 7f911ffff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912015c230 con 0x7f912006c140 2023-11-28T13:00:52.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.711+0000 7f911e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91200b1d10 0x7f91201602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:52.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.711+0000 7f911e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91200b1d10 0x7f91201602e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44292/0 (socket says 172.21.15.82:44292) 2023-11-28T13:00:52.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.711+0000 7f911e7fc700 1 -- 172.21.15.82:0/175213905 learned_addr learned my addr 172.21.15.82:0/175213905 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:52.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.711+0000 7f911f7fe700 1 --2- 172.21.15.82:0/175213905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91200d25b0 0x7f9120160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:52.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.711+0000 7f911effd700 1 --2- 172.21.15.82:0/175213905 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f912006c140 0x7f91201f4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:52.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.711+0000 7f911e7fc700 1 -- 172.21.15.82:0/175213905 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f912006c140 msgr2=0x7f91201f4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:52.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.711+0000 7f911e7fc700 1 --2- 172.21.15.82:0/175213905 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f912006c140 0x7f91201f4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.711+0000 7f911e7fc700 1 -- 172.21.15.82:0/175213905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91200d25b0 msgr2=0x7f9120160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:52.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.711+0000 7f911e7fc700 1 --2- 172.21.15.82:0/175213905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91200d25b0 0x7f9120160820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.711+0000 7f911e7fc700 1 -- 172.21.15.82:0/175213905 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9118009a70 con 0x7f91200b1d10 2023-11-28T13:00:52.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.711+0000 7f911e7fc700 1 --2- 172.21.15.82:0/175213905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91200b1d10 0x7f91201602e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f911000c780 tx=0x7f911000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:52.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.715+0000 7f9107fff700 1 -- 172.21.15.82:0/175213905 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9110005d90 con 0x7f91200b1d10 2023-11-28T13:00:52.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.715+0000 7f9107fff700 1 -- 172.21.15.82:0/175213905 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91100070d0 con 0x7f91200b1d10 2023-11-28T13:00:52.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.715+0000 7f911ffff700 1 -- 172.21.15.82:0/175213905 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91200d1050 con 0x7f91200b1d10 2023-11-28T13:00:52.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.715+0000 7f9107fff700 1 -- 172.21.15.82:0/175213905 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9110007480 con 0x7f91200b1d10 2023-11-28T13:00:52.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.715+0000 7f911ffff700 1 -- 172.21.15.82:0/175213905 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91200b20e0 con 0x7f91200b1d10 2023-11-28T13:00:52.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.715+0000 7f911ffff700 1 -- 172.21.15.82:0/175213905 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91200d11e0 con 0x7f91200b1d10 2023-11-28T13:00:52.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.715+0000 7f9107fff700 1 -- 172.21.15.82:0/175213905 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9110019030 con 0x7f91200b1d10 2023-11-28T13:00:52.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.715+0000 7f9107fff700 1 --2- 172.21.15.82:0/175213905 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f910c064ee0 0x7f910c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:52.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.719+0000 7f9107fff700 1 -- 172.21.15.82:0/175213905 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f91100812e0 con 0x7f91200b1d10 2023-11-28T13:00:52.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.719+0000 7f911effd700 1 --2- 172.21.15.82:0/175213905 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f910c064ee0 0x7f910c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:52.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.719+0000 7f911effd700 1 --2- 172.21.15.82:0/175213905 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f910c064ee0 0x7f910c067390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9114007fd0 tx=0x7f9114009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:52.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.723+0000 7f9107fff700 1 -- 172.21.15.82:0/175213905 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f911004f540 con 0x7f91200b1d10 2023-11-28T13:00:52.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.891+0000 7f911ffff700 1 -- 172.21.15.82:0/175213905 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9120065fc0 con 0x7f91200b1d10 2023-11-28T13:00:52.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.891+0000 7f9107fff700 1 -- 172.21.15.82:0/175213905 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9110017020 con 0x7f91200b1d10 2023-11-28T13:00:52.895 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:00:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.891+0000 7f911ffff700 1 -- 172.21.15.82:0/175213905 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f910c064ee0 msgr2=0x7f910c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.891+0000 7f911ffff700 1 --2- 172.21.15.82:0/175213905 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f910c064ee0 0x7f910c067390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9114007fd0 tx=0x7f9114009040 comp rx=0 tx=0).stop 2023-11-28T13:00:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.891+0000 7f911ffff700 1 -- 172.21.15.82:0/175213905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91200b1d10 msgr2=0x7f91201602e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.891+0000 7f911ffff700 1 --2- 172.21.15.82:0/175213905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91200b1d10 0x7f91201602e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f911000c780 tx=0x7f911000ca90 comp rx=0 tx=0).stop 2023-11-28T13:00:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.891+0000 7f911ffff700 1 -- 172.21.15.82:0/175213905 shutdown_connections 2023-11-28T13:00:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.891+0000 7f911ffff700 1 --2- 172.21.15.82:0/175213905 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f910c064ee0 0x7f910c067390 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.891+0000 7f911ffff700 1 --2- 172.21.15.82:0/175213905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91200d25b0 0x7f9120160820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.891+0000 7f911ffff700 1 --2- 172.21.15.82:0/175213905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91200b1d10 0x7f91201602e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.891+0000 7f911ffff700 1 --2- 172.21.15.82:0/175213905 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f912006c140 0x7f91201f4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:52.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.891+0000 7f911ffff700 1 -- 172.21.15.82:0/175213905 >> 172.21.15.82:0/175213905 conn(0x7f91200b52a0 msgr2=0x7f912015fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:52.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.891+0000 7f911ffff700 1 -- 172.21.15.82:0/175213905 shutdown_connections 2023-11-28T13:00:52.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:52.891+0000 7f911ffff700 1 -- 172.21.15.82:0/175213905 wait complete. 2023-11-28T13:00:52.910 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T13:00:53.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.023+0000 7f264a21e700 1 Processor -- start 2023-11-28T13:00:53.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.023+0000 7f264a21e700 1 -- start start 2023-11-28T13:00:53.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.023+0000 7f264a21e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f26440b1d10 0x7f26440cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.023+0000 7f264a21e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26440d25b0 0x7f264406ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.023+0000 7f264a21e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2644069bc0 con 0x7f26440b5940 2023-11-28T13:00:53.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.023+0000 7f264a21e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26440d1480 con 0x7f26440b1d10 2023-11-28T13:00:53.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.023+0000 7f264a21e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26440cd280 con 0x7f26440d25b0 2023-11-28T13:00:53.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f2649a1d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f26440b5940 0x7f264406a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53260/0 (socket says 172.21.15.82:53260) 2023-11-28T13:00:53.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f2649a1d700 1 -- 172.21.15.82:0/298458169 learned_addr learned my addr 172.21.15.82:0/298458169 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:53.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f2648a1b700 1 --2- 172.21.15.82:0/298458169 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26440d25b0 0x7f264406ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f264921c700 1 --2- 172.21.15.82:0/298458169 >> v2:172.21.15.114:3300/0 conn(0x7f26440b1d10 0x7f26440cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f263bfff700 1 -- 172.21.15.82:0/298458169 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1480254235 0 0) 0x7f2644069bc0 con 0x7f26440b5940 2023-11-28T13:00:53.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f263bfff700 1 -- 172.21.15.82:0/298458169 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26300035d0 con 0x7f26440b5940 2023-11-28T13:00:53.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f2648a1b700 1 -- 172.21.15.82:0/298458169 >> v2:172.21.15.114:3300/0 conn(0x7f26440b1d10 msgr2=0x7f26440cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:53.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f2648a1b700 1 --2- 172.21.15.82:0/298458169 >> v2:172.21.15.114:3300/0 conn(0x7f26440b1d10 0x7f26440cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f2648a1b700 1 -- 172.21.15.82:0/298458169 >> v1:172.21.15.82:6789/0 conn(0x7f26440b5940 legacy=0x7f264406a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f2648a1b700 1 -- 172.21.15.82:0/298458169 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26440cd560 con 0x7f26440d25b0 2023-11-28T13:00:53.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f2648a1b700 1 --2- 172.21.15.82:0/298458169 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26440d25b0 0x7f264406ba30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2640009880 tx=0x7f2640009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d430bfb54834b51c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:53.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f263bfff700 1 -- 172.21.15.82:0/298458169 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640011830 con 0x7f26440d25b0 2023-11-28T13:00:53.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f263bfff700 1 -- 172.21.15.82:0/298458169 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2640011990 con 0x7f26440d25b0 2023-11-28T13:00:53.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f263bfff700 1 -- 172.21.15.82:0/298458169 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640011d00 con 0x7f26440d25b0 2023-11-28T13:00:53.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f264a21e700 1 -- 172.21.15.82:0/298458169 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26440d25b0 msgr2=0x7f264406ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f264a21e700 1 --2- 172.21.15.82:0/298458169 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26440d25b0 0x7f264406ba30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2640009880 tx=0x7f2640009b90 comp rx=0 tx=0).stop 2023-11-28T13:00:53.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f264a21e700 1 -- 172.21.15.82:0/298458169 shutdown_connections 2023-11-28T13:00:53.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f264a21e700 1 --2- 172.21.15.82:0/298458169 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26440d25b0 0x7f264406ba30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f264a21e700 1 --2- 172.21.15.82:0/298458169 >> v2:172.21.15.114:3300/0 conn(0x7f26440b1d10 0x7f26440cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f264a21e700 1 -- 172.21.15.82:0/298458169 >> 172.21.15.82:0/298458169 conn(0x7f26440b52a0 msgr2=0x7f26440d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:53.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f264a21e700 1 -- 172.21.15.82:0/298458169 shutdown_connections 2023-11-28T13:00:53.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f264a21e700 1 -- 172.21.15.82:0/298458169 wait complete. 2023-11-28T13:00:53.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f264a21e700 1 Processor -- start 2023-11-28T13:00:53.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.027+0000 7f264a21e700 1 -- start start 2023-11-28T13:00:53.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f264a21e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26440b1d10 0x7f26440a9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f264a21e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26440b5940 0x7f264414ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f264a21e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26440d25b0 0x7f26440cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f264a21e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264415beb0 con 0x7f26440b5940 2023-11-28T13:00:53.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f264a21e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264415c100 con 0x7f26440d25b0 2023-11-28T13:00:53.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f264a21e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264415c3e0 con 0x7f26440b1d10 2023-11-28T13:00:53.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f2648a1b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26440b5940 0x7f264414ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f2648a1b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26440b5940 0x7f264414ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44304/0 (socket says 172.21.15.82:44304) 2023-11-28T13:00:53.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f2648a1b700 1 -- 172.21.15.82:0/2514613314 learned_addr learned my addr 172.21.15.82:0/2514613314 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:53.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f264921c700 1 --2- 172.21.15.82:0/2514613314 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26440b1d10 0x7f26440a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f2649a1d700 1 --2- 172.21.15.82:0/2514613314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26440d25b0 0x7f26440cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f2648a1b700 1 -- 172.21.15.82:0/2514613314 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26440b1d10 msgr2=0x7f26440a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f2648a1b700 1 --2- 172.21.15.82:0/2514613314 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26440b1d10 0x7f26440a9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f2648a1b700 1 -- 172.21.15.82:0/2514613314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26440d25b0 msgr2=0x7f26440cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f2648a1b700 1 --2- 172.21.15.82:0/2514613314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26440d25b0 0x7f26440cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f2648a1b700 1 -- 172.21.15.82:0/2514613314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26400094b0 con 0x7f26440b5940 2023-11-28T13:00:53.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f2648a1b700 1 --2- 172.21.15.82:0/2514613314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26440b5940 0x7f264414ed60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2640014040 tx=0x7f2640004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:53.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f2639ffb700 1 -- 172.21.15.82:0/2514613314 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640004590 con 0x7f26440b5940 2023-11-28T13:00:53.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f2639ffb700 1 -- 172.21.15.82:0/2514613314 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264001e070 con 0x7f26440b5940 2023-11-28T13:00:53.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f264a21e700 1 -- 172.21.15.82:0/2514613314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26440d1050 con 0x7f26440b5940 2023-11-28T13:00:53.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f2639ffb700 1 -- 172.21.15.82:0/2514613314 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640003900 con 0x7f26440b5940 2023-11-28T13:00:53.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f264a21e700 1 -- 172.21.15.82:0/2514613314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26440b20e0 con 0x7f26440b5940 2023-11-28T13:00:53.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.031+0000 7f264a21e700 1 -- 172.21.15.82:0/2514613314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26440d11e0 con 0x7f26440b5940 2023-11-28T13:00:53.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.035+0000 7f2639ffb700 1 -- 172.21.15.82:0/2514613314 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f264000f050 con 0x7f26440b5940 2023-11-28T13:00:53.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.035+0000 7f2639ffb700 1 --2- 172.21.15.82:0/2514613314 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2628064ee0 0x7f2628067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.035+0000 7f2639ffb700 1 -- 172.21.15.82:0/2514613314 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2640020070 con 0x7f26440b5940 2023-11-28T13:00:53.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.035+0000 7f264921c700 1 --2- 172.21.15.82:0/2514613314 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2628064ee0 0x7f2628067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.035+0000 7f264921c700 1 --2- 172.21.15.82:0/2514613314 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2628064ee0 0x7f2628067390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2634009bf0 tx=0x7f2634009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:53.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.039+0000 7f2639ffb700 1 -- 172.21.15.82:0/2514613314 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2640051400 con 0x7f26440b5940 2023-11-28T13:00:53.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.199+0000 7f264a21e700 1 -- 172.21.15.82:0/2514613314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2644065fc0 con 0x7f26440b5940 2023-11-28T13:00:53.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.199+0000 7f2639ffb700 1 -- 172.21.15.82:0/2514613314 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2640054a20 con 0x7f26440b5940 2023-11-28T13:00:53.206 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-11-28T13:00:53.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.203+0000 7f264a21e700 1 -- 172.21.15.82:0/2514613314 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2628064ee0 msgr2=0x7f2628067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.203+0000 7f264a21e700 1 --2- 172.21.15.82:0/2514613314 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2628064ee0 0x7f2628067390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2634009bf0 tx=0x7f2634009240 comp rx=0 tx=0).stop 2023-11-28T13:00:53.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.203+0000 7f264a21e700 1 -- 172.21.15.82:0/2514613314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26440b5940 msgr2=0x7f264414ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.203+0000 7f264a21e700 1 --2- 172.21.15.82:0/2514613314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26440b5940 0x7f264414ed60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2640014040 tx=0x7f2640004770 comp rx=0 tx=0).stop 2023-11-28T13:00:53.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.203+0000 7f264a21e700 1 -- 172.21.15.82:0/2514613314 shutdown_connections 2023-11-28T13:00:53.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.203+0000 7f264a21e700 1 --2- 172.21.15.82:0/2514613314 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2628064ee0 0x7f2628067390 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.203+0000 7f264a21e700 1 --2- 172.21.15.82:0/2514613314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26440d25b0 0x7f26440cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.203+0000 7f264a21e700 1 --2- 172.21.15.82:0/2514613314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26440b5940 0x7f264414ed60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.203+0000 7f264a21e700 1 --2- 172.21.15.82:0/2514613314 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26440b1d10 0x7f26440a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.203+0000 7f264a21e700 1 -- 172.21.15.82:0/2514613314 >> 172.21.15.82:0/2514613314 conn(0x7f26440b52a0 msgr2=0x7f26440d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:53.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.203+0000 7f264a21e700 1 -- 172.21.15.82:0/2514613314 shutdown_connections 2023-11-28T13:00:53.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.203+0000 7f264a21e700 1 -- 172.21.15.82:0/2514613314 wait complete. 2023-11-28T13:00:53.220 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T13:00:53.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f567d86e700 1 Processor -- start 2023-11-28T13:00:53.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f567d86e700 1 -- start start 2023-11-28T13:00:53.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f567d86e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f567806c140 0x7f56780cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f567d86e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5678069bc0 con 0x7f56780b1d10 2023-11-28T13:00:53.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f567d86e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56780d1480 con 0x7f56780d25b0 2023-11-28T13:00:53.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f567d86e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56780cd280 con 0x7f567806c140 2023-11-28T13:00:53.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f567c86c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f56780b1d10 0x7f567806ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53268/0 (socket says 172.21.15.82:53268) 2023-11-28T13:00:53.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f567c86c700 1 -- 172.21.15.82:0/2987908756 learned_addr learned my addr 172.21.15.82:0/2987908756 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:53.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f5677fff700 1 --2- 172.21.15.82:0/2987908756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f567806c140 0x7f56780cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f56777fe700 1 -- 172.21.15.82:0/2987908756 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876065003 0 0) 0x7f5678069bc0 con 0x7f56780b1d10 2023-11-28T13:00:53.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f56777fe700 1 -- 172.21.15.82:0/2987908756 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56680035d0 con 0x7f56780b1d10 2023-11-28T13:00:53.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f56777fe700 1 -- 172.21.15.82:0/2987908756 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2090618088 0 0) 0x7f56680035d0 con 0x7f56780b1d10 2023-11-28T13:00:53.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f56777fe700 1 -- 172.21.15.82:0/2987908756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f567806c140 msgr2=0x7f56780cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:53.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f56777fe700 1 --2- 172.21.15.82:0/2987908756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f567806c140 0x7f56780cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f56777fe700 1 -- 172.21.15.82:0/2987908756 >> v1:172.21.15.114:6789/0 conn(0x7f56780d25b0 legacy=0x7f567806a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f56777fe700 1 -- 172.21.15.82:0/2987908756 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56780cd560 con 0x7f56780b1d10 2023-11-28T13:00:53.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f56777fe700 1 -- 172.21.15.82:0/2987908756 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f566c001670 con 0x7f56780b1d10 2023-11-28T13:00:53.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f56777fe700 1 -- 172.21.15.82:0/2987908756 >> v1:172.21.15.82:6789/0 conn(0x7f56780b1d10 legacy=0x7f567806ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f56777fe700 1 --2- 172.21.15.82:0/2987908756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5668003a50 0x7f5668003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f56777fe700 1 --2- 172.21.15.82:0/2987908756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5668004870 0x7f5668004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f56777fe700 1 --2- 172.21.15.82:0/2987908756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f567806c140 0x7f5668005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f56777fe700 1 -- 172.21.15.82:0/2987908756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56780cd280 con 0x7f5668003a50 2023-11-28T13:00:53.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f56777fe700 1 -- 172.21.15.82:0/2987908756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566800bae0 con 0x7f5668004870 2023-11-28T13:00:53.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f56777fe700 1 -- 172.21.15.82:0/2987908756 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566800bc70 con 0x7f567806c140 2023-11-28T13:00:53.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f567c86c700 1 --2- 172.21.15.82:0/2987908756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5668003a50 0x7f5668003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f5677fff700 1 --2- 172.21.15.82:0/2987908756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5668004870 0x7f5668004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f567d06d700 1 --2- 172.21.15.82:0/2987908756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f567806c140 0x7f5668005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f567c86c700 1 -- 172.21.15.82:0/2987908756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f567806c140 msgr2=0x7f5668005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:53.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f567c86c700 1 --2- 172.21.15.82:0/2987908756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f567806c140 0x7f5668005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f567c86c700 1 -- 172.21.15.82:0/2987908756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5668004870 msgr2=0x7f5668004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:53.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f567c86c700 1 --2- 172.21.15.82:0/2987908756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5668004870 0x7f5668004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f567c86c700 1 -- 172.21.15.82:0/2987908756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56680035d0 con 0x7f5668003a50 2023-11-28T13:00:53.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f567c86c700 1 --2- 172.21.15.82:0/2987908756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5668003a50 0x7f5668003e60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f566c00c320 tx=0x7f56680058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231c1c6608a90ecc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:53.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f56777fe700 1 -- 172.21.15.82:0/2987908756 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c007c30 con 0x7f5668003a50 2023-11-28T13:00:53.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f56777fe700 1 -- 172.21.15.82:0/2987908756 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c00ce80 con 0x7f5668003a50 2023-11-28T13:00:53.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.331+0000 7f56777fe700 1 -- 172.21.15.82:0/2987908756 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c005bc0 con 0x7f5668003a50 2023-11-28T13:00:53.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.335+0000 7f567d86e700 1 -- 172.21.15.82:0/2987908756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5668003a50 msgr2=0x7f5668003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.335+0000 7f567d86e700 1 --2- 172.21.15.82:0/2987908756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5668003a50 0x7f5668003e60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f566c00c320 tx=0x7f56680058a0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.335+0000 7f567d06d700 1 -- 172.21.15.82:0/2987908756 reap_dead start 2023-11-28T13:00:53.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.335+0000 7f567d86e700 1 -- 172.21.15.82:0/2987908756 shutdown_connections 2023-11-28T13:00:53.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.335+0000 7f567d86e700 1 -- 172.21.15.82:0/2987908756 >> 172.21.15.82:0/2987908756 conn(0x7f56780b52a0 msgr2=0x7f56780d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:53.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.335+0000 7f567d86e700 1 -- 172.21.15.82:0/2987908756 shutdown_connections 2023-11-28T13:00:53.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.335+0000 7f567d86e700 1 -- 172.21.15.82:0/2987908756 wait complete. 2023-11-28T13:00:53.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.335+0000 7f567d86e700 1 Processor -- start 2023-11-28T13:00:53.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.335+0000 7f567d86e700 1 -- start start 2023-11-28T13:00:53.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f567d86e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5668003a50 0x7f567815c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f567d86e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56781542b0 0x7f567815e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f567d86e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f567815b9b0 0x7f567815e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f567d86e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5678157d30 con 0x7f56781542b0 2023-11-28T13:00:53.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f567d86e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56780cb710 con 0x7f5668003a50 2023-11-28T13:00:53.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f567d86e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567815eb20 con 0x7f567815b9b0 2023-11-28T13:00:53.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f5677fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56781542b0 0x7f567815e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f567c86c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5668003a50 0x7f567815c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f5677fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56781542b0 0x7f567815e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44320/0 (socket says 172.21.15.82:44320) 2023-11-28T13:00:53.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f5677fff700 1 -- 172.21.15.82:0/1250356550 learned_addr learned my addr 172.21.15.82:0/1250356550 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:53.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f567d06d700 1 --2- 172.21.15.82:0/1250356550 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f567815b9b0 0x7f567815e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f5677fff700 1 -- 172.21.15.82:0/1250356550 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f567815b9b0 msgr2=0x7f567815e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f5677fff700 1 --2- 172.21.15.82:0/1250356550 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f567815b9b0 0x7f567815e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f5677fff700 1 -- 172.21.15.82:0/1250356550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5668003a50 msgr2=0x7f567815c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f5677fff700 1 --2- 172.21.15.82:0/1250356550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5668003a50 0x7f567815c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f5677fff700 1 -- 172.21.15.82:0/1250356550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56780d1050 con 0x7f56781542b0 2023-11-28T13:00:53.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f567c86c700 1 --2- 172.21.15.82:0/1250356550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5668003a50 0x7f567815c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:53.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f5677fff700 1 --2- 172.21.15.82:0/1250356550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56781542b0 0x7f567815e0a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f56640119d0 tx=0x7f5664011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:53.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f56757fa700 1 -- 172.21.15.82:0/1250356550 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5664011e70 con 0x7f56781542b0 2023-11-28T13:00:53.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f56757fa700 1 -- 172.21.15.82:0/1250356550 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5664004240 con 0x7f56781542b0 2023-11-28T13:00:53.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f567d86e700 1 -- 172.21.15.82:0/1250356550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56780b20e0 con 0x7f56781542b0 2023-11-28T13:00:53.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f56757fa700 1 -- 172.21.15.82:0/1250356550 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56640045d0 con 0x7f56781542b0 2023-11-28T13:00:53.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.339+0000 7f567d86e700 1 -- 172.21.15.82:0/1250356550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56780d11e0 con 0x7f56781542b0 2023-11-28T13:00:53.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.343+0000 7f567d86e700 1 -- 172.21.15.82:0/1250356550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5678065fc0 con 0x7f56781542b0 2023-11-28T13:00:53.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.343+0000 7f56757fa700 1 -- 172.21.15.82:0/1250356550 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f566401b030 con 0x7f56781542b0 2023-11-28T13:00:53.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.343+0000 7f56757fa700 1 --2- 172.21.15.82:0/1250356550 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f565c064ee0 0x7f565c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.343+0000 7f567c86c700 1 --2- 172.21.15.82:0/1250356550 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f565c064ee0 0x7f565c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.343+0000 7f56757fa700 1 -- 172.21.15.82:0/1250356550 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5664082420 con 0x7f56781542b0 2023-11-28T13:00:53.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.343+0000 7f567c86c700 1 --2- 172.21.15.82:0/1250356550 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f565c064ee0 0x7f565c067390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f566c001930 tx=0x7f566c007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:53.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.347+0000 7f56757fa700 1 -- 172.21.15.82:0/1250356550 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f56640505c0 con 0x7f56781542b0 2023-11-28T13:00:53.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.511+0000 7f567d86e700 1 -- 172.21.15.82:0/1250356550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5678159ef0 con 0x7f56781542b0 2023-11-28T13:00:53.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.511+0000 7f56757fa700 1 -- 172.21.15.82:0/1250356550 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56640190a0 con 0x7f56781542b0 2023-11-28T13:00:53.515 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-11-28T13:00:53.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.511+0000 7f567d86e700 1 -- 172.21.15.82:0/1250356550 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f565c064ee0 msgr2=0x7f565c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.511+0000 7f567d86e700 1 --2- 172.21.15.82:0/1250356550 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f565c064ee0 0x7f565c067390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f566c001930 tx=0x7f566c007000 comp rx=0 tx=0).stop 2023-11-28T13:00:53.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.511+0000 7f567d86e700 1 -- 172.21.15.82:0/1250356550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56781542b0 msgr2=0x7f567815e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.511+0000 7f567d86e700 1 --2- 172.21.15.82:0/1250356550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56781542b0 0x7f567815e0a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f56640119d0 tx=0x7f5664011ce0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.511+0000 7f567d86e700 1 -- 172.21.15.82:0/1250356550 shutdown_connections 2023-11-28T13:00:53.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.511+0000 7f567d86e700 1 --2- 172.21.15.82:0/1250356550 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f565c064ee0 0x7f565c067390 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.511+0000 7f567d86e700 1 --2- 172.21.15.82:0/1250356550 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f567815b9b0 0x7f567815e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.511+0000 7f567d86e700 1 --2- 172.21.15.82:0/1250356550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56781542b0 0x7f567815e0a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.511+0000 7f567d86e700 1 --2- 172.21.15.82:0/1250356550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5668003a50 0x7f567815c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.511+0000 7f567d86e700 1 -- 172.21.15.82:0/1250356550 >> 172.21.15.82:0/1250356550 conn(0x7f56780b52a0 msgr2=0x7f567815f080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:53.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.511+0000 7f567d86e700 1 -- 172.21.15.82:0/1250356550 shutdown_connections 2023-11-28T13:00:53.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.511+0000 7f567d86e700 1 -- 172.21.15.82:0/1250356550 wait complete. 2023-11-28T13:00:53.530 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:00:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.631+0000 7fd3833f7700 1 Processor -- start 2023-11-28T13:00:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.631+0000 7fd3833f7700 1 -- start start 2023-11-28T13:00:53.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.631+0000 7fd3833f7700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd37c0b3910 0x7fd37c06b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.631+0000 7fd3833f7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd37c06c910 0x7fd37c06d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.631+0000 7fd3833f7700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd37c070070 0x7fd37c0704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.631+0000 7fd3833f7700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37c06c480 con 0x7fd37c06c910 2023-11-28T13:00:53.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.631+0000 7fd3833f7700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37c0709f0 con 0x7fd37c0b3910 2023-11-28T13:00:53.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.631+0000 7fd3833f7700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c06dbe0 con 0x7fd37c070070 2023-11-28T13:00:53.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.631+0000 7fd381bf4700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd37c06c910 0x7fd37c06d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.631+0000 7fd381bf4700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd37c06c910 0x7fd37c06d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44324/0 (socket says 172.21.15.82:44324) 2023-11-28T13:00:53.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.631+0000 7fd381bf4700 1 -- 172.21.15.82:0/3626832995 learned_addr learned my addr 172.21.15.82:0/3626832995 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:53.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.631+0000 7fd3823f5700 1 --2- 172.21.15.82:0/3626832995 >> v2:172.21.15.114:3300/0 conn(0x7fd37c0b3910 0x7fd37c06b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.631+0000 7fd382bf6700 1 --2- 172.21.15.82:0/3626832995 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd37c070070 0x7fd37c0704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.635+0000 7fd381bf4700 1 -- 172.21.15.82:0/3626832995 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd37c070070 msgr2=0x7fd37c0704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:53.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.635+0000 7fd381bf4700 1 --2- 172.21.15.82:0/3626832995 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd37c070070 0x7fd37c0704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.635+0000 7fd381bf4700 1 -- 172.21.15.82:0/3626832995 >> v2:172.21.15.114:3300/0 conn(0x7fd37c0b3910 msgr2=0x7fd37c06b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:53.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.635+0000 7fd381bf4700 1 --2- 172.21.15.82:0/3626832995 >> v2:172.21.15.114:3300/0 conn(0x7fd37c0b3910 0x7fd37c06b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.635+0000 7fd381bf4700 1 -- 172.21.15.82:0/3626832995 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c06dec0 con 0x7fd37c06c910 2023-11-28T13:00:53.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.635+0000 7fd381bf4700 1 --2- 172.21.15.82:0/3626832995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd37c06c910 0x7fd37c06d320 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0cf630 tx=0x7fd36c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59edf85cc51fcd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:53.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.635+0000 7fd3813f3700 1 -- 172.21.15.82:0/3626832995 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c011830 con 0x7fd37c06c910 2023-11-28T13:00:53.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.635+0000 7fd3813f3700 1 -- 172.21.15.82:0/3626832995 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c011990 con 0x7fd37c06c910 2023-11-28T13:00:53.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.635+0000 7fd3813f3700 1 -- 172.21.15.82:0/3626832995 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c011d20 con 0x7fd37c06c910 2023-11-28T13:00:53.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.635+0000 7fd3833f7700 1 -- 172.21.15.82:0/3626832995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd37c06c910 msgr2=0x7fd37c06d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.635+0000 7fd3833f7700 1 --2- 172.21.15.82:0/3626832995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd37c06c910 0x7fd37c06d320 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0cf630 tx=0x7fd36c009bf0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.635+0000 7fd3833f7700 1 -- 172.21.15.82:0/3626832995 shutdown_connections 2023-11-28T13:00:53.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.635+0000 7fd3833f7700 1 --2- 172.21.15.82:0/3626832995 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd37c070070 0x7fd37c0704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.635+0000 7fd3833f7700 1 --2- 172.21.15.82:0/3626832995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd37c06c910 0x7fd37c06d320 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.635+0000 7fd3833f7700 1 --2- 172.21.15.82:0/3626832995 >> v2:172.21.15.114:3300/0 conn(0x7fd37c0b3910 0x7fd37c06b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.635+0000 7fd3833f7700 1 -- 172.21.15.82:0/3626832995 >> 172.21.15.82:0/3626832995 conn(0x7fd37c0ce600 msgr2=0x7fd37c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:53.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.635+0000 7fd3833f7700 1 -- 172.21.15.82:0/3626832995 shutdown_connections 2023-11-28T13:00:53.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.635+0000 7fd3833f7700 1 -- 172.21.15.82:0/3626832995 wait complete. 2023-11-28T13:00:53.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.635+0000 7fd3833f7700 1 Processor -- start 2023-11-28T13:00:53.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.635+0000 7fd3833f7700 1 -- start start 2023-11-28T13:00:53.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd3833f7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd37c06c910 0x7fd37c1f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd3833f7700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd37c070070 0x7fd37c158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd3833f7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd37c0b3910 0x7fd37c0ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd3833f7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0afb70 con 0x7fd37c0b3910 2023-11-28T13:00:53.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd3833f7700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0afdf0 con 0x7fd37c06c910 2023-11-28T13:00:53.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd3833f7700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0ae5a0 con 0x7fd37c070070 2023-11-28T13:00:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd382bf6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd37c0b3910 0x7fd37c0ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd382bf6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd37c0b3910 0x7fd37c0ae060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44330/0 (socket says 172.21.15.82:44330) 2023-11-28T13:00:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd382bf6700 1 -- 172.21.15.82:0/860008152 learned_addr learned my addr 172.21.15.82:0/860008152 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd3823f5700 1 --2- 172.21.15.82:0/860008152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd37c06c910 0x7fd37c1f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd381bf4700 1 --2- 172.21.15.82:0/860008152 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd37c070070 0x7fd37c158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd382bf6700 1 -- 172.21.15.82:0/860008152 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd37c070070 msgr2=0x7fd37c158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd382bf6700 1 --2- 172.21.15.82:0/860008152 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd37c070070 0x7fd37c158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd382bf6700 1 -- 172.21.15.82:0/860008152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd37c06c910 msgr2=0x7fd37c1f1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd382bf6700 1 --2- 172.21.15.82:0/860008152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd37c06c910 0x7fd37c1f1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd382bf6700 1 -- 172.21.15.82:0/860008152 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c009570 con 0x7fd37c0b3910 2023-11-28T13:00:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd381bf4700 1 --2- 172.21.15.82:0/860008152 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd37c070070 0x7fd37c158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd382bf6700 1 --2- 172.21.15.82:0/860008152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd37c0b3910 0x7fd37c0ae060 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd37400efc0 tx=0x7fd37400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:53.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd372ffd700 1 -- 172.21.15.82:0/860008152 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd374009ea0 con 0x7fd37c0b3910 2023-11-28T13:00:53.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd372ffd700 1 -- 172.21.15.82:0/860008152 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37400f040 con 0x7fd37c0b3910 2023-11-28T13:00:53.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd3833f7700 1 -- 172.21.15.82:0/860008152 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37c0c8f80 con 0x7fd37c0b3910 2023-11-28T13:00:53.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd372ffd700 1 -- 172.21.15.82:0/860008152 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd374014480 con 0x7fd37c0b3910 2023-11-28T13:00:53.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.639+0000 7fd3833f7700 1 -- 172.21.15.82:0/860008152 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37c06c110 con 0x7fd37c0b3910 2023-11-28T13:00:53.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.643+0000 7fd3833f7700 1 -- 172.21.15.82:0/860008152 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37c06d860 con 0x7fd37c0b3910 2023-11-28T13:00:53.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.643+0000 7fd372ffd700 1 -- 172.21.15.82:0/860008152 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd3740145e0 con 0x7fd37c0b3910 2023-11-28T13:00:53.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.643+0000 7fd372ffd700 1 --2- 172.21.15.82:0/860008152 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd360064ee0 0x7fd360067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.643+0000 7fd372ffd700 1 -- 172.21.15.82:0/860008152 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd374082990 con 0x7fd37c0b3910 2023-11-28T13:00:53.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.643+0000 7fd3823f5700 1 --2- 172.21.15.82:0/860008152 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd360064ee0 0x7fd360067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.643+0000 7fd3823f5700 1 --2- 172.21.15.82:0/860008152 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd360064ee0 0x7fd360067390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0707c0 tx=0x7fd378009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:53.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.651+0000 7fd372ffd700 1 -- 172.21.15.82:0/860008152 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd374050a40 con 0x7fd37c0b3910 2023-11-28T13:00:53.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.811+0000 7fd3833f7700 1 -- 172.21.15.82:0/860008152 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd37c0aff60 con 0x7fd37c0b3910 2023-11-28T13:00:53.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.815+0000 7fd372ffd700 1 -- 172.21.15.82:0/860008152 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17811 (secure 0 0 0) 0x7fd37c0aff60 con 0x7fd37c0b3910 2023-11-28T13:00:53.821 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:53.821 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:00:26.981345+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:00:24.360641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T13:00:24.960863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:00:53.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.819+0000 7fd3833f7700 1 -- 172.21.15.82:0/860008152 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd360064ee0 msgr2=0x7fd360067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.819+0000 7fd3833f7700 1 --2- 172.21.15.82:0/860008152 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd360064ee0 0x7fd360067390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0707c0 tx=0x7fd378009240 comp rx=0 tx=0).stop 2023-11-28T13:00:53.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.819+0000 7fd3833f7700 1 -- 172.21.15.82:0/860008152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd37c0b3910 msgr2=0x7fd37c0ae060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.819+0000 7fd3833f7700 1 --2- 172.21.15.82:0/860008152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd37c0b3910 0x7fd37c0ae060 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd37400efc0 tx=0x7fd37400c3a0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.819+0000 7fd3833f7700 1 -- 172.21.15.82:0/860008152 shutdown_connections 2023-11-28T13:00:53.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.819+0000 7fd3833f7700 1 --2- 172.21.15.82:0/860008152 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd360064ee0 0x7fd360067390 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.819+0000 7fd3833f7700 1 --2- 172.21.15.82:0/860008152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd37c0b3910 0x7fd37c0ae060 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.819+0000 7fd3833f7700 1 --2- 172.21.15.82:0/860008152 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd37c070070 0x7fd37c158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.819+0000 7fd3833f7700 1 --2- 172.21.15.82:0/860008152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd37c06c910 0x7fd37c1f1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.819+0000 7fd3833f7700 1 -- 172.21.15.82:0/860008152 >> 172.21.15.82:0/860008152 conn(0x7fd37c0ce600 msgr2=0x7fd37c0cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:53.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.819+0000 7fd3833f7700 1 -- 172.21.15.82:0/860008152 shutdown_connections 2023-11-28T13:00:53.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.819+0000 7fd3833f7700 1 -- 172.21.15.82:0/860008152 wait complete. 2023-11-28T13:00:53.836 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T13:00:24.360641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T13:00:24.960863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:00:53.836 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:00:53.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.955+0000 7f1f572b5700 1 Processor -- start 2023-11-28T13:00:53.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.955+0000 7f1f572b5700 1 -- start start 2023-11-28T13:00:53.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.955+0000 7f1f572b5700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f500d25b0 0x7f1f500cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.955+0000 7f1f572b5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f50069bc0 con 0x7f1f5006c140 2023-11-28T13:00:53.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.955+0000 7f1f572b5700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f500d1480 con 0x7f1f500b1d10 2023-11-28T13:00:53.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.955+0000 7f1f572b5700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500cd280 con 0x7f1f500d25b0 2023-11-28T13:00:53.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.955+0000 7f1f55ab2700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1f5006c140 0x7f1f5006a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53282/0 (socket says 172.21.15.82:53282) 2023-11-28T13:00:53.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.955+0000 7f1f55ab2700 1 -- 172.21.15.82:0/169119534 learned_addr learned my addr 172.21.15.82:0/169119534 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:53.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.955+0000 7f1f56ab4700 1 --2- 172.21.15.82:0/169119534 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f500d25b0 0x7f1f500cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.955+0000 7f1f552b1700 1 -- 172.21.15.82:0/169119534 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206282841 0 0) 0x7f1f50069bc0 con 0x7f1f5006c140 2023-11-28T13:00:53.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.955+0000 7f1f552b1700 1 -- 172.21.15.82:0/169119534 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f3c0035d0 con 0x7f1f5006c140 2023-11-28T13:00:53.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.955+0000 7f1f56ab4700 1 -- 172.21.15.82:0/169119534 >> v1:172.21.15.114:6789/0 conn(0x7f1f500b1d10 legacy=0x7f1f5006ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.955+0000 7f1f552b1700 1 -- 172.21.15.82:0/169119534 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265415111 0 0) 0x7f1f500d1480 con 0x7f1f500b1d10 2023-11-28T13:00:53.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.955+0000 7f1f56ab4700 1 -- 172.21.15.82:0/169119534 >> v1:172.21.15.82:6789/0 conn(0x7f1f5006c140 legacy=0x7f1f5006a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.955+0000 7f1f56ab4700 1 -- 172.21.15.82:0/169119534 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f500cd560 con 0x7f1f500d25b0 2023-11-28T13:00:53.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.955+0000 7f1f56ab4700 1 --2- 172.21.15.82:0/169119534 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f500d25b0 0x7f1f500cec20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009dc0 tx=0x7f1f4800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76920d90832a9f23 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:53.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.955+0000 7f1f552b1700 1 -- 172.21.15.82:0/169119534 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4800e070 con 0x7f1f500d25b0 2023-11-28T13:00:53.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.959+0000 7f1f552b1700 1 -- 172.21.15.82:0/169119534 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f48003a40 con 0x7f1f500d25b0 2023-11-28T13:00:53.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.959+0000 7f1f552b1700 1 -- 172.21.15.82:0/169119534 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f48003db0 con 0x7f1f500d25b0 2023-11-28T13:00:53.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.959+0000 7f1f572b5700 1 -- 172.21.15.82:0/169119534 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f500d25b0 msgr2=0x7f1f500cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.959+0000 7f1f572b5700 1 --2- 172.21.15.82:0/169119534 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f500d25b0 0x7f1f500cec20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009dc0 tx=0x7f1f4800b330 comp rx=0 tx=0).stop 2023-11-28T13:00:53.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.959+0000 7f1f572b5700 1 -- 172.21.15.82:0/169119534 shutdown_connections 2023-11-28T13:00:53.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.959+0000 7f1f572b5700 1 --2- 172.21.15.82:0/169119534 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f500d25b0 0x7f1f500cec20 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.959+0000 7f1f572b5700 1 -- 172.21.15.82:0/169119534 >> 172.21.15.82:0/169119534 conn(0x7f1f500b52a0 msgr2=0x7f1f500d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:53.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.959+0000 7f1f572b5700 1 -- 172.21.15.82:0/169119534 shutdown_connections 2023-11-28T13:00:53.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.959+0000 7f1f572b5700 1 -- 172.21.15.82:0/169119534 wait complete. 2023-11-28T13:00:53.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.959+0000 7f1f572b5700 1 Processor -- start 2023-11-28T13:00:53.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.959+0000 7f1f572b5700 1 -- start start 2023-11-28T13:00:53.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f572b5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5006c140 0x7f1f500b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f572b5700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f500b1d10 0x7f1f500a9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f572b5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f500d25b0 0x7f1f5015eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f572b5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5015e680 con 0x7f1f5006c140 2023-11-28T13:00:53.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f572b5700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5015da00 con 0x7f1f500d25b0 2023-11-28T13:00:53.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f572b5700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5015dce0 con 0x7f1f500b1d10 2023-11-28T13:00:53.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f562b3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5006c140 0x7f1f500b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f562b3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5006c140 0x7f1f500b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44346/0 (socket says 172.21.15.82:44346) 2023-11-28T13:00:53.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f562b3700 1 -- 172.21.15.82:0/3148926647 learned_addr learned my addr 172.21.15.82:0/3148926647 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:53.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f55ab2700 1 --2- 172.21.15.82:0/3148926647 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f500b1d10 0x7f1f500a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f56ab4700 1 --2- 172.21.15.82:0/3148926647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f500d25b0 0x7f1f5015eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f562b3700 1 -- 172.21.15.82:0/3148926647 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f500b1d10 msgr2=0x7f1f500a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f562b3700 1 --2- 172.21.15.82:0/3148926647 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f500b1d10 0x7f1f500a9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f562b3700 1 -- 172.21.15.82:0/3148926647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f500d25b0 msgr2=0x7f1f5015eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:53.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f562b3700 1 --2- 172.21.15.82:0/3148926647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f500d25b0 0x7f1f5015eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:53.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f562b3700 1 -- 172.21.15.82:0/3148926647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f48009a70 con 0x7f1f5006c140 2023-11-28T13:00:53.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f562b3700 1 --2- 172.21.15.82:0/3148926647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5006c140 0x7f1f500b0a00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400c520 tx=0x7f1f4400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:53.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f42ffd700 1 -- 172.21.15.82:0/3148926647 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f440054e0 con 0x7f1f5006c140 2023-11-28T13:00:53.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f42ffd700 1 -- 172.21.15.82:0/3148926647 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f440036a0 con 0x7f1f5006c140 2023-11-28T13:00:53.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f572b5700 1 -- 172.21.15.82:0/3148926647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f500d1050 con 0x7f1f5006c140 2023-11-28T13:00:53.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f42ffd700 1 -- 172.21.15.82:0/3148926647 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f44003a10 con 0x7f1f5006c140 2023-11-28T13:00:53.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f572b5700 1 -- 172.21.15.82:0/3148926647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f500b20e0 con 0x7f1f5006c140 2023-11-28T13:00:53.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.963+0000 7f1f572b5700 1 -- 172.21.15.82:0/3148926647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f500d11e0 con 0x7f1f5006c140 2023-11-28T13:00:53.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.967+0000 7f1f42ffd700 1 -- 172.21.15.82:0/3148926647 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1f44019030 con 0x7f1f5006c140 2023-11-28T13:00:53.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.967+0000 7f1f42ffd700 1 --2- 172.21.15.82:0/3148926647 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1f34064ee0 0x7f1f34067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:53.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.967+0000 7f1f42ffd700 1 -- 172.21.15.82:0/3148926647 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1f44081170 con 0x7f1f5006c140 2023-11-28T13:00:53.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.967+0000 7f1f55ab2700 1 --2- 172.21.15.82:0/3148926647 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1f34064ee0 0x7f1f34067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:53.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.967+0000 7f1f55ab2700 1 --2- 172.21.15.82:0/3148926647 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1f34064ee0 0x7f1f34067390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1f500b30c0 tx=0x7f1f4c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:53.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:53.971+0000 7f1f42ffd700 1 -- 172.21.15.82:0/3148926647 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1f4404a400 con 0x7f1f5006c140 2023-11-28T13:00:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.131+0000 7f1f572b5700 1 -- 172.21.15.82:0/3148926647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f5015e8f0 con 0x7f1f5006c140 2023-11-28T13:00:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.135+0000 7f1f42ffd700 1 -- 172.21.15.82:0/3148926647 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f44017020 con 0x7f1f5006c140 2023-11-28T13:00:54.139 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:00:54.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.135+0000 7f1f572b5700 1 -- 172.21.15.82:0/3148926647 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1f34064ee0 msgr2=0x7f1f34067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:54.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.135+0000 7f1f572b5700 1 --2- 172.21.15.82:0/3148926647 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1f34064ee0 0x7f1f34067390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1f500b30c0 tx=0x7f1f4c009040 comp rx=0 tx=0).stop 2023-11-28T13:00:54.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.135+0000 7f1f572b5700 1 -- 172.21.15.82:0/3148926647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5006c140 msgr2=0x7f1f500b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:54.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.135+0000 7f1f572b5700 1 --2- 172.21.15.82:0/3148926647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5006c140 0x7f1f500b0a00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400c520 tx=0x7f1f4400c8e0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.135+0000 7f1f572b5700 1 -- 172.21.15.82:0/3148926647 shutdown_connections 2023-11-28T13:00:54.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.135+0000 7f1f572b5700 1 --2- 172.21.15.82:0/3148926647 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1f34064ee0 0x7f1f34067390 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.135+0000 7f1f572b5700 1 --2- 172.21.15.82:0/3148926647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f500d25b0 0x7f1f5015eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.135+0000 7f1f572b5700 1 --2- 172.21.15.82:0/3148926647 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f500b1d10 0x7f1f500a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.135+0000 7f1f572b5700 1 --2- 172.21.15.82:0/3148926647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5006c140 0x7f1f500b0a00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.135+0000 7f1f572b5700 1 -- 172.21.15.82:0/3148926647 >> 172.21.15.82:0/3148926647 conn(0x7f1f500b52a0 msgr2=0x7f1f5006ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:54.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.135+0000 7f1f572b5700 1 -- 172.21.15.82:0/3148926647 shutdown_connections 2023-11-28T13:00:54.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.135+0000 7f1f572b5700 1 -- 172.21.15.82:0/3148926647 wait complete. 2023-11-28T13:00:54.153 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:00:54.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.267+0000 7fd6f2b6b700 1 Processor -- start 2023-11-28T13:00:54.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.267+0000 7fd6f2b6b700 1 -- start start 2023-11-28T13:00:54.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f2b6b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6ec1578a0 0x7fd6ec0afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:54.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f2b6b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6ec15abf0 con 0x7fd6ec15a480 2023-11-28T13:00:54.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f2b6b700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6ec15aed0 con 0x7fd6ec06de30 2023-11-28T13:00:54.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f2b6b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec0b00b0 con 0x7fd6ec1578a0 2023-11-28T13:00:54.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f1368700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd6ec15a480 0x7fd6ec0ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53284/0 (socket says 172.21.15.82:53284) 2023-11-28T13:00:54.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f1368700 1 -- 172.21.15.82:0/1634733851 learned_addr learned my addr 172.21.15.82:0/1634733851 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:54.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f1b69700 1 --2- 172.21.15.82:0/1634733851 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6ec1578a0 0x7fd6ec0afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:54.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f0b67700 1 -- 172.21.15.82:0/1634733851 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1904798343 0 0) 0x7fd6ec15abf0 con 0x7fd6ec15a480 2023-11-28T13:00:54.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f0b67700 1 -- 172.21.15.82:0/1634733851 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6d80035d0 con 0x7fd6ec15a480 2023-11-28T13:00:54.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f0b67700 1 -- 172.21.15.82:0/1634733851 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602347540 0 0) 0x7fd6ec15aed0 con 0x7fd6ec06de30 2023-11-28T13:00:54.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f0b67700 1 -- 172.21.15.82:0/1634733851 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6ec15abf0 con 0x7fd6ec06de30 2023-11-28T13:00:54.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f0b67700 1 -- 172.21.15.82:0/1634733851 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2440698148 0 0) 0x7fd6d80035d0 con 0x7fd6ec15a480 2023-11-28T13:00:54.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f1b69700 1 -- 172.21.15.82:0/1634733851 >> v1:172.21.15.114:6789/0 conn(0x7fd6ec06de30 legacy=0x7fd6ec06fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:54.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f1b69700 1 -- 172.21.15.82:0/1634733851 >> v1:172.21.15.82:6789/0 conn(0x7fd6ec15a480 legacy=0x7fd6ec0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:54.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f1b69700 1 -- 172.21.15.82:0/1634733851 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec15b1b0 con 0x7fd6ec1578a0 2023-11-28T13:00:54.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f1b69700 1 --2- 172.21.15.82:0/1634733851 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6ec1578a0 0x7fd6ec0afb70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009880 tx=0x7fd6e8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb8d50c907340944 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:54.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f0b67700 1 -- 172.21.15.82:0/1634733851 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc001670 con 0x7fd6ec1578a0 2023-11-28T13:00:54.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f0b67700 1 -- 172.21.15.82:0/1634733851 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e8004030 con 0x7fd6ec1578a0 2023-11-28T13:00:54.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f0b67700 1 -- 172.21.15.82:0/1634733851 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e80043c0 con 0x7fd6ec1578a0 2023-11-28T13:00:54.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f2b6b700 1 -- 172.21.15.82:0/1634733851 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6ec1578a0 msgr2=0x7fd6ec0afb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:54.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f2b6b700 1 --2- 172.21.15.82:0/1634733851 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6ec1578a0 0x7fd6ec0afb70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009880 tx=0x7fd6e8009b90 comp rx=0 tx=0).stop 2023-11-28T13:00:54.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f2b6b700 1 -- 172.21.15.82:0/1634733851 shutdown_connections 2023-11-28T13:00:54.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f2b6b700 1 --2- 172.21.15.82:0/1634733851 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6ec1578a0 0x7fd6ec0afb70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f2b6b700 1 -- 172.21.15.82:0/1634733851 >> 172.21.15.82:0/1634733851 conn(0x7fd6ec0d07e0 msgr2=0x7fd6ec0d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:54.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.271+0000 7fd6f2b6b700 1 -- 172.21.15.82:0/1634733851 shutdown_connections 2023-11-28T13:00:54.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.275+0000 7fd6f2b6b700 1 -- 172.21.15.82:0/1634733851 wait complete. 2023-11-28T13:00:54.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.275+0000 7fd6f2b6b700 1 Processor -- start 2023-11-28T13:00:54.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.275+0000 7fd6f2b6b700 1 -- start start 2023-11-28T13:00:54.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6f2b6b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6ec06de30 0x7fd6ec158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:54.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6f2b6b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6ec1578a0 0x7fd6ec159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:54.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6f2b6b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6ec15a480 0x7fd6ec1f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:54.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6f2b6b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec0b36b0 con 0x7fd6ec06de30 2023-11-28T13:00:54.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6f2b6b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec0cae40 con 0x7fd6ec15a480 2023-11-28T13:00:54.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6f2b6b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec0b3950 con 0x7fd6ec1578a0 2023-11-28T13:00:54.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6f1b69700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6ec06de30 0x7fd6ec158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:54.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6f1b69700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6ec06de30 0x7fd6ec158f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44350/0 (socket says 172.21.15.82:44350) 2023-11-28T13:00:54.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6f1b69700 1 -- 172.21.15.82:0/3456391967 learned_addr learned my addr 172.21.15.82:0/3456391967 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:54.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6f236a700 1 --2- 172.21.15.82:0/3456391967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6ec15a480 0x7fd6ec1f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:54.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6f1368700 1 --2- 172.21.15.82:0/3456391967 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6ec1578a0 0x7fd6ec159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:54.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6f1b69700 1 -- 172.21.15.82:0/3456391967 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6ec1578a0 msgr2=0x7fd6ec159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:54.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6f1b69700 1 --2- 172.21.15.82:0/3456391967 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6ec1578a0 0x7fd6ec159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6f1b69700 1 -- 172.21.15.82:0/3456391967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6ec15a480 msgr2=0x7fd6ec1f42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:54.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6f1b69700 1 --2- 172.21.15.82:0/3456391967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6ec15a480 0x7fd6ec1f42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6f1b69700 1 -- 172.21.15.82:0/3456391967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e80094b0 con 0x7fd6ec06de30 2023-11-28T13:00:54.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6f236a700 1 --2- 172.21.15.82:0/3456391967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6ec15a480 0x7fd6ec1f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:54.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6f1b69700 1 --2- 172.21.15.82:0/3456391967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6ec06de30 0x7fd6ec158f30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80097d0 tx=0x7fd6e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:54.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6e27fc700 1 -- 172.21.15.82:0/3456391967 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8003d40 con 0x7fd6ec06de30 2023-11-28T13:00:54.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6e27fc700 1 -- 172.21.15.82:0/3456391967 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e8011630 con 0x7fd6ec06de30 2023-11-28T13:00:54.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6f2b6b700 1 -- 172.21.15.82:0/3456391967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ec15a8d0 con 0x7fd6ec06de30 2023-11-28T13:00:54.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6e27fc700 1 -- 172.21.15.82:0/3456391967 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8003ea0 con 0x7fd6ec06de30 2023-11-28T13:00:54.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.279+0000 7fd6f2b6b700 1 -- 172.21.15.82:0/3456391967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ec06d910 con 0x7fd6ec06de30 2023-11-28T13:00:54.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.283+0000 7fd6f2b6b700 1 -- 172.21.15.82:0/3456391967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ec0ceac0 con 0x7fd6ec06de30 2023-11-28T13:00:54.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.283+0000 7fd6e27fc700 1 -- 172.21.15.82:0/3456391967 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd6e802d070 con 0x7fd6ec06de30 2023-11-28T13:00:54.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.283+0000 7fd6e27fc700 1 --2- 172.21.15.82:0/3456391967 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd6d0064ee0 0x7fd6d0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:54.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.283+0000 7fd6e27fc700 1 -- 172.21.15.82:0/3456391967 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd6e8082c70 con 0x7fd6ec06de30 2023-11-28T13:00:54.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.283+0000 7fd6f1368700 1 --2- 172.21.15.82:0/3456391967 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd6d0064ee0 0x7fd6d0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:54.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.283+0000 7fd6f1368700 1 --2- 172.21.15.82:0/3456391967 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd6d0064ee0 0x7fd6d0067390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec159810 tx=0x7fd6dc001490 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:54.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.291+0000 7fd6e27fc700 1 -- 172.21.15.82:0/3456391967 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd6e8050ca0 con 0x7fd6ec06de30 2023-11-28T13:00:54.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.451+0000 7fd6f2b6b700 1 -- 172.21.15.82:0/3456391967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd6ec0b3e70 con 0x7fd6ec06de30 2023-11-28T13:00:54.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.451+0000 7fd6e27fc700 1 -- 172.21.15.82:0/3456391967 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd6e80160a0 con 0x7fd6ec06de30 2023-11-28T13:00:54.457 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:00:54.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.455+0000 7fd6f2b6b700 1 -- 172.21.15.82:0/3456391967 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd6d0064ee0 msgr2=0x7fd6d0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:54.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.455+0000 7fd6f2b6b700 1 --2- 172.21.15.82:0/3456391967 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd6d0064ee0 0x7fd6d0067390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec159810 tx=0x7fd6dc001490 comp rx=0 tx=0).stop 2023-11-28T13:00:54.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.455+0000 7fd6f2b6b700 1 -- 172.21.15.82:0/3456391967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6ec06de30 msgr2=0x7fd6ec158f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:54.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.455+0000 7fd6f2b6b700 1 --2- 172.21.15.82:0/3456391967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6ec06de30 0x7fd6ec158f30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80097d0 tx=0x7fd6e8004770 comp rx=0 tx=0).stop 2023-11-28T13:00:54.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.455+0000 7fd6f2b6b700 1 -- 172.21.15.82:0/3456391967 shutdown_connections 2023-11-28T13:00:54.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.455+0000 7fd6f2b6b700 1 --2- 172.21.15.82:0/3456391967 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd6d0064ee0 0x7fd6d0067390 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.455+0000 7fd6f2b6b700 1 --2- 172.21.15.82:0/3456391967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6ec15a480 0x7fd6ec1f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.455+0000 7fd6f2b6b700 1 --2- 172.21.15.82:0/3456391967 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6ec1578a0 0x7fd6ec159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.455+0000 7fd6f2b6b700 1 --2- 172.21.15.82:0/3456391967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6ec06de30 0x7fd6ec158f30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.455+0000 7fd6f2b6b700 1 -- 172.21.15.82:0/3456391967 >> 172.21.15.82:0/3456391967 conn(0x7fd6ec0d07e0 msgr2=0x7fd6ec0cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:54.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.455+0000 7fd6f2b6b700 1 -- 172.21.15.82:0/3456391967 shutdown_connections 2023-11-28T13:00:54.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.455+0000 7fd6f2b6b700 1 -- 172.21.15.82:0/3456391967 wait complete. 2023-11-28T13:00:54.471 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T13:00:54.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26e167700 1 Processor -- start 2023-11-28T13:00:54.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26e167700 1 -- start start 2023-11-28T13:00:54.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26e167700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc268158eb0 0x7fc2680c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:54.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26e167700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc2680b0c70 0x7fc26815c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:54.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26e167700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2680ad9b0 con 0x7fc2680ae090 2023-11-28T13:00:54.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26e167700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2680adee0 con 0x7fc2680b0c70 2023-11-28T13:00:54.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26e167700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc268159280 con 0x7fc268158eb0 2023-11-28T13:00:54.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26d966700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc2680b0c70 0x7fc26815c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:54.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26c964700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc2680ae090 0x7fc2680b0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53288/0 (socket says 172.21.15.82:53288) 2023-11-28T13:00:54.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26c964700 1 -- 172.21.15.82:0/204729876 learned_addr learned my addr 172.21.15.82:0/204729876 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:54.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26d165700 1 --2- 172.21.15.82:0/204729876 >> v2:172.21.15.114:3300/0 conn(0x7fc268158eb0 0x7fc2680c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:54.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc267fff700 1 -- 172.21.15.82:0/204729876 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3030616706 0 0) 0x7fc2680ad9b0 con 0x7fc2680ae090 2023-11-28T13:00:54.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc267fff700 1 -- 172.21.15.82:0/204729876 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2500035d0 con 0x7fc2680ae090 2023-11-28T13:00:54.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26d966700 1 -- 172.21.15.82:0/204729876 >> v2:172.21.15.114:3300/0 conn(0x7fc268158eb0 msgr2=0x7fc2680c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:54.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26d966700 1 --2- 172.21.15.82:0/204729876 >> v2:172.21.15.114:3300/0 conn(0x7fc268158eb0 0x7fc2680c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26d966700 1 -- 172.21.15.82:0/204729876 >> v1:172.21.15.82:6789/0 conn(0x7fc2680ae090 legacy=0x7fc2680b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:54.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26d966700 1 -- 172.21.15.82:0/204729876 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc268069e60 con 0x7fc2680b0c70 2023-11-28T13:00:54.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26d966700 1 --2- 172.21.15.82:0/204729876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2680b0c70 0x7fc26815c9d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc26806bef0 tx=0x7fc260009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e3cfd6a73698ac server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:54.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc267fff700 1 -- 172.21.15.82:0/204729876 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260011830 con 0x7fc2680b0c70 2023-11-28T13:00:54.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc267fff700 1 -- 172.21.15.82:0/204729876 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc260011990 con 0x7fc2680b0c70 2023-11-28T13:00:54.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc267fff700 1 -- 172.21.15.82:0/204729876 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260011d00 con 0x7fc2680b0c70 2023-11-28T13:00:54.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26e167700 1 -- 172.21.15.82:0/204729876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2680b0c70 msgr2=0x7fc26815c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:54.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26e167700 1 --2- 172.21.15.82:0/204729876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2680b0c70 0x7fc26815c9d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc26806bef0 tx=0x7fc260009b30 comp rx=0 tx=0).stop 2023-11-28T13:00:54.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26e167700 1 -- 172.21.15.82:0/204729876 shutdown_connections 2023-11-28T13:00:54.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26e167700 1 --2- 172.21.15.82:0/204729876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2680b0c70 0x7fc26815c9d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26e167700 1 --2- 172.21.15.82:0/204729876 >> v2:172.21.15.114:3300/0 conn(0x7fc268158eb0 0x7fc2680c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26e167700 1 -- 172.21.15.82:0/204729876 >> 172.21.15.82:0/204729876 conn(0x7fc2680ce630 msgr2=0x7fc2680cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:54.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26e167700 1 -- 172.21.15.82:0/204729876 shutdown_connections 2023-11-28T13:00:54.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.591+0000 7fc26e167700 1 -- 172.21.15.82:0/204729876 wait complete. 2023-11-28T13:00:54.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc26e167700 1 Processor -- start 2023-11-28T13:00:54.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc26e167700 1 -- start start 2023-11-28T13:00:54.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc26e167700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2680ae090 0x7fc2681f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:54.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc26e167700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2680b0c70 0x7fc2680cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:54.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc26e167700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc268158eb0 0x7fc2680b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:54.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc26e167700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2681f2fd0 con 0x7fc2680ae090 2023-11-28T13:00:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc26e167700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2680cc9a0 con 0x7fc2680b0c70 2023-11-28T13:00:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc26e167700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2680cb3c0 con 0x7fc268158eb0 2023-11-28T13:00:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc26d165700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2680ae090 0x7fc2681f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc26d165700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2680ae090 0x7fc2681f2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44376/0 (socket says 172.21.15.82:44376) 2023-11-28T13:00:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc26d165700 1 -- 172.21.15.82:0/1693118596 learned_addr learned my addr 172.21.15.82:0/1693118596 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc26c964700 1 --2- 172.21.15.82:0/1693118596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2680b0c70 0x7fc2680cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc26d966700 1 --2- 172.21.15.82:0/1693118596 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc268158eb0 0x7fc2680b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc26d165700 1 -- 172.21.15.82:0/1693118596 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc268158eb0 msgr2=0x7fc2680b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc26d165700 1 --2- 172.21.15.82:0/1693118596 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc268158eb0 0x7fc2680b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc26d165700 1 -- 172.21.15.82:0/1693118596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2680b0c70 msgr2=0x7fc2680cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc26d165700 1 --2- 172.21.15.82:0/1693118596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2680b0c70 0x7fc2680cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc26d165700 1 -- 172.21.15.82:0/1693118596 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2600094b0 con 0x7fc2680ae090 2023-11-28T13:00:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc26d165700 1 --2- 172.21.15.82:0/1693118596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2680ae090 0x7fc2681f2a90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc25800efc0 tx=0x7fc25800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:54.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc265ffb700 1 -- 172.21.15.82:0/1693118596 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25800cd10 con 0x7fc2680ae090 2023-11-28T13:00:54.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc265ffb700 1 -- 172.21.15.82:0/1693118596 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25800f040 con 0x7fc2680ae090 2023-11-28T13:00:54.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc26e167700 1 -- 172.21.15.82:0/1693118596 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc268071c90 con 0x7fc2680ae090 2023-11-28T13:00:54.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc265ffb700 1 -- 172.21.15.82:0/1693118596 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2580146a0 con 0x7fc2680ae090 2023-11-28T13:00:54.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.595+0000 7fc26e167700 1 -- 172.21.15.82:0/1693118596 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2680adc00 con 0x7fc2680ae090 2023-11-28T13:00:54.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.599+0000 7fc26e167700 1 -- 172.21.15.82:0/1693118596 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc268071f70 con 0x7fc2680ae090 2023-11-28T13:00:54.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.599+0000 7fc265ffb700 1 -- 172.21.15.82:0/1693118596 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc258014800 con 0x7fc2680ae090 2023-11-28T13:00:54.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.599+0000 7fc265ffb700 1 --2- 172.21.15.82:0/1693118596 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc254064f10 0x7fc2540673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:54.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.599+0000 7fc26c964700 1 --2- 172.21.15.82:0/1693118596 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc254064f10 0x7fc2540673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:54.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.599+0000 7fc265ffb700 1 -- 172.21.15.82:0/1693118596 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc2580827b0 con 0x7fc2680ae090 2023-11-28T13:00:54.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.599+0000 7fc26c964700 1 --2- 172.21.15.82:0/1693118596 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc254064f10 0x7fc2540673c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc2680ca7f0 tx=0x7fc25c007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:54.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.603+0000 7fc265ffb700 1 -- 172.21.15.82:0/1693118596 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc258050950 con 0x7fc2680ae090 2023-11-28T13:00:54.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.759+0000 7fc26e167700 1 -- 172.21.15.82:0/1693118596 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc268065fc0 con 0x7fc2680ae090 2023-11-28T13:00:54.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.763+0000 7fc265ffb700 1 -- 172.21.15.82:0/1693118596 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc258053f70 con 0x7fc2680ae090 2023-11-28T13:00:54.767 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-11-28T13:00:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.767+0000 7fc26e167700 1 -- 172.21.15.82:0/1693118596 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc254064f10 msgr2=0x7fc2540673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.767+0000 7fc26e167700 1 --2- 172.21.15.82:0/1693118596 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc254064f10 0x7fc2540673c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc2680ca7f0 tx=0x7fc25c007de0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.767+0000 7fc26e167700 1 -- 172.21.15.82:0/1693118596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2680ae090 msgr2=0x7fc2681f2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.767+0000 7fc26e167700 1 --2- 172.21.15.82:0/1693118596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2680ae090 0x7fc2681f2a90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc25800efc0 tx=0x7fc25800c3a0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.767+0000 7fc26e167700 1 -- 172.21.15.82:0/1693118596 shutdown_connections 2023-11-28T13:00:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.767+0000 7fc26e167700 1 --2- 172.21.15.82:0/1693118596 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc254064f10 0x7fc2540673c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.767+0000 7fc26e167700 1 --2- 172.21.15.82:0/1693118596 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc268158eb0 0x7fc2680b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.767+0000 7fc26e167700 1 --2- 172.21.15.82:0/1693118596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2680b0c70 0x7fc2680cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.767+0000 7fc26e167700 1 --2- 172.21.15.82:0/1693118596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2680ae090 0x7fc2681f2a90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.767+0000 7fc26e167700 1 -- 172.21.15.82:0/1693118596 >> 172.21.15.82:0/1693118596 conn(0x7fc2680ce630 msgr2=0x7fc268159530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:54.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.767+0000 7fc26e167700 1 -- 172.21.15.82:0/1693118596 shutdown_connections 2023-11-28T13:00:54.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.767+0000 7fc26e167700 1 -- 172.21.15.82:0/1693118596 wait complete. 2023-11-28T13:00:54.785 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T13:00:54.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.895+0000 7f7bfb59e700 1 Processor -- start 2023-11-28T13:00:54.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.895+0000 7f7bfb59e700 1 -- start start 2023-11-28T13:00:54.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.895+0000 7f7bfb59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7bfc06ba30 0x7f7bfc06be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:54.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.895+0000 7f7bfb59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bfc0d1050 con 0x7f7bfc0b5c20 2023-11-28T13:00:54.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.895+0000 7f7bfb59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bfc06c3a0 con 0x7f7bfc0b1f30 2023-11-28T13:00:54.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.895+0000 7f7bfb59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc0b2300 con 0x7f7bfc06ba30 2023-11-28T13:00:54.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.895+0000 7f7bfad9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7bfc0b5c20 0x7f7bfc0b60a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53304/0 (socket says 172.21.15.82:53304) 2023-11-28T13:00:54.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.895+0000 7f7bfad9d700 1 -- 172.21.15.82:0/154163265 learned_addr learned my addr 172.21.15.82:0/154163265 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:54.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.895+0000 7f7bf9d9b700 1 --2- 172.21.15.82:0/154163265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7bfc06ba30 0x7f7bfc06be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:54.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.895+0000 7f7bf959a700 1 -- 172.21.15.82:0/154163265 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2264640199 0 0) 0x7f7bfc0d1050 con 0x7f7bfc0b5c20 2023-11-28T13:00:54.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.895+0000 7f7bf959a700 1 -- 172.21.15.82:0/154163265 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7be40035d0 con 0x7f7bfc0b5c20 2023-11-28T13:00:54.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.895+0000 7f7bf959a700 1 -- 172.21.15.82:0/154163265 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517039655 0 0) 0x7f7bfc06c3a0 con 0x7f7bfc0b1f30 2023-11-28T13:00:54.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.895+0000 7f7bf959a700 1 -- 172.21.15.82:0/154163265 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bfc0d1050 con 0x7f7bfc0b1f30 2023-11-28T13:00:54.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.895+0000 7f7bf9d9b700 1 -- 172.21.15.82:0/154163265 >> v1:172.21.15.114:6789/0 conn(0x7f7bfc0b1f30 legacy=0x7f7bfc0d2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:54.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.895+0000 7f7bf9d9b700 1 -- 172.21.15.82:0/154163265 >> v1:172.21.15.82:6789/0 conn(0x7f7bfc0b5c20 legacy=0x7f7bfc0b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:54.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.895+0000 7f7bf9d9b700 1 -- 172.21.15.82:0/154163265 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bfc0cd0c0 con 0x7f7bfc06ba30 2023-11-28T13:00:54.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.895+0000 7f7bf9d9b700 1 --2- 172.21.15.82:0/154163265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7bfc06ba30 0x7f7bfc06be60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0009880 tx=0x7f7bf0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fae6e889afc1a964 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:54.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.899+0000 7f7bf959a700 1 -- 172.21.15.82:0/154163265 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0011830 con 0x7f7bfc06ba30 2023-11-28T13:00:54.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.899+0000 7f7bf959a700 1 -- 172.21.15.82:0/154163265 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf0011990 con 0x7f7bfc06ba30 2023-11-28T13:00:54.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.899+0000 7f7bf959a700 1 -- 172.21.15.82:0/154163265 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0011d20 con 0x7f7bfc06ba30 2023-11-28T13:00:54.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.899+0000 7f7bfb59e700 1 -- 172.21.15.82:0/154163265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7bfc06ba30 msgr2=0x7f7bfc06be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:54.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.899+0000 7f7bfb59e700 1 --2- 172.21.15.82:0/154163265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7bfc06ba30 0x7f7bfc06be60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0009880 tx=0x7f7bf0009b90 comp rx=0 tx=0).stop 2023-11-28T13:00:54.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.899+0000 7f7bfb59e700 1 -- 172.21.15.82:0/154163265 shutdown_connections 2023-11-28T13:00:54.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.899+0000 7f7bfb59e700 1 --2- 172.21.15.82:0/154163265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7bfc06ba30 0x7f7bfc06be60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.899+0000 7f7bfb59e700 1 -- 172.21.15.82:0/154163265 >> 172.21.15.82:0/154163265 conn(0x7f7bfc0b52d0 msgr2=0x7f7bfc0d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:54.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.899+0000 7f7bfb59e700 1 -- 172.21.15.82:0/154163265 shutdown_connections 2023-11-28T13:00:54.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.899+0000 7f7bfb59e700 1 -- 172.21.15.82:0/154163265 wait complete. 2023-11-28T13:00:54.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.899+0000 7f7bfb59e700 1 Processor -- start 2023-11-28T13:00:54.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.899+0000 7f7bfb59e700 1 -- start start 2023-11-28T13:00:54.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7bfb59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bfc06ba30 0x7f7bfc1f13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:54.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7bfb59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7bfc0b1f30 0x7f7bfc15f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:54.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7bfb59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bfc0b5c20 0x7f7bfc0ab180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:54.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7bfb59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc1f1910 con 0x7f7bfc0b5c20 2023-11-28T13:00:54.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7bfb59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc0abbd0 con 0x7f7bfc06ba30 2023-11-28T13:00:54.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7bfb59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc15c7e0 con 0x7f7bfc0b1f30 2023-11-28T13:00:54.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7bfad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bfc0b5c20 0x7f7bfc0ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:54.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7bfa59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bfc06ba30 0x7f7bfc1f13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:54.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7bf9d9b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7bfc0b1f30 0x7f7bfc15f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:54.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7bfa59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bfc06ba30 0x7f7bfc1f13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:37950/0 (socket says 172.21.15.82:37950) 2023-11-28T13:00:54.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7bfa59c700 1 -- 172.21.15.82:0/20943659 learned_addr learned my addr 172.21.15.82:0/20943659 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:54.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7bfad9d700 1 -- 172.21.15.82:0/20943659 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7bfc0b1f30 msgr2=0x7f7bfc15f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:54.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7bfad9d700 1 --2- 172.21.15.82:0/20943659 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7bfc0b1f30 0x7f7bfc15f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7bfad9d700 1 -- 172.21.15.82:0/20943659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bfc06ba30 msgr2=0x7f7bfc1f13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:54.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7bfad9d700 1 --2- 172.21.15.82:0/20943659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bfc06ba30 0x7f7bfc1f13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:54.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7bfad9d700 1 -- 172.21.15.82:0/20943659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf00094b0 con 0x7f7bfc0b5c20 2023-11-28T13:00:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7bfa59c700 1 --2- 172.21.15.82:0/20943659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bfc06ba30 0x7f7bfc1f13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7bfad9d700 1 --2- 172.21.15.82:0/20943659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bfc0b5c20 0x7f7bfc0ab180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400ca70 tx=0x7f7bf400caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7beaffd700 1 -- 172.21.15.82:0/20943659 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4007480 con 0x7f7bfc0b5c20 2023-11-28T13:00:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7beaffd700 1 -- 172.21.15.82:0/20943659 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf40075e0 con 0x7f7bfc0b5c20 2023-11-28T13:00:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7beaffd700 1 -- 172.21.15.82:0/20943659 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4007990 con 0x7f7bfc0b5c20 2023-11-28T13:00:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7bfb59e700 1 -- 172.21.15.82:0/20943659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bfc0d1580 con 0x7f7bfc0b5c20 2023-11-28T13:00:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.903+0000 7f7bfb59e700 1 -- 172.21.15.82:0/20943659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bfc0d12a0 con 0x7f7bfc0b5c20 2023-11-28T13:00:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.907+0000 7f7bfb59e700 1 -- 172.21.15.82:0/20943659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bfc0cd380 con 0x7f7bfc0b5c20 2023-11-28T13:00:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.907+0000 7f7beaffd700 1 -- 172.21.15.82:0/20943659 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7bf4019030 con 0x7f7bfc0b5c20 2023-11-28T13:00:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.907+0000 7f7beaffd700 1 --2- 172.21.15.82:0/20943659 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7bdc064ee0 0x7f7bdc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.907+0000 7f7bfa59c700 1 --2- 172.21.15.82:0/20943659 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7bdc064ee0 0x7f7bdc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.907+0000 7f7beaffd700 1 -- 172.21.15.82:0/20943659 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7bf4081770 con 0x7f7bfc0b5c20 2023-11-28T13:00:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.907+0000 7f7bfa59c700 1 --2- 172.21.15.82:0/20943659 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7bdc064ee0 0x7f7bdc067390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7bec0011e0 tx=0x7f7bec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:54.915+0000 7f7beaffd700 1 -- 172.21.15.82:0/20943659 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7bf404f7a0 con 0x7f7bfc0b5c20 2023-11-28T13:00:55.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.075+0000 7f7bfb59e700 1 -- 172.21.15.82:0/20943659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7bfc065fc0 con 0x7f7bfc0b5c20 2023-11-28T13:00:55.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.075+0000 7f7beaffd700 1 -- 172.21.15.82:0/20943659 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7bf40170a0 con 0x7f7bfc0b5c20 2023-11-28T13:00:55.080 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-11-28T13:00:55.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.075+0000 7f7bfb59e700 1 -- 172.21.15.82:0/20943659 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7bdc064ee0 msgr2=0x7f7bdc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:55.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.075+0000 7f7bfb59e700 1 --2- 172.21.15.82:0/20943659 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7bdc064ee0 0x7f7bdc067390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7bec0011e0 tx=0x7f7bec009040 comp rx=0 tx=0).stop 2023-11-28T13:00:55.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.075+0000 7f7bfb59e700 1 -- 172.21.15.82:0/20943659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bfc0b5c20 msgr2=0x7f7bfc0ab180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:55.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.075+0000 7f7bfb59e700 1 --2- 172.21.15.82:0/20943659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bfc0b5c20 0x7f7bfc0ab180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400ca70 tx=0x7f7bf400caa0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.075+0000 7f7bfb59e700 1 -- 172.21.15.82:0/20943659 shutdown_connections 2023-11-28T13:00:55.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.075+0000 7f7bfb59e700 1 --2- 172.21.15.82:0/20943659 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7bdc064ee0 0x7f7bdc067390 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.079+0000 7f7bfb59e700 1 --2- 172.21.15.82:0/20943659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bfc0b5c20 0x7f7bfc0ab180 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.079+0000 7f7bfb59e700 1 --2- 172.21.15.82:0/20943659 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7bfc0b1f30 0x7f7bfc15f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.079+0000 7f7bfb59e700 1 --2- 172.21.15.82:0/20943659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bfc06ba30 0x7f7bfc1f13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.079+0000 7f7bfb59e700 1 -- 172.21.15.82:0/20943659 >> 172.21.15.82:0/20943659 conn(0x7f7bfc0b52d0 msgr2=0x7f7bfc069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:55.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.079+0000 7f7bfb59e700 1 -- 172.21.15.82:0/20943659 shutdown_connections 2023-11-28T13:00:55.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.079+0000 7f7bfb59e700 1 -- 172.21.15.82:0/20943659 wait complete. 2023-11-28T13:00:55.093 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:00:55.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.199+0000 7eff85d00700 1 Processor -- start 2023-11-28T13:00:55.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.199+0000 7eff85d00700 1 -- start start 2023-11-28T13:00:55.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.199+0000 7eff85d00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7eff800b3910 0x7eff8006b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:55.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.199+0000 7eff85d00700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff8006c910 0x7eff8006d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:55.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.199+0000 7eff85d00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8006c480 con 0x7eff80070070 2023-11-28T13:00:55.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.199+0000 7eff85d00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff8006dbe0 con 0x7eff800b3910 2023-11-28T13:00:55.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.199+0000 7eff85d00700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8006dec0 con 0x7eff8006c910 2023-11-28T13:00:55.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.199+0000 7eff84cfe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7eff800b3910 0x7eff8006b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:55.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.199+0000 7eff854ff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7eff80070070 0x7eff8015db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53312/0 (socket says 172.21.15.82:53312) 2023-11-28T13:00:55.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.199+0000 7eff854ff700 1 -- 172.21.15.82:0/4069299535 learned_addr learned my addr 172.21.15.82:0/4069299535 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:55.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.199+0000 7eff7ffff700 1 --2- 172.21.15.82:0/4069299535 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff8006c910 0x7eff8006d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:55.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.199+0000 7eff84cfe700 1 -- 172.21.15.82:0/4069299535 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff8006c910 msgr2=0x7eff8006d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:55.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.199+0000 7eff84cfe700 1 --2- 172.21.15.82:0/4069299535 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff8006c910 0x7eff8006d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.199+0000 7eff84cfe700 1 -- 172.21.15.82:0/4069299535 >> v1:172.21.15.82:6789/0 conn(0x7eff80070070 legacy=0x7eff8015db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:55.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.199+0000 7eff84cfe700 1 -- 172.21.15.82:0/4069299535 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8006c110 con 0x7eff800b3910 2023-11-28T13:00:55.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.199+0000 7eff7f7fe700 1 -- 172.21.15.82:0/4069299535 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667082732 0 0) 0x7eff8006c480 con 0x7eff80070070 2023-11-28T13:00:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.199+0000 7eff84cfe700 1 --2- 172.21.15.82:0/4069299535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff800b3910 0x7eff8006b0a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7eff70009d90 tx=0x7eff7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15b88d97b7f8e13 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.203+0000 7eff7f7fe700 1 -- 172.21.15.82:0/4069299535 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7000e070 con 0x7eff800b3910 2023-11-28T13:00:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.203+0000 7eff7f7fe700 1 -- 172.21.15.82:0/4069299535 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7000bb20 con 0x7eff800b3910 2023-11-28T13:00:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.203+0000 7eff7f7fe700 1 -- 172.21.15.82:0/4069299535 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70012430 con 0x7eff800b3910 2023-11-28T13:00:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.203+0000 7eff85d00700 1 -- 172.21.15.82:0/4069299535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff800b3910 msgr2=0x7eff8006b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.203+0000 7eff85d00700 1 --2- 172.21.15.82:0/4069299535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff800b3910 0x7eff8006b0a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7eff70009d90 tx=0x7eff7000b330 comp rx=0 tx=0).stop 2023-11-28T13:00:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.203+0000 7eff85d00700 1 -- 172.21.15.82:0/4069299535 shutdown_connections 2023-11-28T13:00:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.203+0000 7eff85d00700 1 --2- 172.21.15.82:0/4069299535 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff8006c910 0x7eff8006d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.203+0000 7eff85d00700 1 --2- 172.21.15.82:0/4069299535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff800b3910 0x7eff8006b0a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.203+0000 7eff85d00700 1 -- 172.21.15.82:0/4069299535 >> 172.21.15.82:0/4069299535 conn(0x7eff800ce600 msgr2=0x7eff800ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.203+0000 7eff85d00700 1 -- 172.21.15.82:0/4069299535 shutdown_connections 2023-11-28T13:00:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.203+0000 7eff85d00700 1 -- 172.21.15.82:0/4069299535 wait complete. 2023-11-28T13:00:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.203+0000 7eff85d00700 1 Processor -- start 2023-11-28T13:00:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.203+0000 7eff85d00700 1 -- start start 2023-11-28T13:00:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.203+0000 7eff85d00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff8006c910 0x7eff800c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.203+0000 7eff85d00700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff80070070 0x7eff800ac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.203+0000 7eff85d00700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff800b3910 0x7eff800ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.203+0000 7eff85d00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff801f28a0 con 0x7eff8006c910 2023-11-28T13:00:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.203+0000 7eff85d00700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff800ab950 con 0x7eff800b3910 2023-11-28T13:00:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.203+0000 7eff85d00700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff800abc30 con 0x7eff80070070 2023-11-28T13:00:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.207+0000 7eff84cfe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff8006c910 0x7eff800c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.207+0000 7eff7ffff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff80070070 0x7eff800ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.207+0000 7eff84cfe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff8006c910 0x7eff800c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44418/0 (socket says 172.21.15.82:44418) 2023-11-28T13:00:55.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.207+0000 7eff84cfe700 1 -- 172.21.15.82:0/396232273 learned_addr learned my addr 172.21.15.82:0/396232273 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:55.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.207+0000 7eff854ff700 1 --2- 172.21.15.82:0/396232273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff800b3910 0x7eff800ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:55.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.207+0000 7eff84cfe700 1 -- 172.21.15.82:0/396232273 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff80070070 msgr2=0x7eff800ac710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:55.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.207+0000 7eff84cfe700 1 --2- 172.21.15.82:0/396232273 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff80070070 0x7eff800ac710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.207+0000 7eff84cfe700 1 -- 172.21.15.82:0/396232273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff800b3910 msgr2=0x7eff800ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:55.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.207+0000 7eff84cfe700 1 --2- 172.21.15.82:0/396232273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff800b3910 0x7eff800ad000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.207+0000 7eff84cfe700 1 -- 172.21.15.82:0/396232273 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff70009a70 con 0x7eff8006c910 2023-11-28T13:00:55.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.207+0000 7eff7ffff700 1 --2- 172.21.15.82:0/396232273 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff80070070 0x7eff800ac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:55.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.207+0000 7eff84cfe700 1 --2- 172.21.15.82:0/396232273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff8006c910 0x7eff800c7db0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7eff70014040 tx=0x7eff70004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:55.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.207+0000 7eff7d7fa700 1 -- 172.21.15.82:0/396232273 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70012430 con 0x7eff8006c910 2023-11-28T13:00:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.207+0000 7eff7d7fa700 1 -- 172.21.15.82:0/396232273 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff70020070 con 0x7eff8006c910 2023-11-28T13:00:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.207+0000 7eff7d7fa700 1 -- 172.21.15.82:0/396232273 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70004280 con 0x7eff8006c910 2023-11-28T13:00:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.207+0000 7eff85d00700 1 -- 172.21.15.82:0/396232273 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8006d860 con 0x7eff8006c910 2023-11-28T13:00:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.207+0000 7eff85d00700 1 -- 172.21.15.82:0/396232273 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff800c8f80 con 0x7eff8006c910 2023-11-28T13:00:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.207+0000 7eff85d00700 1 -- 172.21.15.82:0/396232273 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff800b3ce0 con 0x7eff8006c910 2023-11-28T13:00:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.207+0000 7eff7d7fa700 1 -- 172.21.15.82:0/396232273 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7eff7002e070 con 0x7eff8006c910 2023-11-28T13:00:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.211+0000 7eff7d7fa700 1 --2- 172.21.15.82:0/396232273 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7eff60064ee0 0x7eff60067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.211+0000 7eff7ffff700 1 --2- 172.21.15.82:0/396232273 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7eff60064ee0 0x7eff60067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.211+0000 7eff7d7fa700 1 -- 172.21.15.82:0/396232273 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff70022070 con 0x7eff8006c910 2023-11-28T13:00:55.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.211+0000 7eff7ffff700 1 --2- 172.21.15.82:0/396232273 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7eff60064ee0 0x7eff60067390 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7eff800c8420 tx=0x7eff68009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:55.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.215+0000 7eff7d7fa700 1 -- 172.21.15.82:0/396232273 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7eff70051c30 con 0x7eff8006c910 2023-11-28T13:00:55.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.379+0000 7eff85d00700 1 -- 172.21.15.82:0/396232273 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff80065fc0 con 0x7eff8006c910 2023-11-28T13:00:55.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.383+0000 7eff7d7fa700 1 -- 172.21.15.82:0/396232273 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17811 (secure 0 0 0) 0x7eff70012e60 con 0x7eff8006c910 2023-11-28T13:00:55.388 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:55.388 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:00:26.981345+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:00:24.360641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T13:00:24.960863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:00:55.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.383+0000 7eff85d00700 1 -- 172.21.15.82:0/396232273 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7eff60064ee0 msgr2=0x7eff60067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:55.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.383+0000 7eff85d00700 1 --2- 172.21.15.82:0/396232273 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7eff60064ee0 0x7eff60067390 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7eff800c8420 tx=0x7eff68009240 comp rx=0 tx=0).stop 2023-11-28T13:00:55.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.383+0000 7eff85d00700 1 -- 172.21.15.82:0/396232273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff8006c910 msgr2=0x7eff800c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:55.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.383+0000 7eff85d00700 1 --2- 172.21.15.82:0/396232273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff8006c910 0x7eff800c7db0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7eff70014040 tx=0x7eff70004af0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.383+0000 7eff85d00700 1 -- 172.21.15.82:0/396232273 shutdown_connections 2023-11-28T13:00:55.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.383+0000 7eff85d00700 1 --2- 172.21.15.82:0/396232273 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7eff60064ee0 0x7eff60067390 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.383+0000 7eff85d00700 1 --2- 172.21.15.82:0/396232273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff800b3910 0x7eff800ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.383+0000 7eff85d00700 1 --2- 172.21.15.82:0/396232273 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff80070070 0x7eff800ac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.383+0000 7eff85d00700 1 --2- 172.21.15.82:0/396232273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff8006c910 0x7eff800c7db0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.383+0000 7eff85d00700 1 -- 172.21.15.82:0/396232273 >> 172.21.15.82:0/396232273 conn(0x7eff800ce600 msgr2=0x7eff800b1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:55.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.383+0000 7eff85d00700 1 -- 172.21.15.82:0/396232273 shutdown_connections 2023-11-28T13:00:55.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.387+0000 7eff85d00700 1 -- 172.21.15.82:0/396232273 wait complete. 2023-11-28T13:00:55.403 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T13:00:24.360641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T13:00:24.960863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:00:55.404 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:00:55.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.515+0000 7f6e6d8e8700 1 Processor -- start 2023-11-28T13:00:55.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.515+0000 7f6e6d8e8700 1 -- start start 2023-11-28T13:00:55.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.515+0000 7f6e6d8e8700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6e68150ee0 0x7f6e68070120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:55.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.515+0000 7f6e6d8e8700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6e680ad8b0 0x7f6e680add10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:55.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.515+0000 7f6e6d8e8700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e680ae250 con 0x7f6e68070660 2023-11-28T13:00:55.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.515+0000 7f6e6d8e8700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e68069bc0 con 0x7f6e680ad8b0 2023-11-28T13:00:55.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.515+0000 7f6e6d8e8700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e68069e80 con 0x7f6e68150ee0 2023-11-28T13:00:55.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.515+0000 7f6e67fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6e68070660 0x7f6e6806ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53322/0 (socket says 172.21.15.82:53322) 2023-11-28T13:00:55.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.515+0000 7f6e67fff700 1 -- 172.21.15.82:0/1775636974 learned_addr learned my addr 172.21.15.82:0/1775636974 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:55.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.515+0000 7f6e6c8e6700 1 --2- 172.21.15.82:0/1775636974 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6e68150ee0 0x7f6e68070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:55.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.515+0000 7f6e6d0e7700 1 --2- 172.21.15.82:0/1775636974 >> v2:172.21.15.114:3300/0 conn(0x7f6e680ad8b0 0x7f6e680add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:55.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.515+0000 7f6e677fe700 1 -- 172.21.15.82:0/1775636974 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906408898 0 0) 0x7f6e680ae250 con 0x7f6e68070660 2023-11-28T13:00:55.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.515+0000 7f6e677fe700 1 -- 172.21.15.82:0/1775636974 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e500035d0 con 0x7f6e68070660 2023-11-28T13:00:55.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.515+0000 7f6e6c8e6700 1 -- 172.21.15.82:0/1775636974 >> v2:172.21.15.114:3300/0 conn(0x7f6e680ad8b0 msgr2=0x7f6e680add10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:55.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.515+0000 7f6e6c8e6700 1 --2- 172.21.15.82:0/1775636974 >> v2:172.21.15.114:3300/0 conn(0x7f6e680ad8b0 0x7f6e680add10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.515+0000 7f6e677fe700 1 -- 172.21.15.82:0/1775636974 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4075056292 0 0) 0x7f6e500035d0 con 0x7f6e68070660 2023-11-28T13:00:55.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.515+0000 7f6e6c8e6700 1 -- 172.21.15.82:0/1775636974 >> v1:172.21.15.82:6789/0 conn(0x7f6e68070660 legacy=0x7f6e6806ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:55.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.515+0000 7f6e6c8e6700 1 -- 172.21.15.82:0/1775636974 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6806a160 con 0x7f6e68150ee0 2023-11-28T13:00:55.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.515+0000 7f6e6c8e6700 1 --2- 172.21.15.82:0/1775636974 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6e68150ee0 0x7f6e68070120 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009850 tx=0x7f6e5c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e53909087236445 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:55.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.519+0000 7f6e677fe700 1 -- 172.21.15.82:0/1775636974 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e58001a10 con 0x7f6e68150ee0 2023-11-28T13:00:55.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.519+0000 7f6e677fe700 1 -- 172.21.15.82:0/1775636974 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5c004030 con 0x7f6e68150ee0 2023-11-28T13:00:55.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.519+0000 7f6e677fe700 1 -- 172.21.15.82:0/1775636974 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c0043a0 con 0x7f6e68150ee0 2023-11-28T13:00:55.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.519+0000 7f6e6d8e8700 1 -- 172.21.15.82:0/1775636974 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6e68150ee0 msgr2=0x7f6e68070120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:55.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.519+0000 7f6e6d8e8700 1 --2- 172.21.15.82:0/1775636974 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6e68150ee0 0x7f6e68070120 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009850 tx=0x7f6e5c009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:55.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.519+0000 7f6e6d8e8700 1 -- 172.21.15.82:0/1775636974 shutdown_connections 2023-11-28T13:00:55.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.519+0000 7f6e6d8e8700 1 --2- 172.21.15.82:0/1775636974 >> v2:172.21.15.114:3300/0 conn(0x7f6e680ad8b0 0x7f6e680add10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.519+0000 7f6e6d8e8700 1 --2- 172.21.15.82:0/1775636974 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6e68150ee0 0x7f6e68070120 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.519+0000 7f6e6d8e8700 1 -- 172.21.15.82:0/1775636974 >> 172.21.15.82:0/1775636974 conn(0x7f6e680ce630 msgr2=0x7f6e680cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:55.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.519+0000 7f6e6d8e8700 1 -- 172.21.15.82:0/1775636974 shutdown_connections 2023-11-28T13:00:55.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.519+0000 7f6e6d8e8700 1 -- 172.21.15.82:0/1775636974 wait complete. 2023-11-28T13:00:55.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.519+0000 7f6e6d8e8700 1 Processor -- start 2023-11-28T13:00:55.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.519+0000 7f6e6d8e8700 1 -- start start 2023-11-28T13:00:55.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e6d8e8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e68070660 0x7f6e68151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:55.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e6d8e8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e680ad8b0 0x7f6e6814f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:55.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e6d8e8700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6e68150ee0 0x7f6e6813f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:55.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e6d8e8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e68153440 con 0x7f6e680ad8b0 2023-11-28T13:00:55.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e6d8e8700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e681523a0 con 0x7f6e68070660 2023-11-28T13:00:55.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e6d8e8700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e68152680 con 0x7f6e68150ee0 2023-11-28T13:00:55.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e67fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e680ad8b0 0x7f6e6814f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:55.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e67fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e680ad8b0 0x7f6e6814f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44422/0 (socket says 172.21.15.82:44422) 2023-11-28T13:00:55.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e67fff700 1 -- 172.21.15.82:0/1232371869 learned_addr learned my addr 172.21.15.82:0/1232371869 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:55.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e6c8e6700 1 --2- 172.21.15.82:0/1232371869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e68070660 0x7f6e68151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:55.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e6d0e7700 1 --2- 172.21.15.82:0/1232371869 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6e68150ee0 0x7f6e6813f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:55.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e67fff700 1 -- 172.21.15.82:0/1232371869 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6e68150ee0 msgr2=0x7f6e6813f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:55.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e67fff700 1 --2- 172.21.15.82:0/1232371869 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6e68150ee0 0x7f6e6813f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e67fff700 1 -- 172.21.15.82:0/1232371869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e68070660 msgr2=0x7f6e68151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:55.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e67fff700 1 --2- 172.21.15.82:0/1232371869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e68070660 0x7f6e68151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e67fff700 1 -- 172.21.15.82:0/1232371869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c0094b0 con 0x7f6e680ad8b0 2023-11-28T13:00:55.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e67fff700 1 --2- 172.21.15.82:0/1232371869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e680ad8b0 0x7f6e6814f5f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6e58001bc0 tx=0x7f6e5800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:55.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e657fa700 1 -- 172.21.15.82:0/1232371869 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5800aac0 con 0x7f6e680ad8b0 2023-11-28T13:00:55.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e657fa700 1 -- 172.21.15.82:0/1232371869 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5800ac20 con 0x7f6e680ad8b0 2023-11-28T13:00:55.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e6d8e8700 1 -- 172.21.15.82:0/1232371869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6806a720 con 0x7f6e680ad8b0 2023-11-28T13:00:55.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e657fa700 1 -- 172.21.15.82:0/1232371869 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e580070d0 con 0x7f6e680ad8b0 2023-11-28T13:00:55.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e6d8e8700 1 -- 172.21.15.82:0/1232371869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6806a440 con 0x7f6e680ad8b0 2023-11-28T13:00:55.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.523+0000 7f6e6d8e8700 1 -- 172.21.15.82:0/1232371869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e6806b350 con 0x7f6e680ad8b0 2023-11-28T13:00:55.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.527+0000 7f6e657fa700 1 -- 172.21.15.82:0/1232371869 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6e5801a030 con 0x7f6e680ad8b0 2023-11-28T13:00:55.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.527+0000 7f6e657fa700 1 --2- 172.21.15.82:0/1232371869 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6e54064ee0 0x7f6e54067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:55.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.527+0000 7f6e657fa700 1 -- 172.21.15.82:0/1232371869 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6e58081b10 con 0x7f6e680ad8b0 2023-11-28T13:00:55.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.527+0000 7f6e6c8e6700 1 --2- 172.21.15.82:0/1232371869 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6e54064ee0 0x7f6e54067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:55.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.527+0000 7f6e6c8e6700 1 --2- 172.21.15.82:0/1232371869 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6e54064ee0 0x7f6e54067390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c0090b0 tx=0x7f6e5c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:55.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.535+0000 7f6e657fa700 1 -- 172.21.15.82:0/1232371869 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6e5804fcb0 con 0x7f6e680ad8b0 2023-11-28T13:00:55.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.691+0000 7f6e6d8e8700 1 -- 172.21.15.82:0/1232371869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e68065fc0 con 0x7f6e680ad8b0 2023-11-28T13:00:55.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.691+0000 7f6e657fa700 1 -- 172.21.15.82:0/1232371869 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e580180a0 con 0x7f6e680ad8b0 2023-11-28T13:00:55.699 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:00:55.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.695+0000 7f6e6d8e8700 1 -- 172.21.15.82:0/1232371869 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6e54064ee0 msgr2=0x7f6e54067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:55.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.695+0000 7f6e6d8e8700 1 --2- 172.21.15.82:0/1232371869 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6e54064ee0 0x7f6e54067390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c0090b0 tx=0x7f6e5c008030 comp rx=0 tx=0).stop 2023-11-28T13:00:55.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.695+0000 7f6e6d8e8700 1 -- 172.21.15.82:0/1232371869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e680ad8b0 msgr2=0x7f6e6814f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:55.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.695+0000 7f6e6d8e8700 1 --2- 172.21.15.82:0/1232371869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e680ad8b0 0x7f6e6814f5f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6e58001bc0 tx=0x7f6e5800cf50 comp rx=0 tx=0).stop 2023-11-28T13:00:55.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.695+0000 7f6e6d8e8700 1 -- 172.21.15.82:0/1232371869 shutdown_connections 2023-11-28T13:00:55.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.695+0000 7f6e6d8e8700 1 --2- 172.21.15.82:0/1232371869 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6e54064ee0 0x7f6e54067390 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.695+0000 7f6e6d8e8700 1 --2- 172.21.15.82:0/1232371869 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6e68150ee0 0x7f6e6813f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.695+0000 7f6e6d8e8700 1 --2- 172.21.15.82:0/1232371869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e680ad8b0 0x7f6e6814f5f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.695+0000 7f6e6d8e8700 1 --2- 172.21.15.82:0/1232371869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e68070660 0x7f6e68151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.695+0000 7f6e6d8e8700 1 -- 172.21.15.82:0/1232371869 >> 172.21.15.82:0/1232371869 conn(0x7f6e680ce630 msgr2=0x7f6e680add10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:55.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.695+0000 7f6e6d8e8700 1 -- 172.21.15.82:0/1232371869 shutdown_connections 2023-11-28T13:00:55.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.695+0000 7f6e6d8e8700 1 -- 172.21.15.82:0/1232371869 wait complete. 2023-11-28T13:00:55.712 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:00:55.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.823+0000 7f1613fff700 1 Processor -- start 2023-11-28T13:00:55.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.823+0000 7f1613fff700 1 -- start start 2023-11-28T13:00:55.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.823+0000 7f1613fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1614159f60 0x7f1614071950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:55.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.823+0000 7f1613fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f16140affb0 0x7f16140b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:55.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.823+0000 7f1613fff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1614070300 con 0x7f161406ade0 2023-11-28T13:00:55.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.823+0000 7f1613fff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16140c9d10 con 0x7f16140affb0 2023-11-28T13:00:55.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.823+0000 7f1613fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1614072260 con 0x7f1614159f60 2023-11-28T13:00:55.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.823+0000 7f16137fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f16140affb0 0x7f16140b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:55.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.823+0000 7f16127fc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f161406ade0 0x7f16140c5600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53336/0 (socket says 172.21.15.82:53336) 2023-11-28T13:00:55.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.823+0000 7f16127fc700 1 -- 172.21.15.82:0/3052068082 learned_addr learned my addr 172.21.15.82:0/3052068082 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:55.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.823+0000 7f1612ffd700 1 --2- 172.21.15.82:0/3052068082 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1614159f60 0x7f1614071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:55.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.823+0000 7f16137fe700 1 -- 172.21.15.82:0/3052068082 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1614159f60 msgr2=0x7f1614071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:55.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.823+0000 7f16137fe700 1 --2- 172.21.15.82:0/3052068082 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1614159f60 0x7f1614071950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.823+0000 7f16137fe700 1 -- 172.21.15.82:0/3052068082 >> v1:172.21.15.82:6789/0 conn(0x7f161406ade0 legacy=0x7f16140c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:55.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.823+0000 7f16137fe700 1 -- 172.21.15.82:0/3052068082 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16140b0900 con 0x7f16140affb0 2023-11-28T13:00:55.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.823+0000 7f1611ffb700 1 -- 172.21.15.82:0/3052068082 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671457094 0 0) 0x7f1614070300 con 0x7f161406ade0 2023-11-28T13:00:55.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.827+0000 7f16137fe700 1 --2- 172.21.15.82:0/3052068082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16140affb0 0x7f16140b03c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f160c009850 tx=0x7f160c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8682a0fdbdeb51 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:55.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.827+0000 7f1611ffb700 1 -- 172.21.15.82:0/3052068082 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c011830 con 0x7f16140affb0 2023-11-28T13:00:55.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.827+0000 7f1611ffb700 1 -- 172.21.15.82:0/3052068082 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160c011990 con 0x7f16140affb0 2023-11-28T13:00:55.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.827+0000 7f1611ffb700 1 -- 172.21.15.82:0/3052068082 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c011d40 con 0x7f16140affb0 2023-11-28T13:00:55.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.827+0000 7f1613fff700 1 -- 172.21.15.82:0/3052068082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16140affb0 msgr2=0x7f16140b03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:55.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.827+0000 7f1613fff700 1 --2- 172.21.15.82:0/3052068082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16140affb0 0x7f16140b03c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f160c009850 tx=0x7f160c009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:55.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.827+0000 7f1613fff700 1 -- 172.21.15.82:0/3052068082 shutdown_connections 2023-11-28T13:00:55.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.827+0000 7f1613fff700 1 --2- 172.21.15.82:0/3052068082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16140affb0 0x7f16140b03c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.827+0000 7f1613fff700 1 --2- 172.21.15.82:0/3052068082 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1614159f60 0x7f1614071950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.827+0000 7f1613fff700 1 -- 172.21.15.82:0/3052068082 >> 172.21.15.82:0/3052068082 conn(0x7f16140cafb0 msgr2=0x7f16140cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:55.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.827+0000 7f1613fff700 1 -- 172.21.15.82:0/3052068082 shutdown_connections 2023-11-28T13:00:55.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.827+0000 7f1613fff700 1 -- 172.21.15.82:0/3052068082 wait complete. 2023-11-28T13:00:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.831+0000 7f1613fff700 1 Processor -- start 2023-11-28T13:00:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.831+0000 7f1613fff700 1 -- start start 2023-11-28T13:00:55.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.831+0000 7f1613fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f161406ade0 0x7f16140b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:55.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.831+0000 7f1613fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16140affb0 0x7f16141472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:55.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.831+0000 7f1613fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1614159f60 0x7f16141477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:55.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.831+0000 7f1613fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161414a9c0 con 0x7f161406ade0 2023-11-28T13:00:55.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.831+0000 7f1613fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16140c3d40 con 0x7f1614159f60 2023-11-28T13:00:55.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.831+0000 7f1613fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16140c6410 con 0x7f16140affb0 2023-11-28T13:00:55.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.831+0000 7f1612ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f161406ade0 0x7f16140b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:55.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.831+0000 7f1612ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f161406ade0 0x7f16140b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44442/0 (socket says 172.21.15.82:44442) 2023-11-28T13:00:55.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.831+0000 7f1612ffd700 1 -- 172.21.15.82:0/272101776 learned_addr learned my addr 172.21.15.82:0/272101776 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:55.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.831+0000 7f16137fe700 1 --2- 172.21.15.82:0/272101776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1614159f60 0x7f16141477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:55.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.831+0000 7f16127fc700 1 --2- 172.21.15.82:0/272101776 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16140affb0 0x7f16141472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:55.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.831+0000 7f1612ffd700 1 -- 172.21.15.82:0/272101776 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16140affb0 msgr2=0x7f16141472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.831+0000 7f1612ffd700 1 --2- 172.21.15.82:0/272101776 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16140affb0 0x7f16141472a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.831+0000 7f1612ffd700 1 -- 172.21.15.82:0/272101776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1614159f60 msgr2=0x7f16141477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.831+0000 7f1612ffd700 1 --2- 172.21.15.82:0/272101776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1614159f60 0x7f16141477e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.831+0000 7f1612ffd700 1 -- 172.21.15.82:0/272101776 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c0094b0 con 0x7f161406ade0 2023-11-28T13:00:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.835+0000 7f1612ffd700 1 --2- 172.21.15.82:0/272101776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f161406ade0 0x7f16140b3600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00e870 tx=0x7f15fc00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.835+0000 7f160b7fe700 1 -- 172.21.15.82:0/272101776 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0095a0 con 0x7f161406ade0 2023-11-28T13:00:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.835+0000 7f160b7fe700 1 -- 172.21.15.82:0/272101776 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc013680 con 0x7f161406ade0 2023-11-28T13:00:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.835+0000 7f160b7fe700 1 -- 172.21.15.82:0/272101776 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0139f0 con 0x7f161406ade0 2023-11-28T13:00:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.835+0000 7f1613fff700 1 -- 172.21.15.82:0/272101776 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16140c96c0 con 0x7f161406ade0 2023-11-28T13:00:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.835+0000 7f1613fff700 1 -- 172.21.15.82:0/272101776 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1614071f80 con 0x7f161406ade0 2023-11-28T13:00:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.835+0000 7f1613fff700 1 -- 172.21.15.82:0/272101776 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16140c99a0 con 0x7f161406ade0 2023-11-28T13:00:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.835+0000 7f160b7fe700 1 -- 172.21.15.82:0/272101776 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f15fc019030 con 0x7f161406ade0 2023-11-28T13:00:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.835+0000 7f160b7fe700 1 --2- 172.21.15.82:0/272101776 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f15f4064ee0 0x7f15f4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.835+0000 7f160b7fe700 1 -- 172.21.15.82:0/272101776 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15fc081cf0 con 0x7f161406ade0 2023-11-28T13:00:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.835+0000 7f16127fc700 1 --2- 172.21.15.82:0/272101776 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f15f4064ee0 0x7f15f4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:55.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.835+0000 7f16127fc700 1 --2- 172.21.15.82:0/272101776 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f15f4064ee0 0x7f15f4067390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1614155fb0 tx=0x7f1604001b70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:55.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:55.847+0000 7f160b7fe700 1 -- 172.21.15.82:0/272101776 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f15fc04fd20 con 0x7f161406ade0 2023-11-28T13:00:56.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.007+0000 7f1613fff700 1 -- 172.21.15.82:0/272101776 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f16140b0fc0 con 0x7f161406ade0 2023-11-28T13:00:56.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.007+0000 7f160b7fe700 1 -- 172.21.15.82:0/272101776 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f15fc053340 con 0x7f161406ade0 2023-11-28T13:00:56.011 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:00:56.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.007+0000 7f1613fff700 1 -- 172.21.15.82:0/272101776 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f15f4064ee0 msgr2=0x7f15f4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:56.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.007+0000 7f1613fff700 1 --2- 172.21.15.82:0/272101776 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f15f4064ee0 0x7f15f4067390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1614155fb0 tx=0x7f1604001b70 comp rx=0 tx=0).stop 2023-11-28T13:00:56.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.007+0000 7f1613fff700 1 -- 172.21.15.82:0/272101776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f161406ade0 msgr2=0x7f16140b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:56.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.007+0000 7f1613fff700 1 --2- 172.21.15.82:0/272101776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f161406ade0 0x7f16140b3600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00e870 tx=0x7f15fc00eb80 comp rx=0 tx=0).stop 2023-11-28T13:00:56.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.007+0000 7f1613fff700 1 -- 172.21.15.82:0/272101776 shutdown_connections 2023-11-28T13:00:56.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.007+0000 7f1613fff700 1 --2- 172.21.15.82:0/272101776 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f15f4064ee0 0x7f15f4067390 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.007+0000 7f1613fff700 1 --2- 172.21.15.82:0/272101776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1614159f60 0x7f16141477e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.007+0000 7f1613fff700 1 --2- 172.21.15.82:0/272101776 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16140affb0 0x7f16141472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.007+0000 7f1613fff700 1 --2- 172.21.15.82:0/272101776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f161406ade0 0x7f16140b3600 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.007+0000 7f1613fff700 1 -- 172.21.15.82:0/272101776 >> 172.21.15.82:0/272101776 conn(0x7f16140cafb0 msgr2=0x7f16140aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:56.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.007+0000 7f1613fff700 1 -- 172.21.15.82:0/272101776 shutdown_connections 2023-11-28T13:00:56.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.007+0000 7f1613fff700 1 -- 172.21.15.82:0/272101776 wait complete. 2023-11-28T13:00:56.033 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T13:00:56.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.147+0000 7f386a869700 1 Processor -- start 2023-11-28T13:00:56.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.147+0000 7f386a869700 1 -- start start 2023-11-28T13:00:56.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.147+0000 7f386a869700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3864150ee0 0x7f3864070120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:56.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.147+0000 7f386a869700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3864070660 0x7f386406ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:56.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.147+0000 7f386a869700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3864069bc0 con 0x7f386406b180 2023-11-28T13:00:56.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.147+0000 7f386a869700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3864069e80 con 0x7f3864070660 2023-11-28T13:00:56.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.147+0000 7f386a869700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386406a160 con 0x7f3864150ee0 2023-11-28T13:00:56.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f3869066700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3864070660 0x7f386406ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:56.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f3869066700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3864070660 0x7f386406ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44446/0 (socket says 172.21.15.82:44446) 2023-11-28T13:00:56.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f3869066700 1 -- 172.21.15.82:0/2860764928 learned_addr learned my addr 172.21.15.82:0/2860764928 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:56.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f3869867700 1 --2- 172.21.15.82:0/2860764928 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3864150ee0 0x7f3864070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:56.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f3869066700 1 -- 172.21.15.82:0/2860764928 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3864150ee0 msgr2=0x7f3864070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:56.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f3869066700 1 --2- 172.21.15.82:0/2860764928 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3864150ee0 0x7f3864070120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f3869066700 1 -- 172.21.15.82:0/2860764928 >> v1:172.21.15.114:6789/0 conn(0x7f386406b180 legacy=0x7f38640ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:56.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f3869066700 1 -- 172.21.15.82:0/2860764928 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386406a440 con 0x7f3864070660 2023-11-28T13:00:56.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f3869066700 1 --2- 172.21.15.82:0/2860764928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3864070660 0x7f386406ac40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3854009910 tx=0x7f3854009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800b199c315289fa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:56.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f3868865700 1 -- 172.21.15.82:0/2860764928 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385400ba60 con 0x7f3864070660 2023-11-28T13:00:56.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f3868865700 1 -- 172.21.15.82:0/2860764928 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385400bbc0 con 0x7f3864070660 2023-11-28T13:00:56.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f3868865700 1 -- 172.21.15.82:0/2860764928 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854009e60 con 0x7f3864070660 2023-11-28T13:00:56.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f386a869700 1 -- 172.21.15.82:0/2860764928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3864070660 msgr2=0x7f386406ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:56.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f386a869700 1 --2- 172.21.15.82:0/2860764928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3864070660 0x7f386406ac40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3854009910 tx=0x7f3854009c20 comp rx=0 tx=0).stop 2023-11-28T13:00:56.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f386a869700 1 -- 172.21.15.82:0/2860764928 shutdown_connections 2023-11-28T13:00:56.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f386a869700 1 --2- 172.21.15.82:0/2860764928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3864070660 0x7f386406ac40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f386a869700 1 --2- 172.21.15.82:0/2860764928 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3864150ee0 0x7f3864070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f386a869700 1 -- 172.21.15.82:0/2860764928 >> 172.21.15.82:0/2860764928 conn(0x7f38640ce630 msgr2=0x7f38640cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:56.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f386a869700 1 -- 172.21.15.82:0/2860764928 shutdown_connections 2023-11-28T13:00:56.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f386a869700 1 -- 172.21.15.82:0/2860764928 wait complete. 2023-11-28T13:00:56.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f386a869700 1 Processor -- start 2023-11-28T13:00:56.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f386a869700 1 -- start start 2023-11-28T13:00:56.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f386a869700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f386406b180 0x7f38640cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:56.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f386a869700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3864070660 0x7f38641460b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:56.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f386a869700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3864150ee0 0x7f38640cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:56.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f386a869700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3864155d80 con 0x7f3864150ee0 2023-11-28T13:00:56.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f386a869700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3864156060 con 0x7f3864070660 2023-11-28T13:00:56.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.151+0000 7f386a869700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3864156340 con 0x7f386406b180 2023-11-28T13:00:56.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.155+0000 7f386a068700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3864150ee0 0x7f38640cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:56.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.155+0000 7f3869867700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f386406b180 0x7f38640cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:56.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.155+0000 7f386a068700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3864150ee0 0x7f38640cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44462/0 (socket says 172.21.15.82:44462) 2023-11-28T13:00:56.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.155+0000 7f386a068700 1 -- 172.21.15.82:0/1266237561 learned_addr learned my addr 172.21.15.82:0/1266237561 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:56.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.155+0000 7f3869066700 1 --2- 172.21.15.82:0/1266237561 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3864070660 0x7f38641460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:56.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.155+0000 7f386a068700 1 -- 172.21.15.82:0/1266237561 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f386406b180 msgr2=0x7f38640cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:56.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.155+0000 7f386a068700 1 --2- 172.21.15.82:0/1266237561 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f386406b180 0x7f38640cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.155+0000 7f386a068700 1 -- 172.21.15.82:0/1266237561 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3864070660 msgr2=0x7f38641460b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:56.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.155+0000 7f386a068700 1 --2- 172.21.15.82:0/1266237561 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3864070660 0x7f38641460b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.155+0000 7f386a068700 1 -- 172.21.15.82:0/1266237561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3854009570 con 0x7f3864150ee0 2023-11-28T13:00:56.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.155+0000 7f3869066700 1 --2- 172.21.15.82:0/1266237561 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3864070660 0x7f38641460b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:56.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.155+0000 7f386a068700 1 --2- 172.21.15.82:0/1266237561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3864150ee0 0x7f38640cafb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f385c00cbd0 tx=0x7f385c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:56.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.155+0000 7f385a7fc700 1 -- 172.21.15.82:0/1266237561 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c003c40 con 0x7f3864150ee0 2023-11-28T13:00:56.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.155+0000 7f385a7fc700 1 -- 172.21.15.82:0/1266237561 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c003da0 con 0x7f3864150ee0 2023-11-28T13:00:56.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.155+0000 7f386a869700 1 -- 172.21.15.82:0/1266237561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38641512b0 con 0x7f3864150ee0 2023-11-28T13:00:56.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.155+0000 7f385a7fc700 1 -- 172.21.15.82:0/1266237561 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c00ab40 con 0x7f3864150ee0 2023-11-28T13:00:56.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.155+0000 7f386a869700 1 -- 172.21.15.82:0/1266237561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386406a720 con 0x7f3864150ee0 2023-11-28T13:00:56.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.155+0000 7f386a869700 1 -- 172.21.15.82:0/1266237561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3864065fc0 con 0x7f3864150ee0 2023-11-28T13:00:56.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.155+0000 7f385a7fc700 1 -- 172.21.15.82:0/1266237561 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f385c010050 con 0x7f3864150ee0 2023-11-28T13:00:56.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.155+0000 7f385a7fc700 1 --2- 172.21.15.82:0/1266237561 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3848064ee0 0x7f3848067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:56.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.155+0000 7f3869867700 1 --2- 172.21.15.82:0/1266237561 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3848064ee0 0x7f3848067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:56.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.159+0000 7f385a7fc700 1 -- 172.21.15.82:0/1266237561 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f385c081d60 con 0x7f3864150ee0 2023-11-28T13:00:56.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.159+0000 7f3869867700 1 --2- 172.21.15.82:0/1266237561 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3848064ee0 0x7f3848067390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3860007a60 tx=0x7f3860008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:56.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.163+0000 7f385a7fc700 1 -- 172.21.15.82:0/1266237561 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f385c04ff00 con 0x7f3864150ee0 2023-11-28T13:00:56.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.323+0000 7f386a869700 1 -- 172.21.15.82:0/1266237561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f38640cde30 con 0x7f3864150ee0 2023-11-28T13:00:56.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.327+0000 7f385a7fc700 1 -- 172.21.15.82:0/1266237561 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f385c053520 con 0x7f3864150ee0 2023-11-28T13:00:56.331 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-11-28T13:00:56.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.331+0000 7f386a869700 1 -- 172.21.15.82:0/1266237561 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3848064ee0 msgr2=0x7f3848067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:56.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.331+0000 7f386a869700 1 --2- 172.21.15.82:0/1266237561 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3848064ee0 0x7f3848067390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3860007a60 tx=0x7f3860008040 comp rx=0 tx=0).stop 2023-11-28T13:00:56.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.331+0000 7f386a869700 1 -- 172.21.15.82:0/1266237561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3864150ee0 msgr2=0x7f38640cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:56.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.331+0000 7f386a869700 1 --2- 172.21.15.82:0/1266237561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3864150ee0 0x7f38640cafb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f385c00cbd0 tx=0x7f385c00cee0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.331+0000 7f386a869700 1 -- 172.21.15.82:0/1266237561 shutdown_connections 2023-11-28T13:00:56.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.331+0000 7f386a869700 1 --2- 172.21.15.82:0/1266237561 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3848064ee0 0x7f3848067390 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.331+0000 7f386a869700 1 --2- 172.21.15.82:0/1266237561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3864150ee0 0x7f38640cafb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.331+0000 7f386a869700 1 --2- 172.21.15.82:0/1266237561 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3864070660 0x7f38641460b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.331+0000 7f386a869700 1 --2- 172.21.15.82:0/1266237561 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f386406b180 0x7f38640cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.331+0000 7f386a869700 1 -- 172.21.15.82:0/1266237561 >> 172.21.15.82:0/1266237561 conn(0x7f38640ce630 msgr2=0x7f386415a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:56.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.331+0000 7f386a869700 1 -- 172.21.15.82:0/1266237561 shutdown_connections 2023-11-28T13:00:56.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.331+0000 7f386a869700 1 -- 172.21.15.82:0/1266237561 wait complete. 2023-11-28T13:00:56.352 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T13:00:56.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.463+0000 7fad108bf700 1 Processor -- start 2023-11-28T13:00:56.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.463+0000 7fad108bf700 1 -- start start 2023-11-28T13:00:56.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad108bf700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fad0c0cef40 0x7fad0c06b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:56.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad108bf700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fad0c06bd40 0x7fad0c0d0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:56.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad108bf700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0c0cd910 con 0x7fad0c0b8160 2023-11-28T13:00:56.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad108bf700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0c06afa0 con 0x7fad0c06bd40 2023-11-28T13:00:56.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad108bf700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0c0d0a20 con 0x7fad0c0cef40 2023-11-28T13:00:56.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad0ad9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fad0c06bd40 0x7fad0c0d0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad0ad9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fad0c06bd40 0x7fad0c0d0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44468/0 (socket says 172.21.15.82:44468) 2023-11-28T13:00:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad0ad9d700 1 -- 172.21.15.82:0/2535486650 learned_addr learned my addr 172.21.15.82:0/2535486650 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad09d9b700 1 --2- 172.21.15.82:0/2535486650 >> v2:172.21.15.114:3300/0 conn(0x7fad0c0cef40 0x7fad0c06b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad0ad9d700 1 -- 172.21.15.82:0/2535486650 >> v2:172.21.15.114:3300/0 conn(0x7fad0c0cef40 msgr2=0x7fad0c06b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad0ad9d700 1 --2- 172.21.15.82:0/2535486650 >> v2:172.21.15.114:3300/0 conn(0x7fad0c0cef40 0x7fad0c06b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad0ad9d700 1 -- 172.21.15.82:0/2535486650 >> v1:172.21.15.114:6789/0 conn(0x7fad0c0b8160 legacy=0x7fad0c0cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad0ad9d700 1 -- 172.21.15.82:0/2535486650 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c06a700 con 0x7fad0c06bd40 2023-11-28T13:00:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad0ad9d700 1 --2- 172.21.15.82:0/2535486650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad0c06bd40 0x7fad0c0d0e40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0cf590 tx=0x7fad0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a7b872f3e0925f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad0959a700 1 -- 172.21.15.82:0/2535486650 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0400e070 con 0x7fad0c06bd40 2023-11-28T13:00:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad0959a700 1 -- 172.21.15.82:0/2535486650 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0400b8d0 con 0x7fad0c06bd40 2023-11-28T13:00:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad0959a700 1 -- 172.21.15.82:0/2535486650 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0400bc80 con 0x7fad0c06bd40 2023-11-28T13:00:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad108bf700 1 -- 172.21.15.82:0/2535486650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad0c06bd40 msgr2=0x7fad0c0d0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad108bf700 1 --2- 172.21.15.82:0/2535486650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad0c06bd40 0x7fad0c0d0e40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0cf590 tx=0x7fad0400b330 comp rx=0 tx=0).stop 2023-11-28T13:00:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad108bf700 1 -- 172.21.15.82:0/2535486650 shutdown_connections 2023-11-28T13:00:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad108bf700 1 --2- 172.21.15.82:0/2535486650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad0c06bd40 0x7fad0c0d0e40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad108bf700 1 --2- 172.21.15.82:0/2535486650 >> v2:172.21.15.114:3300/0 conn(0x7fad0c0cef40 0x7fad0c06b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad108bf700 1 -- 172.21.15.82:0/2535486650 >> 172.21.15.82:0/2535486650 conn(0x7fad0c0d02c0 msgr2=0x7fad0c0d2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad108bf700 1 -- 172.21.15.82:0/2535486650 shutdown_connections 2023-11-28T13:00:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.467+0000 7fad108bf700 1 -- 172.21.15.82:0/2535486650 wait complete. 2023-11-28T13:00:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.471+0000 7fad108bf700 1 Processor -- start 2023-11-28T13:00:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.471+0000 7fad108bf700 1 -- start start 2023-11-28T13:00:56.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.471+0000 7fad108bf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad0c06bd40 0x7fad0c0b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7fad108bf700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad0c0b8160 0x7fad0c15f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7fad108bf700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad0c0cef40 0x7fad0c1f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7fad108bf700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c0cacd0 con 0x7fad0c06bd40 2023-11-28T13:00:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7fad108bf700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c0b54b0 con 0x7fad0c0cef40 2023-11-28T13:00:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7fad108bf700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c0caf20 con 0x7fad0c0b8160 2023-11-28T13:00:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7fad0a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad0c06bd40 0x7fad0c0b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:56.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7fad0a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad0c06bd40 0x7fad0c0b4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44480/0 (socket says 172.21.15.82:44480) 2023-11-28T13:00:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7fad0a59c700 1 -- 172.21.15.82:0/3255544265 learned_addr learned my addr 172.21.15.82:0/3255544265 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7fad09d9b700 1 --2- 172.21.15.82:0/3255544265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad0c0b8160 0x7fad0c15f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:56.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7fad0ad9d700 1 --2- 172.21.15.82:0/3255544265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad0c0cef40 0x7fad0c1f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:56.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7fad0a59c700 1 -- 172.21.15.82:0/3255544265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad0c0b8160 msgr2=0x7fad0c15f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:56.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7fad0a59c700 1 --2- 172.21.15.82:0/3255544265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad0c0b8160 0x7fad0c15f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7fad0a59c700 1 -- 172.21.15.82:0/3255544265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad0c0cef40 msgr2=0x7fad0c1f2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7fad0a59c700 1 --2- 172.21.15.82:0/3255544265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad0c0cef40 0x7fad0c1f2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7fad0a59c700 1 -- 172.21.15.82:0/3255544265 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad04009b30 con 0x7fad0c06bd40 2023-11-28T13:00:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7fad0a59c700 1 --2- 172.21.15.82:0/3255544265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad0c06bd40 0x7fad0c0b4f70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fad0000c500 tx=0x7fad0000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:56.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7facfaffd700 1 -- 172.21.15.82:0/3255544265 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad000052d0 con 0x7fad0c06bd40 2023-11-28T13:00:56.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7facfaffd700 1 -- 172.21.15.82:0/3255544265 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad00005430 con 0x7fad0c06bd40 2023-11-28T13:00:56.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7fad108bf700 1 -- 172.21.15.82:0/3255544265 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0c06acc0 con 0x7fad0c06bd40 2023-11-28T13:00:56.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7facfaffd700 1 -- 172.21.15.82:0/3255544265 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad000055a0 con 0x7fad0c06bd40 2023-11-28T13:00:56.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7fad108bf700 1 -- 172.21.15.82:0/3255544265 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0c06a9e0 con 0x7fad0c06bd40 2023-11-28T13:00:56.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.475+0000 7fad108bf700 1 -- 172.21.15.82:0/3255544265 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0c0b8530 con 0x7fad0c06bd40 2023-11-28T13:00:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.479+0000 7facfaffd700 1 -- 172.21.15.82:0/3255544265 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fad00010050 con 0x7fad0c06bd40 2023-11-28T13:00:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.479+0000 7facfaffd700 1 --2- 172.21.15.82:0/3255544265 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7facec064ee0 0x7facec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.479+0000 7fad09d9b700 1 --2- 172.21.15.82:0/3255544265 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7facec064ee0 0x7facec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.479+0000 7facfaffd700 1 -- 172.21.15.82:0/3255544265 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fad000810c0 con 0x7fad0c06bd40 2023-11-28T13:00:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.479+0000 7fad09d9b700 1 --2- 172.21.15.82:0/3255544265 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7facec064ee0 0x7facec067390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0ccc80 tx=0x7facfc009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:56.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.483+0000 7facfaffd700 1 -- 172.21.15.82:0/3255544265 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fad00049400 con 0x7fad0c06bd40 2023-11-28T13:00:56.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.651+0000 7fad108bf700 1 -- 172.21.15.82:0/3255544265 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fad0c0d24a0 con 0x7fad0c06bd40 2023-11-28T13:00:56.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.651+0000 7facfaffd700 1 -- 172.21.15.82:0/3255544265 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fad0004f090 con 0x7fad0c06bd40 2023-11-28T13:00:56.657 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-11-28T13:00:56.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.655+0000 7fad108bf700 1 -- 172.21.15.82:0/3255544265 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7facec064ee0 msgr2=0x7facec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:56.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.655+0000 7fad108bf700 1 --2- 172.21.15.82:0/3255544265 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7facec064ee0 0x7facec067390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0ccc80 tx=0x7facfc009240 comp rx=0 tx=0).stop 2023-11-28T13:00:56.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.655+0000 7fad108bf700 1 -- 172.21.15.82:0/3255544265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad0c06bd40 msgr2=0x7fad0c0b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:56.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.655+0000 7fad108bf700 1 --2- 172.21.15.82:0/3255544265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad0c06bd40 0x7fad0c0b4f70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fad0000c500 tx=0x7fad0000c810 comp rx=0 tx=0).stop 2023-11-28T13:00:56.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.655+0000 7fad108bf700 1 -- 172.21.15.82:0/3255544265 shutdown_connections 2023-11-28T13:00:56.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.655+0000 7fad108bf700 1 --2- 172.21.15.82:0/3255544265 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7facec064ee0 0x7facec067390 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.655+0000 7fad108bf700 1 --2- 172.21.15.82:0/3255544265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad0c0cef40 0x7fad0c1f2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.655+0000 7fad108bf700 1 --2- 172.21.15.82:0/3255544265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fad0c0b8160 0x7fad0c15f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.655+0000 7fad108bf700 1 --2- 172.21.15.82:0/3255544265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad0c06bd40 0x7fad0c0b4f70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.655+0000 7fad108bf700 1 -- 172.21.15.82:0/3255544265 >> 172.21.15.82:0/3255544265 conn(0x7fad0c0d02c0 msgr2=0x7fad0c15fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:56.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.655+0000 7fad108bf700 1 -- 172.21.15.82:0/3255544265 shutdown_connections 2023-11-28T13:00:56.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.655+0000 7fad108bf700 1 -- 172.21.15.82:0/3255544265 wait complete. 2023-11-28T13:00:56.671 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:00:56.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.775+0000 7f70f748a700 1 Processor -- start 2023-11-28T13:00:56.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.775+0000 7f70f748a700 1 -- start start 2023-11-28T13:00:56.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.775+0000 7f70f748a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f70f00cd030 0x7f70f00cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:56.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.775+0000 7f70f748a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f70f006abd0 0x7f70f006b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:56.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.775+0000 7f70f748a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f00ccb60 con 0x7f70f015c390 2023-11-28T13:00:56.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.775+0000 7f70f748a700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f006b590 con 0x7f70f006abd0 2023-11-28T13:00:56.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.775+0000 7f70f748a700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f00c48e0 con 0x7f70f00cd030 2023-11-28T13:00:56.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.775+0000 7f70f6488700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f70f015c390 0x7f70f00ab8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58286/0 (socket says 172.21.15.82:58286) 2023-11-28T13:00:56.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.775+0000 7f70f6c89700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f70f006abd0 0x7f70f006b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:56.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.775+0000 7f70f6488700 1 -- 172.21.15.82:0/1839698790 learned_addr learned my addr 172.21.15.82:0/1839698790 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:56.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.775+0000 7f70f5c87700 1 --2- 172.21.15.82:0/1839698790 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f70f00cd030 0x7f70f00cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:56.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.775+0000 7f70f6c89700 1 -- 172.21.15.82:0/1839698790 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f70f00cd030 msgr2=0x7f70f00cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:56.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.775+0000 7f70f6c89700 1 --2- 172.21.15.82:0/1839698790 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f70f00cd030 0x7f70f00cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.775+0000 7f70f6c89700 1 -- 172.21.15.82:0/1839698790 >> v1:172.21.15.82:6789/0 conn(0x7f70f015c390 legacy=0x7f70f00ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:56.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.775+0000 7f70f6c89700 1 -- 172.21.15.82:0/1839698790 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f015c760 con 0x7f70f006abd0 2023-11-28T13:00:56.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.775+0000 7f70f6c89700 1 --2- 172.21.15.82:0/1839698790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70f006abd0 0x7f70f006b050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009d90 tx=0x7f70e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c15474381b65bd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:56.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.775+0000 7f70f5486700 1 -- 172.21.15.82:0/1839698790 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e800e070 con 0x7f70f006abd0 2023-11-28T13:00:56.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.779+0000 7f70f5486700 1 -- 172.21.15.82:0/1839698790 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e800bb20 con 0x7f70f006abd0 2023-11-28T13:00:56.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.779+0000 7f70f5486700 1 -- 172.21.15.82:0/1839698790 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e8012430 con 0x7f70f006abd0 2023-11-28T13:00:56.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.779+0000 7f70f748a700 1 -- 172.21.15.82:0/1839698790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70f006abd0 msgr2=0x7f70f006b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:56.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.779+0000 7f70f748a700 1 --2- 172.21.15.82:0/1839698790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70f006abd0 0x7f70f006b050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009d90 tx=0x7f70e800b330 comp rx=0 tx=0).stop 2023-11-28T13:00:56.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.779+0000 7f70f748a700 1 -- 172.21.15.82:0/1839698790 shutdown_connections 2023-11-28T13:00:56.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.779+0000 7f70f748a700 1 --2- 172.21.15.82:0/1839698790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70f006abd0 0x7f70f006b050 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.779+0000 7f70f748a700 1 --2- 172.21.15.82:0/1839698790 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f70f00cd030 0x7f70f00cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.779+0000 7f70f748a700 1 -- 172.21.15.82:0/1839698790 >> 172.21.15.82:0/1839698790 conn(0x7f70f00cf6a0 msgr2=0x7f70f00cb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:56.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.779+0000 7f70f748a700 1 -- 172.21.15.82:0/1839698790 shutdown_connections 2023-11-28T13:00:56.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.779+0000 7f70f748a700 1 -- 172.21.15.82:0/1839698790 wait complete. 2023-11-28T13:00:56.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.779+0000 7f70f748a700 1 Processor -- start 2023-11-28T13:00:56.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.779+0000 7f70f748a700 1 -- start start 2023-11-28T13:00:56.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.779+0000 7f70f748a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70f006abd0 0x7f70f015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:56.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.779+0000 7f70f748a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f70f00cd030 0x7f70f00c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:56.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.779+0000 7f70f748a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70f015c390 0x7f70f006c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:56.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.779+0000 7f70f748a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f0156250 con 0x7f70f015c390 2023-11-28T13:00:56.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.779+0000 7f70f748a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f0157090 con 0x7f70f006abd0 2023-11-28T13:00:56.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.779+0000 7f70f748a700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f0156480 con 0x7f70f00cd030 2023-11-28T13:00:56.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.783+0000 7f70f6c89700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70f015c390 0x7f70f006c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:56.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.783+0000 7f70f6488700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70f006abd0 0x7f70f015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:56.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.783+0000 7f70f5c87700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f70f00cd030 0x7f70f00c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:56.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.783+0000 7f70f6c89700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70f015c390 0x7f70f006c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42180/0 (socket says 172.21.15.82:42180) 2023-11-28T13:00:56.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.783+0000 7f70f6c89700 1 -- 172.21.15.82:0/2537759083 learned_addr learned my addr 172.21.15.82:0/2537759083 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:56.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.783+0000 7f70f6c89700 1 -- 172.21.15.82:0/2537759083 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f70f00cd030 msgr2=0x7f70f00c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:56.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.783+0000 7f70f6c89700 1 --2- 172.21.15.82:0/2537759083 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f70f00cd030 0x7f70f00c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.783+0000 7f70f6c89700 1 -- 172.21.15.82:0/2537759083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70f006abd0 msgr2=0x7f70f015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:56.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.783+0000 7f70f6c89700 1 --2- 172.21.15.82:0/2537759083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70f006abd0 0x7f70f015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.783+0000 7f70f6c89700 1 -- 172.21.15.82:0/2537759083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e8009a70 con 0x7f70f015c390 2023-11-28T13:00:56.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.783+0000 7f70f6c89700 1 --2- 172.21.15.82:0/2537759083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70f015c390 0x7f70f006c4b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f70e8014040 tx=0x7f70e8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:56.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.783+0000 7f70e6ffd700 1 -- 172.21.15.82:0/2537759083 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e8012430 con 0x7f70f015c390 2023-11-28T13:00:56.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.783+0000 7f70e6ffd700 1 -- 172.21.15.82:0/2537759083 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e8020070 con 0x7f70f015c390 2023-11-28T13:00:56.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.783+0000 7f70f748a700 1 -- 172.21.15.82:0/2537759083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f00adb70 con 0x7f70f015c390 2023-11-28T13:00:56.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.783+0000 7f70e6ffd700 1 -- 172.21.15.82:0/2537759083 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e8004280 con 0x7f70f015c390 2023-11-28T13:00:56.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.783+0000 7f70f748a700 1 -- 172.21.15.82:0/2537759083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f00ccd90 con 0x7f70f015c390 2023-11-28T13:00:56.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.783+0000 7f70f748a700 1 -- 172.21.15.82:0/2537759083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f00ade50 con 0x7f70f015c390 2023-11-28T13:00:56.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.787+0000 7f70e6ffd700 1 -- 172.21.15.82:0/2537759083 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f70e802e070 con 0x7f70f015c390 2023-11-28T13:00:56.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.787+0000 7f70e6ffd700 1 --2- 172.21.15.82:0/2537759083 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f70d4064f10 0x7f70d40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:56.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.787+0000 7f70e6ffd700 1 -- 172.21.15.82:0/2537759083 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f70e8022070 con 0x7f70f015c390 2023-11-28T13:00:56.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.787+0000 7f70f6488700 1 --2- 172.21.15.82:0/2537759083 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f70d4064f10 0x7f70d40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:56.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.787+0000 7f70f6488700 1 --2- 172.21.15.82:0/2537759083 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f70d4064f10 0x7f70d40673c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f70ec005930 tx=0x7f70ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:56.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.795+0000 7f70e6ffd700 1 -- 172.21.15.82:0/2537759083 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f70e8051bb0 con 0x7f70f015c390 2023-11-28T13:00:56.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.955+0000 7f70f748a700 1 -- 172.21.15.82:0/2537759083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70f0157230 con 0x7f70f015c390 2023-11-28T13:00:56.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.959+0000 7f70e6ffd700 1 -- 172.21.15.82:0/2537759083 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17811 (secure 0 0 0) 0x7f70e80551d0 con 0x7f70f015c390 2023-11-28T13:00:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:56.965 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:00:26.981345+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:00:24.360641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T13:00:24.960863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:00:56.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.959+0000 7f70f748a700 1 -- 172.21.15.82:0/2537759083 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f70d4064f10 msgr2=0x7f70d40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:56.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.959+0000 7f70f748a700 1 --2- 172.21.15.82:0/2537759083 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f70d4064f10 0x7f70d40673c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f70ec005930 tx=0x7f70ec009040 comp rx=0 tx=0).stop 2023-11-28T13:00:56.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.959+0000 7f70f748a700 1 -- 172.21.15.82:0/2537759083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70f015c390 msgr2=0x7f70f006c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:56.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.959+0000 7f70f748a700 1 --2- 172.21.15.82:0/2537759083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70f015c390 0x7f70f006c4b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f70e8014040 tx=0x7f70e8004af0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.963+0000 7f70f748a700 1 -- 172.21.15.82:0/2537759083 shutdown_connections 2023-11-28T13:00:56.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.963+0000 7f70f748a700 1 --2- 172.21.15.82:0/2537759083 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f70d4064f10 0x7f70d40673c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.963+0000 7f70f748a700 1 --2- 172.21.15.82:0/2537759083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70f015c390 0x7f70f006c4b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.963+0000 7f70f748a700 1 --2- 172.21.15.82:0/2537759083 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f70f00cd030 0x7f70f00c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.963+0000 7f70f748a700 1 --2- 172.21.15.82:0/2537759083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70f006abd0 0x7f70f015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:56.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.963+0000 7f70f748a700 1 -- 172.21.15.82:0/2537759083 >> 172.21.15.82:0/2537759083 conn(0x7f70f00cf6a0 msgr2=0x7f70f0155a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:56.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.963+0000 7f70f748a700 1 -- 172.21.15.82:0/2537759083 shutdown_connections 2023-11-28T13:00:56.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:56.963+0000 7f70f748a700 1 -- 172.21.15.82:0/2537759083 wait complete. 2023-11-28T13:00:56.981 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T13:00:24.360641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T13:00:24.960863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:00:56.982 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:00:57.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.095+0000 7f522bfff700 1 Processor -- start 2023-11-28T13:00:57.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.095+0000 7f522bfff700 1 -- start start 2023-11-28T13:00:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522bfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f522c0ce2d0 0x7f522c0ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f522c071110 0x7f522c071550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522bfff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f522c071a90 con 0x7f522c0cba10 2023-11-28T13:00:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522bfff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522c15a4b0 con 0x7f522c071110 2023-11-28T13:00:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522bfff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522c159930 con 0x7f522c0ce2d0 2023-11-28T13:00:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f522c071110 0x7f522c071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f522c071110 0x7f522c071550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42186/0 (socket says 172.21.15.82:42186) 2023-11-28T13:00:57.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522b7fe700 1 -- 172.21.15.82:0/3331727197 learned_addr learned my addr 172.21.15.82:0/3331727197 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:57.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522a7fc700 1 --2- 172.21.15.82:0/3331727197 >> v2:172.21.15.114:3300/0 conn(0x7f522c0ce2d0 0x7f522c0ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:57.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522b7fe700 1 -- 172.21.15.82:0/3331727197 >> v2:172.21.15.114:3300/0 conn(0x7f522c0ce2d0 msgr2=0x7f522c0ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:57.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522b7fe700 1 --2- 172.21.15.82:0/3331727197 >> v2:172.21.15.114:3300/0 conn(0x7f522c0ce2d0 0x7f522c0ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522b7fe700 1 -- 172.21.15.82:0/3331727197 >> v1:172.21.15.114:6789/0 conn(0x7f522c0cba10 legacy=0x7f522c0ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:57.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522b7fe700 1 -- 172.21.15.82:0/3331727197 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c159c10 con 0x7f522c071110 2023-11-28T13:00:57.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522a7fc700 1 --2- 172.21.15.82:0/3331727197 >> v2:172.21.15.114:3300/0 conn(0x7f522c0ce2d0 0x7f522c0ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:00:57.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522b7fe700 1 --2- 172.21.15.82:0/3331727197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f522c071110 0x7f522c071550 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f522c070f10 tx=0x7f522400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb62d23ebc29d09d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:57.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f5229ffb700 1 -- 172.21.15.82:0/3331727197 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522400e070 con 0x7f522c071110 2023-11-28T13:00:57.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f5229ffb700 1 -- 172.21.15.82:0/3331727197 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522400b9c0 con 0x7f522c071110 2023-11-28T13:00:57.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f5229ffb700 1 -- 172.21.15.82:0/3331727197 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522400bd70 con 0x7f522c071110 2023-11-28T13:00:57.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522bfff700 1 -- 172.21.15.82:0/3331727197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f522c071110 msgr2=0x7f522c071550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:57.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522bfff700 1 --2- 172.21.15.82:0/3331727197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f522c071110 0x7f522c071550 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f522c070f10 tx=0x7f522400b330 comp rx=0 tx=0).stop 2023-11-28T13:00:57.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522bfff700 1 -- 172.21.15.82:0/3331727197 shutdown_connections 2023-11-28T13:00:57.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522bfff700 1 --2- 172.21.15.82:0/3331727197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f522c071110 0x7f522c071550 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522bfff700 1 --2- 172.21.15.82:0/3331727197 >> v2:172.21.15.114:3300/0 conn(0x7f522c0ce2d0 0x7f522c0ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522bfff700 1 -- 172.21.15.82:0/3331727197 >> 172.21.15.82:0/3331727197 conn(0x7f522c0b1f50 msgr2=0x7f522c0cf790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:57.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522bfff700 1 -- 172.21.15.82:0/3331727197 shutdown_connections 2023-11-28T13:00:57.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.099+0000 7f522bfff700 1 -- 172.21.15.82:0/3331727197 wait complete. 2023-11-28T13:00:57.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.103+0000 7f522bfff700 1 Processor -- start 2023-11-28T13:00:57.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.103+0000 7f522bfff700 1 -- start start 2023-11-28T13:00:57.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.103+0000 7f522bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f522c071110 0x7f522c15b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:57.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.103+0000 7f522bfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f522c0cba10 0x7f522c15a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:57.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.103+0000 7f522bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f522c0ce2d0 0x7f522c155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:57.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.103+0000 7f522bfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c1f39f0 con 0x7f522c0ce2d0 2023-11-28T13:00:57.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.103+0000 7f522bfff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c1ef6f0 con 0x7f522c071110 2023-11-28T13:00:57.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.103+0000 7f522bfff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522c1f2d70 con 0x7f522c0cba10 2023-11-28T13:00:57.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.103+0000 7f522b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f522c0ce2d0 0x7f522c155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:57.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.103+0000 7f522b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f522c0ce2d0 0x7f522c155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42190/0 (socket says 172.21.15.82:42190) 2023-11-28T13:00:57.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.103+0000 7f522b7fe700 1 -- 172.21.15.82:0/3482161942 learned_addr learned my addr 172.21.15.82:0/3482161942 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:57.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.103+0000 7f522affd700 1 --2- 172.21.15.82:0/3482161942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f522c071110 0x7f522c15b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:57.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.103+0000 7f522a7fc700 1 --2- 172.21.15.82:0/3482161942 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f522c0cba10 0x7f522c15a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:57.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.103+0000 7f522b7fe700 1 -- 172.21.15.82:0/3482161942 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f522c0cba10 msgr2=0x7f522c15a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:57.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.103+0000 7f522b7fe700 1 --2- 172.21.15.82:0/3482161942 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f522c0cba10 0x7f522c15a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.103+0000 7f522b7fe700 1 -- 172.21.15.82:0/3482161942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f522c071110 msgr2=0x7f522c15b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:57.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.103+0000 7f522b7fe700 1 --2- 172.21.15.82:0/3482161942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f522c071110 0x7f522c15b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.103+0000 7f522b7fe700 1 -- 172.21.15.82:0/3482161942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5224009b30 con 0x7f522c0ce2d0 2023-11-28T13:00:57.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.103+0000 7f522b7fe700 1 --2- 172.21.15.82:0/3482161942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f522c0ce2d0 0x7f522c155610 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f522400b730 tx=0x7f5224004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:57.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.107+0000 7f52237fe700 1 -- 172.21.15.82:0/3482161942 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5224004870 con 0x7f522c0ce2d0 2023-11-28T13:00:57.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.107+0000 7f52237fe700 1 -- 172.21.15.82:0/3482161942 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52240099b0 con 0x7f522c0ce2d0 2023-11-28T13:00:57.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.107+0000 7f522bfff700 1 -- 172.21.15.82:0/3482161942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f522c15a1d0 con 0x7f522c0ce2d0 2023-11-28T13:00:57.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.107+0000 7f52237fe700 1 -- 172.21.15.82:0/3482161942 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522401b670 con 0x7f522c0ce2d0 2023-11-28T13:00:57.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.107+0000 7f522bfff700 1 -- 172.21.15.82:0/3482161942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f522c159ef0 con 0x7f522c0ce2d0 2023-11-28T13:00:57.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.107+0000 7f522bfff700 1 -- 172.21.15.82:0/3482161942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522c1594e0 con 0x7f522c0ce2d0 2023-11-28T13:00:57.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.107+0000 7f52237fe700 1 -- 172.21.15.82:0/3482161942 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f522402b070 con 0x7f522c0ce2d0 2023-11-28T13:00:57.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.107+0000 7f52237fe700 1 --2- 172.21.15.82:0/3482161942 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f520c064ee0 0x7f520c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:57.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.107+0000 7f522affd700 1 --2- 172.21.15.82:0/3482161942 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f520c064ee0 0x7f520c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:57.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.107+0000 7f52237fe700 1 -- 172.21.15.82:0/3482161942 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5224083570 con 0x7f522c0ce2d0 2023-11-28T13:00:57.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.107+0000 7f522affd700 1 --2- 172.21.15.82:0/3482161942 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f520c064ee0 0x7f520c067390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5214000f60 tx=0x7f5214009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:57.121 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:00:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.115+0000 7f52237fe700 1 -- 172.21.15.82:0/3482161942 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5224051710 con 0x7f522c0ce2d0 2023-11-28T13:00:57.124 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:00:57.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.279+0000 7f522bfff700 1 -- 172.21.15.82:0/3482161942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f522c1f3b30 con 0x7f522c0ce2d0 2023-11-28T13:00:57.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.279+0000 7f52237fe700 1 -- 172.21.15.82:0/3482161942 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f522c1f3b30 con 0x7f522c0ce2d0 2023-11-28T13:00:57.284 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:00:57.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.283+0000 7f522bfff700 1 -- 172.21.15.82:0/3482161942 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f520c064ee0 msgr2=0x7f520c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:57.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.283+0000 7f522bfff700 1 --2- 172.21.15.82:0/3482161942 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f520c064ee0 0x7f520c067390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5214000f60 tx=0x7f5214009040 comp rx=0 tx=0).stop 2023-11-28T13:00:57.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.283+0000 7f522bfff700 1 -- 172.21.15.82:0/3482161942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f522c0ce2d0 msgr2=0x7f522c155610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:57.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.283+0000 7f522bfff700 1 --2- 172.21.15.82:0/3482161942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f522c0ce2d0 0x7f522c155610 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f522400b730 tx=0x7f5224004af0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.283+0000 7f522bfff700 1 -- 172.21.15.82:0/3482161942 shutdown_connections 2023-11-28T13:00:57.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.283+0000 7f522bfff700 1 --2- 172.21.15.82:0/3482161942 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f520c064ee0 0x7f520c067390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.283+0000 7f522bfff700 1 --2- 172.21.15.82:0/3482161942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f522c0ce2d0 0x7f522c155610 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.283+0000 7f522bfff700 1 --2- 172.21.15.82:0/3482161942 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f522c0cba10 0x7f522c15a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.283+0000 7f522bfff700 1 --2- 172.21.15.82:0/3482161942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f522c071110 0x7f522c15b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.283+0000 7f522bfff700 1 -- 172.21.15.82:0/3482161942 >> 172.21.15.82:0/3482161942 conn(0x7f522c0b1f50 msgr2=0x7f522c158cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:57.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.283+0000 7f522bfff700 1 -- 172.21.15.82:0/3482161942 shutdown_connections 2023-11-28T13:00:57.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.283+0000 7f522bfff700 1 -- 172.21.15.82:0/3482161942 wait complete. 2023-11-28T13:00:57.298 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:00:57.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.411+0000 7feb5d149700 1 Processor -- start 2023-11-28T13:00:57.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.411+0000 7feb5d149700 1 -- start start 2023-11-28T13:00:57.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.411+0000 7feb5d149700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb58158eb0 0x7feb580c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:57.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.411+0000 7feb5d149700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feb580b0c70 0x7feb5815c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:57.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.411+0000 7feb5d149700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb580ad9b0 con 0x7feb580ae090 2023-11-28T13:00:57.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.411+0000 7feb5d149700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb580adee0 con 0x7feb580b0c70 2023-11-28T13:00:57.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.411+0000 7feb5d149700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb58159280 con 0x7feb58158eb0 2023-11-28T13:00:57.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.415+0000 7feb5c948700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feb580b0c70 0x7feb5815c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:57.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.415+0000 7feb57fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb58158eb0 0x7feb580c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:57.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.415+0000 7feb4f7fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7feb580ae090 0x7feb580b0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:35876/0 (socket says 172.21.15.82:35876) 2023-11-28T13:00:57.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.415+0000 7feb4f7fe700 1 -- 172.21.15.82:0/4150299160 learned_addr learned my addr 172.21.15.82:0/4150299160 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:57.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.415+0000 7feb5c948700 1 -- 172.21.15.82:0/4150299160 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb58158eb0 msgr2=0x7feb580c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:57.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.415+0000 7feb5c948700 1 --2- 172.21.15.82:0/4150299160 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb58158eb0 0x7feb580c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.415+0000 7feb5c948700 1 -- 172.21.15.82:0/4150299160 >> v1:172.21.15.114:6789/0 conn(0x7feb580ae090 legacy=0x7feb580b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:57.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.415+0000 7feb5c948700 1 -- 172.21.15.82:0/4150299160 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb58069e60 con 0x7feb580b0c70 2023-11-28T13:00:57.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.415+0000 7feb577fe700 1 -- 172.21.15.82:0/4150299160 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888476807 0 0) 0x7feb580ad9b0 con 0x7feb580ae090 2023-11-28T13:00:57.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.415+0000 7feb5c948700 1 --2- 172.21.15.82:0/4150299160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb580b0c70 0x7feb5815c9d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feb5000bfa0 tx=0x7feb5000d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7390a7ceedb12d9f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:57.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.415+0000 7feb577fe700 1 -- 172.21.15.82:0/4150299160 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb50010070 con 0x7feb580b0c70 2023-11-28T13:00:57.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.415+0000 7feb577fe700 1 -- 172.21.15.82:0/4150299160 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5000b2e0 con 0x7feb580b0c70 2023-11-28T13:00:57.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.415+0000 7feb577fe700 1 -- 172.21.15.82:0/4150299160 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5000dc40 con 0x7feb580b0c70 2023-11-28T13:00:57.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.415+0000 7feb5d149700 1 -- 172.21.15.82:0/4150299160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb580b0c70 msgr2=0x7feb5815c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:57.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.415+0000 7feb5d149700 1 --2- 172.21.15.82:0/4150299160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb580b0c70 0x7feb5815c9d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feb5000bfa0 tx=0x7feb5000d330 comp rx=0 tx=0).stop 2023-11-28T13:00:57.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.415+0000 7feb5d149700 1 -- 172.21.15.82:0/4150299160 shutdown_connections 2023-11-28T13:00:57.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.415+0000 7feb5d149700 1 --2- 172.21.15.82:0/4150299160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb580b0c70 0x7feb5815c9d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.415+0000 7feb5d149700 1 --2- 172.21.15.82:0/4150299160 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb58158eb0 0x7feb580c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.415+0000 7feb5d149700 1 -- 172.21.15.82:0/4150299160 >> 172.21.15.82:0/4150299160 conn(0x7feb580ce630 msgr2=0x7feb580cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.415+0000 7feb5d149700 1 -- 172.21.15.82:0/4150299160 shutdown_connections 2023-11-28T13:00:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.415+0000 7feb5d149700 1 -- 172.21.15.82:0/4150299160 wait complete. 2023-11-28T13:00:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.419+0000 7feb5d149700 1 Processor -- start 2023-11-28T13:00:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.419+0000 7feb5d149700 1 -- start start 2023-11-28T13:00:57.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.419+0000 7feb5d149700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb580ae090 0x7feb58159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:57.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.419+0000 7feb5d149700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb580b0c70 0x7feb580cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:57.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.419+0000 7feb5d149700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb58158eb0 0x7feb580cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:57.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.419+0000 7feb5d149700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb580cb9a0 con 0x7feb580ae090 2023-11-28T13:00:57.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.419+0000 7feb5d149700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb580cb090 con 0x7feb58158eb0 2023-11-28T13:00:57.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.419+0000 7feb5d149700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb580ad130 con 0x7feb580b0c70 2023-11-28T13:00:57.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.419+0000 7feb57fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb580ae090 0x7feb58159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:57.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.419+0000 7feb57fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb580ae090 0x7feb58159450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42192/0 (socket says 172.21.15.82:42192) 2023-11-28T13:00:57.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.419+0000 7feb57fff700 1 -- 172.21.15.82:0/1569294706 learned_addr learned my addr 172.21.15.82:0/1569294706 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:57.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.419+0000 7feb4f7fe700 1 --2- 172.21.15.82:0/1569294706 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb580b0c70 0x7feb580cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:57.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.419+0000 7feb5c948700 1 --2- 172.21.15.82:0/1569294706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb58158eb0 0x7feb580cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:57.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.419+0000 7feb57fff700 1 -- 172.21.15.82:0/1569294706 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb580b0c70 msgr2=0x7feb580cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:57.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.419+0000 7feb57fff700 1 --2- 172.21.15.82:0/1569294706 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb580b0c70 0x7feb580cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.419+0000 7feb57fff700 1 -- 172.21.15.82:0/1569294706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb58158eb0 msgr2=0x7feb580cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:57.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.419+0000 7feb57fff700 1 --2- 172.21.15.82:0/1569294706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb58158eb0 0x7feb580cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.419+0000 7feb57fff700 1 -- 172.21.15.82:0/1569294706 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5000bc80 con 0x7feb580ae090 2023-11-28T13:00:57.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.419+0000 7feb57fff700 1 --2- 172.21.15.82:0/1569294706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb580ae090 0x7feb58159450 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7feb4800e9d0 tx=0x7feb4800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:57.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.419+0000 7feb557fa700 1 -- 172.21.15.82:0/1569294706 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb48009720 con 0x7feb580ae090 2023-11-28T13:00:57.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.423+0000 7feb557fa700 1 -- 172.21.15.82:0/1569294706 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4800ee70 con 0x7feb580ae090 2023-11-28T13:00:57.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.423+0000 7feb5d149700 1 -- 172.21.15.82:0/1569294706 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb58071c90 con 0x7feb580ae090 2023-11-28T13:00:57.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.423+0000 7feb557fa700 1 -- 172.21.15.82:0/1569294706 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4800ca50 con 0x7feb580ae090 2023-11-28T13:00:57.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.423+0000 7feb5d149700 1 -- 172.21.15.82:0/1569294706 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb580adc00 con 0x7feb580ae090 2023-11-28T13:00:57.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.423+0000 7feb5d149700 1 -- 172.21.15.82:0/1569294706 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb58071f70 con 0x7feb580ae090 2023-11-28T13:00:57.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.423+0000 7feb557fa700 1 -- 172.21.15.82:0/1569294706 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7feb48019030 con 0x7feb580ae090 2023-11-28T13:00:57.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.423+0000 7feb557fa700 1 --2- 172.21.15.82:0/1569294706 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feb38064f10 0x7feb380673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:57.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.423+0000 7feb4f7fe700 1 --2- 172.21.15.82:0/1569294706 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feb38064f10 0x7feb380673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:57.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.423+0000 7feb557fa700 1 -- 172.21.15.82:0/1569294706 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feb48081d70 con 0x7feb580ae090 2023-11-28T13:00:57.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.427+0000 7feb4f7fe700 1 --2- 172.21.15.82:0/1569294706 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feb38064f10 0x7feb380673c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feb5815c530 tx=0x7feb40007e90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:57.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.435+0000 7feb557fa700 1 -- 172.21.15.82:0/1569294706 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7feb4804fe90 con 0x7feb580ae090 2023-11-28T13:00:57.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.599+0000 7feb5d149700 1 -- 172.21.15.82:0/1569294706 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feb58065fc0 con 0x7feb580ae090 2023-11-28T13:00:57.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.599+0000 7feb557fa700 1 -- 172.21.15.82:0/1569294706 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7feb480534b0 con 0x7feb580ae090 2023-11-28T13:00:57.604 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:00:57.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.599+0000 7feb5d149700 1 -- 172.21.15.82:0/1569294706 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feb38064f10 msgr2=0x7feb380673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:57.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.599+0000 7feb5d149700 1 --2- 172.21.15.82:0/1569294706 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feb38064f10 0x7feb380673c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feb5815c530 tx=0x7feb40007e90 comp rx=0 tx=0).stop 2023-11-28T13:00:57.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.599+0000 7feb5d149700 1 -- 172.21.15.82:0/1569294706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb580ae090 msgr2=0x7feb58159450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:57.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.599+0000 7feb5d149700 1 --2- 172.21.15.82:0/1569294706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb580ae090 0x7feb58159450 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7feb4800e9d0 tx=0x7feb4800ece0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.603+0000 7feb5d149700 1 -- 172.21.15.82:0/1569294706 shutdown_connections 2023-11-28T13:00:57.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.603+0000 7feb5d149700 1 --2- 172.21.15.82:0/1569294706 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feb38064f10 0x7feb380673c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.603+0000 7feb5d149700 1 --2- 172.21.15.82:0/1569294706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb58158eb0 0x7feb580cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.603+0000 7feb5d149700 1 --2- 172.21.15.82:0/1569294706 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb580b0c70 0x7feb580cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.603+0000 7feb5d149700 1 --2- 172.21.15.82:0/1569294706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb580ae090 0x7feb58159450 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.603+0000 7feb5d149700 1 -- 172.21.15.82:0/1569294706 >> 172.21.15.82:0/1569294706 conn(0x7feb580ce630 msgr2=0x7feb581581d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:57.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.603+0000 7feb5d149700 1 -- 172.21.15.82:0/1569294706 shutdown_connections 2023-11-28T13:00:57.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.603+0000 7feb5d149700 1 -- 172.21.15.82:0/1569294706 wait complete. 2023-11-28T13:00:57.618 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T13:00:57.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.727+0000 7ffb726c4700 1 Processor -- start 2023-11-28T13:00:57.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.727+0000 7ffb726c4700 1 -- start start 2023-11-28T13:00:57.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.727+0000 7ffb726c4700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ffb6c0ad820 0x7ffb6c06a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:57.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.727+0000 7ffb726c4700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb6c0c93a0 con 0x7ffb6c070910 2023-11-28T13:00:57.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.727+0000 7ffb726c4700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb6c06ab10 con 0x7ffb6c0c9b10 2023-11-28T13:00:57.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.727+0000 7ffb726c4700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb6c0c96f0 con 0x7ffb6c0ad820 2023-11-28T13:00:57.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.727+0000 7ffb716c2700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ffb6c070910 0x7ffb6c070ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58302/0 (socket says 172.21.15.82:58302) 2023-11-28T13:00:57.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.727+0000 7ffb716c2700 1 -- 172.21.15.82:0/1791430502 learned_addr learned my addr 172.21.15.82:0/1791430502 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:00:57.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.727+0000 7ffb70ec1700 1 --2- 172.21.15.82:0/1791430502 >> v2:172.21.15.82:3300/0 conn(0x7ffb6c0ad820 0x7ffb6c06a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.727+0000 7ffb70ec1700 1 -- 172.21.15.82:0/1791430502 >> v1:172.21.15.114:6789/0 conn(0x7ffb6c0c9b10 legacy=0x7ffb6c0c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.727+0000 7ffb70ec1700 1 -- 172.21.15.82:0/1791430502 >> v1:172.21.15.82:6789/0 conn(0x7ffb6c070910 legacy=0x7ffb6c070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.727+0000 7ffb70ec1700 1 -- 172.21.15.82:0/1791430502 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6c06ade0 con 0x7ffb6c0ad820 2023-11-28T13:00:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.727+0000 7ffb6bfff700 1 -- 172.21.15.82:0/1791430502 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103913162 0 0) 0x7ffb6c0c93a0 con 0x7ffb6c070910 2023-11-28T13:00:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.727+0000 7ffb70ec1700 1 --2- 172.21.15.82:0/1791430502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb6c0ad820 0x7ffb6c06a5d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009850 tx=0x7ffb54009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430d2a521e777d14 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.727+0000 7ffb6bfff700 1 -- 172.21.15.82:0/1791430502 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb54011830 con 0x7ffb6c0ad820 2023-11-28T13:00:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.727+0000 7ffb6bfff700 1 -- 172.21.15.82:0/1791430502 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb54011990 con 0x7ffb6c0ad820 2023-11-28T13:00:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.727+0000 7ffb6bfff700 1 -- 172.21.15.82:0/1791430502 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb54011d20 con 0x7ffb6c0ad820 2023-11-28T13:00:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb726c4700 1 -- 172.21.15.82:0/1791430502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb6c0ad820 msgr2=0x7ffb6c06a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb726c4700 1 --2- 172.21.15.82:0/1791430502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb6c0ad820 0x7ffb6c06a5d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009850 tx=0x7ffb54009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb726c4700 1 -- 172.21.15.82:0/1791430502 shutdown_connections 2023-11-28T13:00:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb726c4700 1 --2- 172.21.15.82:0/1791430502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb6c0ad820 0x7ffb6c06a5d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb726c4700 1 -- 172.21.15.82:0/1791430502 >> 172.21.15.82:0/1791430502 conn(0x7ffb6c0ce630 msgr2=0x7ffb6c0cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb726c4700 1 -- 172.21.15.82:0/1791430502 shutdown_connections 2023-11-28T13:00:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb726c4700 1 -- 172.21.15.82:0/1791430502 wait complete. 2023-11-28T13:00:57.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb726c4700 1 Processor -- start 2023-11-28T13:00:57.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb726c4700 1 -- start start 2023-11-28T13:00:57.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb726c4700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb6c070910 0x7ffb6c0cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:57.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb726c4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb6c0ad820 0x7ffb6c14a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:57.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb726c4700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb6c0c9b10 0x7ffb6c157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:57.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb726c4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c0cce60 con 0x7ffb6c0ad820 2023-11-28T13:00:57.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb726c4700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c0cd140 con 0x7ffb6c0c9b10 2023-11-28T13:00:57.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb726c4700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c0cd420 con 0x7ffb6c070910 2023-11-28T13:00:57.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb70ec1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb6c0ad820 0x7ffb6c14a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:57.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb70ec1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb6c0ad820 0x7ffb6c14a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42220/0 (socket says 172.21.15.82:42220) 2023-11-28T13:00:57.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb70ec1700 1 -- 172.21.15.82:0/161588720 learned_addr learned my addr 172.21.15.82:0/161588720 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:57.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb716c2700 1 --2- 172.21.15.82:0/161588720 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb6c070910 0x7ffb6c0cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:57.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb71ec3700 1 --2- 172.21.15.82:0/161588720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb6c0c9b10 0x7ffb6c157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:57.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb70ec1700 1 -- 172.21.15.82:0/161588720 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb6c070910 msgr2=0x7ffb6c0cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:57.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb70ec1700 1 --2- 172.21.15.82:0/161588720 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb6c070910 0x7ffb6c0cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb70ec1700 1 -- 172.21.15.82:0/161588720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb6c0c9b10 msgr2=0x7ffb6c157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:57.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb70ec1700 1 --2- 172.21.15.82:0/161588720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb6c0c9b10 0x7ffb6c157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb70ec1700 1 -- 172.21.15.82:0/161588720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb540094b0 con 0x7ffb6c0ad820 2023-11-28T13:00:57.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb70ec1700 1 --2- 172.21.15.82:0/161588720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb6c0ad820 0x7ffb6c14a2b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ffb54014040 tx=0x7ffb54004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:57.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb69ffb700 1 -- 172.21.15.82:0/161588720 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5400bc10 con 0x7ffb6c0ad820 2023-11-28T13:00:57.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb69ffb700 1 -- 172.21.15.82:0/161588720 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5401e070 con 0x7ffb6c0ad820 2023-11-28T13:00:57.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb69ffb700 1 -- 172.21.15.82:0/161588720 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5401a420 con 0x7ffb6c0ad820 2023-11-28T13:00:57.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.731+0000 7ffb726c4700 1 -- 172.21.15.82:0/161588720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb6c06b3a0 con 0x7ffb6c0ad820 2023-11-28T13:00:57.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.735+0000 7ffb726c4700 1 -- 172.21.15.82:0/161588720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6c06b0c0 con 0x7ffb6c0ad820 2023-11-28T13:00:57.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.735+0000 7ffb69ffb700 1 -- 172.21.15.82:0/161588720 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ffb5402a020 con 0x7ffb6c0ad820 2023-11-28T13:00:57.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.735+0000 7ffb726c4700 1 -- 172.21.15.82:0/161588720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb6c1608b0 con 0x7ffb6c0ad820 2023-11-28T13:00:57.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.735+0000 7ffb69ffb700 1 --2- 172.21.15.82:0/161588720 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ffb4c064ee0 0x7ffb4c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:57.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.735+0000 7ffb69ffb700 1 -- 172.21.15.82:0/161588720 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb54083310 con 0x7ffb6c0ad820 2023-11-28T13:00:57.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.735+0000 7ffb716c2700 1 --2- 172.21.15.82:0/161588720 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ffb4c064ee0 0x7ffb4c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:57.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.735+0000 7ffb716c2700 1 --2- 172.21.15.82:0/161588720 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ffb4c064ee0 0x7ffb4c067390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c0012e0 tx=0x7ffb5c001910 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:57.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.743+0000 7ffb69ffb700 1 -- 172.21.15.82:0/161588720 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ffb54051430 con 0x7ffb6c0ad820 2023-11-28T13:00:57.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.903+0000 7ffb726c4700 1 -- 172.21.15.82:0/161588720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb6c065fc0 con 0x7ffb6c0ad820 2023-11-28T13:00:57.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.907+0000 7ffb69ffb700 1 -- 172.21.15.82:0/161588720 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffb54054a50 con 0x7ffb6c0ad820 2023-11-28T13:00:57.912 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-11-28T13:00:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.911+0000 7ffb726c4700 1 -- 172.21.15.82:0/161588720 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ffb4c064ee0 msgr2=0x7ffb4c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.911+0000 7ffb726c4700 1 --2- 172.21.15.82:0/161588720 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ffb4c064ee0 0x7ffb4c067390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c0012e0 tx=0x7ffb5c001910 comp rx=0 tx=0).stop 2023-11-28T13:00:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.911+0000 7ffb726c4700 1 -- 172.21.15.82:0/161588720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb6c0ad820 msgr2=0x7ffb6c14a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.911+0000 7ffb726c4700 1 --2- 172.21.15.82:0/161588720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb6c0ad820 0x7ffb6c14a2b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ffb54014040 tx=0x7ffb54004770 comp rx=0 tx=0).stop 2023-11-28T13:00:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.911+0000 7ffb726c4700 1 -- 172.21.15.82:0/161588720 shutdown_connections 2023-11-28T13:00:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.911+0000 7ffb726c4700 1 --2- 172.21.15.82:0/161588720 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ffb4c064ee0 0x7ffb4c067390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.911+0000 7ffb726c4700 1 --2- 172.21.15.82:0/161588720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb6c0c9b10 0x7ffb6c157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.911+0000 7ffb726c4700 1 --2- 172.21.15.82:0/161588720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb6c0ad820 0x7ffb6c14a2b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.911+0000 7ffb726c4700 1 --2- 172.21.15.82:0/161588720 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb6c070910 0x7ffb6c0cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:57.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.911+0000 7ffb726c4700 1 -- 172.21.15.82:0/161588720 >> 172.21.15.82:0/161588720 conn(0x7ffb6c0ce630 msgr2=0x7ffb6c15c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:57.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.911+0000 7ffb726c4700 1 -- 172.21.15.82:0/161588720 shutdown_connections 2023-11-28T13:00:57.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:57.911+0000 7ffb726c4700 1 -- 172.21.15.82:0/161588720 wait complete. 2023-11-28T13:00:57.932 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T13:00:58.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.039+0000 7fd76327d700 1 Processor -- start 2023-11-28T13:00:58.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.039+0000 7fd76327d700 1 -- start start 2023-11-28T13:00:58.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd76327d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd75c156c50 0x7fd75c159f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:58.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd76327d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd75c0b1de0 0x7fd75c06dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:58.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd76327d700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd75c0b2330 con 0x7fd75c06e100 2023-11-28T13:00:58.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd76327d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd75c0b3400 con 0x7fd75c156c50 2023-11-28T13:00:58.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd76327d700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c15a480 con 0x7fd75c0b1de0 2023-11-28T13:00:58.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd76227b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd75c156c50 0x7fd75c159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:58.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd761a7a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd75c0b1de0 0x7fd75c06dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:58.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd761a7a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd75c0b1de0 0x7fd75c06dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:51362/0 (socket says 172.21.15.82:51362) 2023-11-28T13:00:58.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd76227b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd75c156c50 0x7fd75c159f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:53644/0 (socket says 172.21.15.82:53644) 2023-11-28T13:00:58.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd762a7c700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd75c06e100 0x7fd75c15cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:35896/0 (socket says 172.21.15.82:35896) 2023-11-28T13:00:58.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd761a7a700 1 -- 172.21.15.82:0/1198866529 learned_addr learned my addr 172.21.15.82:0/1198866529 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:58.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd76227b700 1 -- 172.21.15.82:0/1198866529 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd75c0b1de0 msgr2=0x7fd75c06dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:58.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd76227b700 1 --2- 172.21.15.82:0/1198866529 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd75c0b1de0 0x7fd75c06dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:58.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd76227b700 1 -- 172.21.15.82:0/1198866529 >> v1:172.21.15.114:6789/0 conn(0x7fd75c06e100 legacy=0x7fd75c15cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:58.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd76227b700 1 -- 172.21.15.82:0/1198866529 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c0b2610 con 0x7fd75c156c50 2023-11-28T13:00:58.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd761a7a700 1 --2- 172.21.15.82:0/1198866529 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd75c0b1de0 0x7fd75c06dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:00:58.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd76227b700 1 --2- 172.21.15.82:0/1198866529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd75c156c50 0x7fd75c159f40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd758009850 tx=0x7fd758009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88c92bbafb89ace8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:58.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd761279700 1 -- 172.21.15.82:0/1198866529 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758011830 con 0x7fd75c156c50 2023-11-28T13:00:58.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd761279700 1 -- 172.21.15.82:0/1198866529 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd758011990 con 0x7fd75c156c50 2023-11-28T13:00:58.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd761279700 1 -- 172.21.15.82:0/1198866529 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758011d40 con 0x7fd75c156c50 2023-11-28T13:00:58.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd76327d700 1 -- 172.21.15.82:0/1198866529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd75c156c50 msgr2=0x7fd75c159f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:58.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd76327d700 1 --2- 172.21.15.82:0/1198866529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd75c156c50 0x7fd75c159f40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd758009850 tx=0x7fd758009b60 comp rx=0 tx=0).stop 2023-11-28T13:00:58.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd76327d700 1 -- 172.21.15.82:0/1198866529 shutdown_connections 2023-11-28T13:00:58.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd76327d700 1 --2- 172.21.15.82:0/1198866529 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd75c0b1de0 0x7fd75c06dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:58.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd76327d700 1 --2- 172.21.15.82:0/1198866529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd75c156c50 0x7fd75c159f40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:58.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd76327d700 1 -- 172.21.15.82:0/1198866529 >> 172.21.15.82:0/1198866529 conn(0x7fd75c0cee90 msgr2=0x7fd75c0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:58.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.043+0000 7fd76327d700 1 -- 172.21.15.82:0/1198866529 shutdown_connections 2023-11-28T13:00:58.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.047+0000 7fd76327d700 1 -- 172.21.15.82:0/1198866529 wait complete. 2023-11-28T13:00:58.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.047+0000 7fd76327d700 1 Processor -- start 2023-11-28T13:00:58.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.047+0000 7fd76327d700 1 -- start start 2023-11-28T13:00:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.047+0000 7fd76327d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd75c06e100 0x7fd75c14e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.047+0000 7fd76327d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd75c0b1de0 0x7fd75c1582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.047+0000 7fd76327d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd75c156c50 0x7fd75c1ee9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.047+0000 7fd76327d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c0cc910 con 0x7fd75c06e100 2023-11-28T13:00:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.047+0000 7fd76327d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c0cc5a0 con 0x7fd75c0b1de0 2023-11-28T13:00:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.047+0000 7fd76327d700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c1ef350 con 0x7fd75c156c50 2023-11-28T13:00:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.047+0000 7fd76227b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd75c06e100 0x7fd75c14e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.047+0000 7fd76227b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd75c06e100 0x7fd75c14e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42234/0 (socket says 172.21.15.82:42234) 2023-11-28T13:00:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.047+0000 7fd76227b700 1 -- 172.21.15.82:0/243606785 learned_addr learned my addr 172.21.15.82:0/243606785 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.047+0000 7fd762a7c700 1 --2- 172.21.15.82:0/243606785 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd75c156c50 0x7fd75c1ee9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.047+0000 7fd761a7a700 1 --2- 172.21.15.82:0/243606785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd75c0b1de0 0x7fd75c1582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.047+0000 7fd76227b700 1 -- 172.21.15.82:0/243606785 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd75c156c50 msgr2=0x7fd75c1ee9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.047+0000 7fd76227b700 1 --2- 172.21.15.82:0/243606785 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd75c156c50 0x7fd75c1ee9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.047+0000 7fd76227b700 1 -- 172.21.15.82:0/243606785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd75c0b1de0 msgr2=0x7fd75c1582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.047+0000 7fd76227b700 1 --2- 172.21.15.82:0/243606785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd75c0b1de0 0x7fd75c1582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.051+0000 7fd76227b700 1 -- 172.21.15.82:0/243606785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74c009570 con 0x7fd75c06e100 2023-11-28T13:00:58.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.051+0000 7fd76227b700 1 --2- 172.21.15.82:0/243606785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd75c06e100 0x7fd75c14e610 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0cf9a0 tx=0x7fd758004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:58.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.051+0000 7fd752ffd700 1 -- 172.21.15.82:0/243606785 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7580044d0 con 0x7fd75c06e100 2023-11-28T13:00:58.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.051+0000 7fd752ffd700 1 -- 172.21.15.82:0/243606785 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7580036c0 con 0x7fd75c06e100 2023-11-28T13:00:58.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.051+0000 7fd76327d700 1 -- 172.21.15.82:0/243606785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7580094b0 con 0x7fd75c06e100 2023-11-28T13:00:58.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.051+0000 7fd752ffd700 1 -- 172.21.15.82:0/243606785 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758003a70 con 0x7fd75c06e100 2023-11-28T13:00:58.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.051+0000 7fd76327d700 1 -- 172.21.15.82:0/243606785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75c0b2bd0 con 0x7fd75c06e100 2023-11-28T13:00:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.051+0000 7fd76327d700 1 -- 172.21.15.82:0/243606785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75c0b28f0 con 0x7fd75c06e100 2023-11-28T13:00:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.051+0000 7fd752ffd700 1 -- 172.21.15.82:0/243606785 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd75800f050 con 0x7fd75c06e100 2023-11-28T13:00:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.051+0000 7fd752ffd700 1 --2- 172.21.15.82:0/243606785 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd740064ee0 0x7fd740067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:58.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.051+0000 7fd752ffd700 1 -- 172.21.15.82:0/243606785 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd758083200 con 0x7fd75c06e100 2023-11-28T13:00:58.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.051+0000 7fd761a7a700 1 --2- 172.21.15.82:0/243606785 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd740064ee0 0x7fd740067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:58.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.055+0000 7fd761a7a700 1 --2- 172.21.15.82:0/243606785 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd740064ee0 0x7fd740067390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0cee20 tx=0x7fd74c0092e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:58.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.059+0000 7fd752ffd700 1 -- 172.21.15.82:0/243606785 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd7580513a0 con 0x7fd75c06e100 2023-11-28T13:00:58.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.223+0000 7fd76327d700 1 -- 172.21.15.82:0/243606785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd75c06af40 con 0x7fd75c06e100 2023-11-28T13:00:58.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.223+0000 7fd752ffd700 1 -- 172.21.15.82:0/243606785 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd7580549c0 con 0x7fd75c06e100 2023-11-28T13:00:58.228 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-11-28T13:00:58.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.227+0000 7fd76327d700 1 -- 172.21.15.82:0/243606785 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd740064ee0 msgr2=0x7fd740067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:58.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.227+0000 7fd76327d700 1 --2- 172.21.15.82:0/243606785 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd740064ee0 0x7fd740067390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0cee20 tx=0x7fd74c0092e0 comp rx=0 tx=0).stop 2023-11-28T13:00:58.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.227+0000 7fd76327d700 1 -- 172.21.15.82:0/243606785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd75c06e100 msgr2=0x7fd75c14e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:58.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.227+0000 7fd76327d700 1 --2- 172.21.15.82:0/243606785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd75c06e100 0x7fd75c14e610 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0cf9a0 tx=0x7fd758004770 comp rx=0 tx=0).stop 2023-11-28T13:00:58.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.227+0000 7fd76327d700 1 -- 172.21.15.82:0/243606785 shutdown_connections 2023-11-28T13:00:58.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.227+0000 7fd76327d700 1 --2- 172.21.15.82:0/243606785 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd740064ee0 0x7fd740067390 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:58.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.227+0000 7fd76327d700 1 --2- 172.21.15.82:0/243606785 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd75c156c50 0x7fd75c1ee9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:58.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.227+0000 7fd76327d700 1 --2- 172.21.15.82:0/243606785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd75c0b1de0 0x7fd75c1582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:58.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.227+0000 7fd76327d700 1 --2- 172.21.15.82:0/243606785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd75c06e100 0x7fd75c14e610 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:58.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.227+0000 7fd76327d700 1 -- 172.21.15.82:0/243606785 >> 172.21.15.82:0/243606785 conn(0x7fd75c0cee90 msgr2=0x7fd75c1545e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:58.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.227+0000 7fd76327d700 1 -- 172.21.15.82:0/243606785 shutdown_connections 2023-11-28T13:00:58.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.227+0000 7fd76327d700 1 -- 172.21.15.82:0/243606785 wait complete. 2023-11-28T13:00:58.251 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T13:00:58.251 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2023-11-28T13:00:58.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.359+0000 7f5db759e700 1 Processor -- start 2023-11-28T13:00:58.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.359+0000 7f5db759e700 1 -- start start 2023-11-28T13:00:58.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db759e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5db81586f0 0x7f5db815c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:58.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db759e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5db80c8c50 0x7f5db806d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:58.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db759e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db806c3b0 con 0x7f5db806c840 2023-11-28T13:00:58.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db759e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5db806d390 con 0x7f5db80c8c50 2023-11-28T13:00:58.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db759e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5db815c8b0 con 0x7f5db81586f0 2023-11-28T13:00:58.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db5d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5db80c8c50 0x7f5db806d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:58.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db5d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5db80c8c50 0x7f5db806d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42242/0 (socket says 172.21.15.82:42242) 2023-11-28T13:00:58.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db5d9b700 1 -- 172.21.15.82:0/1679696376 learned_addr learned my addr 172.21.15.82:0/1679696376 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:58.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db6d9d700 1 --1- 172.21.15.82:0/1679696376 >> v1:172.21.15.82:6789/0 conn(0x7f5db806c840 0x7f5db806cc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58314/0 (socket says 172.21.15.82:58314) 2023-11-28T13:00:58.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db5d9b700 1 -- 172.21.15.82:0/1679696376 >> v2:172.21.15.114:3300/0 conn(0x7f5db81586f0 msgr2=0x7f5db815c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:58.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db659c700 1 --2- 172.21.15.82:0/1679696376 >> v2:172.21.15.114:3300/0 conn(0x7f5db81586f0 0x7f5db815c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:58.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db5d9b700 1 --2- 172.21.15.82:0/1679696376 >> v2:172.21.15.114:3300/0 conn(0x7f5db81586f0 0x7f5db815c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:58.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db5d9b700 1 -- 172.21.15.82:0/1679696376 >> v1:172.21.15.82:6789/0 conn(0x7f5db806c840 legacy=0x7f5db806cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:58.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db5d9b700 1 -- 172.21.15.82:0/1679696376 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db815cb90 con 0x7f5db80c8c50 2023-11-28T13:00:58.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db659c700 1 --2- 172.21.15.82:0/1679696376 >> v2:172.21.15.114:3300/0 conn(0x7f5db81586f0 0x7f5db815c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:00:58.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db5d9b700 1 --2- 172.21.15.82:0/1679696376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db80c8c50 0x7f5db806d880 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5db80c5680 tx=0x7f5db000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ffec9cd20f149a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:58.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db559a700 1 -- 172.21.15.82:0/1679696376 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db000e070 con 0x7f5db80c8c50 2023-11-28T13:00:58.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db559a700 1 -- 172.21.15.82:0/1679696376 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db000b9c0 con 0x7f5db80c8c50 2023-11-28T13:00:58.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db559a700 1 -- 172.21.15.82:0/1679696376 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db000bd70 con 0x7f5db80c8c50 2023-11-28T13:00:58.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db759e700 1 -- 172.21.15.82:0/1679696376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db80c8c50 msgr2=0x7f5db806d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:58.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db759e700 1 --2- 172.21.15.82:0/1679696376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db80c8c50 0x7f5db806d880 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5db80c5680 tx=0x7f5db000b330 comp rx=0 tx=0).stop 2023-11-28T13:00:58.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db759e700 1 -- 172.21.15.82:0/1679696376 shutdown_connections 2023-11-28T13:00:58.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db759e700 1 --2- 172.21.15.82:0/1679696376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db80c8c50 0x7f5db806d880 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:58.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db759e700 1 --2- 172.21.15.82:0/1679696376 >> v2:172.21.15.114:3300/0 conn(0x7f5db81586f0 0x7f5db815c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:58.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db759e700 1 -- 172.21.15.82:0/1679696376 >> 172.21.15.82:0/1679696376 conn(0x7f5db80ce600 msgr2=0x7f5db80ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:58.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db759e700 1 -- 172.21.15.82:0/1679696376 shutdown_connections 2023-11-28T13:00:58.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db759e700 1 -- 172.21.15.82:0/1679696376 wait complete. 2023-11-28T13:00:58.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db759e700 1 Processor -- start 2023-11-28T13:00:58.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.363+0000 7f5db759e700 1 -- start start 2023-11-28T13:00:58.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5db759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db806c840 0x7f5db80ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:58.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5db759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5db80c8c50 0x7f5db80ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:58.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5db759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5db81586f0 0x7f5db80aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:58.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5db759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db814d840 con 0x7f5db806c840 2023-11-28T13:00:58.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5db759e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db814e0b0 con 0x7f5db80c8c50 2023-11-28T13:00:58.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5db759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db814e300 con 0x7f5db81586f0 2023-11-28T13:00:58.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5db659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db806c840 0x7f5db80ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:58.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5db659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db806c840 0x7f5db80ae060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42258/0 (socket says 172.21.15.82:42258) 2023-11-28T13:00:58.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5db659c700 1 -- 172.21.15.82:0/1763634818 learned_addr learned my addr 172.21.15.82:0/1763634818 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:58.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5db6d9d700 1 --2- 172.21.15.82:0/1763634818 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5db81586f0 0x7f5db80aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:58.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5db5d9b700 1 --2- 172.21.15.82:0/1763634818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5db80c8c50 0x7f5db80ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:58.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5db6d9d700 1 -- 172.21.15.82:0/1763634818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5db80c8c50 msgr2=0x7f5db80ae5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:58.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5db6d9d700 1 --2- 172.21.15.82:0/1763634818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5db80c8c50 0x7f5db80ae5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:58.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5db6d9d700 1 -- 172.21.15.82:0/1763634818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db806c840 msgr2=0x7f5db80ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:58.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5db6d9d700 1 --2- 172.21.15.82:0/1763634818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db806c840 0x7f5db80ae060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:58.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5db6d9d700 1 -- 172.21.15.82:0/1763634818 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db0009b30 con 0x7f5db81586f0 2023-11-28T13:00:58.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5db6d9d700 1 --2- 172.21.15.82:0/1763634818 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5db81586f0 0x7f5db80aeae0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5da800c460 tx=0x7f5da800c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:58.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5da6ffd700 1 -- 172.21.15.82:0/1763634818 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da8004a90 con 0x7f5db81586f0 2023-11-28T13:00:58.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5da6ffd700 1 -- 172.21.15.82:0/1763634818 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da8004bf0 con 0x7f5db81586f0 2023-11-28T13:00:58.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5db759e700 1 -- 172.21.15.82:0/1763634818 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db815d150 con 0x7f5db81586f0 2023-11-28T13:00:58.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5da6ffd700 1 -- 172.21.15.82:0/1763634818 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da80070d0 con 0x7f5db81586f0 2023-11-28T13:00:58.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.367+0000 7f5db759e700 1 -- 172.21.15.82:0/1763634818 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db815ce70 con 0x7f5db81586f0 2023-11-28T13:00:58.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.371+0000 7f5db759e700 1 -- 172.21.15.82:0/1763634818 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db806ddc0 con 0x7f5db81586f0 2023-11-28T13:00:58.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.371+0000 7f5da6ffd700 1 -- 172.21.15.82:0/1763634818 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5da8010070 con 0x7f5db81586f0 2023-11-28T13:00:58.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.371+0000 7f5da6ffd700 1 --2- 172.21.15.82:0/1763634818 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5d98064ee0 0x7f5d98067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:58.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.371+0000 7f5db659c700 1 --2- 172.21.15.82:0/1763634818 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5d98064ee0 0x7f5d98067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:58.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.371+0000 7f5da6ffd700 1 -- 172.21.15.82:0/1763634818 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5da80814a0 con 0x7f5db81586f0 2023-11-28T13:00:58.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.371+0000 7f5db659c700 1 --2- 172.21.15.82:0/1763634818 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5d98064ee0 0x7f5d98067390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5dac006fd0 tx=0x7f5dac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:58.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.383+0000 7f5da6ffd700 1 -- 172.21.15.82:0/1763634818 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5da804f590 con 0x7f5db81586f0 2023-11-28T13:00:58.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.607+0000 7f5db759e700 1 -- 172.21.15.82:0/1763634818 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7f5db8065fc0 con 0x7f5db81586f0 2023-11-28T13:00:58.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.919+0000 7f5da6ffd700 1 -- 172.21.15.82:0/1763634818 <== mon.2 v2:172.21.15.114:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v50) v1 ==== 145+0+0 (secure 0 0 0) 0x7f5da8052bb0 con 0x7f5db81586f0 2023-11-28T13:00:58.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.923+0000 7f5db759e700 1 -- 172.21.15.82:0/1763634818 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5d98064ee0 msgr2=0x7f5d98067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:58.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.923+0000 7f5db759e700 1 --2- 172.21.15.82:0/1763634818 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5d98064ee0 0x7f5d98067390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5dac006fd0 tx=0x7f5dac008040 comp rx=0 tx=0).stop 2023-11-28T13:00:58.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.923+0000 7f5db759e700 1 -- 172.21.15.82:0/1763634818 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5db81586f0 msgr2=0x7f5db80aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:58.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.923+0000 7f5db759e700 1 --2- 172.21.15.82:0/1763634818 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5db81586f0 0x7f5db80aeae0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5da800c460 tx=0x7f5da800c770 comp rx=0 tx=0).stop 2023-11-28T13:00:58.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.923+0000 7f5db759e700 1 -- 172.21.15.82:0/1763634818 shutdown_connections 2023-11-28T13:00:58.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.923+0000 7f5db759e700 1 --2- 172.21.15.82:0/1763634818 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5d98064ee0 0x7f5d98067390 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:58.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.923+0000 7f5db759e700 1 --2- 172.21.15.82:0/1763634818 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5db81586f0 0x7f5db80aeae0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:58.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.923+0000 7f5db759e700 1 --2- 172.21.15.82:0/1763634818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5db80c8c50 0x7f5db80ae5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:58.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.923+0000 7f5db759e700 1 --2- 172.21.15.82:0/1763634818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db806c840 0x7f5db80ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:58.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.923+0000 7f5db759e700 1 -- 172.21.15.82:0/1763634818 >> 172.21.15.82:0/1763634818 conn(0x7f5db80ce600 msgr2=0x7f5db806cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:58.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.923+0000 7f5db759e700 1 -- 172.21.15.82:0/1763634818 shutdown_connections 2023-11-28T13:00:58.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:58.923+0000 7f5db759e700 1 -- 172.21.15.82:0/1763634818 wait complete. 2023-11-28T13:00:58.947 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T13:00:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.063+0000 7fe2bb0a1700 1 Processor -- start 2023-11-28T13:00:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.063+0000 7fe2bb0a1700 1 -- start start 2023-11-28T13:00:59.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.063+0000 7fe2bb0a1700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe2b40ad820 0x7fe2b406a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:59.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.063+0000 7fe2bb0a1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe2b40c9b10 0x7fe2b40c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:59.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.063+0000 7fe2bb0a1700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b40c93a0 con 0x7fe2b4070910 2023-11-28T13:00:59.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.063+0000 7fe2bb0a1700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b40c96f0 con 0x7fe2b40c9b10 2023-11-28T13:00:59.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.063+0000 7fe2bb0a1700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b4071580 con 0x7fe2b40ad820 2023-11-28T13:00:59.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.063+0000 7fe2ba8a0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe2b40c9b10 0x7fe2b40c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:59.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.063+0000 7fe2ba8a0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe2b40c9b10 0x7fe2b40c9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42260/0 (socket says 172.21.15.82:42260) 2023-11-28T13:00:59.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.063+0000 7fe2ba8a0700 1 -- 172.21.15.82:0/3939711978 learned_addr learned my addr 172.21.15.82:0/3939711978 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:59.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.063+0000 7fe2b989e700 1 --2- 172.21.15.82:0/3939711978 >> v2:172.21.15.114:3300/0 conn(0x7fe2b40ad820 0x7fe2b406a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:59.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.063+0000 7fe2ba8a0700 1 -- 172.21.15.82:0/3939711978 >> v2:172.21.15.114:3300/0 conn(0x7fe2b40ad820 msgr2=0x7fe2b406a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:59.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.067+0000 7fe2ba8a0700 1 --2- 172.21.15.82:0/3939711978 >> v2:172.21.15.114:3300/0 conn(0x7fe2b40ad820 0x7fe2b406a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.067+0000 7fe2ba8a0700 1 -- 172.21.15.82:0/3939711978 >> v1:172.21.15.114:6789/0 conn(0x7fe2b4070910 legacy=0x7fe2b4070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.067+0000 7fe2ba8a0700 1 -- 172.21.15.82:0/3939711978 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b406ab10 con 0x7fe2b40c9b10 2023-11-28T13:00:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.067+0000 7fe2ba8a0700 1 --2- 172.21.15.82:0/3939711978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2b40c9b10 0x7fe2b40c9fb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe2b406faf0 tx=0x7fe2ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a2c9d4905824e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.067+0000 7fe2b909d700 1 -- 172.21.15.82:0/3939711978 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac00e070 con 0x7fe2b40c9b10 2023-11-28T13:00:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.067+0000 7fe2b909d700 1 -- 172.21.15.82:0/3939711978 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac00b8d0 con 0x7fe2b40c9b10 2023-11-28T13:00:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.067+0000 7fe2b909d700 1 -- 172.21.15.82:0/3939711978 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac00bc80 con 0x7fe2b40c9b10 2023-11-28T13:00:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.067+0000 7fe2bb0a1700 1 -- 172.21.15.82:0/3939711978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2b40c9b10 msgr2=0x7fe2b40c9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.067+0000 7fe2bb0a1700 1 --2- 172.21.15.82:0/3939711978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2b40c9b10 0x7fe2b40c9fb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe2b406faf0 tx=0x7fe2ac00b330 comp rx=0 tx=0).stop 2023-11-28T13:00:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.067+0000 7fe2bb0a1700 1 -- 172.21.15.82:0/3939711978 shutdown_connections 2023-11-28T13:00:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.067+0000 7fe2bb0a1700 1 --2- 172.21.15.82:0/3939711978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2b40c9b10 0x7fe2b40c9fb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.067+0000 7fe2bb0a1700 1 --2- 172.21.15.82:0/3939711978 >> v2:172.21.15.114:3300/0 conn(0x7fe2b40ad820 0x7fe2b406a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.067+0000 7fe2bb0a1700 1 -- 172.21.15.82:0/3939711978 >> 172.21.15.82:0/3939711978 conn(0x7fe2b40ce630 msgr2=0x7fe2b40cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.067+0000 7fe2bb0a1700 1 -- 172.21.15.82:0/3939711978 shutdown_connections 2023-11-28T13:00:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.067+0000 7fe2bb0a1700 1 -- 172.21.15.82:0/3939711978 wait complete. 2023-11-28T13:00:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.067+0000 7fe2bb0a1700 1 Processor -- start 2023-11-28T13:00:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.067+0000 7fe2bb0a1700 1 -- start start 2023-11-28T13:00:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2bb0a1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2b4070910 0x7fe2b4141250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2bb0a1700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2b40ad820 0x7fe2b4146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2bb0a1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2b40c9b10 0x7fe2b4159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2bb0a1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b415c2d0 con 0x7fe2b40c9b10 2023-11-28T13:00:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2bb0a1700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b41eb0d0 con 0x7fe2b4070910 2023-11-28T13:00:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2bb0a1700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b415bff0 con 0x7fe2b40ad820 2023-11-28T13:00:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2ba8a0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2b40c9b10 0x7fe2b4159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2ba8a0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2b40c9b10 0x7fe2b4159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42270/0 (socket says 172.21.15.82:42270) 2023-11-28T13:00:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2ba8a0700 1 -- 172.21.15.82:0/1843084697 learned_addr learned my addr 172.21.15.82:0/1843084697 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2ba09f700 1 --2- 172.21.15.82:0/1843084697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2b4070910 0x7fe2b4141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2b989e700 1 --2- 172.21.15.82:0/1843084697 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2b40ad820 0x7fe2b4146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:59.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2ba8a0700 1 -- 172.21.15.82:0/1843084697 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2b40ad820 msgr2=0x7fe2b4146d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:59.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2ba8a0700 1 --2- 172.21.15.82:0/1843084697 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2b40ad820 0x7fe2b4146d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2ba8a0700 1 -- 172.21.15.82:0/1843084697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2b4070910 msgr2=0x7fe2b4141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:59.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2ba8a0700 1 --2- 172.21.15.82:0/1843084697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2b4070910 0x7fe2b4141250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2ba8a0700 1 -- 172.21.15.82:0/1843084697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ac009b30 con 0x7fe2b40c9b10 2023-11-28T13:00:59.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2ba8a0700 1 --2- 172.21.15.82:0/1843084697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2b40c9b10 0x7fe2b4159440 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40ce260 tx=0x7fe2ac004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:59.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2aaffd700 1 -- 172.21.15.82:0/1843084697 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac004800 con 0x7fe2b40c9b10 2023-11-28T13:00:59.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2aaffd700 1 -- 172.21.15.82:0/1843084697 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac0092e0 con 0x7fe2b40c9b10 2023-11-28T13:00:59.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2bb0a1700 1 -- 172.21.15.82:0/1843084697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b406b0c0 con 0x7fe2b40c9b10 2023-11-28T13:00:59.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2aaffd700 1 -- 172.21.15.82:0/1843084697 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac01c650 con 0x7fe2b40c9b10 2023-11-28T13:00:59.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2bb0a1700 1 -- 172.21.15.82:0/1843084697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b406ade0 con 0x7fe2b40c9b10 2023-11-28T13:00:59.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.071+0000 7fe2bb0a1700 1 -- 172.21.15.82:0/1843084697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b406b3a0 con 0x7fe2b40c9b10 2023-11-28T13:00:59.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.075+0000 7fe2aaffd700 1 -- 172.21.15.82:0/1843084697 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe2ac01c7b0 con 0x7fe2b40c9b10 2023-11-28T13:00:59.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.075+0000 7fe2aaffd700 1 --2- 172.21.15.82:0/1843084697 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe298064ee0 0x7fe298067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:59.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.075+0000 7fe2aaffd700 1 -- 172.21.15.82:0/1843084697 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe2ac083b40 con 0x7fe2b40c9b10 2023-11-28T13:00:59.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.075+0000 7fe2ba09f700 1 --2- 172.21.15.82:0/1843084697 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe298064ee0 0x7fe298067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:59.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.075+0000 7fe2ba09f700 1 --2- 172.21.15.82:0/1843084697 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe298064ee0 0x7fe298067390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4001800 tx=0x7fe2a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:59.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.079+0000 7fe2aaffd700 1 -- 172.21.15.82:0/1843084697 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe2ac051ce0 con 0x7fe2b40c9b10 2023-11-28T13:00:59.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.243+0000 7fe2bb0a1700 1 -- 172.21.15.82:0/1843084697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe2b41eaf30 con 0x7fe2b40c9b10 2023-11-28T13:00:59.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.251+0000 7fe2aaffd700 1 -- 172.21.15.82:0/1843084697 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe2b41eaf30 con 0x7fe2b40c9b10 2023-11-28T13:00:59.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.255+0000 7fe2bb0a1700 1 -- 172.21.15.82:0/1843084697 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe298064ee0 msgr2=0x7fe298067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:59.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.255+0000 7fe2bb0a1700 1 --2- 172.21.15.82:0/1843084697 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe298064ee0 0x7fe298067390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4001800 tx=0x7fe2a4009040 comp rx=0 tx=0).stop 2023-11-28T13:00:59.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.255+0000 7fe2bb0a1700 1 -- 172.21.15.82:0/1843084697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2b40c9b10 msgr2=0x7fe2b4159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:59.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.255+0000 7fe2bb0a1700 1 --2- 172.21.15.82:0/1843084697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2b40c9b10 0x7fe2b4159440 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40ce260 tx=0x7fe2ac004af0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.255+0000 7fe2bb0a1700 1 -- 172.21.15.82:0/1843084697 shutdown_connections 2023-11-28T13:00:59.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.255+0000 7fe2bb0a1700 1 --2- 172.21.15.82:0/1843084697 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe298064ee0 0x7fe298067390 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.255+0000 7fe2bb0a1700 1 --2- 172.21.15.82:0/1843084697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2b40c9b10 0x7fe2b4159440 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.255+0000 7fe2bb0a1700 1 --2- 172.21.15.82:0/1843084697 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2b40ad820 0x7fe2b4146d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.255+0000 7fe2bb0a1700 1 --2- 172.21.15.82:0/1843084697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2b4070910 0x7fe2b4141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.255+0000 7fe2bb0a1700 1 -- 172.21.15.82:0/1843084697 >> 172.21.15.82:0/1843084697 conn(0x7fe2b40ce630 msgr2=0x7fe2b40b3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:59.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.255+0000 7fe2bb0a1700 1 -- 172.21.15.82:0/1843084697 shutdown_connections 2023-11-28T13:00:59.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.255+0000 7fe2bb0a1700 1 -- 172.21.15.82:0/1843084697 wait complete. 2023-11-28T13:00:59.274 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T13:00:59.275 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T13:00:59.291 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T13:00:59.311 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T13:00:59.311 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:00:59.311 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:00:59.340 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:00:59.341 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:00:59.348 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:00:59.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.459+0000 7f44e686a700 1 Processor -- start 2023-11-28T13:00:59.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.459+0000 7f44e686a700 1 -- start start 2023-11-28T13:00:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44e686a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f44e015a3c0 0x7f44e00ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44e686a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f44e00707b0 0x7f44e00c4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44e686a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e015de70 con 0x7f44e00b1c70 2023-11-28T13:00:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44e686a700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e015a790 con 0x7f44e00707b0 2023-11-28T13:00:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44e686a700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e015e0c0 con 0x7f44e015a3c0 2023-11-28T13:00:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44e4e07700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f44e00707b0 0x7f44e00c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44e4e07700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f44e00707b0 0x7f44e00c4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42280/0 (socket says 172.21.15.82:42280) 2023-11-28T13:00:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44e4e07700 1 -- 172.21.15.82:0/324428806 learned_addr learned my addr 172.21.15.82:0/324428806 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44df7fe700 1 --1- 172.21.15.82:0/324428806 >> v1:172.21.15.82:6789/0 conn(0x7f44e00b1c70 0x7f44e00700a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58316/0 (socket says 172.21.15.82:58316) 2023-11-28T13:00:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44dffff700 1 --2- 172.21.15.82:0/324428806 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f44e015a3c0 0x7f44e00ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44e4e07700 1 -- 172.21.15.82:0/324428806 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f44e015a3c0 msgr2=0x7f44e00ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44e4e07700 1 --2- 172.21.15.82:0/324428806 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f44e015a3c0 0x7f44e00ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44e4e07700 1 -- 172.21.15.82:0/324428806 >> v1:172.21.15.82:6789/0 conn(0x7f44e00b1c70 legacy=0x7f44e00700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44e4e07700 1 -- 172.21.15.82:0/324428806 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e015e3a0 con 0x7f44e00707b0 2023-11-28T13:00:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44e4e07700 1 --2- 172.21.15.82:0/324428806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e00707b0 0x7f44e00c4730 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009910 tx=0x7f44d0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b171d6088b83304 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44deffd700 1 -- 172.21.15.82:0/324428806 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d000ba60 con 0x7f44e00707b0 2023-11-28T13:00:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44deffd700 1 -- 172.21.15.82:0/324428806 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d000bbc0 con 0x7f44e00707b0 2023-11-28T13:00:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44deffd700 1 -- 172.21.15.82:0/324428806 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d0009e60 con 0x7f44e00707b0 2023-11-28T13:00:59.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44e686a700 1 -- 172.21.15.82:0/324428806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e00707b0 msgr2=0x7f44e00c4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:59.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44e686a700 1 --2- 172.21.15.82:0/324428806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e00707b0 0x7f44e00c4730 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009910 tx=0x7f44d0009c20 comp rx=0 tx=0).stop 2023-11-28T13:00:59.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44e686a700 1 -- 172.21.15.82:0/324428806 shutdown_connections 2023-11-28T13:00:59.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44e686a700 1 --2- 172.21.15.82:0/324428806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e00707b0 0x7f44e00c4730 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44e686a700 1 --2- 172.21.15.82:0/324428806 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f44e015a3c0 0x7f44e00ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44e686a700 1 -- 172.21.15.82:0/324428806 >> 172.21.15.82:0/324428806 conn(0x7f44e00d0be0 msgr2=0x7f44e00d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:59.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44e686a700 1 -- 172.21.15.82:0/324428806 shutdown_connections 2023-11-28T13:00:59.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.463+0000 7f44e686a700 1 -- 172.21.15.82:0/324428806 wait complete. 2023-11-28T13:00:59.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44e686a700 1 Processor -- start 2023-11-28T13:00:59.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44e686a700 1 -- start start 2023-11-28T13:00:59.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44e686a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e00707b0 0x7f44e014b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:59.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44e686a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f44e00b1c70 0x7f44e00b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:59.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44e686a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e015a3c0 0x7f44e00c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:59.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44e686a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e00b54f0 con 0x7f44e015a3c0 2023-11-28T13:00:59.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44e686a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e00b57d0 con 0x7f44e00707b0 2023-11-28T13:00:59.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44e686a700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e00b5ab0 con 0x7f44e00b1c70 2023-11-28T13:00:59.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44e4e07700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e015a3c0 0x7f44e00c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:59.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44e4e07700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e015a3c0 0x7f44e00c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42282/0 (socket says 172.21.15.82:42282) 2023-11-28T13:00:59.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44e4e07700 1 -- 172.21.15.82:0/1474316316 learned_addr learned my addr 172.21.15.82:0/1474316316 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:59.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44df7fe700 1 --2- 172.21.15.82:0/1474316316 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f44e00b1c70 0x7f44e00b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:59.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44dffff700 1 --2- 172.21.15.82:0/1474316316 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e00707b0 0x7f44e014b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:59.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44e4e07700 1 -- 172.21.15.82:0/1474316316 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f44e00b1c70 msgr2=0x7f44e00b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:59.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44e4e07700 1 --2- 172.21.15.82:0/1474316316 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f44e00b1c70 0x7f44e00b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44e4e07700 1 -- 172.21.15.82:0/1474316316 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e00707b0 msgr2=0x7f44e014b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:59.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44e4e07700 1 --2- 172.21.15.82:0/1474316316 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e00707b0 0x7f44e014b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44e4e07700 1 -- 172.21.15.82:0/1474316316 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d0009570 con 0x7f44e015a3c0 2023-11-28T13:00:59.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44e4e07700 1 --2- 172.21.15.82:0/1474316316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e015a3c0 0x7f44e00c93e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009c60 tx=0x7f44d0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:59.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44dcff9700 1 -- 172.21.15.82:0/1474316316 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d0004510 con 0x7f44e015a3c0 2023-11-28T13:00:59.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44dcff9700 1 -- 172.21.15.82:0/1474316316 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d001e070 con 0x7f44e015a3c0 2023-11-28T13:00:59.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44e686a700 1 -- 172.21.15.82:0/1474316316 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e015e960 con 0x7f44e015a3c0 2023-11-28T13:00:59.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44dcff9700 1 -- 172.21.15.82:0/1474316316 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d0003900 con 0x7f44e015a3c0 2023-11-28T13:00:59.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.467+0000 7f44e686a700 1 -- 172.21.15.82:0/1474316316 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e015e680 con 0x7f44e015a3c0 2023-11-28T13:00:59.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.471+0000 7f44dcff9700 1 -- 172.21.15.82:0/1474316316 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f44d000f050 con 0x7f44e015a3c0 2023-11-28T13:00:59.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.471+0000 7f44e686a700 1 -- 172.21.15.82:0/1474316316 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e00cd1d0 con 0x7f44e015a3c0 2023-11-28T13:00:59.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.471+0000 7f44dcff9700 1 --2- 172.21.15.82:0/1474316316 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f44c0064ee0 0x7f44c0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:59.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.471+0000 7f44dcff9700 1 -- 172.21.15.82:0/1474316316 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f44d0020070 con 0x7f44e015a3c0 2023-11-28T13:00:59.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.471+0000 7f44dffff700 1 --2- 172.21.15.82:0/1474316316 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f44c0064ee0 0x7f44c0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:59.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.471+0000 7f44dffff700 1 --2- 172.21.15.82:0/1474316316 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f44c0064ee0 0x7f44c0067390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f44c8009a00 tx=0x7f44c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:59.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.475+0000 7f44dcff9700 1 -- 172.21.15.82:0/1474316316 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f44d00513d0 con 0x7f44e015a3c0 2023-11-28T13:00:59.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.639+0000 7f44e686a700 1 -- 172.21.15.82:0/1474316316 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44e0073760 con 0x7f44e015a3c0 2023-11-28T13:00:59.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.643+0000 7f44dcff9700 1 -- 172.21.15.82:0/1474316316 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17811 (secure 0 0 0) 0x7f44d0015090 con 0x7f44e015a3c0 2023-11-28T13:00:59.648 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:00:59.648 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:00:26.981345+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:00:24.360641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T13:00:24.960863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:00:59.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.643+0000 7f44e686a700 1 -- 172.21.15.82:0/1474316316 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f44c0064ee0 msgr2=0x7f44c0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:59.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.643+0000 7f44e686a700 1 --2- 172.21.15.82:0/1474316316 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f44c0064ee0 0x7f44c0067390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f44c8009a00 tx=0x7f44c8008040 comp rx=0 tx=0).stop 2023-11-28T13:00:59.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.643+0000 7f44e686a700 1 -- 172.21.15.82:0/1474316316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e015a3c0 msgr2=0x7f44e00c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:59.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.643+0000 7f44e686a700 1 --2- 172.21.15.82:0/1474316316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e015a3c0 0x7f44e00c93e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009c60 tx=0x7f44d0004770 comp rx=0 tx=0).stop 2023-11-28T13:00:59.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.643+0000 7f44e686a700 1 -- 172.21.15.82:0/1474316316 shutdown_connections 2023-11-28T13:00:59.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.643+0000 7f44e686a700 1 --2- 172.21.15.82:0/1474316316 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f44c0064ee0 0x7f44c0067390 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.643+0000 7f44e686a700 1 --2- 172.21.15.82:0/1474316316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e015a3c0 0x7f44e00c93e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.643+0000 7f44e686a700 1 --2- 172.21.15.82:0/1474316316 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f44e00b1c70 0x7f44e00b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.643+0000 7f44e686a700 1 --2- 172.21.15.82:0/1474316316 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e00707b0 0x7f44e014b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.643+0000 7f44e686a700 1 -- 172.21.15.82:0/1474316316 >> 172.21.15.82:0/1474316316 conn(0x7f44e00d0be0 msgr2=0x7f44e0156f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:59.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.647+0000 7f44e686a700 1 -- 172.21.15.82:0/1474316316 shutdown_connections 2023-11-28T13:00:59.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.647+0000 7f44e686a700 1 -- 172.21.15.82:0/1474316316 wait complete. 2023-11-28T13:00:59.662 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T13:00:24.360641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T13:00:24.960863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:00:59.663 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:00:59.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.779+0000 7f9815721700 1 Processor -- start 2023-11-28T13:00:59.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.779+0000 7f9815721700 1 -- start start 2023-11-28T13:00:59.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.779+0000 7f9815721700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98101578a0 0x7f98100afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:59.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.779+0000 7f9815721700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f981015a480 0x7f98100ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:59.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.779+0000 7f9815721700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981015abf0 con 0x7f98100ce8f0 2023-11-28T13:00:59.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.779+0000 7f9815721700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98100b00b0 con 0x7f981015a480 2023-11-28T13:00:59.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.779+0000 7f9815721700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981015aed0 con 0x7f98101578a0 2023-11-28T13:00:59.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.779+0000 7f980f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f981015a480 0x7f98100ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:59.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.779+0000 7f980f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f981015a480 0x7f98100ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42284/0 (socket says 172.21.15.82:42284) 2023-11-28T13:00:59.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.779+0000 7f980f7fe700 1 -- 172.21.15.82:0/2390821650 learned_addr learned my addr 172.21.15.82:0/2390821650 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:59.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.779+0000 7f9814f20700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f98100ce8f0 0x7f981006de30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58320/0 (socket says 172.21.15.82:58320) 2023-11-28T13:00:59.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.783+0000 7f980ffff700 1 --2- 172.21.15.82:0/2390821650 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98101578a0 0x7f98100afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:59.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.783+0000 7f980effd700 1 -- 172.21.15.82:0/2390821650 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349576375 0 0) 0x7f981015abf0 con 0x7f98100ce8f0 2023-11-28T13:00:59.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.783+0000 7f980effd700 1 -- 172.21.15.82:0/2390821650 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97f00035d0 con 0x7f98100ce8f0 2023-11-28T13:00:59.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.783+0000 7f980f7fe700 1 -- 172.21.15.82:0/2390821650 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98101578a0 msgr2=0x7f98100afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:00:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.783+0000 7f980f7fe700 1 --2- 172.21.15.82:0/2390821650 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98101578a0 0x7f98100afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.783+0000 7f980f7fe700 1 -- 172.21.15.82:0/2390821650 >> v1:172.21.15.82:6789/0 conn(0x7f98100ce8f0 legacy=0x7f981006de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.783+0000 7f980f7fe700 1 -- 172.21.15.82:0/2390821650 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981015b1b0 con 0x7f981015a480 2023-11-28T13:00:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.783+0000 7f980f7fe700 1 --2- 172.21.15.82:0/2390821650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f981015a480 0x7f98100ce3b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009910 tx=0x7f97f8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228c022d21964ebe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.783+0000 7f980effd700 1 -- 172.21.15.82:0/2390821650 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8011830 con 0x7f981015a480 2023-11-28T13:00:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.783+0000 7f980effd700 1 -- 172.21.15.82:0/2390821650 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f8011990 con 0x7f981015a480 2023-11-28T13:00:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.783+0000 7f980effd700 1 -- 172.21.15.82:0/2390821650 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8011d40 con 0x7f981015a480 2023-11-28T13:00:59.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.783+0000 7f9815721700 1 -- 172.21.15.82:0/2390821650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f981015a480 msgr2=0x7f98100ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:59.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.783+0000 7f9815721700 1 --2- 172.21.15.82:0/2390821650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f981015a480 0x7f98100ce3b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009910 tx=0x7f97f8009c20 comp rx=0 tx=0).stop 2023-11-28T13:00:59.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.783+0000 7f9815721700 1 -- 172.21.15.82:0/2390821650 shutdown_connections 2023-11-28T13:00:59.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.783+0000 7f9815721700 1 --2- 172.21.15.82:0/2390821650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f981015a480 0x7f98100ce3b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.783+0000 7f9815721700 1 --2- 172.21.15.82:0/2390821650 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98101578a0 0x7f98100afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.783+0000 7f9815721700 1 -- 172.21.15.82:0/2390821650 >> 172.21.15.82:0/2390821650 conn(0x7f98100d07e0 msgr2=0x7f98100d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:59.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.783+0000 7f9815721700 1 -- 172.21.15.82:0/2390821650 shutdown_connections 2023-11-28T13:00:59.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.783+0000 7f9815721700 1 -- 172.21.15.82:0/2390821650 wait complete. 2023-11-28T13:00:59.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f9815721700 1 Processor -- start 2023-11-28T13:00:59.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f9815721700 1 -- start start 2023-11-28T13:00:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f9815721700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98100ce8f0 0x7f98100c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f9815721700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98101578a0 0x7f9810159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f9815721700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f981015a480 0x7f98101597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f9815721700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98100b0880 con 0x7f98101578a0 2023-11-28T13:00:59.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f9815721700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98100b4810 con 0x7f98100ce8f0 2023-11-28T13:00:59.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f9815721700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98100c66c0 con 0x7f981015a480 2023-11-28T13:00:59.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f980f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98101578a0 0x7f9810159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:59.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f980f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98101578a0 0x7f9810159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42292/0 (socket says 172.21.15.82:42292) 2023-11-28T13:00:59.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f980f7fe700 1 -- 172.21.15.82:0/3909280577 learned_addr learned my addr 172.21.15.82:0/3909280577 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:00:59.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f9814f20700 1 --2- 172.21.15.82:0/3909280577 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f981015a480 0x7f98101597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:59.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f980ffff700 1 --2- 172.21.15.82:0/3909280577 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98100ce8f0 0x7f98100c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:59.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f980f7fe700 1 -- 172.21.15.82:0/3909280577 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f981015a480 msgr2=0x7f98101597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:59.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f980f7fe700 1 --2- 172.21.15.82:0/3909280577 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f981015a480 0x7f98101597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f980f7fe700 1 -- 172.21.15.82:0/3909280577 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98100ce8f0 msgr2=0x7f98100c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:59.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f980f7fe700 1 --2- 172.21.15.82:0/3909280577 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98100ce8f0 0x7f98100c6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f980f7fe700 1 -- 172.21.15.82:0/3909280577 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f8009570 con 0x7f98101578a0 2023-11-28T13:00:59.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f980f7fe700 1 --2- 172.21.15.82:0/3909280577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98101578a0 0x7f9810159280 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f97f8000c00 tx=0x7f97f8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:59.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f980cff9700 1 -- 172.21.15.82:0/3909280577 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8004500 con 0x7f98101578a0 2023-11-28T13:00:59.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f980cff9700 1 -- 172.21.15.82:0/3909280577 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f80036c0 con 0x7f98101578a0 2023-11-28T13:00:59.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f980cff9700 1 -- 172.21.15.82:0/3909280577 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8003a70 con 0x7f98101578a0 2023-11-28T13:00:59.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f9815721700 1 -- 172.21.15.82:0/3909280577 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981015a8d0 con 0x7f98101578a0 2023-11-28T13:00:59.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.787+0000 7f9815721700 1 -- 172.21.15.82:0/3909280577 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981006d910 con 0x7f98101578a0 2023-11-28T13:00:59.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.791+0000 7f9815721700 1 -- 172.21.15.82:0/3909280577 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9810157c70 con 0x7f98101578a0 2023-11-28T13:00:59.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.791+0000 7f980cff9700 1 -- 172.21.15.82:0/3909280577 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f97f802d070 con 0x7f98101578a0 2023-11-28T13:00:59.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.791+0000 7f980cff9700 1 --2- 172.21.15.82:0/3909280577 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f97f4064ee0 0x7f97f4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:00:59.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.791+0000 7f980ffff700 1 --2- 172.21.15.82:0/3909280577 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f97f4064ee0 0x7f97f4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:00:59.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.791+0000 7f980cff9700 1 -- 172.21.15.82:0/3909280577 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f97f8021030 con 0x7f98101578a0 2023-11-28T13:00:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.791+0000 7f980ffff700 1 --2- 172.21.15.82:0/3909280577 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f97f4064ee0 0x7f97f4067390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9800009bf0 tx=0x7f9800009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:00:59.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.799+0000 7f980cff9700 1 -- 172.21.15.82:0/3909280577 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f97f80515a0 con 0x7f98101578a0 2023-11-28T13:00:59.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.959+0000 7f9815721700 1 -- 172.21.15.82:0/3909280577 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f98100b4950 con 0x7f98101578a0 2023-11-28T13:00:59.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.959+0000 7f980cff9700 1 -- 172.21.15.82:0/3909280577 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f97f80150a0 con 0x7f98101578a0 2023-11-28T13:00:59.965 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:00:59.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.963+0000 7f9815721700 1 -- 172.21.15.82:0/3909280577 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f97f4064ee0 msgr2=0x7f97f4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:59.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.963+0000 7f9815721700 1 --2- 172.21.15.82:0/3909280577 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f97f4064ee0 0x7f97f4067390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9800009bf0 tx=0x7f9800009240 comp rx=0 tx=0).stop 2023-11-28T13:00:59.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.963+0000 7f9815721700 1 -- 172.21.15.82:0/3909280577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98101578a0 msgr2=0x7f9810159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:00:59.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.963+0000 7f9815721700 1 --2- 172.21.15.82:0/3909280577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98101578a0 0x7f9810159280 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f97f8000c00 tx=0x7f97f8004770 comp rx=0 tx=0).stop 2023-11-28T13:00:59.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.963+0000 7f9815721700 1 -- 172.21.15.82:0/3909280577 shutdown_connections 2023-11-28T13:00:59.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.963+0000 7f9815721700 1 --2- 172.21.15.82:0/3909280577 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f97f4064ee0 0x7f97f4067390 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.963+0000 7f9815721700 1 --2- 172.21.15.82:0/3909280577 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f981015a480 0x7f98101597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.963+0000 7f9815721700 1 --2- 172.21.15.82:0/3909280577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98101578a0 0x7f9810159280 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.963+0000 7f9815721700 1 --2- 172.21.15.82:0/3909280577 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98100ce8f0 0x7f98100c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:00:59.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.963+0000 7f9815721700 1 -- 172.21.15.82:0/3909280577 >> 172.21.15.82:0/3909280577 conn(0x7f98100d07e0 msgr2=0x7f981015da00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:00:59.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.963+0000 7f9815721700 1 -- 172.21.15.82:0/3909280577 shutdown_connections 2023-11-28T13:00:59.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:00:59.963+0000 7f9815721700 1 -- 172.21.15.82:0/3909280577 wait complete. 2023-11-28T13:00:59.980 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:01:00.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.091+0000 7f09d3bec700 1 Processor -- start 2023-11-28T13:01:00.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.091+0000 7f09d3bec700 1 -- start start 2023-11-28T13:01:00.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d3bec700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f09cc0ced60 0x7f09cc06b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:00.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d3bec700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f09cc06bd40 0x7f09cc0d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:00.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d3bec700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09cc0cf1b0 con 0x7f09cc15fcb0 2023-11-28T13:01:00.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d3bec700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09cc06c1c0 con 0x7f09cc06bd40 2023-11-28T13:01:00.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d3bec700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc06af10 con 0x7f09cc0ced60 2023-11-28T13:01:00.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d1988700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f09cc15fcb0 0x7f09cc0cd200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58334/0 (socket says 172.21.15.82:58334) 2023-11-28T13:01:00.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d1988700 1 -- 172.21.15.82:0/93741977 learned_addr learned my addr 172.21.15.82:0/93741977 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:00.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d2189700 1 --2- 172.21.15.82:0/93741977 >> v2:172.21.15.114:3300/0 conn(0x7f09cc06bd40 0x7f09cc0d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:00.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d1187700 1 --2- 172.21.15.82:0/93741977 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f09cc0ced60 0x7f09cc06b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:00.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d0986700 1 -- 172.21.15.82:0/93741977 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999274845 0 0) 0x7f09cc0cf1b0 con 0x7f09cc15fcb0 2023-11-28T13:01:00.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d0986700 1 -- 172.21.15.82:0/93741977 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09b80035d0 con 0x7f09cc15fcb0 2023-11-28T13:01:00.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d2189700 1 -- 172.21.15.82:0/93741977 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f09cc0ced60 msgr2=0x7f09cc06b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:00.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d2189700 1 --2- 172.21.15.82:0/93741977 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f09cc0ced60 0x7f09cc06b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d2189700 1 -- 172.21.15.82:0/93741977 >> v1:172.21.15.82:6789/0 conn(0x7f09cc15fcb0 legacy=0x7f09cc0cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:00.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d2189700 1 -- 172.21.15.82:0/93741977 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc0cd910 con 0x7f09cc06bd40 2023-11-28T13:01:00.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d1187700 1 --2- 172.21.15.82:0/93741977 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f09cc0ced60 0x7f09cc06b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:00.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d2189700 1 --2- 172.21.15.82:0/93741977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09cc06bd40 0x7f09cc0d0d20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f09c4009dc0 tx=0x7f09c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea8229c8e505b1c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:00.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d0986700 1 -- 172.21.15.82:0/93741977 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c400e070 con 0x7f09cc06bd40 2023-11-28T13:01:00.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d0986700 1 -- 172.21.15.82:0/93741977 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c400bae0 con 0x7f09cc06bd40 2023-11-28T13:01:00.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d0986700 1 -- 172.21.15.82:0/93741977 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c400be90 con 0x7f09cc06bd40 2023-11-28T13:01:00.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d3bec700 1 -- 172.21.15.82:0/93741977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09cc06bd40 msgr2=0x7f09cc0d0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:00.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.095+0000 7f09d3bec700 1 --2- 172.21.15.82:0/93741977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09cc06bd40 0x7f09cc0d0d20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f09c4009dc0 tx=0x7f09c400b330 comp rx=0 tx=0).stop 2023-11-28T13:01:00.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.099+0000 7f09d3bec700 1 -- 172.21.15.82:0/93741977 shutdown_connections 2023-11-28T13:01:00.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.099+0000 7f09d3bec700 1 --2- 172.21.15.82:0/93741977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09cc06bd40 0x7f09cc0d0d20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.099+0000 7f09d3bec700 1 --2- 172.21.15.82:0/93741977 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f09cc0ced60 0x7f09cc06b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.099+0000 7f09d3bec700 1 -- 172.21.15.82:0/93741977 >> 172.21.15.82:0/93741977 conn(0x7f09cc0d02c0 msgr2=0x7f09cc0d2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:00.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.099+0000 7f09d3bec700 1 -- 172.21.15.82:0/93741977 shutdown_connections 2023-11-28T13:01:00.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.099+0000 7f09d3bec700 1 -- 172.21.15.82:0/93741977 wait complete. 2023-11-28T13:01:00.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.099+0000 7f09d3bec700 1 Processor -- start 2023-11-28T13:01:00.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.099+0000 7f09d3bec700 1 -- start start 2023-11-28T13:01:00.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.099+0000 7f09d3bec700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f09cc06bd40 0x7f09cc0d2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:00.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.099+0000 7f09d3bec700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09cc0ced60 0x7f09cc0c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:00.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.099+0000 7f09d3bec700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09cc15fcb0 0x7f09cc0b7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:00.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.099+0000 7f09d3bec700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc0b6e90 con 0x7f09cc15fcb0 2023-11-28T13:01:00.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.099+0000 7f09d3bec700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc1f3200 con 0x7f09cc0ced60 2023-11-28T13:01:00.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.099+0000 7f09d3bec700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc0b6560 con 0x7f09cc06bd40 2023-11-28T13:01:00.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.099+0000 7f09d2189700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09cc15fcb0 0x7f09cc0b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:00.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.099+0000 7f09d2189700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09cc15fcb0 0x7f09cc0b7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42302/0 (socket says 172.21.15.82:42302) 2023-11-28T13:01:00.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.099+0000 7f09d2189700 1 -- 172.21.15.82:0/382748538 learned_addr learned my addr 172.21.15.82:0/382748538 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:00.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.099+0000 7f09d1988700 1 --2- 172.21.15.82:0/382748538 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f09cc06bd40 0x7f09cc0d2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:00.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.099+0000 7f09d1187700 1 --2- 172.21.15.82:0/382748538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09cc0ced60 0x7f09cc0c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:00.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.103+0000 7f09d2189700 1 -- 172.21.15.82:0/382748538 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f09cc06bd40 msgr2=0x7f09cc0d2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:00.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.103+0000 7f09d2189700 1 --2- 172.21.15.82:0/382748538 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f09cc06bd40 0x7f09cc0d2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.103+0000 7f09d2189700 1 -- 172.21.15.82:0/382748538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09cc0ced60 msgr2=0x7f09cc0c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:00.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.103+0000 7f09d2189700 1 --2- 172.21.15.82:0/382748538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09cc0ced60 0x7f09cc0c66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.103+0000 7f09d2189700 1 -- 172.21.15.82:0/382748538 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c80094b0 con 0x7f09cc15fcb0 2023-11-28T13:01:00.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.103+0000 7f09d1988700 1 --2- 172.21.15.82:0/382748538 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f09cc06bd40 0x7f09cc0d2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:00.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.103+0000 7f09d2189700 1 --2- 172.21.15.82:0/382748538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09cc15fcb0 0x7f09cc0b7320 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f09cc06c600 tx=0x7f09c4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:00.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.103+0000 7f09be7fc700 1 -- 172.21.15.82:0/382748538 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c4004550 con 0x7f09cc15fcb0 2023-11-28T13:01:00.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.103+0000 7f09be7fc700 1 -- 172.21.15.82:0/382748538 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c4020070 con 0x7f09cc15fcb0 2023-11-28T13:01:00.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.103+0000 7f09d3bec700 1 -- 172.21.15.82:0/382748538 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c4009a70 con 0x7f09cc15fcb0 2023-11-28T13:01:00.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.103+0000 7f09be7fc700 1 -- 172.21.15.82:0/382748538 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c4004910 con 0x7f09cc15fcb0 2023-11-28T13:01:00.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.103+0000 7f09d3bec700 1 -- 172.21.15.82:0/382748538 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09cc06a670 con 0x7f09cc15fcb0 2023-11-28T13:01:00.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.103+0000 7f09d3bec700 1 -- 172.21.15.82:0/382748538 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09cc0d0820 con 0x7f09cc15fcb0 2023-11-28T13:01:00.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.107+0000 7f09be7fc700 1 -- 172.21.15.82:0/382748538 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f09c402e070 con 0x7f09cc15fcb0 2023-11-28T13:01:00.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.107+0000 7f09be7fc700 1 --2- 172.21.15.82:0/382748538 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f09b0064ee0 0x7f09b0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:00.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.107+0000 7f09d1988700 1 --2- 172.21.15.82:0/382748538 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f09b0064ee0 0x7f09b0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:00.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.107+0000 7f09be7fc700 1 -- 172.21.15.82:0/382748538 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f09c4022070 con 0x7f09cc15fcb0 2023-11-28T13:01:00.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.107+0000 7f09d1988700 1 --2- 172.21.15.82:0/382748538 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f09b0064ee0 0x7f09b0067390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f09c00011e0 tx=0x7f09c0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:00.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.111+0000 7f09be7fc700 1 -- 172.21.15.82:0/382748538 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f09c4051ba0 con 0x7f09cc15fcb0 2023-11-28T13:01:00.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.275+0000 7f09d3bec700 1 -- 172.21.15.82:0/382748538 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f09cc06a950 con 0x7f09cc15fcb0 2023-11-28T13:01:00.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.275+0000 7f09be7fc700 1 -- 172.21.15.82:0/382748538 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f09c402c0a0 con 0x7f09cc15fcb0 2023-11-28T13:01:00.281 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:01:00.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.279+0000 7f09d3bec700 1 -- 172.21.15.82:0/382748538 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f09b0064ee0 msgr2=0x7f09b0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:00.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.279+0000 7f09d3bec700 1 --2- 172.21.15.82:0/382748538 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f09b0064ee0 0x7f09b0067390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f09c00011e0 tx=0x7f09c0009040 comp rx=0 tx=0).stop 2023-11-28T13:01:00.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.279+0000 7f09d3bec700 1 -- 172.21.15.82:0/382748538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09cc15fcb0 msgr2=0x7f09cc0b7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:00.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.279+0000 7f09d3bec700 1 --2- 172.21.15.82:0/382748538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09cc15fcb0 0x7f09cc0b7320 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f09cc06c600 tx=0x7f09c4004af0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.279+0000 7f09d3bec700 1 -- 172.21.15.82:0/382748538 shutdown_connections 2023-11-28T13:01:00.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.279+0000 7f09d3bec700 1 --2- 172.21.15.82:0/382748538 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f09b0064ee0 0x7f09b0067390 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.279+0000 7f09d3bec700 1 --2- 172.21.15.82:0/382748538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09cc15fcb0 0x7f09cc0b7320 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.279+0000 7f09d3bec700 1 --2- 172.21.15.82:0/382748538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09cc0ced60 0x7f09cc0c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.279+0000 7f09d3bec700 1 --2- 172.21.15.82:0/382748538 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f09cc06bd40 0x7f09cc0d2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.279+0000 7f09d3bec700 1 -- 172.21.15.82:0/382748538 >> 172.21.15.82:0/382748538 conn(0x7f09cc0d02c0 msgr2=0x7f09cc1576e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:00.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.279+0000 7f09d3bec700 1 -- 172.21.15.82:0/382748538 shutdown_connections 2023-11-28T13:01:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.279+0000 7f09d3bec700 1 -- 172.21.15.82:0/382748538 wait complete. 2023-11-28T13:01:00.296 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T13:01:00.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.411+0000 7f1b3e6cb700 1 Processor -- start 2023-11-28T13:01:00.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.411+0000 7f1b3e6cb700 1 -- start start 2023-11-28T13:01:00.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b3e6cb700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1b380ad820 0x7f1b3806a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:00.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b3e6cb700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b380c93a0 con 0x7f1b38070910 2023-11-28T13:01:00.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b3e6cb700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3806ab10 con 0x7f1b380c9b10 2023-11-28T13:01:00.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b3e6cb700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b380c96f0 con 0x7f1b380ad820 2023-11-28T13:01:00.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b3d6c9700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1b38070910 0x7f1b38070ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58346/0 (socket says 172.21.15.82:58346) 2023-11-28T13:01:00.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b3d6c9700 1 -- 172.21.15.82:0/1109732965 learned_addr learned my addr 172.21.15.82:0/1109732965 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:00.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b3cec8700 1 --2- 172.21.15.82:0/1109732965 >> v2:172.21.15.82:3300/0 conn(0x7f1b380ad820 0x7f1b3806a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:00.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b37fff700 1 -- 172.21.15.82:0/1109732965 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973866905 0 0) 0x7f1b380c93a0 con 0x7f1b38070910 2023-11-28T13:01:00.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b37fff700 1 -- 172.21.15.82:0/1109732965 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b200035d0 con 0x7f1b38070910 2023-11-28T13:01:00.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b3cec8700 1 -- 172.21.15.82:0/1109732965 >> v1:172.21.15.114:6789/0 conn(0x7f1b380c9b10 legacy=0x7f1b380c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:00.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b3cec8700 1 -- 172.21.15.82:0/1109732965 >> v1:172.21.15.82:6789/0 conn(0x7f1b38070910 legacy=0x7f1b38070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:00.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b37fff700 1 -- 172.21.15.82:0/1109732965 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2228586377 0 0) 0x7f1b200035d0 con 0x7f1b38070910 2023-11-28T13:01:00.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b3cec8700 1 -- 172.21.15.82:0/1109732965 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3806ade0 con 0x7f1b380ad820 2023-11-28T13:01:00.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b3cec8700 1 --2- 172.21.15.82:0/1109732965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b380ad820 0x7f1b3806a5d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009850 tx=0x7f1b2c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f38fd6c9045541 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:00.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b37fff700 1 -- 172.21.15.82:0/1109732965 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b280019f0 con 0x7f1b380ad820 2023-11-28T13:01:00.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b37fff700 1 -- 172.21.15.82:0/1109732965 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2c004030 con 0x7f1b380ad820 2023-11-28T13:01:00.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b37fff700 1 -- 172.21.15.82:0/1109732965 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0043c0 con 0x7f1b380ad820 2023-11-28T13:01:00.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b3e6cb700 1 -- 172.21.15.82:0/1109732965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b380ad820 msgr2=0x7f1b3806a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:00.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b3e6cb700 1 --2- 172.21.15.82:0/1109732965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b380ad820 0x7f1b3806a5d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009850 tx=0x7f1b2c009b60 comp rx=0 tx=0).stop 2023-11-28T13:01:00.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b3e6cb700 1 -- 172.21.15.82:0/1109732965 shutdown_connections 2023-11-28T13:01:00.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b3e6cb700 1 --2- 172.21.15.82:0/1109732965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b380ad820 0x7f1b3806a5d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b3e6cb700 1 -- 172.21.15.82:0/1109732965 >> 172.21.15.82:0/1109732965 conn(0x7f1b380ce630 msgr2=0x7f1b380cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:00.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b3e6cb700 1 -- 172.21.15.82:0/1109732965 shutdown_connections 2023-11-28T13:01:00.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.415+0000 7f1b3e6cb700 1 -- 172.21.15.82:0/1109732965 wait complete. 2023-11-28T13:01:00.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3e6cb700 1 Processor -- start 2023-11-28T13:01:00.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3e6cb700 1 -- start start 2023-11-28T13:01:00.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3e6cb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b38070910 0x7f1b380caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:00.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3e6cb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b380ad820 0x7f1b380ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:00.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3e6cb700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1b380c9b10 0x7f1b38143f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:00.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3e6cb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b38156b10 con 0x7f1b38070910 2023-11-28T13:01:00.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3e6cb700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b380cd650 con 0x7f1b380ad820 2023-11-28T13:01:00.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3e6cb700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b380cd930 con 0x7f1b380c9b10 2023-11-28T13:01:00.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3d6c9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b38070910 0x7f1b380caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:00.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3d6c9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b38070910 0x7f1b380caac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42316/0 (socket says 172.21.15.82:42316) 2023-11-28T13:01:00.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3d6c9700 1 -- 172.21.15.82:0/2797008472 learned_addr learned my addr 172.21.15.82:0/2797008472 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:00.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3deca700 1 --2- 172.21.15.82:0/2797008472 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1b380c9b10 0x7f1b38143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:00.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3cec8700 1 --2- 172.21.15.82:0/2797008472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b380ad820 0x7f1b380ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:00.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3d6c9700 1 -- 172.21.15.82:0/2797008472 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1b380c9b10 msgr2=0x7f1b38143f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:00.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3d6c9700 1 --2- 172.21.15.82:0/2797008472 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1b380c9b10 0x7f1b38143f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3d6c9700 1 -- 172.21.15.82:0/2797008472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b380ad820 msgr2=0x7f1b380ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:00.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3d6c9700 1 --2- 172.21.15.82:0/2797008472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b380ad820 0x7f1b380ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3d6c9700 1 -- 172.21.15.82:0/2797008472 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c0094b0 con 0x7f1b38070910 2023-11-28T13:01:00.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3d6c9700 1 --2- 172.21.15.82:0/2797008472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b38070910 0x7f1b380caac0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800cc70 tx=0x7f1b2800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:00.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b35ffb700 1 -- 172.21.15.82:0/2797008472 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2800ade0 con 0x7f1b38070910 2023-11-28T13:01:00.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b35ffb700 1 -- 172.21.15.82:0/2797008472 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2800ce70 con 0x7f1b38070910 2023-11-28T13:01:00.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b35ffb700 1 -- 172.21.15.82:0/2797008472 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b280072f0 con 0x7f1b38070910 2023-11-28T13:01:00.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3e6cb700 1 -- 172.21.15.82:0/2797008472 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3806b3a0 con 0x7f1b38070910 2023-11-28T13:01:00.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3e6cb700 1 -- 172.21.15.82:0/2797008472 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3806b0c0 con 0x7f1b38070910 2023-11-28T13:01:00.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.419+0000 7f1b3e6cb700 1 -- 172.21.15.82:0/2797008472 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b381608b0 con 0x7f1b38070910 2023-11-28T13:01:00.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.423+0000 7f1b35ffb700 1 -- 172.21.15.82:0/2797008472 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1b28010070 con 0x7f1b38070910 2023-11-28T13:01:00.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.423+0000 7f1b35ffb700 1 --2- 172.21.15.82:0/2797008472 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1b24064ee0 0x7f1b24067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:00.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.423+0000 7f1b35ffb700 1 -- 172.21.15.82:0/2797008472 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1b28081da0 con 0x7f1b38070910 2023-11-28T13:01:00.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.423+0000 7f1b3cec8700 1 --2- 172.21.15.82:0/2797008472 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1b24064ee0 0x7f1b24067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:00.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.423+0000 7f1b3cec8700 1 --2- 172.21.15.82:0/2797008472 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1b24064ee0 0x7f1b24067390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009850 tx=0x7f1b2c013040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:00.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.427+0000 7f1b35ffb700 1 -- 172.21.15.82:0/2797008472 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1b2804fe50 con 0x7f1b38070910 2023-11-28T13:01:00.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.591+0000 7f1b3e6cb700 1 -- 172.21.15.82:0/2797008472 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b38065fc0 con 0x7f1b38070910 2023-11-28T13:01:00.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.591+0000 7f1b35ffb700 1 -- 172.21.15.82:0/2797008472 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b28018020 con 0x7f1b38070910 2023-11-28T13:01:00.597 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-11-28T13:01:00.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.591+0000 7f1b3e6cb700 1 -- 172.21.15.82:0/2797008472 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1b24064ee0 msgr2=0x7f1b24067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:00.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.591+0000 7f1b3e6cb700 1 --2- 172.21.15.82:0/2797008472 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1b24064ee0 0x7f1b24067390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009850 tx=0x7f1b2c013040 comp rx=0 tx=0).stop 2023-11-28T13:01:00.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.591+0000 7f1b3e6cb700 1 -- 172.21.15.82:0/2797008472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b38070910 msgr2=0x7f1b380caac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:00.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.591+0000 7f1b3e6cb700 1 --2- 172.21.15.82:0/2797008472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b38070910 0x7f1b380caac0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800cc70 tx=0x7f1b2800a340 comp rx=0 tx=0).stop 2023-11-28T13:01:00.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.591+0000 7f1b3e6cb700 1 -- 172.21.15.82:0/2797008472 shutdown_connections 2023-11-28T13:01:00.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.591+0000 7f1b3e6cb700 1 --2- 172.21.15.82:0/2797008472 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1b24064ee0 0x7f1b24067390 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.591+0000 7f1b3e6cb700 1 --2- 172.21.15.82:0/2797008472 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1b380c9b10 0x7f1b38143f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.591+0000 7f1b3e6cb700 1 --2- 172.21.15.82:0/2797008472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b380ad820 0x7f1b380ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.591+0000 7f1b3e6cb700 1 --2- 172.21.15.82:0/2797008472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b38070910 0x7f1b380caac0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.591+0000 7f1b3e6cb700 1 -- 172.21.15.82:0/2797008472 >> 172.21.15.82:0/2797008472 conn(0x7f1b380ce630 msgr2=0x7f1b3815db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:00.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.591+0000 7f1b3e6cb700 1 -- 172.21.15.82:0/2797008472 shutdown_connections 2023-11-28T13:01:00.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.591+0000 7f1b3e6cb700 1 -- 172.21.15.82:0/2797008472 wait complete. 2023-11-28T13:01:00.610 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T13:01:00.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.723+0000 7f2c9759e700 1 Processor -- start 2023-11-28T13:01:00.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.723+0000 7f2c9759e700 1 -- start start 2023-11-28T13:01:00.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.723+0000 7f2c9759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c980c8c80 0x7f2c98163d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:00.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.723+0000 7f2c9759e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c980ad9b0 con 0x7f2c98158eb0 2023-11-28T13:01:00.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.723+0000 7f2c9759e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c980c90f0 con 0x7f2c980ae090 2023-11-28T13:01:00.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.723+0000 7f2c9759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c980adee0 con 0x7f2c980c8c80 2023-11-28T13:01:00.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.723+0000 7f2c9659c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2c98158eb0 0x7f2c980b0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58362/0 (socket says 172.21.15.82:58362) 2023-11-28T13:01:00.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.723+0000 7f2c9659c700 1 -- 172.21.15.82:0/1300740442 learned_addr learned my addr 172.21.15.82:0/1300740442 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:00.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.723+0000 7f2c96d9d700 1 --2- 172.21.15.82:0/1300740442 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c980c8c80 0x7f2c98163d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:00.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.727+0000 7f2c9559a700 1 -- 172.21.15.82:0/1300740442 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344415982 0 0) 0x7f2c980ad9b0 con 0x7f2c98158eb0 2023-11-28T13:01:00.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.727+0000 7f2c9559a700 1 -- 172.21.15.82:0/1300740442 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c780035d0 con 0x7f2c98158eb0 2023-11-28T13:01:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.727+0000 7f2c9559a700 1 -- 172.21.15.82:0/1300740442 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284249333 0 0) 0x7f2c980c90f0 con 0x7f2c980ae090 2023-11-28T13:01:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.727+0000 7f2c9559a700 1 -- 172.21.15.82:0/1300740442 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c980ad9b0 con 0x7f2c980ae090 2023-11-28T13:01:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.727+0000 7f2c9559a700 1 -- 172.21.15.82:0/1300740442 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2521264909 0 0) 0x7f2c780035d0 con 0x7f2c98158eb0 2023-11-28T13:01:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.727+0000 7f2c96d9d700 1 -- 172.21.15.82:0/1300740442 >> v1:172.21.15.114:6789/0 conn(0x7f2c980ae090 legacy=0x7f2c980b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.727+0000 7f2c96d9d700 1 -- 172.21.15.82:0/1300740442 >> v1:172.21.15.82:6789/0 conn(0x7f2c98158eb0 legacy=0x7f2c980b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.727+0000 7f2c96d9d700 1 -- 172.21.15.82:0/1300740442 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c98159280 con 0x7f2c980c8c80 2023-11-28T13:01:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.727+0000 7f2c96d9d700 1 --2- 172.21.15.82:0/1300740442 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c980c8c80 0x7f2c98163d60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009880 tx=0x7f2c90009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87cd5cbbd7d3178a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.727+0000 7f2c9559a700 1 -- 172.21.15.82:0/1300740442 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c80001670 con 0x7f2c980c8c80 2023-11-28T13:01:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.727+0000 7f2c9559a700 1 -- 172.21.15.82:0/1300740442 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c90004030 con 0x7f2c980c8c80 2023-11-28T13:01:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.727+0000 7f2c9559a700 1 -- 172.21.15.82:0/1300740442 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c900043c0 con 0x7f2c980c8c80 2023-11-28T13:01:00.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.727+0000 7f2c9759e700 1 -- 172.21.15.82:0/1300740442 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c980c8c80 msgr2=0x7f2c98163d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:00.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.727+0000 7f2c9759e700 1 --2- 172.21.15.82:0/1300740442 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c980c8c80 0x7f2c98163d60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009880 tx=0x7f2c90009b90 comp rx=0 tx=0).stop 2023-11-28T13:01:00.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.727+0000 7f2c9759e700 1 -- 172.21.15.82:0/1300740442 shutdown_connections 2023-11-28T13:01:00.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.727+0000 7f2c9759e700 1 --2- 172.21.15.82:0/1300740442 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c980c8c80 0x7f2c98163d60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.727+0000 7f2c9759e700 1 -- 172.21.15.82:0/1300740442 >> 172.21.15.82:0/1300740442 conn(0x7f2c980ce630 msgr2=0x7f2c980cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:00.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.727+0000 7f2c9759e700 1 -- 172.21.15.82:0/1300740442 shutdown_connections 2023-11-28T13:01:00.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.727+0000 7f2c9759e700 1 -- 172.21.15.82:0/1300740442 wait complete. 2023-11-28T13:01:00.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.727+0000 7f2c9759e700 1 Processor -- start 2023-11-28T13:01:00.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c9759e700 1 -- start start 2023-11-28T13:01:00.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c9759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c980ae090 0x7f2c981f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:00.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c9759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c980c8c80 0x7f2c981f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:00.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c9759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c98158eb0 0x7f2c980c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:00.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c9759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c981539f0 con 0x7f2c980c8c80 2023-11-28T13:01:00.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c9759e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c981f5a90 con 0x7f2c980ae090 2023-11-28T13:01:00.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c9759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c980cc500 con 0x7f2c98158eb0 2023-11-28T13:01:00.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c95d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c980c8c80 0x7f2c981f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:00.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c95d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c980c8c80 0x7f2c981f0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42328/0 (socket says 172.21.15.82:42328) 2023-11-28T13:01:00.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c95d9b700 1 -- 172.21.15.82:0/1031399205 learned_addr learned my addr 172.21.15.82:0/1031399205 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:00.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c9659c700 1 --2- 172.21.15.82:0/1031399205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c980ae090 0x7f2c981f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:00.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c96d9d700 1 --2- 172.21.15.82:0/1031399205 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c98158eb0 0x7f2c980c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:00.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c95d9b700 1 -- 172.21.15.82:0/1031399205 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c98158eb0 msgr2=0x7f2c980c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:00.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c95d9b700 1 --2- 172.21.15.82:0/1031399205 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c98158eb0 0x7f2c980c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c95d9b700 1 -- 172.21.15.82:0/1031399205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c980ae090 msgr2=0x7f2c981f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c95d9b700 1 --2- 172.21.15.82:0/1031399205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c980ae090 0x7f2c981f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c95d9b700 1 -- 172.21.15.82:0/1031399205 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c900094b0 con 0x7f2c980c8c80 2023-11-28T13:01:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c95d9b700 1 --2- 172.21.15.82:0/1031399205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c980c8c80 0x7f2c981f0f20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800cbd0 tx=0x7f2c8800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c8effd700 1 -- 172.21.15.82:0/1031399205 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88003c20 con 0x7f2c980c8c80 2023-11-28T13:01:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c8effd700 1 -- 172.21.15.82:0/1031399205 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c88003d80 con 0x7f2c980c8c80 2023-11-28T13:01:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c9759e700 1 -- 172.21.15.82:0/1031399205 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c980adc00 con 0x7f2c980c8c80 2023-11-28T13:01:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c8effd700 1 -- 172.21.15.82:0/1031399205 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8800aae0 con 0x7f2c980c8c80 2023-11-28T13:01:00.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.731+0000 7f2c9759e700 1 -- 172.21.15.82:0/1031399205 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c98069e60 con 0x7f2c980c8c80 2023-11-28T13:01:00.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.735+0000 7f2c9759e700 1 -- 172.21.15.82:0/1031399205 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c98071c90 con 0x7f2c980c8c80 2023-11-28T13:01:00.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.735+0000 7f2c8effd700 1 -- 172.21.15.82:0/1031399205 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2c88010050 con 0x7f2c980c8c80 2023-11-28T13:01:00.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.735+0000 7f2c8effd700 1 --2- 172.21.15.82:0/1031399205 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2c7c064ee0 0x7f2c7c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:00.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.735+0000 7f2c8effd700 1 -- 172.21.15.82:0/1031399205 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2c88081d30 con 0x7f2c980c8c80 2023-11-28T13:01:00.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.735+0000 7f2c9659c700 1 --2- 172.21.15.82:0/1031399205 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2c7c064ee0 0x7f2c7c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:00.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.735+0000 7f2c9659c700 1 --2- 172.21.15.82:0/1031399205 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2c7c064ee0 0x7f2c7c067390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2c80000f60 tx=0x7f2c80000bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:00.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.743+0000 7f2c8effd700 1 -- 172.21.15.82:0/1031399205 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2c8804fe70 con 0x7f2c980c8c80 2023-11-28T13:01:00.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.903+0000 7f2c9759e700 1 -- 172.21.15.82:0/1031399205 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2c98153b30 con 0x7f2c980c8c80 2023-11-28T13:01:00.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.903+0000 7f2c8effd700 1 -- 172.21.15.82:0/1031399205 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2c98153b30 con 0x7f2c980c8c80 2023-11-28T13:01:00.909 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-11-28T13:01:00.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.907+0000 7f2c9759e700 1 -- 172.21.15.82:0/1031399205 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2c7c064ee0 msgr2=0x7f2c7c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:00.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.907+0000 7f2c9759e700 1 --2- 172.21.15.82:0/1031399205 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2c7c064ee0 0x7f2c7c067390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2c80000f60 tx=0x7f2c80000bc0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.907+0000 7f2c9759e700 1 -- 172.21.15.82:0/1031399205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c980c8c80 msgr2=0x7f2c981f0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:00.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.907+0000 7f2c9759e700 1 --2- 172.21.15.82:0/1031399205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c980c8c80 0x7f2c981f0f20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800cbd0 tx=0x7f2c8800cee0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.907+0000 7f2c9759e700 1 -- 172.21.15.82:0/1031399205 shutdown_connections 2023-11-28T13:01:00.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.907+0000 7f2c9759e700 1 --2- 172.21.15.82:0/1031399205 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2c7c064ee0 0x7f2c7c067390 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.907+0000 7f2c9759e700 1 --2- 172.21.15.82:0/1031399205 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2c98158eb0 0x7f2c980c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.907+0000 7f2c9759e700 1 --2- 172.21.15.82:0/1031399205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c980c8c80 0x7f2c981f0f20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.907+0000 7f2c9759e700 1 --2- 172.21.15.82:0/1031399205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c980ae090 0x7f2c981f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:00.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.907+0000 7f2c9759e700 1 -- 172.21.15.82:0/1031399205 >> 172.21.15.82:0/1031399205 conn(0x7f2c980ce630 msgr2=0x7f2c981567d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:00.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.907+0000 7f2c9759e700 1 -- 172.21.15.82:0/1031399205 shutdown_connections 2023-11-28T13:01:00.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:00.907+0000 7f2c9759e700 1 -- 172.21.15.82:0/1031399205 wait complete. 2023-11-28T13:01:00.923 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T13:01:01.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.035+0000 7f7b9c1ff700 1 Processor -- start 2023-11-28T13:01:01.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.035+0000 7f7b9c1ff700 1 -- start start 2023-11-28T13:01:01.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.035+0000 7f7b9c1ff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7b94159e00 0x7f7b9406a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:01.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.035+0000 7f7b9c1ff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7b9415a1d0 0x7f7b9415c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:01.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.035+0000 7f7b9c1ff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9415cf30 0x7f7b940703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:01.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.035+0000 7f7b9c1ff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9415d3a0 con 0x7f7b94159e00 2023-11-28T13:01:01.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.035+0000 7f7b9c1ff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9406abc0 con 0x7f7b9415a1d0 2023-11-28T13:01:01.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.035+0000 7f7b9c1ff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b94069bc0 con 0x7f7b9415cf30 2023-11-28T13:01:01.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.035+0000 7f7b99f9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7b94159e00 0x7f7b9406a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:01.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b99f9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7b94159e00 0x7f7b9406a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42330/0 (socket says 172.21.15.82:42330) 2023-11-28T13:01:01.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b9979a700 1 --2- 172.21.15.82:0/675674208 >> v2:172.21.15.114:3300/0 conn(0x7f7b9415a1d0 0x7f7b9415c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:01.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b99f9b700 1 -- 172.21.15.82:0/675674208 learned_addr learned my addr 172.21.15.82:0/675674208 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:01.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b9a79c700 1 --2- 172.21.15.82:0/675674208 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9415cf30 0x7f7b940703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b99f9b700 1 -- 172.21.15.82:0/675674208 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9415cf30 msgr2=0x7f7b940703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b99f9b700 1 --2- 172.21.15.82:0/675674208 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9415cf30 0x7f7b940703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b99f9b700 1 -- 172.21.15.82:0/675674208 >> v2:172.21.15.114:3300/0 conn(0x7f7b9415a1d0 msgr2=0x7f7b9415c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b99f9b700 1 --2- 172.21.15.82:0/675674208 >> v2:172.21.15.114:3300/0 conn(0x7f7b9415a1d0 0x7f7b9415c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b99f9b700 1 -- 172.21.15.82:0/675674208 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b940ce6b0 con 0x7f7b94159e00 2023-11-28T13:01:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b9979a700 1 --2- 172.21.15.82:0/675674208 >> v2:172.21.15.114:3300/0 conn(0x7f7b9415a1d0 0x7f7b9415c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b99f9b700 1 --2- 172.21.15.82:0/675674208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b94159e00 0x7f7b9406a680 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7b940caf70 tx=0x7f7b84009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a7625349b43309 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b98f99700 1 -- 172.21.15.82:0/675674208 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b84011830 con 0x7f7b94159e00 2023-11-28T13:01:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b98f99700 1 -- 172.21.15.82:0/675674208 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b84011990 con 0x7f7b94159e00 2023-11-28T13:01:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b98f99700 1 -- 172.21.15.82:0/675674208 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b84011d20 con 0x7f7b94159e00 2023-11-28T13:01:01.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b9c1ff700 1 -- 172.21.15.82:0/675674208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b94159e00 msgr2=0x7f7b9406a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:01.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b9c1ff700 1 --2- 172.21.15.82:0/675674208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b94159e00 0x7f7b9406a680 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7b940caf70 tx=0x7f7b84009bf0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b9c1ff700 1 -- 172.21.15.82:0/675674208 shutdown_connections 2023-11-28T13:01:01.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b9c1ff700 1 --2- 172.21.15.82:0/675674208 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9415cf30 0x7f7b940703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b9c1ff700 1 --2- 172.21.15.82:0/675674208 >> v2:172.21.15.114:3300/0 conn(0x7f7b9415a1d0 0x7f7b9415c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b9c1ff700 1 --2- 172.21.15.82:0/675674208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b94159e00 0x7f7b9406a680 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b9c1ff700 1 -- 172.21.15.82:0/675674208 >> 172.21.15.82:0/675674208 conn(0x7f7b940ce9b0 msgr2=0x7f7b940ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:01.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b9c1ff700 1 -- 172.21.15.82:0/675674208 shutdown_connections 2023-11-28T13:01:01.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.039+0000 7f7b9c1ff700 1 -- 172.21.15.82:0/675674208 wait complete. 2023-11-28T13:01:01.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b9c1ff700 1 Processor -- start 2023-11-28T13:01:01.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b9c1ff700 1 -- start start 2023-11-28T13:01:01.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b9c1ff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b94159e00 0x7f7b940b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:01.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b9c1ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9415a1d0 0x7f7b9406ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:01.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b9c1ff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9415cf30 0x7f7b9406cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:01.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b9c1ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b94156800 con 0x7f7b9415a1d0 2023-11-28T13:01:01.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b9c1ff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9415ab10 con 0x7f7b94159e00 2023-11-28T13:01:01.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b9c1ff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9415adf0 con 0x7f7b9415cf30 2023-11-28T13:01:01.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b9979a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9415a1d0 0x7f7b9406ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:01.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b9979a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9415a1d0 0x7f7b9406ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42338/0 (socket says 172.21.15.82:42338) 2023-11-28T13:01:01.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b9979a700 1 -- 172.21.15.82:0/2937538447 learned_addr learned my addr 172.21.15.82:0/2937538447 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:01.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b99f9b700 1 --2- 172.21.15.82:0/2937538447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b94159e00 0x7f7b940b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:01.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b9a79c700 1 --2- 172.21.15.82:0/2937538447 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9415cf30 0x7f7b9406cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:01.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b9979a700 1 -- 172.21.15.82:0/2937538447 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9415cf30 msgr2=0x7f7b9406cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:01.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b9979a700 1 --2- 172.21.15.82:0/2937538447 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9415cf30 0x7f7b9406cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b9979a700 1 -- 172.21.15.82:0/2937538447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b94159e00 msgr2=0x7f7b940b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:01.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b9979a700 1 --2- 172.21.15.82:0/2937538447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b94159e00 0x7f7b940b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b9979a700 1 -- 172.21.15.82:0/2937538447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c009a70 con 0x7f7b9415a1d0 2023-11-28T13:01:01.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b99f9b700 1 --2- 172.21.15.82:0/2937538447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b94159e00 0x7f7b940b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:01.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b9a79c700 1 --2- 172.21.15.82:0/2937538447 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9415cf30 0x7f7b9406cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:01.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b9979a700 1 --2- 172.21.15.82:0/2937538447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9415a1d0 0x7f7b9406ca00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00efc0 tx=0x7f7b8c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:01.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b8a7fc700 1 -- 172.21.15.82:0/2937538447 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c00cee0 con 0x7f7b9415a1d0 2023-11-28T13:01:01.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b8a7fc700 1 -- 172.21.15.82:0/2937538447 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8c00f040 con 0x7f7b9415a1d0 2023-11-28T13:01:01.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b9c1ff700 1 -- 172.21.15.82:0/2937538447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b84009570 con 0x7f7b9415a1d0 2023-11-28T13:01:01.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b8a7fc700 1 -- 172.21.15.82:0/2937538447 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c014680 con 0x7f7b9415a1d0 2023-11-28T13:01:01.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.043+0000 7f7b9c1ff700 1 -- 172.21.15.82:0/2937538447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9415d890 con 0x7f7b9415a1d0 2023-11-28T13:01:01.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.047+0000 7f7b9c1ff700 1 -- 172.21.15.82:0/2937538447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9415d5b0 con 0x7f7b9415a1d0 2023-11-28T13:01:01.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.047+0000 7f7b8a7fc700 1 -- 172.21.15.82:0/2937538447 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7b8c0147e0 con 0x7f7b9415a1d0 2023-11-28T13:01:01.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.047+0000 7f7b8a7fc700 1 --2- 172.21.15.82:0/2937538447 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b78064ee0 0x7f7b78067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:01.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.047+0000 7f7b8a7fc700 1 -- 172.21.15.82:0/2937538447 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b8c082f30 con 0x7f7b9415a1d0 2023-11-28T13:01:01.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.047+0000 7f7b99f9b700 1 --2- 172.21.15.82:0/2937538447 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b78064ee0 0x7f7b78067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:01.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.047+0000 7f7b99f9b700 1 --2- 172.21.15.82:0/2937538447 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b78064ee0 0x7f7b78067390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7b84000c00 tx=0x7f7b84008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:01.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.051+0000 7f7b8a7fc700 1 -- 172.21.15.82:0/2937538447 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7b8c050fe0 con 0x7f7b9415a1d0 2023-11-28T13:01:01.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.223+0000 7f7b9c1ff700 1 -- 172.21.15.82:0/2937538447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7b94069e80 con 0x7f7b9415a1d0 2023-11-28T13:01:01.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.223+0000 7f7b8a7fc700 1 -- 172.21.15.82:0/2937538447 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7b8c054600 con 0x7f7b9415a1d0 2023-11-28T13:01:01.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.227+0000 7f7b9c1ff700 1 -- 172.21.15.82:0/2937538447 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b78064ee0 msgr2=0x7f7b78067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:01.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.227+0000 7f7b9c1ff700 1 --2- 172.21.15.82:0/2937538447 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b78064ee0 0x7f7b78067390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7b84000c00 tx=0x7f7b84008030 comp rx=0 tx=0).stop 2023-11-28T13:01:01.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.227+0000 7f7b9c1ff700 1 -- 172.21.15.82:0/2937538447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9415a1d0 msgr2=0x7f7b9406ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:01.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.227+0000 7f7b9c1ff700 1 --2- 172.21.15.82:0/2937538447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9415a1d0 0x7f7b9406ca00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00efc0 tx=0x7f7b8c00c3a0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.227+0000 7f7b9c1ff700 1 -- 172.21.15.82:0/2937538447 shutdown_connections 2023-11-28T13:01:01.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.227+0000 7f7b9c1ff700 1 --2- 172.21.15.82:0/2937538447 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b78064ee0 0x7f7b78067390 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.227+0000 7f7b9c1ff700 1 --2- 172.21.15.82:0/2937538447 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9415cf30 0x7f7b9406cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.227+0000 7f7b9c1ff700 1 --2- 172.21.15.82:0/2937538447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9415a1d0 0x7f7b9406ca00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.227+0000 7f7b9c1ff700 1 --2- 172.21.15.82:0/2937538447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b94159e00 0x7f7b940b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.227+0000 7f7b9c1ff700 1 -- 172.21.15.82:0/2937538447 >> 172.21.15.82:0/2937538447 conn(0x7f7b940ce9b0 msgr2=0x7f7b940af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:01.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.227+0000 7f7b9c1ff700 1 -- 172.21.15.82:0/2937538447 shutdown_connections 2023-11-28T13:01:01.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.227+0000 7f7b9c1ff700 1 -- 172.21.15.82:0/2937538447 wait complete. 2023-11-28T13:01:01.232 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2023-11-28T13:01:01.242 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:01:01.242 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:01:01.249 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:01:01.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.355+0000 7f6d4eec9700 1 Processor -- start 2023-11-28T13:01:01.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.355+0000 7f6d4eec9700 1 -- start start 2023-11-28T13:01:01.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.355+0000 7f6d4eec9700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6d480b3910 0x7f6d4806b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:01.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.355+0000 7f6d4eec9700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6d4806c910 0x7f6d4806d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:01.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.355+0000 7f6d4eec9700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d48070070 0x7f6d480704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:01.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.355+0000 7f6d4eec9700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d4806c480 con 0x7f6d480b3910 2023-11-28T13:01:01.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.355+0000 7f6d4eec9700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d480709f0 con 0x7f6d4806c910 2023-11-28T13:01:01.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.355+0000 7f6d4eec9700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4806dbe0 con 0x7f6d48070070 2023-11-28T13:01:01.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.355+0000 7f6d4dec7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6d480b3910 0x7f6d4806b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:01.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.355+0000 7f6d4dec7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6d480b3910 0x7f6d4806b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42340/0 (socket says 172.21.15.82:42340) 2023-11-28T13:01:01.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.355+0000 7f6d4dec7700 1 -- 172.21.15.82:0/2661008907 learned_addr learned my addr 172.21.15.82:0/2661008907 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:01.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.355+0000 7f6d4e6c8700 1 --2- 172.21.15.82:0/2661008907 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d48070070 0x7f6d480704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:01.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.355+0000 7f6d4d6c6700 1 --2- 172.21.15.82:0/2661008907 >> v2:172.21.15.114:3300/0 conn(0x7f6d4806c910 0x7f6d4806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.355+0000 7f6d4dec7700 1 -- 172.21.15.82:0/2661008907 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d48070070 msgr2=0x7f6d480704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.355+0000 7f6d4dec7700 1 --2- 172.21.15.82:0/2661008907 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d48070070 0x7f6d480704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.355+0000 7f6d4dec7700 1 -- 172.21.15.82:0/2661008907 >> v2:172.21.15.114:3300/0 conn(0x7f6d4806c910 msgr2=0x7f6d4806d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.355+0000 7f6d4dec7700 1 --2- 172.21.15.82:0/2661008907 >> v2:172.21.15.114:3300/0 conn(0x7f6d4806c910 0x7f6d4806d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.355+0000 7f6d4dec7700 1 -- 172.21.15.82:0/2661008907 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4806dec0 con 0x7f6d480b3910 2023-11-28T13:01:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.355+0000 7f6d4d6c6700 1 --2- 172.21.15.82:0/2661008907 >> v2:172.21.15.114:3300/0 conn(0x7f6d4806c910 0x7f6d4806d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.359+0000 7f6d4dec7700 1 --2- 172.21.15.82:0/2661008907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d480b3910 0x7f6d4806b0a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6d4806bd00 tx=0x7f6d3c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc660df6aedc09e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.359+0000 7f6d4cec5700 1 -- 172.21.15.82:0/2661008907 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c011830 con 0x7f6d480b3910 2023-11-28T13:01:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.359+0000 7f6d4cec5700 1 -- 172.21.15.82:0/2661008907 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c011990 con 0x7f6d480b3910 2023-11-28T13:01:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.359+0000 7f6d4cec5700 1 -- 172.21.15.82:0/2661008907 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c011d20 con 0x7f6d480b3910 2023-11-28T13:01:01.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.359+0000 7f6d4eec9700 1 -- 172.21.15.82:0/2661008907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d480b3910 msgr2=0x7f6d4806b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:01.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.359+0000 7f6d4eec9700 1 --2- 172.21.15.82:0/2661008907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d480b3910 0x7f6d4806b0a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6d4806bd00 tx=0x7f6d3c009bf0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.359+0000 7f6d4eec9700 1 -- 172.21.15.82:0/2661008907 shutdown_connections 2023-11-28T13:01:01.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.359+0000 7f6d4eec9700 1 --2- 172.21.15.82:0/2661008907 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d48070070 0x7f6d480704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.359+0000 7f6d4eec9700 1 --2- 172.21.15.82:0/2661008907 >> v2:172.21.15.114:3300/0 conn(0x7f6d4806c910 0x7f6d4806d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.359+0000 7f6d4eec9700 1 --2- 172.21.15.82:0/2661008907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d480b3910 0x7f6d4806b0a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.359+0000 7f6d4eec9700 1 -- 172.21.15.82:0/2661008907 >> 172.21.15.82:0/2661008907 conn(0x7f6d480ce600 msgr2=0x7f6d480ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:01.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.359+0000 7f6d4eec9700 1 -- 172.21.15.82:0/2661008907 shutdown_connections 2023-11-28T13:01:01.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.359+0000 7f6d4eec9700 1 -- 172.21.15.82:0/2661008907 wait complete. 2023-11-28T13:01:01.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.359+0000 7f6d4eec9700 1 Processor -- start 2023-11-28T13:01:01.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.359+0000 7f6d4eec9700 1 -- start start 2023-11-28T13:01:01.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.359+0000 7f6d4eec9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d4806c910 0x7f6d48148b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:01.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.359+0000 7f6d4eec9700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d48070070 0x7f6d480b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:01.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.359+0000 7f6d4eec9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d480b0770 0x7f6d480c5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:01.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.359+0000 7f6d4eec9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480b0c10 con 0x7f6d480b0770 2023-11-28T13:01:01.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.359+0000 7f6d4eec9700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480c64b0 con 0x7f6d4806c910 2023-11-28T13:01:01.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.363+0000 7f6d4eec9700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480c89d0 con 0x7f6d48070070 2023-11-28T13:01:01.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.363+0000 7f6d4e6c8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d480b0770 0x7f6d480c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:01.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.363+0000 7f6d4e6c8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d480b0770 0x7f6d480c5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42352/0 (socket says 172.21.15.82:42352) 2023-11-28T13:01:01.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.363+0000 7f6d4e6c8700 1 -- 172.21.15.82:0/533329612 learned_addr learned my addr 172.21.15.82:0/533329612 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:01.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.363+0000 7f6d4d6c6700 1 --2- 172.21.15.82:0/533329612 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d48070070 0x7f6d480b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:01.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.363+0000 7f6d4dec7700 1 --2- 172.21.15.82:0/533329612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d4806c910 0x7f6d48148b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:01.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.363+0000 7f6d4e6c8700 1 -- 172.21.15.82:0/533329612 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d48070070 msgr2=0x7f6d480b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:01.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.363+0000 7f6d4e6c8700 1 --2- 172.21.15.82:0/533329612 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d48070070 0x7f6d480b0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.363+0000 7f6d4e6c8700 1 -- 172.21.15.82:0/533329612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d4806c910 msgr2=0x7f6d48148b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:01.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.363+0000 7f6d4e6c8700 1 --2- 172.21.15.82:0/533329612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d4806c910 0x7f6d48148b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.363+0000 7f6d4e6c8700 1 -- 172.21.15.82:0/533329612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c009570 con 0x7f6d480b0770 2023-11-28T13:01:01.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.363+0000 7f6d4e6c8700 1 --2- 172.21.15.82:0/533329612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d480b0770 0x7f6d480c5740 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000efc0 tx=0x7f6d4000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:01.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.363+0000 7f6d467fc700 1 -- 172.21.15.82:0/533329612 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4000cad0 con 0x7f6d480b0770 2023-11-28T13:01:01.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.363+0000 7f6d467fc700 1 -- 172.21.15.82:0/533329612 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4000f040 con 0x7f6d480b0770 2023-11-28T13:01:01.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.363+0000 7f6d4eec9700 1 -- 172.21.15.82:0/533329612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d480c8f80 con 0x7f6d480b0770 2023-11-28T13:01:01.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.363+0000 7f6d467fc700 1 -- 172.21.15.82:0/533329612 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4000ce70 con 0x7f6d480b0770 2023-11-28T13:01:01.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.363+0000 7f6d4eec9700 1 -- 172.21.15.82:0/533329612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4806c110 con 0x7f6d480b0770 2023-11-28T13:01:01.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.363+0000 7f6d4eec9700 1 -- 172.21.15.82:0/533329612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4806d860 con 0x7f6d480b0770 2023-11-28T13:01:01.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.363+0000 7f6d467fc700 1 -- 172.21.15.82:0/533329612 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6d40014480 con 0x7f6d480b0770 2023-11-28T13:01:01.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.363+0000 7f6d467fc700 1 --2- 172.21.15.82:0/533329612 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6d34064ee0 0x7f6d34067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:01.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.367+0000 7f6d467fc700 1 -- 172.21.15.82:0/533329612 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6d40082930 con 0x7f6d480b0770 2023-11-28T13:01:01.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.367+0000 7f6d4dec7700 1 --2- 172.21.15.82:0/533329612 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6d34064ee0 0x7f6d34067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:01.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.367+0000 7f6d4dec7700 1 --2- 172.21.15.82:0/533329612 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6d34064ee0 0x7f6d34067390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6d4806e580 tx=0x7f6d3c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:01.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.371+0000 7f6d467fc700 1 -- 172.21.15.82:0/533329612 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6d40050a70 con 0x7f6d480b0770 2023-11-28T13:01:01.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.535+0000 7f6d4eec9700 1 -- 172.21.15.82:0/533329612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d48065fc0 con 0x7f6d480b0770 2023-11-28T13:01:01.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.539+0000 7f6d467fc700 1 -- 172.21.15.82:0/533329612 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17811 (secure 0 0 0) 0x7f6d40054090 con 0x7f6d480b0770 2023-11-28T13:01:01.545 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:01.545 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:00:26.981345+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:00:24.360641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T13:00:24.960863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:01:01.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.543+0000 7f6d4eec9700 1 -- 172.21.15.82:0/533329612 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6d34064ee0 msgr2=0x7f6d34067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:01.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.543+0000 7f6d4eec9700 1 --2- 172.21.15.82:0/533329612 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6d34064ee0 0x7f6d34067390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6d4806e580 tx=0x7f6d3c008030 comp rx=0 tx=0).stop 2023-11-28T13:01:01.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.543+0000 7f6d4eec9700 1 -- 172.21.15.82:0/533329612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d480b0770 msgr2=0x7f6d480c5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:01.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.543+0000 7f6d4eec9700 1 --2- 172.21.15.82:0/533329612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d480b0770 0x7f6d480c5740 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000efc0 tx=0x7f6d4000c0c0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.543+0000 7f6d4eec9700 1 -- 172.21.15.82:0/533329612 shutdown_connections 2023-11-28T13:01:01.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.543+0000 7f6d4eec9700 1 --2- 172.21.15.82:0/533329612 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6d34064ee0 0x7f6d34067390 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.543+0000 7f6d4eec9700 1 --2- 172.21.15.82:0/533329612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d480b0770 0x7f6d480c5740 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.543+0000 7f6d4eec9700 1 --2- 172.21.15.82:0/533329612 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d48070070 0x7f6d480b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.543+0000 7f6d4eec9700 1 --2- 172.21.15.82:0/533329612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d4806c910 0x7f6d48148b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.543+0000 7f6d4eec9700 1 -- 172.21.15.82:0/533329612 >> 172.21.15.82:0/533329612 conn(0x7f6d480ce600 msgr2=0x7f6d480b1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.543+0000 7f6d4eec9700 1 -- 172.21.15.82:0/533329612 shutdown_connections 2023-11-28T13:01:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.543+0000 7f6d4eec9700 1 -- 172.21.15.82:0/533329612 wait complete. 2023-11-28T13:01:01.561 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T13:00:24.360641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T13:00:24.960863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:01:01.561 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:01:01.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.679+0000 7f2d134cc700 1 Processor -- start 2023-11-28T13:01:01.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.683+0000 7f2d134cc700 1 -- start start 2023-11-28T13:01:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.683+0000 7f2d134cc700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2d0c150ee0 0x7f2d0c070120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.683+0000 7f2d134cc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0c069bc0 con 0x7f2d0c070660 2023-11-28T13:01:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.683+0000 7f2d134cc700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0c069e80 con 0x7f2d0c0ad8b0 2023-11-28T13:01:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.683+0000 7f2d134cc700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c06a160 con 0x7f2d0c150ee0 2023-11-28T13:01:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.683+0000 7f2d11cc9700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2d0c070660 0x7f2d0c06ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58368/0 (socket says 172.21.15.82:58368) 2023-11-28T13:01:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.683+0000 7f2d11cc9700 1 -- 172.21.15.82:0/1694350774 learned_addr learned my addr 172.21.15.82:0/1694350774 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.683+0000 7f2d124ca700 1 --2- 172.21.15.82:0/1694350774 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2d0c150ee0 0x7f2d0c070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.683+0000 7f2d114c8700 1 -- 172.21.15.82:0/1694350774 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509535513 0 0) 0x7f2d0c069bc0 con 0x7f2d0c070660 2023-11-28T13:01:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.683+0000 7f2d114c8700 1 -- 172.21.15.82:0/1694350774 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cf80035d0 con 0x7f2d0c070660 2023-11-28T13:01:01.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.683+0000 7f2d114c8700 1 -- 172.21.15.82:0/1694350774 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257935547 0 0) 0x7f2d0c069e80 con 0x7f2d0c0ad8b0 2023-11-28T13:01:01.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.683+0000 7f2d114c8700 1 -- 172.21.15.82:0/1694350774 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d0c069bc0 con 0x7f2d0c0ad8b0 2023-11-28T13:01:01.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.683+0000 7f2d124ca700 1 -- 172.21.15.82:0/1694350774 >> v1:172.21.15.114:6789/0 conn(0x7f2d0c0ad8b0 legacy=0x7f2d0c15a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:01.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.683+0000 7f2d124ca700 1 -- 172.21.15.82:0/1694350774 >> v1:172.21.15.82:6789/0 conn(0x7f2d0c070660 legacy=0x7f2d0c06ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:01.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.683+0000 7f2d124ca700 1 -- 172.21.15.82:0/1694350774 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c06a440 con 0x7f2d0c150ee0 2023-11-28T13:01:01.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.683+0000 7f2d124ca700 1 --2- 172.21.15.82:0/1694350774 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2d0c150ee0 0x7f2d0c070120 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009880 tx=0x7f2d08009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7cb73d6dd1bebd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:01.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.683+0000 7f2d114c8700 1 -- 172.21.15.82:0/1694350774 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08011830 con 0x7f2d0c150ee0 2023-11-28T13:01:01.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.683+0000 7f2d114c8700 1 -- 172.21.15.82:0/1694350774 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d08011990 con 0x7f2d0c150ee0 2023-11-28T13:01:01.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.683+0000 7f2d114c8700 1 -- 172.21.15.82:0/1694350774 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08011d20 con 0x7f2d0c150ee0 2023-11-28T13:01:01.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.687+0000 7f2d134cc700 1 -- 172.21.15.82:0/1694350774 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2d0c150ee0 msgr2=0x7f2d0c070120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:01.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.687+0000 7f2d134cc700 1 --2- 172.21.15.82:0/1694350774 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2d0c150ee0 0x7f2d0c070120 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009880 tx=0x7f2d08009b90 comp rx=0 tx=0).stop 2023-11-28T13:01:01.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.687+0000 7f2d134cc700 1 -- 172.21.15.82:0/1694350774 shutdown_connections 2023-11-28T13:01:01.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.687+0000 7f2d134cc700 1 --2- 172.21.15.82:0/1694350774 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2d0c150ee0 0x7f2d0c070120 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.687+0000 7f2d134cc700 1 -- 172.21.15.82:0/1694350774 >> 172.21.15.82:0/1694350774 conn(0x7f2d0c0ce630 msgr2=0x7f2d0c0cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:01.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.687+0000 7f2d134cc700 1 -- 172.21.15.82:0/1694350774 shutdown_connections 2023-11-28T13:01:01.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.687+0000 7f2d134cc700 1 -- 172.21.15.82:0/1694350774 wait complete. 2023-11-28T13:01:01.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.687+0000 7f2d134cc700 1 Processor -- start 2023-11-28T13:01:01.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.687+0000 7f2d134cc700 1 -- start start 2023-11-28T13:01:01.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d134cc700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2d0c070660 0x7f2d0c14f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:01.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d134cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d0c0ad8b0 0x7f2d0c1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:01.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d134cc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0c150ee0 0x7f2d0c159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:01.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d134cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c152990 con 0x7f2d0c0ad8b0 2023-11-28T13:01:01.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d134cc700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c152b70 con 0x7f2d0c150ee0 2023-11-28T13:01:01.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d134cc700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c152e50 con 0x7f2d0c070660 2023-11-28T13:01:01.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d11cc9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d0c0ad8b0 0x7f2d0c1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:01.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d11cc9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d0c0ad8b0 0x7f2d0c1591e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42362/0 (socket says 172.21.15.82:42362) 2023-11-28T13:01:01.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d11cc9700 1 -- 172.21.15.82:0/12060714 learned_addr learned my addr 172.21.15.82:0/12060714 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:01.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d12ccb700 1 --2- 172.21.15.82:0/12060714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0c150ee0 0x7f2d0c159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:01.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d124ca700 1 --2- 172.21.15.82:0/12060714 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2d0c070660 0x7f2d0c14f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:01.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d11cc9700 1 -- 172.21.15.82:0/12060714 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2d0c070660 msgr2=0x7f2d0c14f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:01.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d11cc9700 1 --2- 172.21.15.82:0/12060714 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2d0c070660 0x7f2d0c14f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d11cc9700 1 -- 172.21.15.82:0/12060714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0c150ee0 msgr2=0x7f2d0c159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:01.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d11cc9700 1 --2- 172.21.15.82:0/12060714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0c150ee0 0x7f2d0c159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d11cc9700 1 -- 172.21.15.82:0/12060714 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d080094b0 con 0x7f2d0c0ad8b0 2023-11-28T13:01:01.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d12ccb700 1 --2- 172.21.15.82:0/12060714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0c150ee0 0x7f2d0c159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:01.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d11cc9700 1 --2- 172.21.15.82:0/12060714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d0c0ad8b0 0x7f2d0c1591e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00c700 tx=0x7f2cfc00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:01.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d02ffd700 1 -- 172.21.15.82:0/12060714 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc005d90 con 0x7f2d0c0ad8b0 2023-11-28T13:01:01.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d02ffd700 1 -- 172.21.15.82:0/12060714 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc0070d0 con 0x7f2d0c0ad8b0 2023-11-28T13:01:01.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d134cc700 1 -- 172.21.15.82:0/12060714 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0c06b350 con 0x7f2d0c0ad8b0 2023-11-28T13:01:01.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d02ffd700 1 -- 172.21.15.82:0/12060714 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc007440 con 0x7f2d0c0ad8b0 2023-11-28T13:01:01.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d134cc700 1 -- 172.21.15.82:0/12060714 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0c06a720 con 0x7f2d0c0ad8b0 2023-11-28T13:01:01.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.691+0000 7f2d134cc700 1 -- 172.21.15.82:0/12060714 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0c06b4e0 con 0x7f2d0c0ad8b0 2023-11-28T13:01:01.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.695+0000 7f2d02ffd700 1 -- 172.21.15.82:0/12060714 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2cfc019030 con 0x7f2d0c0ad8b0 2023-11-28T13:01:01.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.695+0000 7f2d02ffd700 1 --2- 172.21.15.82:0/12060714 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2cf0064ee0 0x7f2cf0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:01.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.695+0000 7f2d02ffd700 1 -- 172.21.15.82:0/12060714 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2cfc0810c0 con 0x7f2d0c0ad8b0 2023-11-28T13:01:01.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.695+0000 7f2d124ca700 1 --2- 172.21.15.82:0/12060714 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2cf0064ee0 0x7f2cf0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:01.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.695+0000 7f2d124ca700 1 --2- 172.21.15.82:0/12060714 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2cf0064ee0 0x7f2cf0067390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2d080090b0 tx=0x7f2d0801c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:01.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.699+0000 7f2d02ffd700 1 -- 172.21.15.82:0/12060714 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2cfc04a400 con 0x7f2d0c0ad8b0 2023-11-28T13:01:01.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.859+0000 7f2d134cc700 1 -- 172.21.15.82:0/12060714 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2d0c065fc0 con 0x7f2d0c0ad8b0 2023-11-28T13:01:01.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.859+0000 7f2d02ffd700 1 -- 172.21.15.82:0/12060714 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2d0c06b4e0 con 0x7f2d0c0ad8b0 2023-11-28T13:01:01.865 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:01:01.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.863+0000 7f2d134cc700 1 -- 172.21.15.82:0/12060714 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2cf0064ee0 msgr2=0x7f2cf0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:01.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.863+0000 7f2d134cc700 1 --2- 172.21.15.82:0/12060714 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2cf0064ee0 0x7f2cf0067390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2d080090b0 tx=0x7f2d0801c040 comp rx=0 tx=0).stop 2023-11-28T13:01:01.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.863+0000 7f2d134cc700 1 -- 172.21.15.82:0/12060714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d0c0ad8b0 msgr2=0x7f2d0c1591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:01.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.863+0000 7f2d134cc700 1 --2- 172.21.15.82:0/12060714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d0c0ad8b0 0x7f2d0c1591e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00c700 tx=0x7f2cfc00ca10 comp rx=0 tx=0).stop 2023-11-28T13:01:01.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.863+0000 7f2d134cc700 1 -- 172.21.15.82:0/12060714 shutdown_connections 2023-11-28T13:01:01.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.863+0000 7f2d134cc700 1 --2- 172.21.15.82:0/12060714 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2cf0064ee0 0x7f2cf0067390 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.863+0000 7f2d134cc700 1 --2- 172.21.15.82:0/12060714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0c150ee0 0x7f2d0c159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.863+0000 7f2d134cc700 1 --2- 172.21.15.82:0/12060714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d0c0ad8b0 0x7f2d0c1591e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.863+0000 7f2d134cc700 1 --2- 172.21.15.82:0/12060714 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2d0c070660 0x7f2d0c14f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:01.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.863+0000 7f2d134cc700 1 -- 172.21.15.82:0/12060714 >> 172.21.15.82:0/12060714 conn(0x7f2d0c0ce630 msgr2=0x7f2d0c0add10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:01.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.863+0000 7f2d134cc700 1 -- 172.21.15.82:0/12060714 shutdown_connections 2023-11-28T13:01:01.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.863+0000 7f2d134cc700 1 -- 172.21.15.82:0/12060714 wait complete. 2023-11-28T13:01:01.887 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:01:02.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.999+0000 7f2260870700 1 Processor -- start 2023-11-28T13:01:02.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:01.999+0000 7f2260870700 1 -- start start 2023-11-28T13:01:02.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f2260870700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f225c0b1d10 0x7f225c0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f2260870700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f225c0d25b0 0x7f225c06ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f2260870700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225c069bc0 con 0x7f225c0b5940 2023-11-28T13:01:02.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f2260870700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225c0d1480 con 0x7f225c0b1d10 2023-11-28T13:01:02.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f2260870700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c0cd280 con 0x7f225c0d25b0 2023-11-28T13:01:02.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f225ad9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f225c0b1d10 0x7f225c0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f225b59e700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f225c0b5940 0x7f225c06a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58382/0 (socket says 172.21.15.82:58382) 2023-11-28T13:01:02.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f225b59e700 1 -- 172.21.15.82:0/1220107974 learned_addr learned my addr 172.21.15.82:0/1220107974 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:02.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f225a59c700 1 --2- 172.21.15.82:0/1220107974 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f225c0d25b0 0x7f225c06ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f225ad9d700 1 -- 172.21.15.82:0/1220107974 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f225c0d25b0 msgr2=0x7f225c06ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:02.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f225ad9d700 1 --2- 172.21.15.82:0/1220107974 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f225c0d25b0 0x7f225c06ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f225ad9d700 1 -- 172.21.15.82:0/1220107974 >> v1:172.21.15.82:6789/0 conn(0x7f225c0b5940 legacy=0x7f225c06a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f225ad9d700 1 -- 172.21.15.82:0/1220107974 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c0cd560 con 0x7f225c0b1d10 2023-11-28T13:01:02.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f225ad9d700 1 --2- 172.21.15.82:0/1220107974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f225c0b1d10 0x7f225c0cec20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f224c009880 tx=0x7f224c009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41663752360f872 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f2259d9b700 1 -- 172.21.15.82:0/1220107974 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c011830 con 0x7f225c0b1d10 2023-11-28T13:01:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f2259d9b700 1 -- 172.21.15.82:0/1220107974 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224c011990 con 0x7f225c0b1d10 2023-11-28T13:01:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f2259d9b700 1 -- 172.21.15.82:0/1220107974 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c011d20 con 0x7f225c0b1d10 2023-11-28T13:01:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f2260870700 1 -- 172.21.15.82:0/1220107974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f225c0b1d10 msgr2=0x7f225c0cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f2260870700 1 --2- 172.21.15.82:0/1220107974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f225c0b1d10 0x7f225c0cec20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f224c009880 tx=0x7f224c009b90 comp rx=0 tx=0).stop 2023-11-28T13:01:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f2260870700 1 -- 172.21.15.82:0/1220107974 shutdown_connections 2023-11-28T13:01:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f2260870700 1 --2- 172.21.15.82:0/1220107974 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f225c0d25b0 0x7f225c06ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f2260870700 1 --2- 172.21.15.82:0/1220107974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f225c0b1d10 0x7f225c0cec20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f2260870700 1 -- 172.21.15.82:0/1220107974 >> 172.21.15.82:0/1220107974 conn(0x7f225c0b52a0 msgr2=0x7f225c0d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f2260870700 1 -- 172.21.15.82:0/1220107974 shutdown_connections 2023-11-28T13:01:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.003+0000 7f2260870700 1 -- 172.21.15.82:0/1220107974 wait complete. 2023-11-28T13:01:02.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.007+0000 7f2260870700 1 Processor -- start 2023-11-28T13:01:02.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.007+0000 7f2260870700 1 -- start start 2023-11-28T13:01:02.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.007+0000 7f2260870700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f225c0b1d10 0x7f225c15cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.007+0000 7f2260870700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f225c0b5940 0x7f225c0c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.007+0000 7f2260870700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f225c0d25b0 0x7f225c0b70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.007+0000 7f2260870700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c0c8ec0 con 0x7f225c0d25b0 2023-11-28T13:01:02.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.007+0000 7f2260870700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c0c8240 con 0x7f225c0b5940 2023-11-28T13:01:02.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.007+0000 7f2260870700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c0c8520 con 0x7f225c0b1d10 2023-11-28T13:01:02.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.007+0000 7f225b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f225c0d25b0 0x7f225c0b70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.007+0000 7f225b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f225c0d25b0 0x7f225c0b70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42378/0 (socket says 172.21.15.82:42378) 2023-11-28T13:01:02.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.007+0000 7f225b59e700 1 -- 172.21.15.82:0/14068867 learned_addr learned my addr 172.21.15.82:0/14068867 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:02.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.007+0000 7f225a59c700 1 --2- 172.21.15.82:0/14068867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f225c0b5940 0x7f225c0c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.007+0000 7f225ad9d700 1 --2- 172.21.15.82:0/14068867 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f225c0b1d10 0x7f225c15cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.011+0000 7f225b59e700 1 -- 172.21.15.82:0/14068867 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f225c0b1d10 msgr2=0x7f225c15cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.011+0000 7f225b59e700 1 --2- 172.21.15.82:0/14068867 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f225c0b1d10 0x7f225c15cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.011+0000 7f225b59e700 1 -- 172.21.15.82:0/14068867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f225c0b5940 msgr2=0x7f225c0c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.011+0000 7f225b59e700 1 --2- 172.21.15.82:0/14068867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f225c0b5940 0x7f225c0c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.011+0000 7f225b59e700 1 -- 172.21.15.82:0/14068867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c0094b0 con 0x7f225c0d25b0 2023-11-28T13:01:02.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.011+0000 7f225b59e700 1 --2- 172.21.15.82:0/14068867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f225c0d25b0 0x7f225c0b70a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f225400cbc0 tx=0x7f225400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.011+0000 7f22537fe700 1 -- 172.21.15.82:0/14068867 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254007480 con 0x7f225c0d25b0 2023-11-28T13:01:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.011+0000 7f22537fe700 1 -- 172.21.15.82:0/14068867 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22540075e0 con 0x7f225c0d25b0 2023-11-28T13:01:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.011+0000 7f2260870700 1 -- 172.21.15.82:0/14068867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225c0d1050 con 0x7f225c0d25b0 2023-11-28T13:01:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.011+0000 7f22537fe700 1 -- 172.21.15.82:0/14068867 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254007950 con 0x7f225c0d25b0 2023-11-28T13:01:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.011+0000 7f2260870700 1 -- 172.21.15.82:0/14068867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225c0b20e0 con 0x7f225c0d25b0 2023-11-28T13:01:02.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.011+0000 7f2260870700 1 -- 172.21.15.82:0/14068867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225c0d11e0 con 0x7f225c0d25b0 2023-11-28T13:01:02.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.011+0000 7f22537fe700 1 -- 172.21.15.82:0/14068867 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2254019030 con 0x7f225c0d25b0 2023-11-28T13:01:02.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.015+0000 7f22537fe700 1 --2- 172.21.15.82:0/14068867 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f223c064ee0 0x7f223c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.015+0000 7f22537fe700 1 -- 172.21.15.82:0/14068867 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2254081730 con 0x7f225c0d25b0 2023-11-28T13:01:02.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.015+0000 7f225ad9d700 1 --2- 172.21.15.82:0/14068867 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f223c064ee0 0x7f223c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.015+0000 7f225ad9d700 1 --2- 172.21.15.82:0/14068867 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f223c064ee0 0x7f223c067390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f224c009bd0 tx=0x7f224c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:02.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.019+0000 7f22537fe700 1 -- 172.21.15.82:0/14068867 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f225404a400 con 0x7f225c0d25b0 2023-11-28T13:01:02.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.179+0000 7f2260870700 1 -- 172.21.15.82:0/14068867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f225c0c9000 con 0x7f225c0d25b0 2023-11-28T13:01:02.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.179+0000 7f22537fe700 1 -- 172.21.15.82:0/14068867 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2254017020 con 0x7f225c0d25b0 2023-11-28T13:01:02.185 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:01:02.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.183+0000 7f2260870700 1 -- 172.21.15.82:0/14068867 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f223c064ee0 msgr2=0x7f223c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.183+0000 7f2260870700 1 --2- 172.21.15.82:0/14068867 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f223c064ee0 0x7f223c067390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f224c009bd0 tx=0x7f224c008030 comp rx=0 tx=0).stop 2023-11-28T13:01:02.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.183+0000 7f2260870700 1 -- 172.21.15.82:0/14068867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f225c0d25b0 msgr2=0x7f225c0b70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.183+0000 7f2260870700 1 --2- 172.21.15.82:0/14068867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f225c0d25b0 0x7f225c0b70a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f225400cbc0 tx=0x7f225400cbf0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.183+0000 7f2260870700 1 -- 172.21.15.82:0/14068867 shutdown_connections 2023-11-28T13:01:02.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.183+0000 7f2260870700 1 --2- 172.21.15.82:0/14068867 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f223c064ee0 0x7f223c067390 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.183+0000 7f2260870700 1 --2- 172.21.15.82:0/14068867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f225c0d25b0 0x7f225c0b70a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.183+0000 7f2260870700 1 --2- 172.21.15.82:0/14068867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f225c0b5940 0x7f225c0c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.183+0000 7f2260870700 1 --2- 172.21.15.82:0/14068867 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f225c0b1d10 0x7f225c15cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.183+0000 7f2260870700 1 -- 172.21.15.82:0/14068867 >> 172.21.15.82:0/14068867 conn(0x7f225c0b52a0 msgr2=0x7f225c0d2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:02.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.183+0000 7f2260870700 1 -- 172.21.15.82:0/14068867 shutdown_connections 2023-11-28T13:01:02.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.183+0000 7f2260870700 1 -- 172.21.15.82:0/14068867 wait complete. 2023-11-28T13:01:02.200 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T13:01:02.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.315+0000 7f546ffff700 1 Processor -- start 2023-11-28T13:01:02.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.315+0000 7f546ffff700 1 -- start start 2023-11-28T13:01:02.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.315+0000 7f546ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54680e12a0 0x7f5468037b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.315+0000 7f546ffff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54680e0af0 con 0x7f54680e1670 2023-11-28T13:01:02.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.315+0000 7f546ffff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5468050f00 con 0x7f5468036770 2023-11-28T13:01:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.315+0000 7f546ffff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54680e45f0 con 0x7f54680e12a0 2023-11-28T13:01:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.315+0000 7f546effd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54680e12a0 0x7f5468037b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.315+0000 7f546e7fc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f54680e1670 0x7f54680e4a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58388/0 (socket says 172.21.15.82:58388) 2023-11-28T13:01:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.315+0000 7f546e7fc700 1 -- 172.21.15.82:0/3312783105 learned_addr learned my addr 172.21.15.82:0/3312783105 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.315+0000 7f546effd700 1 -- 172.21.15.82:0/3312783105 >> v1:172.21.15.114:6789/0 conn(0x7f5468036770 legacy=0x7f546804f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.315+0000 7f546dffb700 1 -- 172.21.15.82:0/3312783105 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008411133 0 0) 0x7f5458001110 con 0x7f54680e1670 2023-11-28T13:01:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.315+0000 7f546effd700 1 -- 172.21.15.82:0/3312783105 >> v1:172.21.15.82:6789/0 conn(0x7f54680e1670 legacy=0x7f54680e4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.315+0000 7f546effd700 1 -- 172.21.15.82:0/3312783105 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5468051150 con 0x7f54680e12a0 2023-11-28T13:01:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.315+0000 7f546effd700 1 --2- 172.21.15.82:0/3312783105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54680e12a0 0x7f5468037b40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5460009850 tx=0x7f5460009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2672eb6f6bb2c778 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.319+0000 7f546dffb700 1 -- 172.21.15.82:0/3312783105 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460011830 con 0x7f54680e12a0 2023-11-28T13:01:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.319+0000 7f546dffb700 1 -- 172.21.15.82:0/3312783105 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5460011990 con 0x7f54680e12a0 2023-11-28T13:01:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.319+0000 7f546dffb700 1 -- 172.21.15.82:0/3312783105 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460011d20 con 0x7f54680e12a0 2023-11-28T13:01:02.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.319+0000 7f546ffff700 1 -- 172.21.15.82:0/3312783105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54680e12a0 msgr2=0x7f5468037b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.319+0000 7f546ffff700 1 --2- 172.21.15.82:0/3312783105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54680e12a0 0x7f5468037b40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5460009850 tx=0x7f5460009b60 comp rx=0 tx=0).stop 2023-11-28T13:01:02.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.319+0000 7f546ffff700 1 -- 172.21.15.82:0/3312783105 shutdown_connections 2023-11-28T13:01:02.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.319+0000 7f546ffff700 1 --2- 172.21.15.82:0/3312783105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54680e12a0 0x7f5468037b40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.319+0000 7f546ffff700 1 -- 172.21.15.82:0/3312783105 >> 172.21.15.82:0/3312783105 conn(0x7f5468051770 msgr2=0x7f5468051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:02.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.319+0000 7f546ffff700 1 -- 172.21.15.82:0/3312783105 shutdown_connections 2023-11-28T13:01:02.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.319+0000 7f546ffff700 1 -- 172.21.15.82:0/3312783105 wait complete. 2023-11-28T13:01:02.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.319+0000 7f546ffff700 1 Processor -- start 2023-11-28T13:01:02.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.319+0000 7f546ffff700 1 -- start start 2023-11-28T13:01:02.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f546ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5468036770 0x7f546816b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f546ffff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54680e12a0 0x7f54680dd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f546ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54680e1670 0x7f54680ddbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f546ffff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54680485c0 con 0x7f5468036770 2023-11-28T13:01:02.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f546ffff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546816a5a0 con 0x7f54680e1670 2023-11-28T13:01:02.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f546ffff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546816a880 con 0x7f54680e12a0 2023-11-28T13:01:02.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f546effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5468036770 0x7f546816b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f546effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5468036770 0x7f546816b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42390/0 (socket says 172.21.15.82:42390) 2023-11-28T13:01:02.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f546effd700 1 -- 172.21.15.82:0/2847783300 learned_addr learned my addr 172.21.15.82:0/2847783300 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:02.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f546e7fc700 1 --2- 172.21.15.82:0/2847783300 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54680e12a0 0x7f54680dd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f546f7fe700 1 --2- 172.21.15.82:0/2847783300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54680e1670 0x7f54680ddbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f546effd700 1 -- 172.21.15.82:0/2847783300 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54680e12a0 msgr2=0x7f54680dd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f546effd700 1 --2- 172.21.15.82:0/2847783300 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54680e12a0 0x7f54680dd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f546effd700 1 -- 172.21.15.82:0/2847783300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54680e1670 msgr2=0x7f54680ddbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f546effd700 1 --2- 172.21.15.82:0/2847783300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54680e1670 0x7f54680ddbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f546effd700 1 -- 172.21.15.82:0/2847783300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54600094b0 con 0x7f5468036770 2023-11-28T13:01:02.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f546effd700 1 --2- 172.21.15.82:0/2847783300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5468036770 0x7f546816b640 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5460000c00 tx=0x7f5460004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:02.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f54677fe700 1 -- 172.21.15.82:0/2847783300 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54600038c0 con 0x7f5468036770 2023-11-28T13:01:02.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f54677fe700 1 -- 172.21.15.82:0/2847783300 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5460003a40 con 0x7f5468036770 2023-11-28T13:01:02.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f546ffff700 1 -- 172.21.15.82:0/2847783300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54680e4210 con 0x7f5468036770 2023-11-28T13:01:02.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f54677fe700 1 -- 172.21.15.82:0/2847783300 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460003df0 con 0x7f5468036770 2023-11-28T13:01:02.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.323+0000 7f546ffff700 1 -- 172.21.15.82:0/2847783300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5468051430 con 0x7f5468036770 2023-11-28T13:01:02.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.327+0000 7f546ffff700 1 -- 172.21.15.82:0/2847783300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54680e5120 con 0x7f5468036770 2023-11-28T13:01:02.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.327+0000 7f54677fe700 1 -- 172.21.15.82:0/2847783300 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f546002d070 con 0x7f5468036770 2023-11-28T13:01:02.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.327+0000 7f54677fe700 1 --2- 172.21.15.82:0/2847783300 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5450064ee0 0x7f5450067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.327+0000 7f54677fe700 1 -- 172.21.15.82:0/2847783300 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5460021030 con 0x7f5468036770 2023-11-28T13:01:02.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.327+0000 7f546e7fc700 1 --2- 172.21.15.82:0/2847783300 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5450064ee0 0x7f5450067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.327+0000 7f546e7fc700 1 --2- 172.21.15.82:0/2847783300 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5450064ee0 0x7f5450067390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f54680dbe30 tx=0x7f5458007db0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:02.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.335+0000 7f54677fe700 1 -- 172.21.15.82:0/2847783300 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5460052000 con 0x7f5468036770 2023-11-28T13:01:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.499+0000 7f546ffff700 1 -- 172.21.15.82:0/2847783300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5468005570 con 0x7f5468036770 2023-11-28T13:01:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.503+0000 7f54677fe700 1 -- 172.21.15.82:0/2847783300 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f546002b020 con 0x7f5468036770 2023-11-28T13:01:02.507 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-11-28T13:01:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.503+0000 7f546ffff700 1 -- 172.21.15.82:0/2847783300 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5450064ee0 msgr2=0x7f5450067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.503+0000 7f546ffff700 1 --2- 172.21.15.82:0/2847783300 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5450064ee0 0x7f5450067390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f54680dbe30 tx=0x7f5458007db0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.503+0000 7f546ffff700 1 -- 172.21.15.82:0/2847783300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5468036770 msgr2=0x7f546816b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.503+0000 7f546ffff700 1 --2- 172.21.15.82:0/2847783300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5468036770 0x7f546816b640 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5460000c00 tx=0x7f5460004770 comp rx=0 tx=0).stop 2023-11-28T13:01:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.503+0000 7f546ffff700 1 -- 172.21.15.82:0/2847783300 shutdown_connections 2023-11-28T13:01:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.503+0000 7f546ffff700 1 --2- 172.21.15.82:0/2847783300 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5450064ee0 0x7f5450067390 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.503+0000 7f546ffff700 1 --2- 172.21.15.82:0/2847783300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54680e1670 0x7f54680ddbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.503+0000 7f546ffff700 1 --2- 172.21.15.82:0/2847783300 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54680e12a0 0x7f54680dd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.503+0000 7f546ffff700 1 --2- 172.21.15.82:0/2847783300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5468036770 0x7f546816b640 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.503+0000 7f546ffff700 1 -- 172.21.15.82:0/2847783300 >> 172.21.15.82:0/2847783300 conn(0x7f5468051770 msgr2=0x7f5468036b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.503+0000 7f546ffff700 1 -- 172.21.15.82:0/2847783300 shutdown_connections 2023-11-28T13:01:02.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.503+0000 7f546ffff700 1 -- 172.21.15.82:0/2847783300 wait complete. 2023-11-28T13:01:02.521 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T13:01:02.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.635+0000 7f307141a700 1 Processor -- start 2023-11-28T13:01:02.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.635+0000 7f307141a700 1 -- start start 2023-11-28T13:01:02.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f307141a700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f306c06c140 0x7f306c0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f307141a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f306c0d25b0 0x7f306c06a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f307141a700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306c069bc0 con 0x7f306c0b1d10 2023-11-28T13:01:02.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f307141a700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306c0d1480 con 0x7f306c06c140 2023-11-28T13:01:02.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f307141a700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c0cd280 con 0x7f306c0d25b0 2023-11-28T13:01:02.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f306b7fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f306c06c140 0x7f306c0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f3070c19700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f306c0d25b0 0x7f306c06a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f306b7fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f306c06c140 0x7f306c0cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:53822/0 (socket says 172.21.15.82:53822) 2023-11-28T13:01:02.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f306bfff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f306c0b1d10 0x7f306c06ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:35942/0 (socket says 172.21.15.82:35942) 2023-11-28T13:01:02.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f306b7fe700 1 -- 172.21.15.82:0/4241390422 learned_addr learned my addr 172.21.15.82:0/4241390422 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:02.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f3070c19700 1 -- 172.21.15.82:0/4241390422 >> v2:172.21.15.114:3300/0 conn(0x7f306c06c140 msgr2=0x7f306c0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:02.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f3070c19700 1 --2- 172.21.15.82:0/4241390422 >> v2:172.21.15.114:3300/0 conn(0x7f306c06c140 0x7f306c0cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f3070c19700 1 -- 172.21.15.82:0/4241390422 >> v1:172.21.15.114:6789/0 conn(0x7f306c0b1d10 legacy=0x7f306c06ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f3070c19700 1 -- 172.21.15.82:0/4241390422 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c0cd560 con 0x7f306c0d25b0 2023-11-28T13:01:02.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f306b7fe700 1 --2- 172.21.15.82:0/4241390422 >> v2:172.21.15.114:3300/0 conn(0x7f306c06c140 0x7f306c0cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:02.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f3070c19700 1 --2- 172.21.15.82:0/4241390422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f306c0d25b0 0x7f306c06a050 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3064009d90 tx=0x7f306400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd60f137597a3ee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:02.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f306affd700 1 -- 172.21.15.82:0/4241390422 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306400e070 con 0x7f306c0d25b0 2023-11-28T13:01:02.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f306affd700 1 -- 172.21.15.82:0/4241390422 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306400bb20 con 0x7f306c0d25b0 2023-11-28T13:01:02.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f306affd700 1 -- 172.21.15.82:0/4241390422 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3064012430 con 0x7f306c0d25b0 2023-11-28T13:01:02.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f307141a700 1 -- 172.21.15.82:0/4241390422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f306c0d25b0 msgr2=0x7f306c06a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f307141a700 1 --2- 172.21.15.82:0/4241390422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f306c0d25b0 0x7f306c06a050 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3064009d90 tx=0x7f306400b330 comp rx=0 tx=0).stop 2023-11-28T13:01:02.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f307141a700 1 -- 172.21.15.82:0/4241390422 shutdown_connections 2023-11-28T13:01:02.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f307141a700 1 --2- 172.21.15.82:0/4241390422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f306c0d25b0 0x7f306c06a050 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f307141a700 1 --2- 172.21.15.82:0/4241390422 >> v2:172.21.15.114:3300/0 conn(0x7f306c06c140 0x7f306c0cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f307141a700 1 -- 172.21.15.82:0/4241390422 >> 172.21.15.82:0/4241390422 conn(0x7f306c0b52a0 msgr2=0x7f306c0d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:02.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f307141a700 1 -- 172.21.15.82:0/4241390422 shutdown_connections 2023-11-28T13:01:02.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.639+0000 7f307141a700 1 -- 172.21.15.82:0/4241390422 wait complete. 2023-11-28T13:01:02.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.643+0000 7f307141a700 1 Processor -- start 2023-11-28T13:01:02.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.643+0000 7f307141a700 1 -- start start 2023-11-28T13:01:02.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.643+0000 7f307141a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306c06c140 0x7f306c1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.643+0000 7f307141a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306c0b1d10 0x7f306c150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.643+0000 7f307141a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f306c0d25b0 0x7f306c15a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.643+0000 7f307141a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c15cc70 con 0x7f306c0b1d10 2023-11-28T13:01:02.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.643+0000 7f307141a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c0cb200 con 0x7f306c06c140 2023-11-28T13:01:02.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.643+0000 7f307141a700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c151300 con 0x7f306c0d25b0 2023-11-28T13:01:02.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.643+0000 7f306b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306c0b1d10 0x7f306c150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.643+0000 7f306b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306c0b1d10 0x7f306c150dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42406/0 (socket says 172.21.15.82:42406) 2023-11-28T13:01:02.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.643+0000 7f306b7fe700 1 -- 172.21.15.82:0/602482535 learned_addr learned my addr 172.21.15.82:0/602482535 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:02.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.643+0000 7f3070c19700 1 --2- 172.21.15.82:0/602482535 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f306c0d25b0 0x7f306c15a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.643+0000 7f306bfff700 1 --2- 172.21.15.82:0/602482535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306c06c140 0x7f306c1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.647+0000 7f306b7fe700 1 -- 172.21.15.82:0/602482535 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f306c0d25b0 msgr2=0x7f306c15a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.647+0000 7f306b7fe700 1 --2- 172.21.15.82:0/602482535 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f306c0d25b0 0x7f306c15a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.647+0000 7f306b7fe700 1 -- 172.21.15.82:0/602482535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306c06c140 msgr2=0x7f306c1543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.647+0000 7f306b7fe700 1 --2- 172.21.15.82:0/602482535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306c06c140 0x7f306c1543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.647+0000 7f306b7fe700 1 -- 172.21.15.82:0/602482535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c009570 con 0x7f306c0b1d10 2023-11-28T13:01:02.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.647+0000 7f306bfff700 1 --2- 172.21.15.82:0/602482535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306c06c140 0x7f306c1543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:02.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.647+0000 7f306b7fe700 1 --2- 172.21.15.82:0/602482535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306c0b1d10 0x7f306c150dc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f305c00ebe0 tx=0x7f305c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:02.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.647+0000 7f3068ff9700 1 -- 172.21.15.82:0/602482535 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c00c850 con 0x7f306c0b1d10 2023-11-28T13:01:02.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.647+0000 7f3068ff9700 1 -- 172.21.15.82:0/602482535 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c00c9b0 con 0x7f306c0b1d10 2023-11-28T13:01:02.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.647+0000 7f307141a700 1 -- 172.21.15.82:0/602482535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3064009a70 con 0x7f306c0b1d10 2023-11-28T13:01:02.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.647+0000 7f3068ff9700 1 -- 172.21.15.82:0/602482535 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c00cd20 con 0x7f306c0b1d10 2023-11-28T13:01:02.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.647+0000 7f307141a700 1 -- 172.21.15.82:0/602482535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306c0d1050 con 0x7f306c0b1d10 2023-11-28T13:01:02.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.647+0000 7f3068ff9700 1 -- 172.21.15.82:0/602482535 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f305c019030 con 0x7f306c0b1d10 2023-11-28T13:01:02.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.647+0000 7f307141a700 1 -- 172.21.15.82:0/602482535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306c0d11e0 con 0x7f306c0b1d10 2023-11-28T13:01:02.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.647+0000 7f3068ff9700 1 --2- 172.21.15.82:0/602482535 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f304c064ee0 0x7f304c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.647+0000 7f306bfff700 1 --2- 172.21.15.82:0/602482535 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f304c064ee0 0x7f304c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.647+0000 7f3068ff9700 1 -- 172.21.15.82:0/602482535 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f305c081b90 con 0x7f306c0b1d10 2023-11-28T13:01:02.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.651+0000 7f306bfff700 1 --2- 172.21.15.82:0/602482535 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f304c064ee0 0x7f304c067390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3054000f60 tx=0x7f3054007df0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:02.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.655+0000 7f3068ff9700 1 -- 172.21.15.82:0/602482535 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f305c04fc40 con 0x7f306c0b1d10 2023-11-28T13:01:02.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.815+0000 7f307141a700 1 -- 172.21.15.82:0/602482535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f306c0b28b0 con 0x7f306c0b1d10 2023-11-28T13:01:02.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.815+0000 7f3068ff9700 1 -- 172.21.15.82:0/602482535 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f305c053260 con 0x7f306c0b1d10 2023-11-28T13:01:02.821 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-11-28T13:01:02.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.819+0000 7f307141a700 1 -- 172.21.15.82:0/602482535 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f304c064ee0 msgr2=0x7f304c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.819+0000 7f307141a700 1 --2- 172.21.15.82:0/602482535 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f304c064ee0 0x7f304c067390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3054000f60 tx=0x7f3054007df0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.819+0000 7f307141a700 1 -- 172.21.15.82:0/602482535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306c0b1d10 msgr2=0x7f306c150dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.819+0000 7f307141a700 1 --2- 172.21.15.82:0/602482535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306c0b1d10 0x7f306c150dc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f305c00ebe0 tx=0x7f305c00eef0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.819+0000 7f307141a700 1 -- 172.21.15.82:0/602482535 shutdown_connections 2023-11-28T13:01:02.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.819+0000 7f307141a700 1 --2- 172.21.15.82:0/602482535 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f304c064ee0 0x7f304c067390 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.819+0000 7f307141a700 1 --2- 172.21.15.82:0/602482535 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f306c0d25b0 0x7f306c15a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.819+0000 7f307141a700 1 --2- 172.21.15.82:0/602482535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306c0b1d10 0x7f306c150dc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.819+0000 7f307141a700 1 --2- 172.21.15.82:0/602482535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306c06c140 0x7f306c1543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.819+0000 7f307141a700 1 -- 172.21.15.82:0/602482535 >> 172.21.15.82:0/602482535 conn(0x7f306c0b52a0 msgr2=0x7f306c15f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:02.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.819+0000 7f307141a700 1 -- 172.21.15.82:0/602482535 shutdown_connections 2023-11-28T13:01:02.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.819+0000 7f307141a700 1 -- 172.21.15.82:0/602482535 wait complete. 2023-11-28T13:01:02.836 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T13:01:02.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b9e7a5700 1 Processor -- start 2023-11-28T13:01:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b9e7a5700 1 -- start start 2023-11-28T13:01:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b9e7a5700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7b981650f0 0x7f7b981674d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b9e7a5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b980d28e0 con 0x7f7b980ced70 2023-11-28T13:01:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b9e7a5700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b980b2040 con 0x7f7b9806b910 2023-11-28T13:01:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b9e7a5700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b980cdfe0 con 0x7f7b981650f0 2023-11-28T13:01:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b9cfa2700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7b980ced70 0x7f7b9806bce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58404/0 (socket says 172.21.15.82:58404) 2023-11-28T13:01:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b9cfa2700 1 -- 172.21.15.82:0/2469804339 learned_addr learned my addr 172.21.15.82:0/2469804339 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b9dfa4700 1 --2- 172.21.15.82:0/2469804339 >> v2:172.21.15.114:3300/0 conn(0x7f7b981650f0 0x7f7b981674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b8ffff700 1 -- 172.21.15.82:0/2469804339 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268560888 0 0) 0x7f7b88001110 con 0x7f7b980ced70 2023-11-28T13:01:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b8ffff700 1 -- 172.21.15.82:0/2469804339 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b840035d0 con 0x7f7b980ced70 2023-11-28T13:01:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b8ffff700 1 -- 172.21.15.82:0/2469804339 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1970581776 0 0) 0x7f7b840035d0 con 0x7f7b980ced70 2023-11-28T13:01:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b8ffff700 1 -- 172.21.15.82:0/2469804339 >> v2:172.21.15.114:3300/0 conn(0x7f7b981650f0 msgr2=0x7f7b981674d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b8ffff700 1 --2- 172.21.15.82:0/2469804339 >> v2:172.21.15.114:3300/0 conn(0x7f7b981650f0 0x7f7b981674d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b8ffff700 1 -- 172.21.15.82:0/2469804339 >> v1:172.21.15.114:6789/0 conn(0x7f7b9806b910 legacy=0x7f7b98160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b8ffff700 1 -- 172.21.15.82:0/2469804339 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b980d1700 con 0x7f7b980ced70 2023-11-28T13:01:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b8ffff700 1 -- 172.21.15.82:0/2469804339 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f7b88001800 con 0x7f7b980ced70 2023-11-28T13:01:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b8ffff700 1 -- 172.21.15.82:0/2469804339 >> v1:172.21.15.82:6789/0 conn(0x7f7b980ced70 legacy=0x7f7b9806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b8ffff700 1 --2- 172.21.15.82:0/2469804339 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b84003a20 0x7f7b84003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b8ffff700 1 --2- 172.21.15.82:0/2469804339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b84004410 0x7f7b840048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b8ffff700 1 --2- 172.21.15.82:0/2469804339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b840050d0 0x7f7b8400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b8ffff700 1 -- 172.21.15.82:0/2469804339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b980cdfe0 con 0x7f7b840050d0 2023-11-28T13:01:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b8ffff700 1 -- 172.21.15.82:0/2469804339 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8400c020 con 0x7f7b84004410 2023-11-28T13:01:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b8ffff700 1 -- 172.21.15.82:0/2469804339 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8400c1e0 con 0x7f7b84003a20 2023-11-28T13:01:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b9dfa4700 1 --2- 172.21.15.82:0/2469804339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b840050d0 0x7f7b8400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b9d7a3700 1 --2- 172.21.15.82:0/2469804339 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b84003a20 0x7f7b84003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b9cfa2700 1 --2- 172.21.15.82:0/2469804339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b84004410 0x7f7b840048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b9dfa4700 1 -- 172.21.15.82:0/2469804339 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b84003a20 msgr2=0x7f7b84003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b9dfa4700 1 --2- 172.21.15.82:0/2469804339 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b84003a20 0x7f7b84003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b9dfa4700 1 -- 172.21.15.82:0/2469804339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b84004410 msgr2=0x7f7b840048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b9dfa4700 1 --2- 172.21.15.82:0/2469804339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b84004410 0x7f7b840048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b9dfa4700 1 -- 172.21.15.82:0/2469804339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b840035d0 con 0x7f7b840050d0 2023-11-28T13:01:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b9dfa4700 1 -- 172.21.15.82:0/2469804339 reap_dead start 2023-11-28T13:01:02.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b9dfa4700 1 --2- 172.21.15.82:0/2469804339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b840050d0 0x7f7b8400ba30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7b90009b70 tx=0x7f7b840058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7904ce4874923e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:02.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b8ffff700 1 -- 172.21.15.82:0/2469804339 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b90004020 con 0x7f7b840050d0 2023-11-28T13:01:02.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b8ffff700 1 -- 172.21.15.82:0/2469804339 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b90004180 con 0x7f7b840050d0 2023-11-28T13:01:02.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.951+0000 7f7b8ffff700 1 -- 172.21.15.82:0/2469804339 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b900044f0 con 0x7f7b840050d0 2023-11-28T13:01:02.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.955+0000 7f7b9e7a5700 1 -- 172.21.15.82:0/2469804339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b840050d0 msgr2=0x7f7b8400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.955+0000 7f7b9e7a5700 1 --2- 172.21.15.82:0/2469804339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b840050d0 0x7f7b8400ba30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7b90009b70 tx=0x7f7b840058a0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.955+0000 7f7b9e7a5700 1 -- 172.21.15.82:0/2469804339 shutdown_connections 2023-11-28T13:01:02.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.955+0000 7f7b9e7a5700 1 --2- 172.21.15.82:0/2469804339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b840050d0 0x7f7b8400ba30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.955+0000 7f7b9e7a5700 1 -- 172.21.15.82:0/2469804339 >> 172.21.15.82:0/2469804339 conn(0x7f7b980d2b20 msgr2=0x7f7b980d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:02.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.955+0000 7f7b9e7a5700 1 -- 172.21.15.82:0/2469804339 shutdown_connections 2023-11-28T13:01:02.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.955+0000 7f7b9e7a5700 1 -- 172.21.15.82:0/2469804339 wait complete. 2023-11-28T13:01:02.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.955+0000 7f7b9e7a5700 1 Processor -- start 2023-11-28T13:01:02.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.955+0000 7f7b9e7a5700 1 -- start start 2023-11-28T13:01:02.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b9e7a5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b840050d0 0x7f7b980cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b9e7a5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9814d060 0x7f7b98161190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b9e7a5700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b980caf40 0x7f7b98069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b9e7a5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b981616d0 con 0x7f7b9814d060 2023-11-28T13:01:02.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b9e7a5700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b980c7ae0 con 0x7f7b840050d0 2023-11-28T13:01:02.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b9e7a5700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9814d4b0 con 0x7f7b980caf40 2023-11-28T13:01:02.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b9cfa2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9814d060 0x7f7b98161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b9cfa2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9814d060 0x7f7b98161190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42428/0 (socket says 172.21.15.82:42428) 2023-11-28T13:01:02.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b9cfa2700 1 -- 172.21.15.82:0/4283599030 learned_addr learned my addr 172.21.15.82:0/4283599030 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:02.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b9dfa4700 1 --2- 172.21.15.82:0/4283599030 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b980caf40 0x7f7b98069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b9d7a3700 1 --2- 172.21.15.82:0/4283599030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b840050d0 0x7f7b980cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b9cfa2700 1 -- 172.21.15.82:0/4283599030 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b980caf40 msgr2=0x7f7b98069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b9cfa2700 1 --2- 172.21.15.82:0/4283599030 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b980caf40 0x7f7b98069bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b9cfa2700 1 -- 172.21.15.82:0/4283599030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b840050d0 msgr2=0x7f7b980cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:02.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b9cfa2700 1 --2- 172.21.15.82:0/4283599030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b840050d0 0x7f7b980cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:02.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b9cfa2700 1 -- 172.21.15.82:0/4283599030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b980d2320 con 0x7f7b9814d060 2023-11-28T13:01:02.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b9dfa4700 1 --2- 172.21.15.82:0/4283599030 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b980caf40 0x7f7b98069bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:02.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b9cfa2700 1 --2- 172.21.15.82:0/4283599030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9814d060 0x7f7b98161190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7b8800e7b0 tx=0x7f7b8800eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:02.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b8dffb700 1 -- 172.21.15.82:0/4283599030 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88012590 con 0x7f7b9814d060 2023-11-28T13:01:02.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b8dffb700 1 -- 172.21.15.82:0/4283599030 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b88012710 con 0x7f7b9814d060 2023-11-28T13:01:02.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b9e7a5700 1 -- 172.21.15.82:0/4283599030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b980cf2c0 con 0x7f7b9814d060 2023-11-28T13:01:02.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b8dffb700 1 -- 172.21.15.82:0/4283599030 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88012ac0 con 0x7f7b9814d060 2023-11-28T13:01:02.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b9e7a5700 1 -- 172.21.15.82:0/4283599030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b980d2600 con 0x7f7b9814d060 2023-11-28T13:01:02.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.959+0000 7f7b9e7a5700 1 -- 172.21.15.82:0/4283599030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b98065fc0 con 0x7f7b9814d060 2023-11-28T13:01:02.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.963+0000 7f7b8dffb700 1 -- 172.21.15.82:0/4283599030 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7b88012c20 con 0x7f7b9814d060 2023-11-28T13:01:02.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.963+0000 7f7b8dffb700 1 --2- 172.21.15.82:0/4283599030 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b7c064ee0 0x7f7b7c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:02.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.963+0000 7f7b8dffb700 1 -- 172.21.15.82:0/4283599030 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b88081bb0 con 0x7f7b9814d060 2023-11-28T13:01:02.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.963+0000 7f7b9d7a3700 1 --2- 172.21.15.82:0/4283599030 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b7c064ee0 0x7f7b7c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:02.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.963+0000 7f7b9d7a3700 1 --2- 172.21.15.82:0/4283599030 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b7c064ee0 0x7f7b7c067390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7b94003c70 tx=0x7f7b94009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:02.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:02.967+0000 7f7b8dffb700 1 -- 172.21.15.82:0/4283599030 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7b88088080 con 0x7f7b9814d060 2023-11-28T13:01:03.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.147+0000 7f7b9e7a5700 1 -- 172.21.15.82:0/4283599030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7b980d28e0 con 0x7f7b9814d060 2023-11-28T13:01:03.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.147+0000 7f7b8dffb700 1 -- 172.21.15.82:0/4283599030 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7b980d28e0 con 0x7f7b9814d060 2023-11-28T13:01:03.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.147+0000 7f7b9e7a5700 1 -- 172.21.15.82:0/4283599030 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b7c064ee0 msgr2=0x7f7b7c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:03.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.147+0000 7f7b9e7a5700 1 --2- 172.21.15.82:0/4283599030 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b7c064ee0 0x7f7b7c067390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7b94003c70 tx=0x7f7b94009040 comp rx=0 tx=0).stop 2023-11-28T13:01:03.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.147+0000 7f7b9e7a5700 1 -- 172.21.15.82:0/4283599030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9814d060 msgr2=0x7f7b98161190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:03.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.147+0000 7f7b9e7a5700 1 --2- 172.21.15.82:0/4283599030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9814d060 0x7f7b98161190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7b8800e7b0 tx=0x7f7b8800eb70 comp rx=0 tx=0).stop 2023-11-28T13:01:03.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.147+0000 7f7b9e7a5700 1 -- 172.21.15.82:0/4283599030 shutdown_connections 2023-11-28T13:01:03.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.147+0000 7f7b9e7a5700 1 --2- 172.21.15.82:0/4283599030 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b7c064ee0 0x7f7b7c067390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:03.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.147+0000 7f7b9e7a5700 1 --2- 172.21.15.82:0/4283599030 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b980caf40 0x7f7b98069bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:03.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.147+0000 7f7b9e7a5700 1 --2- 172.21.15.82:0/4283599030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9814d060 0x7f7b98161190 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:03.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.147+0000 7f7b9e7a5700 1 --2- 172.21.15.82:0/4283599030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b840050d0 0x7f7b980cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:03.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.147+0000 7f7b9e7a5700 1 -- 172.21.15.82:0/4283599030 >> 172.21.15.82:0/4283599030 conn(0x7f7b980d2b20 msgr2=0x7f7b980b7040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:03.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.147+0000 7f7b9e7a5700 1 -- 172.21.15.82:0/4283599030 shutdown_connections 2023-11-28T13:01:03.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.147+0000 7f7b9e7a5700 1 -- 172.21.15.82:0/4283599030 wait complete. 2023-11-28T13:01:03.155 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2023-11-28T13:01:03.166 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2023-11-28T13:01:03.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:03.166 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T13:01:03.193 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:01:03.193 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-11-28T13:01:03.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:03.193 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T13:01:03.236 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:01:03.236 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:01:03.244 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:01:03.244 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:01:03.252 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:01:03.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.359+0000 7f351bfff700 1 Processor -- start 2023-11-28T13:01:03.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.359+0000 7f351bfff700 1 -- start start 2023-11-28T13:01:03.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f351bfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f351c06b0a0 0x7f351c06d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:03.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f351bfff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351c06c480 con 0x7f351c0b3910 2023-11-28T13:01:03.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f351bfff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351c06dbe0 con 0x7f351c070070 2023-11-28T13:01:03.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f351bfff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351c06dec0 con 0x7f351c06b0a0 2023-11-28T13:01:03.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f351affd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f351c0b3910 0x7f351c06c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58410/0 (socket says 172.21.15.82:58410) 2023-11-28T13:01:03.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f351affd700 1 -- 172.21.15.82:0/2119634840 learned_addr learned my addr 172.21.15.82:0/2119634840 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:03.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f351a7fc700 1 --2- 172.21.15.82:0/2119634840 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f351c06b0a0 0x7f351c06d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:03.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f3519ffb700 1 -- 172.21.15.82:0/2119634840 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27625975 0 0) 0x7f351c06c480 con 0x7f351c0b3910 2023-11-28T13:01:03.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f3519ffb700 1 -- 172.21.15.82:0/2119634840 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35040035d0 con 0x7f351c0b3910 2023-11-28T13:01:03.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f3519ffb700 1 -- 172.21.15.82:0/2119634840 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3044874004 0 0) 0x7f351c06dbe0 con 0x7f351c070070 2023-11-28T13:01:03.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f3519ffb700 1 -- 172.21.15.82:0/2119634840 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f351c06c480 con 0x7f351c070070 2023-11-28T13:01:03.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f351a7fc700 1 -- 172.21.15.82:0/2119634840 >> v1:172.21.15.114:6789/0 conn(0x7f351c070070 legacy=0x7f351c15db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:03.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f351a7fc700 1 -- 172.21.15.82:0/2119634840 >> v1:172.21.15.82:6789/0 conn(0x7f351c0b3910 legacy=0x7f351c06c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:03.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f3519ffb700 1 -- 172.21.15.82:0/2119634840 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4090288519 0 0) 0x7f35040035d0 con 0x7f351c0b3910 2023-11-28T13:01:03.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f351a7fc700 1 -- 172.21.15.82:0/2119634840 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351c06c110 con 0x7f351c06b0a0 2023-11-28T13:01:03.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f351a7fc700 1 --2- 172.21.15.82:0/2119634840 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f351c06b0a0 0x7f351c06d320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f350c009880 tx=0x7f350c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e72d98b3285b61f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:03.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f3519ffb700 1 -- 172.21.15.82:0/2119634840 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3510001670 con 0x7f351c06b0a0 2023-11-28T13:01:03.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f3519ffb700 1 -- 172.21.15.82:0/2119634840 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c004030 con 0x7f351c06b0a0 2023-11-28T13:01:03.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f3519ffb700 1 -- 172.21.15.82:0/2119634840 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c0043c0 con 0x7f351c06b0a0 2023-11-28T13:01:03.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f351bfff700 1 -- 172.21.15.82:0/2119634840 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f351c06b0a0 msgr2=0x7f351c06d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:03.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f351bfff700 1 --2- 172.21.15.82:0/2119634840 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f351c06b0a0 0x7f351c06d320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f350c009880 tx=0x7f350c009b90 comp rx=0 tx=0).stop 2023-11-28T13:01:03.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f351bfff700 1 -- 172.21.15.82:0/2119634840 shutdown_connections 2023-11-28T13:01:03.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.363+0000 7f351bfff700 1 --2- 172.21.15.82:0/2119634840 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f351c06b0a0 0x7f351c06d320 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:03.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.367+0000 7f351bfff700 1 -- 172.21.15.82:0/2119634840 >> 172.21.15.82:0/2119634840 conn(0x7f351c0ce600 msgr2=0x7f351c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:03.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.367+0000 7f351bfff700 1 -- 172.21.15.82:0/2119634840 shutdown_connections 2023-11-28T13:01:03.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.367+0000 7f351bfff700 1 -- 172.21.15.82:0/2119634840 wait complete. 2023-11-28T13:01:03.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.367+0000 7f351bfff700 1 Processor -- start 2023-11-28T13:01:03.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.367+0000 7f351bfff700 1 -- start start 2023-11-28T13:01:03.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f351bfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f351c06b0a0 0x7f351c154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:03.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f351bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f351c070070 0x7f351c0c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:03.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f351bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f351c0b3910 0x7f351c15ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:03.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f351bfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c1f1290 con 0x7f351c0b3910 2023-11-28T13:01:03.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f351bfff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c1f1570 con 0x7f351c070070 2023-11-28T13:01:03.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f351bfff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351c1f1850 con 0x7f351c06b0a0 2023-11-28T13:01:03.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f351b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f351c0b3910 0x7f351c15ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:03.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f351a7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f351c070070 0x7f351c0c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:03.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f351b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f351c0b3910 0x7f351c15ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42436/0 (socket says 172.21.15.82:42436) 2023-11-28T13:01:03.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f351affd700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f351c06b0a0 0x7f351c154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:03.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f351b7fe700 1 -- 172.21.15.82:0/3512302264 learned_addr learned my addr 172.21.15.82:0/3512302264 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f351b7fe700 1 -- 172.21.15.82:0/3512302264 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f351c06b0a0 msgr2=0x7f351c154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f351b7fe700 1 --2- 172.21.15.82:0/3512302264 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f351c06b0a0 0x7f351c154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f351b7fe700 1 -- 172.21.15.82:0/3512302264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f351c070070 msgr2=0x7f351c0c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f351b7fe700 1 --2- 172.21.15.82:0/3512302264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f351c070070 0x7f351c0c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f351b7fe700 1 -- 172.21.15.82:0/3512302264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c0094b0 con 0x7f351c0b3910 2023-11-28T13:01:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f351b7fe700 1 --2- 172.21.15.82:0/3512302264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f351c0b3910 0x7f351c15ce80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f351400cc20 tx=0x7f351400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f35037fe700 1 -- 172.21.15.82:0/3512302264 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514003c20 con 0x7f351c0b3910 2023-11-28T13:01:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f35037fe700 1 -- 172.21.15.82:0/3512302264 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3514003d80 con 0x7f351c0b3910 2023-11-28T13:01:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f351bfff700 1 -- 172.21.15.82:0/3512302264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351c06d860 con 0x7f351c0b3910 2023-11-28T13:01:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f35037fe700 1 -- 172.21.15.82:0/3512302264 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351400aae0 con 0x7f351c0b3910 2023-11-28T13:01:03.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.371+0000 7f351bfff700 1 -- 172.21.15.82:0/3512302264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351c0c8f80 con 0x7f351c0b3910 2023-11-28T13:01:03.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.375+0000 7f351bfff700 1 -- 172.21.15.82:0/3512302264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351c0b3ce0 con 0x7f351c0b3910 2023-11-28T13:01:03.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.375+0000 7f35037fe700 1 -- 172.21.15.82:0/3512302264 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3514010050 con 0x7f351c0b3910 2023-11-28T13:01:03.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.375+0000 7f35037fe700 1 --2- 172.21.15.82:0/3512302264 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3508064ee0 0x7f3508067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:03.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.375+0000 7f35037fe700 1 -- 172.21.15.82:0/3512302264 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3514081e70 con 0x7f351c0b3910 2023-11-28T13:01:03.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.375+0000 7f351affd700 1 --2- 172.21.15.82:0/3512302264 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3508064ee0 0x7f3508067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:03.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.379+0000 7f351affd700 1 --2- 172.21.15.82:0/3512302264 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3508064ee0 0x7f3508067390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3510007fd0 tx=0x7f3510007df0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:03.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.383+0000 7f35037fe700 1 -- 172.21.15.82:0/3512302264 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f351404ff20 con 0x7f351c0b3910 2023-11-28T13:01:03.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.543+0000 7f351bfff700 1 -- 172.21.15.82:0/3512302264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f351c065fc0 con 0x7f351c0b3910 2023-11-28T13:01:03.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.547+0000 7f35037fe700 1 -- 172.21.15.82:0/3512302264 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17811 (secure 0 0 0) 0x7f3514053540 con 0x7f351c0b3910 2023-11-28T13:01:03.552 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:03.552 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:00:26.981345+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:00:24.360641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T13:00:24.960863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:01:03.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.547+0000 7f351bfff700 1 -- 172.21.15.82:0/3512302264 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3508064ee0 msgr2=0x7f3508067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:03.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.547+0000 7f351bfff700 1 --2- 172.21.15.82:0/3512302264 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3508064ee0 0x7f3508067390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3510007fd0 tx=0x7f3510007df0 comp rx=0 tx=0).stop 2023-11-28T13:01:03.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.547+0000 7f351bfff700 1 -- 172.21.15.82:0/3512302264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f351c0b3910 msgr2=0x7f351c15ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:03.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.547+0000 7f351bfff700 1 --2- 172.21.15.82:0/3512302264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f351c0b3910 0x7f351c15ce80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f351400cc20 tx=0x7f351400cf30 comp rx=0 tx=0).stop 2023-11-28T13:01:03.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.547+0000 7f351bfff700 1 -- 172.21.15.82:0/3512302264 shutdown_connections 2023-11-28T13:01:03.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.547+0000 7f351bfff700 1 --2- 172.21.15.82:0/3512302264 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3508064ee0 0x7f3508067390 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:03.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.547+0000 7f351bfff700 1 --2- 172.21.15.82:0/3512302264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f351c0b3910 0x7f351c15ce80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:03.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.547+0000 7f351bfff700 1 --2- 172.21.15.82:0/3512302264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f351c070070 0x7f351c0c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:03.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.547+0000 7f351bfff700 1 --2- 172.21.15.82:0/3512302264 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f351c06b0a0 0x7f351c154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:03.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.547+0000 7f351bfff700 1 -- 172.21.15.82:0/3512302264 >> 172.21.15.82:0/3512302264 conn(0x7f351c0ce600 msgr2=0x7f351c0b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:03.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.547+0000 7f351bfff700 1 -- 172.21.15.82:0/3512302264 shutdown_connections 2023-11-28T13:01:03.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.547+0000 7f351bfff700 1 -- 172.21.15.82:0/3512302264 wait complete. 2023-11-28T13:01:03.566 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T13:00:24.360641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T13:00:24.960863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:01:03.567 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:01:03.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.683+0000 7f283759e700 1 Processor -- start 2023-11-28T13:01:03.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.683+0000 7f283759e700 1 -- start start 2023-11-28T13:01:03.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.683+0000 7f283759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28380b1d10 0x7f28380cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:03.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.683+0000 7f283759e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f283806c140 0x7f283806a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:03.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.683+0000 7f283759e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2838069bc0 con 0x7f28380d25b0 2023-11-28T13:01:03.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.683+0000 7f283759e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28380d1480 con 0x7f283806c140 2023-11-28T13:01:03.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.683+0000 7f283759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28380cd280 con 0x7f28380b1d10 2023-11-28T13:01:03.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.683+0000 7f2836d9d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f283806c140 0x7f283806a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:03.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.683+0000 7f283659c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28380b1d10 0x7f28380cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:03.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.683+0000 7f283659c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28380b1d10 0x7f28380cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:51590/0 (socket says 172.21.15.82:51590) 2023-11-28T13:01:03.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.683+0000 7f283659c700 1 -- 172.21.15.82:0/123999013 learned_addr learned my addr 172.21.15.82:0/123999013 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:03.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.683+0000 7f283659c700 1 -- 172.21.15.82:0/123999013 >> v2:172.21.15.114:3300/0 conn(0x7f283806c140 msgr2=0x7f283806a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:03.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.683+0000 7f283659c700 1 --2- 172.21.15.82:0/123999013 >> v2:172.21.15.114:3300/0 conn(0x7f283806c140 0x7f283806a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:03.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.683+0000 7f283659c700 1 -- 172.21.15.82:0/123999013 >> v1:172.21.15.114:6789/0 conn(0x7f28380d25b0 legacy=0x7f283806ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:03.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.683+0000 7f283659c700 1 -- 172.21.15.82:0/123999013 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28380cd560 con 0x7f28380b1d10 2023-11-28T13:01:03.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.683+0000 7f283659c700 1 --2- 172.21.15.82:0/123999013 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28380b1d10 0x7f28380cec20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2828009910 tx=0x7f2828009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=973a698b1ae709d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:03.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.683+0000 7f283559a700 1 -- 172.21.15.82:0/123999013 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2828011830 con 0x7f28380b1d10 2023-11-28T13:01:03.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.683+0000 7f283559a700 1 -- 172.21.15.82:0/123999013 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2828011990 con 0x7f28380b1d10 2023-11-28T13:01:03.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.683+0000 7f283559a700 1 -- 172.21.15.82:0/123999013 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2828011d40 con 0x7f28380b1d10 2023-11-28T13:01:03.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.687+0000 7f283759e700 1 -- 172.21.15.82:0/123999013 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28380b1d10 msgr2=0x7f28380cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:03.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.687+0000 7f283759e700 1 --2- 172.21.15.82:0/123999013 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28380b1d10 0x7f28380cec20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2828009910 tx=0x7f2828009c20 comp rx=0 tx=0).stop 2023-11-28T13:01:03.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.687+0000 7f283759e700 1 -- 172.21.15.82:0/123999013 shutdown_connections 2023-11-28T13:01:03.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.687+0000 7f283759e700 1 --2- 172.21.15.82:0/123999013 >> v2:172.21.15.114:3300/0 conn(0x7f283806c140 0x7f283806a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:03.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.687+0000 7f283759e700 1 --2- 172.21.15.82:0/123999013 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28380b1d10 0x7f28380cec20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:03.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.687+0000 7f283759e700 1 -- 172.21.15.82:0/123999013 >> 172.21.15.82:0/123999013 conn(0x7f28380b52a0 msgr2=0x7f28380d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:03.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.687+0000 7f283759e700 1 -- 172.21.15.82:0/123999013 shutdown_connections 2023-11-28T13:01:03.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.687+0000 7f283759e700 1 -- 172.21.15.82:0/123999013 wait complete. 2023-11-28T13:01:03.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.687+0000 7f283759e700 1 Processor -- start 2023-11-28T13:01:03.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.687+0000 7f283759e700 1 -- start start 2023-11-28T13:01:03.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f283759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f283806c140 0x7f283815e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:03.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f283759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28380b1d10 0x7f283815bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:03.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f283759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28380d25b0 0x7f28381f1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:03.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f283759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283815c240 con 0x7f283806c140 2023-11-28T13:01:03.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f283759e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28380c65a0 con 0x7f28380b1d10 2023-11-28T13:01:03.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f283759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28380c6880 con 0x7f28380d25b0 2023-11-28T13:01:03.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f283659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f283806c140 0x7f283815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:03.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f283659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f283806c140 0x7f283815e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42440/0 (socket says 172.21.15.82:42440) 2023-11-28T13:01:03.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f283659c700 1 -- 172.21.15.82:0/2940513314 learned_addr learned my addr 172.21.15.82:0/2940513314 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:03.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f2836d9d700 1 --2- 172.21.15.82:0/2940513314 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28380d25b0 0x7f28381f1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:03.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f2835d9b700 1 --2- 172.21.15.82:0/2940513314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28380b1d10 0x7f283815bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f283659c700 1 -- 172.21.15.82:0/2940513314 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28380d25b0 msgr2=0x7f28381f1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f283659c700 1 --2- 172.21.15.82:0/2940513314 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28380d25b0 0x7f28381f1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f283659c700 1 -- 172.21.15.82:0/2940513314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28380b1d10 msgr2=0x7f283815bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f283659c700 1 --2- 172.21.15.82:0/2940513314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28380b1d10 0x7f283815bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f283659c700 1 -- 172.21.15.82:0/2940513314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2828009570 con 0x7f283806c140 2023-11-28T13:01:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f283659c700 1 --2- 172.21.15.82:0/2940513314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f283806c140 0x7f283815e750 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2828000c00 tx=0x7f2828004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:03.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f2826ffd700 1 -- 172.21.15.82:0/2940513314 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2828004510 con 0x7f283806c140 2023-11-28T13:01:03.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f2826ffd700 1 -- 172.21.15.82:0/2940513314 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28280036c0 con 0x7f283806c140 2023-11-28T13:01:03.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f2826ffd700 1 -- 172.21.15.82:0/2940513314 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2828003a70 con 0x7f283806c140 2023-11-28T13:01:03.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f283759e700 1 -- 172.21.15.82:0/2940513314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28380d1050 con 0x7f283806c140 2023-11-28T13:01:03.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.691+0000 7f283759e700 1 -- 172.21.15.82:0/2940513314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28380b20e0 con 0x7f283806c140 2023-11-28T13:01:03.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.695+0000 7f283759e700 1 -- 172.21.15.82:0/2940513314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28380d11e0 con 0x7f283806c140 2023-11-28T13:01:03.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.695+0000 7f2826ffd700 1 -- 172.21.15.82:0/2940513314 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f282802d070 con 0x7f283806c140 2023-11-28T13:01:03.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.695+0000 7f2826ffd700 1 --2- 172.21.15.82:0/2940513314 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2818064ee0 0x7f2818067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:03.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.695+0000 7f2835d9b700 1 --2- 172.21.15.82:0/2940513314 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2818064ee0 0x7f2818067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:03.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.695+0000 7f2826ffd700 1 -- 172.21.15.82:0/2940513314 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2828021030 con 0x7f283806c140 2023-11-28T13:01:03.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.695+0000 7f2835d9b700 1 --2- 172.21.15.82:0/2940513314 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2818064ee0 0x7f2818067390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f28380d21c0 tx=0x7f282c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:03.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.703+0000 7f2826ffd700 1 -- 172.21.15.82:0/2940513314 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f28280515e0 con 0x7f283806c140 2023-11-28T13:01:03.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.863+0000 7f283759e700 1 -- 172.21.15.82:0/2940513314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2838065fc0 con 0x7f283806c140 2023-11-28T13:01:03.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.867+0000 7f2826ffd700 1 -- 172.21.15.82:0/2940513314 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f282802b0a0 con 0x7f283806c140 2023-11-28T13:01:03.871 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:01:03.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.871+0000 7f283759e700 1 -- 172.21.15.82:0/2940513314 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2818064ee0 msgr2=0x7f2818067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:03.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.871+0000 7f283759e700 1 --2- 172.21.15.82:0/2940513314 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2818064ee0 0x7f2818067390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f28380d21c0 tx=0x7f282c009040 comp rx=0 tx=0).stop 2023-11-28T13:01:03.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.871+0000 7f283759e700 1 -- 172.21.15.82:0/2940513314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f283806c140 msgr2=0x7f283815e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:03.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.871+0000 7f283759e700 1 --2- 172.21.15.82:0/2940513314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f283806c140 0x7f283815e750 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2828000c00 tx=0x7f2828004770 comp rx=0 tx=0).stop 2023-11-28T13:01:03.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.871+0000 7f283759e700 1 -- 172.21.15.82:0/2940513314 shutdown_connections 2023-11-28T13:01:03.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.871+0000 7f283759e700 1 --2- 172.21.15.82:0/2940513314 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2818064ee0 0x7f2818067390 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:03.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.871+0000 7f283759e700 1 --2- 172.21.15.82:0/2940513314 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28380d25b0 0x7f28381f1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:03.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.871+0000 7f283759e700 1 --2- 172.21.15.82:0/2940513314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28380b1d10 0x7f283815bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:03.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.871+0000 7f283759e700 1 --2- 172.21.15.82:0/2940513314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f283806c140 0x7f283815e750 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:03.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.871+0000 7f283759e700 1 -- 172.21.15.82:0/2940513314 >> 172.21.15.82:0/2940513314 conn(0x7f28380b52a0 msgr2=0x7f28380b8400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:03.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.871+0000 7f283759e700 1 -- 172.21.15.82:0/2940513314 shutdown_connections 2023-11-28T13:01:03.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:03.871+0000 7f283759e700 1 -- 172.21.15.82:0/2940513314 wait complete. 2023-11-28T13:01:03.890 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:01:04.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f01556d8700 1 Processor -- start 2023-11-28T13:01:04.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f01556d8700 1 -- start start 2023-11-28T13:01:04.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f01556d8700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f015015a400 0x7f015006a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f01556d8700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01500cc5a0 con 0x7f01500ce000 2023-11-28T13:01:04.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f01556d8700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015015ec00 con 0x7f0150070400 2023-11-28T13:01:04.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f01556d8700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01500c9370 con 0x7f015015a400 2023-11-28T13:01:04.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f014effd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f015015a400 0x7f015006a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f014f7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f01500ce000 0x7f015015e4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58418/0 (socket says 172.21.15.82:58418) 2023-11-28T13:01:04.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f014f7fe700 1 -- 172.21.15.82:0/2238556336 learned_addr learned my addr 172.21.15.82:0/2238556336 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:04.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f014effd700 1 -- 172.21.15.82:0/2238556336 >> v1:172.21.15.114:6789/0 conn(0x7f0150070400 legacy=0x7f015015dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:04.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f014dffb700 1 -- 172.21.15.82:0/2238556336 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1787752218 0 0) 0x7f01500cc5a0 con 0x7f01500ce000 2023-11-28T13:01:04.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f014effd700 1 -- 172.21.15.82:0/2238556336 >> v1:172.21.15.82:6789/0 conn(0x7f01500ce000 legacy=0x7f015015e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:04.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f014effd700 1 -- 172.21.15.82:0/2238556336 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01500c9650 con 0x7f015015a400 2023-11-28T13:01:04.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f014effd700 1 --2- 172.21.15.82:0/2238556336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f015015a400 0x7f015006a5a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0144009850 tx=0x7f0144009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e6ffef33be9769 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:04.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f014dffb700 1 -- 172.21.15.82:0/2238556336 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0144011830 con 0x7f015015a400 2023-11-28T13:01:04.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f014dffb700 1 -- 172.21.15.82:0/2238556336 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0144011990 con 0x7f015015a400 2023-11-28T13:01:04.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f014dffb700 1 -- 172.21.15.82:0/2238556336 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0144011d20 con 0x7f015015a400 2023-11-28T13:01:04.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f01556d8700 1 -- 172.21.15.82:0/2238556336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f015015a400 msgr2=0x7f015006a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:04.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f01556d8700 1 --2- 172.21.15.82:0/2238556336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f015015a400 0x7f015006a5a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0144009850 tx=0x7f0144009b60 comp rx=0 tx=0).stop 2023-11-28T13:01:04.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f01556d8700 1 -- 172.21.15.82:0/2238556336 shutdown_connections 2023-11-28T13:01:04.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f01556d8700 1 --2- 172.21.15.82:0/2238556336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f015015a400 0x7f015006a5a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f01556d8700 1 -- 172.21.15.82:0/2238556336 >> 172.21.15.82:0/2238556336 conn(0x7f01500ce9d0 msgr2=0x7f01500ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:04.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f01556d8700 1 -- 172.21.15.82:0/2238556336 shutdown_connections 2023-11-28T13:01:04.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.011+0000 7f01556d8700 1 -- 172.21.15.82:0/2238556336 wait complete. 2023-11-28T13:01:04.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.015+0000 7f01556d8700 1 Processor -- start 2023-11-28T13:01:04.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.015+0000 7f01556d8700 1 -- start start 2023-11-28T13:01:04.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.015+0000 7f01556d8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150070400 0x7f01500c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.015+0000 7f01556d8700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01500ce000 0x7f01500acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.015+0000 7f01556d8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f015015a400 0x7f015014dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.015+0000 7f01556d8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015006c180 con 0x7f0150070400 2023-11-28T13:01:04.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.015+0000 7f01556d8700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015006ca20 con 0x7f015015a400 2023-11-28T13:01:04.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.015+0000 7f01556d8700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01500c63a0 con 0x7f01500ce000 2023-11-28T13:01:04.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.015+0000 7f014effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150070400 0x7f01500c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.015+0000 7f014effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150070400 0x7f01500c5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42452/0 (socket says 172.21.15.82:42452) 2023-11-28T13:01:04.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.015+0000 7f014effd700 1 -- 172.21.15.82:0/2632333499 learned_addr learned my addr 172.21.15.82:0/2632333499 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:04.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.015+0000 7f014e7fc700 1 --2- 172.21.15.82:0/2632333499 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01500ce000 0x7f01500acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.015+0000 7f014f7fe700 1 --2- 172.21.15.82:0/2632333499 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f015015a400 0x7f015014dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.015+0000 7f014effd700 1 -- 172.21.15.82:0/2632333499 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01500ce000 msgr2=0x7f01500acb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:04.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.015+0000 7f014effd700 1 --2- 172.21.15.82:0/2632333499 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01500ce000 0x7f01500acb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.015+0000 7f014effd700 1 -- 172.21.15.82:0/2632333499 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f015015a400 msgr2=0x7f015014dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:04.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.015+0000 7f014effd700 1 --2- 172.21.15.82:0/2632333499 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f015015a400 0x7f015014dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.015+0000 7f014effd700 1 -- 172.21.15.82:0/2632333499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01440094b0 con 0x7f0150070400 2023-11-28T13:01:04.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.019+0000 7f014effd700 1 --2- 172.21.15.82:0/2632333499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150070400 0x7f01500c5aa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f01440090b0 tx=0x7f0144004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:04.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.019+0000 7f01377fe700 1 -- 172.21.15.82:0/2632333499 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014400bb20 con 0x7f0150070400 2023-11-28T13:01:04.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.019+0000 7f01377fe700 1 -- 172.21.15.82:0/2632333499 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014401e070 con 0x7f0150070400 2023-11-28T13:01:04.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.019+0000 7f01556d8700 1 -- 172.21.15.82:0/2632333499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01500ccad0 con 0x7f0150070400 2023-11-28T13:01:04.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.019+0000 7f01377fe700 1 -- 172.21.15.82:0/2632333499 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014400bec0 con 0x7f0150070400 2023-11-28T13:01:04.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.019+0000 7f01556d8700 1 -- 172.21.15.82:0/2632333499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01500cc7f0 con 0x7f0150070400 2023-11-28T13:01:04.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.019+0000 7f01556d8700 1 -- 172.21.15.82:0/2632333499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015006aae0 con 0x7f0150070400 2023-11-28T13:01:04.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.019+0000 7f01377fe700 1 -- 172.21.15.82:0/2632333499 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f014402a020 con 0x7f0150070400 2023-11-28T13:01:04.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.019+0000 7f01377fe700 1 --2- 172.21.15.82:0/2632333499 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f013c064ee0 0x7f013c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.019+0000 7f01377fe700 1 -- 172.21.15.82:0/2632333499 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f01440831f0 con 0x7f0150070400 2023-11-28T13:01:04.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.019+0000 7f014e7fc700 1 --2- 172.21.15.82:0/2632333499 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f013c064ee0 0x7f013c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.019+0000 7f014e7fc700 1 --2- 172.21.15.82:0/2632333499 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f013c064ee0 0x7f013c067390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f015014ea40 tx=0x7f0140009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:04.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.027+0000 7f01377fe700 1 -- 172.21.15.82:0/2632333499 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0144051390 con 0x7f0150070400 2023-11-28T13:01:04.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.183+0000 7f01556d8700 1 -- 172.21.15.82:0/2632333499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0150073e20 con 0x7f0150070400 2023-11-28T13:01:04.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.183+0000 7f01377fe700 1 -- 172.21.15.82:0/2632333499 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f01440549b0 con 0x7f0150070400 2023-11-28T13:01:04.190 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:01:04.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.187+0000 7f01556d8700 1 -- 172.21.15.82:0/2632333499 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f013c064ee0 msgr2=0x7f013c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:04.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.187+0000 7f01556d8700 1 --2- 172.21.15.82:0/2632333499 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f013c064ee0 0x7f013c067390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f015014ea40 tx=0x7f0140009040 comp rx=0 tx=0).stop 2023-11-28T13:01:04.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.187+0000 7f01556d8700 1 -- 172.21.15.82:0/2632333499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150070400 msgr2=0x7f01500c5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:04.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.187+0000 7f01556d8700 1 --2- 172.21.15.82:0/2632333499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150070400 0x7f01500c5aa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f01440090b0 tx=0x7f0144004770 comp rx=0 tx=0).stop 2023-11-28T13:01:04.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.187+0000 7f01556d8700 1 -- 172.21.15.82:0/2632333499 shutdown_connections 2023-11-28T13:01:04.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.187+0000 7f01556d8700 1 --2- 172.21.15.82:0/2632333499 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f013c064ee0 0x7f013c067390 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.187+0000 7f01556d8700 1 --2- 172.21.15.82:0/2632333499 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f015015a400 0x7f015014dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.187+0000 7f01556d8700 1 --2- 172.21.15.82:0/2632333499 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01500ce000 0x7f01500acb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.187+0000 7f01556d8700 1 --2- 172.21.15.82:0/2632333499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150070400 0x7f01500c5aa0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.187+0000 7f01556d8700 1 -- 172.21.15.82:0/2632333499 >> 172.21.15.82:0/2632333499 conn(0x7f01500ce9d0 msgr2=0x7f01500cb450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:04.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.187+0000 7f01556d8700 1 -- 172.21.15.82:0/2632333499 shutdown_connections 2023-11-28T13:01:04.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.187+0000 7f01556d8700 1 -- 172.21.15.82:0/2632333499 wait complete. 2023-11-28T13:01:04.207 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T13:01:04.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0ad201700 1 Processor -- start 2023-11-28T13:01:04.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0ad201700 1 -- start start 2023-11-28T13:01:04.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0ad201700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe0a80b1d10 0x7fe0a80cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0ad201700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a80d25b0 0x7fe0a806ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0ad201700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0a80b5940 0x7fe0a806bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0ad201700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a8069bc0 con 0x7fe0a80b1d10 2023-11-28T13:01:04.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0ad201700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a80d1480 con 0x7fe0a80b5940 2023-11-28T13:01:04.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0ad201700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a80cd280 con 0x7fe0a80d25b0 2023-11-28T13:01:04.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0a7fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe0a80b1d10 0x7fe0a80cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0a7fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe0a80b1d10 0x7fe0a80cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42454/0 (socket says 172.21.15.82:42454) 2023-11-28T13:01:04.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0a7fff700 1 -- 172.21.15.82:0/3027240959 learned_addr learned my addr 172.21.15.82:0/3027240959 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:04.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0a77fe700 1 --2- 172.21.15.82:0/3027240959 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a80d25b0 0x7fe0a806ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0aca00700 1 --2- 172.21.15.82:0/3027240959 >> v2:172.21.15.114:3300/0 conn(0x7fe0a80b5940 0x7fe0a806bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0a7fff700 1 -- 172.21.15.82:0/3027240959 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a80d25b0 msgr2=0x7fe0a806ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:04.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0a7fff700 1 --2- 172.21.15.82:0/3027240959 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a80d25b0 0x7fe0a806ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0a7fff700 1 -- 172.21.15.82:0/3027240959 >> v2:172.21.15.114:3300/0 conn(0x7fe0a80b5940 msgr2=0x7fe0a806bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:04.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0a7fff700 1 --2- 172.21.15.82:0/3027240959 >> v2:172.21.15.114:3300/0 conn(0x7fe0a80b5940 0x7fe0a806bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0a7fff700 1 -- 172.21.15.82:0/3027240959 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a80cd560 con 0x7fe0a80b1d10 2023-11-28T13:01:04.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0aca00700 1 --2- 172.21.15.82:0/3027240959 >> v2:172.21.15.114:3300/0 conn(0x7fe0a80b5940 0x7fe0a806bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:01:04.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0a7fff700 1 --2- 172.21.15.82:0/3027240959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a80b1d10 0x7fe0a80cec20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe098009910 tx=0x7fe098009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4330d2f9687295 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:04.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0a6ffd700 1 -- 172.21.15.82:0/3027240959 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09800ba20 con 0x7fe0a80b1d10 2023-11-28T13:01:04.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0a6ffd700 1 -- 172.21.15.82:0/3027240959 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09800bb80 con 0x7fe0a80b1d10 2023-11-28T13:01:04.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.323+0000 7fe0a6ffd700 1 -- 172.21.15.82:0/3027240959 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098009e60 con 0x7fe0a80b1d10 2023-11-28T13:01:04.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0ad201700 1 -- 172.21.15.82:0/3027240959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a80b1d10 msgr2=0x7fe0a80cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:04.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0ad201700 1 --2- 172.21.15.82:0/3027240959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a80b1d10 0x7fe0a80cec20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe098009910 tx=0x7fe098009c20 comp rx=0 tx=0).stop 2023-11-28T13:01:04.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0ad201700 1 -- 172.21.15.82:0/3027240959 shutdown_connections 2023-11-28T13:01:04.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0ad201700 1 --2- 172.21.15.82:0/3027240959 >> v2:172.21.15.114:3300/0 conn(0x7fe0a80b5940 0x7fe0a806bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0ad201700 1 --2- 172.21.15.82:0/3027240959 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a80d25b0 0x7fe0a806ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0ad201700 1 --2- 172.21.15.82:0/3027240959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a80b1d10 0x7fe0a80cec20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0ad201700 1 -- 172.21.15.82:0/3027240959 >> 172.21.15.82:0/3027240959 conn(0x7fe0a80b52a0 msgr2=0x7fe0a80d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:04.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0ad201700 1 -- 172.21.15.82:0/3027240959 shutdown_connections 2023-11-28T13:01:04.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0ad201700 1 -- 172.21.15.82:0/3027240959 wait complete. 2023-11-28T13:01:04.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0ad201700 1 Processor -- start 2023-11-28T13:01:04.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0ad201700 1 -- start start 2023-11-28T13:01:04.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0ad201700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a80b1d10 0x7fe0a80c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0ad201700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a80b5940 0x7fe0a80b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0ad201700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0a80d25b0 0x7fe0a80b7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0ad201700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a8147260 con 0x7fe0a80b5940 2023-11-28T13:01:04.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0ad201700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a81f5bb0 con 0x7fe0a80d25b0 2023-11-28T13:01:04.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0ad201700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a8146930 con 0x7fe0a80b1d10 2023-11-28T13:01:04.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0a77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a80b5940 0x7fe0a80b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0a77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a80b5940 0x7fe0a80b6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42470/0 (socket says 172.21.15.82:42470) 2023-11-28T13:01:04.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0a77fe700 1 -- 172.21.15.82:0/2405036744 learned_addr learned my addr 172.21.15.82:0/2405036744 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:04.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0aca00700 1 --2- 172.21.15.82:0/2405036744 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0a80d25b0 0x7fe0a80b7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0a7fff700 1 --2- 172.21.15.82:0/2405036744 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a80b1d10 0x7fe0a80c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0a77fe700 1 -- 172.21.15.82:0/2405036744 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a80b1d10 msgr2=0x7fe0a80c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:04.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0a77fe700 1 --2- 172.21.15.82:0/2405036744 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a80b1d10 0x7fe0a80c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0a77fe700 1 -- 172.21.15.82:0/2405036744 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0a80d25b0 msgr2=0x7fe0a80b7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:04.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0a77fe700 1 --2- 172.21.15.82:0/2405036744 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0a80d25b0 0x7fe0a80b7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0a77fe700 1 -- 172.21.15.82:0/2405036744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe098009570 con 0x7fe0a80b5940 2023-11-28T13:01:04.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.327+0000 7fe0a7fff700 1 --2- 172.21.15.82:0/2405036744 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a80b1d10 0x7fe0a80c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:01:04.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.331+0000 7fe0a77fe700 1 --2- 172.21.15.82:0/2405036744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a80b5940 0x7fe0a80b6e30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00d800 tx=0x7fe09c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:04.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.331+0000 7fe0a4ff9700 1 -- 172.21.15.82:0/2405036744 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c0125f0 con 0x7fe0a80b5940 2023-11-28T13:01:04.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.331+0000 7fe0a4ff9700 1 -- 172.21.15.82:0/2405036744 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c012750 con 0x7fe0a80b5940 2023-11-28T13:01:04.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.331+0000 7fe0ad201700 1 -- 172.21.15.82:0/2405036744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a80d1050 con 0x7fe0a80b5940 2023-11-28T13:01:04.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.331+0000 7fe0a4ff9700 1 -- 172.21.15.82:0/2405036744 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c012b00 con 0x7fe0a80b5940 2023-11-28T13:01:04.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.331+0000 7fe0ad201700 1 -- 172.21.15.82:0/2405036744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a80b20e0 con 0x7fe0a80b5940 2023-11-28T13:01:04.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.331+0000 7fe0ad201700 1 -- 172.21.15.82:0/2405036744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a80d11e0 con 0x7fe0a80b5940 2023-11-28T13:01:04.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.331+0000 7fe0a4ff9700 1 -- 172.21.15.82:0/2405036744 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe09c012c60 con 0x7fe0a80b5940 2023-11-28T13:01:04.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.331+0000 7fe0a4ff9700 1 --2- 172.21.15.82:0/2405036744 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe094064ee0 0x7fe094067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.331+0000 7fe0a4ff9700 1 -- 172.21.15.82:0/2405036744 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe09c082470 con 0x7fe0a80b5940 2023-11-28T13:01:04.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.331+0000 7fe0a7fff700 1 --2- 172.21.15.82:0/2405036744 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe094064ee0 0x7fe094067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.335+0000 7fe0a7fff700 1 --2- 172.21.15.82:0/2405036744 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe094064ee0 0x7fe094067390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe098000c00 tx=0x7fe098008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:04.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.339+0000 7fe0a4ff9700 1 -- 172.21.15.82:0/2405036744 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe09c050520 con 0x7fe0a80b5940 2023-11-28T13:01:04.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.499+0000 7fe0ad201700 1 -- 172.21.15.82:0/2405036744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe0a8065fc0 con 0x7fe0a80b5940 2023-11-28T13:01:04.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.499+0000 7fe0a4ff9700 1 -- 172.21.15.82:0/2405036744 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe09c053b40 con 0x7fe0a80b5940 2023-11-28T13:01:04.504 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-11-28T13:01:04.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.499+0000 7fe0ad201700 1 -- 172.21.15.82:0/2405036744 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe094064ee0 msgr2=0x7fe094067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:04.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.499+0000 7fe0ad201700 1 --2- 172.21.15.82:0/2405036744 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe094064ee0 0x7fe094067390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe098000c00 tx=0x7fe098008030 comp rx=0 tx=0).stop 2023-11-28T13:01:04.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.499+0000 7fe0ad201700 1 -- 172.21.15.82:0/2405036744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a80b5940 msgr2=0x7fe0a80b6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:04.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.499+0000 7fe0ad201700 1 --2- 172.21.15.82:0/2405036744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a80b5940 0x7fe0a80b6e30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00d800 tx=0x7fe09c00dbc0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.503+0000 7fe0ad201700 1 -- 172.21.15.82:0/2405036744 shutdown_connections 2023-11-28T13:01:04.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.503+0000 7fe0ad201700 1 --2- 172.21.15.82:0/2405036744 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe094064ee0 0x7fe094067390 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.503+0000 7fe0ad201700 1 --2- 172.21.15.82:0/2405036744 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0a80d25b0 0x7fe0a80b7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.503+0000 7fe0ad201700 1 --2- 172.21.15.82:0/2405036744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a80b5940 0x7fe0a80b6e30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.503+0000 7fe0ad201700 1 --2- 172.21.15.82:0/2405036744 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a80b1d10 0x7fe0a80c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.503+0000 7fe0ad201700 1 -- 172.21.15.82:0/2405036744 >> 172.21.15.82:0/2405036744 conn(0x7fe0a80b52a0 msgr2=0x7fe0a80d2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:04.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.503+0000 7fe0ad201700 1 -- 172.21.15.82:0/2405036744 shutdown_connections 2023-11-28T13:01:04.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.503+0000 7fe0ad201700 1 -- 172.21.15.82:0/2405036744 wait complete. 2023-11-28T13:01:04.518 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T13:01:04.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80d10c4700 1 Processor -- start 2023-11-28T13:01:04.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80d10c4700 1 -- start start 2023-11-28T13:01:04.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80d10c4700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f80cc15a400 0x7f80cc06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80d10c4700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f80cc070400 0x7f80cc070850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80d10c4700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80cc070d90 con 0x7f80cc15dde0 2023-11-28T13:01:04.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80d10c4700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80cc0cc5a0 con 0x7f80cc15a400 2023-11-28T13:01:04.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80d10c4700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc0c9370 con 0x7f80cc070400 2023-11-28T13:01:04.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80cb59e700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f80cc15dde0 0x7f80cc15e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58428/0 (socket says 172.21.15.82:58428) 2023-11-28T13:01:04.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80cb59e700 1 -- 172.21.15.82:0/4215793182 learned_addr learned my addr 172.21.15.82:0/4215793182 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:04.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80cad9d700 1 --2- 172.21.15.82:0/4215793182 >> v2:172.21.15.114:3300/0 conn(0x7f80cc15a400 0x7f80cc06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80c259c700 1 --2- 172.21.15.82:0/4215793182 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f80cc070400 0x7f80cc070850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80ca59c700 1 -- 172.21.15.82:0/4215793182 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804725088 0 0) 0x7f80c4001490 con 0x7f80cc15dde0 2023-11-28T13:01:04.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80ca59c700 1 -- 172.21.15.82:0/4215793182 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80b80035d0 con 0x7f80cc15dde0 2023-11-28T13:01:04.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80cad9d700 1 -- 172.21.15.82:0/4215793182 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f80cc070400 msgr2=0x7f80cc070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:04.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80cad9d700 1 --2- 172.21.15.82:0/4215793182 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f80cc070400 0x7f80cc070850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80cad9d700 1 -- 172.21.15.82:0/4215793182 >> v1:172.21.15.82:6789/0 conn(0x7f80cc15dde0 legacy=0x7f80cc15e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:04.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80ca59c700 1 -- 172.21.15.82:0/4215793182 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 485731111 0 0) 0x7f80b80035d0 con 0x7f80cc15dde0 2023-11-28T13:01:04.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80cad9d700 1 -- 172.21.15.82:0/4215793182 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc0c9650 con 0x7f80cc15a400 2023-11-28T13:01:04.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80cad9d700 1 --2- 172.21.15.82:0/4215793182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80cc15a400 0x7f80cc06a5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f80bc009850 tx=0x7f80bc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97bae0f1fd234322 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:04.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80ca59c700 1 -- 172.21.15.82:0/4215793182 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4001b80 con 0x7f80cc15a400 2023-11-28T13:01:04.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80ca59c700 1 -- 172.21.15.82:0/4215793182 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80bc004030 con 0x7f80cc15a400 2023-11-28T13:01:04.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80ca59c700 1 -- 172.21.15.82:0/4215793182 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc0043a0 con 0x7f80cc15a400 2023-11-28T13:01:04.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80d10c4700 1 -- 172.21.15.82:0/4215793182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80cc15a400 msgr2=0x7f80cc06a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:04.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80d10c4700 1 --2- 172.21.15.82:0/4215793182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80cc15a400 0x7f80cc06a5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f80bc009850 tx=0x7f80bc009b60 comp rx=0 tx=0).stop 2023-11-28T13:01:04.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80d10c4700 1 -- 172.21.15.82:0/4215793182 shutdown_connections 2023-11-28T13:01:04.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80d10c4700 1 --2- 172.21.15.82:0/4215793182 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f80cc070400 0x7f80cc070850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80d10c4700 1 --2- 172.21.15.82:0/4215793182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80cc15a400 0x7f80cc06a5a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80d10c4700 1 -- 172.21.15.82:0/4215793182 >> 172.21.15.82:0/4215793182 conn(0x7f80cc0ce9d0 msgr2=0x7f80cc0ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:04.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80d10c4700 1 -- 172.21.15.82:0/4215793182 shutdown_connections 2023-11-28T13:01:04.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.631+0000 7f80d10c4700 1 -- 172.21.15.82:0/4215793182 wait complete. 2023-11-28T13:01:04.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.635+0000 7f80d10c4700 1 Processor -- start 2023-11-28T13:01:04.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.635+0000 7f80d10c4700 1 -- start start 2023-11-28T13:01:04.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.635+0000 7f80d10c4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80cc070400 0x7f80cc1531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.635+0000 7f80d10c4700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f80cc15a400 0x7f80cc0c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.635+0000 7f80d10c4700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80cc15dde0 0x7f80cc0acc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.635+0000 7f80d10c4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc15cec0 con 0x7f80cc070400 2023-11-28T13:01:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.635+0000 7f80d10c4700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc15d1a0 con 0x7f80cc15dde0 2023-11-28T13:01:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.635+0000 7f80d10c4700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc15d480 con 0x7f80cc15a400 2023-11-28T13:01:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.635+0000 7f80cad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80cc070400 0x7f80cc1531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.635+0000 7f80cad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80cc070400 0x7f80cc1531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42476/0 (socket says 172.21.15.82:42476) 2023-11-28T13:01:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.635+0000 7f80cad9d700 1 -- 172.21.15.82:0/2751089366 learned_addr learned my addr 172.21.15.82:0/2751089366 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.635+0000 7f80c259c700 1 --2- 172.21.15.82:0/2751089366 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f80cc15a400 0x7f80cc0c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.635+0000 7f80cb59e700 1 --2- 172.21.15.82:0/2751089366 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80cc15dde0 0x7f80cc0acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.639+0000 7f80cad9d700 1 -- 172.21.15.82:0/2751089366 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f80cc15a400 msgr2=0x7f80cc0c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.639+0000 7f80cad9d700 1 --2- 172.21.15.82:0/2751089366 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f80cc15a400 0x7f80cc0c5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.639+0000 7f80cad9d700 1 -- 172.21.15.82:0/2751089366 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80cc15dde0 msgr2=0x7f80cc0acc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.639+0000 7f80cad9d700 1 --2- 172.21.15.82:0/2751089366 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80cc15dde0 0x7f80cc0acc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.639+0000 7f80cad9d700 1 -- 172.21.15.82:0/2751089366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc0094b0 con 0x7f80cc070400 2023-11-28T13:01:04.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.639+0000 7f80cad9d700 1 --2- 172.21.15.82:0/2751089366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80cc070400 0x7f80cc1531d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f80cc06e810 tx=0x7f80bc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:04.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.639+0000 7f80c3fff700 1 -- 172.21.15.82:0/2751089366 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc003cd0 con 0x7f80cc070400 2023-11-28T13:01:04.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.639+0000 7f80c3fff700 1 -- 172.21.15.82:0/2751089366 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80bc003e50 con 0x7f80cc070400 2023-11-28T13:01:04.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.639+0000 7f80d10c4700 1 -- 172.21.15.82:0/2751089366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80cc0ccad0 con 0x7f80cc070400 2023-11-28T13:01:04.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.639+0000 7f80c3fff700 1 -- 172.21.15.82:0/2751089366 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc011870 con 0x7f80cc070400 2023-11-28T13:01:04.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.639+0000 7f80d10c4700 1 -- 172.21.15.82:0/2751089366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80cc0cc7f0 con 0x7f80cc070400 2023-11-28T13:01:04.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.639+0000 7f80d10c4700 1 -- 172.21.15.82:0/2751089366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80cc06aae0 con 0x7f80cc070400 2023-11-28T13:01:04.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.639+0000 7f80c3fff700 1 -- 172.21.15.82:0/2751089366 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f80bc02b070 con 0x7f80cc070400 2023-11-28T13:01:04.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.643+0000 7f80c3fff700 1 --2- 172.21.15.82:0/2751089366 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f80ac064ee0 0x7f80ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.643+0000 7f80c259c700 1 --2- 172.21.15.82:0/2751089366 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f80ac064ee0 0x7f80ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.643+0000 7f80c3fff700 1 -- 172.21.15.82:0/2751089366 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f80bc082fb0 con 0x7f80cc070400 2023-11-28T13:01:04.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.643+0000 7f80c259c700 1 --2- 172.21.15.82:0/2751089366 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f80ac064ee0 0x7f80ac067390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0cf7c0 tx=0x7f80b4009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:04.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.647+0000 7f80c3fff700 1 -- 172.21.15.82:0/2751089366 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f80bc051150 con 0x7f80cc070400 2023-11-28T13:01:04.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.803+0000 7f80d10c4700 1 -- 172.21.15.82:0/2751089366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f80cc15b8b0 con 0x7f80cc070400 2023-11-28T13:01:04.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.803+0000 7f80c3fff700 1 -- 172.21.15.82:0/2751089366 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f80cc15b8b0 con 0x7f80cc070400 2023-11-28T13:01:04.809 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-11-28T13:01:04.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.807+0000 7f80d10c4700 1 -- 172.21.15.82:0/2751089366 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f80ac064ee0 msgr2=0x7f80ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:04.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.807+0000 7f80d10c4700 1 --2- 172.21.15.82:0/2751089366 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f80ac064ee0 0x7f80ac067390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0cf7c0 tx=0x7f80b4009240 comp rx=0 tx=0).stop 2023-11-28T13:01:04.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.807+0000 7f80d10c4700 1 -- 172.21.15.82:0/2751089366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80cc070400 msgr2=0x7f80cc1531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:04.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.807+0000 7f80d10c4700 1 --2- 172.21.15.82:0/2751089366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80cc070400 0x7f80cc1531d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f80cc06e810 tx=0x7f80bc004770 comp rx=0 tx=0).stop 2023-11-28T13:01:04.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.807+0000 7f80d10c4700 1 -- 172.21.15.82:0/2751089366 shutdown_connections 2023-11-28T13:01:04.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.807+0000 7f80d10c4700 1 --2- 172.21.15.82:0/2751089366 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f80ac064ee0 0x7f80ac067390 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.807+0000 7f80d10c4700 1 --2- 172.21.15.82:0/2751089366 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80cc15dde0 0x7f80cc0acc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.807+0000 7f80d10c4700 1 --2- 172.21.15.82:0/2751089366 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f80cc15a400 0x7f80cc0c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.807+0000 7f80d10c4700 1 --2- 172.21.15.82:0/2751089366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80cc070400 0x7f80cc1531d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.807+0000 7f80d10c4700 1 -- 172.21.15.82:0/2751089366 >> 172.21.15.82:0/2751089366 conn(0x7f80cc0ce9d0 msgr2=0x7f80cc0ae760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:04.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.807+0000 7f80d10c4700 1 -- 172.21.15.82:0/2751089366 shutdown_connections 2023-11-28T13:01:04.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.807+0000 7f80d10c4700 1 -- 172.21.15.82:0/2751089366 wait complete. 2023-11-28T13:01:04.824 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T13:01:04.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe31de0700 1 Processor -- start 2023-11-28T13:01:04.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe31de0700 1 -- start start 2023-11-28T13:01:04.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe31de0700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbe2c070070 0x7fbe2c070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe31de0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbe2c160900 0x7fbe2c0cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe31de0700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe2c0c1910 0x7fbe2c1641e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe31de0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe2c070980 con 0x7fbe2c160900 2023-11-28T13:01:04.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe31de0700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe2c0ce030 con 0x7fbe2c070070 2023-11-28T13:01:04.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe31de0700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c0ce310 con 0x7fbe2c0c1910 2023-11-28T13:01:04.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe2bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbe2c160900 0x7fbe2c0cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe2bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbe2c160900 0x7fbe2c0cc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42480/0 (socket says 172.21.15.82:42480) 2023-11-28T13:01:04.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe2bfff700 1 -- 172.21.15.82:0/1601478889 learned_addr learned my addr 172.21.15.82:0/1601478889 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:04.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe315df700 1 --2- 172.21.15.82:0/1601478889 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe2c0c1910 0x7fbe2c1641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe30dde700 1 --2- 172.21.15.82:0/1601478889 >> v2:172.21.15.114:3300/0 conn(0x7fbe2c070070 0x7fbe2c070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe2bfff700 1 -- 172.21.15.82:0/1601478889 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe2c0c1910 msgr2=0x7fbe2c1641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:04.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe2bfff700 1 --2- 172.21.15.82:0/1601478889 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe2c0c1910 0x7fbe2c1641e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe2bfff700 1 -- 172.21.15.82:0/1601478889 >> v2:172.21.15.114:3300/0 conn(0x7fbe2c070070 msgr2=0x7fbe2c070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:04.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe2bfff700 1 --2- 172.21.15.82:0/1601478889 >> v2:172.21.15.114:3300/0 conn(0x7fbe2c070070 0x7fbe2c070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe2bfff700 1 -- 172.21.15.82:0/1601478889 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2c06a5d0 con 0x7fbe2c160900 2023-11-28T13:01:04.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe2bfff700 1 --2- 172.21.15.82:0/1601478889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2c160900 0x7fbe2c0cc1d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c06bf40 tx=0x7fbe2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6106bab07da685f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:04.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe2b7fe700 1 -- 172.21.15.82:0/1601478889 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2400e070 con 0x7fbe2c160900 2023-11-28T13:01:04.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe2b7fe700 1 -- 172.21.15.82:0/1601478889 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2400b910 con 0x7fbe2c160900 2023-11-28T13:01:04.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.939+0000 7fbe2b7fe700 1 -- 172.21.15.82:0/1601478889 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2400bcc0 con 0x7fbe2c160900 2023-11-28T13:01:04.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.943+0000 7fbe31de0700 1 -- 172.21.15.82:0/1601478889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2c160900 msgr2=0x7fbe2c0cc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:04.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.943+0000 7fbe31de0700 1 --2- 172.21.15.82:0/1601478889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2c160900 0x7fbe2c0cc1d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c06bf40 tx=0x7fbe2400b330 comp rx=0 tx=0).stop 2023-11-28T13:01:04.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.943+0000 7fbe31de0700 1 -- 172.21.15.82:0/1601478889 shutdown_connections 2023-11-28T13:01:04.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.943+0000 7fbe31de0700 1 --2- 172.21.15.82:0/1601478889 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe2c0c1910 0x7fbe2c1641e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.943+0000 7fbe31de0700 1 --2- 172.21.15.82:0/1601478889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2c160900 0x7fbe2c0cc1d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.943+0000 7fbe31de0700 1 --2- 172.21.15.82:0/1601478889 >> v2:172.21.15.114:3300/0 conn(0x7fbe2c070070 0x7fbe2c070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.943+0000 7fbe31de0700 1 -- 172.21.15.82:0/1601478889 >> 172.21.15.82:0/1601478889 conn(0x7fbe2c0ce600 msgr2=0x7fbe2c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:04.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.943+0000 7fbe31de0700 1 -- 172.21.15.82:0/1601478889 shutdown_connections 2023-11-28T13:01:04.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.943+0000 7fbe31de0700 1 -- 172.21.15.82:0/1601478889 wait complete. 2023-11-28T13:01:04.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.943+0000 7fbe31de0700 1 Processor -- start 2023-11-28T13:01:04.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.943+0000 7fbe31de0700 1 -- start start 2023-11-28T13:01:04.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.943+0000 7fbe31de0700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe2c070070 0x7fbe2c0c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.943+0000 7fbe31de0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2c15f280 0x7fbe2c15e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.943+0000 7fbe31de0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe2c0c7d50 0x7fbe2c0c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.943+0000 7fbe31de0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c0c6260 con 0x7fbe2c15f280 2023-11-28T13:01:04.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.943+0000 7fbe31de0700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c0c6540 con 0x7fbe2c0c7d50 2023-11-28T13:01:04.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.943+0000 7fbe31de0700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c0c3100 con 0x7fbe2c070070 2023-11-28T13:01:04.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.947+0000 7fbe2bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2c15f280 0x7fbe2c15e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.947+0000 7fbe2bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2c15f280 0x7fbe2c15e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42486/0 (socket says 172.21.15.82:42486) 2023-11-28T13:01:04.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.947+0000 7fbe2bfff700 1 -- 172.21.15.82:0/3006859811 learned_addr learned my addr 172.21.15.82:0/3006859811 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:04.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.947+0000 7fbe30dde700 1 --2- 172.21.15.82:0/3006859811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe2c070070 0x7fbe2c0c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.947+0000 7fbe315df700 1 --2- 172.21.15.82:0/3006859811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe2c0c7d50 0x7fbe2c0c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.947+0000 7fbe2bfff700 1 -- 172.21.15.82:0/3006859811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe2c070070 msgr2=0x7fbe2c0c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:04.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.947+0000 7fbe2bfff700 1 --2- 172.21.15.82:0/3006859811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe2c070070 0x7fbe2c0c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.947+0000 7fbe2bfff700 1 -- 172.21.15.82:0/3006859811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe2c0c7d50 msgr2=0x7fbe2c0c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:04.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.947+0000 7fbe2bfff700 1 --2- 172.21.15.82:0/3006859811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe2c0c7d50 0x7fbe2c0c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:04.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.947+0000 7fbe2bfff700 1 -- 172.21.15.82:0/3006859811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe24009b30 con 0x7fbe2c15f280 2023-11-28T13:01:04.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.947+0000 7fbe2bfff700 1 --2- 172.21.15.82:0/3006859811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2c15f280 0x7fbe2c15e900 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400b370 tx=0x7fbe24004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:04.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.947+0000 7fbe297fa700 1 -- 172.21.15.82:0/3006859811 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24004450 con 0x7fbe2c15f280 2023-11-28T13:01:04.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.947+0000 7fbe297fa700 1 -- 172.21.15.82:0/3006859811 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe240045b0 con 0x7fbe2c15f280 2023-11-28T13:01:04.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.947+0000 7fbe297fa700 1 -- 172.21.15.82:0/3006859811 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24004960 con 0x7fbe2c15f280 2023-11-28T13:01:04.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.947+0000 7fbe31de0700 1 -- 172.21.15.82:0/3006859811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2c06ab90 con 0x7fbe2c15f280 2023-11-28T13:01:04.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.947+0000 7fbe31de0700 1 -- 172.21.15.82:0/3006859811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2c06a8b0 con 0x7fbe2c15f280 2023-11-28T13:01:04.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.947+0000 7fbe297fa700 1 -- 172.21.15.82:0/3006859811 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbe24025460 con 0x7fbe2c15f280 2023-11-28T13:01:04.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.947+0000 7fbe31de0700 1 -- 172.21.15.82:0/3006859811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe2c0cc710 con 0x7fbe2c15f280 2023-11-28T13:01:04.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.947+0000 7fbe297fa700 1 --2- 172.21.15.82:0/3006859811 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbe0c064ee0 0x7fbe0c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:04.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.947+0000 7fbe297fa700 1 -- 172.21.15.82:0/3006859811 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbe24083b80 con 0x7fbe2c15f280 2023-11-28T13:01:04.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.951+0000 7fbe30dde700 1 --2- 172.21.15.82:0/3006859811 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbe0c064ee0 0x7fbe0c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:04.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.951+0000 7fbe30dde700 1 --2- 172.21.15.82:0/3006859811 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbe0c064ee0 0x7fbe0c067390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c06a100 tx=0x7fbe1c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:04.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:04.959+0000 7fbe297fa700 1 -- 172.21.15.82:0/3006859811 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbe24051c40 con 0x7fbe2c15f280 2023-11-28T13:01:05.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.131+0000 7fbe31de0700 1 -- 172.21.15.82:0/3006859811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbe2c0c3620 con 0x7fbe2c15f280 2023-11-28T13:01:05.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.131+0000 7fbe297fa700 1 -- 172.21.15.82:0/3006859811 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbe2c0c3620 con 0x7fbe2c15f280 2023-11-28T13:01:05.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.135+0000 7fbe31de0700 1 -- 172.21.15.82:0/3006859811 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbe0c064ee0 msgr2=0x7fbe0c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:05.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.135+0000 7fbe31de0700 1 --2- 172.21.15.82:0/3006859811 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbe0c064ee0 0x7fbe0c067390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c06a100 tx=0x7fbe1c009240 comp rx=0 tx=0).stop 2023-11-28T13:01:05.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.135+0000 7fbe31de0700 1 -- 172.21.15.82:0/3006859811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2c15f280 msgr2=0x7fbe2c15e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:05.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.135+0000 7fbe31de0700 1 --2- 172.21.15.82:0/3006859811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2c15f280 0x7fbe2c15e900 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400b370 tx=0x7fbe24004af0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.135+0000 7fbe31de0700 1 -- 172.21.15.82:0/3006859811 shutdown_connections 2023-11-28T13:01:05.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.135+0000 7fbe31de0700 1 --2- 172.21.15.82:0/3006859811 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbe0c064ee0 0x7fbe0c067390 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.135+0000 7fbe31de0700 1 --2- 172.21.15.82:0/3006859811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe2c0c7d50 0x7fbe2c0c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.135+0000 7fbe31de0700 1 --2- 172.21.15.82:0/3006859811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe2c15f280 0x7fbe2c15e900 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.135+0000 7fbe31de0700 1 --2- 172.21.15.82:0/3006859811 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe2c070070 0x7fbe2c0c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.135+0000 7fbe31de0700 1 -- 172.21.15.82:0/3006859811 >> 172.21.15.82:0/3006859811 conn(0x7fbe2c0ce600 msgr2=0x7fbe2c0adcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:05.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.135+0000 7fbe31de0700 1 -- 172.21.15.82:0/3006859811 shutdown_connections 2023-11-28T13:01:05.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.135+0000 7fbe31de0700 1 -- 172.21.15.82:0/3006859811 wait complete. 2023-11-28T13:01:05.140 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2023-11-28T13:01:05.151 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:01:05.151 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:01:05.159 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:01:05.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.267+0000 7f2f5f59e700 1 Processor -- start 2023-11-28T13:01:05.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.267+0000 7f2f5f59e700 1 -- start start 2023-11-28T13:01:05.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.267+0000 7f2f5f59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2f60070070 0x7f2f60070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:05.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.267+0000 7f2f5f59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2f600c1910 0x7f2f6006c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:05.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.267+0000 7f2f5f59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f60070980 con 0x7f2f60160900 2023-11-28T13:01:05.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.267+0000 7f2f5f59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f600ce030 con 0x7f2f600c1910 2023-11-28T13:01:05.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.267+0000 7f2f5f59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f600ce310 con 0x7f2f60070070 2023-11-28T13:01:05.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.267+0000 7f2f5ed9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2f600c1910 0x7f2f6006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:05.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.267+0000 7f2f5ed9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2f600c1910 0x7f2f6006c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42494/0 (socket says 172.21.15.82:42494) 2023-11-28T13:01:05.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.267+0000 7f2f5ed9d700 1 -- 172.21.15.82:0/218334860 learned_addr learned my addr 172.21.15.82:0/218334860 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:05.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.267+0000 7f2f5e59c700 1 --2- 172.21.15.82:0/218334860 >> v2:172.21.15.114:3300/0 conn(0x7f2f60070070 0x7f2f60070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:05.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.271+0000 7f2f5ed9d700 1 -- 172.21.15.82:0/218334860 >> v2:172.21.15.114:3300/0 conn(0x7f2f60070070 msgr2=0x7f2f60070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:05.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.271+0000 7f2f5ed9d700 1 --2- 172.21.15.82:0/218334860 >> v2:172.21.15.114:3300/0 conn(0x7f2f60070070 0x7f2f60070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.271+0000 7f2f5ed9d700 1 -- 172.21.15.82:0/218334860 >> v1:172.21.15.114:6789/0 conn(0x7f2f60160900 legacy=0x7f2f600cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:05.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.271+0000 7f2f5d59a700 1 -- 172.21.15.82:0/218334860 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3410259102 0 0) 0x7f2f60070980 con 0x7f2f60160900 2023-11-28T13:01:05.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.271+0000 7f2f5ed9d700 1 -- 172.21.15.82:0/218334860 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6006a5d0 con 0x7f2f600c1910 2023-11-28T13:01:05.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.271+0000 7f2f5ed9d700 1 --2- 172.21.15.82:0/218334860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f600c1910 0x7f2f6006c070 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2f6006bf40 tx=0x7f2f5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c5ae2cd3466c87 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:05.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.271+0000 7f2f5d59a700 1 -- 172.21.15.82:0/218334860 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5800e070 con 0x7f2f600c1910 2023-11-28T13:01:05.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.271+0000 7f2f5d59a700 1 -- 172.21.15.82:0/218334860 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5800b910 con 0x7f2f600c1910 2023-11-28T13:01:05.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.271+0000 7f2f5d59a700 1 -- 172.21.15.82:0/218334860 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5800bcc0 con 0x7f2f600c1910 2023-11-28T13:01:05.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.271+0000 7f2f5f59e700 1 -- 172.21.15.82:0/218334860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f600c1910 msgr2=0x7f2f6006c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:05.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.271+0000 7f2f5f59e700 1 --2- 172.21.15.82:0/218334860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f600c1910 0x7f2f6006c070 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2f6006bf40 tx=0x7f2f5800b330 comp rx=0 tx=0).stop 2023-11-28T13:01:05.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.271+0000 7f2f5f59e700 1 -- 172.21.15.82:0/218334860 shutdown_connections 2023-11-28T13:01:05.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.271+0000 7f2f5f59e700 1 --2- 172.21.15.82:0/218334860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f600c1910 0x7f2f6006c070 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.271+0000 7f2f5f59e700 1 --2- 172.21.15.82:0/218334860 >> v2:172.21.15.114:3300/0 conn(0x7f2f60070070 0x7f2f60070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.271+0000 7f2f5f59e700 1 -- 172.21.15.82:0/218334860 >> 172.21.15.82:0/218334860 conn(0x7f2f600ce600 msgr2=0x7f2f600ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:05.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.271+0000 7f2f5f59e700 1 -- 172.21.15.82:0/218334860 shutdown_connections 2023-11-28T13:01:05.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.271+0000 7f2f5f59e700 1 -- 172.21.15.82:0/218334860 wait complete. 2023-11-28T13:01:05.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.271+0000 7f2f5f59e700 1 Processor -- start 2023-11-28T13:01:05.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f5f59e700 1 -- start start 2023-11-28T13:01:05.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f5f59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2f60070070 0x7f2f6015bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:05.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f5f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f6015c640 0x7f2f60161ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:05.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f5f59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f600b2480 0x7f2f600b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:05.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f5f59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f600b2e40 con 0x7f2f6015c640 2023-11-28T13:01:05.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f5f59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f60163fb0 con 0x7f2f600b2480 2023-11-28T13:01:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f5f59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f600c37a0 con 0x7f2f60070070 2023-11-28T13:01:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f5dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f6015c640 0x7f2f60161ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f5dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f6015c640 0x7f2f60161ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42500/0 (socket says 172.21.15.82:42500) 2023-11-28T13:01:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f5dd9b700 1 -- 172.21.15.82:0/714109446 learned_addr learned my addr 172.21.15.82:0/714109446 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f5e59c700 1 --2- 172.21.15.82:0/714109446 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2f60070070 0x7f2f6015bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f5ed9d700 1 --2- 172.21.15.82:0/714109446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f600b2480 0x7f2f600b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f5dd9b700 1 -- 172.21.15.82:0/714109446 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2f60070070 msgr2=0x7f2f6015bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f5dd9b700 1 --2- 172.21.15.82:0/714109446 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2f60070070 0x7f2f6015bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f5dd9b700 1 -- 172.21.15.82:0/714109446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f600b2480 msgr2=0x7f2f600b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:05.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f5dd9b700 1 --2- 172.21.15.82:0/714109446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f600b2480 0x7f2f600b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f5dd9b700 1 -- 172.21.15.82:0/714109446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f58009b30 con 0x7f2f6015c640 2023-11-28T13:01:05.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f5dd9b700 1 --2- 172.21.15.82:0/714109446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f6015c640 0x7f2f60161ce0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2f500011e0 tx=0x7f2f5000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:05.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f56ffd700 1 -- 172.21.15.82:0/714109446 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f500054e0 con 0x7f2f6015c640 2023-11-28T13:01:05.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f56ffd700 1 -- 172.21.15.82:0/714109446 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f500036a0 con 0x7f2f6015c640 2023-11-28T13:01:05.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f5f59e700 1 -- 172.21.15.82:0/714109446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6006ab90 con 0x7f2f6015c640 2023-11-28T13:01:05.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f56ffd700 1 -- 172.21.15.82:0/714109446 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f50003a50 con 0x7f2f6015c640 2023-11-28T13:01:05.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.275+0000 7f2f5f59e700 1 -- 172.21.15.82:0/714109446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6006a8b0 con 0x7f2f6015c640 2023-11-28T13:01:05.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.279+0000 7f2f5f59e700 1 -- 172.21.15.82:0/714109446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f600cdc50 con 0x7f2f6015c640 2023-11-28T13:01:05.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.279+0000 7f2f56ffd700 1 -- 172.21.15.82:0/714109446 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2f50019030 con 0x7f2f6015c640 2023-11-28T13:01:05.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.279+0000 7f2f56ffd700 1 --2- 172.21.15.82:0/714109446 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2f40064ee0 0x7f2f40067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:05.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.279+0000 7f2f5e59c700 1 --2- 172.21.15.82:0/714109446 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2f40064ee0 0x7f2f40067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:05.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.279+0000 7f2f56ffd700 1 -- 172.21.15.82:0/714109446 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2f50081180 con 0x7f2f6015c640 2023-11-28T13:01:05.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.279+0000 7f2f5e59c700 1 --2- 172.21.15.82:0/714109446 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2f40064ee0 0x7f2f40067390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2f600ca9b0 tx=0x7f2f48009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:05.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.287+0000 7f2f56ffd700 1 -- 172.21.15.82:0/714109446 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2f5004f320 con 0x7f2f6015c640 2023-11-28T13:01:05.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.447+0000 7f2f5f59e700 1 -- 172.21.15.82:0/714109446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f600c38e0 con 0x7f2f6015c640 2023-11-28T13:01:05.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.451+0000 7f2f56ffd700 1 -- 172.21.15.82:0/714109446 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17811 (secure 0 0 0) 0x7f2f50052940 con 0x7f2f6015c640 2023-11-28T13:01:05.457 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:05.457 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:00:26.981345+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:00:24.360641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T13:00:24.960863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:01:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.455+0000 7f2f5f59e700 1 -- 172.21.15.82:0/714109446 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2f40064ee0 msgr2=0x7f2f40067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:05.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.455+0000 7f2f5f59e700 1 --2- 172.21.15.82:0/714109446 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2f40064ee0 0x7f2f40067390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2f600ca9b0 tx=0x7f2f48009240 comp rx=0 tx=0).stop 2023-11-28T13:01:05.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.455+0000 7f2f5f59e700 1 -- 172.21.15.82:0/714109446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f6015c640 msgr2=0x7f2f60161ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:05.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.455+0000 7f2f5f59e700 1 --2- 172.21.15.82:0/714109446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f6015c640 0x7f2f60161ce0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2f500011e0 tx=0x7f2f5000ca30 comp rx=0 tx=0).stop 2023-11-28T13:01:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.455+0000 7f2f5f59e700 1 -- 172.21.15.82:0/714109446 shutdown_connections 2023-11-28T13:01:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.455+0000 7f2f5f59e700 1 --2- 172.21.15.82:0/714109446 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2f40064ee0 0x7f2f40067390 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.455+0000 7f2f5f59e700 1 --2- 172.21.15.82:0/714109446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f600b2480 0x7f2f600b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.455+0000 7f2f5f59e700 1 --2- 172.21.15.82:0/714109446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f6015c640 0x7f2f60161ce0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.455+0000 7f2f5f59e700 1 --2- 172.21.15.82:0/714109446 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2f60070070 0x7f2f6015bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.455+0000 7f2f5f59e700 1 -- 172.21.15.82:0/714109446 >> 172.21.15.82:0/714109446 conn(0x7f2f600ce600 msgr2=0x7f2f600af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.455+0000 7f2f5f59e700 1 -- 172.21.15.82:0/714109446 shutdown_connections 2023-11-28T13:01:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.455+0000 7f2f5f59e700 1 -- 172.21.15.82:0/714109446 wait complete. 2023-11-28T13:01:05.472 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T13:00:24.360641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T13:00:24.960863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:01:05.473 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:01:05.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.587+0000 7f07712df700 1 Processor -- start 2023-11-28T13:01:05.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.587+0000 7f07712df700 1 -- start start 2023-11-28T13:01:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.587+0000 7f07712df700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0764037710 0x7f0764051740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.587+0000 7f07712df700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0764006ce0 0x7f07640e32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.587+0000 7f07712df700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0764008020 con 0x7f07640dc7f0 2023-11-28T13:01:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.587+0000 7f07712df700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07640e3820 con 0x7f0764006ce0 2023-11-28T13:01:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.587+0000 7f07712df700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07640502a0 con 0x7f0764037710 2023-11-28T13:01:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.587+0000 7f0770ade700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0764006ce0 0x7f07640e32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.587+0000 7f0770ade700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0764006ce0 0x7f07640e32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42504/0 (socket says 172.21.15.82:42504) 2023-11-28T13:01:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.587+0000 7f0770ade700 1 -- 172.21.15.82:0/943672901 learned_addr learned my addr 172.21.15.82:0/943672901 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:05.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.587+0000 7f076b7fe700 1 --2- 172.21.15.82:0/943672901 >> v2:172.21.15.114:3300/0 conn(0x7f0764037710 0x7f0764051740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:05.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.591+0000 7f0770ade700 1 -- 172.21.15.82:0/943672901 >> v2:172.21.15.114:3300/0 conn(0x7f0764037710 msgr2=0x7f0764051740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:05.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.591+0000 7f0770ade700 1 --2- 172.21.15.82:0/943672901 >> v2:172.21.15.114:3300/0 conn(0x7f0764037710 0x7f0764051740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.591+0000 7f0770ade700 1 -- 172.21.15.82:0/943672901 >> v1:172.21.15.114:6789/0 conn(0x7f07640dc7f0 legacy=0x7f0764037000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:05.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.591+0000 7f076affd700 1 -- 172.21.15.82:0/943672901 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116750568 0 0) 0x7f0764008020 con 0x7f07640dc7f0 2023-11-28T13:01:05.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.591+0000 7f0770ade700 1 -- 172.21.15.82:0/943672901 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076404fce0 con 0x7f0764006ce0 2023-11-28T13:01:05.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.591+0000 7f0770ade700 1 --2- 172.21.15.82:0/943672901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0764006ce0 0x7f07640e32e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f076c04ed50 tx=0x7f076c072430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6dc300a483eaf6b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:05.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.591+0000 7f076affd700 1 -- 172.21.15.82:0/943672901 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c0657e0 con 0x7f0764006ce0 2023-11-28T13:01:05.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.591+0000 7f076affd700 1 -- 172.21.15.82:0/943672901 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c065940 con 0x7f0764006ce0 2023-11-28T13:01:05.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.591+0000 7f076affd700 1 -- 172.21.15.82:0/943672901 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c066230 con 0x7f0764006ce0 2023-11-28T13:01:05.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.591+0000 7f07712df700 1 -- 172.21.15.82:0/943672901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0764006ce0 msgr2=0x7f07640e32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:05.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.591+0000 7f07712df700 1 --2- 172.21.15.82:0/943672901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0764006ce0 0x7f07640e32e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f076c04ed50 tx=0x7f076c072430 comp rx=0 tx=0).stop 2023-11-28T13:01:05.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.591+0000 7f07712df700 1 -- 172.21.15.82:0/943672901 shutdown_connections 2023-11-28T13:01:05.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.591+0000 7f07712df700 1 --2- 172.21.15.82:0/943672901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0764006ce0 0x7f07640e32e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.591+0000 7f07712df700 1 --2- 172.21.15.82:0/943672901 >> v2:172.21.15.114:3300/0 conn(0x7f0764037710 0x7f0764051740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.591+0000 7f07712df700 1 -- 172.21.15.82:0/943672901 >> 172.21.15.82:0/943672901 conn(0x7f0764052000 msgr2=0x7f0764052400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:05.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.591+0000 7f07712df700 1 -- 172.21.15.82:0/943672901 shutdown_connections 2023-11-28T13:01:05.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.591+0000 7f07712df700 1 -- 172.21.15.82:0/943672901 wait complete. 2023-11-28T13:01:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.591+0000 7f07712df700 1 Processor -- start 2023-11-28T13:01:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.591+0000 7f07712df700 1 -- start start 2023-11-28T13:01:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f07712df700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0764006ce0 0x7f07640dad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f07712df700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0764037710 0x7f07640de020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f07712df700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07640dc7f0 0x7f07640d8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f07712df700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07640dd260 con 0x7f0764037710 2023-11-28T13:01:05.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f07712df700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07640dd540 con 0x7f07640dc7f0 2023-11-28T13:01:05.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f07712df700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07640dd820 con 0x7f0764006ce0 2023-11-28T13:01:05.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f076b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0764037710 0x7f07640de020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:05.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f076b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0764037710 0x7f07640de020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42508/0 (socket says 172.21.15.82:42508) 2023-11-28T13:01:05.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f076b7fe700 1 -- 172.21.15.82:0/204372045 learned_addr learned my addr 172.21.15.82:0/204372045 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:05.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f0770ade700 1 --2- 172.21.15.82:0/204372045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07640dc7f0 0x7f07640d8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:05.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f076bfff700 1 --2- 172.21.15.82:0/204372045 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0764006ce0 0x7f07640dad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:05.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f076b7fe700 1 -- 172.21.15.82:0/204372045 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0764006ce0 msgr2=0x7f07640dad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:05.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f076b7fe700 1 --2- 172.21.15.82:0/204372045 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0764006ce0 0x7f07640dad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f076b7fe700 1 -- 172.21.15.82:0/204372045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07640dc7f0 msgr2=0x7f07640d8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:05.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f076b7fe700 1 --2- 172.21.15.82:0/204372045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07640dc7f0 0x7f07640d8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f076b7fe700 1 -- 172.21.15.82:0/204372045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07640082c0 con 0x7f0764037710 2023-11-28T13:01:05.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f076bfff700 1 --2- 172.21.15.82:0/204372045 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0764006ce0 0x7f07640dad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:05.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f076b7fe700 1 --2- 172.21.15.82:0/204372045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0764037710 0x7f07640de020 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f075800e9a0 tx=0x7f075800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:05.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f0768ff9700 1 -- 172.21.15.82:0/204372045 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758009720 con 0x7f0764037710 2023-11-28T13:01:05.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f0768ff9700 1 -- 172.21.15.82:0/204372045 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075800c850 con 0x7f0764037710 2023-11-28T13:01:05.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f07712df700 1 -- 172.21.15.82:0/204372045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076404ffc0 con 0x7f0764037710 2023-11-28T13:01:05.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f0768ff9700 1 -- 172.21.15.82:0/204372045 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075800cc00 con 0x7f0764037710 2023-11-28T13:01:05.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.595+0000 7f07712df700 1 -- 172.21.15.82:0/204372045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07640dcbc0 con 0x7f0764037710 2023-11-28T13:01:05.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.599+0000 7f0768ff9700 1 -- 172.21.15.82:0/204372045 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0758019030 con 0x7f0764037710 2023-11-28T13:01:05.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.599+0000 7f07712df700 1 -- 172.21.15.82:0/204372045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07640059c0 con 0x7f0764037710 2023-11-28T13:01:05.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.599+0000 7f0768ff9700 1 --2- 172.21.15.82:0/204372045 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0750064ee0 0x7f0750067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:05.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.599+0000 7f0768ff9700 1 -- 172.21.15.82:0/204372045 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0758081f60 con 0x7f0764037710 2023-11-28T13:01:05.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.599+0000 7f076bfff700 1 --2- 172.21.15.82:0/204372045 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0750064ee0 0x7f0750067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:05.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.599+0000 7f076bfff700 1 --2- 172.21.15.82:0/204372045 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0750064ee0 0x7f0750067390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0760000f60 tx=0x7f0760009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:05.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.607+0000 7f0768ff9700 1 -- 172.21.15.82:0/204372045 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0758050010 con 0x7f0764037710 2023-11-28T13:01:05.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.767+0000 7f07712df700 1 -- 172.21.15.82:0/204372045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07640dd3a0 con 0x7f0764037710 2023-11-28T13:01:05.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.771+0000 7f0768ff9700 1 -- 172.21.15.82:0/204372045 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f07640dd3a0 con 0x7f0764037710 2023-11-28T13:01:05.775 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:01:05.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.771+0000 7f07712df700 1 -- 172.21.15.82:0/204372045 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0750064ee0 msgr2=0x7f0750067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:05.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.771+0000 7f07712df700 1 --2- 172.21.15.82:0/204372045 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0750064ee0 0x7f0750067390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0760000f60 tx=0x7f0760009040 comp rx=0 tx=0).stop 2023-11-28T13:01:05.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.771+0000 7f07712df700 1 -- 172.21.15.82:0/204372045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0764037710 msgr2=0x7f07640de020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:05.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.771+0000 7f07712df700 1 --2- 172.21.15.82:0/204372045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0764037710 0x7f07640de020 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f075800e9a0 tx=0x7f075800ecb0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.771+0000 7f07712df700 1 -- 172.21.15.82:0/204372045 shutdown_connections 2023-11-28T13:01:05.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.771+0000 7f07712df700 1 --2- 172.21.15.82:0/204372045 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0750064ee0 0x7f0750067390 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.771+0000 7f07712df700 1 --2- 172.21.15.82:0/204372045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07640dc7f0 0x7f07640d8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.771+0000 7f07712df700 1 --2- 172.21.15.82:0/204372045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0764037710 0x7f07640de020 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.771+0000 7f07712df700 1 --2- 172.21.15.82:0/204372045 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0764006ce0 0x7f07640dad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.771+0000 7f07712df700 1 -- 172.21.15.82:0/204372045 >> 172.21.15.82:0/204372045 conn(0x7f0764052000 msgr2=0x7f076404a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:05.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.771+0000 7f07712df700 1 -- 172.21.15.82:0/204372045 shutdown_connections 2023-11-28T13:01:05.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.771+0000 7f07712df700 1 -- 172.21.15.82:0/204372045 wait complete. 2023-11-28T13:01:05.790 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:01:05.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.899+0000 7fdce0b6f700 1 Processor -- start 2023-11-28T13:01:05.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.899+0000 7fdce0b6f700 1 -- start start 2023-11-28T13:01:05.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.899+0000 7fdce0b6f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdcdc0b1f30 0x7fdcdc0d2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:05.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.899+0000 7fdce0b6f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdcdc06ba30 0x7fdcdc06be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:05.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.899+0000 7fdce0b6f700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcdc0d1050 con 0x7fdcdc069bc0 2023-11-28T13:01:05.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.899+0000 7fdce0b6f700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcdc0b2300 con 0x7fdcdc0b1f30 2023-11-28T13:01:05.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.899+0000 7fdce0b6f700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcdc06c3a0 con 0x7fdcdc06ba30 2023-11-28T13:01:05.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.899+0000 7fdcdbfff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdcdc069bc0 0x7fdcdc069fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58434/0 (socket says 172.21.15.82:58434) 2023-11-28T13:01:05.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.899+0000 7fdcdbfff700 1 -- 172.21.15.82:0/3125414717 learned_addr learned my addr 172.21.15.82:0/3125414717 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:05.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.899+0000 7fdcdb7fe700 1 --2- 172.21.15.82:0/3125414717 >> v2:172.21.15.82:3300/0 conn(0x7fdcdc0b1f30 0x7fdcdc0d2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:05.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.899+0000 7fdcdaffd700 1 --2- 172.21.15.82:0/3125414717 >> v2:172.21.15.114:3300/0 conn(0x7fdcdc06ba30 0x7fdcdc06be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:05.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.899+0000 7fdcda7fc700 1 -- 172.21.15.82:0/3125414717 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207567759 0 0) 0x7fdcdc0d1050 con 0x7fdcdc069bc0 2023-11-28T13:01:05.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.899+0000 7fdcda7fc700 1 -- 172.21.15.82:0/3125414717 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcc40035d0 con 0x7fdcdc069bc0 2023-11-28T13:01:05.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.899+0000 7fdcdb7fe700 1 -- 172.21.15.82:0/3125414717 >> v2:172.21.15.114:3300/0 conn(0x7fdcdc06ba30 msgr2=0x7fdcdc06be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:05.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.899+0000 7fdcdb7fe700 1 --2- 172.21.15.82:0/3125414717 >> v2:172.21.15.114:3300/0 conn(0x7fdcdc06ba30 0x7fdcdc06be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.899+0000 7fdcdb7fe700 1 -- 172.21.15.82:0/3125414717 >> v1:172.21.15.82:6789/0 conn(0x7fdcdc069bc0 legacy=0x7fdcdc069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:05.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.899+0000 7fdcdb7fe700 1 -- 172.21.15.82:0/3125414717 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc0cd0c0 con 0x7fdcdc0b1f30 2023-11-28T13:01:05.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.903+0000 7fdcdb7fe700 1 --2- 172.21.15.82:0/3125414717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc0b1f30 0x7fdcdc0d2290 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0d32a0 tx=0x7fdcd0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2807f087a2969f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:05.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.903+0000 7fdcda7fc700 1 -- 172.21.15.82:0/3125414717 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0011830 con 0x7fdcdc0b1f30 2023-11-28T13:01:05.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.903+0000 7fdcda7fc700 1 -- 172.21.15.82:0/3125414717 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd0011990 con 0x7fdcdc0b1f30 2023-11-28T13:01:05.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.903+0000 7fdcda7fc700 1 -- 172.21.15.82:0/3125414717 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0011d20 con 0x7fdcdc0b1f30 2023-11-28T13:01:05.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.903+0000 7fdce0b6f700 1 -- 172.21.15.82:0/3125414717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc0b1f30 msgr2=0x7fdcdc0d2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:05.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.903+0000 7fdce0b6f700 1 --2- 172.21.15.82:0/3125414717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc0b1f30 0x7fdcdc0d2290 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0d32a0 tx=0x7fdcd0009b30 comp rx=0 tx=0).stop 2023-11-28T13:01:05.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.903+0000 7fdce0b6f700 1 -- 172.21.15.82:0/3125414717 shutdown_connections 2023-11-28T13:01:05.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.903+0000 7fdce0b6f700 1 --2- 172.21.15.82:0/3125414717 >> v2:172.21.15.114:3300/0 conn(0x7fdcdc06ba30 0x7fdcdc06be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.903+0000 7fdce0b6f700 1 --2- 172.21.15.82:0/3125414717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc0b1f30 0x7fdcdc0d2290 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.903+0000 7fdce0b6f700 1 -- 172.21.15.82:0/3125414717 >> 172.21.15.82:0/3125414717 conn(0x7fdcdc0b52d0 msgr2=0x7fdcdc0d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:05.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.903+0000 7fdce0b6f700 1 -- 172.21.15.82:0/3125414717 shutdown_connections 2023-11-28T13:01:05.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.903+0000 7fdce0b6f700 1 -- 172.21.15.82:0/3125414717 wait complete. 2023-11-28T13:01:05.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.903+0000 7fdce0b6f700 1 Processor -- start 2023-11-28T13:01:05.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdce0b6f700 1 -- start start 2023-11-28T13:01:05.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdce0b6f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdcdc069bc0 0x7fdcdc0cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:05.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdce0b6f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcdc06ba30 0x7fdcdc155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:05.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdce0b6f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc1f4fe0 0x7fdcdc1528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:05.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdce0b6f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0caa80 con 0x7fdcdc1f4fe0 2023-11-28T13:01:05.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdce0b6f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0cad60 con 0x7fdcdc06ba30 2023-11-28T13:01:05.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdce0b6f700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0cb040 con 0x7fdcdc069bc0 2023-11-28T13:01:05.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdcdbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc1f4fe0 0x7fdcdc1528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:05.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdcdbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc1f4fe0 0x7fdcdc1528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42528/0 (socket says 172.21.15.82:42528) 2023-11-28T13:01:05.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdcdbfff700 1 -- 172.21.15.82:0/2024317600 learned_addr learned my addr 172.21.15.82:0/2024317600 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:05.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdcdb7fe700 1 --2- 172.21.15.82:0/2024317600 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdcdc069bc0 0x7fdcdc0cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:05.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdcdaffd700 1 --2- 172.21.15.82:0/2024317600 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcdc06ba30 0x7fdcdc155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:05.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdcdbfff700 1 -- 172.21.15.82:0/2024317600 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdcdc069bc0 msgr2=0x7fdcdc0cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:05.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdcdbfff700 1 --2- 172.21.15.82:0/2024317600 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdcdc069bc0 0x7fdcdc0cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdcdbfff700 1 -- 172.21.15.82:0/2024317600 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcdc06ba30 msgr2=0x7fdcdc155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:05.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdcdbfff700 1 --2- 172.21.15.82:0/2024317600 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcdc06ba30 0x7fdcdc155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:05.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdcdbfff700 1 -- 172.21.15.82:0/2024317600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd00094b0 con 0x7fdcdc1f4fe0 2023-11-28T13:01:05.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdcdaffd700 1 --2- 172.21.15.82:0/2024317600 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcdc06ba30 0x7fdcdc155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:05.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdcdb7fe700 1 --2- 172.21.15.82:0/2024317600 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdcdc069bc0 0x7fdcdc0cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:05.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdcdbfff700 1 --2- 172.21.15.82:0/2024317600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc1f4fe0 0x7fdcdc1528d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400caa0 tx=0x7fdcd400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:05.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdcc3fff700 1 -- 172.21.15.82:0/2024317600 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd400a7b0 con 0x7fdcdc1f4fe0 2023-11-28T13:01:05.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdcc3fff700 1 -- 172.21.15.82:0/2024317600 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd400a910 con 0x7fdcdc1f4fe0 2023-11-28T13:01:05.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdcc3fff700 1 -- 172.21.15.82:0/2024317600 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd400aca0 con 0x7fdcdc1f4fe0 2023-11-28T13:01:05.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdce0b6f700 1 -- 172.21.15.82:0/2024317600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcdc0d1580 con 0x7fdcdc1f4fe0 2023-11-28T13:01:05.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.907+0000 7fdce0b6f700 1 -- 172.21.15.82:0/2024317600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcdc0d12a0 con 0x7fdcdc1f4fe0 2023-11-28T13:01:05.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.911+0000 7fdce0b6f700 1 -- 172.21.15.82:0/2024317600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcdc0cd380 con 0x7fdcdc1f4fe0 2023-11-28T13:01:05.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.911+0000 7fdcc3fff700 1 -- 172.21.15.82:0/2024317600 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdcd4019030 con 0x7fdcdc1f4fe0 2023-11-28T13:01:05.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.911+0000 7fdcc3fff700 1 --2- 172.21.15.82:0/2024317600 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdcc8064ee0 0x7fdcc8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:05.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.911+0000 7fdcdb7fe700 1 --2- 172.21.15.82:0/2024317600 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdcc8064ee0 0x7fdcc8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:05.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.911+0000 7fdcc3fff700 1 -- 172.21.15.82:0/2024317600 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdcd40818e0 con 0x7fdcdc1f4fe0 2023-11-28T13:01:05.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.911+0000 7fdcdb7fe700 1 --2- 172.21.15.82:0/2024317600 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdcc8064ee0 0x7fdcc8067390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc08ba00 tx=0x7fdcd0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:05.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:05.915+0000 7fdcc3fff700 1 -- 172.21.15.82:0/2024317600 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdcd404f990 con 0x7fdcdc1f4fe0 2023-11-28T13:01:06.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.083+0000 7fdce0b6f700 1 -- 172.21.15.82:0/2024317600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdcdc0cdce0 con 0x7fdcdc1f4fe0 2023-11-28T13:01:06.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.083+0000 7fdcc3fff700 1 -- 172.21.15.82:0/2024317600 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdcd4017020 con 0x7fdcdc1f4fe0 2023-11-28T13:01:06.087 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:01:06.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.087+0000 7fdce0b6f700 1 -- 172.21.15.82:0/2024317600 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdcc8064ee0 msgr2=0x7fdcc8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:06.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.087+0000 7fdce0b6f700 1 --2- 172.21.15.82:0/2024317600 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdcc8064ee0 0x7fdcc8067390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc08ba00 tx=0x7fdcd0008030 comp rx=0 tx=0).stop 2023-11-28T13:01:06.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.087+0000 7fdce0b6f700 1 -- 172.21.15.82:0/2024317600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc1f4fe0 msgr2=0x7fdcdc1528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:06.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.087+0000 7fdce0b6f700 1 --2- 172.21.15.82:0/2024317600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc1f4fe0 0x7fdcdc1528d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400caa0 tx=0x7fdcd400cb80 comp rx=0 tx=0).stop 2023-11-28T13:01:06.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.087+0000 7fdce0b6f700 1 -- 172.21.15.82:0/2024317600 shutdown_connections 2023-11-28T13:01:06.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.087+0000 7fdce0b6f700 1 --2- 172.21.15.82:0/2024317600 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdcc8064ee0 0x7fdcc8067390 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.087+0000 7fdce0b6f700 1 --2- 172.21.15.82:0/2024317600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc1f4fe0 0x7fdcdc1528d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.087+0000 7fdce0b6f700 1 --2- 172.21.15.82:0/2024317600 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcdc06ba30 0x7fdcdc155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.087+0000 7fdce0b6f700 1 --2- 172.21.15.82:0/2024317600 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdcdc069bc0 0x7fdcdc0cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.087+0000 7fdce0b6f700 1 -- 172.21.15.82:0/2024317600 >> 172.21.15.82:0/2024317600 conn(0x7fdcdc0b52d0 msgr2=0x7fdcdc0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:06.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.087+0000 7fdce0b6f700 1 -- 172.21.15.82:0/2024317600 shutdown_connections 2023-11-28T13:01:06.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.087+0000 7fdce0b6f700 1 -- 172.21.15.82:0/2024317600 wait complete. 2023-11-28T13:01:06.109 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T13:01:06.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.219+0000 7f5e00ffd700 1 Processor -- start 2023-11-28T13:01:06.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.219+0000 7f5e00ffd700 1 -- start start 2023-11-28T13:01:06.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.219+0000 7f5e00ffd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5dfc06c140 0x7f5dfc0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:06.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.219+0000 7f5e00ffd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dfc069bc0 con 0x7f5dfc0b1d10 2023-11-28T13:01:06.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.219+0000 7f5e00ffd700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dfc0d1480 con 0x7f5dfc0d25b0 2023-11-28T13:01:06.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.219+0000 7f5e00ffd700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dfc0cd280 con 0x7f5dfc06c140 2023-11-28T13:01:06.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.219+0000 7f5dfb7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5dfc0b1d10 0x7f5dfc06ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58446/0 (socket says 172.21.15.82:58446) 2023-11-28T13:01:06.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.219+0000 7f5dfb7fe700 1 -- 172.21.15.82:0/2019901641 learned_addr learned my addr 172.21.15.82:0/2019901641 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:06.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.219+0000 7f5dfaffd700 1 --2- 172.21.15.82:0/2019901641 >> v2:172.21.15.114:3300/0 conn(0x7f5dfc06c140 0x7f5dfc0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:06.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.219+0000 7f5dfa7fc700 1 -- 172.21.15.82:0/2019901641 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803665531 0 0) 0x7f5dfc069bc0 con 0x7f5dfc0b1d10 2023-11-28T13:01:06.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.219+0000 7f5dfa7fc700 1 -- 172.21.15.82:0/2019901641 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5de40035d0 con 0x7f5dfc0b1d10 2023-11-28T13:01:06.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.219+0000 7f5dfaffd700 1 -- 172.21.15.82:0/2019901641 >> v1:172.21.15.114:6789/0 conn(0x7f5dfc0d25b0 legacy=0x7f5dfc06a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:06.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.219+0000 7f5dfaffd700 1 -- 172.21.15.82:0/2019901641 >> v1:172.21.15.82:6789/0 conn(0x7f5dfc0b1d10 legacy=0x7f5dfc06ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:06.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.219+0000 7f5dfaffd700 1 -- 172.21.15.82:0/2019901641 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc0cd560 con 0x7f5dfc06c140 2023-11-28T13:01:06.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.219+0000 7f5dfaffd700 1 --2- 172.21.15.82:0/2019901641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dfc06c140 0x7f5dfc0cec20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009850 tx=0x7f5df0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beb94e43f4a03c7b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:06.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.219+0000 7f5dfa7fc700 1 -- 172.21.15.82:0/2019901641 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0011830 con 0x7f5dfc06c140 2023-11-28T13:01:06.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.219+0000 7f5dfa7fc700 1 -- 172.21.15.82:0/2019901641 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df0011990 con 0x7f5dfc06c140 2023-11-28T13:01:06.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.219+0000 7f5dfa7fc700 1 -- 172.21.15.82:0/2019901641 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0011d40 con 0x7f5dfc06c140 2023-11-28T13:01:06.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.223+0000 7f5e00ffd700 1 -- 172.21.15.82:0/2019901641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dfc06c140 msgr2=0x7f5dfc0cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:06.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.223+0000 7f5e00ffd700 1 --2- 172.21.15.82:0/2019901641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dfc06c140 0x7f5dfc0cec20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009850 tx=0x7f5df0009b60 comp rx=0 tx=0).stop 2023-11-28T13:01:06.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.223+0000 7f5e00ffd700 1 -- 172.21.15.82:0/2019901641 shutdown_connections 2023-11-28T13:01:06.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.223+0000 7f5e00ffd700 1 --2- 172.21.15.82:0/2019901641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dfc06c140 0x7f5dfc0cec20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.223+0000 7f5e00ffd700 1 -- 172.21.15.82:0/2019901641 >> 172.21.15.82:0/2019901641 conn(0x7f5dfc0b52a0 msgr2=0x7f5dfc0d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:06.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.223+0000 7f5e00ffd700 1 -- 172.21.15.82:0/2019901641 shutdown_connections 2023-11-28T13:01:06.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.223+0000 7f5e00ffd700 1 -- 172.21.15.82:0/2019901641 wait complete. 2023-11-28T13:01:06.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.223+0000 7f5e00ffd700 1 Processor -- start 2023-11-28T13:01:06.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.223+0000 7f5e00ffd700 1 -- start start 2023-11-28T13:01:06.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5e00ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dfc06c140 0x7f5dfc150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:06.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5e00ffd700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5dfc0b1d10 0x7f5dfc0cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:06.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5e00ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc0d25b0 0x7f5dfc0d2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:06.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5e00ffd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc1513a0 con 0x7f5dfc0d25b0 2023-11-28T13:01:06.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5e00ffd700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc0cc920 con 0x7f5dfc06c140 2023-11-28T13:01:06.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5e00ffd700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc15cc60 con 0x7f5dfc0b1d10 2023-11-28T13:01:06.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5dfbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc0d25b0 0x7f5dfc0d2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:06.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5dfbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc0d25b0 0x7f5dfc0d2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42544/0 (socket says 172.21.15.82:42544) 2023-11-28T13:01:06.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5dfbfff700 1 -- 172.21.15.82:0/2193460358 learned_addr learned my addr 172.21.15.82:0/2193460358 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:06.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5dfb7fe700 1 --2- 172.21.15.82:0/2193460358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dfc06c140 0x7f5dfc150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:06.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5dfaffd700 1 --2- 172.21.15.82:0/2193460358 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5dfc0b1d10 0x7f5dfc0cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:06.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5dfbfff700 1 -- 172.21.15.82:0/2193460358 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5dfc0b1d10 msgr2=0x7f5dfc0cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:06.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5dfbfff700 1 --2- 172.21.15.82:0/2193460358 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5dfc0b1d10 0x7f5dfc0cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5dfbfff700 1 -- 172.21.15.82:0/2193460358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dfc06c140 msgr2=0x7f5dfc150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:06.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5dfbfff700 1 --2- 172.21.15.82:0/2193460358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dfc06c140 0x7f5dfc150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5dfbfff700 1 -- 172.21.15.82:0/2193460358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df00094b0 con 0x7f5dfc0d25b0 2023-11-28T13:01:06.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5dfbfff700 1 --2- 172.21.15.82:0/2193460358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc0d25b0 0x7f5dfc0d2a00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5df400cb10 tx=0x7f5df400ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:06.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5de3fff700 1 -- 172.21.15.82:0/2193460358 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4003c20 con 0x7f5dfc0d25b0 2023-11-28T13:01:06.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5de3fff700 1 -- 172.21.15.82:0/2193460358 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df4003d80 con 0x7f5dfc0d25b0 2023-11-28T13:01:06.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5e00ffd700 1 -- 172.21.15.82:0/2193460358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dfc0d1050 con 0x7f5dfc0d25b0 2023-11-28T13:01:06.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5de3fff700 1 -- 172.21.15.82:0/2193460358 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df400aa20 con 0x7f5dfc0d25b0 2023-11-28T13:01:06.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.227+0000 7f5e00ffd700 1 -- 172.21.15.82:0/2193460358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dfc0b20e0 con 0x7f5dfc0d25b0 2023-11-28T13:01:06.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.231+0000 7f5de3fff700 1 -- 172.21.15.82:0/2193460358 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5df4010050 con 0x7f5dfc0d25b0 2023-11-28T13:01:06.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.231+0000 7f5e00ffd700 1 -- 172.21.15.82:0/2193460358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dfc0d11e0 con 0x7f5dfc0d25b0 2023-11-28T13:01:06.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.231+0000 7f5de3fff700 1 --2- 172.21.15.82:0/2193460358 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5de8064ee0 0x7f5de8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:06.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.231+0000 7f5de3fff700 1 -- 172.21.15.82:0/2193460358 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5df4081ca0 con 0x7f5dfc0d25b0 2023-11-28T13:01:06.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.231+0000 7f5dfb7fe700 1 --2- 172.21.15.82:0/2193460358 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5de8064ee0 0x7f5de8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:06.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.231+0000 7f5dfb7fe700 1 --2- 172.21.15.82:0/2193460358 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5de8064ee0 0x7f5de8067390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5dec007fd0 tx=0x7f5dec007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:06.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.239+0000 7f5de3fff700 1 -- 172.21.15.82:0/2193460358 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5df404fd50 con 0x7f5dfc0d25b0 2023-11-28T13:01:06.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.399+0000 7f5e00ffd700 1 -- 172.21.15.82:0/2193460358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5dfc065fc0 con 0x7f5dfc0d25b0 2023-11-28T13:01:06.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.399+0000 7f5de3fff700 1 -- 172.21.15.82:0/2193460358 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5df4053370 con 0x7f5dfc0d25b0 2023-11-28T13:01:06.405 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-11-28T13:01:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.403+0000 7f5e00ffd700 1 -- 172.21.15.82:0/2193460358 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5de8064ee0 msgr2=0x7f5de8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.403+0000 7f5e00ffd700 1 --2- 172.21.15.82:0/2193460358 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5de8064ee0 0x7f5de8067390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5dec007fd0 tx=0x7f5dec007de0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.403+0000 7f5e00ffd700 1 -- 172.21.15.82:0/2193460358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc0d25b0 msgr2=0x7f5dfc0d2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.403+0000 7f5e00ffd700 1 --2- 172.21.15.82:0/2193460358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc0d25b0 0x7f5dfc0d2a00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5df400cb10 tx=0x7f5df400ce20 comp rx=0 tx=0).stop 2023-11-28T13:01:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.403+0000 7f5e00ffd700 1 -- 172.21.15.82:0/2193460358 shutdown_connections 2023-11-28T13:01:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.403+0000 7f5e00ffd700 1 --2- 172.21.15.82:0/2193460358 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5de8064ee0 0x7f5de8067390 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.403+0000 7f5e00ffd700 1 --2- 172.21.15.82:0/2193460358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc0d25b0 0x7f5dfc0d2a00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.403+0000 7f5e00ffd700 1 --2- 172.21.15.82:0/2193460358 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5dfc0b1d10 0x7f5dfc0cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.403+0000 7f5e00ffd700 1 --2- 172.21.15.82:0/2193460358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dfc06c140 0x7f5dfc150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.403+0000 7f5e00ffd700 1 -- 172.21.15.82:0/2193460358 >> 172.21.15.82:0/2193460358 conn(0x7f5dfc0b52a0 msgr2=0x7f5dfc06ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.403+0000 7f5e00ffd700 1 -- 172.21.15.82:0/2193460358 shutdown_connections 2023-11-28T13:01:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.403+0000 7f5e00ffd700 1 -- 172.21.15.82:0/2193460358 wait complete. 2023-11-28T13:01:06.420 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T13:01:06.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.535+0000 7f12553fd700 1 Processor -- start 2023-11-28T13:01:06.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.535+0000 7f12553fd700 1 -- start start 2023-11-28T13:01:06.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.535+0000 7f12553fd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f12480e29f0 0x7f1248055490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:06.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.535+0000 7f12553fd700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1248038560 0x7f124803ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:06.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.535+0000 7f12553fd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1248007360 con 0x7f124803b160 2023-11-28T13:01:06.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.535+0000 7f12553fd700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f124803b600 con 0x7f12480e29f0 2023-11-28T13:01:06.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.535+0000 7f12553fd700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12480e2dc0 con 0x7f1248038560 2023-11-28T13:01:06.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.535+0000 7f1254bfc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f124803b160 0x7f12480e64c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58462/0 (socket says 172.21.15.82:58462) 2023-11-28T13:01:06.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.535+0000 7f124ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f12480e29f0 0x7f1248055490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:06.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.535+0000 7f1254bfc700 1 -- 172.21.15.82:0/2334092324 learned_addr learned my addr 172.21.15.82:0/2334092324 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:06.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.535+0000 7f124f7fe700 1 --2- 172.21.15.82:0/2334092324 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1248038560 0x7f124803ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:06.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.535+0000 7f124ffff700 1 -- 172.21.15.82:0/2334092324 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1248038560 msgr2=0x7f124803ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:06.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.535+0000 7f124ffff700 1 --2- 172.21.15.82:0/2334092324 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1248038560 0x7f124803ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.535+0000 7f124ffff700 1 -- 172.21.15.82:0/2334092324 >> v1:172.21.15.82:6789/0 conn(0x7f124803b160 legacy=0x7f12480e64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:06.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.535+0000 7f124ffff700 1 -- 172.21.15.82:0/2334092324 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1248053f70 con 0x7f12480e29f0 2023-11-28T13:01:06.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.535+0000 7f124ffff700 1 --2- 172.21.15.82:0/2334092324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12480e29f0 0x7f1248055490 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1240009880 tx=0x7f1240009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa72b75f192c3e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:06.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.535+0000 7f124effd700 1 -- 172.21.15.82:0/2334092324 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1240011830 con 0x7f12480e29f0 2023-11-28T13:01:06.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.535+0000 7f124effd700 1 -- 172.21.15.82:0/2334092324 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1240011990 con 0x7f12480e29f0 2023-11-28T13:01:06.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.535+0000 7f124effd700 1 -- 172.21.15.82:0/2334092324 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1240011d20 con 0x7f12480e29f0 2023-11-28T13:01:06.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.539+0000 7f12553fd700 1 -- 172.21.15.82:0/2334092324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12480e29f0 msgr2=0x7f1248055490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:06.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.539+0000 7f12553fd700 1 --2- 172.21.15.82:0/2334092324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12480e29f0 0x7f1248055490 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1240009880 tx=0x7f1240009b90 comp rx=0 tx=0).stop 2023-11-28T13:01:06.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.539+0000 7f12553fd700 1 -- 172.21.15.82:0/2334092324 shutdown_connections 2023-11-28T13:01:06.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.539+0000 7f12553fd700 1 --2- 172.21.15.82:0/2334092324 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1248038560 0x7f124803ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.539+0000 7f12553fd700 1 --2- 172.21.15.82:0/2334092324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12480e29f0 0x7f1248055490 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.539+0000 7f12553fd700 1 -- 172.21.15.82:0/2334092324 >> 172.21.15.82:0/2334092324 conn(0x7f1248055c20 msgr2=0x7f1248056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:06.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.539+0000 7f12553fd700 1 -- 172.21.15.82:0/2334092324 shutdown_connections 2023-11-28T13:01:06.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.539+0000 7f12553fd700 1 -- 172.21.15.82:0/2334092324 wait complete. 2023-11-28T13:01:06.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.539+0000 7f12553fd700 1 Processor -- start 2023-11-28T13:01:06.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.539+0000 7f12553fd700 1 -- start start 2023-11-28T13:01:06.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.539+0000 7f12553fd700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1248038560 0x7f1248052f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:06.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f12553fd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f124803b160 0x7f1248038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:06.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f12553fd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12480e29f0 0x7f12480d20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:06.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f12553fd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124817c010 con 0x7f124803b160 2023-11-28T13:01:06.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f12553fd700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124817c2f0 con 0x7f12480e29f0 2023-11-28T13:01:06.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f12553fd700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124817c5d0 con 0x7f1248038560 2023-11-28T13:01:06.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f124f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f124803b160 0x7f1248038c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:06.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f124f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f124803b160 0x7f1248038c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42556/0 (socket says 172.21.15.82:42556) 2023-11-28T13:01:06.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f124f7fe700 1 -- 172.21.15.82:0/2812109024 learned_addr learned my addr 172.21.15.82:0/2812109024 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:06.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f124ffff700 1 --2- 172.21.15.82:0/2812109024 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1248038560 0x7f1248052f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:06.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f1254bfc700 1 --2- 172.21.15.82:0/2812109024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12480e29f0 0x7f12480d20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:06.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f124f7fe700 1 -- 172.21.15.82:0/2812109024 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1248038560 msgr2=0x7f1248052f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:06.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f124f7fe700 1 --2- 172.21.15.82:0/2812109024 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1248038560 0x7f1248052f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f124f7fe700 1 -- 172.21.15.82:0/2812109024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12480e29f0 msgr2=0x7f12480d20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:06.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f124f7fe700 1 --2- 172.21.15.82:0/2812109024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12480e29f0 0x7f12480d20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f124f7fe700 1 -- 172.21.15.82:0/2812109024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12400094b0 con 0x7f124803b160 2023-11-28T13:01:06.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f124f7fe700 1 --2- 172.21.15.82:0/2812109024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f124803b160 0x7f1248038c20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f124400e9a0 tx=0x7f124400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:06.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f124cff9700 1 -- 172.21.15.82:0/2812109024 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244009720 con 0x7f124803b160 2023-11-28T13:01:06.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f124cff9700 1 -- 172.21.15.82:0/2812109024 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124400c690 con 0x7f124803b160 2023-11-28T13:01:06.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f12553fd700 1 -- 172.21.15.82:0/2812109024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1248007080 con 0x7f124803b160 2023-11-28T13:01:06.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f124cff9700 1 -- 172.21.15.82:0/2812109024 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124400ca40 con 0x7f124803b160 2023-11-28T13:01:06.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f12553fd700 1 -- 172.21.15.82:0/2812109024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1248006dc0 con 0x7f124803b160 2023-11-28T13:01:06.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.543+0000 7f12553fd700 1 -- 172.21.15.82:0/2812109024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1248053920 con 0x7f124803b160 2023-11-28T13:01:06.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.547+0000 7f124cff9700 1 -- 172.21.15.82:0/2812109024 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1244019030 con 0x7f124803b160 2023-11-28T13:01:06.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.547+0000 7f124cff9700 1 --2- 172.21.15.82:0/2812109024 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f123c064ee0 0x7f123c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:06.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.547+0000 7f124cff9700 1 -- 172.21.15.82:0/2812109024 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1244081df0 con 0x7f124803b160 2023-11-28T13:01:06.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.547+0000 7f124ffff700 1 --2- 172.21.15.82:0/2812109024 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f123c064ee0 0x7f123c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:06.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.547+0000 7f124ffff700 1 --2- 172.21.15.82:0/2812109024 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f123c064ee0 0x7f123c067390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1240000c00 tx=0x7f1240008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:06.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.559+0000 7f124cff9700 1 -- 172.21.15.82:0/2812109024 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f124404feb0 con 0x7f124803b160 2023-11-28T13:01:06.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.719+0000 7f12553fd700 1 -- 172.21.15.82:0/2812109024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1248005570 con 0x7f124803b160 2023-11-28T13:01:06.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.719+0000 7f124cff9700 1 -- 172.21.15.82:0/2812109024 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f12440534d0 con 0x7f124803b160 2023-11-28T13:01:06.726 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-11-28T13:01:06.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.723+0000 7f12553fd700 1 -- 172.21.15.82:0/2812109024 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f123c064ee0 msgr2=0x7f123c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:06.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.723+0000 7f12553fd700 1 --2- 172.21.15.82:0/2812109024 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f123c064ee0 0x7f123c067390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1240000c00 tx=0x7f1240008030 comp rx=0 tx=0).stop 2023-11-28T13:01:06.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.723+0000 7f12553fd700 1 -- 172.21.15.82:0/2812109024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f124803b160 msgr2=0x7f1248038c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:06.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.723+0000 7f12553fd700 1 --2- 172.21.15.82:0/2812109024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f124803b160 0x7f1248038c20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f124400e9a0 tx=0x7f124400ecb0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.723+0000 7f12553fd700 1 -- 172.21.15.82:0/2812109024 shutdown_connections 2023-11-28T13:01:06.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.723+0000 7f12553fd700 1 --2- 172.21.15.82:0/2812109024 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f123c064ee0 0x7f123c067390 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.723+0000 7f12553fd700 1 --2- 172.21.15.82:0/2812109024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12480e29f0 0x7f12480d20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.723+0000 7f12553fd700 1 --2- 172.21.15.82:0/2812109024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f124803b160 0x7f1248038c20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.723+0000 7f12553fd700 1 --2- 172.21.15.82:0/2812109024 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1248038560 0x7f1248052f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.723+0000 7f12553fd700 1 -- 172.21.15.82:0/2812109024 >> 172.21.15.82:0/2812109024 conn(0x7f1248055c20 msgr2=0x7f124803a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:06.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.723+0000 7f12553fd700 1 -- 172.21.15.82:0/2812109024 shutdown_connections 2023-11-28T13:01:06.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.723+0000 7f12553fd700 1 -- 172.21.15.82:0/2812109024 wait complete. 2023-11-28T13:01:06.746 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T13:01:06.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85b59e700 1 Processor -- start 2023-11-28T13:01:06.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85b59e700 1 -- start start 2023-11-28T13:01:06.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85b59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe85c15c1c0 0x7fe85c0c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:06.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85b59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe85c06dae0 0x7fe85c0ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:06.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85b59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe85c0cd2e0 con 0x7fe85c0ca4b0 2023-11-28T13:01:06.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85b59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe85c0ca9c0 con 0x7fe85c15c1c0 2023-11-28T13:01:06.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85b59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c0cd530 con 0x7fe85c06dae0 2023-11-28T13:01:06.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85a59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe85c15c1c0 0x7fe85c0c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:06.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85a59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe85c15c1c0 0x7fe85c0c9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40214/0 (socket says 172.21.15.82:40214) 2023-11-28T13:01:06.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85a59c700 1 -- 172.21.15.82:0/4155079845 learned_addr learned my addr 172.21.15.82:0/4155079845 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:06.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85ad9d700 1 --2- 172.21.15.82:0/4155079845 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe85c06dae0 0x7fe85c0ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:06.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85a59c700 1 -- 172.21.15.82:0/4155079845 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe85c06dae0 msgr2=0x7fe85c0ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:06.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85a59c700 1 --2- 172.21.15.82:0/4155079845 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe85c06dae0 0x7fe85c0ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85a59c700 1 -- 172.21.15.82:0/4155079845 >> v1:172.21.15.114:6789/0 conn(0x7fe85c0ca4b0 legacy=0x7fe85c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:06.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85a59c700 1 -- 172.21.15.82:0/4155079845 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85c0cd810 con 0x7fe85c15c1c0 2023-11-28T13:01:06.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85959a700 1 -- 172.21.15.82:0/4155079845 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322724897 0 0) 0x7fe85c0cd2e0 con 0x7fe85c0ca4b0 2023-11-28T13:01:06.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85a59c700 1 --2- 172.21.15.82:0/4155079845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85c15c1c0 0x7fe85c0c9f70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe850009910 tx=0x7fe850009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384d85acf1d0e80f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:06.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85959a700 1 -- 172.21.15.82:0/4155079845 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe850011830 con 0x7fe85c15c1c0 2023-11-28T13:01:06.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85959a700 1 -- 172.21.15.82:0/4155079845 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe850011990 con 0x7fe85c15c1c0 2023-11-28T13:01:06.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85959a700 1 -- 172.21.15.82:0/4155079845 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe850011d40 con 0x7fe85c15c1c0 2023-11-28T13:01:06.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85b59e700 1 -- 172.21.15.82:0/4155079845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85c15c1c0 msgr2=0x7fe85c0c9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:06.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85b59e700 1 --2- 172.21.15.82:0/4155079845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85c15c1c0 0x7fe85c0c9f70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe850009910 tx=0x7fe850009c20 comp rx=0 tx=0).stop 2023-11-28T13:01:06.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85b59e700 1 -- 172.21.15.82:0/4155079845 shutdown_connections 2023-11-28T13:01:06.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85b59e700 1 --2- 172.21.15.82:0/4155079845 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe85c06dae0 0x7fe85c0ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85b59e700 1 --2- 172.21.15.82:0/4155079845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85c15c1c0 0x7fe85c0c9f70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85b59e700 1 -- 172.21.15.82:0/4155079845 >> 172.21.15.82:0/4155079845 conn(0x7fe85c0cf710 msgr2=0x7fe85c0cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:06.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85b59e700 1 -- 172.21.15.82:0/4155079845 shutdown_connections 2023-11-28T13:01:06.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.855+0000 7fe85b59e700 1 -- 172.21.15.82:0/4155079845 wait complete. 2023-11-28T13:01:06.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe85b59e700 1 Processor -- start 2023-11-28T13:01:06.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe85b59e700 1 -- start start 2023-11-28T13:01:06.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe85b59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe85c06dae0 0x7fe85c149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:06.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe85b59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe85c0ca4b0 0x7fe85c15dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:06.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe85b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85c15c1c0 0x7fe85c0b2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:06.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe85b59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c15e610 con 0x7fe85c15c1c0 2023-11-28T13:01:06.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe85b59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c0b4550 con 0x7fe85c06dae0 2023-11-28T13:01:06.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe85b59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c0b4830 con 0x7fe85c0ca4b0 2023-11-28T13:01:06.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe85ad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85c15c1c0 0x7fe85c0b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:06.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe85ad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85c15c1c0 0x7fe85c0b2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40226/0 (socket says 172.21.15.82:40226) 2023-11-28T13:01:06.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe85ad9d700 1 -- 172.21.15.82:0/250322168 learned_addr learned my addr 172.21.15.82:0/250322168 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:06.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe859d9b700 1 --2- 172.21.15.82:0/250322168 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe85c0ca4b0 0x7fe85c15dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:06.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe85a59c700 1 --2- 172.21.15.82:0/250322168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe85c06dae0 0x7fe85c149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:06.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe85ad9d700 1 -- 172.21.15.82:0/250322168 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe85c0ca4b0 msgr2=0x7fe85c15dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:06.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe85ad9d700 1 --2- 172.21.15.82:0/250322168 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe85c0ca4b0 0x7fe85c15dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe85ad9d700 1 -- 172.21.15.82:0/250322168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe85c06dae0 msgr2=0x7fe85c149f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:06.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe85ad9d700 1 --2- 172.21.15.82:0/250322168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe85c06dae0 0x7fe85c149f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:06.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe85ad9d700 1 -- 172.21.15.82:0/250322168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe850009570 con 0x7fe85c15c1c0 2023-11-28T13:01:06.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe85ad9d700 1 --2- 172.21.15.82:0/250322168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85c15c1c0 0x7fe85c0b2540 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe85400e750 tx=0x7fe85400ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:06.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe84affd700 1 -- 172.21.15.82:0/250322168 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854009560 con 0x7fe85c15c1c0 2023-11-28T13:01:06.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe85b59e700 1 -- 172.21.15.82:0/250322168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe85c15c590 con 0x7fe85c15c1c0 2023-11-28T13:01:06.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe84affd700 1 -- 172.21.15.82:0/250322168 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe854013680 con 0x7fe85c15c1c0 2023-11-28T13:01:06.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe85b59e700 1 -- 172.21.15.82:0/250322168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85c0cdaf0 con 0x7fe85c15c1c0 2023-11-28T13:01:06.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.859+0000 7fe84affd700 1 -- 172.21.15.82:0/250322168 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854005c40 con 0x7fe85c15c1c0 2023-11-28T13:01:06.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.863+0000 7fe85b59e700 1 -- 172.21.15.82:0/250322168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe85c160b70 con 0x7fe85c15c1c0 2023-11-28T13:01:06.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.863+0000 7fe84affd700 1 -- 172.21.15.82:0/250322168 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe854019030 con 0x7fe85c15c1c0 2023-11-28T13:01:06.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.863+0000 7fe84affd700 1 --2- 172.21.15.82:0/250322168 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe83c064ee0 0x7fe83c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:06.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.863+0000 7fe84affd700 1 -- 172.21.15.82:0/250322168 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe854081c60 con 0x7fe85c15c1c0 2023-11-28T13:01:06.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.863+0000 7fe85a59c700 1 --2- 172.21.15.82:0/250322168 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe83c064ee0 0x7fe83c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:06.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.867+0000 7fe85a59c700 1 --2- 172.21.15.82:0/250322168 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe83c064ee0 0x7fe83c067390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe850009150 tx=0x7fe85001c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:06.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:06.871+0000 7fe84affd700 1 -- 172.21.15.82:0/250322168 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe85404fc90 con 0x7fe85c15c1c0 2023-11-28T13:01:07.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.043+0000 7fe85b59e700 1 -- 172.21.15.82:0/250322168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe85c065fc0 con 0x7fe85c15c1c0 2023-11-28T13:01:07.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.043+0000 7fe84affd700 1 -- 172.21.15.82:0/250322168 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe854017080 con 0x7fe85c15c1c0 2023-11-28T13:01:07.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.047+0000 7fe85b59e700 1 -- 172.21.15.82:0/250322168 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe83c064ee0 msgr2=0x7fe83c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:07.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.047+0000 7fe85b59e700 1 --2- 172.21.15.82:0/250322168 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe83c064ee0 0x7fe83c067390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe850009150 tx=0x7fe85001c040 comp rx=0 tx=0).stop 2023-11-28T13:01:07.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.047+0000 7fe85b59e700 1 -- 172.21.15.82:0/250322168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85c15c1c0 msgr2=0x7fe85c0b2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:07.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.047+0000 7fe85b59e700 1 --2- 172.21.15.82:0/250322168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85c15c1c0 0x7fe85c0b2540 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe85400e750 tx=0x7fe85400ea60 comp rx=0 tx=0).stop 2023-11-28T13:01:07.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.047+0000 7fe85b59e700 1 -- 172.21.15.82:0/250322168 shutdown_connections 2023-11-28T13:01:07.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.047+0000 7fe85b59e700 1 --2- 172.21.15.82:0/250322168 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe83c064ee0 0x7fe83c067390 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.047+0000 7fe85b59e700 1 --2- 172.21.15.82:0/250322168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85c15c1c0 0x7fe85c0b2540 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.047+0000 7fe85b59e700 1 --2- 172.21.15.82:0/250322168 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe85c0ca4b0 0x7fe85c15dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.047+0000 7fe85b59e700 1 --2- 172.21.15.82:0/250322168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe85c06dae0 0x7fe85c149f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.047+0000 7fe85b59e700 1 -- 172.21.15.82:0/250322168 >> 172.21.15.82:0/250322168 conn(0x7fe85c0cf710 msgr2=0x7fe85c06a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:07.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.047+0000 7fe85b59e700 1 -- 172.21.15.82:0/250322168 shutdown_connections 2023-11-28T13:01:07.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.047+0000 7fe85b59e700 1 -- 172.21.15.82:0/250322168 wait complete. 2023-11-28T13:01:07.054 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2023-11-28T13:01:07.065 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi114.front.sepia.ceph.com... 2023-11-28T13:01:07.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:07.065 DEBUG:teuthology.orchestra.run.smithi114:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-28T13:01:07.094 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:01:07.094 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-28T13:01:07.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:07.094 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T13:01:07.152 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:01:07.152 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:01:07.160 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:01:07.161 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:01:07.169 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:01:07.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.319+0000 7fc7a2b64700 1 Processor -- start 2023-11-28T13:01:07.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.319+0000 7fc7a2b64700 1 -- start start 2023-11-28T13:01:07.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.319+0000 7fc7a2b64700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc79c070070 0x7fc79c0704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:07.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.319+0000 7fc7a2b64700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79c06c480 con 0x7fc79c06b0a0 2023-11-28T13:01:07.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.319+0000 7fc7a2b64700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79c0709f0 con 0x7fc79c0b3910 2023-11-28T13:01:07.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.319+0000 7fc7a2b64700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c06dbe0 con 0x7fc79c070070 2023-11-28T13:01:07.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.319+0000 7fc7a1361700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc79c06b0a0 0x7fc79c06d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50182/0 (socket says 172.21.15.82:50182) 2023-11-28T13:01:07.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.319+0000 7fc7a1361700 1 -- 172.21.15.82:0/2944945347 learned_addr learned my addr 172.21.15.82:0/2944945347 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:07.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.319+0000 7fc7a2363700 1 --2- 172.21.15.82:0/2944945347 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc79c070070 0x7fc79c0704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:07.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.319+0000 7fc7a0b60700 1 -- 172.21.15.82:0/2944945347 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172380090 0 0) 0x7fc79c06c480 con 0x7fc79c06b0a0 2023-11-28T13:01:07.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.319+0000 7fc7a0b60700 1 -- 172.21.15.82:0/2944945347 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7880035d0 con 0x7fc79c06b0a0 2023-11-28T13:01:07.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.319+0000 7fc7a0b60700 1 -- 172.21.15.82:0/2944945347 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 956169097 0 0) 0x7fc7880035d0 con 0x7fc79c06b0a0 2023-11-28T13:01:07.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a0b60700 1 -- 172.21.15.82:0/2944945347 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc79c070070 msgr2=0x7fc79c0704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:07.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a0b60700 1 --2- 172.21.15.82:0/2944945347 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc79c070070 0x7fc79c0704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a0b60700 1 -- 172.21.15.82:0/2944945347 >> v1:172.21.15.114:6789/0 conn(0x7fc79c0b3910 legacy=0x7fc79c06c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:07.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a0b60700 1 -- 172.21.15.82:0/2944945347 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c06dec0 con 0x7fc79c06b0a0 2023-11-28T13:01:07.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a0b60700 1 -- 172.21.15.82:0/2944945347 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7fc7980019f0 con 0x7fc79c06b0a0 2023-11-28T13:01:07.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a0b60700 1 -- 172.21.15.82:0/2944945347 >> v1:172.21.15.82:6789/0 conn(0x7fc79c06b0a0 legacy=0x7fc79c06d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:07.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a0b60700 1 --2- 172.21.15.82:0/2944945347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc788003a50 0x7fc788003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:07.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a0b60700 1 --2- 172.21.15.82:0/2944945347 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc79c070070 0x7fc788004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:07.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a0b60700 1 --2- 172.21.15.82:0/2944945347 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc788004db0 0x7fc788005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:07.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a0b60700 1 -- 172.21.15.82:0/2944945347 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c06dbe0 con 0x7fc788003a50 2023-11-28T13:01:07.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a0b60700 1 -- 172.21.15.82:0/2944945347 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78800ba30 con 0x7fc788004db0 2023-11-28T13:01:07.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a0b60700 1 -- 172.21.15.82:0/2944945347 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78800bbc0 con 0x7fc79c070070 2023-11-28T13:01:07.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a1b62700 1 --2- 172.21.15.82:0/2944945347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc788003a50 0x7fc788003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:07.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a2363700 1 --2- 172.21.15.82:0/2944945347 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc788004db0 0x7fc788005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:07.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a1361700 1 --2- 172.21.15.82:0/2944945347 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc79c070070 0x7fc788004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:07.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a2363700 1 -- 172.21.15.82:0/2944945347 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc79c070070 msgr2=0x7fc788004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:07.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a2363700 1 --2- 172.21.15.82:0/2944945347 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc79c070070 0x7fc788004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a2363700 1 -- 172.21.15.82:0/2944945347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc788003a50 msgr2=0x7fc788003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:07.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a2363700 1 --2- 172.21.15.82:0/2944945347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc788003a50 0x7fc788003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a2363700 1 -- 172.21.15.82:0/2944945347 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7880035d0 con 0x7fc788004db0 2023-11-28T13:01:07.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a1b62700 1 --2- 172.21.15.82:0/2944945347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc788003a50 0x7fc788003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:07.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a2363700 1 --2- 172.21.15.82:0/2944945347 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc788004db0 0x7fc788005220 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc794009b70 tx=0x7fc7880058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c37d741034ab15a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:07.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a0b60700 1 -- 172.21.15.82:0/2944945347 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79400e6c0 con 0x7fc788004db0 2023-11-28T13:01:07.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a0b60700 1 -- 172.21.15.82:0/2944945347 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79400e820 con 0x7fc788004db0 2023-11-28T13:01:07.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a0b60700 1 -- 172.21.15.82:0/2944945347 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79400eb90 con 0x7fc788004db0 2023-11-28T13:01:07.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a2b64700 1 -- 172.21.15.82:0/2944945347 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc788004db0 msgr2=0x7fc788005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:07.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a2b64700 1 --2- 172.21.15.82:0/2944945347 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc788004db0 0x7fc788005220 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc794009b70 tx=0x7fc7880058a0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a2363700 1 -- 172.21.15.82:0/2944945347 reap_dead start 2023-11-28T13:01:07.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a2b64700 1 -- 172.21.15.82:0/2944945347 shutdown_connections 2023-11-28T13:01:07.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a2b64700 1 -- 172.21.15.82:0/2944945347 >> 172.21.15.82:0/2944945347 conn(0x7fc79c0ce600 msgr2=0x7fc79c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:07.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a2b64700 1 -- 172.21.15.82:0/2944945347 shutdown_connections 2023-11-28T13:01:07.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.323+0000 7fc7a2b64700 1 -- 172.21.15.82:0/2944945347 wait complete. 2023-11-28T13:01:07.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a2b64700 1 Processor -- start 2023-11-28T13:01:07.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a2b64700 1 -- start start 2023-11-28T13:01:07.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a2b64700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc788004db0 0x7fc79c15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:07.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a2b64700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc79c0afe50 0x7fc79c0b2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:07.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a2b64700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc79c0c56d0 0x7fc79c155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:07.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a2b64700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c0ae160 con 0x7fc79c0afe50 2023-11-28T13:01:07.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a2b64700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c15b2f0 con 0x7fc79c0c56d0 2023-11-28T13:01:07.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a2b64700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c15aa50 con 0x7fc788004db0 2023-11-28T13:01:07.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a1361700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc79c0afe50 0x7fc79c0b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:07.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a1361700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc79c0afe50 0x7fc79c0b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40254/0 (socket says 172.21.15.82:40254) 2023-11-28T13:01:07.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a1361700 1 -- 172.21.15.82:0/3993253374 learned_addr learned my addr 172.21.15.82:0/3993253374 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:07.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a2363700 1 --2- 172.21.15.82:0/3993253374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc79c0c56d0 0x7fc79c155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:07.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a1b62700 1 --2- 172.21.15.82:0/3993253374 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc788004db0 0x7fc79c15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:07.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a2363700 1 -- 172.21.15.82:0/3993253374 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc788004db0 msgr2=0x7fc79c15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:07.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a2363700 1 --2- 172.21.15.82:0/3993253374 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc788004db0 0x7fc79c15a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a2363700 1 -- 172.21.15.82:0/3993253374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc79c0afe50 msgr2=0x7fc79c0b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:07.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a2363700 1 --2- 172.21.15.82:0/3993253374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc79c0afe50 0x7fc79c0b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a2363700 1 -- 172.21.15.82:0/3993253374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c0c8f80 con 0x7fc79c0c56d0 2023-11-28T13:01:07.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a1361700 1 --2- 172.21.15.82:0/3993253374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc79c0afe50 0x7fc79c0b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:07.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a2363700 1 --2- 172.21.15.82:0/3993253374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc79c0c56d0 0x7fc79c155ac0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc794019000 tx=0x7fc7940047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:07.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7927fc700 1 -- 172.21.15.82:0/3993253374 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79400e6c0 con 0x7fc79c0c56d0 2023-11-28T13:01:07.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7927fc700 1 -- 172.21.15.82:0/3993253374 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7940044a0 con 0x7fc79c0c56d0 2023-11-28T13:01:07.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a2b64700 1 -- 172.21.15.82:0/3993253374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79c06c110 con 0x7fc79c0c56d0 2023-11-28T13:01:07.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7927fc700 1 -- 172.21.15.82:0/3993253374 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc794004610 con 0x7fc79c0c56d0 2023-11-28T13:01:07.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.327+0000 7fc7a2b64700 1 -- 172.21.15.82:0/3993253374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79c0b3ce0 con 0x7fc79c0c56d0 2023-11-28T13:01:07.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.331+0000 7fc7a2b64700 1 -- 172.21.15.82:0/3993253374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79c065fc0 con 0x7fc79c0c56d0 2023-11-28T13:01:07.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.331+0000 7fc7927fc700 1 -- 172.21.15.82:0/3993253374 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc794019030 con 0x7fc79c0c56d0 2023-11-28T13:01:07.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.331+0000 7fc7927fc700 1 --2- 172.21.15.82:0/3993253374 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc780064ee0 0x7fc780067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:07.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.331+0000 7fc7927fc700 1 -- 172.21.15.82:0/3993253374 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc794082bd0 con 0x7fc79c0c56d0 2023-11-28T13:01:07.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.331+0000 7fc7a1b62700 1 --2- 172.21.15.82:0/3993253374 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc780064ee0 0x7fc780067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:07.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.331+0000 7fc7a1b62700 1 --2- 172.21.15.82:0/3993253374 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc780064ee0 0x7fc780067390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc78c000c00 tx=0x7fc78c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:07.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.339+0000 7fc7927fc700 1 -- 172.21.15.82:0/3993253374 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc794050e10 con 0x7fc79c0c56d0 2023-11-28T13:01:07.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.503+0000 7fc7a2b64700 1 -- 172.21.15.82:0/3993253374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc79c0ae2a0 con 0x7fc79c0c56d0 2023-11-28T13:01:07.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.511+0000 7fc7927fc700 1 -- 172.21.15.82:0/3993253374 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17811 (secure 0 0 0) 0x7fc794054430 con 0x7fc79c0c56d0 2023-11-28T13:01:07.513 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:07.513 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:00:26.981345+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:00:24.360641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T13:00:24.960863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:01:07.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.511+0000 7fc7a2b64700 1 -- 172.21.15.82:0/3993253374 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc780064ee0 msgr2=0x7fc780067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:07.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.511+0000 7fc7a2b64700 1 --2- 172.21.15.82:0/3993253374 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc780064ee0 0x7fc780067390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc78c000c00 tx=0x7fc78c009040 comp rx=0 tx=0).stop 2023-11-28T13:01:07.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.511+0000 7fc7a2b64700 1 -- 172.21.15.82:0/3993253374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc79c0c56d0 msgr2=0x7fc79c155ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:07.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.511+0000 7fc7a2b64700 1 --2- 172.21.15.82:0/3993253374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc79c0c56d0 0x7fc79c155ac0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc794019000 tx=0x7fc7940047e0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.511+0000 7fc7a2b64700 1 -- 172.21.15.82:0/3993253374 shutdown_connections 2023-11-28T13:01:07.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.511+0000 7fc7a2b64700 1 --2- 172.21.15.82:0/3993253374 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc780064ee0 0x7fc780067390 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.511+0000 7fc7a2b64700 1 --2- 172.21.15.82:0/3993253374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc79c0c56d0 0x7fc79c155ac0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.511+0000 7fc7a2b64700 1 --2- 172.21.15.82:0/3993253374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc79c0afe50 0x7fc79c0b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.511+0000 7fc7a2b64700 1 --2- 172.21.15.82:0/3993253374 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc788004db0 0x7fc79c15a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.511+0000 7fc7a2b64700 1 -- 172.21.15.82:0/3993253374 >> 172.21.15.82:0/3993253374 conn(0x7fc79c0ce600 msgr2=0x7fc79c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:07.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.511+0000 7fc7a2b64700 1 -- 172.21.15.82:0/3993253374 shutdown_connections 2023-11-28T13:01:07.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.511+0000 7fc7a2b64700 1 -- 172.21.15.82:0/3993253374 wait complete. 2023-11-28T13:01:07.528 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T13:00:24.360641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T13:00:24.960863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:01:07.529 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:01:07.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.651+0000 7fe0b359e700 1 Processor -- start 2023-11-28T13:01:07.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.651+0000 7fe0b359e700 1 -- start start 2023-11-28T13:01:07.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b359e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0b40afb70 0x7fe0b415a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:07.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b359e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0b406de30 0x7fe0b406e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:07.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b359e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b415a9c0 con 0x7fe0b41578a0 2023-11-28T13:01:07.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b359e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b406e7b0 con 0x7fe0b406de30 2023-11-28T13:01:07.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b359e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b415abf0 con 0x7fe0b40afb70 2023-11-28T13:01:07.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b2d9d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0b406de30 0x7fe0b406e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:07.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b1d9b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0b40afb70 0x7fe0b415a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:07.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b1d9b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0b40afb70 0x7fe0b415a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:50586/0 (socket says 172.21.15.82:50586) 2023-11-28T13:01:07.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b2d9d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0b406de30 0x7fe0b406e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:48872/0 (socket says 172.21.15.82:48872) 2023-11-28T13:01:07.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b259c700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe0b41578a0 0x7fe0b40ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:39230/0 (socket says 172.21.15.82:39230) 2023-11-28T13:01:07.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b1d9b700 1 -- 172.21.15.82:0/3894416718 learned_addr learned my addr 172.21.15.82:0/3894416718 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:07.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b2d9d700 1 -- 172.21.15.82:0/3894416718 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0b40afb70 msgr2=0x7fe0b415a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:07.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b2d9d700 1 --2- 172.21.15.82:0/3894416718 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0b40afb70 0x7fe0b415a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b2d9d700 1 -- 172.21.15.82:0/3894416718 >> v1:172.21.15.114:6789/0 conn(0x7fe0b41578a0 legacy=0x7fe0b40ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:07.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b2d9d700 1 -- 172.21.15.82:0/3894416718 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b415aed0 con 0x7fe0b406de30 2023-11-28T13:01:07.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b2d9d700 1 --2- 172.21.15.82:0/3894416718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0b406de30 0x7fe0b406e270 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009d90 tx=0x7fe0ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8276dd2a89c264 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:07.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b159a700 1 -- 172.21.15.82:0/3894416718 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac00e070 con 0x7fe0b406de30 2023-11-28T13:01:07.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b159a700 1 -- 172.21.15.82:0/3894416718 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ac00bb20 con 0x7fe0b406de30 2023-11-28T13:01:07.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b159a700 1 -- 172.21.15.82:0/3894416718 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac012430 con 0x7fe0b406de30 2023-11-28T13:01:07.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b359e700 1 -- 172.21.15.82:0/3894416718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0b406de30 msgr2=0x7fe0b406e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:07.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b359e700 1 --2- 172.21.15.82:0/3894416718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0b406de30 0x7fe0b406e270 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009d90 tx=0x7fe0ac00b330 comp rx=0 tx=0).stop 2023-11-28T13:01:07.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b359e700 1 -- 172.21.15.82:0/3894416718 shutdown_connections 2023-11-28T13:01:07.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b359e700 1 --2- 172.21.15.82:0/3894416718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0b406de30 0x7fe0b406e270 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b359e700 1 --2- 172.21.15.82:0/3894416718 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0b40afb70 0x7fe0b415a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b359e700 1 -- 172.21.15.82:0/3894416718 >> 172.21.15.82:0/3894416718 conn(0x7fe0b40d07e0 msgr2=0x7fe0b40d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:07.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b359e700 1 -- 172.21.15.82:0/3894416718 shutdown_connections 2023-11-28T13:01:07.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.655+0000 7fe0b359e700 1 -- 172.21.15.82:0/3894416718 wait complete. 2023-11-28T13:01:07.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.659+0000 7fe0b359e700 1 Processor -- start 2023-11-28T13:01:07.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.659+0000 7fe0b359e700 1 -- start start 2023-11-28T13:01:07.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0b359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0b406de30 0x7fe0b41e5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:07.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0b359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b40afb70 0x7fe0b41f3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:07.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0b359e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0b41578a0 0x7fe0b41f3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:07.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0b359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b41e5d90 con 0x7fe0b40afb70 2023-11-28T13:01:07.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0b359e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b40b4950 con 0x7fe0b406de30 2023-11-28T13:01:07.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0b359e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b40b4c30 con 0x7fe0b41578a0 2023-11-28T13:01:07.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0b1d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b40afb70 0x7fe0b41f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:07.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0b2d9d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0b41578a0 0x7fe0b41f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:07.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0b1d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b40afb70 0x7fe0b41f3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40260/0 (socket says 172.21.15.82:40260) 2023-11-28T13:01:07.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0b259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0b406de30 0x7fe0b41e5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:07.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0b1d9b700 1 -- 172.21.15.82:0/3601065095 learned_addr learned my addr 172.21.15.82:0/3601065095 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:07.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0b1d9b700 1 -- 172.21.15.82:0/3601065095 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0b41578a0 msgr2=0x7fe0b41f3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:07.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0b1d9b700 1 --2- 172.21.15.82:0/3601065095 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0b41578a0 0x7fe0b41f3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0b1d9b700 1 -- 172.21.15.82:0/3601065095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0b406de30 msgr2=0x7fe0b41e5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0b1d9b700 1 --2- 172.21.15.82:0/3601065095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0b406de30 0x7fe0b41e5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0b1d9b700 1 -- 172.21.15.82:0/3601065095 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac009a70 con 0x7fe0b40afb70 2023-11-28T13:01:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0b1d9b700 1 --2- 172.21.15.82:0/3601065095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b40afb70 0x7fe0b41f3030 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00e930 tx=0x7fe09c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0aaffd700 1 -- 172.21.15.82:0/3601065095 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c0096c0 con 0x7fe0b40afb70 2023-11-28T13:01:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0aaffd700 1 -- 172.21.15.82:0/3601065095 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c013680 con 0x7fe0b40afb70 2023-11-28T13:01:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0b359e700 1 -- 172.21.15.82:0/3601065095 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b406d910 con 0x7fe0b40afb70 2023-11-28T13:01:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0aaffd700 1 -- 172.21.15.82:0/3601065095 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c013a30 con 0x7fe0b40afb70 2023-11-28T13:01:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0b359e700 1 -- 172.21.15.82:0/3601065095 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b415b1b0 con 0x7fe0b40afb70 2023-11-28T13:01:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.663+0000 7fe0b359e700 1 -- 172.21.15.82:0/3601065095 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b40affc0 con 0x7fe0b40afb70 2023-11-28T13:01:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.667+0000 7fe0aaffd700 1 -- 172.21.15.82:0/3601065095 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe09c019030 con 0x7fe0b40afb70 2023-11-28T13:01:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.667+0000 7fe0aaffd700 1 --2- 172.21.15.82:0/3601065095 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe094064ee0 0x7fe094067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.667+0000 7fe0aaffd700 1 -- 172.21.15.82:0/3601065095 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe09c081e00 con 0x7fe0b40afb70 2023-11-28T13:01:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.667+0000 7fe0b259c700 1 --2- 172.21.15.82:0/3601065095 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe094064ee0 0x7fe094067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:07.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.667+0000 7fe0b259c700 1 --2- 172.21.15.82:0/3601065095 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe094064ee0 0x7fe094067390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4000f60 tx=0x7fe0a4007ef0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:07.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.671+0000 7fe0aaffd700 1 -- 172.21.15.82:0/3601065095 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe09c04fe30 con 0x7fe0b40afb70 2023-11-28T13:01:07.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.835+0000 7fe0b359e700 1 -- 172.21.15.82:0/3601065095 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe0b4065fc0 con 0x7fe0b40afb70 2023-11-28T13:01:07.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.835+0000 7fe0aaffd700 1 -- 172.21.15.82:0/3601065095 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe09c053450 con 0x7fe0b40afb70 2023-11-28T13:01:07.841 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:01:07.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.839+0000 7fe0b359e700 1 -- 172.21.15.82:0/3601065095 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe094064ee0 msgr2=0x7fe094067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:07.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.839+0000 7fe0b359e700 1 --2- 172.21.15.82:0/3601065095 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe094064ee0 0x7fe094067390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4000f60 tx=0x7fe0a4007ef0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.839+0000 7fe0b359e700 1 -- 172.21.15.82:0/3601065095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b40afb70 msgr2=0x7fe0b41f3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:07.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.839+0000 7fe0b359e700 1 --2- 172.21.15.82:0/3601065095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b40afb70 0x7fe0b41f3030 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00e930 tx=0x7fe09c00ec40 comp rx=0 tx=0).stop 2023-11-28T13:01:07.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.839+0000 7fe0b359e700 1 -- 172.21.15.82:0/3601065095 shutdown_connections 2023-11-28T13:01:07.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.839+0000 7fe0b359e700 1 --2- 172.21.15.82:0/3601065095 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe094064ee0 0x7fe094067390 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.839+0000 7fe0b359e700 1 --2- 172.21.15.82:0/3601065095 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0b41578a0 0x7fe0b41f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.839+0000 7fe0b359e700 1 --2- 172.21.15.82:0/3601065095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b40afb70 0x7fe0b41f3030 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.839+0000 7fe0b359e700 1 --2- 172.21.15.82:0/3601065095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0b406de30 0x7fe0b41e5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.839+0000 7fe0b359e700 1 -- 172.21.15.82:0/3601065095 >> 172.21.15.82:0/3601065095 conn(0x7fe0b40d07e0 msgr2=0x7fe0b4159240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:07.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.839+0000 7fe0b359e700 1 -- 172.21.15.82:0/3601065095 shutdown_connections 2023-11-28T13:01:07.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.839+0000 7fe0b359e700 1 -- 172.21.15.82:0/3601065095 wait complete. 2023-11-28T13:01:07.856 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:01:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.967+0000 7f1f52cb4700 1 Processor -- start 2023-11-28T13:01:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f52cb4700 1 -- start start 2023-11-28T13:01:07.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f52cb4700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1f4c0ad820 0x7f1f4c06a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:07.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f52cb4700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f4c0c9b10 0x7f1f4c0c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:07.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f52cb4700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4c0c93a0 con 0x7f1f4c070910 2023-11-28T13:01:07.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f52cb4700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4c0c96f0 con 0x7f1f4c0ad820 2023-11-28T13:01:07.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f52cb4700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c071580 con 0x7f1f4c0c9b10 2023-11-28T13:01:07.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f514b1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1f4c0ad820 0x7f1f4c06a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:07.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f514b1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1f4c0ad820 0x7f1f4c06a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40276/0 (socket says 172.21.15.82:40276) 2023-11-28T13:01:07.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f514b1700 1 -- 172.21.15.82:0/1406084414 learned_addr learned my addr 172.21.15.82:0/1406084414 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:07.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f524b3700 1 --2- 172.21.15.82:0/1406084414 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f4c0c9b10 0x7f1f4c0c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:07.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f514b1700 1 -- 172.21.15.82:0/1406084414 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f4c0c9b10 msgr2=0x7f1f4c0c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:07.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f514b1700 1 --2- 172.21.15.82:0/1406084414 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f4c0c9b10 0x7f1f4c0c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f514b1700 1 -- 172.21.15.82:0/1406084414 >> v1:172.21.15.82:6789/0 conn(0x7f1f4c070910 legacy=0x7f1f4c070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:07.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f514b1700 1 -- 172.21.15.82:0/1406084414 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c06ab10 con 0x7f1f4c0ad820 2023-11-28T13:01:07.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f524b3700 1 --2- 172.21.15.82:0/1406084414 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f4c0c9b10 0x7f1f4c0c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:07.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f514b1700 1 --2- 172.21.15.82:0/1406084414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4c0ad820 0x7f1f4c06a5d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009e80 tx=0x7f1f3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b96af6eb555f80b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:07.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f50cb0700 1 -- 172.21.15.82:0/1406084414 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c00e070 con 0x7f1f4c0ad820 2023-11-28T13:01:07.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f50cb0700 1 -- 172.21.15.82:0/1406084414 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c00b980 con 0x7f1f4c0ad820 2023-11-28T13:01:07.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f50cb0700 1 -- 172.21.15.82:0/1406084414 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c00bd30 con 0x7f1f4c0ad820 2023-11-28T13:01:07.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f52cb4700 1 -- 172.21.15.82:0/1406084414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4c0ad820 msgr2=0x7f1f4c06a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:07.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f52cb4700 1 --2- 172.21.15.82:0/1406084414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4c0ad820 0x7f1f4c06a5d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009e80 tx=0x7f1f3c00b330 comp rx=0 tx=0).stop 2023-11-28T13:01:07.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f52cb4700 1 -- 172.21.15.82:0/1406084414 shutdown_connections 2023-11-28T13:01:07.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f52cb4700 1 --2- 172.21.15.82:0/1406084414 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f4c0c9b10 0x7f1f4c0c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f52cb4700 1 --2- 172.21.15.82:0/1406084414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4c0ad820 0x7f1f4c06a5d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f52cb4700 1 -- 172.21.15.82:0/1406084414 >> 172.21.15.82:0/1406084414 conn(0x7f1f4c0ce630 msgr2=0x7f1f4c0cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:07.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f52cb4700 1 -- 172.21.15.82:0/1406084414 shutdown_connections 2023-11-28T13:01:07.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.971+0000 7f1f52cb4700 1 -- 172.21.15.82:0/1406084414 wait complete. 2023-11-28T13:01:07.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.975+0000 7f1f52cb4700 1 Processor -- start 2023-11-28T13:01:07.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.975+0000 7f1f52cb4700 1 -- start start 2023-11-28T13:01:07.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.975+0000 7f1f52cb4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4c070910 0x7f1f4c1f94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:07.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.975+0000 7f1f52cb4700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f4c0ad820 0x7f1f4c0cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:07.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.975+0000 7f1f52cb4700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f4c0c9b10 0x7f1f4c157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:07.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.975+0000 7f1f52cb4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c1f7480 con 0x7f1f4c070910 2023-11-28T13:01:07.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.975+0000 7f1f52cb4700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c1f99e0 con 0x7f1f4c0ad820 2023-11-28T13:01:07.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.975+0000 7f1f52cb4700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c1f6800 con 0x7f1f4c0c9b10 2023-11-28T13:01:07.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.975+0000 7f1f51cb2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4c070910 0x7f1f4c1f94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:07.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.975+0000 7f1f51cb2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4c070910 0x7f1f4c1f94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40284/0 (socket says 172.21.15.82:40284) 2023-11-28T13:01:07.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.975+0000 7f1f51cb2700 1 -- 172.21.15.82:0/2448673727 learned_addr learned my addr 172.21.15.82:0/2448673727 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:07.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.975+0000 7f1f514b1700 1 --2- 172.21.15.82:0/2448673727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f4c0ad820 0x7f1f4c0cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:07.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.975+0000 7f1f524b3700 1 --2- 172.21.15.82:0/2448673727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f4c0c9b10 0x7f1f4c157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:07.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.975+0000 7f1f51cb2700 1 -- 172.21.15.82:0/2448673727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f4c0c9b10 msgr2=0x7f1f4c157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:07.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.975+0000 7f1f51cb2700 1 --2- 172.21.15.82:0/2448673727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f4c0c9b10 0x7f1f4c157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.975+0000 7f1f51cb2700 1 -- 172.21.15.82:0/2448673727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f4c0ad820 msgr2=0x7f1f4c0cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:07.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.975+0000 7f1f51cb2700 1 --2- 172.21.15.82:0/2448673727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f4c0ad820 0x7f1f4c0cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:07.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.975+0000 7f1f51cb2700 1 -- 172.21.15.82:0/2448673727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c009b30 con 0x7f1f4c070910 2023-11-28T13:01:07.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.975+0000 7f1f51cb2700 1 --2- 172.21.15.82:0/2448673727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4c070910 0x7f1f4c1f94a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000c500 tx=0x7f1f4000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:07.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.979+0000 7f1f4a7fc700 1 -- 172.21.15.82:0/2448673727 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f400052d0 con 0x7f1f4c070910 2023-11-28T13:01:07.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.979+0000 7f1f4a7fc700 1 -- 172.21.15.82:0/2448673727 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f40005430 con 0x7f1f4c070910 2023-11-28T13:01:07.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.979+0000 7f1f52cb4700 1 -- 172.21.15.82:0/2448673727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4c06b0c0 con 0x7f1f4c070910 2023-11-28T13:01:07.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.979+0000 7f1f4a7fc700 1 -- 172.21.15.82:0/2448673727 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f400055a0 con 0x7f1f4c070910 2023-11-28T13:01:07.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.979+0000 7f1f52cb4700 1 -- 172.21.15.82:0/2448673727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4c06ade0 con 0x7f1f4c070910 2023-11-28T13:01:07.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.979+0000 7f1f52cb4700 1 -- 172.21.15.82:0/2448673727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4c06b3a0 con 0x7f1f4c070910 2023-11-28T13:01:07.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.979+0000 7f1f4a7fc700 1 -- 172.21.15.82:0/2448673727 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1f40019030 con 0x7f1f4c070910 2023-11-28T13:01:07.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.979+0000 7f1f4a7fc700 1 --2- 172.21.15.82:0/2448673727 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1f38064ee0 0x7f1f38067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:07.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.979+0000 7f1f4a7fc700 1 -- 172.21.15.82:0/2448673727 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1f400810d0 con 0x7f1f4c070910 2023-11-28T13:01:07.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.979+0000 7f1f514b1700 1 --2- 172.21.15.82:0/2448673727 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1f38064ee0 0x7f1f38067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:07.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.979+0000 7f1f514b1700 1 --2- 172.21.15.82:0/2448673727 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1f38064ee0 0x7f1f38067390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009e80 tx=0x7f1f3c009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:07.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:07.987+0000 7f1f4a7fc700 1 -- 172.21.15.82:0/2448673727 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1f4004f270 con 0x7f1f4c070910 2023-11-28T13:01:08.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.155+0000 7f1f52cb4700 1 -- 172.21.15.82:0/2448673727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1f4c065fc0 con 0x7f1f4c070910 2023-11-28T13:01:08.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.155+0000 7f1f4a7fc700 1 -- 172.21.15.82:0/2448673727 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1f40052890 con 0x7f1f4c070910 2023-11-28T13:01:08.160 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:01:08.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.155+0000 7f1f52cb4700 1 -- 172.21.15.82:0/2448673727 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1f38064ee0 msgr2=0x7f1f38067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:08.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.155+0000 7f1f52cb4700 1 --2- 172.21.15.82:0/2448673727 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1f38064ee0 0x7f1f38067390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009e80 tx=0x7f1f3c009000 comp rx=0 tx=0).stop 2023-11-28T13:01:08.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.155+0000 7f1f52cb4700 1 -- 172.21.15.82:0/2448673727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4c070910 msgr2=0x7f1f4c1f94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:08.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.155+0000 7f1f52cb4700 1 --2- 172.21.15.82:0/2448673727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4c070910 0x7f1f4c1f94a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000c500 tx=0x7f1f4000c810 comp rx=0 tx=0).stop 2023-11-28T13:01:08.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.155+0000 7f1f52cb4700 1 -- 172.21.15.82:0/2448673727 shutdown_connections 2023-11-28T13:01:08.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.155+0000 7f1f52cb4700 1 --2- 172.21.15.82:0/2448673727 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1f38064ee0 0x7f1f38067390 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.155+0000 7f1f52cb4700 1 --2- 172.21.15.82:0/2448673727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f4c0c9b10 0x7f1f4c157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.155+0000 7f1f52cb4700 1 --2- 172.21.15.82:0/2448673727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f4c0ad820 0x7f1f4c0cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.155+0000 7f1f52cb4700 1 --2- 172.21.15.82:0/2448673727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4c070910 0x7f1f4c1f94a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.155+0000 7f1f52cb4700 1 -- 172.21.15.82:0/2448673727 >> 172.21.15.82:0/2448673727 conn(0x7f1f4c0ce630 msgr2=0x7f1f4c15dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:08.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.155+0000 7f1f52cb4700 1 -- 172.21.15.82:0/2448673727 shutdown_connections 2023-11-28T13:01:08.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.155+0000 7f1f52cb4700 1 -- 172.21.15.82:0/2448673727 wait complete. 2023-11-28T13:01:08.174 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T13:01:08.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.287+0000 7f50eb59e700 1 Processor -- start 2023-11-28T13:01:08.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.287+0000 7f50eb59e700 1 -- start start 2023-11-28T13:01:08.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.287+0000 7f50eb59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50ec159ff0 0x7f50ec0cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.287+0000 7f50eb59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ec06c7c0 con 0x7f50ec071820 2023-11-28T13:01:08.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.287+0000 7f50eb59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ec06ca60 con 0x7f50ec15a3c0 2023-11-28T13:01:08.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.287+0000 7f50eb59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec06cd40 con 0x7f50ec159ff0 2023-11-28T13:01:08.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.287+0000 7f50ead9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f50ec071820 0x7f50ec0b25e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50192/0 (socket says 172.21.15.82:50192) 2023-11-28T13:01:08.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.287+0000 7f50ead9d700 1 -- 172.21.15.82:0/3599423933 learned_addr learned my addr 172.21.15.82:0/3599423933 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:08.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.287+0000 7f50ea59c700 1 --2- 172.21.15.82:0/3599423933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50ec159ff0 0x7f50ec0cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.287+0000 7f50e959a700 1 -- 172.21.15.82:0/3599423933 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273799129 0 0) 0x7f50ec06c7c0 con 0x7f50ec071820 2023-11-28T13:01:08.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.287+0000 7f50e959a700 1 -- 172.21.15.82:0/3599423933 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50d40035d0 con 0x7f50ec071820 2023-11-28T13:01:08.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.287+0000 7f50e959a700 1 -- 172.21.15.82:0/3599423933 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798425014 0 0) 0x7f50ec06ca60 con 0x7f50ec15a3c0 2023-11-28T13:01:08.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.287+0000 7f50e959a700 1 -- 172.21.15.82:0/3599423933 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50ec06c7c0 con 0x7f50ec15a3c0 2023-11-28T13:01:08.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.287+0000 7f50e959a700 1 -- 172.21.15.82:0/3599423933 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 543597215 0 0) 0x7f50d40035d0 con 0x7f50ec071820 2023-11-28T13:01:08.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.287+0000 7f50e959a700 1 -- 172.21.15.82:0/3599423933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50ec159ff0 msgr2=0x7f50ec0cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:08.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.287+0000 7f50e959a700 1 --2- 172.21.15.82:0/3599423933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50ec159ff0 0x7f50ec0cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.287+0000 7f50e959a700 1 -- 172.21.15.82:0/3599423933 >> v1:172.21.15.114:6789/0 conn(0x7f50ec15a3c0 legacy=0x7f50ec071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:08.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.287+0000 7f50e959a700 1 -- 172.21.15.82:0/3599423933 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec0ca4b0 con 0x7f50ec071820 2023-11-28T13:01:08.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.287+0000 7f50e959a700 1 -- 172.21.15.82:0/3599423933 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f50e40019f0 con 0x7f50ec071820 2023-11-28T13:01:08.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.287+0000 7f50e959a700 1 -- 172.21.15.82:0/3599423933 >> v1:172.21.15.82:6789/0 conn(0x7f50ec071820 legacy=0x7f50ec0b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:08.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50e959a700 1 --2- 172.21.15.82:0/3599423933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d4003be0 0x7f50d4003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50e959a700 1 --2- 172.21.15.82:0/3599423933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50ec159ff0 0x7f50d4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50e959a700 1 --2- 172.21.15.82:0/3599423933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d4004db0 0x7f50d4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50e959a700 1 -- 172.21.15.82:0/3599423933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec06cd40 con 0x7f50d4004db0 2023-11-28T13:01:08.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50e959a700 1 -- 172.21.15.82:0/3599423933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d400bae0 con 0x7f50d4003be0 2023-11-28T13:01:08.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50e959a700 1 -- 172.21.15.82:0/3599423933 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d400bca0 con 0x7f50ec159ff0 2023-11-28T13:01:08.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50ead9d700 1 --2- 172.21.15.82:0/3599423933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d4004db0 0x7f50d4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50e9d9b700 1 --2- 172.21.15.82:0/3599423933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50ec159ff0 0x7f50d4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50ea59c700 1 --2- 172.21.15.82:0/3599423933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d4003be0 0x7f50d4003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50ead9d700 1 -- 172.21.15.82:0/3599423933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50ec159ff0 msgr2=0x7f50d4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:08.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50ead9d700 1 --2- 172.21.15.82:0/3599423933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50ec159ff0 0x7f50d4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50ead9d700 1 -- 172.21.15.82:0/3599423933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d4003be0 msgr2=0x7f50d4003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:08.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50ead9d700 1 --2- 172.21.15.82:0/3599423933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d4003be0 0x7f50d4003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50ead9d700 1 -- 172.21.15.82:0/3599423933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d40035d0 con 0x7f50d4004db0 2023-11-28T13:01:08.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50ead9d700 1 --2- 172.21.15.82:0/3599423933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d4004db0 0x7f50d4005220 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f50ec071c10 tx=0x7f50d40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd659a87bd9f212 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:08.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50e959a700 1 -- 172.21.15.82:0/3599423933 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e40070d0 con 0x7f50d4004db0 2023-11-28T13:01:08.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50e959a700 1 -- 172.21.15.82:0/3599423933 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e4007230 con 0x7f50d4004db0 2023-11-28T13:01:08.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50e959a700 1 -- 172.21.15.82:0/3599423933 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e40075e0 con 0x7f50d4004db0 2023-11-28T13:01:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50eb59e700 1 -- 172.21.15.82:0/3599423933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d4004db0 msgr2=0x7f50d4005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50eb59e700 1 --2- 172.21.15.82:0/3599423933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d4004db0 0x7f50d4005220 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f50ec071c10 tx=0x7f50d40058a0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50ead9d700 1 -- 172.21.15.82:0/3599423933 reap_dead start 2023-11-28T13:01:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50eb59e700 1 -- 172.21.15.82:0/3599423933 shutdown_connections 2023-11-28T13:01:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50eb59e700 1 -- 172.21.15.82:0/3599423933 >> 172.21.15.82:0/3599423933 conn(0x7f50ec0b1f50 msgr2=0x7f50ec0cf790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50eb59e700 1 -- 172.21.15.82:0/3599423933 shutdown_connections 2023-11-28T13:01:08.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.291+0000 7f50eb59e700 1 -- 172.21.15.82:0/3599423933 wait complete. 2023-11-28T13:01:08.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50eb59e700 1 Processor -- start 2023-11-28T13:01:08.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50eb59e700 1 -- start start 2023-11-28T13:01:08.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50eb59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d4004db0 0x7f50ec147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50eb59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50ec0c6860 0x7f50ec0c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50eb59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50ec157fa0 0x7f50ec158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50eb59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec158950 con 0x7f50d4004db0 2023-11-28T13:01:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50eb59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec15a790 con 0x7f50ec0c6860 2023-11-28T13:01:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50eb59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec0c73d0 con 0x7f50ec157fa0 2023-11-28T13:01:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50ea59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d4004db0 0x7f50ec147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50ea59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d4004db0 0x7f50ec147b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40292/0 (socket says 172.21.15.82:40292) 2023-11-28T13:01:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50ea59c700 1 -- 172.21.15.82:0/2886567482 learned_addr learned my addr 172.21.15.82:0/2886567482 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50e9d9b700 1 --2- 172.21.15.82:0/2886567482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50ec0c6860 0x7f50ec0c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50ead9d700 1 --2- 172.21.15.82:0/2886567482 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50ec157fa0 0x7f50ec158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50ea59c700 1 -- 172.21.15.82:0/2886567482 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50ec157fa0 msgr2=0x7f50ec158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50ea59c700 1 --2- 172.21.15.82:0/2886567482 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50ec157fa0 0x7f50ec158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50ea59c700 1 -- 172.21.15.82:0/2886567482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50ec0c6860 msgr2=0x7f50ec0c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50ea59c700 1 --2- 172.21.15.82:0/2886567482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50ec0c6860 0x7f50ec0c6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50ea59c700 1 -- 172.21.15.82:0/2886567482 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec0aefc0 con 0x7f50d4004db0 2023-11-28T13:01:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50ea59c700 1 --2- 172.21.15.82:0/2886567482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d4004db0 0x7f50ec147b20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f50dc011a20 tx=0x7f50dc011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50daffd700 1 -- 172.21.15.82:0/2886567482 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc011ec0 con 0x7f50d4004db0 2023-11-28T13:01:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50daffd700 1 -- 172.21.15.82:0/2886567482 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50dc00f940 con 0x7f50d4004db0 2023-11-28T13:01:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50eb59e700 1 -- 172.21.15.82:0/2886567482 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50ec0ca790 con 0x7f50d4004db0 2023-11-28T13:01:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50daffd700 1 -- 172.21.15.82:0/2886567482 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc00fcd0 con 0x7f50d4004db0 2023-11-28T13:01:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.295+0000 7f50eb59e700 1 -- 172.21.15.82:0/2886567482 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50ec0b2cf0 con 0x7f50d4004db0 2023-11-28T13:01:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.299+0000 7f50eb59e700 1 -- 172.21.15.82:0/2886567482 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50ec065fc0 con 0x7f50d4004db0 2023-11-28T13:01:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.299+0000 7f50daffd700 1 -- 172.21.15.82:0/2886567482 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f50dc014440 con 0x7f50d4004db0 2023-11-28T13:01:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.299+0000 7f50daffd700 1 --2- 172.21.15.82:0/2886567482 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f50cc064ee0 0x7f50cc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.299+0000 7f50daffd700 1 -- 172.21.15.82:0/2886567482 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f50dc0827a0 con 0x7f50d4004db0 2023-11-28T13:01:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.299+0000 7f50e9d9b700 1 --2- 172.21.15.82:0/2886567482 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f50cc064ee0 0x7f50cc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.303+0000 7f50e9d9b700 1 --2- 172.21.15.82:0/2886567482 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f50cc064ee0 0x7f50cc067390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f50ec15d820 tx=0x7f50e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:08.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.307+0000 7f50daffd700 1 -- 172.21.15.82:0/2886567482 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f50dc050870 con 0x7f50d4004db0 2023-11-28T13:01:08.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.463+0000 7f50eb59e700 1 -- 172.21.15.82:0/2886567482 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f50ec0cc6d0 con 0x7f50d4004db0 2023-11-28T13:01:08.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.463+0000 7f50daffd700 1 -- 172.21.15.82:0/2886567482 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f50dc053e90 con 0x7f50d4004db0 2023-11-28T13:01:08.471 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-11-28T13:01:08.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.467+0000 7f50eb59e700 1 -- 172.21.15.82:0/2886567482 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f50cc064ee0 msgr2=0x7f50cc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:08.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.467+0000 7f50eb59e700 1 --2- 172.21.15.82:0/2886567482 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f50cc064ee0 0x7f50cc067390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f50ec15d820 tx=0x7f50e0009040 comp rx=0 tx=0).stop 2023-11-28T13:01:08.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.467+0000 7f50eb59e700 1 -- 172.21.15.82:0/2886567482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d4004db0 msgr2=0x7f50ec147b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:08.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.467+0000 7f50eb59e700 1 --2- 172.21.15.82:0/2886567482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d4004db0 0x7f50ec147b20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f50dc011a20 tx=0x7f50dc011d30 comp rx=0 tx=0).stop 2023-11-28T13:01:08.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.467+0000 7f50eb59e700 1 -- 172.21.15.82:0/2886567482 shutdown_connections 2023-11-28T13:01:08.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.467+0000 7f50eb59e700 1 --2- 172.21.15.82:0/2886567482 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f50cc064ee0 0x7f50cc067390 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.467+0000 7f50eb59e700 1 --2- 172.21.15.82:0/2886567482 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50ec157fa0 0x7f50ec158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.467+0000 7f50eb59e700 1 --2- 172.21.15.82:0/2886567482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50ec0c6860 0x7f50ec0c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.467+0000 7f50eb59e700 1 --2- 172.21.15.82:0/2886567482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d4004db0 0x7f50ec147b20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.467+0000 7f50eb59e700 1 -- 172.21.15.82:0/2886567482 >> 172.21.15.82:0/2886567482 conn(0x7f50ec0b1f50 msgr2=0x7f50ec06a760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.467+0000 7f50eb59e700 1 -- 172.21.15.82:0/2886567482 shutdown_connections 2023-11-28T13:01:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.467+0000 7f50eb59e700 1 -- 172.21.15.82:0/2886567482 wait complete. 2023-11-28T13:01:08.485 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T13:01:08.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.591+0000 7f570359e700 1 Processor -- start 2023-11-28T13:01:08.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.591+0000 7f570359e700 1 -- start start 2023-11-28T13:01:08.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.595+0000 7f570359e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57040cba10 0x7f57040ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.595+0000 7f570359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5704071820 0x7f57040ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.595+0000 7f570359e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f570415a4b0 con 0x7f57040ce2d0 2023-11-28T13:01:08.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.595+0000 7f570359e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5704159930 con 0x7f5704071820 2023-11-28T13:01:08.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.595+0000 7f570359e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5704159c10 con 0x7f57040cba10 2023-11-28T13:01:08.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.595+0000 7f5702d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5704071820 0x7f57040ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.595+0000 7f5702d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5704071820 0x7f57040ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40294/0 (socket says 172.21.15.82:40294) 2023-11-28T13:01:08.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.595+0000 7f5702d9d700 1 -- 172.21.15.82:0/383613427 learned_addr learned my addr 172.21.15.82:0/383613427 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:08.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.595+0000 7f570259c700 1 --2- 172.21.15.82:0/383613427 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57040cba10 0x7f57040ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.595+0000 7f570259c700 1 -- 172.21.15.82:0/383613427 >> v2:172.21.15.82:3300/0 conn(0x7f5704071820 msgr2=0x7f57040ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:08.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.595+0000 7f570259c700 1 --2- 172.21.15.82:0/383613427 >> v2:172.21.15.82:3300/0 conn(0x7f5704071820 0x7f57040ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.595+0000 7f570259c700 1 -- 172.21.15.82:0/383613427 >> v1:172.21.15.114:6789/0 conn(0x7f57040ce2d0 legacy=0x7f5704071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:08.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.595+0000 7f570259c700 1 -- 172.21.15.82:0/383613427 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5704159ef0 con 0x7f57040cba10 2023-11-28T13:01:08.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.595+0000 7f570159a700 1 -- 172.21.15.82:0/383613427 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055658898 0 0) 0x7f570415a4b0 con 0x7f57040ce2d0 2023-11-28T13:01:08.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.595+0000 7f5702d9d700 1 --2- 172.21.15.82:0/383613427 >> v2:172.21.15.82:3300/0 conn(0x7f5704071820 0x7f57040ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:08.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.595+0000 7f570259c700 1 --2- 172.21.15.82:0/383613427 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57040cba10 0x7f57040ca6c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f56fc009d90 tx=0x7f56fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37f74824376644c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:08.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.595+0000 7f570159a700 1 -- 172.21.15.82:0/383613427 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56fc00e070 con 0x7f57040cba10 2023-11-28T13:01:08.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.595+0000 7f570159a700 1 -- 172.21.15.82:0/383613427 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56fc00bb20 con 0x7f57040cba10 2023-11-28T13:01:08.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.595+0000 7f570159a700 1 -- 172.21.15.82:0/383613427 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56fc012430 con 0x7f57040cba10 2023-11-28T13:01:08.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.599+0000 7f570359e700 1 -- 172.21.15.82:0/383613427 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57040cba10 msgr2=0x7f57040ca6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:08.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.599+0000 7f570359e700 1 --2- 172.21.15.82:0/383613427 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57040cba10 0x7f57040ca6c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f56fc009d90 tx=0x7f56fc00b330 comp rx=0 tx=0).stop 2023-11-28T13:01:08.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.599+0000 7f570359e700 1 -- 172.21.15.82:0/383613427 shutdown_connections 2023-11-28T13:01:08.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.599+0000 7f570359e700 1 --2- 172.21.15.82:0/383613427 >> v2:172.21.15.82:3300/0 conn(0x7f5704071820 0x7f57040ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.599+0000 7f570359e700 1 --2- 172.21.15.82:0/383613427 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f57040cba10 0x7f57040ca6c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.599+0000 7f570359e700 1 -- 172.21.15.82:0/383613427 >> 172.21.15.82:0/383613427 conn(0x7f57040b1f50 msgr2=0x7f57040cf790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:08.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.599+0000 7f570359e700 1 -- 172.21.15.82:0/383613427 shutdown_connections 2023-11-28T13:01:08.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.599+0000 7f570359e700 1 -- 172.21.15.82:0/383613427 wait complete. 2023-11-28T13:01:08.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.599+0000 7f570359e700 1 Processor -- start 2023-11-28T13:01:08.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.599+0000 7f570359e700 1 -- start start 2023-11-28T13:01:08.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f570359e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5704071820 0x7f57040c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f570359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57040cba10 0x7f57041ee020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f570359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57040ce2d0 0x7f57040c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f570359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57041ee560 con 0x7f57040ce2d0 2023-11-28T13:01:08.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f570359e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57040c93c0 con 0x7f57040cba10 2023-11-28T13:01:08.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f570359e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5704157160 con 0x7f5704071820 2023-11-28T13:01:08.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f5702d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57040ce2d0 0x7f57040c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f5702d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57040ce2d0 0x7f57040c6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40310/0 (socket says 172.21.15.82:40310) 2023-11-28T13:01:08.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f5702d9d700 1 -- 172.21.15.82:0/1230602465 learned_addr learned my addr 172.21.15.82:0/1230602465 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:08.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f570259c700 1 --2- 172.21.15.82:0/1230602465 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5704071820 0x7f57040c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f5701d9b700 1 --2- 172.21.15.82:0/1230602465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57040cba10 0x7f57041ee020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f5702d9d700 1 -- 172.21.15.82:0/1230602465 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5704071820 msgr2=0x7f57040c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:08.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f5702d9d700 1 --2- 172.21.15.82:0/1230602465 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5704071820 0x7f57040c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f5702d9d700 1 -- 172.21.15.82:0/1230602465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57040cba10 msgr2=0x7f57041ee020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:08.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f5702d9d700 1 --2- 172.21.15.82:0/1230602465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57040cba10 0x7f57041ee020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f5702d9d700 1 -- 172.21.15.82:0/1230602465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f400b810 con 0x7f57040ce2d0 2023-11-28T13:01:08.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f5702d9d700 1 --2- 172.21.15.82:0/1230602465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57040ce2d0 0x7f57040c6860 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f56f4010e60 tx=0x7f56f400e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:08.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f56faffd700 1 -- 172.21.15.82:0/1230602465 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f4011450 con 0x7f57040ce2d0 2023-11-28T13:01:08.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f56faffd700 1 -- 172.21.15.82:0/1230602465 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f40115b0 con 0x7f57040ce2d0 2023-11-28T13:01:08.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f570359e700 1 -- 172.21.15.82:0/1230602465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56fc009a70 con 0x7f57040ce2d0 2023-11-28T13:01:08.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f56faffd700 1 -- 172.21.15.82:0/1230602465 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f4011960 con 0x7f57040ce2d0 2023-11-28T13:01:08.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.603+0000 7f570359e700 1 -- 172.21.15.82:0/1230602465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57040cac00 con 0x7f57040ce2d0 2023-11-28T13:01:08.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.607+0000 7f56faffd700 1 -- 172.21.15.82:0/1230602465 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f56f4020030 con 0x7f57040ce2d0 2023-11-28T13:01:08.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.607+0000 7f570359e700 1 -- 172.21.15.82:0/1230602465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f570415a1d0 con 0x7f57040ce2d0 2023-11-28T13:01:08.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.607+0000 7f56faffd700 1 --2- 172.21.15.82:0/1230602465 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f56e4064ee0 0x7f56e4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.607+0000 7f56faffd700 1 -- 172.21.15.82:0/1230602465 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f56f4084890 con 0x7f57040ce2d0 2023-11-28T13:01:08.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.607+0000 7f570259c700 1 --2- 172.21.15.82:0/1230602465 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f56e4064ee0 0x7f56e4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.607+0000 7f570259c700 1 --2- 172.21.15.82:0/1230602465 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f56e4064ee0 0x7f56e4067390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f56fc014040 tx=0x7f56fc011000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:08.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.611+0000 7f56faffd700 1 -- 172.21.15.82:0/1230602465 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f56f40529f0 con 0x7f57040ce2d0 2023-11-28T13:01:08.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.771+0000 7f570359e700 1 -- 172.21.15.82:0/1230602465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f57041594e0 con 0x7f57040ce2d0 2023-11-28T13:01:08.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.771+0000 7f56faffd700 1 -- 172.21.15.82:0/1230602465 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56f4056010 con 0x7f57040ce2d0 2023-11-28T13:01:08.776 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-11-28T13:01:08.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.775+0000 7f570359e700 1 -- 172.21.15.82:0/1230602465 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f56e4064ee0 msgr2=0x7f56e4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:08.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.775+0000 7f570359e700 1 --2- 172.21.15.82:0/1230602465 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f56e4064ee0 0x7f56e4067390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f56fc014040 tx=0x7f56fc011000 comp rx=0 tx=0).stop 2023-11-28T13:01:08.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.775+0000 7f570359e700 1 -- 172.21.15.82:0/1230602465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57040ce2d0 msgr2=0x7f57040c6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:08.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.775+0000 7f570359e700 1 --2- 172.21.15.82:0/1230602465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57040ce2d0 0x7f57040c6860 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f56f4010e60 tx=0x7f56f400e640 comp rx=0 tx=0).stop 2023-11-28T13:01:08.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.775+0000 7f570359e700 1 -- 172.21.15.82:0/1230602465 shutdown_connections 2023-11-28T13:01:08.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.775+0000 7f570359e700 1 --2- 172.21.15.82:0/1230602465 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f56e4064ee0 0x7f56e4067390 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.775+0000 7f570359e700 1 --2- 172.21.15.82:0/1230602465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57040ce2d0 0x7f57040c6860 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.775+0000 7f570359e700 1 --2- 172.21.15.82:0/1230602465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57040cba10 0x7f57041ee020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.775+0000 7f570359e700 1 --2- 172.21.15.82:0/1230602465 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5704071820 0x7f57040c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.775+0000 7f570359e700 1 -- 172.21.15.82:0/1230602465 >> 172.21.15.82:0/1230602465 conn(0x7f57040b1f50 msgr2=0x7f57040ce740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.775+0000 7f570359e700 1 -- 172.21.15.82:0/1230602465 shutdown_connections 2023-11-28T13:01:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.775+0000 7f570359e700 1 -- 172.21.15.82:0/1230602465 wait complete. 2023-11-28T13:01:08.791 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T13:01:08.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.895+0000 7f262a8d0700 1 Processor -- start 2023-11-28T13:01:08.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.895+0000 7f262a8d0700 1 -- start start 2023-11-28T13:01:08.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f262a8d0700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f26241586f0 0x7f262415c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f262a8d0700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26240c8c50 0x7f262406d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f262a8d0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262406c3b0 con 0x7f262406c840 2023-11-28T13:01:08.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f262a8d0700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262406d3d0 con 0x7f26241586f0 2023-11-28T13:01:08.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f262a8d0700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262415c8b0 con 0x7f26240c8c50 2023-11-28T13:01:08.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f262a0cf700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f262406c840 0x7f262406ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50196/0 (socket says 172.21.15.82:50196) 2023-11-28T13:01:08.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f262a0cf700 1 -- 172.21.15.82:0/1874719630 learned_addr learned my addr 172.21.15.82:0/1874719630 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:08.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26290cd700 1 --2- 172.21.15.82:0/1874719630 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26240c8c50 0x7f262406d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26288cc700 1 -- 172.21.15.82:0/1874719630 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620172030 0 0) 0x7f262406c3b0 con 0x7f262406c840 2023-11-28T13:01:08.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26298ce700 1 --2- 172.21.15.82:0/1874719630 >> v2:172.21.15.114:3300/0 conn(0x7f26241586f0 0x7f262415c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26288cc700 1 -- 172.21.15.82:0/1874719630 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f260c0035d0 con 0x7f262406c840 2023-11-28T13:01:08.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26288cc700 1 -- 172.21.15.82:0/1874719630 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3058962676 0 0) 0x7f260c0035d0 con 0x7f262406c840 2023-11-28T13:01:08.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26288cc700 1 -- 172.21.15.82:0/1874719630 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26240c8c50 msgr2=0x7f262406d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:08.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26288cc700 1 --2- 172.21.15.82:0/1874719630 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26240c8c50 0x7f262406d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26288cc700 1 -- 172.21.15.82:0/1874719630 >> v2:172.21.15.114:3300/0 conn(0x7f26241586f0 msgr2=0x7f262415c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:08.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26288cc700 1 --2- 172.21.15.82:0/1874719630 >> v2:172.21.15.114:3300/0 conn(0x7f26241586f0 0x7f262415c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26288cc700 1 -- 172.21.15.82:0/1874719630 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262415cb90 con 0x7f262406c840 2023-11-28T13:01:08.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26288cc700 1 -- 172.21.15.82:0/1874719630 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f261c001670 con 0x7f262406c840 2023-11-28T13:01:08.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26288cc700 1 -- 172.21.15.82:0/1874719630 >> v1:172.21.15.82:6789/0 conn(0x7f262406c840 legacy=0x7f262406ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:08.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26288cc700 1 --2- 172.21.15.82:0/1874719630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f260c003a20 0x7f260c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26288cc700 1 --2- 172.21.15.82:0/1874719630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f260c004450 0x7f260c004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26288cc700 1 --2- 172.21.15.82:0/1874719630 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26240c8c50 0x7f260c005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26288cc700 1 -- 172.21.15.82:0/1874719630 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262406d3d0 con 0x7f260c003a20 2023-11-28T13:01:08.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26288cc700 1 -- 172.21.15.82:0/1874719630 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262415c8b0 con 0x7f260c004450 2023-11-28T13:01:08.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26288cc700 1 -- 172.21.15.82:0/1874719630 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c00ba30 con 0x7f26240c8c50 2023-11-28T13:01:08.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26298ce700 1 --2- 172.21.15.82:0/1874719630 >> v2:172.21.15.114:3300/0 conn(0x7f26241586f0 0x7f262415c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:08.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26298ce700 1 --2- 172.21.15.82:0/1874719630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f260c003a20 0x7f260c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f262a0cf700 1 --2- 172.21.15.82:0/1874719630 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26240c8c50 0x7f260c005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26290cd700 1 --2- 172.21.15.82:0/1874719630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f260c004450 0x7f260c004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f262a0cf700 1 -- 172.21.15.82:0/1874719630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f260c004450 msgr2=0x7f260c004910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:08.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f262a0cf700 1 --2- 172.21.15.82:0/1874719630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f260c004450 0x7f260c004910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f262a0cf700 1 -- 172.21.15.82:0/1874719630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f260c003a20 msgr2=0x7f260c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:08.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f262a0cf700 1 --2- 172.21.15.82:0/1874719630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f260c003a20 0x7f260c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f262a0cf700 1 -- 172.21.15.82:0/1874719630 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c0035d0 con 0x7f26240c8c50 2023-11-28T13:01:08.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26298ce700 1 --2- 172.21.15.82:0/1874719630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f260c003a20 0x7f260c003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:08.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f262a0cf700 1 --2- 172.21.15.82:0/1874719630 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26240c8c50 0x7f260c005090 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f261c00c320 tx=0x7f260c0058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=862284546fb3d30f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:08.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26288cc700 1 -- 172.21.15.82:0/1874719630 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c00ce60 con 0x7f26240c8c50 2023-11-28T13:01:08.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26288cc700 1 -- 172.21.15.82:0/1874719630 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c005980 con 0x7f26240c8c50 2023-11-28T13:01:08.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f26288cc700 1 -- 172.21.15.82:0/1874719630 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c005d30 con 0x7f26240c8c50 2023-11-28T13:01:08.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f262a8d0700 1 -- 172.21.15.82:0/1874719630 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26240c8c50 msgr2=0x7f260c005090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:08.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f262a8d0700 1 --2- 172.21.15.82:0/1874719630 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26240c8c50 0x7f260c005090 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f261c00c320 tx=0x7f260c0058a0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f262a0cf700 1 -- 172.21.15.82:0/1874719630 reap_dead start 2023-11-28T13:01:08.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f262a8d0700 1 -- 172.21.15.82:0/1874719630 shutdown_connections 2023-11-28T13:01:08.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f262a8d0700 1 -- 172.21.15.82:0/1874719630 >> 172.21.15.82:0/1874719630 conn(0x7f26240ce600 msgr2=0x7f26240ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:08.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f262a8d0700 1 -- 172.21.15.82:0/1874719630 shutdown_connections 2023-11-28T13:01:08.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.899+0000 7f262a8d0700 1 -- 172.21.15.82:0/1874719630 wait complete. 2023-11-28T13:01:08.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.903+0000 7f262a8d0700 1 Processor -- start 2023-11-28T13:01:08.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.903+0000 7f262a8d0700 1 -- start start 2023-11-28T13:01:08.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.903+0000 7f262a8d0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26240c8c50 0x7f26241557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f262a8d0700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26241592d0 0x7f2624159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f262a8d0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2624156010 0x7f26241564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f262a8d0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2624155d20 con 0x7f26240c8c50 2023-11-28T13:01:08.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f262a8d0700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2624159c80 con 0x7f2624156010 2023-11-28T13:01:08.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f26298ce700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26240c8c50 0x7f26241557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f262a8d0700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26240b2970 con 0x7f26241592d0 2023-11-28T13:01:08.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f26298ce700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26240c8c50 0x7f26241557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40324/0 (socket says 172.21.15.82:40324) 2023-11-28T13:01:08.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f26298ce700 1 -- 172.21.15.82:0/3688139207 learned_addr learned my addr 172.21.15.82:0/3688139207 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:08.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f26290cd700 1 --2- 172.21.15.82:0/3688139207 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26241592d0 0x7f2624159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f26298ce700 1 -- 172.21.15.82:0/3688139207 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26241592d0 msgr2=0x7f2624159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:08.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f262a0cf700 1 --2- 172.21.15.82:0/3688139207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2624156010 0x7f26241564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f26298ce700 1 --2- 172.21.15.82:0/3688139207 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26241592d0 0x7f2624159740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f26298ce700 1 -- 172.21.15.82:0/3688139207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2624156010 msgr2=0x7f26241564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:08.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f26298ce700 1 --2- 172.21.15.82:0/3688139207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2624156010 0x7f26241564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:08.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f26298ce700 1 -- 172.21.15.82:0/3688139207 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262415d150 con 0x7f26240c8c50 2023-11-28T13:01:08.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f262a0cf700 1 --2- 172.21.15.82:0/3688139207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2624156010 0x7f26241564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:01:08.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f26298ce700 1 --2- 172.21.15.82:0/3688139207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26240c8c50 0x7f26241557e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2618011930 tx=0x7f2618011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:08.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f26227fc700 1 -- 172.21.15.82:0/3688139207 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261800c070 con 0x7f26240c8c50 2023-11-28T13:01:08.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f26227fc700 1 -- 172.21.15.82:0/3688139207 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261800f870 con 0x7f26240c8c50 2023-11-28T13:01:08.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f262a8d0700 1 -- 172.21.15.82:0/3688139207 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262415ce70 con 0x7f26240c8c50 2023-11-28T13:01:08.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f26227fc700 1 -- 172.21.15.82:0/3688139207 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261800fc00 con 0x7f26240c8c50 2023-11-28T13:01:08.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f262a8d0700 1 -- 172.21.15.82:0/3688139207 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2624158ac0 con 0x7f26240c8c50 2023-11-28T13:01:08.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f26227fc700 1 -- 172.21.15.82:0/3688139207 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2618025070 con 0x7f26240c8c50 2023-11-28T13:01:08.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f262a8d0700 1 -- 172.21.15.82:0/3688139207 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2624065fc0 con 0x7f26240c8c50 2023-11-28T13:01:08.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f26227fc700 1 --2- 172.21.15.82:0/3688139207 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2610064f10 0x7f26100673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:08.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f26227fc700 1 -- 172.21.15.82:0/3688139207 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2618082380 con 0x7f26240c8c50 2023-11-28T13:01:08.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.907+0000 7f26290cd700 1 --2- 172.21.15.82:0/3688139207 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2610064f10 0x7f26100673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:08.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.911+0000 7f26290cd700 1 --2- 172.21.15.82:0/3688139207 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2610064f10 0x7f26100673c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f26241f4f70 tx=0x7f261400d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:08.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:08.915+0000 7f26227fc700 1 -- 172.21.15.82:0/3688139207 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f26180504e0 con 0x7f26240c8c50 2023-11-28T13:01:09.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.095+0000 7f262a8d0700 1 -- 172.21.15.82:0/3688139207 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f26241e6f20 con 0x7f26240c8c50 2023-11-28T13:01:09.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.095+0000 7f26227fc700 1 -- 172.21.15.82:0/3688139207 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2618053b00 con 0x7f26240c8c50 2023-11-28T13:01:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.095+0000 7f262a8d0700 1 -- 172.21.15.82:0/3688139207 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2610064f10 msgr2=0x7f26100673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.095+0000 7f262a8d0700 1 --2- 172.21.15.82:0/3688139207 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2610064f10 0x7f26100673c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f26241f4f70 tx=0x7f261400d040 comp rx=0 tx=0).stop 2023-11-28T13:01:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.095+0000 7f262a8d0700 1 -- 172.21.15.82:0/3688139207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26240c8c50 msgr2=0x7f26241557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.095+0000 7f262a8d0700 1 --2- 172.21.15.82:0/3688139207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26240c8c50 0x7f26241557e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2618011930 tx=0x7f2618011cf0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.095+0000 7f262a8d0700 1 -- 172.21.15.82:0/3688139207 shutdown_connections 2023-11-28T13:01:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.095+0000 7f262a8d0700 1 --2- 172.21.15.82:0/3688139207 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2610064f10 0x7f26100673c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.095+0000 7f262a8d0700 1 --2- 172.21.15.82:0/3688139207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2624156010 0x7f26241564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.095+0000 7f262a8d0700 1 --2- 172.21.15.82:0/3688139207 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26241592d0 0x7f2624159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.095+0000 7f262a8d0700 1 --2- 172.21.15.82:0/3688139207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26240c8c50 0x7f26241557e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.095+0000 7f262a8d0700 1 -- 172.21.15.82:0/3688139207 >> 172.21.15.82:0/3688139207 conn(0x7f26240ce600 msgr2=0x7f2624157b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.095+0000 7f262a8d0700 1 -- 172.21.15.82:0/3688139207 shutdown_connections 2023-11-28T13:01:09.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.095+0000 7f262a8d0700 1 -- 172.21.15.82:0/3688139207 wait complete. 2023-11-28T13:01:09.155 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2023-11-28T13:01:09.155 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:01:09.155 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:01:09.163 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:01:09.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.275+0000 7f309c904700 1 Processor -- start 2023-11-28T13:01:09.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.275+0000 7f309c904700 1 -- start start 2023-11-28T13:01:09.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.275+0000 7f309c904700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3098158f00 0x7f309806b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:09.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.275+0000 7f309c904700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f30980cac20 0x7f309806a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:09.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.275+0000 7f309c904700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f309806c830 0x7f309806cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:09.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.275+0000 7f309c904700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30980c9c30 con 0x7f309806c830 2023-11-28T13:01:09.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.275+0000 7f309c904700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309806d1c0 con 0x7f30980cac20 2023-11-28T13:01:09.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.275+0000 7f309c904700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309806ae20 con 0x7f3098158f00 2023-11-28T13:01:09.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.275+0000 7f309759e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f309806c830 0x7f309806cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:09.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.275+0000 7f309759e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f309806c830 0x7f309806cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40334/0 (socket says 172.21.15.82:40334) 2023-11-28T13:01:09.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.275+0000 7f309759e700 1 -- 172.21.15.82:0/4259125906 learned_addr learned my addr 172.21.15.82:0/4259125906 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:09.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.275+0000 7f3096d9d700 1 --2- 172.21.15.82:0/4259125906 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3098158f00 0x7f309806b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:09.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.275+0000 7f309659c700 1 --2- 172.21.15.82:0/4259125906 >> v2:172.21.15.114:3300/0 conn(0x7f30980cac20 0x7f309806a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:09.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.279+0000 7f309759e700 1 -- 172.21.15.82:0/4259125906 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3098158f00 msgr2=0x7f309806b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:09.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.279+0000 7f309759e700 1 --2- 172.21.15.82:0/4259125906 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3098158f00 0x7f309806b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.279+0000 7f309759e700 1 -- 172.21.15.82:0/4259125906 >> v2:172.21.15.114:3300/0 conn(0x7f30980cac20 msgr2=0x7f309806a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:09.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.279+0000 7f309759e700 1 --2- 172.21.15.82:0/4259125906 >> v2:172.21.15.114:3300/0 conn(0x7f30980cac20 0x7f309806a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.279+0000 7f309759e700 1 -- 172.21.15.82:0/4259125906 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30980ca790 con 0x7f309806c830 2023-11-28T13:01:09.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.279+0000 7f309659c700 1 --2- 172.21.15.82:0/4259125906 >> v2:172.21.15.114:3300/0 conn(0x7f30980cac20 0x7f309806a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:09.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.279+0000 7f309759e700 1 --2- 172.21.15.82:0/4259125906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f309806c830 0x7f309806cc80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3098070520 tx=0x7f3088009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3856d23236a95730 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:09.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.279+0000 7f3095d9b700 1 -- 172.21.15.82:0/4259125906 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3088011830 con 0x7f309806c830 2023-11-28T13:01:09.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.279+0000 7f3095d9b700 1 -- 172.21.15.82:0/4259125906 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3088011990 con 0x7f309806c830 2023-11-28T13:01:09.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.279+0000 7f3095d9b700 1 -- 172.21.15.82:0/4259125906 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3088011d20 con 0x7f309806c830 2023-11-28T13:01:09.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.279+0000 7f309c904700 1 -- 172.21.15.82:0/4259125906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f309806c830 msgr2=0x7f309806cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:09.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.279+0000 7f309c904700 1 --2- 172.21.15.82:0/4259125906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f309806c830 0x7f309806cc80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3098070520 tx=0x7f3088009bf0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.279+0000 7f309c904700 1 -- 172.21.15.82:0/4259125906 shutdown_connections 2023-11-28T13:01:09.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.279+0000 7f309c904700 1 --2- 172.21.15.82:0/4259125906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f309806c830 0x7f309806cc80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.279+0000 7f309c904700 1 --2- 172.21.15.82:0/4259125906 >> v2:172.21.15.114:3300/0 conn(0x7f30980cac20 0x7f309806a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.279+0000 7f309c904700 1 --2- 172.21.15.82:0/4259125906 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3098158f00 0x7f309806b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.279+0000 7f309c904700 1 -- 172.21.15.82:0/4259125906 >> 172.21.15.82:0/4259125906 conn(0x7f30980cb890 msgr2=0x7f30980cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:09.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.279+0000 7f309c904700 1 -- 172.21.15.82:0/4259125906 shutdown_connections 2023-11-28T13:01:09.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.279+0000 7f309c904700 1 -- 172.21.15.82:0/4259125906 wait complete. 2023-11-28T13:01:09.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f309c904700 1 Processor -- start 2023-11-28T13:01:09.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f309c904700 1 -- start start 2023-11-28T13:01:09.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f309c904700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f309806c830 0x7f30981ee170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:09.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f309c904700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30980cac20 0x7f3098155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:09.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f309c904700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3098158f00 0x7f3098155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:09.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f309c904700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3098154170 con 0x7f309806c830 2023-11-28T13:01:09.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f309c904700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3098154450 con 0x7f3098158f00 2023-11-28T13:01:09.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f309c904700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3098154730 con 0x7f30980cac20 2023-11-28T13:01:09.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f3096d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f309806c830 0x7f30981ee170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:09.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f3096d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f309806c830 0x7f30981ee170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40342/0 (socket says 172.21.15.82:40342) 2023-11-28T13:01:09.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f3096d9d700 1 -- 172.21.15.82:0/869900394 learned_addr learned my addr 172.21.15.82:0/869900394 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:09.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f309659c700 1 --2- 172.21.15.82:0/869900394 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30980cac20 0x7f3098155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f309759e700 1 --2- 172.21.15.82:0/869900394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3098158f00 0x7f3098155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f3096d9d700 1 -- 172.21.15.82:0/869900394 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30980cac20 msgr2=0x7f3098155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f3096d9d700 1 --2- 172.21.15.82:0/869900394 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30980cac20 0x7f3098155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f3096d9d700 1 -- 172.21.15.82:0/869900394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3098158f00 msgr2=0x7f3098155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f3096d9d700 1 --2- 172.21.15.82:0/869900394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3098158f00 0x7f3098155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f3096d9d700 1 -- 172.21.15.82:0/869900394 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3088009570 con 0x7f309806c830 2023-11-28T13:01:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f309659c700 1 --2- 172.21.15.82:0/869900394 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30980cac20 0x7f3098155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:01:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f3096d9d700 1 --2- 172.21.15.82:0/869900394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f309806c830 0x7f30981ee170 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f309000efc0 tx=0x7f309000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f308f7fe700 1 -- 172.21.15.82:0/869900394 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090009b80 con 0x7f309806c830 2023-11-28T13:01:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f308f7fe700 1 -- 172.21.15.82:0/869900394 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309000f040 con 0x7f309806c830 2023-11-28T13:01:09.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f309c904700 1 -- 172.21.15.82:0/869900394 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30980c9e60 con 0x7f309806c830 2023-11-28T13:01:09.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f308f7fe700 1 -- 172.21.15.82:0/869900394 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090014480 con 0x7f309806c830 2023-11-28T13:01:09.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.283+0000 7f309c904700 1 -- 172.21.15.82:0/869900394 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30980cb070 con 0x7f309806c830 2023-11-28T13:01:09.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.287+0000 7f309c904700 1 -- 172.21.15.82:0/869900394 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30980ca140 con 0x7f309806c830 2023-11-28T13:01:09.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.287+0000 7f308f7fe700 1 -- 172.21.15.82:0/869900394 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f30900145e0 con 0x7f309806c830 2023-11-28T13:01:09.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.287+0000 7f308f7fe700 1 --2- 172.21.15.82:0/869900394 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3078064ee0 0x7f3078067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:09.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.287+0000 7f309659c700 1 --2- 172.21.15.82:0/869900394 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3078064ee0 0x7f3078067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:09.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.287+0000 7f308f7fe700 1 -- 172.21.15.82:0/869900394 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3090082940 con 0x7f309806c830 2023-11-28T13:01:09.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.287+0000 7f309659c700 1 --2- 172.21.15.82:0/869900394 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3078064ee0 0x7f3078067390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f30980c5220 tx=0x7f3080008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:09.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.295+0000 7f308f7fe700 1 -- 172.21.15.82:0/869900394 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f30900509b0 con 0x7f309806c830 2023-11-28T13:01:09.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.459+0000 7f309c904700 1 -- 172.21.15.82:0/869900394 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3098065fc0 con 0x7f309806c830 2023-11-28T13:01:09.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.463+0000 7f308f7fe700 1 -- 172.21.15.82:0/869900394 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17907 (secure 0 0 0) 0x7f3090053fd0 con 0x7f309806c830 2023-11-28T13:01:09.468 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:09.468 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:01:08.993802+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:00:24.360641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T13:00:24.960863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.26","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:01:09.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.467+0000 7f309c904700 1 -- 172.21.15.82:0/869900394 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3078064ee0 msgr2=0x7f3078067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:09.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.467+0000 7f309c904700 1 --2- 172.21.15.82:0/869900394 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3078064ee0 0x7f3078067390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f30980c5220 tx=0x7f3080008040 comp rx=0 tx=0).stop 2023-11-28T13:01:09.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.467+0000 7f309c904700 1 -- 172.21.15.82:0/869900394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f309806c830 msgr2=0x7f30981ee170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:09.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.467+0000 7f309c904700 1 --2- 172.21.15.82:0/869900394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f309806c830 0x7f30981ee170 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f309000efc0 tx=0x7f309000c3a0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.467+0000 7f309c904700 1 -- 172.21.15.82:0/869900394 shutdown_connections 2023-11-28T13:01:09.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.467+0000 7f309c904700 1 --2- 172.21.15.82:0/869900394 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3078064ee0 0x7f3078067390 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.467+0000 7f309c904700 1 --2- 172.21.15.82:0/869900394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3098158f00 0x7f3098155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.467+0000 7f309c904700 1 --2- 172.21.15.82:0/869900394 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30980cac20 0x7f3098155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.467+0000 7f309c904700 1 --2- 172.21.15.82:0/869900394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f309806c830 0x7f30981ee170 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.467+0000 7f309c904700 1 -- 172.21.15.82:0/869900394 >> 172.21.15.82:0/869900394 conn(0x7f30980cb890 msgr2=0x7f30980c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:09.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.467+0000 7f309c904700 1 -- 172.21.15.82:0/869900394 shutdown_connections 2023-11-28T13:01:09.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.467+0000 7f309c904700 1 -- 172.21.15.82:0/869900394 wait complete. 2023-11-28T13:01:09.487 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T13:00:24.360641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T13:00:24.960863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:01:09.487 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:01:09.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.603+0000 7f03d6290700 1 Processor -- start 2023-11-28T13:01:09.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.603+0000 7f03d6290700 1 -- start start 2023-11-28T13:01:09.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.607+0000 7f03d6290700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03d00cba10 0x7f03d00ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:09.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.607+0000 7f03d6290700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f03d00ce2d0 0x7f03d00ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:09.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.607+0000 7f03d6290700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d015a4b0 con 0x7f03d0071110 2023-11-28T13:01:09.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.607+0000 7f03d6290700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d0159930 con 0x7f03d00ce2d0 2023-11-28T13:01:09.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.607+0000 7f03d6290700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d0159c10 con 0x7f03d00cba10 2023-11-28T13:01:09.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.607+0000 7f03d4a8d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f03d00ce2d0 0x7f03d00ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:09.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.607+0000 7f03d528e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03d00cba10 0x7f03d00ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:09.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.607+0000 7f03d4a8d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f03d00ce2d0 0x7f03d00ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:48980/0 (socket says 172.21.15.82:48980) 2023-11-28T13:01:09.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.607+0000 7f03d4a8d700 1 -- 172.21.15.82:0/1224274634 learned_addr learned my addr 172.21.15.82:0/1224274634 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:09.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.607+0000 7f03d4a8d700 1 -- 172.21.15.82:0/1224274634 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03d00cba10 msgr2=0x7f03d00ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:09.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.607+0000 7f03d4a8d700 1 --2- 172.21.15.82:0/1224274634 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03d00cba10 0x7f03d00ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.607+0000 7f03d4a8d700 1 -- 172.21.15.82:0/1224274634 >> v1:172.21.15.114:6789/0 conn(0x7f03d0071110 legacy=0x7f03d015ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:09.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.607+0000 7f03d4a8d700 1 -- 172.21.15.82:0/1224274634 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d0159ef0 con 0x7f03d00ce2d0 2023-11-28T13:01:09.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.607+0000 7f03d528e700 1 --2- 172.21.15.82:0/1224274634 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03d00cba10 0x7f03d00ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:09.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.607+0000 7f03d4a8d700 1 --2- 172.21.15.82:0/1224274634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03d00ce2d0 0x7f03d00ce740 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f03c0009910 tx=0x7f03c0009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52b34fe529b8a29f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:09.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.607+0000 7f03c7fff700 1 -- 172.21.15.82:0/1224274634 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0011830 con 0x7f03d00ce2d0 2023-11-28T13:01:09.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.611+0000 7f03c7fff700 1 -- 172.21.15.82:0/1224274634 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c0011990 con 0x7f03d00ce2d0 2023-11-28T13:01:09.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.611+0000 7f03c7fff700 1 -- 172.21.15.82:0/1224274634 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0011d40 con 0x7f03d00ce2d0 2023-11-28T13:01:09.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.611+0000 7f03d6290700 1 -- 172.21.15.82:0/1224274634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03d00ce2d0 msgr2=0x7f03d00ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:09.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.611+0000 7f03d6290700 1 --2- 172.21.15.82:0/1224274634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03d00ce2d0 0x7f03d00ce740 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f03c0009910 tx=0x7f03c0009c20 comp rx=0 tx=0).stop 2023-11-28T13:01:09.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.611+0000 7f03d6290700 1 -- 172.21.15.82:0/1224274634 shutdown_connections 2023-11-28T13:01:09.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.611+0000 7f03d6290700 1 --2- 172.21.15.82:0/1224274634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03d00ce2d0 0x7f03d00ce740 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.611+0000 7f03d6290700 1 --2- 172.21.15.82:0/1224274634 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03d00cba10 0x7f03d00ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.611+0000 7f03d6290700 1 -- 172.21.15.82:0/1224274634 >> 172.21.15.82:0/1224274634 conn(0x7f03d00b1f50 msgr2=0x7f03d00cf790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:09.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.611+0000 7f03d6290700 1 -- 172.21.15.82:0/1224274634 shutdown_connections 2023-11-28T13:01:09.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.611+0000 7f03d6290700 1 -- 172.21.15.82:0/1224274634 wait complete. 2023-11-28T13:01:09.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.611+0000 7f03d6290700 1 Processor -- start 2023-11-28T13:01:09.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.611+0000 7f03d6290700 1 -- start start 2023-11-28T13:01:09.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03d6290700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03d0071110 0x7f03d0157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:09.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03d6290700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03d00cba10 0x7f03d01f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:09.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03d6290700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03d00ce2d0 0x7f03d00c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:09.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03d6290700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d00acfe0 con 0x7f03d00cba10 2023-11-28T13:01:09.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03d6290700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d00c6860 con 0x7f03d00ce2d0 2023-11-28T13:01:09.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03d6290700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d014e700 con 0x7f03d0071110 2023-11-28T13:01:09.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03d4a8d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03d00cba10 0x7f03d01f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:09.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03d4a8d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03d00cba10 0x7f03d01f4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40354/0 (socket says 172.21.15.82:40354) 2023-11-28T13:01:09.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03d4a8d700 1 -- 172.21.15.82:0/4176204046 learned_addr learned my addr 172.21.15.82:0/4176204046 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:09.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03d528e700 1 --2- 172.21.15.82:0/4176204046 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03d0071110 0x7f03d0157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:09.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03d5a8f700 1 --2- 172.21.15.82:0/4176204046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03d00ce2d0 0x7f03d00c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:09.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03d4a8d700 1 -- 172.21.15.82:0/4176204046 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03d0071110 msgr2=0x7f03d0157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:09.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03d4a8d700 1 --2- 172.21.15.82:0/4176204046 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03d0071110 0x7f03d0157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03d4a8d700 1 -- 172.21.15.82:0/4176204046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03d00ce2d0 msgr2=0x7f03d00c32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:09.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03d4a8d700 1 --2- 172.21.15.82:0/4176204046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03d00ce2d0 0x7f03d00c32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03d4a8d700 1 -- 172.21.15.82:0/4176204046 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc0094b0 con 0x7f03d00cba10 2023-11-28T13:01:09.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03d4a8d700 1 --2- 172.21.15.82:0/4176204046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03d00cba10 0x7f03d01f4ed0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f03c0013000 tx=0x7f03c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:09.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03c5ffb700 1 -- 172.21.15.82:0/4176204046 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0004510 con 0x7f03d00cba10 2023-11-28T13:01:09.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03c5ffb700 1 -- 172.21.15.82:0/4176204046 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c001e070 con 0x7f03d00cba10 2023-11-28T13:01:09.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03d6290700 1 -- 172.21.15.82:0/4176204046 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c0009570 con 0x7f03d00cba10 2023-11-28T13:01:09.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03c5ffb700 1 -- 172.21.15.82:0/4176204046 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c00038c0 con 0x7f03d00cba10 2023-11-28T13:01:09.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03d6290700 1 -- 172.21.15.82:0/4176204046 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d00cac00 con 0x7f03d00cba10 2023-11-28T13:01:09.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.615+0000 7f03d6290700 1 -- 172.21.15.82:0/4176204046 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d015a1d0 con 0x7f03d00cba10 2023-11-28T13:01:09.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.619+0000 7f03c5ffb700 1 -- 172.21.15.82:0/4176204046 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f03c000f050 con 0x7f03d00cba10 2023-11-28T13:01:09.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.619+0000 7f03c5ffb700 1 --2- 172.21.15.82:0/4176204046 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f03b4064ee0 0x7f03b4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:09.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.619+0000 7f03c5ffb700 1 -- 172.21.15.82:0/4176204046 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f03c0020070 con 0x7f03d00cba10 2023-11-28T13:01:09.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.619+0000 7f03d528e700 1 --2- 172.21.15.82:0/4176204046 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f03b4064ee0 0x7f03b4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:09.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.619+0000 7f03d528e700 1 --2- 172.21.15.82:0/4176204046 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f03b4064ee0 0x7f03b4067390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f03cc009d80 tx=0x7f03cc009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:09.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.623+0000 7f03c5ffb700 1 -- 172.21.15.82:0/4176204046 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f03c0051430 con 0x7f03d00cba10 2023-11-28T13:01:09.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.783+0000 7f03d6290700 1 -- 172.21.15.82:0/4176204046 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03d01594e0 con 0x7f03d00cba10 2023-11-28T13:01:09.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.787+0000 7f03c5ffb700 1 -- 172.21.15.82:0/4176204046 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03c002a0a0 con 0x7f03d00cba10 2023-11-28T13:01:09.793 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:01:09.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.787+0000 7f03d6290700 1 -- 172.21.15.82:0/4176204046 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f03b4064ee0 msgr2=0x7f03b4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:09.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.787+0000 7f03d6290700 1 --2- 172.21.15.82:0/4176204046 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f03b4064ee0 0x7f03b4067390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f03cc009d80 tx=0x7f03cc009240 comp rx=0 tx=0).stop 2023-11-28T13:01:09.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.787+0000 7f03d6290700 1 -- 172.21.15.82:0/4176204046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03d00cba10 msgr2=0x7f03d01f4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:09.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.787+0000 7f03d6290700 1 --2- 172.21.15.82:0/4176204046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03d00cba10 0x7f03d01f4ed0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f03c0013000 tx=0x7f03c0004770 comp rx=0 tx=0).stop 2023-11-28T13:01:09.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.787+0000 7f03d6290700 1 -- 172.21.15.82:0/4176204046 shutdown_connections 2023-11-28T13:01:09.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.787+0000 7f03d6290700 1 --2- 172.21.15.82:0/4176204046 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f03b4064ee0 0x7f03b4067390 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.787+0000 7f03d6290700 1 --2- 172.21.15.82:0/4176204046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03d00ce2d0 0x7f03d00c32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.787+0000 7f03d6290700 1 --2- 172.21.15.82:0/4176204046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03d00cba10 0x7f03d01f4ed0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.787+0000 7f03d6290700 1 --2- 172.21.15.82:0/4176204046 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03d0071110 0x7f03d0157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.787+0000 7f03d6290700 1 -- 172.21.15.82:0/4176204046 >> 172.21.15.82:0/4176204046 conn(0x7f03d00b1f50 msgr2=0x7f03d00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:09.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.791+0000 7f03d6290700 1 -- 172.21.15.82:0/4176204046 shutdown_connections 2023-11-28T13:01:09.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.791+0000 7f03d6290700 1 -- 172.21.15.82:0/4176204046 wait complete. 2023-11-28T13:01:09.814 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:01:09.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877b59e700 1 Processor -- start 2023-11-28T13:01:09.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877b59e700 1 -- start start 2023-11-28T13:01:09.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877b59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f877c0ae090 0x7f877c0c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:09.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877b59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877c0ad9b0 con 0x7f877c158eb0 2023-11-28T13:01:09.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877b59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877c159280 con 0x7f877c0b0c70 2023-11-28T13:01:09.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877b59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877c0adee0 con 0x7f877c0ae090 2023-11-28T13:01:09.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877a59c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f877c158eb0 0x7f877c0b0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50206/0 (socket says 172.21.15.82:50206) 2023-11-28T13:01:09.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877a59c700 1 -- 172.21.15.82:0/3707475321 learned_addr learned my addr 172.21.15.82:0/3707475321 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:09.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f8779d9b700 1 --2- 172.21.15.82:0/3707475321 >> v2:172.21.15.114:3300/0 conn(0x7f877c0ae090 0x7f877c0c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:09.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877959a700 1 -- 172.21.15.82:0/3707475321 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842877855 0 0) 0x7f877c0ad9b0 con 0x7f877c158eb0 2023-11-28T13:01:09.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877959a700 1 -- 172.21.15.82:0/3707475321 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f875c0057e0 con 0x7f877c158eb0 2023-11-28T13:01:09.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877959a700 1 -- 172.21.15.82:0/3707475321 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3470384335 0 0) 0x7f875c0057e0 con 0x7f877c158eb0 2023-11-28T13:01:09.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877959a700 1 -- 172.21.15.82:0/3707475321 >> v2:172.21.15.114:3300/0 conn(0x7f877c0ae090 msgr2=0x7f877c0c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:09.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877959a700 1 --2- 172.21.15.82:0/3707475321 >> v2:172.21.15.114:3300/0 conn(0x7f877c0ae090 0x7f877c0c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877959a700 1 -- 172.21.15.82:0/3707475321 >> v1:172.21.15.114:6789/0 conn(0x7f877c0b0c70 legacy=0x7f877c15c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:09.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877959a700 1 -- 172.21.15.82:0/3707475321 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c069e60 con 0x7f877c158eb0 2023-11-28T13:01:09.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877959a700 1 -- 172.21.15.82:0/3707475321 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f8764001670 con 0x7f877c158eb0 2023-11-28T13:01:09.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877959a700 1 -- 172.21.15.82:0/3707475321 >> v1:172.21.15.82:6789/0 conn(0x7f877c158eb0 legacy=0x7f877c0b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:09.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877959a700 1 --2- 172.21.15.82:0/3707475321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f875c005c30 0x7f875c006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:09.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877959a700 1 --2- 172.21.15.82:0/3707475321 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f875c006a80 0x7f875c006ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:09.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877959a700 1 --2- 172.21.15.82:0/3707475321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f875c007430 0x7f875c00dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:09.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877959a700 1 -- 172.21.15.82:0/3707475321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c0adee0 con 0x7f875c007430 2023-11-28T13:01:09.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877959a700 1 -- 172.21.15.82:0/3707475321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875c00e340 con 0x7f875c005c30 2023-11-28T13:01:09.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877959a700 1 -- 172.21.15.82:0/3707475321 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f875c00e500 con 0x7f875c006a80 2023-11-28T13:01:09.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.927+0000 7f877ad9d700 1 --2- 172.21.15.82:0/3707475321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f875c007430 0x7f875c00dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:09.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.931+0000 7f877ad9d700 1 -- 172.21.15.82:0/3707475321 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f875c006a80 msgr2=0x7f875c006ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:09.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.931+0000 7f8779d9b700 1 --2- 172.21.15.82:0/3707475321 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f875c006a80 0x7f875c006ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:09.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.931+0000 7f877ad9d700 1 --2- 172.21.15.82:0/3707475321 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f875c006a80 0x7f875c006ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.931+0000 7f877ad9d700 1 -- 172.21.15.82:0/3707475321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f875c005c30 msgr2=0x7f875c006040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.931+0000 7f877ad9d700 1 --2- 172.21.15.82:0/3707475321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f875c005c30 0x7f875c006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.931+0000 7f877ad9d700 1 -- 172.21.15.82:0/3707475321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875c0057e0 con 0x7f875c007430 2023-11-28T13:01:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.931+0000 7f877ad9d700 1 -- 172.21.15.82:0/3707475321 reap_dead start 2023-11-28T13:01:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.931+0000 7f877ad9d700 1 --2- 172.21.15.82:0/3707475321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f875c007430 0x7f875c00dc40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f876c0017e0 tx=0x7f875c007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79617645f5b3c6fc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.931+0000 7f877959a700 1 -- 172.21.15.82:0/3707475321 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c0052d0 con 0x7f875c007430 2023-11-28T13:01:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.931+0000 7f877959a700 1 -- 172.21.15.82:0/3707475321 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876c005430 con 0x7f875c007430 2023-11-28T13:01:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.931+0000 7f877959a700 1 -- 172.21.15.82:0/3707475321 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c0055a0 con 0x7f875c007430 2023-11-28T13:01:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.931+0000 7f877b59e700 1 -- 172.21.15.82:0/3707475321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f875c007430 msgr2=0x7f875c00dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.931+0000 7f877b59e700 1 --2- 172.21.15.82:0/3707475321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f875c007430 0x7f875c00dc40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f876c0017e0 tx=0x7f875c007ab0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.931+0000 7f877b59e700 1 -- 172.21.15.82:0/3707475321 shutdown_connections 2023-11-28T13:01:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.931+0000 7f877b59e700 1 --2- 172.21.15.82:0/3707475321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f875c007430 0x7f875c00dc40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.931+0000 7f877b59e700 1 -- 172.21.15.82:0/3707475321 >> 172.21.15.82:0/3707475321 conn(0x7f877c0ce630 msgr2=0x7f877c0cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.931+0000 7f877b59e700 1 -- 172.21.15.82:0/3707475321 shutdown_connections 2023-11-28T13:01:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.931+0000 7f877b59e700 1 -- 172.21.15.82:0/3707475321 wait complete. 2023-11-28T13:01:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.935+0000 7f877b59e700 1 Processor -- start 2023-11-28T13:01:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.935+0000 7f877b59e700 1 -- start start 2023-11-28T13:01:09.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.935+0000 7f877b59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f875c007430 0x7f877c14ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:09.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.935+0000 7f877b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f877c14cb20 0x7f877c144140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:09.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.935+0000 7f877b59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f877c0c79a0 0x7f877c0c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:09.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.935+0000 7f877b59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c14aac0 con 0x7f877c14cb20 2023-11-28T13:01:09.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.935+0000 7f877b59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c0c8380 con 0x7f877c0c79a0 2023-11-28T13:01:09.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.935+0000 7f877b59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877c14cf90 con 0x7f875c007430 2023-11-28T13:01:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.935+0000 7f8779d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f877c14cb20 0x7f877c144140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.935+0000 7f877a59c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f875c007430 0x7f877c14ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.935+0000 7f8779d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f877c14cb20 0x7f877c144140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40376/0 (socket says 172.21.15.82:40376) 2023-11-28T13:01:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.935+0000 7f8779d9b700 1 -- 172.21.15.82:0/2453888107 learned_addr learned my addr 172.21.15.82:0/2453888107 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.935+0000 7f877ad9d700 1 --2- 172.21.15.82:0/2453888107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f877c0c79a0 0x7f877c0c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.935+0000 7f8779d9b700 1 -- 172.21.15.82:0/2453888107 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f875c007430 msgr2=0x7f877c14ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.935+0000 7f8779d9b700 1 --2- 172.21.15.82:0/2453888107 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f875c007430 0x7f877c14ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.935+0000 7f8779d9b700 1 -- 172.21.15.82:0/2453888107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f877c0c79a0 msgr2=0x7f877c0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.935+0000 7f8779d9b700 1 --2- 172.21.15.82:0/2453888107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f877c0c79a0 0x7f877c0c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.935+0000 7f8779d9b700 1 -- 172.21.15.82:0/2453888107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c071c90 con 0x7f877c14cb20 2023-11-28T13:01:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.939+0000 7f8779d9b700 1 --2- 172.21.15.82:0/2453888107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f877c14cb20 0x7f877c144140 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8774007f60 tx=0x7f8774007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:09.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.939+0000 7f8772ffd700 1 -- 172.21.15.82:0/2453888107 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877400fd50 con 0x7f877c14cb20 2023-11-28T13:01:09.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.939+0000 7f8772ffd700 1 -- 172.21.15.82:0/2453888107 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8774011040 con 0x7f877c14cb20 2023-11-28T13:01:09.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.939+0000 7f877b59e700 1 -- 172.21.15.82:0/2453888107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877c0adc00 con 0x7f877c14cb20 2023-11-28T13:01:09.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.939+0000 7f8772ffd700 1 -- 172.21.15.82:0/2453888107 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774017640 con 0x7f877c14cb20 2023-11-28T13:01:09.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.939+0000 7f877b59e700 1 -- 172.21.15.82:0/2453888107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877c071f70 con 0x7f877c14cb20 2023-11-28T13:01:09.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.939+0000 7f877b59e700 1 -- 172.21.15.82:0/2453888107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877c065fc0 con 0x7f877c14cb20 2023-11-28T13:01:09.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.939+0000 7f8772ffd700 1 -- 172.21.15.82:0/2453888107 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f877401e030 con 0x7f877c14cb20 2023-11-28T13:01:09.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.943+0000 7f8772ffd700 1 --2- 172.21.15.82:0/2453888107 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8760064ee0 0x7f8760067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:09.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.943+0000 7f8772ffd700 1 -- 172.21.15.82:0/2453888107 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8774082060 con 0x7f877c14cb20 2023-11-28T13:01:09.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.943+0000 7f877a59c700 1 --2- 172.21.15.82:0/2453888107 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8760064ee0 0x7f8760067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:09.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.943+0000 7f877a59c700 1 --2- 172.21.15.82:0/2453888107 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8760064ee0 0x7f8760067390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f877c158130 tx=0x7f8764001730 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:09.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:09.947+0000 7f8772ffd700 1 -- 172.21.15.82:0/2453888107 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8774050160 con 0x7f877c14cb20 2023-11-28T13:01:10.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.107+0000 7f877b59e700 1 -- 172.21.15.82:0/2453888107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f877c14d7d0 con 0x7f877c14cb20 2023-11-28T13:01:10.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.107+0000 7f8772ffd700 1 -- 172.21.15.82:0/2453888107 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f877401c020 con 0x7f877c14cb20 2023-11-28T13:01:10.113 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:01:10.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.111+0000 7f877b59e700 1 -- 172.21.15.82:0/2453888107 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8760064ee0 msgr2=0x7f8760067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:10.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.111+0000 7f877b59e700 1 --2- 172.21.15.82:0/2453888107 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8760064ee0 0x7f8760067390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f877c158130 tx=0x7f8764001730 comp rx=0 tx=0).stop 2023-11-28T13:01:10.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.111+0000 7f877b59e700 1 -- 172.21.15.82:0/2453888107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f877c14cb20 msgr2=0x7f877c144140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:10.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.111+0000 7f877b59e700 1 --2- 172.21.15.82:0/2453888107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f877c14cb20 0x7f877c144140 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8774007f60 tx=0x7f8774007f90 comp rx=0 tx=0).stop 2023-11-28T13:01:10.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.111+0000 7f877b59e700 1 -- 172.21.15.82:0/2453888107 shutdown_connections 2023-11-28T13:01:10.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.111+0000 7f877b59e700 1 --2- 172.21.15.82:0/2453888107 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8760064ee0 0x7f8760067390 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.111+0000 7f877b59e700 1 --2- 172.21.15.82:0/2453888107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f877c0c79a0 0x7f877c0c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.111+0000 7f877b59e700 1 --2- 172.21.15.82:0/2453888107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f877c14cb20 0x7f877c144140 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.111+0000 7f877b59e700 1 --2- 172.21.15.82:0/2453888107 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f875c007430 0x7f877c14ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.111+0000 7f877b59e700 1 -- 172.21.15.82:0/2453888107 >> 172.21.15.82:0/2453888107 conn(0x7f877c0ce630 msgr2=0x7f877c1568f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:10.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.111+0000 7f877b59e700 1 -- 172.21.15.82:0/2453888107 shutdown_connections 2023-11-28T13:01:10.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.111+0000 7f877b59e700 1 -- 172.21.15.82:0/2453888107 wait complete. 2023-11-28T13:01:10.132 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T13:01:10.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01d09cb700 1 Processor -- start 2023-11-28T13:01:10.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01d09cb700 1 -- start start 2023-11-28T13:01:10.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01d09cb700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f01cc071380 0x7f01cc15c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:10.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01d09cb700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01cc071750 0x7f01cc1606c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:10.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01d09cb700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f01cc0caa90 0x7f01cc1598c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:10.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01d09cb700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01cc06a450 con 0x7f01cc071380 2023-11-28T13:01:10.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01d09cb700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01cc15ff30 con 0x7f01cc0caa90 2023-11-28T13:01:10.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01d09cb700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc15d1d0 con 0x7f01cc071750 2023-11-28T13:01:10.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01cb7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f01cc071380 0x7f01cc15c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:10.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01cb7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f01cc071380 0x7f01cc15c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40390/0 (socket says 172.21.15.82:40390) 2023-11-28T13:01:10.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01cb7fe700 1 -- 172.21.15.82:0/2403932432 learned_addr learned my addr 172.21.15.82:0/2403932432 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:10.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01cbfff700 1 --2- 172.21.15.82:0/2403932432 >> v2:172.21.15.114:3300/0 conn(0x7f01cc0caa90 0x7f01cc1598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:10.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01caffd700 1 --2- 172.21.15.82:0/2403932432 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01cc071750 0x7f01cc1606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:10.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01cb7fe700 1 -- 172.21.15.82:0/2403932432 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01cc071750 msgr2=0x7f01cc1606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:10.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01cb7fe700 1 --2- 172.21.15.82:0/2403932432 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01cc071750 0x7f01cc1606c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01cb7fe700 1 -- 172.21.15.82:0/2403932432 >> v2:172.21.15.114:3300/0 conn(0x7f01cc0caa90 msgr2=0x7f01cc1598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:10.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01cb7fe700 1 --2- 172.21.15.82:0/2403932432 >> v2:172.21.15.114:3300/0 conn(0x7f01cc0caa90 0x7f01cc1598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01cb7fe700 1 -- 172.21.15.82:0/2403932432 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc15d4b0 con 0x7f01cc071380 2023-11-28T13:01:10.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01cbfff700 1 --2- 172.21.15.82:0/2403932432 >> v2:172.21.15.114:3300/0 conn(0x7f01cc0caa90 0x7f01cc1598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:10.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01cb7fe700 1 --2- 172.21.15.82:0/2403932432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01cc071380 0x7f01cc15c8a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f01cc0af100 tx=0x7f01b4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2885677ffa8aaf0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:10.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01ca7fc700 1 -- 172.21.15.82:0/2403932432 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b400b8a0 con 0x7f01cc071380 2023-11-28T13:01:10.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01ca7fc700 1 -- 172.21.15.82:0/2403932432 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b400ba00 con 0x7f01cc071380 2023-11-28T13:01:10.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01ca7fc700 1 -- 172.21.15.82:0/2403932432 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b400bd90 con 0x7f01cc071380 2023-11-28T13:01:10.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01d09cb700 1 -- 172.21.15.82:0/2403932432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01cc071380 msgr2=0x7f01cc15c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:10.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.247+0000 7f01d09cb700 1 --2- 172.21.15.82:0/2403932432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01cc071380 0x7f01cc15c8a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f01cc0af100 tx=0x7f01b4009bf0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.251+0000 7f01d09cb700 1 -- 172.21.15.82:0/2403932432 shutdown_connections 2023-11-28T13:01:10.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.251+0000 7f01d09cb700 1 --2- 172.21.15.82:0/2403932432 >> v2:172.21.15.114:3300/0 conn(0x7f01cc0caa90 0x7f01cc1598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.251+0000 7f01d09cb700 1 --2- 172.21.15.82:0/2403932432 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01cc071750 0x7f01cc1606c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.251+0000 7f01d09cb700 1 --2- 172.21.15.82:0/2403932432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01cc071380 0x7f01cc15c8a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.251+0000 7f01d09cb700 1 -- 172.21.15.82:0/2403932432 >> 172.21.15.82:0/2403932432 conn(0x7f01cc0b1f50 msgr2=0x7f01cc0cf790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:10.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.251+0000 7f01d09cb700 1 -- 172.21.15.82:0/2403932432 shutdown_connections 2023-11-28T13:01:10.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.251+0000 7f01d09cb700 1 -- 172.21.15.82:0/2403932432 wait complete. 2023-11-28T13:01:10.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.251+0000 7f01d09cb700 1 Processor -- start 2023-11-28T13:01:10.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.251+0000 7f01d09cb700 1 -- start start 2023-11-28T13:01:10.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.251+0000 7f01d09cb700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01cc071380 0x7f01cc15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:10.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.251+0000 7f01d09cb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01cc071750 0x7f01cc15ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:10.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.251+0000 7f01d09cb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01cc0caa90 0x7f01cc147db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:10.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.251+0000 7f01d09cb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc0b5230 con 0x7f01cc0caa90 2023-11-28T13:01:10.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.251+0000 7f01d09cb700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc0b4620 con 0x7f01cc071750 2023-11-28T13:01:10.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.251+0000 7f01d09cb700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc0b4900 con 0x7f01cc071380 2023-11-28T13:01:10.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.251+0000 7f01cbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01cc0caa90 0x7f01cc147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:10.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.251+0000 7f01cbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01cc0caa90 0x7f01cc147db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40392/0 (socket says 172.21.15.82:40392) 2023-11-28T13:01:10.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.251+0000 7f01cbfff700 1 -- 172.21.15.82:0/1084030981 learned_addr learned my addr 172.21.15.82:0/1084030981 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:10.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.251+0000 7f01cb7fe700 1 --2- 172.21.15.82:0/1084030981 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01cc071380 0x7f01cc15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:10.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.251+0000 7f01caffd700 1 --2- 172.21.15.82:0/1084030981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01cc071750 0x7f01cc15ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:10.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.255+0000 7f01cbfff700 1 -- 172.21.15.82:0/1084030981 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01cc071380 msgr2=0x7f01cc15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:10.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.255+0000 7f01cbfff700 1 --2- 172.21.15.82:0/1084030981 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01cc071380 0x7f01cc15a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.255+0000 7f01cbfff700 1 -- 172.21.15.82:0/1084030981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01cc071750 msgr2=0x7f01cc15ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:10.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.255+0000 7f01cbfff700 1 --2- 172.21.15.82:0/1084030981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01cc071750 0x7f01cc15ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.255+0000 7f01cbfff700 1 -- 172.21.15.82:0/1084030981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b4009570 con 0x7f01cc0caa90 2023-11-28T13:01:10.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.255+0000 7f01cb7fe700 1 --2- 172.21.15.82:0/1084030981 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01cc071380 0x7f01cc15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:10.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.255+0000 7f01cbfff700 1 --2- 172.21.15.82:0/1084030981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01cc0caa90 0x7f01cc147db0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f01c400e810 tx=0x7f01c400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:10.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.255+0000 7f01c3fff700 1 -- 172.21.15.82:0/1084030981 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c400c030 con 0x7f01cc0caa90 2023-11-28T13:01:10.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.255+0000 7f01c3fff700 1 -- 172.21.15.82:0/1084030981 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c4004220 con 0x7f01cc0caa90 2023-11-28T13:01:10.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.255+0000 7f01d09cb700 1 -- 172.21.15.82:0/1084030981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01cc15d790 con 0x7f01cc0caa90 2023-11-28T13:01:10.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.255+0000 7f01c3fff700 1 -- 172.21.15.82:0/1084030981 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c40045b0 con 0x7f01cc0caa90 2023-11-28T13:01:10.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.255+0000 7f01d09cb700 1 -- 172.21.15.82:0/1084030981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01cc1601a0 con 0x7f01cc0caa90 2023-11-28T13:01:10.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.255+0000 7f01d09cb700 1 -- 172.21.15.82:0/1084030981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01cc15cde0 con 0x7f01cc0caa90 2023-11-28T13:01:10.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.255+0000 7f01c3fff700 1 -- 172.21.15.82:0/1084030981 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f01c4022070 con 0x7f01cc0caa90 2023-11-28T13:01:10.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.259+0000 7f01c3fff700 1 --2- 172.21.15.82:0/1084030981 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f01ac064ee0 0x7f01ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:10.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.259+0000 7f01cb7fe700 1 --2- 172.21.15.82:0/1084030981 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f01ac064ee0 0x7f01ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:10.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.259+0000 7f01c3fff700 1 -- 172.21.15.82:0/1084030981 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f01c4081c30 con 0x7f01cc0caa90 2023-11-28T13:01:10.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.259+0000 7f01cb7fe700 1 --2- 172.21.15.82:0/1084030981 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f01ac064ee0 0x7f01ac067390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f01b4000c00 tx=0x7f01b4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:10.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.267+0000 7f01c3fff700 1 -- 172.21.15.82:0/1084030981 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f01c404fd90 con 0x7f01cc0caa90 2023-11-28T13:01:10.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.427+0000 7f01d09cb700 1 -- 172.21.15.82:0/1084030981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f01cc15c8a0 con 0x7f01cc0caa90 2023-11-28T13:01:10.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.431+0000 7f01c3fff700 1 -- 172.21.15.82:0/1084030981 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f01c400f040 con 0x7f01cc0caa90 2023-11-28T13:01:10.435 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-11-28T13:01:10.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.431+0000 7f01d09cb700 1 -- 172.21.15.82:0/1084030981 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f01ac064ee0 msgr2=0x7f01ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:10.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.431+0000 7f01d09cb700 1 --2- 172.21.15.82:0/1084030981 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f01ac064ee0 0x7f01ac067390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f01b4000c00 tx=0x7f01b4008030 comp rx=0 tx=0).stop 2023-11-28T13:01:10.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.431+0000 7f01d09cb700 1 -- 172.21.15.82:0/1084030981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01cc0caa90 msgr2=0x7f01cc147db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:10.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.431+0000 7f01d09cb700 1 --2- 172.21.15.82:0/1084030981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01cc0caa90 0x7f01cc147db0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f01c400e810 tx=0x7f01c400ebd0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.431+0000 7f01d09cb700 1 -- 172.21.15.82:0/1084030981 shutdown_connections 2023-11-28T13:01:10.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.431+0000 7f01d09cb700 1 --2- 172.21.15.82:0/1084030981 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f01ac064ee0 0x7f01ac067390 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.431+0000 7f01d09cb700 1 --2- 172.21.15.82:0/1084030981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01cc0caa90 0x7f01cc147db0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.431+0000 7f01d09cb700 1 --2- 172.21.15.82:0/1084030981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01cc071750 0x7f01cc15ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.431+0000 7f01d09cb700 1 --2- 172.21.15.82:0/1084030981 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01cc071380 0x7f01cc15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.431+0000 7f01d09cb700 1 -- 172.21.15.82:0/1084030981 >> 172.21.15.82:0/1084030981 conn(0x7f01cc0b1f50 msgr2=0x7f01cc0af130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:10.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.431+0000 7f01d09cb700 1 -- 172.21.15.82:0/1084030981 shutdown_connections 2023-11-28T13:01:10.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.431+0000 7f01d09cb700 1 -- 172.21.15.82:0/1084030981 wait complete. 2023-11-28T13:01:10.450 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T13:01:10.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.567+0000 7f6361fff700 1 Processor -- start 2023-11-28T13:01:10.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.567+0000 7f6361fff700 1 -- start start 2023-11-28T13:01:10.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f6361fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f635c06c140 0x7f635c0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:10.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f6361fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f635c0d25b0 0x7f635c06a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:10.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f6361fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f635c069bc0 con 0x7f635c0b1d10 2023-11-28T13:01:10.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f6361fff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f635c0d1480 con 0x7f635c06c140 2023-11-28T13:01:10.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f6361fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635c0cd280 con 0x7f635c0d25b0 2023-11-28T13:01:10.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f635bfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f635c06c140 0x7f635c0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:10.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f63617fe700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f635c0d25b0 0x7f635c06a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:10.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f635bfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f635c06c140 0x7f635c0cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:49040/0 (socket says 172.21.15.82:49040) 2023-11-28T13:01:10.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f635bfff700 1 -- 172.21.15.82:0/2795539412 learned_addr learned my addr 172.21.15.82:0/2795539412 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:10.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f635bfff700 1 -- 172.21.15.82:0/2795539412 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f635c0d25b0 msgr2=0x7f635c06a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:10.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f635bfff700 1 --2- 172.21.15.82:0/2795539412 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f635c0d25b0 0x7f635c06a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f635bfff700 1 -- 172.21.15.82:0/2795539412 >> v1:172.21.15.114:6789/0 conn(0x7f635c0b1d10 legacy=0x7f635c06ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:10.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f635bfff700 1 -- 172.21.15.82:0/2795539412 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635c0cd560 con 0x7f635c06c140 2023-11-28T13:01:10.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f635bfff700 1 --2- 172.21.15.82:0/2795539412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f635c06c140 0x7f635c0cec20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f634c009910 tx=0x7f634c009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdff367084a5e9b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:10.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f635b7fe700 1 -- 172.21.15.82:0/2795539412 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634c011830 con 0x7f635c06c140 2023-11-28T13:01:10.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f635b7fe700 1 -- 172.21.15.82:0/2795539412 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634c011990 con 0x7f635c06c140 2023-11-28T13:01:10.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f635b7fe700 1 -- 172.21.15.82:0/2795539412 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634c011d40 con 0x7f635c06c140 2023-11-28T13:01:10.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f6361fff700 1 -- 172.21.15.82:0/2795539412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f635c06c140 msgr2=0x7f635c0cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:10.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f6361fff700 1 --2- 172.21.15.82:0/2795539412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f635c06c140 0x7f635c0cec20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f634c009910 tx=0x7f634c009c20 comp rx=0 tx=0).stop 2023-11-28T13:01:10.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f6361fff700 1 -- 172.21.15.82:0/2795539412 shutdown_connections 2023-11-28T13:01:10.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f6361fff700 1 --2- 172.21.15.82:0/2795539412 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f635c0d25b0 0x7f635c06a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f6361fff700 1 --2- 172.21.15.82:0/2795539412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f635c06c140 0x7f635c0cec20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f6361fff700 1 -- 172.21.15.82:0/2795539412 >> 172.21.15.82:0/2795539412 conn(0x7f635c0b52a0 msgr2=0x7f635c0d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:10.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f6361fff700 1 -- 172.21.15.82:0/2795539412 shutdown_connections 2023-11-28T13:01:10.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.571+0000 7f6361fff700 1 -- 172.21.15.82:0/2795539412 wait complete. 2023-11-28T13:01:10.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.575+0000 7f6361fff700 1 Processor -- start 2023-11-28T13:01:10.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.575+0000 7f6361fff700 1 -- start start 2023-11-28T13:01:10.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.575+0000 7f6361fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f635c06c140 0x7f635c15e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:10.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.575+0000 7f6361fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f635c0b1d10 0x7f635c0b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:10.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.575+0000 7f6361fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f635c0d25b0 0x7f635c0b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:10.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.575+0000 7f6361fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635c0ca160 con 0x7f635c0d25b0 2023-11-28T13:01:10.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.575+0000 7f6361fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635c0ca440 con 0x7f635c06c140 2023-11-28T13:01:10.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.575+0000 7f6361fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635c0ca720 con 0x7f635c0b1d10 2023-11-28T13:01:10.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.575+0000 7f63617fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f635c0d25b0 0x7f635c0b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:10.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.575+0000 7f63617fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f635c0d25b0 0x7f635c0b2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40402/0 (socket says 172.21.15.82:40402) 2023-11-28T13:01:10.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.575+0000 7f63617fe700 1 -- 172.21.15.82:0/2294223697 learned_addr learned my addr 172.21.15.82:0/2294223697 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:10.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.575+0000 7f635bfff700 1 --2- 172.21.15.82:0/2294223697 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f635c0b1d10 0x7f635c0b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:10.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.575+0000 7f6360ffd700 1 --2- 172.21.15.82:0/2294223697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f635c06c140 0x7f635c15e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:10.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.575+0000 7f63617fe700 1 -- 172.21.15.82:0/2294223697 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f635c0b1d10 msgr2=0x7f635c0b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:10.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.575+0000 7f63617fe700 1 --2- 172.21.15.82:0/2294223697 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f635c0b1d10 0x7f635c0b0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.575+0000 7f63617fe700 1 -- 172.21.15.82:0/2294223697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f635c06c140 msgr2=0x7f635c15e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:10.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.575+0000 7f63617fe700 1 --2- 172.21.15.82:0/2294223697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f635c06c140 0x7f635c15e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.575+0000 7f63617fe700 1 -- 172.21.15.82:0/2294223697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c009570 con 0x7f635c0d25b0 2023-11-28T13:01:10.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.579+0000 7f63617fe700 1 --2- 172.21.15.82:0/2294223697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f635c0d25b0 0x7f635c0b2e40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f635400efc0 tx=0x7f6354009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:10.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.579+0000 7f63597fa700 1 -- 172.21.15.82:0/2294223697 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6354009b20 con 0x7f635c0d25b0 2023-11-28T13:01:10.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.579+0000 7f63597fa700 1 -- 172.21.15.82:0/2294223697 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635400f040 con 0x7f635c0d25b0 2023-11-28T13:01:10.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.579+0000 7f6361fff700 1 -- 172.21.15.82:0/2294223697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f635c0d1050 con 0x7f635c0d25b0 2023-11-28T13:01:10.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.579+0000 7f63597fa700 1 -- 172.21.15.82:0/2294223697 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635400cd40 con 0x7f635c0d25b0 2023-11-28T13:01:10.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.579+0000 7f6361fff700 1 -- 172.21.15.82:0/2294223697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f635c0b20e0 con 0x7f635c0d25b0 2023-11-28T13:01:10.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.579+0000 7f6361fff700 1 -- 172.21.15.82:0/2294223697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f635c0d11e0 con 0x7f635c0d25b0 2023-11-28T13:01:10.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.579+0000 7f63597fa700 1 -- 172.21.15.82:0/2294223697 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6354014480 con 0x7f635c0d25b0 2023-11-28T13:01:10.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.579+0000 7f63597fa700 1 --2- 172.21.15.82:0/2294223697 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6348064ee0 0x7f6348067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:10.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.579+0000 7f6360ffd700 1 --2- 172.21.15.82:0/2294223697 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6348064ee0 0x7f6348067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:10.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.579+0000 7f63597fa700 1 -- 172.21.15.82:0/2294223697 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6354082be0 con 0x7f635c0d25b0 2023-11-28T13:01:10.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.579+0000 7f6360ffd700 1 --2- 172.21.15.82:0/2294223697 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6348064ee0 0x7f6348067390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6350000f60 tx=0x7f6350009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:10.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.587+0000 7f63597fa700 1 -- 172.21.15.82:0/2294223697 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6354050bf0 con 0x7f635c0d25b0 2023-11-28T13:01:10.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.747+0000 7f6361fff700 1 -- 172.21.15.82:0/2294223697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f635c065fc0 con 0x7f635c0d25b0 2023-11-28T13:01:10.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.747+0000 7f63597fa700 1 -- 172.21.15.82:0/2294223697 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f63540180a0 con 0x7f635c0d25b0 2023-11-28T13:01:10.754 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-11-28T13:01:10.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.751+0000 7f6361fff700 1 -- 172.21.15.82:0/2294223697 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6348064ee0 msgr2=0x7f6348067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:10.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.751+0000 7f6361fff700 1 --2- 172.21.15.82:0/2294223697 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6348064ee0 0x7f6348067390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6350000f60 tx=0x7f6350009040 comp rx=0 tx=0).stop 2023-11-28T13:01:10.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.751+0000 7f6361fff700 1 -- 172.21.15.82:0/2294223697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f635c0d25b0 msgr2=0x7f635c0b2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:10.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.751+0000 7f6361fff700 1 --2- 172.21.15.82:0/2294223697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f635c0d25b0 0x7f635c0b2e40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f635400efc0 tx=0x7f6354009f60 comp rx=0 tx=0).stop 2023-11-28T13:01:10.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.751+0000 7f6361fff700 1 -- 172.21.15.82:0/2294223697 shutdown_connections 2023-11-28T13:01:10.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.751+0000 7f6361fff700 1 --2- 172.21.15.82:0/2294223697 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6348064ee0 0x7f6348067390 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.751+0000 7f6361fff700 1 --2- 172.21.15.82:0/2294223697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f635c0d25b0 0x7f635c0b2e40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.751+0000 7f6361fff700 1 --2- 172.21.15.82:0/2294223697 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f635c0b1d10 0x7f635c0b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.751+0000 7f6361fff700 1 --2- 172.21.15.82:0/2294223697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f635c06c140 0x7f635c15e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.751+0000 7f6361fff700 1 -- 172.21.15.82:0/2294223697 >> 172.21.15.82:0/2294223697 conn(0x7f635c0b52a0 msgr2=0x7f635c06a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:10.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.751+0000 7f6361fff700 1 -- 172.21.15.82:0/2294223697 shutdown_connections 2023-11-28T13:01:10.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.751+0000 7f6361fff700 1 -- 172.21.15.82:0/2294223697 wait complete. 2023-11-28T13:01:10.769 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T13:01:10.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.879+0000 7f9b73fff700 1 Processor -- start 2023-11-28T13:01:10.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.879+0000 7f9b73fff700 1 -- start start 2023-11-28T13:01:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.879+0000 7f9b73fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9b74158ed0 0x7f9b7406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.879+0000 7f9b73fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b740ae940 0x7f9b7406d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.879+0000 7f9b73fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9b740cd830 0x7f9b740710b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.879+0000 7f9b73fff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b740aee90 con 0x7f9b740cd830 2023-11-28T13:01:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.879+0000 7f9b73fff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b7415d5b0 con 0x7f9b74158ed0 2023-11-28T13:01:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.879+0000 7f9b73fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7415da40 con 0x7f9b740ae940 2023-11-28T13:01:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b737fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9b740cd830 0x7f9b740710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b737fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9b740cd830 0x7f9b740710b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40408/0 (socket says 172.21.15.82:40408) 2023-11-28T13:01:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b737fe700 1 -- 172.21.15.82:0/112988983 learned_addr learned my addr 172.21.15.82:0/112988983 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b72ffd700 1 --2- 172.21.15.82:0/112988983 >> v2:172.21.15.114:3300/0 conn(0x7f9b74158ed0 0x7f9b7406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b727fc700 1 --2- 172.21.15.82:0/112988983 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b740ae940 0x7f9b7406d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:10.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b737fe700 1 -- 172.21.15.82:0/112988983 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b740ae940 msgr2=0x7f9b7406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:10.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b737fe700 1 --2- 172.21.15.82:0/112988983 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b740ae940 0x7f9b7406d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b737fe700 1 -- 172.21.15.82:0/112988983 >> v2:172.21.15.114:3300/0 conn(0x7f9b74158ed0 msgr2=0x7f9b7406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b737fe700 1 --2- 172.21.15.82:0/112988983 >> v2:172.21.15.114:3300/0 conn(0x7f9b74158ed0 0x7f9b7406d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b737fe700 1 -- 172.21.15.82:0/112988983 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7415cc80 con 0x7f9b740cd830 2023-11-28T13:01:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b737fe700 1 --2- 172.21.15.82:0/112988983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b740cd830 0x7f9b740710b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9b7406fa90 tx=0x7f9b6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927240e64c3f17e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b71ffb700 1 -- 172.21.15.82:0/112988983 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c00e070 con 0x7f9b740cd830 2023-11-28T13:01:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b71ffb700 1 -- 172.21.15.82:0/112988983 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6c00b910 con 0x7f9b740cd830 2023-11-28T13:01:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b71ffb700 1 -- 172.21.15.82:0/112988983 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c00bcc0 con 0x7f9b740cd830 2023-11-28T13:01:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b73fff700 1 -- 172.21.15.82:0/112988983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b740cd830 msgr2=0x7f9b740710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b73fff700 1 --2- 172.21.15.82:0/112988983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b740cd830 0x7f9b740710b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9b7406fa90 tx=0x7f9b6c00b330 comp rx=0 tx=0).stop 2023-11-28T13:01:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b73fff700 1 -- 172.21.15.82:0/112988983 shutdown_connections 2023-11-28T13:01:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b73fff700 1 --2- 172.21.15.82:0/112988983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b740cd830 0x7f9b740710b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b73fff700 1 --2- 172.21.15.82:0/112988983 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b740ae940 0x7f9b7406d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b73fff700 1 --2- 172.21.15.82:0/112988983 >> v2:172.21.15.114:3300/0 conn(0x7f9b74158ed0 0x7f9b7406d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b73fff700 1 -- 172.21.15.82:0/112988983 >> 172.21.15.82:0/112988983 conn(0x7f9b740cf710 msgr2=0x7f9b740cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b73fff700 1 -- 172.21.15.82:0/112988983 shutdown_connections 2023-11-28T13:01:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.883+0000 7f9b73fff700 1 -- 172.21.15.82:0/112988983 wait complete. 2023-11-28T13:01:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b73fff700 1 Processor -- start 2023-11-28T13:01:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b73fff700 1 -- start start 2023-11-28T13:01:10.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b73fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b740ae940 0x7f9b740c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b73fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b740cd830 0x7f9b740c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b73fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b74158ed0 0x7f9b740c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b73fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b741ee370 con 0x7f9b74158ed0 2023-11-28T13:01:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b73fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b740b3530 con 0x7f9b740ae940 2023-11-28T13:01:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b73fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b740c5920 con 0x7f9b740cd830 2023-11-28T13:01:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b737fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b74158ed0 0x7f9b740c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b727fc700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b740cd830 0x7f9b740c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b72ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b740ae940 0x7f9b740c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b737fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b74158ed0 0x7f9b740c80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40412/0 (socket says 172.21.15.82:40412) 2023-11-28T13:01:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b727fc700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b740cd830 0x7f9b740c8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:50816/0 (socket says 172.21.15.82:50816) 2023-11-28T13:01:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b737fe700 1 -- 172.21.15.82:0/319113516 learned_addr learned my addr 172.21.15.82:0/319113516 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b737fe700 1 -- 172.21.15.82:0/319113516 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b740cd830 msgr2=0x7f9b740c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:10.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b737fe700 1 --2- 172.21.15.82:0/319113516 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b740cd830 0x7f9b740c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b737fe700 1 -- 172.21.15.82:0/319113516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b740ae940 msgr2=0x7f9b740c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:10.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b737fe700 1 --2- 172.21.15.82:0/319113516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b740ae940 0x7f9b740c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:10.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b737fe700 1 -- 172.21.15.82:0/319113516 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6c009b30 con 0x7f9b74158ed0 2023-11-28T13:01:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b737fe700 1 --2- 172.21.15.82:0/319113516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b74158ed0 0x7f9b740c80d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9b7406ed30 tx=0x7f9b6c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b6bfff700 1 -- 172.21.15.82:0/319113516 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c0099b0 con 0x7f9b74158ed0 2023-11-28T13:01:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b73fff700 1 -- 172.21.15.82:0/319113516 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b7415d240 con 0x7f9b74158ed0 2023-11-28T13:01:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b73fff700 1 -- 172.21.15.82:0/319113516 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7415cf60 con 0x7f9b74158ed0 2023-11-28T13:01:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b6bfff700 1 -- 172.21.15.82:0/319113516 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6c00ce80 con 0x7f9b74158ed0 2023-11-28T13:01:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.887+0000 7f9b6bfff700 1 -- 172.21.15.82:0/319113516 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c004470 con 0x7f9b74158ed0 2023-11-28T13:01:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.891+0000 7f9b73fff700 1 -- 172.21.15.82:0/319113516 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4c005310 con 0x7f9b74158ed0 2023-11-28T13:01:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.891+0000 7f9b6bfff700 1 -- 172.21.15.82:0/319113516 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9b6c02c070 con 0x7f9b74158ed0 2023-11-28T13:01:10.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.891+0000 7f9b6bfff700 1 --2- 172.21.15.82:0/319113516 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9b58064f10 0x7f9b580673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:10.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.891+0000 7f9b6bfff700 1 -- 172.21.15.82:0/319113516 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9b6c083420 con 0x7f9b74158ed0 2023-11-28T13:01:10.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.891+0000 7f9b72ffd700 1 --2- 172.21.15.82:0/319113516 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9b58064f10 0x7f9b580673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:10.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.891+0000 7f9b72ffd700 1 --2- 172.21.15.82:0/319113516 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9b58064f10 0x7f9b580673c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9b64009ad0 tx=0x7f9b64009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:10.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:10.899+0000 7f9b6bfff700 1 -- 172.21.15.82:0/319113516 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9b6c051500 con 0x7f9b74158ed0 2023-11-28T13:01:11.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.075+0000 7f9b73fff700 1 -- 172.21.15.82:0/319113516 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9b4c005b40 con 0x7f9b74158ed0 2023-11-28T13:01:11.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.079+0000 7f9b6bfff700 1 -- 172.21.15.82:0/319113516 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9b6c054b20 con 0x7f9b74158ed0 2023-11-28T13:01:11.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.079+0000 7f9b73fff700 1 -- 172.21.15.82:0/319113516 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9b58064f10 msgr2=0x7f9b580673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:11.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.079+0000 7f9b73fff700 1 --2- 172.21.15.82:0/319113516 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9b58064f10 0x7f9b580673c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9b64009ad0 tx=0x7f9b64009240 comp rx=0 tx=0).stop 2023-11-28T13:01:11.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.079+0000 7f9b73fff700 1 -- 172.21.15.82:0/319113516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b74158ed0 msgr2=0x7f9b740c80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:11.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.079+0000 7f9b73fff700 1 --2- 172.21.15.82:0/319113516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b74158ed0 0x7f9b740c80d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9b7406ed30 tx=0x7f9b6c004af0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.079+0000 7f9b73fff700 1 -- 172.21.15.82:0/319113516 shutdown_connections 2023-11-28T13:01:11.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.079+0000 7f9b73fff700 1 --2- 172.21.15.82:0/319113516 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9b58064f10 0x7f9b580673c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.079+0000 7f9b73fff700 1 --2- 172.21.15.82:0/319113516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b74158ed0 0x7f9b740c80d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.079+0000 7f9b73fff700 1 --2- 172.21.15.82:0/319113516 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b740cd830 0x7f9b740c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.079+0000 7f9b73fff700 1 --2- 172.21.15.82:0/319113516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b740ae940 0x7f9b740c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.079+0000 7f9b73fff700 1 -- 172.21.15.82:0/319113516 >> 172.21.15.82:0/319113516 conn(0x7f9b740cf710 msgr2=0x7f9b740cb860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:11.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.079+0000 7f9b73fff700 1 -- 172.21.15.82:0/319113516 shutdown_connections 2023-11-28T13:01:11.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.079+0000 7f9b73fff700 1 -- 172.21.15.82:0/319113516 wait complete. 2023-11-28T13:01:11.086 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2023-11-28T13:01:11.096 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2023-11-28T13:01:11.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:11.096 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-28T13:01:11.108 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:01:11.108 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-11-28T13:01:11.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:11.109 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T13:01:11.156 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:01:11.157 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:01:11.164 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:01:11.164 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:01:11.172 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:01:11.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.283+0000 7fcf8093e700 1 Processor -- start 2023-11-28T13:01:11.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.283+0000 7fcf8093e700 1 -- start start 2023-11-28T13:01:11.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.283+0000 7fcf8093e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcf7c0b3910 0x7fcf7c06b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:11.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.283+0000 7fcf8093e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf7c06c910 0x7fcf7c06d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:11.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.283+0000 7fcf8093e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7c06c480 con 0x7fcf7c070070 2023-11-28T13:01:11.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.283+0000 7fcf8093e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf7c06dbe0 con 0x7fcf7c0b3910 2023-11-28T13:01:11.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.283+0000 7fcf8093e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c06dec0 con 0x7fcf7c06c910 2023-11-28T13:01:11.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.283+0000 7fcf7ad9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcf7c0b3910 0x7fcf7c06b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:11.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.283+0000 7fcf7ad9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcf7c0b3910 0x7fcf7c06b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40418/0 (socket says 172.21.15.82:40418) 2023-11-28T13:01:11.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.283+0000 7fcf7ad9d700 1 -- 172.21.15.82:0/2673667973 learned_addr learned my addr 172.21.15.82:0/2673667973 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:11.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.287+0000 7fcf7a59c700 1 --2- 172.21.15.82:0/2673667973 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf7c06c910 0x7fcf7c06d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:11.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.287+0000 7fcf7ad9d700 1 -- 172.21.15.82:0/2673667973 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf7c06c910 msgr2=0x7fcf7c06d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:11.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.287+0000 7fcf7ad9d700 1 --2- 172.21.15.82:0/2673667973 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf7c06c910 0x7fcf7c06d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.287+0000 7fcf7ad9d700 1 -- 172.21.15.82:0/2673667973 >> v1:172.21.15.114:6789/0 conn(0x7fcf7c070070 legacy=0x7fcf7c15db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:11.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.287+0000 7fcf7ad9d700 1 -- 172.21.15.82:0/2673667973 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c06c110 con 0x7fcf7c0b3910 2023-11-28T13:01:11.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.287+0000 7fcf7a59c700 1 --2- 172.21.15.82:0/2673667973 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf7c06c910 0x7fcf7c06d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:11.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.287+0000 7fcf7ad9d700 1 --2- 172.21.15.82:0/2673667973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf7c0b3910 0x7fcf7c06b0a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009910 tx=0x7fcf64009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc89560546dfed6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:11.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.287+0000 7fcf79d9b700 1 -- 172.21.15.82:0/2673667973 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6400ba60 con 0x7fcf7c0b3910 2023-11-28T13:01:11.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.287+0000 7fcf79d9b700 1 -- 172.21.15.82:0/2673667973 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6400bbc0 con 0x7fcf7c0b3910 2023-11-28T13:01:11.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.287+0000 7fcf79d9b700 1 -- 172.21.15.82:0/2673667973 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64009e60 con 0x7fcf7c0b3910 2023-11-28T13:01:11.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.287+0000 7fcf8093e700 1 -- 172.21.15.82:0/2673667973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf7c0b3910 msgr2=0x7fcf7c06b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:11.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.287+0000 7fcf8093e700 1 --2- 172.21.15.82:0/2673667973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf7c0b3910 0x7fcf7c06b0a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009910 tx=0x7fcf64009c20 comp rx=0 tx=0).stop 2023-11-28T13:01:11.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.287+0000 7fcf8093e700 1 -- 172.21.15.82:0/2673667973 shutdown_connections 2023-11-28T13:01:11.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.287+0000 7fcf8093e700 1 --2- 172.21.15.82:0/2673667973 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf7c06c910 0x7fcf7c06d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.287+0000 7fcf8093e700 1 --2- 172.21.15.82:0/2673667973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf7c0b3910 0x7fcf7c06b0a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.287+0000 7fcf8093e700 1 -- 172.21.15.82:0/2673667973 >> 172.21.15.82:0/2673667973 conn(0x7fcf7c0ce600 msgr2=0x7fcf7c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:11.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.287+0000 7fcf8093e700 1 -- 172.21.15.82:0/2673667973 shutdown_connections 2023-11-28T13:01:11.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.287+0000 7fcf8093e700 1 -- 172.21.15.82:0/2673667973 wait complete. 2023-11-28T13:01:11.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.287+0000 7fcf8093e700 1 Processor -- start 2023-11-28T13:01:11.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.287+0000 7fcf8093e700 1 -- start start 2023-11-28T13:01:11.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf8093e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf7c06c910 0x7fcf7c155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:11.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf8093e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf7c070070 0x7fcf7c0c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:11.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf8093e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf7c0c8220 0x7fcf7c14c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:11.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf8093e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c1f1d90 con 0x7fcf7c0c8220 2023-11-28T13:01:11.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf8093e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c0abd20 con 0x7fcf7c070070 2023-11-28T13:01:11.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf8093e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c0c86c0 con 0x7fcf7c06c910 2023-11-28T13:01:11.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf7b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf7c0c8220 0x7fcf7c14c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:11.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf7b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf7c0c8220 0x7fcf7c14c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40426/0 (socket says 172.21.15.82:40426) 2023-11-28T13:01:11.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf7b59e700 1 -- 172.21.15.82:0/1342506239 learned_addr learned my addr 172.21.15.82:0/1342506239 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:11.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf7a59c700 1 --2- 172.21.15.82:0/1342506239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf7c070070 0x7fcf7c0c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:11.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf7ad9d700 1 --2- 172.21.15.82:0/1342506239 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf7c06c910 0x7fcf7c155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:11.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf7b59e700 1 -- 172.21.15.82:0/1342506239 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf7c06c910 msgr2=0x7fcf7c155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:11.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf7b59e700 1 --2- 172.21.15.82:0/1342506239 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf7c06c910 0x7fcf7c155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf7b59e700 1 -- 172.21.15.82:0/1342506239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf7c070070 msgr2=0x7fcf7c0c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:11.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf7b59e700 1 --2- 172.21.15.82:0/1342506239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf7c070070 0x7fcf7c0c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf7b59e700 1 -- 172.21.15.82:0/1342506239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf64009570 con 0x7fcf7c0c8220 2023-11-28T13:01:11.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf7b59e700 1 --2- 172.21.15.82:0/1342506239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf7c0c8220 0x7fcf7c14c610 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400cc50 tx=0x7fcf7400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:11.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf737fe700 1 -- 172.21.15.82:0/1342506239 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf74003c20 con 0x7fcf7c0c8220 2023-11-28T13:01:11.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf737fe700 1 -- 172.21.15.82:0/1342506239 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf74003d80 con 0x7fcf7c0c8220 2023-11-28T13:01:11.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf8093e700 1 -- 172.21.15.82:0/1342506239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7c06d860 con 0x7fcf7c0c8220 2023-11-28T13:01:11.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf737fe700 1 -- 172.21.15.82:0/1342506239 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7400aab0 con 0x7fcf7c0c8220 2023-11-28T13:01:11.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf8093e700 1 -- 172.21.15.82:0/1342506239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7c0c8f80 con 0x7fcf7c0c8220 2023-11-28T13:01:11.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.291+0000 7fcf8093e700 1 -- 172.21.15.82:0/1342506239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf7c0b3ce0 con 0x7fcf7c0c8220 2023-11-28T13:01:11.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.295+0000 7fcf737fe700 1 -- 172.21.15.82:0/1342506239 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcf74010050 con 0x7fcf7c0c8220 2023-11-28T13:01:11.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.295+0000 7fcf737fe700 1 --2- 172.21.15.82:0/1342506239 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcf5c064ee0 0x7fcf5c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:11.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.295+0000 7fcf737fe700 1 -- 172.21.15.82:0/1342506239 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fcf74081e10 con 0x7fcf7c0c8220 2023-11-28T13:01:11.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.295+0000 7fcf7ad9d700 1 --2- 172.21.15.82:0/1342506239 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcf5c064ee0 0x7fcf5c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:11.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.295+0000 7fcf7ad9d700 1 --2- 172.21.15.82:0/1342506239 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcf5c064ee0 0x7fcf5c067390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c06e580 tx=0x7fcf64008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:11.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.303+0000 7fcf737fe700 1 -- 172.21.15.82:0/1342506239 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcf74085030 con 0x7fcf7c0c8220 2023-11-28T13:01:11.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.463+0000 7fcf8093e700 1 -- 172.21.15.82:0/1342506239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf7c065fc0 con 0x7fcf7c0c8220 2023-11-28T13:01:11.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.467+0000 7fcf737fe700 1 -- 172.21.15.82:0/1342506239 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17907 (secure 0 0 0) 0x7fcf7404fe80 con 0x7fcf7c0c8220 2023-11-28T13:01:11.471 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:11.471 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:01:08.993802+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:00:24.360641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T13:00:24.960863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.26","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:01:11.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.467+0000 7fcf8093e700 1 -- 172.21.15.82:0/1342506239 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcf5c064ee0 msgr2=0x7fcf5c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:11.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.467+0000 7fcf8093e700 1 --2- 172.21.15.82:0/1342506239 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcf5c064ee0 0x7fcf5c067390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c06e580 tx=0x7fcf64008030 comp rx=0 tx=0).stop 2023-11-28T13:01:11.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.467+0000 7fcf8093e700 1 -- 172.21.15.82:0/1342506239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf7c0c8220 msgr2=0x7fcf7c14c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:11.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.467+0000 7fcf8093e700 1 --2- 172.21.15.82:0/1342506239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf7c0c8220 0x7fcf7c14c610 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400cc50 tx=0x7fcf7400cf60 comp rx=0 tx=0).stop 2023-11-28T13:01:11.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.467+0000 7fcf8093e700 1 -- 172.21.15.82:0/1342506239 shutdown_connections 2023-11-28T13:01:11.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.467+0000 7fcf8093e700 1 --2- 172.21.15.82:0/1342506239 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcf5c064ee0 0x7fcf5c067390 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.467+0000 7fcf8093e700 1 --2- 172.21.15.82:0/1342506239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf7c0c8220 0x7fcf7c14c610 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.467+0000 7fcf8093e700 1 --2- 172.21.15.82:0/1342506239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf7c070070 0x7fcf7c0c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.467+0000 7fcf8093e700 1 --2- 172.21.15.82:0/1342506239 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf7c06c910 0x7fcf7c155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.467+0000 7fcf8093e700 1 -- 172.21.15.82:0/1342506239 >> 172.21.15.82:0/1342506239 conn(0x7fcf7c0ce600 msgr2=0x7fcf7c0704b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:11.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.467+0000 7fcf8093e700 1 -- 172.21.15.82:0/1342506239 shutdown_connections 2023-11-28T13:01:11.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.467+0000 7fcf8093e700 1 -- 172.21.15.82:0/1342506239 wait complete. 2023-11-28T13:01:11.486 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T13:00:24.360641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T13:00:24.960863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:01:11.487 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:01:11.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.603+0000 7f26b759e700 1 Processor -- start 2023-11-28T13:01:11.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.603+0000 7f26b759e700 1 -- start start 2023-11-28T13:01:11.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.603+0000 7f26b759e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f26b80b1d10 0x7f26b80cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:11.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.603+0000 7f26b759e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b8069bc0 con 0x7f26b806c140 2023-11-28T13:01:11.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.603+0000 7f26b759e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b80d1480 con 0x7f26b80d25b0 2023-11-28T13:01:11.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.603+0000 7f26b759e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b80cd280 con 0x7f26b80b1d10 2023-11-28T13:01:11.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.607+0000 7f26b6d9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f26b806c140 0x7f26b806a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50222/0 (socket says 172.21.15.82:50222) 2023-11-28T13:01:11.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.607+0000 7f26b6d9d700 1 -- 172.21.15.82:0/3958965224 learned_addr learned my addr 172.21.15.82:0/3958965224 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:11.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.607+0000 7f26b659c700 1 --2- 172.21.15.82:0/3958965224 >> v2:172.21.15.114:3300/0 conn(0x7f26b80b1d10 0x7f26b80cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:11.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.607+0000 7f26b559a700 1 -- 172.21.15.82:0/3958965224 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765927570 0 0) 0x7f26b8069bc0 con 0x7f26b806c140 2023-11-28T13:01:11.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.607+0000 7f26b559a700 1 -- 172.21.15.82:0/3958965224 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26a00035d0 con 0x7f26b806c140 2023-11-28T13:01:11.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.607+0000 7f26b659c700 1 -- 172.21.15.82:0/3958965224 >> v1:172.21.15.114:6789/0 conn(0x7f26b80d25b0 legacy=0x7f26b806ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:11.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.607+0000 7f26b659c700 1 -- 172.21.15.82:0/3958965224 >> v1:172.21.15.82:6789/0 conn(0x7f26b806c140 legacy=0x7f26b806a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:11.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.607+0000 7f26b559a700 1 -- 172.21.15.82:0/3958965224 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546879333 0 0) 0x7f26b80d1480 con 0x7f26b80d25b0 2023-11-28T13:01:11.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.607+0000 7f26b659c700 1 -- 172.21.15.82:0/3958965224 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b80cd560 con 0x7f26b80b1d10 2023-11-28T13:01:11.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.607+0000 7f26b659c700 1 --2- 172.21.15.82:0/3958965224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26b80b1d10 0x7f26b80cec20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f26a8009850 tx=0x7f26a8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52e2e9d91342ff58 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:11.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.607+0000 7f26b559a700 1 -- 172.21.15.82:0/3958965224 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a8011830 con 0x7f26b80b1d10 2023-11-28T13:01:11.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.607+0000 7f26b559a700 1 -- 172.21.15.82:0/3958965224 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a8011990 con 0x7f26b80b1d10 2023-11-28T13:01:11.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.607+0000 7f26b559a700 1 -- 172.21.15.82:0/3958965224 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a8011d40 con 0x7f26b80b1d10 2023-11-28T13:01:11.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.607+0000 7f26b759e700 1 -- 172.21.15.82:0/3958965224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26b80b1d10 msgr2=0x7f26b80cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:11.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.607+0000 7f26b759e700 1 --2- 172.21.15.82:0/3958965224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26b80b1d10 0x7f26b80cec20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f26a8009850 tx=0x7f26a8009b60 comp rx=0 tx=0).stop 2023-11-28T13:01:11.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.607+0000 7f26b759e700 1 -- 172.21.15.82:0/3958965224 shutdown_connections 2023-11-28T13:01:11.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.607+0000 7f26b759e700 1 --2- 172.21.15.82:0/3958965224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26b80b1d10 0x7f26b80cec20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.607+0000 7f26b759e700 1 -- 172.21.15.82:0/3958965224 >> 172.21.15.82:0/3958965224 conn(0x7f26b80b52a0 msgr2=0x7f26b80d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:11.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.607+0000 7f26b759e700 1 -- 172.21.15.82:0/3958965224 shutdown_connections 2023-11-28T13:01:11.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.607+0000 7f26b759e700 1 -- 172.21.15.82:0/3958965224 wait complete. 2023-11-28T13:01:11.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26b759e700 1 Processor -- start 2023-11-28T13:01:11.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26b759e700 1 -- start start 2023-11-28T13:01:11.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26b759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26b806c140 0x7f26b80c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:11.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26b759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26b80b1d10 0x7f26b8150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:11.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26b759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26b80d25b0 0x7f26b8160010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:11.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26b759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b80caa00 con 0x7f26b80d25b0 2023-11-28T13:01:11.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26b759e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b81f4d80 con 0x7f26b80b1d10 2023-11-28T13:01:11.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26b759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b81f5060 con 0x7f26b806c140 2023-11-28T13:01:11.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26b6d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26b80d25b0 0x7f26b8160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:11.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26b6d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26b80d25b0 0x7f26b8160010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40432/0 (socket says 172.21.15.82:40432) 2023-11-28T13:01:11.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26b6d9d700 1 -- 172.21.15.82:0/580380554 learned_addr learned my addr 172.21.15.82:0/580380554 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:11.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26b5d9b700 1 --2- 172.21.15.82:0/580380554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26b80b1d10 0x7f26b8150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:11.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26b659c700 1 --2- 172.21.15.82:0/580380554 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26b806c140 0x7f26b80c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:11.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26b6d9d700 1 -- 172.21.15.82:0/580380554 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26b806c140 msgr2=0x7f26b80c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:11.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26b6d9d700 1 --2- 172.21.15.82:0/580380554 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26b806c140 0x7f26b80c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26b6d9d700 1 -- 172.21.15.82:0/580380554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26b80b1d10 msgr2=0x7f26b8150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:11.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26b6d9d700 1 --2- 172.21.15.82:0/580380554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26b80b1d10 0x7f26b8150aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26b6d9d700 1 -- 172.21.15.82:0/580380554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a80094b0 con 0x7f26b80d25b0 2023-11-28T13:01:11.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26b659c700 1 --2- 172.21.15.82:0/580380554 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26b806c140 0x7f26b80c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:11.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26b6d9d700 1 --2- 172.21.15.82:0/580380554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26b80d25b0 0x7f26b8160010 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f26b0002230 tx=0x7f26b000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:11.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26a6ffd700 1 -- 172.21.15.82:0/580380554 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b0007480 con 0x7f26b80d25b0 2023-11-28T13:01:11.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26a6ffd700 1 -- 172.21.15.82:0/580380554 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b00075e0 con 0x7f26b80d25b0 2023-11-28T13:01:11.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26b759e700 1 -- 172.21.15.82:0/580380554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b80d1050 con 0x7f26b80d25b0 2023-11-28T13:01:11.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.611+0000 7f26a6ffd700 1 -- 172.21.15.82:0/580380554 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b0007950 con 0x7f26b80d25b0 2023-11-28T13:01:11.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.615+0000 7f26b759e700 1 -- 172.21.15.82:0/580380554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b80b20e0 con 0x7f26b80d25b0 2023-11-28T13:01:11.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.615+0000 7f26b759e700 1 -- 172.21.15.82:0/580380554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b80d11e0 con 0x7f26b80d25b0 2023-11-28T13:01:11.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.615+0000 7f26a6ffd700 1 -- 172.21.15.82:0/580380554 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f26b0019030 con 0x7f26b80d25b0 2023-11-28T13:01:11.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.615+0000 7f26a6ffd700 1 --2- 172.21.15.82:0/580380554 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2698064ee0 0x7f2698067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:11.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.615+0000 7f26b659c700 1 --2- 172.21.15.82:0/580380554 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2698064ee0 0x7f2698067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:11.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.615+0000 7f26a6ffd700 1 -- 172.21.15.82:0/580380554 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f26b00815c0 con 0x7f26b80d25b0 2023-11-28T13:01:11.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.615+0000 7f26b659c700 1 --2- 172.21.15.82:0/580380554 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2698064ee0 0x7f2698067390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f26a80090b0 tx=0x7f26a8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:11.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.623+0000 7f26a6ffd700 1 -- 172.21.15.82:0/580380554 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f26b004a400 con 0x7f26b80d25b0 2023-11-28T13:01:11.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.779+0000 7f26b759e700 1 -- 172.21.15.82:0/580380554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f26b81f5520 con 0x7f26b80d25b0 2023-11-28T13:01:11.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.779+0000 7f26a6ffd700 1 -- 172.21.15.82:0/580380554 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f26b00170a0 con 0x7f26b80d25b0 2023-11-28T13:01:11.786 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:01:11.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.783+0000 7f26b759e700 1 -- 172.21.15.82:0/580380554 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2698064ee0 msgr2=0x7f2698067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:11.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.783+0000 7f26b759e700 1 --2- 172.21.15.82:0/580380554 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2698064ee0 0x7f2698067390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f26a80090b0 tx=0x7f26a8008030 comp rx=0 tx=0).stop 2023-11-28T13:01:11.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.783+0000 7f26b759e700 1 -- 172.21.15.82:0/580380554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26b80d25b0 msgr2=0x7f26b8160010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:11.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.783+0000 7f26b759e700 1 --2- 172.21.15.82:0/580380554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26b80d25b0 0x7f26b8160010 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f26b0002230 tx=0x7f26b000cae0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.783+0000 7f26b759e700 1 -- 172.21.15.82:0/580380554 shutdown_connections 2023-11-28T13:01:11.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.783+0000 7f26b759e700 1 --2- 172.21.15.82:0/580380554 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2698064ee0 0x7f2698067390 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.783+0000 7f26b759e700 1 --2- 172.21.15.82:0/580380554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26b80d25b0 0x7f26b8160010 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.783+0000 7f26b759e700 1 --2- 172.21.15.82:0/580380554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26b80b1d10 0x7f26b8150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.783+0000 7f26b759e700 1 --2- 172.21.15.82:0/580380554 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26b806c140 0x7f26b80c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.783+0000 7f26b759e700 1 -- 172.21.15.82:0/580380554 >> 172.21.15.82:0/580380554 conn(0x7f26b80b52a0 msgr2=0x7f26b815b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:11.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.783+0000 7f26b759e700 1 -- 172.21.15.82:0/580380554 shutdown_connections 2023-11-28T13:01:11.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.783+0000 7f26b759e700 1 -- 172.21.15.82:0/580380554 wait complete. 2023-11-28T13:01:11.801 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:01:11.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.915+0000 7faae6290700 1 Processor -- start 2023-11-28T13:01:11.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.915+0000 7faae6290700 1 -- start start 2023-11-28T13:01:11.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae6290700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faae0158720 0x7faae00b0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:11.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae6290700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faae006a450 0x7faae006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:11.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae6290700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae00b0790 con 0x7faae0071130 2023-11-28T13:01:11.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae6290700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae006ae00 con 0x7faae006a450 2023-11-28T13:01:11.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae6290700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae0158af0 con 0x7faae0158720 2023-11-28T13:01:11.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae4a8d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faae006a450 0x7faae006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:11.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae528e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faae0158720 0x7faae00b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:11.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae4a8d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faae006a450 0x7faae006a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:49124/0 (socket says 172.21.15.82:49124) 2023-11-28T13:01:11.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae5a8f700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7faae0071130 0x7faae00715b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:39312/0 (socket says 172.21.15.82:39312) 2023-11-28T13:01:11.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae4a8d700 1 -- 172.21.15.82:0/1632400303 learned_addr learned my addr 172.21.15.82:0/1632400303 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:11.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae528e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faae0158720 0x7faae00b0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:50860/0 (socket says 172.21.15.82:50860) 2023-11-28T13:01:11.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae4a8d700 1 -- 172.21.15.82:0/1632400303 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faae0158720 msgr2=0x7faae00b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:11.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae4a8d700 1 --2- 172.21.15.82:0/1632400303 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faae0158720 0x7faae00b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae4a8d700 1 -- 172.21.15.82:0/1632400303 >> v1:172.21.15.114:6789/0 conn(0x7faae0071130 legacy=0x7faae00715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:11.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae4a8d700 1 -- 172.21.15.82:0/1632400303 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae00af490 con 0x7faae006a450 2023-11-28T13:01:11.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae528e700 1 --2- 172.21.15.82:0/1632400303 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faae0158720 0x7faae00b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:11.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae4a8d700 1 --2- 172.21.15.82:0/1632400303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faae006a450 0x7faae006a8c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faadc009910 tx=0x7faadc009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a95dad23e4c09ce server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:11.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faad3fff700 1 -- 172.21.15.82:0/1632400303 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc011830 con 0x7faae006a450 2023-11-28T13:01:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faad3fff700 1 -- 172.21.15.82:0/1632400303 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faadc011990 con 0x7faae006a450 2023-11-28T13:01:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faad3fff700 1 -- 172.21.15.82:0/1632400303 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc011d40 con 0x7faae006a450 2023-11-28T13:01:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae6290700 1 -- 172.21.15.82:0/1632400303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faae006a450 msgr2=0x7faae006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae6290700 1 --2- 172.21.15.82:0/1632400303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faae006a450 0x7faae006a8c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faadc009910 tx=0x7faadc009c20 comp rx=0 tx=0).stop 2023-11-28T13:01:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae6290700 1 -- 172.21.15.82:0/1632400303 shutdown_connections 2023-11-28T13:01:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae6290700 1 --2- 172.21.15.82:0/1632400303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faae006a450 0x7faae006a8c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae6290700 1 --2- 172.21.15.82:0/1632400303 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faae0158720 0x7faae00b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae6290700 1 -- 172.21.15.82:0/1632400303 >> 172.21.15.82:0/1632400303 conn(0x7faae00ce630 msgr2=0x7faae00cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.919+0000 7faae6290700 1 -- 172.21.15.82:0/1632400303 shutdown_connections 2023-11-28T13:01:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.923+0000 7faae6290700 1 -- 172.21.15.82:0/1632400303 wait complete. 2023-11-28T13:01:11.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.923+0000 7faae6290700 1 Processor -- start 2023-11-28T13:01:11.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.923+0000 7faae6290700 1 -- start start 2023-11-28T13:01:11.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.923+0000 7faae6290700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faae006a450 0x7faae015a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:11.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.923+0000 7faae6290700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae0071130 0x7faae014e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:11.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.923+0000 7faae6290700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faae0158720 0x7faae014c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:11.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.923+0000 7faae6290700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae014eab0 con 0x7faae0071130 2023-11-28T13:01:11.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.923+0000 7faae6290700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae0159790 con 0x7faae0158720 2023-11-28T13:01:11.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.923+0000 7faae6290700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae0159a70 con 0x7faae006a450 2023-11-28T13:01:11.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.923+0000 7faae4a8d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae0071130 0x7faae014e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:11.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.923+0000 7faae4a8d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae0071130 0x7faae014e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40444/0 (socket says 172.21.15.82:40444) 2023-11-28T13:01:11.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.923+0000 7faae4a8d700 1 -- 172.21.15.82:0/2933361590 learned_addr learned my addr 172.21.15.82:0/2933361590 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:11.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.923+0000 7faae5a8f700 1 --2- 172.21.15.82:0/2933361590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faae0158720 0x7faae014c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:11.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.923+0000 7faae528e700 1 --2- 172.21.15.82:0/2933361590 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faae006a450 0x7faae015a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:11.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.923+0000 7faae5a8f700 1 -- 172.21.15.82:0/2933361590 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faae006a450 msgr2=0x7faae015a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:11.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.923+0000 7faae5a8f700 1 --2- 172.21.15.82:0/2933361590 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faae006a450 0x7faae015a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.927+0000 7faae5a8f700 1 -- 172.21.15.82:0/2933361590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae0071130 msgr2=0x7faae014e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:11.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.927+0000 7faae5a8f700 1 --2- 172.21.15.82:0/2933361590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae0071130 0x7faae014e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:11.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.927+0000 7faae5a8f700 1 -- 172.21.15.82:0/2933361590 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad40094b0 con 0x7faae0158720 2023-11-28T13:01:11.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.927+0000 7faae5a8f700 1 --2- 172.21.15.82:0/2933361590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faae0158720 0x7faae014c140 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faad800cb10 tx=0x7faad800ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:11.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.927+0000 7faad1ffb700 1 -- 172.21.15.82:0/2933361590 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad800a9e0 con 0x7faae0158720 2023-11-28T13:01:11.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.927+0000 7faad1ffb700 1 -- 172.21.15.82:0/2933361590 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad800ab40 con 0x7faae0158720 2023-11-28T13:01:11.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.927+0000 7faae6290700 1 -- 172.21.15.82:0/2933361590 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc009570 con 0x7faae0158720 2023-11-28T13:01:11.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.927+0000 7faad1ffb700 1 -- 172.21.15.82:0/2933361590 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad8007070 con 0x7faae0158720 2023-11-28T13:01:11.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.927+0000 7faae6290700 1 -- 172.21.15.82:0/2933361590 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae00afa50 con 0x7faae0158720 2023-11-28T13:01:11.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.927+0000 7faae6290700 1 -- 172.21.15.82:0/2933361590 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae00af770 con 0x7faae0158720 2023-11-28T13:01:11.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.927+0000 7faad1ffb700 1 -- 172.21.15.82:0/2933361590 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faad8019030 con 0x7faae0158720 2023-11-28T13:01:11.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.927+0000 7faad1ffb700 1 --2- 172.21.15.82:0/2933361590 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7faac4064ee0 0x7faac4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:11.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.927+0000 7faad1ffb700 1 -- 172.21.15.82:0/2933361590 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7faad8081bc0 con 0x7faae0158720 2023-11-28T13:01:11.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.927+0000 7faae528e700 1 --2- 172.21.15.82:0/2933361590 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7faac4064ee0 0x7faac4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:11.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.931+0000 7faae528e700 1 --2- 172.21.15.82:0/2933361590 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7faac4064ee0 0x7faac4067390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faad4009ce0 tx=0x7faad4009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:11.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:11.935+0000 7faad1ffb700 1 -- 172.21.15.82:0/2933361590 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faad804fce0 con 0x7faae0158720 2023-11-28T13:01:12.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.103+0000 7faae6290700 1 -- 172.21.15.82:0/2933361590 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faae00afd30 con 0x7faae0158720 2023-11-28T13:01:12.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.103+0000 7faad1ffb700 1 -- 172.21.15.82:0/2933361590 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7faad8017020 con 0x7faae0158720 2023-11-28T13:01:12.108 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:01:12.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.103+0000 7faae6290700 1 -- 172.21.15.82:0/2933361590 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7faac4064ee0 msgr2=0x7faac4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:12.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.103+0000 7faae6290700 1 --2- 172.21.15.82:0/2933361590 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7faac4064ee0 0x7faac4067390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faad4009ce0 tx=0x7faad4009240 comp rx=0 tx=0).stop 2023-11-28T13:01:12.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.103+0000 7faae6290700 1 -- 172.21.15.82:0/2933361590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faae0158720 msgr2=0x7faae014c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:12.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.103+0000 7faae6290700 1 --2- 172.21.15.82:0/2933361590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faae0158720 0x7faae014c140 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faad800cb10 tx=0x7faad800ce20 comp rx=0 tx=0).stop 2023-11-28T13:01:12.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.103+0000 7faae6290700 1 -- 172.21.15.82:0/2933361590 shutdown_connections 2023-11-28T13:01:12.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.103+0000 7faae6290700 1 --2- 172.21.15.82:0/2933361590 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7faac4064ee0 0x7faac4067390 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.103+0000 7faae6290700 1 --2- 172.21.15.82:0/2933361590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faae0158720 0x7faae014c140 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.103+0000 7faae6290700 1 --2- 172.21.15.82:0/2933361590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae0071130 0x7faae014e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.103+0000 7faae6290700 1 --2- 172.21.15.82:0/2933361590 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faae006a450 0x7faae015a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.103+0000 7faae6290700 1 -- 172.21.15.82:0/2933361590 >> 172.21.15.82:0/2933361590 conn(0x7faae00ce630 msgr2=0x7faae00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:12.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.103+0000 7faae6290700 1 -- 172.21.15.82:0/2933361590 shutdown_connections 2023-11-28T13:01:12.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.103+0000 7faae6290700 1 -- 172.21.15.82:0/2933361590 wait complete. 2023-11-28T13:01:12.122 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T13:01:12.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.235+0000 7feb9ce29700 1 Processor -- start 2023-11-28T13:01:12.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.235+0000 7feb9ce29700 1 -- start start 2023-11-28T13:01:12.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.235+0000 7feb9ce29700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feb98158720 0x7feb980b0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:12.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.235+0000 7feb9ce29700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feb9806a450 0x7feb9806a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:12.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.235+0000 7feb9ce29700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb98069bc0 0x7feb98071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:12.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.235+0000 7feb9ce29700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9806ae30 con 0x7feb98158720 2023-11-28T13:01:12.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.235+0000 7feb9ce29700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb980b0790 con 0x7feb9806a450 2023-11-28T13:01:12.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.235+0000 7feb9ce29700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb98158af0 con 0x7feb98069bc0 2023-11-28T13:01:12.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.235+0000 7feb977fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feb98158720 0x7feb980b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:12.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.235+0000 7feb977fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feb98158720 0x7feb980b0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40450/0 (socket says 172.21.15.82:40450) 2023-11-28T13:01:12.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.235+0000 7feb977fe700 1 -- 172.21.15.82:0/1493665336 learned_addr learned my addr 172.21.15.82:0/1493665336 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:12.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.235+0000 7feb96ffd700 1 --2- 172.21.15.82:0/1493665336 >> v2:172.21.15.114:3300/0 conn(0x7feb9806a450 0x7feb9806a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:12.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.235+0000 7feb97fff700 1 --2- 172.21.15.82:0/1493665336 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb98069bc0 0x7feb98071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:12.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.235+0000 7feb977fe700 1 -- 172.21.15.82:0/1493665336 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb98069bc0 msgr2=0x7feb98071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:12.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.235+0000 7feb977fe700 1 --2- 172.21.15.82:0/1493665336 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb98069bc0 0x7feb98071130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.235+0000 7feb977fe700 1 -- 172.21.15.82:0/1493665336 >> v2:172.21.15.114:3300/0 conn(0x7feb9806a450 msgr2=0x7feb9806a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:12.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.235+0000 7feb977fe700 1 --2- 172.21.15.82:0/1493665336 >> v2:172.21.15.114:3300/0 conn(0x7feb9806a450 0x7feb9806a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.235+0000 7feb977fe700 1 -- 172.21.15.82:0/1493665336 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb980af490 con 0x7feb98158720 2023-11-28T13:01:12.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.239+0000 7feb977fe700 1 --2- 172.21.15.82:0/1493665336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb98158720 0x7feb980b0250 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7feb980cf530 tx=0x7feb90009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fb773652b2b913 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:12.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.239+0000 7feb967fc700 1 -- 172.21.15.82:0/1493665336 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9000b8a0 con 0x7feb98158720 2023-11-28T13:01:12.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.239+0000 7feb967fc700 1 -- 172.21.15.82:0/1493665336 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9000ba00 con 0x7feb98158720 2023-11-28T13:01:12.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.239+0000 7feb967fc700 1 -- 172.21.15.82:0/1493665336 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9000bd90 con 0x7feb98158720 2023-11-28T13:01:12.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.239+0000 7feb9ce29700 1 -- 172.21.15.82:0/1493665336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb98158720 msgr2=0x7feb980b0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:12.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.239+0000 7feb9ce29700 1 --2- 172.21.15.82:0/1493665336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb98158720 0x7feb980b0250 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7feb980cf530 tx=0x7feb90009bf0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.239+0000 7feb9ce29700 1 -- 172.21.15.82:0/1493665336 shutdown_connections 2023-11-28T13:01:12.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.239+0000 7feb9ce29700 1 --2- 172.21.15.82:0/1493665336 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb98069bc0 0x7feb98071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.239+0000 7feb9ce29700 1 --2- 172.21.15.82:0/1493665336 >> v2:172.21.15.114:3300/0 conn(0x7feb9806a450 0x7feb9806a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.239+0000 7feb9ce29700 1 --2- 172.21.15.82:0/1493665336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb98158720 0x7feb980b0250 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.239+0000 7feb9ce29700 1 -- 172.21.15.82:0/1493665336 >> 172.21.15.82:0/1493665336 conn(0x7feb980ce630 msgr2=0x7feb980cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:12.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.239+0000 7feb9ce29700 1 -- 172.21.15.82:0/1493665336 shutdown_connections 2023-11-28T13:01:12.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.239+0000 7feb9ce29700 1 -- 172.21.15.82:0/1493665336 wait complete. 2023-11-28T13:01:12.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.239+0000 7feb9ce29700 1 Processor -- start 2023-11-28T13:01:12.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.239+0000 7feb9ce29700 1 -- start start 2023-11-28T13:01:12.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb9ce29700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb98069bc0 0x7feb9813f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:12.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb9ce29700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb9806a450 0x7feb981f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:12.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb9ce29700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb98158720 0x7feb98154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:12.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb9ce29700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb981f4bd0 con 0x7feb9806a450 2023-11-28T13:01:12.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb9ce29700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb981f3fc0 con 0x7feb98158720 2023-11-28T13:01:12.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb9ce29700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb981f42a0 con 0x7feb98069bc0 2023-11-28T13:01:12.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb96ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb9806a450 0x7feb981f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:12.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb96ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb9806a450 0x7feb981f36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40464/0 (socket says 172.21.15.82:40464) 2023-11-28T13:01:12.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb96ffd700 1 -- 172.21.15.82:0/2902038831 learned_addr learned my addr 172.21.15.82:0/2902038831 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:12.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb97fff700 1 --2- 172.21.15.82:0/2902038831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb98158720 0x7feb98154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:12.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb977fe700 1 --2- 172.21.15.82:0/2902038831 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb98069bc0 0x7feb9813f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:12.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb96ffd700 1 -- 172.21.15.82:0/2902038831 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb98069bc0 msgr2=0x7feb9813f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:12.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb96ffd700 1 --2- 172.21.15.82:0/2902038831 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb98069bc0 0x7feb9813f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb96ffd700 1 -- 172.21.15.82:0/2902038831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb98158720 msgr2=0x7feb98154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:12.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb96ffd700 1 --2- 172.21.15.82:0/2902038831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb98158720 0x7feb98154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb96ffd700 1 -- 172.21.15.82:0/2902038831 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb90009570 con 0x7feb9806a450 2023-11-28T13:01:12.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb96ffd700 1 --2- 172.21.15.82:0/2902038831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb9806a450 0x7feb981f36c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7feb8000e760 tx=0x7feb8000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:12.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb8ffff700 1 -- 172.21.15.82:0/2902038831 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8000c070 con 0x7feb9806a450 2023-11-28T13:01:12.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb8ffff700 1 -- 172.21.15.82:0/2902038831 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb80013610 con 0x7feb9806a450 2023-11-28T13:01:12.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb8ffff700 1 -- 172.21.15.82:0/2902038831 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80013980 con 0x7feb9806a450 2023-11-28T13:01:12.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb9ce29700 1 -- 172.21.15.82:0/2902038831 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb980afa50 con 0x7feb9806a450 2023-11-28T13:01:12.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.243+0000 7feb9ce29700 1 -- 172.21.15.82:0/2902038831 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb980af770 con 0x7feb9806a450 2023-11-28T13:01:12.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.247+0000 7feb9ce29700 1 -- 172.21.15.82:0/2902038831 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb980afd30 con 0x7feb9806a450 2023-11-28T13:01:12.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.247+0000 7feb8ffff700 1 -- 172.21.15.82:0/2902038831 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7feb80023070 con 0x7feb9806a450 2023-11-28T13:01:12.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.247+0000 7feb8ffff700 1 --2- 172.21.15.82:0/2902038831 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feb78064ee0 0x7feb78067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:12.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.247+0000 7feb8ffff700 1 -- 172.21.15.82:0/2902038831 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7feb80081c90 con 0x7feb9806a450 2023-11-28T13:01:12.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.247+0000 7feb977fe700 1 --2- 172.21.15.82:0/2902038831 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feb78064ee0 0x7feb78067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:12.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.247+0000 7feb977fe700 1 --2- 172.21.15.82:0/2902038831 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feb78064ee0 0x7feb78067390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7feb90000c00 tx=0x7feb90008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:12.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.255+0000 7feb8ffff700 1 -- 172.21.15.82:0/2902038831 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7feb8004fd70 con 0x7feb9806a450 2023-11-28T13:01:12.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.415+0000 7feb9ce29700 1 -- 172.21.15.82:0/2902038831 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feb98065fc0 con 0x7feb9806a450 2023-11-28T13:01:12.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.415+0000 7feb8ffff700 1 -- 172.21.15.82:0/2902038831 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7feb8000f040 con 0x7feb9806a450 2023-11-28T13:01:12.422 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-11-28T13:01:12.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.419+0000 7feb9ce29700 1 -- 172.21.15.82:0/2902038831 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feb78064ee0 msgr2=0x7feb78067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:12.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.419+0000 7feb9ce29700 1 --2- 172.21.15.82:0/2902038831 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feb78064ee0 0x7feb78067390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7feb90000c00 tx=0x7feb90008030 comp rx=0 tx=0).stop 2023-11-28T13:01:12.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.419+0000 7feb9ce29700 1 -- 172.21.15.82:0/2902038831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb9806a450 msgr2=0x7feb981f36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:12.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.419+0000 7feb9ce29700 1 --2- 172.21.15.82:0/2902038831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb9806a450 0x7feb981f36c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7feb8000e760 tx=0x7feb8000ea70 comp rx=0 tx=0).stop 2023-11-28T13:01:12.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.419+0000 7feb9ce29700 1 -- 172.21.15.82:0/2902038831 shutdown_connections 2023-11-28T13:01:12.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.419+0000 7feb9ce29700 1 --2- 172.21.15.82:0/2902038831 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feb78064ee0 0x7feb78067390 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.419+0000 7feb9ce29700 1 --2- 172.21.15.82:0/2902038831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb98158720 0x7feb98154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.419+0000 7feb9ce29700 1 --2- 172.21.15.82:0/2902038831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb9806a450 0x7feb981f36c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.419+0000 7feb9ce29700 1 --2- 172.21.15.82:0/2902038831 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb98069bc0 0x7feb9813f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.419+0000 7feb9ce29700 1 -- 172.21.15.82:0/2902038831 >> 172.21.15.82:0/2902038831 conn(0x7feb980ce630 msgr2=0x7feb980cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:12.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.419+0000 7feb9ce29700 1 -- 172.21.15.82:0/2902038831 shutdown_connections 2023-11-28T13:01:12.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.419+0000 7feb9ce29700 1 -- 172.21.15.82:0/2902038831 wait complete. 2023-11-28T13:01:12.436 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T13:01:12.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.551+0000 7f059cb81700 1 Processor -- start 2023-11-28T13:01:12.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.551+0000 7f059cb81700 1 -- start start 2023-11-28T13:01:12.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.551+0000 7f059cb81700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f05980b1d10 0x7f05980cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:12.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.551+0000 7f059cb81700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05980d25b0 0x7f059806ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:12.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.551+0000 7f059cb81700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0598069bc0 con 0x7f05980b5940 2023-11-28T13:01:12.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.551+0000 7f059cb81700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05980d1480 con 0x7f05980b1d10 2023-11-28T13:01:12.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.551+0000 7f059cb81700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05980cd280 con 0x7f05980d25b0 2023-11-28T13:01:12.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.551+0000 7f0597fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f05980b5940 0x7f059806a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50228/0 (socket says 172.21.15.82:50228) 2023-11-28T13:01:12.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.551+0000 7f0597fff700 1 -- 172.21.15.82:0/520546154 learned_addr learned my addr 172.21.15.82:0/520546154 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:12.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.555+0000 7f05977fe700 1 --2- 172.21.15.82:0/520546154 >> v2:172.21.15.114:3300/0 conn(0x7f05980b1d10 0x7f05980cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:12.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.555+0000 7f0596ffd700 1 --2- 172.21.15.82:0/520546154 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05980d25b0 0x7f059806ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:12.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.555+0000 7f05967fc700 1 -- 172.21.15.82:0/520546154 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793613077 0 0) 0x7f0598069bc0 con 0x7f05980b5940 2023-11-28T13:01:12.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.555+0000 7f05967fc700 1 -- 172.21.15.82:0/520546154 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05800035d0 con 0x7f05980b5940 2023-11-28T13:01:12.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.555+0000 7f0596ffd700 1 -- 172.21.15.82:0/520546154 >> v2:172.21.15.114:3300/0 conn(0x7f05980b1d10 msgr2=0x7f05980cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:12.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.555+0000 7f05967fc700 1 -- 172.21.15.82:0/520546154 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1347963825 0 0) 0x7f05800035d0 con 0x7f05980b5940 2023-11-28T13:01:12.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.555+0000 7f0596ffd700 1 --2- 172.21.15.82:0/520546154 >> v2:172.21.15.114:3300/0 conn(0x7f05980b1d10 0x7f05980cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.555+0000 7f0596ffd700 1 -- 172.21.15.82:0/520546154 >> v1:172.21.15.82:6789/0 conn(0x7f05980b5940 legacy=0x7f059806a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:12.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.555+0000 7f0596ffd700 1 -- 172.21.15.82:0/520546154 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05980cd560 con 0x7f05980d25b0 2023-11-28T13:01:12.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.555+0000 7f0596ffd700 1 --2- 172.21.15.82:0/520546154 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05980d25b0 0x7f059806ba30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0588009880 tx=0x7f0588009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39d0e30e9a930df1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:12.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.555+0000 7f05967fc700 1 -- 172.21.15.82:0/520546154 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05900019f0 con 0x7f05980d25b0 2023-11-28T13:01:12.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.555+0000 7f05967fc700 1 -- 172.21.15.82:0/520546154 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0588004030 con 0x7f05980d25b0 2023-11-28T13:01:12.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.555+0000 7f05967fc700 1 -- 172.21.15.82:0/520546154 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05880043c0 con 0x7f05980d25b0 2023-11-28T13:01:12.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.555+0000 7f059cb81700 1 -- 172.21.15.82:0/520546154 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05980d25b0 msgr2=0x7f059806ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:12.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.555+0000 7f059cb81700 1 --2- 172.21.15.82:0/520546154 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05980d25b0 0x7f059806ba30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0588009880 tx=0x7f0588009b90 comp rx=0 tx=0).stop 2023-11-28T13:01:12.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.555+0000 7f059cb81700 1 -- 172.21.15.82:0/520546154 shutdown_connections 2023-11-28T13:01:12.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.555+0000 7f059cb81700 1 --2- 172.21.15.82:0/520546154 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05980d25b0 0x7f059806ba30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.555+0000 7f059cb81700 1 --2- 172.21.15.82:0/520546154 >> v2:172.21.15.114:3300/0 conn(0x7f05980b1d10 0x7f05980cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.555+0000 7f059cb81700 1 -- 172.21.15.82:0/520546154 >> 172.21.15.82:0/520546154 conn(0x7f05980b52a0 msgr2=0x7f05980d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:12.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.555+0000 7f059cb81700 1 -- 172.21.15.82:0/520546154 shutdown_connections 2023-11-28T13:01:12.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.555+0000 7f059cb81700 1 -- 172.21.15.82:0/520546154 wait complete. 2023-11-28T13:01:12.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.559+0000 7f059cb81700 1 Processor -- start 2023-11-28T13:01:12.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.559+0000 7f059cb81700 1 -- start start 2023-11-28T13:01:12.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.559+0000 7f059cb81700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05980b1d10 0x7f059814f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:12.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.559+0000 7f059cb81700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05980b5940 0x7f05980b2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:12.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.559+0000 7f059cb81700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05980d25b0 0x7f05980b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:12.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.559+0000 7f059cb81700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059814f840 con 0x7f05980b5940 2023-11-28T13:01:12.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.559+0000 7f059cb81700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059815e5c0 con 0x7f05980d25b0 2023-11-28T13:01:12.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.559+0000 7f059cb81700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059815d9b0 con 0x7f05980b1d10 2023-11-28T13:01:12.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.559+0000 7f0596ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05980b5940 0x7f05980b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:12.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.559+0000 7f0596ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05980b5940 0x7f05980b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40476/0 (socket says 172.21.15.82:40476) 2023-11-28T13:01:12.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.559+0000 7f0596ffd700 1 -- 172.21.15.82:0/3457679509 learned_addr learned my addr 172.21.15.82:0/3457679509 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:12.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.563+0000 7f05977fe700 1 --2- 172.21.15.82:0/3457679509 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05980b1d10 0x7f059814f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:12.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.563+0000 7f0597fff700 1 --2- 172.21.15.82:0/3457679509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05980d25b0 0x7f05980b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:12.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.563+0000 7f0596ffd700 1 -- 172.21.15.82:0/3457679509 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05980b1d10 msgr2=0x7f059814f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:12.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.563+0000 7f0596ffd700 1 --2- 172.21.15.82:0/3457679509 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05980b1d10 0x7f059814f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.563+0000 7f0596ffd700 1 -- 172.21.15.82:0/3457679509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05980d25b0 msgr2=0x7f05980b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:12.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.563+0000 7f0596ffd700 1 --2- 172.21.15.82:0/3457679509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05980d25b0 0x7f05980b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.563+0000 7f0596ffd700 1 -- 172.21.15.82:0/3457679509 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05880094b0 con 0x7f05980b5940 2023-11-28T13:01:12.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.563+0000 7f05977fe700 1 --2- 172.21.15.82:0/3457679509 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05980b1d10 0x7f059814f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:12.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.563+0000 7f0596ffd700 1 --2- 172.21.15.82:0/3457679509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05980b5940 0x7f05980b2810 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0588014040 tx=0x7f0588004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:12.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.563+0000 7f057ffff700 1 -- 172.21.15.82:0/3457679509 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588006ea0 con 0x7f05980b5940 2023-11-28T13:01:12.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.563+0000 7f057ffff700 1 -- 172.21.15.82:0/3457679509 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0588011630 con 0x7f05980b5940 2023-11-28T13:01:12.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.563+0000 7f059cb81700 1 -- 172.21.15.82:0/3457679509 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05980d1050 con 0x7f05980b5940 2023-11-28T13:01:12.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.563+0000 7f057ffff700 1 -- 172.21.15.82:0/3457679509 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05880119e0 con 0x7f05980b5940 2023-11-28T13:01:12.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.563+0000 7f059cb81700 1 -- 172.21.15.82:0/3457679509 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05980b20e0 con 0x7f05980b5940 2023-11-28T13:01:12.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.563+0000 7f059cb81700 1 -- 172.21.15.82:0/3457679509 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05980d11e0 con 0x7f05980b5940 2023-11-28T13:01:12.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.563+0000 7f057ffff700 1 -- 172.21.15.82:0/3457679509 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f058800f050 con 0x7f05980b5940 2023-11-28T13:01:12.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.567+0000 7f057ffff700 1 --2- 172.21.15.82:0/3457679509 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0584064f10 0x7f05840673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:12.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.567+0000 7f057ffff700 1 -- 172.21.15.82:0/3457679509 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0588082d10 con 0x7f05980b5940 2023-11-28T13:01:12.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.567+0000 7f05977fe700 1 --2- 172.21.15.82:0/3457679509 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0584064f10 0x7f05840673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:12.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.567+0000 7f05977fe700 1 --2- 172.21.15.82:0/3457679509 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0584064f10 0x7f05840673c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f058c009c40 tx=0x7f058c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:12.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.571+0000 7f057ffff700 1 -- 172.21.15.82:0/3457679509 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0588050e70 con 0x7f05980b5940 2023-11-28T13:01:12.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.735+0000 7f059cb81700 1 -- 172.21.15.82:0/3457679509 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f059815e770 con 0x7f05980b5940 2023-11-28T13:01:12.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.735+0000 7f057ffff700 1 -- 172.21.15.82:0/3457679509 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0588054490 con 0x7f05980b5940 2023-11-28T13:01:12.740 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-11-28T13:01:12.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.735+0000 7f059cb81700 1 -- 172.21.15.82:0/3457679509 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0584064f10 msgr2=0x7f05840673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:12.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.735+0000 7f059cb81700 1 --2- 172.21.15.82:0/3457679509 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0584064f10 0x7f05840673c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f058c009c40 tx=0x7f058c008040 comp rx=0 tx=0).stop 2023-11-28T13:01:12.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.735+0000 7f059cb81700 1 -- 172.21.15.82:0/3457679509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05980b5940 msgr2=0x7f05980b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:12.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.735+0000 7f059cb81700 1 --2- 172.21.15.82:0/3457679509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05980b5940 0x7f05980b2810 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0588014040 tx=0x7f0588004770 comp rx=0 tx=0).stop 2023-11-28T13:01:12.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.739+0000 7f059cb81700 1 -- 172.21.15.82:0/3457679509 shutdown_connections 2023-11-28T13:01:12.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.739+0000 7f059cb81700 1 --2- 172.21.15.82:0/3457679509 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0584064f10 0x7f05840673c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.739+0000 7f059cb81700 1 --2- 172.21.15.82:0/3457679509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05980d25b0 0x7f05980b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.739+0000 7f059cb81700 1 --2- 172.21.15.82:0/3457679509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05980b5940 0x7f05980b2810 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.739+0000 7f059cb81700 1 --2- 172.21.15.82:0/3457679509 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05980b1d10 0x7f059814f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.739+0000 7f059cb81700 1 -- 172.21.15.82:0/3457679509 >> 172.21.15.82:0/3457679509 conn(0x7f05980b52a0 msgr2=0x7f05980d2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:12.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.739+0000 7f059cb81700 1 -- 172.21.15.82:0/3457679509 shutdown_connections 2023-11-28T13:01:12.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.739+0000 7f059cb81700 1 -- 172.21.15.82:0/3457679509 wait complete. 2023-11-28T13:01:12.755 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T13:01:12.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c394a7700 1 Processor -- start 2023-11-28T13:01:12.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c394a7700 1 -- start start 2023-11-28T13:01:12.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c394a7700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6c34070070 0x7f6c34070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:12.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c394a7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6c340c1910 0x7f6c3406c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:12.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c394a7700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c34070980 con 0x7f6c34160900 2023-11-28T13:01:12.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c394a7700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c340ce030 con 0x7f6c340c1910 2023-11-28T13:01:12.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c394a7700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c340ce310 con 0x7f6c34070070 2023-11-28T13:01:12.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c38ca6700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6c340c1910 0x7f6c3406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:12.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c337fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6c34160900 0x7f6c340cc1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50244/0 (socket says 172.21.15.82:50244) 2023-11-28T13:01:12.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c337fe700 1 -- 172.21.15.82:0/895236780 learned_addr learned my addr 172.21.15.82:0/895236780 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:12.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c33fff700 1 --2- 172.21.15.82:0/895236780 >> v2:172.21.15.114:3300/0 conn(0x7f6c34070070 0x7f6c34070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:12.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c32ffd700 1 -- 172.21.15.82:0/895236780 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1716643235 0 0) 0x7f6c34070980 con 0x7f6c34160900 2023-11-28T13:01:12.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c32ffd700 1 -- 172.21.15.82:0/895236780 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c1c0035d0 con 0x7f6c34160900 2023-11-28T13:01:12.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c38ca6700 1 -- 172.21.15.82:0/895236780 >> v2:172.21.15.114:3300/0 conn(0x7f6c34070070 msgr2=0x7f6c34070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:12.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c38ca6700 1 --2- 172.21.15.82:0/895236780 >> v2:172.21.15.114:3300/0 conn(0x7f6c34070070 0x7f6c34070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c38ca6700 1 -- 172.21.15.82:0/895236780 >> v1:172.21.15.82:6789/0 conn(0x7f6c34160900 legacy=0x7f6c340cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:12.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c38ca6700 1 -- 172.21.15.82:0/895236780 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3406a5d0 con 0x7f6c340c1910 2023-11-28T13:01:12.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c38ca6700 1 --2- 172.21.15.82:0/895236780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c340c1910 0x7f6c3406c070 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6c3406bf40 tx=0x7f6c2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8309c2b65f77bc90 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:12.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c32ffd700 1 -- 172.21.15.82:0/895236780 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c00e070 con 0x7f6c340c1910 2023-11-28T13:01:12.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c32ffd700 1 -- 172.21.15.82:0/895236780 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c00bb20 con 0x7f6c340c1910 2023-11-28T13:01:12.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c32ffd700 1 -- 172.21.15.82:0/895236780 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c012430 con 0x7f6c340c1910 2023-11-28T13:01:12.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c394a7700 1 -- 172.21.15.82:0/895236780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c340c1910 msgr2=0x7f6c3406c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:12.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c394a7700 1 --2- 172.21.15.82:0/895236780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c340c1910 0x7f6c3406c070 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6c3406bf40 tx=0x7f6c2c00b330 comp rx=0 tx=0).stop 2023-11-28T13:01:12.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c394a7700 1 -- 172.21.15.82:0/895236780 shutdown_connections 2023-11-28T13:01:12.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c394a7700 1 --2- 172.21.15.82:0/895236780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c340c1910 0x7f6c3406c070 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c394a7700 1 --2- 172.21.15.82:0/895236780 >> v2:172.21.15.114:3300/0 conn(0x7f6c34070070 0x7f6c34070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c394a7700 1 -- 172.21.15.82:0/895236780 >> 172.21.15.82:0/895236780 conn(0x7f6c340ce600 msgr2=0x7f6c340ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:12.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c394a7700 1 -- 172.21.15.82:0/895236780 shutdown_connections 2023-11-28T13:01:12.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.867+0000 7f6c394a7700 1 -- 172.21.15.82:0/895236780 wait complete. 2023-11-28T13:01:12.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.871+0000 7f6c394a7700 1 Processor -- start 2023-11-28T13:01:12.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.871+0000 7f6c394a7700 1 -- start start 2023-11-28T13:01:12.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.871+0000 7f6c394a7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c34070070 0x7f6c340c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:12.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.871+0000 7f6c394a7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c341f5b30 0x7f6c340c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:12.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.871+0000 7f6c394a7700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c341f33c0 0x7f6c341622d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:12.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.871+0000 7f6c394a7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340c65d0 con 0x7f6c341f5b30 2023-11-28T13:01:12.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.871+0000 7f6c394a7700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c341f6a90 con 0x7f6c34070070 2023-11-28T13:01:12.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.871+0000 7f6c394a7700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340c63c0 con 0x7f6c341f33c0 2023-11-28T13:01:12.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.871+0000 7f6c337fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c341f5b30 0x7f6c340c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:12.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.871+0000 7f6c337fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c341f5b30 0x7f6c340c5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40490/0 (socket says 172.21.15.82:40490) 2023-11-28T13:01:12.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.871+0000 7f6c337fe700 1 -- 172.21.15.82:0/3828305218 learned_addr learned my addr 172.21.15.82:0/3828305218 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:12.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.871+0000 7f6c38ca6700 1 --2- 172.21.15.82:0/3828305218 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c341f33c0 0x7f6c341622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:12.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.871+0000 7f6c33fff700 1 --2- 172.21.15.82:0/3828305218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c34070070 0x7f6c340c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:12.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.871+0000 7f6c337fe700 1 -- 172.21.15.82:0/3828305218 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c341f33c0 msgr2=0x7f6c341622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:12.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.871+0000 7f6c337fe700 1 --2- 172.21.15.82:0/3828305218 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c341f33c0 0x7f6c341622d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.871+0000 7f6c337fe700 1 -- 172.21.15.82:0/3828305218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c34070070 msgr2=0x7f6c340c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:12.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.871+0000 7f6c337fe700 1 --2- 172.21.15.82:0/3828305218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c34070070 0x7f6c340c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:12.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.871+0000 7f6c337fe700 1 -- 172.21.15.82:0/3828305218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c009a70 con 0x7f6c341f5b30 2023-11-28T13:01:12.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.871+0000 7f6c337fe700 1 --2- 172.21.15.82:0/3828305218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c341f5b30 0x7f6c340c5e80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400c700 tx=0x7f6c2400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:12.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.871+0000 7f6c30ff9700 1 -- 172.21.15.82:0/3828305218 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24005d90 con 0x7f6c341f5b30 2023-11-28T13:01:12.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.875+0000 7f6c30ff9700 1 -- 172.21.15.82:0/3828305218 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c240070d0 con 0x7f6c341f5b30 2023-11-28T13:01:12.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.875+0000 7f6c394a7700 1 -- 172.21.15.82:0/3828305218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3406ab90 con 0x7f6c341f5b30 2023-11-28T13:01:12.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.875+0000 7f6c30ff9700 1 -- 172.21.15.82:0/3828305218 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24007480 con 0x7f6c341f5b30 2023-11-28T13:01:12.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.875+0000 7f6c394a7700 1 -- 172.21.15.82:0/3828305218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3406a8b0 con 0x7f6c341f5b30 2023-11-28T13:01:12.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.875+0000 7f6c394a7700 1 -- 172.21.15.82:0/3828305218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c340cdc50 con 0x7f6c341f5b30 2023-11-28T13:01:12.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.875+0000 7f6c30ff9700 1 -- 172.21.15.82:0/3828305218 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6c24019030 con 0x7f6c341f5b30 2023-11-28T13:01:12.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.875+0000 7f6c30ff9700 1 --2- 172.21.15.82:0/3828305218 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c20064f10 0x7f6c200673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:12.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.879+0000 7f6c33fff700 1 --2- 172.21.15.82:0/3828305218 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c20064f10 0x7f6c200673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:12.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.879+0000 7f6c30ff9700 1 -- 172.21.15.82:0/3828305218 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6c24081230 con 0x7f6c341f5b30 2023-11-28T13:01:12.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.879+0000 7f6c33fff700 1 --2- 172.21.15.82:0/3828305218 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c20064f10 0x7f6c200673c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009b50 tx=0x7f6c28009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:12.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:12.883+0000 7f6c30ff9700 1 -- 172.21.15.82:0/3828305218 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6c2404f240 con 0x7f6c341f5b30 2023-11-28T13:01:13.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.059+0000 7f6c394a7700 1 -- 172.21.15.82:0/3828305218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6c341f6bd0 con 0x7f6c341f5b30 2023-11-28T13:01:13.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.059+0000 7f6c30ff9700 1 -- 172.21.15.82:0/3828305218 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6c341f6bd0 con 0x7f6c341f5b30 2023-11-28T13:01:13.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.063+0000 7f6c394a7700 1 -- 172.21.15.82:0/3828305218 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c20064f10 msgr2=0x7f6c200673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:13.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.063+0000 7f6c394a7700 1 --2- 172.21.15.82:0/3828305218 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c20064f10 0x7f6c200673c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009b50 tx=0x7f6c28009240 comp rx=0 tx=0).stop 2023-11-28T13:01:13.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.063+0000 7f6c394a7700 1 -- 172.21.15.82:0/3828305218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c341f5b30 msgr2=0x7f6c340c5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:13.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.063+0000 7f6c394a7700 1 --2- 172.21.15.82:0/3828305218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c341f5b30 0x7f6c340c5e80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400c700 tx=0x7f6c2400ca10 comp rx=0 tx=0).stop 2023-11-28T13:01:13.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.063+0000 7f6c394a7700 1 -- 172.21.15.82:0/3828305218 shutdown_connections 2023-11-28T13:01:13.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.063+0000 7f6c394a7700 1 --2- 172.21.15.82:0/3828305218 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c20064f10 0x7f6c200673c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.063+0000 7f6c394a7700 1 --2- 172.21.15.82:0/3828305218 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c341f33c0 0x7f6c341622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.063+0000 7f6c394a7700 1 --2- 172.21.15.82:0/3828305218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c341f5b30 0x7f6c340c5e80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.063+0000 7f6c394a7700 1 --2- 172.21.15.82:0/3828305218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c34070070 0x7f6c340c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.063+0000 7f6c394a7700 1 -- 172.21.15.82:0/3828305218 >> 172.21.15.82:0/3828305218 conn(0x7f6c340ce600 msgr2=0x7f6c340cc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:13.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.063+0000 7f6c394a7700 1 -- 172.21.15.82:0/3828305218 shutdown_connections 2023-11-28T13:01:13.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.063+0000 7f6c394a7700 1 -- 172.21.15.82:0/3828305218 wait complete. 2023-11-28T13:01:13.070 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2023-11-28T13:01:13.080 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:01:13.080 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:01:13.089 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:01:13.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f360e6af700 1 Processor -- start 2023-11-28T13:01:13.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f360e6af700 1 -- start start 2023-11-28T13:01:13.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f360e6af700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f360806dae0 0x7f360806b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:13.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f360e6af700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f360815d5b0 con 0x7f3608158ed0 2023-11-28T13:01:13.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f360e6af700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f360815da40 con 0x7f36080ae940 2023-11-28T13:01:13.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f360e6af700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36080aee90 con 0x7f360806dae0 2023-11-28T13:01:13.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f360d6ad700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3608158ed0 0x7f360806d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50248/0 (socket says 172.21.15.82:50248) 2023-11-28T13:01:13.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f360d6ad700 1 -- 172.21.15.82:0/4034040377 learned_addr learned my addr 172.21.15.82:0/4034040377 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:13.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f360ceac700 1 --2- 172.21.15.82:0/4034040377 >> v2:172.21.15.114:3300/0 conn(0x7f360806dae0 0x7f360806b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:13.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f35fbfff700 1 -- 172.21.15.82:0/4034040377 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2321693645 0 0) 0x7f360815d5b0 con 0x7f3608158ed0 2023-11-28T13:01:13.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f35fbfff700 1 -- 172.21.15.82:0/4034040377 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35f40035d0 con 0x7f3608158ed0 2023-11-28T13:01:13.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f35fbfff700 1 -- 172.21.15.82:0/4034040377 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 526310636 0 0) 0x7f35f40035d0 con 0x7f3608158ed0 2023-11-28T13:01:13.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f35fbfff700 1 -- 172.21.15.82:0/4034040377 >> v2:172.21.15.114:3300/0 conn(0x7f360806dae0 msgr2=0x7f360806b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:13.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f35fbfff700 1 --2- 172.21.15.82:0/4034040377 >> v2:172.21.15.114:3300/0 conn(0x7f360806dae0 0x7f360806b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f35fbfff700 1 -- 172.21.15.82:0/4034040377 >> v1:172.21.15.114:6789/0 conn(0x7f36080ae940 legacy=0x7f360806baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:13.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f35fbfff700 1 -- 172.21.15.82:0/4034040377 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360815cc80 con 0x7f3608158ed0 2023-11-28T13:01:13.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f35fbfff700 1 -- 172.21.15.82:0/4034040377 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f35fc001670 con 0x7f3608158ed0 2023-11-28T13:01:13.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f35fbfff700 1 -- 172.21.15.82:0/4034040377 >> v1:172.21.15.82:6789/0 conn(0x7f3608158ed0 legacy=0x7f360806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:13.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f35fbfff700 1 --2- 172.21.15.82:0/4034040377 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35f4003a20 0x7f35f4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:13.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f35fbfff700 1 --2- 172.21.15.82:0/4034040377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f4004870 0x7f35f4004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:13.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f35fbfff700 1 --2- 172.21.15.82:0/4034040377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35f4005220 0x7f35f400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:13.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f35fbfff700 1 -- 172.21.15.82:0/4034040377 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36080aee90 con 0x7f35f4004870 2023-11-28T13:01:13.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f35fbfff700 1 -- 172.21.15.82:0/4034040377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f400c130 con 0x7f35f4005220 2023-11-28T13:01:13.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f35fbfff700 1 -- 172.21.15.82:0/4034040377 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f400c2f0 con 0x7f35f4003a20 2023-11-28T13:01:13.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f360ceac700 1 --2- 172.21.15.82:0/4034040377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f4004870 0x7f35f4004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:13.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f360d6ad700 1 --2- 172.21.15.82:0/4034040377 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35f4003a20 0x7f35f4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:13.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f360deae700 1 --2- 172.21.15.82:0/4034040377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35f4005220 0x7f35f400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:13.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f360ceac700 1 -- 172.21.15.82:0/4034040377 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35f4003a20 msgr2=0x7f35f4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:13.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f360ceac700 1 --2- 172.21.15.82:0/4034040377 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35f4003a20 0x7f35f4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f360ceac700 1 -- 172.21.15.82:0/4034040377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35f4005220 msgr2=0x7f35f400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:13.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f360ceac700 1 --2- 172.21.15.82:0/4034040377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35f4005220 0x7f35f400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f360deae700 1 -- 172.21.15.82:0/4034040377 reap_dead start 2023-11-28T13:01:13.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f360ceac700 1 -- 172.21.15.82:0/4034040377 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f40035d0 con 0x7f35f4004870 2023-11-28T13:01:13.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.195+0000 7f360ceac700 1 --2- 172.21.15.82:0/4034040377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f4004870 0x7f35f4004ce0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3600009f90 tx=0x7f35f40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba33261eff4dae25 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:13.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.199+0000 7f35fbfff700 1 -- 172.21.15.82:0/4034040377 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360000ec30 con 0x7f35f4004870 2023-11-28T13:01:13.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.199+0000 7f35fbfff700 1 -- 172.21.15.82:0/4034040377 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360000f040 con 0x7f35f4004870 2023-11-28T13:01:13.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.199+0000 7f35fbfff700 1 -- 172.21.15.82:0/4034040377 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3600014480 con 0x7f35f4004870 2023-11-28T13:01:13.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.199+0000 7f360e6af700 1 -- 172.21.15.82:0/4034040377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f4004870 msgr2=0x7f35f4004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:13.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.199+0000 7f360e6af700 1 --2- 172.21.15.82:0/4034040377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f4004870 0x7f35f4004ce0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3600009f90 tx=0x7f35f40058a0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.199+0000 7f360e6af700 1 -- 172.21.15.82:0/4034040377 shutdown_connections 2023-11-28T13:01:13.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.199+0000 7f360e6af700 1 --2- 172.21.15.82:0/4034040377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f4004870 0x7f35f4004ce0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.199+0000 7f360e6af700 1 -- 172.21.15.82:0/4034040377 >> 172.21.15.82:0/4034040377 conn(0x7f36080cf710 msgr2=0x7f36080cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:13.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.199+0000 7f360e6af700 1 -- 172.21.15.82:0/4034040377 shutdown_connections 2023-11-28T13:01:13.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.199+0000 7f360e6af700 1 -- 172.21.15.82:0/4034040377 wait complete. 2023-11-28T13:01:13.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360e6af700 1 Processor -- start 2023-11-28T13:01:13.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360e6af700 1 -- start start 2023-11-28T13:01:13.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360e6af700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f4004870 0x7f36080c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:13.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360e6af700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f36080ced20 0x7f36080c2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:13.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360e6af700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3608147c20 0x7f3608148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:13.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360e6af700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36081485d0 con 0x7f35f4004870 2023-11-28T13:01:13.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360e6af700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360814ca20 con 0x7f3608147c20 2023-11-28T13:01:13.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360e6af700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36080cf190 con 0x7f36080ced20 2023-11-28T13:01:13.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360d6ad700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f4004870 0x7f36080c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:13.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360d6ad700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f4004870 0x7f36080c4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40500/0 (socket says 172.21.15.82:40500) 2023-11-28T13:01:13.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360d6ad700 1 -- 172.21.15.82:0/1693155618 learned_addr learned my addr 172.21.15.82:0/1693155618 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:13.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360ceac700 1 --2- 172.21.15.82:0/1693155618 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f36080ced20 0x7f36080c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:13.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360deae700 1 --2- 172.21.15.82:0/1693155618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3608147c20 0x7f3608148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:13.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360d6ad700 1 -- 172.21.15.82:0/1693155618 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f36080ced20 msgr2=0x7f36080c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:13.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360d6ad700 1 --2- 172.21.15.82:0/1693155618 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f36080ced20 0x7f36080c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360d6ad700 1 -- 172.21.15.82:0/1693155618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3608147c20 msgr2=0x7f3608148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:13.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360d6ad700 1 --2- 172.21.15.82:0/1693155618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3608147c20 0x7f3608148090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360d6ad700 1 -- 172.21.15.82:0/1693155618 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360815d240 con 0x7f35f4004870 2023-11-28T13:01:13.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360d6ad700 1 --2- 172.21.15.82:0/1693155618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f4004870 0x7f36080c4b40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00e900 tx=0x7f35fc00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:13.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f35f9ffb700 1 -- 172.21.15.82:0/1693155618 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc00ee50 con 0x7f35f4004870 2023-11-28T13:01:13.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f35f9ffb700 1 -- 172.21.15.82:0/1693155618 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc00c7e0 con 0x7f35f4004870 2023-11-28T13:01:13.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f35f9ffb700 1 -- 172.21.15.82:0/1693155618 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc00cb70 con 0x7f35f4004870 2023-11-28T13:01:13.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360e6af700 1 -- 172.21.15.82:0/1693155618 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360815cf60 con 0x7f35f4004870 2023-11-28T13:01:13.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360e6af700 1 -- 172.21.15.82:0/1693155618 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36081592a0 con 0x7f35f4004870 2023-11-28T13:01:13.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.203+0000 7f360e6af700 1 -- 172.21.15.82:0/1693155618 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3608072210 con 0x7f35f4004870 2023-11-28T13:01:13.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.207+0000 7f35f9ffb700 1 -- 172.21.15.82:0/1693155618 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f35fc00ccd0 con 0x7f35f4004870 2023-11-28T13:01:13.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.207+0000 7f35f9ffb700 1 --2- 172.21.15.82:0/1693155618 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f35ec064f10 0x7f35ec0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:13.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.207+0000 7f35f9ffb700 1 -- 172.21.15.82:0/1693155618 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f35fc081bd0 con 0x7f35f4004870 2023-11-28T13:01:13.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.207+0000 7f360ceac700 1 --2- 172.21.15.82:0/1693155618 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f35ec064f10 0x7f35ec0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:13.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.207+0000 7f360ceac700 1 --2- 172.21.15.82:0/1693155618 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f35ec064f10 0x7f35ec0673c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f360000afd0 tx=0x7f3600020040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:13.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.211+0000 7f35f9ffb700 1 -- 172.21.15.82:0/1693155618 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f35fc04fd30 con 0x7f35f4004870 2023-11-28T13:01:13.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.375+0000 7f360e6af700 1 -- 172.21.15.82:0/1693155618 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3608065fc0 con 0x7f35f4004870 2023-11-28T13:01:13.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.375+0000 7f35f9ffb700 1 -- 172.21.15.82:0/1693155618 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17907 (secure 0 0 0) 0x7f35fc053350 con 0x7f35f4004870 2023-11-28T13:01:13.382 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:13.382 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:01:08.993802+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:00:24.360641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T13:00:24.960863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.26","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:01:13.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.379+0000 7f360e6af700 1 -- 172.21.15.82:0/1693155618 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f35ec064f10 msgr2=0x7f35ec0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:13.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.379+0000 7f360e6af700 1 --2- 172.21.15.82:0/1693155618 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f35ec064f10 0x7f35ec0673c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f360000afd0 tx=0x7f3600020040 comp rx=0 tx=0).stop 2023-11-28T13:01:13.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.379+0000 7f360e6af700 1 -- 172.21.15.82:0/1693155618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f4004870 msgr2=0x7f36080c4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:13.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.379+0000 7f360e6af700 1 --2- 172.21.15.82:0/1693155618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f4004870 0x7f36080c4b40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00e900 tx=0x7f35fc00ec10 comp rx=0 tx=0).stop 2023-11-28T13:01:13.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.379+0000 7f360e6af700 1 -- 172.21.15.82:0/1693155618 shutdown_connections 2023-11-28T13:01:13.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.379+0000 7f360e6af700 1 --2- 172.21.15.82:0/1693155618 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f35ec064f10 0x7f35ec0673c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.379+0000 7f360e6af700 1 --2- 172.21.15.82:0/1693155618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3608147c20 0x7f3608148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.379+0000 7f360e6af700 1 --2- 172.21.15.82:0/1693155618 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f36080ced20 0x7f36080c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.379+0000 7f360e6af700 1 --2- 172.21.15.82:0/1693155618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f4004870 0x7f36080c4b40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.379+0000 7f360e6af700 1 -- 172.21.15.82:0/1693155618 >> 172.21.15.82:0/1693155618 conn(0x7f36080cf710 msgr2=0x7f360806b470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:13.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.379+0000 7f360e6af700 1 -- 172.21.15.82:0/1693155618 shutdown_connections 2023-11-28T13:01:13.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.379+0000 7f360e6af700 1 -- 172.21.15.82:0/1693155618 wait complete. 2023-11-28T13:01:13.397 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T13:00:24.360641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T13:00:24.960863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:01:13.397 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:01:13.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.507+0000 7f9ad8a28700 1 Processor -- start 2023-11-28T13:01:13.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.507+0000 7f9ad8a28700 1 -- start start 2023-11-28T13:01:13.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad8a28700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9ad4071750 0x7f9ad41606c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:13.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad8a28700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9ad40caa90 0x7f9ad41598c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:13.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad8a28700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad415ff30 con 0x7f9ad4071380 2023-11-28T13:01:13.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad8a28700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad406a450 con 0x7f9ad4071750 2023-11-28T13:01:13.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad8a28700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad415cfb0 con 0x7f9ad40caa90 2023-11-28T13:01:13.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad259c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9ad4071750 0x7f9ad41606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:13.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad259c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9ad4071750 0x7f9ad41606c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40506/0 (socket says 172.21.15.82:40506) 2023-11-28T13:01:13.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad259c700 1 -- 172.21.15.82:0/2629276953 learned_addr learned my addr 172.21.15.82:0/2629276953 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:13.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad359e700 1 --2- 172.21.15.82:0/2629276953 >> v2:172.21.15.114:3300/0 conn(0x7f9ad40caa90 0x7f9ad41598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:13.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad259c700 1 -- 172.21.15.82:0/2629276953 >> v2:172.21.15.114:3300/0 conn(0x7f9ad40caa90 msgr2=0x7f9ad41598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:13.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad259c700 1 --2- 172.21.15.82:0/2629276953 >> v2:172.21.15.114:3300/0 conn(0x7f9ad40caa90 0x7f9ad41598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad259c700 1 -- 172.21.15.82:0/2629276953 >> v1:172.21.15.114:6789/0 conn(0x7f9ad4071380 legacy=0x7f9ad415c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:13.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad259c700 1 -- 172.21.15.82:0/2629276953 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad415d1d0 con 0x7f9ad4071750 2023-11-28T13:01:13.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad259c700 1 --2- 172.21.15.82:0/2629276953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad4071750 0x7f9ad41606c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9ad40cb4d0 tx=0x7f9ac8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882b42af7fa36c73 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:13.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad1d9b700 1 -- 172.21.15.82:0/2629276953 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8004230 con 0x7f9ad4071750 2023-11-28T13:01:13.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad1d9b700 1 -- 172.21.15.82:0/2629276953 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac8004390 con 0x7f9ad4071750 2023-11-28T13:01:13.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad1d9b700 1 -- 172.21.15.82:0/2629276953 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80036c0 con 0x7f9ad4071750 2023-11-28T13:01:13.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad8a28700 1 -- 172.21.15.82:0/2629276953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad4071750 msgr2=0x7f9ad41606c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:13.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad8a28700 1 --2- 172.21.15.82:0/2629276953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad4071750 0x7f9ad41606c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9ad40cb4d0 tx=0x7f9ac8009bf0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad8a28700 1 -- 172.21.15.82:0/2629276953 shutdown_connections 2023-11-28T13:01:13.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad8a28700 1 --2- 172.21.15.82:0/2629276953 >> v2:172.21.15.114:3300/0 conn(0x7f9ad40caa90 0x7f9ad41598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad8a28700 1 --2- 172.21.15.82:0/2629276953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad4071750 0x7f9ad41606c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.511+0000 7f9ad8a28700 1 -- 172.21.15.82:0/2629276953 >> 172.21.15.82:0/2629276953 conn(0x7f9ad40b1f50 msgr2=0x7f9ad40cf790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:13.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.515+0000 7f9ad8a28700 1 -- 172.21.15.82:0/2629276953 shutdown_connections 2023-11-28T13:01:13.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.515+0000 7f9ad8a28700 1 -- 172.21.15.82:0/2629276953 wait complete. 2023-11-28T13:01:13.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.515+0000 7f9ad8a28700 1 Processor -- start 2023-11-28T13:01:13.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.515+0000 7f9ad8a28700 1 -- start start 2023-11-28T13:01:13.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.515+0000 7f9ad8a28700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ad4071380 0x7f9ad415a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:13.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.515+0000 7f9ad8a28700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad4071750 0x7f9ad415ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:13.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.515+0000 7f9ad8a28700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ad40caa90 0x7f9ad41f1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:13.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.515+0000 7f9ad8a28700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad40b3a80 con 0x7f9ad4071750 2023-11-28T13:01:13.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.515+0000 7f9ad8a28700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad41f2840 con 0x7f9ad4071380 2023-11-28T13:01:13.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.515+0000 7f9ad8a28700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad40b30e0 con 0x7f9ad40caa90 2023-11-28T13:01:13.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.515+0000 7f9ad259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad4071750 0x7f9ad415ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:13.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.515+0000 7f9ad259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad4071750 0x7f9ad415ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40512/0 (socket says 172.21.15.82:40512) 2023-11-28T13:01:13.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.515+0000 7f9ad259c700 1 -- 172.21.15.82:0/4176263576 learned_addr learned my addr 172.21.15.82:0/4176263576 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:13.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.519+0000 7f9ad2d9d700 1 --2- 172.21.15.82:0/4176263576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ad4071380 0x7f9ad415a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:13.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.519+0000 7f9ad359e700 1 --2- 172.21.15.82:0/4176263576 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ad40caa90 0x7f9ad41f1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:13.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.519+0000 7f9ad259c700 1 -- 172.21.15.82:0/4176263576 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ad40caa90 msgr2=0x7f9ad41f1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:13.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.519+0000 7f9ad259c700 1 --2- 172.21.15.82:0/4176263576 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ad40caa90 0x7f9ad41f1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.519+0000 7f9ad259c700 1 -- 172.21.15.82:0/4176263576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ad4071380 msgr2=0x7f9ad415a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:13.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.519+0000 7f9ad259c700 1 --2- 172.21.15.82:0/4176263576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ad4071380 0x7f9ad415a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.519+0000 7f9ad259c700 1 -- 172.21.15.82:0/4176263576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac8009570 con 0x7f9ad4071750 2023-11-28T13:01:13.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.519+0000 7f9ad259c700 1 --2- 172.21.15.82:0/4176263576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad4071750 0x7f9ad415ad50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8004000 tx=0x7f9ac8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:13.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.519+0000 7f9abb7fe700 1 -- 172.21.15.82:0/4176263576 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8003e60 con 0x7f9ad4071750 2023-11-28T13:01:13.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.519+0000 7f9abb7fe700 1 -- 172.21.15.82:0/4176263576 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac801f070 con 0x7f9ad4071750 2023-11-28T13:01:13.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.519+0000 7f9abb7fe700 1 -- 172.21.15.82:0/4176263576 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac800b8a0 con 0x7f9ad4071750 2023-11-28T13:01:13.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.519+0000 7f9ad8a28700 1 -- 172.21.15.82:0/4176263576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad415d790 con 0x7f9ad4071750 2023-11-28T13:01:13.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.519+0000 7f9ad8a28700 1 -- 172.21.15.82:0/4176263576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad41601a0 con 0x7f9ad4071750 2023-11-28T13:01:13.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.519+0000 7f9ad8a28700 1 -- 172.21.15.82:0/4176263576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad4160c00 con 0x7f9ad4071750 2023-11-28T13:01:13.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.519+0000 7f9abb7fe700 1 -- 172.21.15.82:0/4176263576 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9ac802a020 con 0x7f9ad4071750 2023-11-28T13:01:13.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.523+0000 7f9abb7fe700 1 --2- 172.21.15.82:0/4176263576 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ac0064ee0 0x7f9ac0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:13.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.523+0000 7f9ad2d9d700 1 --2- 172.21.15.82:0/4176263576 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ac0064ee0 0x7f9ac0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:13.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.523+0000 7f9abb7fe700 1 -- 172.21.15.82:0/4176263576 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9ac80837f0 con 0x7f9ad4071750 2023-11-28T13:01:13.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.523+0000 7f9ad2d9d700 1 --2- 172.21.15.82:0/4176263576 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ac0064ee0 0x7f9ac0067390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4158a80 tx=0x7f9ac4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:13.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.531+0000 7f9abb7fe700 1 -- 172.21.15.82:0/4176263576 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9ac80517e0 con 0x7f9ad4071750 2023-11-28T13:01:13.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.695+0000 7f9ad8a28700 1 -- 172.21.15.82:0/4176263576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9ad4160c00 con 0x7f9ad4071750 2023-11-28T13:01:13.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.695+0000 7f9abb7fe700 1 -- 172.21.15.82:0/4176263576 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9ac8010380 con 0x7f9ad4071750 2023-11-28T13:01:13.702 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:01:13.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.699+0000 7f9ad8a28700 1 -- 172.21.15.82:0/4176263576 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ac0064ee0 msgr2=0x7f9ac0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:13.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.699+0000 7f9ad8a28700 1 --2- 172.21.15.82:0/4176263576 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ac0064ee0 0x7f9ac0067390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4158a80 tx=0x7f9ac4009040 comp rx=0 tx=0).stop 2023-11-28T13:01:13.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.699+0000 7f9ad8a28700 1 -- 172.21.15.82:0/4176263576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad4071750 msgr2=0x7f9ad415ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:13.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.699+0000 7f9ad8a28700 1 --2- 172.21.15.82:0/4176263576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad4071750 0x7f9ad415ad50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8004000 tx=0x7f9ac8004770 comp rx=0 tx=0).stop 2023-11-28T13:01:13.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.699+0000 7f9ad8a28700 1 -- 172.21.15.82:0/4176263576 shutdown_connections 2023-11-28T13:01:13.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.699+0000 7f9ad8a28700 1 --2- 172.21.15.82:0/4176263576 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ac0064ee0 0x7f9ac0067390 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.699+0000 7f9ad8a28700 1 --2- 172.21.15.82:0/4176263576 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ad40caa90 0x7f9ad41f1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.699+0000 7f9ad8a28700 1 --2- 172.21.15.82:0/4176263576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad4071750 0x7f9ad415ad50 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.699+0000 7f9ad8a28700 1 --2- 172.21.15.82:0/4176263576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ad4071380 0x7f9ad415a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.699+0000 7f9ad8a28700 1 -- 172.21.15.82:0/4176263576 >> 172.21.15.82:0/4176263576 conn(0x7f9ad40b1f50 msgr2=0x7f9ad415f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:13.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.699+0000 7f9ad8a28700 1 -- 172.21.15.82:0/4176263576 shutdown_connections 2023-11-28T13:01:13.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.699+0000 7f9ad8a28700 1 -- 172.21.15.82:0/4176263576 wait complete. 2023-11-28T13:01:13.721 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:01:13.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.839+0000 7fd20257c700 1 Processor -- start 2023-11-28T13:01:13.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.839+0000 7fd20257c700 1 -- start start 2023-11-28T13:01:13.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.839+0000 7fd20257c700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd1fc06a450 0x7fd1fc06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:13.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.839+0000 7fd20257c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1fc158af0 con 0x7fd1fc158720 2023-11-28T13:01:13.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.839+0000 7fd20257c700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1fc0af490 con 0x7fd1fc071130 2023-11-28T13:01:13.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.839+0000 7fd20257c700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1fc06ae10 con 0x7fd1fc06a450 2023-11-28T13:01:13.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.839+0000 7fd20157a700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd1fc158720 0x7fd1fc0b0250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50254/0 (socket says 172.21.15.82:50254) 2023-11-28T13:01:13.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.839+0000 7fd20157a700 1 -- 172.21.15.82:0/1660569601 learned_addr learned my addr 172.21.15.82:0/1660569601 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:13.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.839+0000 7fd200d79700 1 --2- 172.21.15.82:0/1660569601 >> v2:172.21.15.114:3300/0 conn(0x7fd1fc06a450 0x7fd1fc06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:13.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.839+0000 7fd1f3fff700 1 -- 172.21.15.82:0/1660569601 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759492083 0 0) 0x7fd1fc158af0 con 0x7fd1fc158720 2023-11-28T13:01:13.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.839+0000 7fd1f3fff700 1 -- 172.21.15.82:0/1660569601 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1e80035d0 con 0x7fd1fc158720 2023-11-28T13:01:13.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.839+0000 7fd200d79700 1 -- 172.21.15.82:0/1660569601 >> v1:172.21.15.114:6789/0 conn(0x7fd1fc071130 legacy=0x7fd1fc071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:13.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.839+0000 7fd200d79700 1 -- 172.21.15.82:0/1660569601 >> v1:172.21.15.82:6789/0 conn(0x7fd1fc158720 legacy=0x7fd1fc0b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:13.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.839+0000 7fd1f3fff700 1 -- 172.21.15.82:0/1660569601 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885394502 0 0) 0x7fd1fc0af490 con 0x7fd1fc071130 2023-11-28T13:01:13.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.839+0000 7fd200d79700 1 -- 172.21.15.82:0/1660569601 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc0af770 con 0x7fd1fc06a450 2023-11-28T13:01:13.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.843+0000 7fd200d79700 1 --2- 172.21.15.82:0/1660569601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1fc06a450 0x7fd1fc06a8d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009850 tx=0x7fd1f8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c265f5f4de588e11 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:13.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.843+0000 7fd1f3fff700 1 -- 172.21.15.82:0/1660569601 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec0015f0 con 0x7fd1fc06a450 2023-11-28T13:01:13.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.843+0000 7fd1f3fff700 1 -- 172.21.15.82:0/1660569601 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f8010590 con 0x7fd1fc06a450 2023-11-28T13:01:13.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.843+0000 7fd1f3fff700 1 -- 172.21.15.82:0/1660569601 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8010900 con 0x7fd1fc06a450 2023-11-28T13:01:13.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.843+0000 7fd20257c700 1 -- 172.21.15.82:0/1660569601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1fc06a450 msgr2=0x7fd1fc06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:13.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.843+0000 7fd20257c700 1 --2- 172.21.15.82:0/1660569601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1fc06a450 0x7fd1fc06a8d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009850 tx=0x7fd1f8009b60 comp rx=0 tx=0).stop 2023-11-28T13:01:13.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.843+0000 7fd20257c700 1 -- 172.21.15.82:0/1660569601 shutdown_connections 2023-11-28T13:01:13.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.843+0000 7fd20257c700 1 --2- 172.21.15.82:0/1660569601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1fc06a450 0x7fd1fc06a8d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.843+0000 7fd20257c700 1 -- 172.21.15.82:0/1660569601 >> 172.21.15.82:0/1660569601 conn(0x7fd1fc0ce630 msgr2=0x7fd1fc0cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:13.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.843+0000 7fd20257c700 1 -- 172.21.15.82:0/1660569601 shutdown_connections 2023-11-28T13:01:13.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.843+0000 7fd20257c700 1 -- 172.21.15.82:0/1660569601 wait complete. 2023-11-28T13:01:13.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.843+0000 7fd20257c700 1 Processor -- start 2023-11-28T13:01:13.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.843+0000 7fd20257c700 1 -- start start 2023-11-28T13:01:13.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd20257c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd1fc06a450 0x7fd1fc14f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:13.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd20257c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1fc071130 0x7fd1fc13a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:13.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd20257c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1fc158720 0x7fd1fc0ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:13.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd20257c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc14f8e0 con 0x7fd1fc158720 2023-11-28T13:01:13.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd20257c700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc0cbdc0 con 0x7fd1fc071130 2023-11-28T13:01:13.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd20257c700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc0b1a90 con 0x7fd1fc06a450 2023-11-28T13:01:13.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd201d7b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1fc158720 0x7fd1fc0ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:13.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd20157a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd1fc06a450 0x7fd1fc14f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:13.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd200d79700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1fc071130 0x7fd1fc13a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:13.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd20157a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd1fc06a450 0x7fd1fc14f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:50934/0 (socket says 172.21.15.82:50934) 2023-11-28T13:01:13.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd200d79700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1fc071130 0x7fd1fc13a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:49274/0 (socket says 172.21.15.82:49274) 2023-11-28T13:01:13.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd20157a700 1 -- 172.21.15.82:0/2413915094 learned_addr learned my addr 172.21.15.82:0/2413915094 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:13.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd201d7b700 1 -- 172.21.15.82:0/2413915094 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd1fc06a450 msgr2=0x7fd1fc14f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:13.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd201d7b700 1 --2- 172.21.15.82:0/2413915094 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd1fc06a450 0x7fd1fc14f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd201d7b700 1 -- 172.21.15.82:0/2413915094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1fc071130 msgr2=0x7fd1fc13a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:13.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd201d7b700 1 --2- 172.21.15.82:0/2413915094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1fc071130 0x7fd1fc13a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:13.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd201d7b700 1 -- 172.21.15.82:0/2413915094 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f80094b0 con 0x7fd1fc158720 2023-11-28T13:01:13.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd201d7b700 1 --2- 172.21.15.82:0/2413915094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1fc158720 0x7fd1fc0ccb40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400cc90 tx=0x7fd1f400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:13.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd1f1ffb700 1 -- 172.21.15.82:0/2413915094 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4003c20 con 0x7fd1fc158720 2023-11-28T13:01:13.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd1f1ffb700 1 -- 172.21.15.82:0/2413915094 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f4003da0 con 0x7fd1fc158720 2023-11-28T13:01:13.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd20257c700 1 -- 172.21.15.82:0/2413915094 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1fc0afd30 con 0x7fd1fc158720 2023-11-28T13:01:13.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd1f1ffb700 1 -- 172.21.15.82:0/2413915094 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f400ab50 con 0x7fd1fc158720 2023-11-28T13:01:13.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.847+0000 7fd20257c700 1 -- 172.21.15.82:0/2413915094 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1fc0afa50 con 0x7fd1fc158720 2023-11-28T13:01:13.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.851+0000 7fd20257c700 1 -- 172.21.15.82:0/2413915094 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1fc0af0f0 con 0x7fd1fc158720 2023-11-28T13:01:13.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.851+0000 7fd1f1ffb700 1 -- 172.21.15.82:0/2413915094 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd1f4010050 con 0x7fd1fc158720 2023-11-28T13:01:13.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.851+0000 7fd1f1ffb700 1 --2- 172.21.15.82:0/2413915094 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd1e0064ee0 0x7fd1e0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:13.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.851+0000 7fd20157a700 1 --2- 172.21.15.82:0/2413915094 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd1e0064ee0 0x7fd1e0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:13.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.851+0000 7fd1f1ffb700 1 -- 172.21.15.82:0/2413915094 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd1f4081eb0 con 0x7fd1fc158720 2023-11-28T13:01:13.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.851+0000 7fd20157a700 1 --2- 172.21.15.82:0/2413915094 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd1e0064ee0 0x7fd1e0067390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec007fd0 tx=0x7fd1ec007a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:13.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:13.863+0000 7fd1f1ffb700 1 -- 172.21.15.82:0/2413915094 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd1f404fec0 con 0x7fd1fc158720 2023-11-28T13:01:14.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.035+0000 7fd20257c700 1 -- 172.21.15.82:0/2413915094 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd1fc065fc0 con 0x7fd1fc158720 2023-11-28T13:01:14.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.039+0000 7fd1f1ffb700 1 -- 172.21.15.82:0/2413915094 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd1f400acb0 con 0x7fd1fc158720 2023-11-28T13:01:14.045 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:01:14.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.043+0000 7fd20257c700 1 -- 172.21.15.82:0/2413915094 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd1e0064ee0 msgr2=0x7fd1e0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:14.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.043+0000 7fd20257c700 1 --2- 172.21.15.82:0/2413915094 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd1e0064ee0 0x7fd1e0067390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec007fd0 tx=0x7fd1ec007a20 comp rx=0 tx=0).stop 2023-11-28T13:01:14.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.043+0000 7fd20257c700 1 -- 172.21.15.82:0/2413915094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1fc158720 msgr2=0x7fd1fc0ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:14.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.043+0000 7fd20257c700 1 --2- 172.21.15.82:0/2413915094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1fc158720 0x7fd1fc0ccb40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400cc90 tx=0x7fd1f400a060 comp rx=0 tx=0).stop 2023-11-28T13:01:14.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.043+0000 7fd20257c700 1 -- 172.21.15.82:0/2413915094 shutdown_connections 2023-11-28T13:01:14.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.043+0000 7fd20257c700 1 --2- 172.21.15.82:0/2413915094 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd1e0064ee0 0x7fd1e0067390 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.043+0000 7fd20257c700 1 --2- 172.21.15.82:0/2413915094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1fc158720 0x7fd1fc0ccb40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.043+0000 7fd20257c700 1 --2- 172.21.15.82:0/2413915094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1fc071130 0x7fd1fc13a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.043+0000 7fd20257c700 1 --2- 172.21.15.82:0/2413915094 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd1fc06a450 0x7fd1fc14f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.043+0000 7fd20257c700 1 -- 172.21.15.82:0/2413915094 >> 172.21.15.82:0/2413915094 conn(0x7fd1fc0ce630 msgr2=0x7fd1fc155f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:14.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.043+0000 7fd20257c700 1 -- 172.21.15.82:0/2413915094 shutdown_connections 2023-11-28T13:01:14.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.043+0000 7fd20257c700 1 -- 172.21.15.82:0/2413915094 wait complete. 2023-11-28T13:01:14.061 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T13:01:14.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.167+0000 7f45f759e700 1 Processor -- start 2023-11-28T13:01:14.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.167+0000 7f45f759e700 1 -- start start 2023-11-28T13:01:14.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45f759e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45f8158eb0 0x7f45f80c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:14.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45f759e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f45f80ae090 0x7f45f80b0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:14.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45f759e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f80ad9b0 con 0x7f45f80b0aa0 2023-11-28T13:01:14.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45f759e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f80adee0 con 0x7f45f80ae090 2023-11-28T13:01:14.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45f759e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f8159280 con 0x7f45f8158eb0 2023-11-28T13:01:14.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45edd9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f45f80ae090 0x7f45f80b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:14.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45edd9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f45f80ae090 0x7f45f80b0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40516/0 (socket says 172.21.15.82:40516) 2023-11-28T13:01:14.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45edd9b700 1 -- 172.21.15.82:0/2046633403 learned_addr learned my addr 172.21.15.82:0/2046633403 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:14.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45f659c700 1 --2- 172.21.15.82:0/2046633403 >> v2:172.21.15.114:3300/0 conn(0x7f45f8158eb0 0x7f45f80c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:14.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45edd9b700 1 -- 172.21.15.82:0/2046633403 >> v2:172.21.15.114:3300/0 conn(0x7f45f8158eb0 msgr2=0x7f45f80c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:14.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45edd9b700 1 --2- 172.21.15.82:0/2046633403 >> v2:172.21.15.114:3300/0 conn(0x7f45f8158eb0 0x7f45f80c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45edd9b700 1 -- 172.21.15.82:0/2046633403 >> v1:172.21.15.114:6789/0 conn(0x7f45f80b0aa0 legacy=0x7f45f8070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:14.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45edd9b700 1 -- 172.21.15.82:0/2046633403 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f8069e60 con 0x7f45f80ae090 2023-11-28T13:01:14.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45f659c700 1 --2- 172.21.15.82:0/2046633403 >> v2:172.21.15.114:3300/0 conn(0x7f45f8158eb0 0x7f45f80c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:01:14.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45edd9b700 1 --2- 172.21.15.82:0/2046633403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45f80ae090 0x7f45f80b0560 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f45f806bef0 tx=0x7f45e0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5157ab89e0208ded server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:14.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45f5d9b700 1 -- 172.21.15.82:0/2046633403 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e0004230 con 0x7f45f80ae090 2023-11-28T13:01:14.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45f5d9b700 1 -- 172.21.15.82:0/2046633403 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e0004390 con 0x7f45f80ae090 2023-11-28T13:01:14.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45f5d9b700 1 -- 172.21.15.82:0/2046633403 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e00036c0 con 0x7f45f80ae090 2023-11-28T13:01:14.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45f759e700 1 -- 172.21.15.82:0/2046633403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45f80ae090 msgr2=0x7f45f80b0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:14.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45f759e700 1 --2- 172.21.15.82:0/2046633403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45f80ae090 0x7f45f80b0560 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f45f806bef0 tx=0x7f45e0009bf0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45f759e700 1 -- 172.21.15.82:0/2046633403 shutdown_connections 2023-11-28T13:01:14.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45f759e700 1 --2- 172.21.15.82:0/2046633403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45f80ae090 0x7f45f80b0560 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45f759e700 1 --2- 172.21.15.82:0/2046633403 >> v2:172.21.15.114:3300/0 conn(0x7f45f8158eb0 0x7f45f80c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45f759e700 1 -- 172.21.15.82:0/2046633403 >> 172.21.15.82:0/2046633403 conn(0x7f45f80ce630 msgr2=0x7f45f80cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:14.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45f759e700 1 -- 172.21.15.82:0/2046633403 shutdown_connections 2023-11-28T13:01:14.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.171+0000 7f45f759e700 1 -- 172.21.15.82:0/2046633403 wait complete. 2023-11-28T13:01:14.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45f759e700 1 Processor -- start 2023-11-28T13:01:14.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45f759e700 1 -- start start 2023-11-28T13:01:14.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45f759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45f80ae090 0x7f45f80b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:14.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45f759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f45f80b0aa0 0x7f45f8159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:14.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45f759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45f8158eb0 0x7f45f8141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:14.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45f759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f8151d20 con 0x7f45f80ae090 2023-11-28T13:01:14.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45f759e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f8152150 con 0x7f45f8158eb0 2023-11-28T13:01:14.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45f759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f8152430 con 0x7f45f80b0aa0 2023-11-28T13:01:14.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45f659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45f80ae090 0x7f45f80b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:14.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45f659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45f80ae090 0x7f45f80b2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40528/0 (socket says 172.21.15.82:40528) 2023-11-28T13:01:14.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45f659c700 1 -- 172.21.15.82:0/3387169568 learned_addr learned my addr 172.21.15.82:0/3387169568 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:14.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45f6d9d700 1 --2- 172.21.15.82:0/3387169568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45f8158eb0 0x7f45f8141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:14.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45edd9b700 1 --2- 172.21.15.82:0/3387169568 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f45f80b0aa0 0x7f45f8159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:14.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45f659c700 1 -- 172.21.15.82:0/3387169568 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f45f80b0aa0 msgr2=0x7f45f8159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:14.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45f659c700 1 --2- 172.21.15.82:0/3387169568 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f45f80b0aa0 0x7f45f8159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45f659c700 1 -- 172.21.15.82:0/3387169568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45f8158eb0 msgr2=0x7f45f8141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:14.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45f659c700 1 --2- 172.21.15.82:0/3387169568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45f8158eb0 0x7f45f8141940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45f659c700 1 -- 172.21.15.82:0/3387169568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e0009570 con 0x7f45f80ae090 2023-11-28T13:01:14.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45f659c700 1 --2- 172.21.15.82:0/3387169568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45f80ae090 0x7f45f80b2e90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f45e800c770 tx=0x7f45e800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:14.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45ef7fe700 1 -- 172.21.15.82:0/3387169568 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e8011800 con 0x7f45f80ae090 2023-11-28T13:01:14.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45ef7fe700 1 -- 172.21.15.82:0/3387169568 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e8011960 con 0x7f45f80ae090 2023-11-28T13:01:14.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45f759e700 1 -- 172.21.15.82:0/3387169568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f8071c90 con 0x7f45f80ae090 2023-11-28T13:01:14.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45ef7fe700 1 -- 172.21.15.82:0/3387169568 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e8011d10 con 0x7f45f80ae090 2023-11-28T13:01:14.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.175+0000 7f45f759e700 1 -- 172.21.15.82:0/3387169568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f80adc00 con 0x7f45f80ae090 2023-11-28T13:01:14.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.179+0000 7f45f759e700 1 -- 172.21.15.82:0/3387169568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f8071f70 con 0x7f45f80ae090 2023-11-28T13:01:14.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.179+0000 7f45ef7fe700 1 -- 172.21.15.82:0/3387169568 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f45e8021070 con 0x7f45f80ae090 2023-11-28T13:01:14.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.179+0000 7f45ef7fe700 1 --2- 172.21.15.82:0/3387169568 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f45d8064ee0 0x7f45d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:14.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.179+0000 7f45ef7fe700 1 -- 172.21.15.82:0/3387169568 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f45e8081e10 con 0x7f45f80ae090 2023-11-28T13:01:14.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.179+0000 7f45edd9b700 1 --2- 172.21.15.82:0/3387169568 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f45d8064ee0 0x7f45d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:14.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.179+0000 7f45edd9b700 1 --2- 172.21.15.82:0/3387169568 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f45d8064ee0 0x7f45d8067390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f45f80cab10 tx=0x7f45e0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:14.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.187+0000 7f45ef7fe700 1 -- 172.21.15.82:0/3387169568 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f45e804ff70 con 0x7f45f80ae090 2023-11-28T13:01:14.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.347+0000 7f45f759e700 1 -- 172.21.15.82:0/3387169568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45f8065fc0 con 0x7f45f80ae090 2023-11-28T13:01:14.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.347+0000 7f45ef7fe700 1 -- 172.21.15.82:0/3387169568 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45e8053590 con 0x7f45f80ae090 2023-11-28T13:01:14.354 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-11-28T13:01:14.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.351+0000 7f45f759e700 1 -- 172.21.15.82:0/3387169568 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f45d8064ee0 msgr2=0x7f45d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:14.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.351+0000 7f45f759e700 1 --2- 172.21.15.82:0/3387169568 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f45d8064ee0 0x7f45d8067390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f45f80cab10 tx=0x7f45e0008030 comp rx=0 tx=0).stop 2023-11-28T13:01:14.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.351+0000 7f45f759e700 1 -- 172.21.15.82:0/3387169568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45f80ae090 msgr2=0x7f45f80b2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:14.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.351+0000 7f45f759e700 1 --2- 172.21.15.82:0/3387169568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45f80ae090 0x7f45f80b2e90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f45e800c770 tx=0x7f45e800cb30 comp rx=0 tx=0).stop 2023-11-28T13:01:14.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.351+0000 7f45f759e700 1 -- 172.21.15.82:0/3387169568 shutdown_connections 2023-11-28T13:01:14.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.351+0000 7f45f759e700 1 --2- 172.21.15.82:0/3387169568 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f45d8064ee0 0x7f45d8067390 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.351+0000 7f45f759e700 1 --2- 172.21.15.82:0/3387169568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45f8158eb0 0x7f45f8141940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.351+0000 7f45f759e700 1 --2- 172.21.15.82:0/3387169568 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f45f80b0aa0 0x7f45f8159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.351+0000 7f45f759e700 1 --2- 172.21.15.82:0/3387169568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45f80ae090 0x7f45f80b2e90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.351+0000 7f45f759e700 1 -- 172.21.15.82:0/3387169568 >> 172.21.15.82:0/3387169568 conn(0x7f45f80ce630 msgr2=0x7f45f8153020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:14.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.351+0000 7f45f759e700 1 -- 172.21.15.82:0/3387169568 shutdown_connections 2023-11-28T13:01:14.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.351+0000 7f45f759e700 1 -- 172.21.15.82:0/3387169568 wait complete. 2023-11-28T13:01:14.368 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T13:01:14.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.479+0000 7f775dd49700 1 Processor -- start 2023-11-28T13:01:14.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.479+0000 7f775dd49700 1 -- start start 2023-11-28T13:01:14.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.479+0000 7f775dd49700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f775806c140 0x7f77580cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:14.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.479+0000 7f775dd49700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77580d25b0 0x7f775806a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:14.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.479+0000 7f775dd49700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7758069bc0 con 0x7f77580b1d10 2023-11-28T13:01:14.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.479+0000 7f775dd49700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77580d1480 con 0x7f775806c140 2023-11-28T13:01:14.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.479+0000 7f775dd49700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77580cd280 con 0x7f77580d25b0 2023-11-28T13:01:14.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.479+0000 7f7757fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f775806c140 0x7f77580cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:14.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.479+0000 7f7757fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f775806c140 0x7f77580cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:49290/0 (socket says 172.21.15.82:49290) 2023-11-28T13:01:14.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.479+0000 7f775d548700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77580d25b0 0x7f775806a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:14.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.479+0000 7f775cd47700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f77580b1d10 0x7f775806ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:39332/0 (socket says 172.21.15.82:39332) 2023-11-28T13:01:14.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.479+0000 7f7757fff700 1 -- 172.21.15.82:0/4014021228 learned_addr learned my addr 172.21.15.82:0/4014021228 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:14.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.479+0000 7f7757fff700 1 -- 172.21.15.82:0/4014021228 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77580d25b0 msgr2=0x7f775806a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:14.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.479+0000 7f7757fff700 1 --2- 172.21.15.82:0/4014021228 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77580d25b0 0x7f775806a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.479+0000 7f7757fff700 1 -- 172.21.15.82:0/4014021228 >> v1:172.21.15.114:6789/0 conn(0x7f77580b1d10 legacy=0x7f775806ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:14.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.479+0000 7f7757fff700 1 -- 172.21.15.82:0/4014021228 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77580cd560 con 0x7f775806c140 2023-11-28T13:01:14.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.479+0000 7f7757fff700 1 --2- 172.21.15.82:0/4014021228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f775806c140 0x7f77580cec20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7740009910 tx=0x7f7740009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e95ca1a7db85c2f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:14.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.479+0000 7f77577fe700 1 -- 172.21.15.82:0/4014021228 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7740004230 con 0x7f775806c140 2023-11-28T13:01:14.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.479+0000 7f77577fe700 1 -- 172.21.15.82:0/4014021228 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7740004390 con 0x7f775806c140 2023-11-28T13:01:14.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.479+0000 7f77577fe700 1 -- 172.21.15.82:0/4014021228 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77400036c0 con 0x7f775806c140 2023-11-28T13:01:14.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.483+0000 7f775dd49700 1 -- 172.21.15.82:0/4014021228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f775806c140 msgr2=0x7f77580cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:14.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.483+0000 7f775dd49700 1 --2- 172.21.15.82:0/4014021228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f775806c140 0x7f77580cec20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7740009910 tx=0x7f7740009c20 comp rx=0 tx=0).stop 2023-11-28T13:01:14.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.483+0000 7f775dd49700 1 -- 172.21.15.82:0/4014021228 shutdown_connections 2023-11-28T13:01:14.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.483+0000 7f775dd49700 1 --2- 172.21.15.82:0/4014021228 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77580d25b0 0x7f775806a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.483+0000 7f775dd49700 1 --2- 172.21.15.82:0/4014021228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f775806c140 0x7f77580cec20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.483+0000 7f775dd49700 1 -- 172.21.15.82:0/4014021228 >> 172.21.15.82:0/4014021228 conn(0x7f77580b52a0 msgr2=0x7f77580d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:14.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.483+0000 7f775dd49700 1 -- 172.21.15.82:0/4014021228 shutdown_connections 2023-11-28T13:01:14.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.483+0000 7f775dd49700 1 -- 172.21.15.82:0/4014021228 wait complete. 2023-11-28T13:01:14.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.483+0000 7f775dd49700 1 Processor -- start 2023-11-28T13:01:14.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.483+0000 7f775dd49700 1 -- start start 2023-11-28T13:01:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.483+0000 7f775dd49700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f775806c140 0x7f775814dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.483+0000 7f775dd49700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77580b1d10 0x7f77581f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.483+0000 7f775dd49700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77580d25b0 0x7f77580cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.483+0000 7f775dd49700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775815c960 con 0x7f77580b1d10 2023-11-28T13:01:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.483+0000 7f775dd49700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775815bd50 con 0x7f775806c140 2023-11-28T13:01:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.483+0000 7f775dd49700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775815c030 con 0x7f77580d25b0 2023-11-28T13:01:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.483+0000 7f7757fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77580b1d10 0x7f77581f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.483+0000 7f7757fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77580b1d10 0x7f77581f23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40542/0 (socket says 172.21.15.82:40542) 2023-11-28T13:01:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.483+0000 7f7757fff700 1 -- 172.21.15.82:0/2653861059 learned_addr learned my addr 172.21.15.82:0/2653861059 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.483+0000 7f775d548700 1 --2- 172.21.15.82:0/2653861059 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77580d25b0 0x7f77580cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.483+0000 7f775cd47700 1 --2- 172.21.15.82:0/2653861059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f775806c140 0x7f775814dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.487+0000 7f7757fff700 1 -- 172.21.15.82:0/2653861059 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77580d25b0 msgr2=0x7f77580cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.487+0000 7f7757fff700 1 --2- 172.21.15.82:0/2653861059 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77580d25b0 0x7f77580cbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.487+0000 7f7757fff700 1 -- 172.21.15.82:0/2653861059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f775806c140 msgr2=0x7f775814dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.487+0000 7f7757fff700 1 --2- 172.21.15.82:0/2653861059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f775806c140 0x7f775814dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.487+0000 7f7757fff700 1 -- 172.21.15.82:0/2653861059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7740009570 con 0x7f77580b1d10 2023-11-28T13:01:14.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.487+0000 7f775cd47700 1 --2- 172.21.15.82:0/2653861059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f775806c140 0x7f775814dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:14.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.487+0000 7f7757fff700 1 --2- 172.21.15.82:0/2653861059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77580b1d10 0x7f77581f23a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7740004000 tx=0x7f7740004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:14.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.487+0000 7f77557fa700 1 -- 172.21.15.82:0/2653861059 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77400036e0 con 0x7f77580b1d10 2023-11-28T13:01:14.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.487+0000 7f77557fa700 1 -- 172.21.15.82:0/2653861059 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7740011630 con 0x7f77580b1d10 2023-11-28T13:01:14.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.487+0000 7f775dd49700 1 -- 172.21.15.82:0/2653861059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77580d1050 con 0x7f77580b1d10 2023-11-28T13:01:14.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.487+0000 7f77557fa700 1 -- 172.21.15.82:0/2653861059 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77400119e0 con 0x7f77580b1d10 2023-11-28T13:01:14.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.487+0000 7f775dd49700 1 -- 172.21.15.82:0/2653861059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77580b20e0 con 0x7f77580b1d10 2023-11-28T13:01:14.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.487+0000 7f775dd49700 1 -- 172.21.15.82:0/2653861059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77580d11e0 con 0x7f77580b1d10 2023-11-28T13:01:14.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.487+0000 7f77557fa700 1 -- 172.21.15.82:0/2653861059 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7740017020 con 0x7f77580b1d10 2023-11-28T13:01:14.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.491+0000 7f77557fa700 1 --2- 172.21.15.82:0/2653861059 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7738064ee0 0x7f7738067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:14.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.491+0000 7f77557fa700 1 -- 172.21.15.82:0/2653861059 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7740083a90 con 0x7f77580b1d10 2023-11-28T13:01:14.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.491+0000 7f775cd47700 1 --2- 172.21.15.82:0/2653861059 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7738064ee0 0x7f7738067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:14.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.491+0000 7f775cd47700 1 --2- 172.21.15.82:0/2653861059 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7738064ee0 0x7f7738067390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f775815d2c0 tx=0x7f7750007e50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:14.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.495+0000 7f77557fa700 1 -- 172.21.15.82:0/2653861059 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7740051bf0 con 0x7f77580b1d10 2023-11-28T13:01:14.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.659+0000 7f775dd49700 1 -- 172.21.15.82:0/2653861059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7758065fc0 con 0x7f77580b1d10 2023-11-28T13:01:14.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.659+0000 7f77557fa700 1 -- 172.21.15.82:0/2653861059 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7740055210 con 0x7f77580b1d10 2023-11-28T13:01:14.663 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-11-28T13:01:14.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.659+0000 7f775dd49700 1 -- 172.21.15.82:0/2653861059 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7738064ee0 msgr2=0x7f7738067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:14.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.659+0000 7f775dd49700 1 --2- 172.21.15.82:0/2653861059 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7738064ee0 0x7f7738067390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f775815d2c0 tx=0x7f7750007e50 comp rx=0 tx=0).stop 2023-11-28T13:01:14.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.659+0000 7f775dd49700 1 -- 172.21.15.82:0/2653861059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77580b1d10 msgr2=0x7f77581f23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:14.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.659+0000 7f775dd49700 1 --2- 172.21.15.82:0/2653861059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77580b1d10 0x7f77581f23a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7740004000 tx=0x7f7740004770 comp rx=0 tx=0).stop 2023-11-28T13:01:14.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.659+0000 7f775dd49700 1 -- 172.21.15.82:0/2653861059 shutdown_connections 2023-11-28T13:01:14.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.659+0000 7f775dd49700 1 --2- 172.21.15.82:0/2653861059 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7738064ee0 0x7f7738067390 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.659+0000 7f775dd49700 1 --2- 172.21.15.82:0/2653861059 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77580d25b0 0x7f77580cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.659+0000 7f775dd49700 1 --2- 172.21.15.82:0/2653861059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77580b1d10 0x7f77581f23a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.659+0000 7f775dd49700 1 --2- 172.21.15.82:0/2653861059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f775806c140 0x7f775814dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.659+0000 7f775dd49700 1 -- 172.21.15.82:0/2653861059 >> 172.21.15.82:0/2653861059 conn(0x7f77580b52a0 msgr2=0x7f77580cf4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:14.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.659+0000 7f775dd49700 1 -- 172.21.15.82:0/2653861059 shutdown_connections 2023-11-28T13:01:14.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.659+0000 7f775dd49700 1 -- 172.21.15.82:0/2653861059 wait complete. 2023-11-28T13:01:14.677 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T13:01:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec7fff700 1 Processor -- start 2023-11-28T13:01:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec7fff700 1 -- start start 2023-11-28T13:01:14.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec7fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ec806b910 0x7f9ec8160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:14.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec7fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9ec80ced70 0x7f9ec806bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:14.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec7fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9ec8069bc0 0x7f9ec8069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec7fff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec80cdfe0 con 0x7f9ec80ced70 2023-11-28T13:01:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec7fff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec80d28e0 con 0x7f9ec8069bc0 2023-11-28T13:01:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec7fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec8160cc0 con 0x7f9ec806b910 2023-11-28T13:01:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec67fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9ec80ced70 0x7f9ec806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec67fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9ec80ced70 0x7f9ec806bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40550/0 (socket says 172.21.15.82:40550) 2023-11-28T13:01:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec67fc700 1 -- 172.21.15.82:0/1291716094 learned_addr learned my addr 172.21.15.82:0/1291716094 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec77fe700 1 --2- 172.21.15.82:0/1291716094 >> v2:172.21.15.114:3300/0 conn(0x7f9ec8069bc0 0x7f9ec8069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec6ffd700 1 --2- 172.21.15.82:0/1291716094 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ec806b910 0x7f9ec8160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec67fc700 1 -- 172.21.15.82:0/1291716094 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ec806b910 msgr2=0x7f9ec8160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec67fc700 1 --2- 172.21.15.82:0/1291716094 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ec806b910 0x7f9ec8160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec67fc700 1 -- 172.21.15.82:0/1291716094 >> v2:172.21.15.114:3300/0 conn(0x7f9ec8069bc0 msgr2=0x7f9ec8069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:14.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec67fc700 1 --2- 172.21.15.82:0/1291716094 >> v2:172.21.15.114:3300/0 conn(0x7f9ec8069bc0 0x7f9ec8069fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec67fc700 1 -- 172.21.15.82:0/1291716094 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec806c220 con 0x7f9ec80ced70 2023-11-28T13:01:14.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec67fc700 1 --2- 172.21.15.82:0/1291716094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec80ced70 0x7f9ec806bce0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80b45a0 tx=0x7f9eb8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbb83c48ca411b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:14.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec5ffb700 1 -- 172.21.15.82:0/1291716094 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8011830 con 0x7f9ec80ced70 2023-11-28T13:01:14.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec5ffb700 1 -- 172.21.15.82:0/1291716094 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb8011990 con 0x7f9ec80ced70 2023-11-28T13:01:14.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec5ffb700 1 -- 172.21.15.82:0/1291716094 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8011d20 con 0x7f9ec80ced70 2023-11-28T13:01:14.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec7fff700 1 -- 172.21.15.82:0/1291716094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec80ced70 msgr2=0x7f9ec806bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:14.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec7fff700 1 --2- 172.21.15.82:0/1291716094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec80ced70 0x7f9ec806bce0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80b45a0 tx=0x7f9eb8009bf0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec7fff700 1 -- 172.21.15.82:0/1291716094 shutdown_connections 2023-11-28T13:01:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec7fff700 1 --2- 172.21.15.82:0/1291716094 >> v2:172.21.15.114:3300/0 conn(0x7f9ec8069bc0 0x7f9ec8069fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec7fff700 1 --2- 172.21.15.82:0/1291716094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec80ced70 0x7f9ec806bce0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec7fff700 1 --2- 172.21.15.82:0/1291716094 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ec806b910 0x7f9ec8160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec7fff700 1 -- 172.21.15.82:0/1291716094 >> 172.21.15.82:0/1291716094 conn(0x7f9ec80d2b20 msgr2=0x7f9ec80d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec7fff700 1 -- 172.21.15.82:0/1291716094 shutdown_connections 2023-11-28T13:01:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.787+0000 7f9ec7fff700 1 -- 172.21.15.82:0/1291716094 wait complete. 2023-11-28T13:01:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ec7fff700 1 Processor -- start 2023-11-28T13:01:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ec7fff700 1 -- start start 2023-11-28T13:01:14.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ec7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8069bc0 0x7f9ec814dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:14.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ec7fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ec806b910 0x7f9ec80cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:14.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ec7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec80ced70 0x7f9ec80cc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:14.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ec7fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80ca9f0 con 0x7f9ec80ced70 2023-11-28T13:01:14.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ec7fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80c9420 con 0x7f9ec8069bc0 2023-11-28T13:01:14.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ec7fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80ca0c0 con 0x7f9ec806b910 2023-11-28T13:01:14.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ec77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec80ced70 0x7f9ec80cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:14.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ec77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec80ced70 0x7f9ec80cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40558/0 (socket says 172.21.15.82:40558) 2023-11-28T13:01:14.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ec77fe700 1 -- 172.21.15.82:0/1837566158 learned_addr learned my addr 172.21.15.82:0/1837566158 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:14.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ec6ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8069bc0 0x7f9ec814dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:14.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ec67fc700 1 --2- 172.21.15.82:0/1837566158 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ec806b910 0x7f9ec80cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:14.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ec77fe700 1 -- 172.21.15.82:0/1837566158 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ec806b910 msgr2=0x7f9ec80cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:14.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ec77fe700 1 --2- 172.21.15.82:0/1837566158 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ec806b910 0x7f9ec80cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ec77fe700 1 -- 172.21.15.82:0/1837566158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8069bc0 msgr2=0x7f9ec814dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:14.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ec77fe700 1 --2- 172.21.15.82:0/1837566158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8069bc0 0x7f9ec814dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ec77fe700 1 -- 172.21.15.82:0/1837566158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb8009570 con 0x7f9ec80ced70 2023-11-28T13:01:14.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ec77fe700 1 --2- 172.21.15.82:0/1837566158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec80ced70 0x7f9ec80cc400 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000eed0 tx=0x7f9ec000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:14.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ebf7fe700 1 -- 172.21.15.82:0/1837566158 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0010040 con 0x7f9ec80ced70 2023-11-28T13:01:14.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ebf7fe700 1 -- 172.21.15.82:0/1837566158 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec000b9f0 con 0x7f9ec80ced70 2023-11-28T13:01:14.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ec7fff700 1 -- 172.21.15.82:0/1837566158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec80cf2c0 con 0x7f9ec80ced70 2023-11-28T13:01:14.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ebf7fe700 1 -- 172.21.15.82:0/1837566158 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec000bda0 con 0x7f9ec80ced70 2023-11-28T13:01:14.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.791+0000 7f9ec7fff700 1 -- 172.21.15.82:0/1837566158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec80b2040 con 0x7f9ec80ced70 2023-11-28T13:01:14.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.795+0000 7f9ec7fff700 1 -- 172.21.15.82:0/1837566158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec80d2320 con 0x7f9ec80ced70 2023-11-28T13:01:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.795+0000 7f9ebf7fe700 1 -- 172.21.15.82:0/1837566158 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9ec0014400 con 0x7f9ec80ced70 2023-11-28T13:01:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.795+0000 7f9ebf7fe700 1 --2- 172.21.15.82:0/1837566158 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ea8064f10 0x7f9ea80673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.795+0000 7f9ebf7fe700 1 -- 172.21.15.82:0/1837566158 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9ec0082300 con 0x7f9ec80ced70 2023-11-28T13:01:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.795+0000 7f9ec6ffd700 1 --2- 172.21.15.82:0/1837566158 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ea8064f10 0x7f9ea80673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.795+0000 7f9ec6ffd700 1 --2- 172.21.15.82:0/1837566158 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ea8064f10 0x7f9ea80673c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009b50 tx=0x7f9eb0009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:14.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.803+0000 7f9ebf7fe700 1 -- 172.21.15.82:0/1837566158 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9ec0050380 con 0x7f9ec80ced70 2023-11-28T13:01:14.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.979+0000 7f9ec7fff700 1 -- 172.21.15.82:0/1837566158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9ec8065fc0 con 0x7f9ec80ced70 2023-11-28T13:01:14.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.979+0000 7f9ebf7fe700 1 -- 172.21.15.82:0/1837566158 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9ec00539a0 con 0x7f9ec80ced70 2023-11-28T13:01:14.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.983+0000 7f9ec7fff700 1 -- 172.21.15.82:0/1837566158 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ea8064f10 msgr2=0x7f9ea80673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:14.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.983+0000 7f9ec7fff700 1 --2- 172.21.15.82:0/1837566158 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ea8064f10 0x7f9ea80673c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009b50 tx=0x7f9eb0009240 comp rx=0 tx=0).stop 2023-11-28T13:01:14.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.983+0000 7f9ec7fff700 1 -- 172.21.15.82:0/1837566158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec80ced70 msgr2=0x7f9ec80cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:14.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.983+0000 7f9ec7fff700 1 --2- 172.21.15.82:0/1837566158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec80ced70 0x7f9ec80cc400 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000eed0 tx=0x7f9ec000ef00 comp rx=0 tx=0).stop 2023-11-28T13:01:14.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.983+0000 7f9ec7fff700 1 -- 172.21.15.82:0/1837566158 shutdown_connections 2023-11-28T13:01:14.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.983+0000 7f9ec7fff700 1 --2- 172.21.15.82:0/1837566158 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ea8064f10 0x7f9ea80673c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.983+0000 7f9ec7fff700 1 --2- 172.21.15.82:0/1837566158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec80ced70 0x7f9ec80cc400 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.983+0000 7f9ec7fff700 1 --2- 172.21.15.82:0/1837566158 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ec806b910 0x7f9ec80cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.983+0000 7f9ec7fff700 1 --2- 172.21.15.82:0/1837566158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8069bc0 0x7f9ec814dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:14.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.983+0000 7f9ec7fff700 1 -- 172.21.15.82:0/1837566158 >> 172.21.15.82:0/1837566158 conn(0x7f9ec80d2b20 msgr2=0x7f9ec80b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:14.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.983+0000 7f9ec7fff700 1 -- 172.21.15.82:0/1837566158 shutdown_connections 2023-11-28T13:01:14.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:14.983+0000 7f9ec7fff700 1 -- 172.21.15.82:0/1837566158 wait complete. 2023-11-28T13:01:14.988 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2023-11-28T13:01:14.999 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi114.front.sepia.ceph.com... 2023-11-28T13:01:14.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:14.999 DEBUG:teuthology.orchestra.run.smithi114:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-28T13:01:15.017 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:01:15.017 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-28T13:01:15.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:15.017 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T13:01:15.067 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T13:01:15.068 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:01:15.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.179+0000 7fe3a09ea700 1 Processor -- start 2023-11-28T13:01:15.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.179+0000 7fe3a09ea700 1 -- start start 2023-11-28T13:01:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.179+0000 7fe3a09ea700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe39c0b3910 0x7fe39c06b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.179+0000 7fe3a09ea700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe39c070070 0x7fe39c0704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.179+0000 7fe3a09ea700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39c06c480 con 0x7fe39c06c910 2023-11-28T13:01:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.179+0000 7fe3a09ea700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39c0709f0 con 0x7fe39c0b3910 2023-11-28T13:01:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.179+0000 7fe3a09ea700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c06dbe0 con 0x7fe39c070070 2023-11-28T13:01:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.179+0000 7fe39ad9d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe39c0b3910 0x7fe39c06b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.179+0000 7fe39b59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe39c070070 0x7fe39c0704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.179+0000 7fe39a59c700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe39c06c910 0x7fe39c06d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:39336/0 (socket says 172.21.15.82:39336) 2023-11-28T13:01:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.179+0000 7fe39a59c700 1 -- 172.21.15.82:0/1903088216 learned_addr learned my addr 172.21.15.82:0/1903088216 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.183+0000 7fe399d9b700 1 -- 172.21.15.82:0/1903088216 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234643646 0 0) 0x7fe39c06c480 con 0x7fe39c06c910 2023-11-28T13:01:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.183+0000 7fe399d9b700 1 -- 172.21.15.82:0/1903088216 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3840035d0 con 0x7fe39c06c910 2023-11-28T13:01:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.183+0000 7fe39b59e700 1 -- 172.21.15.82:0/1903088216 >> v2:172.21.15.114:3300/0 conn(0x7fe39c0b3910 msgr2=0x7fe39c06b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.183+0000 7fe39b59e700 1 --2- 172.21.15.82:0/1903088216 >> v2:172.21.15.114:3300/0 conn(0x7fe39c0b3910 0x7fe39c06b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.183+0000 7fe39b59e700 1 -- 172.21.15.82:0/1903088216 >> v1:172.21.15.114:6789/0 conn(0x7fe39c06c910 legacy=0x7fe39c06d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:15.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.183+0000 7fe39b59e700 1 -- 172.21.15.82:0/1903088216 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c06dec0 con 0x7fe39c070070 2023-11-28T13:01:15.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.183+0000 7fe39ad9d700 1 --2- 172.21.15.82:0/1903088216 >> v2:172.21.15.114:3300/0 conn(0x7fe39c0b3910 0x7fe39c06b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:15.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.183+0000 7fe39b59e700 1 --2- 172.21.15.82:0/1903088216 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe39c070070 0x7fe39c0704b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe394009850 tx=0x7fe394009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=628f344b45292c05 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:15.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.183+0000 7fe399d9b700 1 -- 172.21.15.82:0/1903088216 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe394011830 con 0x7fe39c070070 2023-11-28T13:01:15.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.183+0000 7fe399d9b700 1 -- 172.21.15.82:0/1903088216 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe394011990 con 0x7fe39c070070 2023-11-28T13:01:15.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.183+0000 7fe399d9b700 1 -- 172.21.15.82:0/1903088216 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe394011d00 con 0x7fe39c070070 2023-11-28T13:01:15.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.183+0000 7fe3a09ea700 1 -- 172.21.15.82:0/1903088216 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe39c070070 msgr2=0x7fe39c0704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:15.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.183+0000 7fe3a09ea700 1 --2- 172.21.15.82:0/1903088216 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe39c070070 0x7fe39c0704b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe394009850 tx=0x7fe394009b60 comp rx=0 tx=0).stop 2023-11-28T13:01:15.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.183+0000 7fe3a09ea700 1 -- 172.21.15.82:0/1903088216 shutdown_connections 2023-11-28T13:01:15.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.183+0000 7fe3a09ea700 1 --2- 172.21.15.82:0/1903088216 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe39c070070 0x7fe39c0704b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.183+0000 7fe3a09ea700 1 --2- 172.21.15.82:0/1903088216 >> v2:172.21.15.114:3300/0 conn(0x7fe39c0b3910 0x7fe39c06b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.183+0000 7fe3a09ea700 1 -- 172.21.15.82:0/1903088216 >> 172.21.15.82:0/1903088216 conn(0x7fe39c0ce600 msgr2=0x7fe39c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:15.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.183+0000 7fe3a09ea700 1 -- 172.21.15.82:0/1903088216 shutdown_connections 2023-11-28T13:01:15.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.183+0000 7fe3a09ea700 1 -- 172.21.15.82:0/1903088216 wait complete. 2023-11-28T13:01:15.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.183+0000 7fe3a09ea700 1 Processor -- start 2023-11-28T13:01:15.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.183+0000 7fe3a09ea700 1 -- start start 2023-11-28T13:01:15.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe3a09ea700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe39c06c910 0x7fe39c14fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:15.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe3a09ea700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe39c070070 0x7fe39c0aed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:15.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe3a09ea700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe39c0b3910 0x7fe39c0c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:15.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe3a09ea700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0af2b0 con 0x7fe39c070070 2023-11-28T13:01:15.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe3a09ea700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0c85b0 con 0x7fe39c06c910 2023-11-28T13:01:15.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe3a09ea700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0c72f0 con 0x7fe39c0b3910 2023-11-28T13:01:15.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe39a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe39c070070 0x7fe39c0aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:15.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe39a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe39c070070 0x7fe39c0aed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40564/0 (socket says 172.21.15.82:40564) 2023-11-28T13:01:15.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe39a59c700 1 -- 172.21.15.82:0/2276757376 learned_addr learned my addr 172.21.15.82:0/2276757376 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:15.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe39b59e700 1 --2- 172.21.15.82:0/2276757376 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe39c0b3910 0x7fe39c0c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:15.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe39ad9d700 1 --2- 172.21.15.82:0/2276757376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe39c06c910 0x7fe39c14fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:15.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe39a59c700 1 -- 172.21.15.82:0/2276757376 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe39c0b3910 msgr2=0x7fe39c0c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:15.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe39a59c700 1 --2- 172.21.15.82:0/2276757376 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe39c0b3910 0x7fe39c0c8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe39a59c700 1 -- 172.21.15.82:0/2276757376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe39c06c910 msgr2=0x7fe39c14fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:15.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe39a59c700 1 --2- 172.21.15.82:0/2276757376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe39c06c910 0x7fe39c14fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe39a59c700 1 -- 172.21.15.82:0/2276757376 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3900094b0 con 0x7fe39c070070 2023-11-28T13:01:15.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe39a59c700 1 --2- 172.21.15.82:0/2276757376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe39c070070 0x7fe39c0aed70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00cb70 tx=0x7fe38c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:15.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe3837fe700 1 -- 172.21.15.82:0/2276757376 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c007480 con 0x7fe39c070070 2023-11-28T13:01:15.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe3837fe700 1 -- 172.21.15.82:0/2276757376 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c0075e0 con 0x7fe39c070070 2023-11-28T13:01:15.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe3a09ea700 1 -- 172.21.15.82:0/2276757376 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3940094b0 con 0x7fe39c070070 2023-11-28T13:01:15.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe3837fe700 1 -- 172.21.15.82:0/2276757376 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c007990 con 0x7fe39c070070 2023-11-28T13:01:15.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe3a09ea700 1 -- 172.21.15.82:0/2276757376 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39c0c8f80 con 0x7fe39c070070 2023-11-28T13:01:15.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.187+0000 7fe3a09ea700 1 -- 172.21.15.82:0/2276757376 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe39c06c110 con 0x7fe39c070070 2023-11-28T13:01:15.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.191+0000 7fe3837fe700 1 -- 172.21.15.82:0/2276757376 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe38c019030 con 0x7fe39c070070 2023-11-28T13:01:15.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.191+0000 7fe3837fe700 1 --2- 172.21.15.82:0/2276757376 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe388064ee0 0x7fe388067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:15.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.191+0000 7fe39ad9d700 1 --2- 172.21.15.82:0/2276757376 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe388064ee0 0x7fe388067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:15.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.191+0000 7fe3837fe700 1 -- 172.21.15.82:0/2276757376 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe38c081720 con 0x7fe39c070070 2023-11-28T13:01:15.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.191+0000 7fe39ad9d700 1 --2- 172.21.15.82:0/2276757376 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe388064ee0 0x7fe388067390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0ae680 tx=0x7fe390009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:15.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.195+0000 7fe3837fe700 1 -- 172.21.15.82:0/2276757376 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe38c04f880 con 0x7fe39c070070 2023-11-28T13:01:15.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.391+0000 7fe3a09ea700 1 -- 172.21.15.82:0/2276757376 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe39c0b3ce0 con 0x7fe39c070070 2023-11-28T13:01:15.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.391+0000 7fe3837fe700 1 -- 172.21.15.82:0/2276757376 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4648 (secure 0 0 0) 0x7fe38c017090 con 0x7fe39c070070 2023-11-28T13:01:15.398 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:15.398 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2058451312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2058451312},{"type":"v1","addr":"172.21.15.82:6835","nonce":2058451312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/4064345694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":4064345694},{"type":"v1","addr":"172.21.15.114:6833","nonce":4064345694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2802500604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2802500604},{"type":"v1","addr":"172.21.15.114:6835","nonce":2802500604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:00:25.978137+0000","modified":"2023-11-28T13:00:28.990262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2893797521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2893797521},{"type":"v1","addr":"172.21.15.82:6837","nonce":2893797521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T13:01:15.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.395+0000 7fe3a09ea700 1 -- 172.21.15.82:0/2276757376 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe388064ee0 msgr2=0x7fe388067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:15.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.395+0000 7fe3a09ea700 1 --2- 172.21.15.82:0/2276757376 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe388064ee0 0x7fe388067390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0ae680 tx=0x7fe390009240 comp rx=0 tx=0).stop 2023-11-28T13:01:15.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.395+0000 7fe3a09ea700 1 -- 172.21.15.82:0/2276757376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe39c070070 msgr2=0x7fe39c0aed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:15.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.395+0000 7fe3a09ea700 1 --2- 172.21.15.82:0/2276757376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe39c070070 0x7fe39c0aed70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00cb70 tx=0x7fe38c00cba0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.395+0000 7fe3a09ea700 1 -- 172.21.15.82:0/2276757376 shutdown_connections 2023-11-28T13:01:15.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.395+0000 7fe3a09ea700 1 --2- 172.21.15.82:0/2276757376 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe388064ee0 0x7fe388067390 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.395+0000 7fe3a09ea700 1 --2- 172.21.15.82:0/2276757376 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe39c0b3910 0x7fe39c0c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.395+0000 7fe3a09ea700 1 --2- 172.21.15.82:0/2276757376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe39c070070 0x7fe39c0aed70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.395+0000 7fe3a09ea700 1 --2- 172.21.15.82:0/2276757376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe39c06c910 0x7fe39c14fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.395+0000 7fe3a09ea700 1 -- 172.21.15.82:0/2276757376 >> 172.21.15.82:0/2276757376 conn(0x7fe39c0ce600 msgr2=0x7fe39c0cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:15.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.395+0000 7fe3a09ea700 1 -- 172.21.15.82:0/2276757376 shutdown_connections 2023-11-28T13:01:15.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.395+0000 7fe3a09ea700 1 -- 172.21.15.82:0/2276757376 wait complete. 2023-11-28T13:01:15.402 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 7 2023-11-28T13:01:15.412 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:01:15.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.519+0000 7f622555a700 1 Processor -- start 2023-11-28T13:01:15.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.519+0000 7f622555a700 1 -- start start 2023-11-28T13:01:15.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.519+0000 7f622555a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f62200b1c70 0x7f622006a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:15.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.519+0000 7f622555a700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f62200b5870 0x7f62200b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:15.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.519+0000 7f622555a700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62200d0c70 con 0x7f62200b5c80 2023-11-28T13:01:15.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.519+0000 7f622555a700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62200cd090 con 0x7f62200b1c70 2023-11-28T13:01:15.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.519+0000 7f622555a700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62200cd8a0 con 0x7f62200b5870 2023-11-28T13:01:15.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.519+0000 7f621ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f62200b1c70 0x7f622006a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:15.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.519+0000 7f621f7fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f62200b5870 0x7f62200b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:15.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.519+0000 7f621ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f62200b1c70 0x7f622006a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40568/0 (socket says 172.21.15.82:40568) 2023-11-28T13:01:15.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.519+0000 7f621ffff700 1 -- 172.21.15.82:0/2521796221 learned_addr learned my addr 172.21.15.82:0/2521796221 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:15.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.519+0000 7f621ffff700 1 -- 172.21.15.82:0/2521796221 >> v2:172.21.15.114:3300/0 conn(0x7f62200b5870 msgr2=0x7f62200b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:15.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.519+0000 7f621ffff700 1 --2- 172.21.15.82:0/2521796221 >> v2:172.21.15.114:3300/0 conn(0x7f62200b5870 0x7f62200b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.519+0000 7f621ffff700 1 -- 172.21.15.82:0/2521796221 >> v1:172.21.15.114:6789/0 conn(0x7f62200b5c80 legacy=0x7f62200d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:15.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.519+0000 7f621ffff700 1 -- 172.21.15.82:0/2521796221 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622006ab10 con 0x7f62200b1c70 2023-11-28T13:01:15.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.523+0000 7f621ffff700 1 --2- 172.21.15.82:0/2521796221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62200b1c70 0x7f622006a5d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f622015fcf0 tx=0x7f6218009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98ece0496b695ea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:15.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.523+0000 7f621effd700 1 -- 172.21.15.82:0/2521796221 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6218011830 con 0x7f62200b1c70 2023-11-28T13:01:15.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.523+0000 7f621effd700 1 -- 172.21.15.82:0/2521796221 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6218011990 con 0x7f62200b1c70 2023-11-28T13:01:15.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.523+0000 7f621effd700 1 -- 172.21.15.82:0/2521796221 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6218011d20 con 0x7f62200b1c70 2023-11-28T13:01:15.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.523+0000 7f622555a700 1 -- 172.21.15.82:0/2521796221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62200b1c70 msgr2=0x7f622006a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:15.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.523+0000 7f622555a700 1 --2- 172.21.15.82:0/2521796221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62200b1c70 0x7f622006a5d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f622015fcf0 tx=0x7f6218009bf0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.523+0000 7f622555a700 1 -- 172.21.15.82:0/2521796221 shutdown_connections 2023-11-28T13:01:15.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.523+0000 7f622555a700 1 --2- 172.21.15.82:0/2521796221 >> v2:172.21.15.114:3300/0 conn(0x7f62200b5870 0x7f62200b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.523+0000 7f622555a700 1 --2- 172.21.15.82:0/2521796221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62200b1c70 0x7f622006a5d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.523+0000 7f622555a700 1 -- 172.21.15.82:0/2521796221 >> 172.21.15.82:0/2521796221 conn(0x7f62200cf4c0 msgr2=0x7f62200cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:15.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.523+0000 7f622555a700 1 -- 172.21.15.82:0/2521796221 shutdown_connections 2023-11-28T13:01:15.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.523+0000 7f622555a700 1 -- 172.21.15.82:0/2521796221 wait complete. 2023-11-28T13:01:15.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.523+0000 7f622555a700 1 Processor -- start 2023-11-28T13:01:15.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.523+0000 7f622555a700 1 -- start start 2023-11-28T13:01:15.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f622555a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62200b1c70 0x7f622014da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:15.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f622555a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62200b5870 0x7f62200ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:15.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f622555a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62200b5c80 0x7f622015de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:15.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f622555a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6220153290 con 0x7f62200b1c70 2023-11-28T13:01:15.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f622555a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6220152c80 con 0x7f62200b5870 2023-11-28T13:01:15.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f622555a700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62200cafa0 con 0x7f62200b5c80 2023-11-28T13:01:15.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f621ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62200b1c70 0x7f622014da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:15.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f621ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62200b1c70 0x7f622014da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40576/0 (socket says 172.21.15.82:40576) 2023-11-28T13:01:15.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f621ffff700 1 -- 172.21.15.82:0/3747020497 learned_addr learned my addr 172.21.15.82:0/3747020497 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:15.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f621f7fe700 1 --2- 172.21.15.82:0/3747020497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62200b5870 0x7f62200ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:15.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f6224d59700 1 --2- 172.21.15.82:0/3747020497 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62200b5c80 0x7f622015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:15.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f621ffff700 1 -- 172.21.15.82:0/3747020497 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62200b5c80 msgr2=0x7f622015de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:15.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f621ffff700 1 --2- 172.21.15.82:0/3747020497 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62200b5c80 0x7f622015de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f621ffff700 1 -- 172.21.15.82:0/3747020497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62200b5870 msgr2=0x7f62200ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:15.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f621ffff700 1 --2- 172.21.15.82:0/3747020497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62200b5870 0x7f62200ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f621ffff700 1 -- 172.21.15.82:0/3747020497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6218009570 con 0x7f62200b1c70 2023-11-28T13:01:15.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f621ffff700 1 --2- 172.21.15.82:0/3747020497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62200b1c70 0x7f622014da40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6220072470 tx=0x7f6218004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:15.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f621cff9700 1 -- 172.21.15.82:0/3747020497 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6218004550 con 0x7f62200b1c70 2023-11-28T13:01:15.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f621cff9700 1 -- 172.21.15.82:0/3747020497 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621801f070 con 0x7f62200b1c70 2023-11-28T13:01:15.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f622555a700 1 -- 172.21.15.82:0/3747020497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62200cd5c0 con 0x7f62200b1c70 2023-11-28T13:01:15.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f621cff9700 1 -- 172.21.15.82:0/3747020497 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6218003900 con 0x7f62200b1c70 2023-11-28T13:01:15.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f622555a700 1 -- 172.21.15.82:0/3747020497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62200cd2e0 con 0x7f62200b1c70 2023-11-28T13:01:15.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f622555a700 1 -- 172.21.15.82:0/3747020497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62200d0900 con 0x7f62200b1c70 2023-11-28T13:01:15.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.527+0000 7f621cff9700 1 -- 172.21.15.82:0/3747020497 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f621800f050 con 0x7f62200b1c70 2023-11-28T13:01:15.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.531+0000 7f621cff9700 1 --2- 172.21.15.82:0/3747020497 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6204064ee0 0x7f6204067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:15.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.531+0000 7f621cff9700 1 -- 172.21.15.82:0/3747020497 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6218021070 con 0x7f62200b1c70 2023-11-28T13:01:15.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.531+0000 7f621f7fe700 1 --2- 172.21.15.82:0/3747020497 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6204064ee0 0x7f6204067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:15.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.531+0000 7f621f7fe700 1 --2- 172.21.15.82:0/3747020497 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6204064ee0 0x7f6204067390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f622015ec20 tx=0x7f620800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:15.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.539+0000 7f621cff9700 1 -- 172.21.15.82:0/3747020497 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6218051490 con 0x7f62200b1c70 2023-11-28T13:01:15.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.699+0000 7f622555a700 1 -- 172.21.15.82:0/3747020497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6220065fc0 con 0x7f62200b1c70 2023-11-28T13:01:15.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.703+0000 7f621cff9700 1 -- 172.21.15.82:0/3747020497 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17907 (secure 0 0 0) 0x7f6218015090 con 0x7f62200b1c70 2023-11-28T13:01:15.708 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:15.709 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:01:08.993802+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:00:24.360641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T13:00:24.960863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.26","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:01:15.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.703+0000 7f622555a700 1 -- 172.21.15.82:0/3747020497 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6204064ee0 msgr2=0x7f6204067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:15.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.703+0000 7f622555a700 1 --2- 172.21.15.82:0/3747020497 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6204064ee0 0x7f6204067390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f622015ec20 tx=0x7f620800b040 comp rx=0 tx=0).stop 2023-11-28T13:01:15.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.703+0000 7f622555a700 1 -- 172.21.15.82:0/3747020497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62200b1c70 msgr2=0x7f622014da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:15.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.703+0000 7f622555a700 1 --2- 172.21.15.82:0/3747020497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62200b1c70 0x7f622014da40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6220072470 tx=0x7f6218004770 comp rx=0 tx=0).stop 2023-11-28T13:01:15.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.707+0000 7f622555a700 1 -- 172.21.15.82:0/3747020497 shutdown_connections 2023-11-28T13:01:15.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.707+0000 7f622555a700 1 --2- 172.21.15.82:0/3747020497 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6204064ee0 0x7f6204067390 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.707+0000 7f622555a700 1 --2- 172.21.15.82:0/3747020497 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62200b5c80 0x7f622015de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.707+0000 7f622555a700 1 --2- 172.21.15.82:0/3747020497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62200b5870 0x7f62200ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.707+0000 7f622555a700 1 --2- 172.21.15.82:0/3747020497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62200b1c70 0x7f622014da40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.707+0000 7f622555a700 1 -- 172.21.15.82:0/3747020497 >> 172.21.15.82:0/3747020497 conn(0x7f62200cf4c0 msgr2=0x7f62200d1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:15.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.707+0000 7f622555a700 1 -- 172.21.15.82:0/3747020497 shutdown_connections 2023-11-28T13:01:15.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.707+0000 7f622555a700 1 -- 172.21.15.82:0/3747020497 wait complete. 2023-11-28T13:01:15.726 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T13:00:24.360641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T13:00:24.960863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:01:15.727 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:01:15.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.835+0000 7eff5c9f6700 1 Processor -- start 2023-11-28T13:01:15.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.835+0000 7eff5c9f6700 1 -- start start 2023-11-28T13:01:15.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.835+0000 7eff5c9f6700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7eff58071130 0x7eff58146150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:15.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.835+0000 7eff5c9f6700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff58164430 con 0x7eff5815ac30 2023-11-28T13:01:15.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.835+0000 7eff5c9f6700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff58164710 con 0x7eff58146690 2023-11-28T13:01:15.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.835+0000 7eff5c9f6700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff58164220 con 0x7eff58071130 2023-11-28T13:01:15.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.835+0000 7eff5659c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7eff5815ac30 0x7eff58070a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50264/0 (socket says 172.21.15.82:50264) 2023-11-28T13:01:15.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.835+0000 7eff5659c700 1 -- 172.21.15.82:0/625405593 learned_addr learned my addr 172.21.15.82:0/625405593 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:15.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.835+0000 7eff55d9b700 1 --2- 172.21.15.82:0/625405593 >> v2:172.21.15.114:3300/0 conn(0x7eff58071130 0x7eff58146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:15.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.835+0000 7eff5559a700 1 -- 172.21.15.82:0/625405593 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178073153 0 0) 0x7eff58164430 con 0x7eff5815ac30 2023-11-28T13:01:15.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.835+0000 7eff5559a700 1 -- 172.21.15.82:0/625405593 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff400035d0 con 0x7eff5815ac30 2023-11-28T13:01:15.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.835+0000 7eff55d9b700 1 -- 172.21.15.82:0/625405593 >> v1:172.21.15.114:6789/0 conn(0x7eff58146690 legacy=0x7eff58160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:15.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.835+0000 7eff5559a700 1 -- 172.21.15.82:0/625405593 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 121093045 0 0) 0x7eff400035d0 con 0x7eff5815ac30 2023-11-28T13:01:15.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.835+0000 7eff55d9b700 1 -- 172.21.15.82:0/625405593 >> v1:172.21.15.82:6789/0 conn(0x7eff5815ac30 legacy=0x7eff58070a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:15.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.835+0000 7eff55d9b700 1 -- 172.21.15.82:0/625405593 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff581649f0 con 0x7eff58071130 2023-11-28T13:01:15.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.835+0000 7eff55d9b700 1 --2- 172.21.15.82:0/625405593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff58071130 0x7eff58146150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7eff48009d90 tx=0x7eff4800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6c29c9a2a67c0f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:15.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.835+0000 7eff5559a700 1 -- 172.21.15.82:0/625405593 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4800e070 con 0x7eff58071130 2023-11-28T13:01:15.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.835+0000 7eff5559a700 1 -- 172.21.15.82:0/625405593 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff48003a40 con 0x7eff58071130 2023-11-28T13:01:15.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.835+0000 7eff5559a700 1 -- 172.21.15.82:0/625405593 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c001670 con 0x7eff58071130 2023-11-28T13:01:15.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.835+0000 7eff5c9f6700 1 -- 172.21.15.82:0/625405593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff58071130 msgr2=0x7eff58146150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:15.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.835+0000 7eff5c9f6700 1 --2- 172.21.15.82:0/625405593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff58071130 0x7eff58146150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7eff48009d90 tx=0x7eff4800b330 comp rx=0 tx=0).stop 2023-11-28T13:01:15.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.839+0000 7eff5c9f6700 1 -- 172.21.15.82:0/625405593 shutdown_connections 2023-11-28T13:01:15.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.839+0000 7eff5c9f6700 1 --2- 172.21.15.82:0/625405593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff58071130 0x7eff58146150 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.839+0000 7eff5c9f6700 1 -- 172.21.15.82:0/625405593 >> 172.21.15.82:0/625405593 conn(0x7eff580b18c0 msgr2=0x7eff580cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:15.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.839+0000 7eff5c9f6700 1 -- 172.21.15.82:0/625405593 shutdown_connections 2023-11-28T13:01:15.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.839+0000 7eff5c9f6700 1 -- 172.21.15.82:0/625405593 wait complete. 2023-11-28T13:01:15.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.839+0000 7eff5c9f6700 1 Processor -- start 2023-11-28T13:01:15.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.839+0000 7eff5c9f6700 1 -- start start 2023-11-28T13:01:15.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.839+0000 7eff5c9f6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff58071130 0x7eff58158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:15.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.839+0000 7eff5c9f6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff58146690 0x7eff580b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:15.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.839+0000 7eff5c9f6700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff5815ac30 0x7eff58145110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:15.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.839+0000 7eff5c9f6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff580b2ed0 con 0x7eff58071130 2023-11-28T13:01:15.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.839+0000 7eff5c9f6700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff581f6030 con 0x7eff58146690 2023-11-28T13:01:15.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.839+0000 7eff5c9f6700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff580b2910 con 0x7eff5815ac30 2023-11-28T13:01:15.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.839+0000 7eff5659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff58071130 0x7eff58158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:15.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.839+0000 7eff5659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff58071130 0x7eff58158630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40578/0 (socket says 172.21.15.82:40578) 2023-11-28T13:01:15.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.839+0000 7eff5659c700 1 -- 172.21.15.82:0/3819238746 learned_addr learned my addr 172.21.15.82:0/3819238746 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:15.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.839+0000 7eff55d9b700 1 --2- 172.21.15.82:0/3819238746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff58146690 0x7eff580b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:15.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.839+0000 7eff56d9d700 1 --2- 172.21.15.82:0/3819238746 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff5815ac30 0x7eff58145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:15.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.843+0000 7eff5659c700 1 -- 172.21.15.82:0/3819238746 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff5815ac30 msgr2=0x7eff58145110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:15.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.843+0000 7eff5659c700 1 --2- 172.21.15.82:0/3819238746 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff5815ac30 0x7eff58145110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.843+0000 7eff5659c700 1 -- 172.21.15.82:0/3819238746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff58146690 msgr2=0x7eff580b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:15.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.843+0000 7eff5659c700 1 --2- 172.21.15.82:0/3819238746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff58146690 0x7eff580b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:15.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.843+0000 7eff5659c700 1 -- 172.21.15.82:0/3819238746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff48009a70 con 0x7eff58071130 2023-11-28T13:01:15.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.843+0000 7eff5659c700 1 --2- 172.21.15.82:0/3819238746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff58071130 0x7eff58158630 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0011e0 tx=0x7eff4c00ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:15.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.843+0000 7eff46ffd700 1 -- 172.21.15.82:0/3819238746 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c004ca0 con 0x7eff58071130 2023-11-28T13:01:15.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.843+0000 7eff46ffd700 1 -- 172.21.15.82:0/3819238746 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4c004e00 con 0x7eff58071130 2023-11-28T13:01:15.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.843+0000 7eff46ffd700 1 -- 172.21.15.82:0/3819238746 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c0072f0 con 0x7eff58071130 2023-11-28T13:01:15.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.843+0000 7eff5c9f6700 1 -- 172.21.15.82:0/3819238746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff58143e00 con 0x7eff58071130 2023-11-28T13:01:15.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.843+0000 7eff5c9f6700 1 -- 172.21.15.82:0/3819238746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff58164cd0 con 0x7eff58071130 2023-11-28T13:01:15.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.843+0000 7eff5c9f6700 1 -- 172.21.15.82:0/3819238746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff5815b000 con 0x7eff58071130 2023-11-28T13:01:15.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.843+0000 7eff46ffd700 1 -- 172.21.15.82:0/3819238746 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7eff4c01a020 con 0x7eff58071130 2023-11-28T13:01:15.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.847+0000 7eff46ffd700 1 --2- 172.21.15.82:0/3819238746 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7eff38064ee0 0x7eff38067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:15.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.847+0000 7eff46ffd700 1 -- 172.21.15.82:0/3819238746 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7eff4c081c40 con 0x7eff58071130 2023-11-28T13:01:15.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.847+0000 7eff55d9b700 1 --2- 172.21.15.82:0/3819238746 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7eff38064ee0 0x7eff38067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:15.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.847+0000 7eff55d9b700 1 --2- 172.21.15.82:0/3819238746 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7eff38064ee0 0x7eff38067390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7eff580b0be0 tx=0x7eff48011000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:15.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:15.855+0000 7eff46ffd700 1 -- 172.21.15.82:0/3819238746 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7eff4c04fd60 con 0x7eff58071130 2023-11-28T13:01:16.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.015+0000 7eff5c9f6700 1 -- 172.21.15.82:0/3819238746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7eff58073e20 con 0x7eff58071130 2023-11-28T13:01:16.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.015+0000 7eff46ffd700 1 -- 172.21.15.82:0/3819238746 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7eff4c053380 con 0x7eff58071130 2023-11-28T13:01:16.022 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:01:16.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.019+0000 7eff5c9f6700 1 -- 172.21.15.82:0/3819238746 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7eff38064ee0 msgr2=0x7eff38067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:16.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.019+0000 7eff5c9f6700 1 --2- 172.21.15.82:0/3819238746 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7eff38064ee0 0x7eff38067390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7eff580b0be0 tx=0x7eff48011000 comp rx=0 tx=0).stop 2023-11-28T13:01:16.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.019+0000 7eff5c9f6700 1 -- 172.21.15.82:0/3819238746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff58071130 msgr2=0x7eff58158630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:16.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.019+0000 7eff5c9f6700 1 --2- 172.21.15.82:0/3819238746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff58071130 0x7eff58158630 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0011e0 tx=0x7eff4c00ca50 comp rx=0 tx=0).stop 2023-11-28T13:01:16.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.019+0000 7eff5c9f6700 1 -- 172.21.15.82:0/3819238746 shutdown_connections 2023-11-28T13:01:16.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.019+0000 7eff5c9f6700 1 --2- 172.21.15.82:0/3819238746 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7eff38064ee0 0x7eff38067390 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.019+0000 7eff5c9f6700 1 --2- 172.21.15.82:0/3819238746 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff5815ac30 0x7eff58145110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.019+0000 7eff5c9f6700 1 --2- 172.21.15.82:0/3819238746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff58146690 0x7eff580b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.019+0000 7eff5c9f6700 1 --2- 172.21.15.82:0/3819238746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff58071130 0x7eff58158630 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.019+0000 7eff5c9f6700 1 -- 172.21.15.82:0/3819238746 >> 172.21.15.82:0/3819238746 conn(0x7eff580b18c0 msgr2=0x7eff5806dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:16.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.019+0000 7eff5c9f6700 1 -- 172.21.15.82:0/3819238746 shutdown_connections 2023-11-28T13:01:16.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.019+0000 7eff5c9f6700 1 -- 172.21.15.82:0/3819238746 wait complete. 2023-11-28T13:01:16.037 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:01:16.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.155+0000 7f8c0a790700 1 Processor -- start 2023-11-28T13:01:16.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.155+0000 7f8c0a790700 1 -- start start 2023-11-28T13:01:16.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.155+0000 7f8c0a790700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c04071820 0x7f8c040ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:16.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.155+0000 7f8c0a790700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0415a4b0 con 0x7f8c040cba10 2023-11-28T13:01:16.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.155+0000 7f8c0a790700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c04159930 con 0x7f8c040ce2d0 2023-11-28T13:01:16.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.155+0000 7f8c0a790700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c04159c10 con 0x7f8c04071820 2023-11-28T13:01:16.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.155+0000 7f8c0978e700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8c040cba10 0x7f8c040ca6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50268/0 (socket says 172.21.15.82:50268) 2023-11-28T13:01:16.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.155+0000 7f8c0978e700 1 -- 172.21.15.82:0/1993659533 learned_addr learned my addr 172.21.15.82:0/1993659533 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:16.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.159+0000 7f8c09f8f700 1 --2- 172.21.15.82:0/1993659533 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c04071820 0x7f8c040ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:16.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.159+0000 7f8bfbfff700 1 -- 172.21.15.82:0/1993659533 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181534862 0 0) 0x7f8c0415a4b0 con 0x7f8c040cba10 2023-11-28T13:01:16.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.159+0000 7f8bfbfff700 1 -- 172.21.15.82:0/1993659533 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bf00035d0 con 0x7f8c040cba10 2023-11-28T13:01:16.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.159+0000 7f8bfbfff700 1 -- 172.21.15.82:0/1993659533 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115678303 0 0) 0x7f8c04159930 con 0x7f8c040ce2d0 2023-11-28T13:01:16.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.159+0000 7f8bfbfff700 1 -- 172.21.15.82:0/1993659533 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c0415a4b0 con 0x7f8c040ce2d0 2023-11-28T13:01:16.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.159+0000 7f8c09f8f700 1 -- 172.21.15.82:0/1993659533 >> v1:172.21.15.114:6789/0 conn(0x7f8c040ce2d0 legacy=0x7f8c04071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:16.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.159+0000 7f8c09f8f700 1 -- 172.21.15.82:0/1993659533 >> v1:172.21.15.82:6789/0 conn(0x7f8c040cba10 legacy=0x7f8c040ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:16.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.159+0000 7f8bfbfff700 1 -- 172.21.15.82:0/1993659533 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1262637629 0 0) 0x7f8bf00035d0 con 0x7f8c040cba10 2023-11-28T13:01:16.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.159+0000 7f8c09f8f700 1 -- 172.21.15.82:0/1993659533 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c04159ef0 con 0x7f8c04071820 2023-11-28T13:01:16.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.159+0000 7f8c09f8f700 1 --2- 172.21.15.82:0/1993659533 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c04071820 0x7f8c040ce740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009dc0 tx=0x7f8bfc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efe5567fb3920790 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:16.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.159+0000 7f8bfbfff700 1 -- 172.21.15.82:0/1993659533 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc00e070 con 0x7f8c04071820 2023-11-28T13:01:16.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.159+0000 7f8bfbfff700 1 -- 172.21.15.82:0/1993659533 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc003a40 con 0x7f8c04071820 2023-11-28T13:01:16.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.159+0000 7f8bfbfff700 1 -- 172.21.15.82:0/1993659533 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c00001670 con 0x7f8c04071820 2023-11-28T13:01:16.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.159+0000 7f8c0a790700 1 -- 172.21.15.82:0/1993659533 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c04071820 msgr2=0x7f8c040ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:16.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.159+0000 7f8c0a790700 1 --2- 172.21.15.82:0/1993659533 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c04071820 0x7f8c040ce740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009dc0 tx=0x7f8bfc00b330 comp rx=0 tx=0).stop 2023-11-28T13:01:16.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.159+0000 7f8c0a790700 1 -- 172.21.15.82:0/1993659533 shutdown_connections 2023-11-28T13:01:16.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.159+0000 7f8c0a790700 1 --2- 172.21.15.82:0/1993659533 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c04071820 0x7f8c040ce740 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.159+0000 7f8c0a790700 1 -- 172.21.15.82:0/1993659533 >> 172.21.15.82:0/1993659533 conn(0x7f8c040b1f50 msgr2=0x7f8c040cf790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:16.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.159+0000 7f8c0a790700 1 -- 172.21.15.82:0/1993659533 shutdown_connections 2023-11-28T13:01:16.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.159+0000 7f8c0a790700 1 -- 172.21.15.82:0/1993659533 wait complete. 2023-11-28T13:01:16.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.163+0000 7f8c0a790700 1 Processor -- start 2023-11-28T13:01:16.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.163+0000 7f8c0a790700 1 -- start start 2023-11-28T13:01:16.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.163+0000 7f8c0a790700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c04071820 0x7f8c041f1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:16.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.163+0000 7f8c0a790700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c040cba10 0x7f8c040c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:16.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.163+0000 7f8c0a790700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c040ce2d0 0x7f8c04151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:16.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.163+0000 7f8c0a790700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040b3b90 con 0x7f8c04071820 2023-11-28T13:01:16.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.163+0000 7f8c0a790700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040b2f80 con 0x7f8c040cba10 2023-11-28T13:01:16.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.163+0000 7f8c0a790700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040b3260 con 0x7f8c040ce2d0 2023-11-28T13:01:16.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.163+0000 7f8c0978e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c04071820 0x7f8c041f1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:16.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.163+0000 7f8c09f8f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c040ce2d0 0x7f8c04151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:16.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.163+0000 7f8c0978e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c04071820 0x7f8c041f1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40586/0 (socket says 172.21.15.82:40586) 2023-11-28T13:01:16.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.163+0000 7f8c0978e700 1 -- 172.21.15.82:0/2675834518 learned_addr learned my addr 172.21.15.82:0/2675834518 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:16.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.163+0000 7f8c08f8d700 1 --2- 172.21.15.82:0/2675834518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c040cba10 0x7f8c040c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:16.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.163+0000 7f8c0978e700 1 -- 172.21.15.82:0/2675834518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c040ce2d0 msgr2=0x7f8c04151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:16.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.163+0000 7f8c0978e700 1 --2- 172.21.15.82:0/2675834518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c040ce2d0 0x7f8c04151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.163+0000 7f8c0978e700 1 -- 172.21.15.82:0/2675834518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c040cba10 msgr2=0x7f8c040c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:16.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.163+0000 7f8c0978e700 1 --2- 172.21.15.82:0/2675834518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c040cba10 0x7f8c040c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.167+0000 7f8c0978e700 1 -- 172.21.15.82:0/2675834518 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc009a70 con 0x7f8c04071820 2023-11-28T13:01:16.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.167+0000 7f8c0978e700 1 --2- 172.21.15.82:0/2675834518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c04071820 0x7f8c041f1780 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8c0000c750 tx=0x7f8c0000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:16.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.167+0000 7f8bf9ffb700 1 -- 172.21.15.82:0/2675834518 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c00004ca0 con 0x7f8c04071820 2023-11-28T13:01:16.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.167+0000 7f8c0a790700 1 -- 172.21.15.82:0/2675834518 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c041594e0 con 0x7f8c04071820 2023-11-28T13:01:16.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.167+0000 7f8c0a790700 1 -- 172.21.15.82:0/2675834518 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0415a1d0 con 0x7f8c04071820 2023-11-28T13:01:16.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.167+0000 7f8bf9ffb700 1 -- 172.21.15.82:0/2675834518 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c00004e00 con 0x7f8c04071820 2023-11-28T13:01:16.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.167+0000 7f8bf9ffb700 1 -- 172.21.15.82:0/2675834518 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c000072f0 con 0x7f8c04071820 2023-11-28T13:01:16.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.167+0000 7f8c0a790700 1 -- 172.21.15.82:0/2675834518 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be4005310 con 0x7f8c04071820 2023-11-28T13:01:16.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.167+0000 7f8bf9ffb700 1 -- 172.21.15.82:0/2675834518 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8c0001a020 con 0x7f8c04071820 2023-11-28T13:01:16.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.167+0000 7f8bf9ffb700 1 --2- 172.21.15.82:0/2675834518 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8be8064ee0 0x7f8be8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:16.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.167+0000 7f8bf9ffb700 1 -- 172.21.15.82:0/2675834518 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8c00081d50 con 0x7f8c04071820 2023-11-28T13:01:16.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.167+0000 7f8c08f8d700 1 --2- 172.21.15.82:0/2675834518 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8be8064ee0 0x7f8be8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:16.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.171+0000 7f8c08f8d700 1 --2- 172.21.15.82:0/2675834518 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8be8064ee0 0x7f8be8067390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8c04159030 tx=0x7f8bf4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:16.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.179+0000 7f8bf9ffb700 1 -- 172.21.15.82:0/2675834518 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8c0004fd60 con 0x7f8c04071820 2023-11-28T13:01:16.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.343+0000 7f8c0a790700 1 -- 172.21.15.82:0/2675834518 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8be4005b40 con 0x7f8c04071820 2023-11-28T13:01:16.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.343+0000 7f8bf9ffb700 1 -- 172.21.15.82:0/2675834518 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8c00053380 con 0x7f8c04071820 2023-11-28T13:01:16.347 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:01:16.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.343+0000 7f8c0a790700 1 -- 172.21.15.82:0/2675834518 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8be8064ee0 msgr2=0x7f8be8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:16.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.343+0000 7f8c0a790700 1 --2- 172.21.15.82:0/2675834518 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8be8064ee0 0x7f8be8067390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8c04159030 tx=0x7f8bf4009040 comp rx=0 tx=0).stop 2023-11-28T13:01:16.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.343+0000 7f8c0a790700 1 -- 172.21.15.82:0/2675834518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c04071820 msgr2=0x7f8c041f1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:16.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.343+0000 7f8c0a790700 1 --2- 172.21.15.82:0/2675834518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c04071820 0x7f8c041f1780 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8c0000c750 tx=0x7f8c0000ca60 comp rx=0 tx=0).stop 2023-11-28T13:01:16.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.343+0000 7f8c0a790700 1 -- 172.21.15.82:0/2675834518 shutdown_connections 2023-11-28T13:01:16.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.343+0000 7f8c0a790700 1 --2- 172.21.15.82:0/2675834518 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8be8064ee0 0x7f8be8067390 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.343+0000 7f8c0a790700 1 --2- 172.21.15.82:0/2675834518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c040ce2d0 0x7f8c04151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.343+0000 7f8c0a790700 1 --2- 172.21.15.82:0/2675834518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c040cba10 0x7f8c040c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.343+0000 7f8c0a790700 1 --2- 172.21.15.82:0/2675834518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c04071820 0x7f8c041f1780 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.343+0000 7f8c0a790700 1 -- 172.21.15.82:0/2675834518 >> 172.21.15.82:0/2675834518 conn(0x7f8c040b1f50 msgr2=0x7f8c040ae8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:16.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.343+0000 7f8c0a790700 1 -- 172.21.15.82:0/2675834518 shutdown_connections 2023-11-28T13:01:16.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.343+0000 7f8c0a790700 1 -- 172.21.15.82:0/2675834518 wait complete. 2023-11-28T13:01:16.362 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T13:01:16.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.475+0000 7efcf592f700 1 Processor -- start 2023-11-28T13:01:16.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.475+0000 7efcf592f700 1 -- start start 2023-11-28T13:01:16.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.475+0000 7efcf592f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efcf0150ee0 0x7efcf0070120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:16.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.475+0000 7efcf592f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efcf0070660 0x7efcf006ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:16.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.475+0000 7efcf592f700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf0069bc0 con 0x7efcf006b180 2023-11-28T13:01:16.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.475+0000 7efcf592f700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf0069e80 con 0x7efcf0070660 2023-11-28T13:01:16.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.475+0000 7efcf592f700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf006a160 con 0x7efcf0150ee0 2023-11-28T13:01:16.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.475+0000 7efceffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efcf0070660 0x7efcf006ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:16.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.475+0000 7efceffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efcf0070660 0x7efcf006ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40600/0 (socket says 172.21.15.82:40600) 2023-11-28T13:01:16.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.475+0000 7efceffff700 1 -- 172.21.15.82:0/1920863684 learned_addr learned my addr 172.21.15.82:0/1920863684 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:16.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.475+0000 7efcf492d700 1 --2- 172.21.15.82:0/1920863684 >> v2:172.21.15.114:3300/0 conn(0x7efcf0150ee0 0x7efcf0070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:16.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.475+0000 7efceffff700 1 -- 172.21.15.82:0/1920863684 >> v2:172.21.15.114:3300/0 conn(0x7efcf0150ee0 msgr2=0x7efcf0070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:16.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.475+0000 7efceffff700 1 --2- 172.21.15.82:0/1920863684 >> v2:172.21.15.114:3300/0 conn(0x7efcf0150ee0 0x7efcf0070120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.475+0000 7efceffff700 1 -- 172.21.15.82:0/1920863684 >> v1:172.21.15.114:6789/0 conn(0x7efcf006b180 legacy=0x7efcf00ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:16.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.479+0000 7efceffff700 1 -- 172.21.15.82:0/1920863684 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf006a440 con 0x7efcf0070660 2023-11-28T13:01:16.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.479+0000 7efcef7fe700 1 -- 172.21.15.82:0/1920863684 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3618994457 0 0) 0x7efcf0069bc0 con 0x7efcf006b180 2023-11-28T13:01:16.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.479+0000 7efceffff700 1 --2- 172.21.15.82:0/1920863684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcf0070660 0x7efcf006ac40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efcf006b760 tx=0x7efcd8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121cb338ec024db5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:16.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.479+0000 7efcef7fe700 1 -- 172.21.15.82:0/1920863684 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8011830 con 0x7efcf0070660 2023-11-28T13:01:16.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.479+0000 7efcef7fe700 1 -- 172.21.15.82:0/1920863684 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd8011990 con 0x7efcf0070660 2023-11-28T13:01:16.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.479+0000 7efcef7fe700 1 -- 172.21.15.82:0/1920863684 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8011d20 con 0x7efcf0070660 2023-11-28T13:01:16.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.479+0000 7efcf592f700 1 -- 172.21.15.82:0/1920863684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcf0070660 msgr2=0x7efcf006ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:16.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.479+0000 7efcf592f700 1 --2- 172.21.15.82:0/1920863684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcf0070660 0x7efcf006ac40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efcf006b760 tx=0x7efcd8009bf0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.479+0000 7efcf592f700 1 -- 172.21.15.82:0/1920863684 shutdown_connections 2023-11-28T13:01:16.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.479+0000 7efcf592f700 1 --2- 172.21.15.82:0/1920863684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcf0070660 0x7efcf006ac40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.479+0000 7efcf592f700 1 --2- 172.21.15.82:0/1920863684 >> v2:172.21.15.114:3300/0 conn(0x7efcf0150ee0 0x7efcf0070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.479+0000 7efcf592f700 1 -- 172.21.15.82:0/1920863684 >> 172.21.15.82:0/1920863684 conn(0x7efcf00ce630 msgr2=0x7efcf00cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:16.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.479+0000 7efcf592f700 1 -- 172.21.15.82:0/1920863684 shutdown_connections 2023-11-28T13:01:16.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.479+0000 7efcf592f700 1 -- 172.21.15.82:0/1920863684 wait complete. 2023-11-28T13:01:16.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.479+0000 7efcf592f700 1 Processor -- start 2023-11-28T13:01:16.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.479+0000 7efcf592f700 1 -- start start 2023-11-28T13:01:16.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efcf592f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcf006b180 0x7efcf01f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:16.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efcf592f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcf0070660 0x7efcf0156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:16.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efcf592f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efcf0150ee0 0x7efcf00cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:16.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efcf592f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf0156d50 con 0x7efcf006b180 2023-11-28T13:01:16.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efcf592f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf0157030 con 0x7efcf0070660 2023-11-28T13:01:16.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efcf592f700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf0157310 con 0x7efcf0150ee0 2023-11-28T13:01:16.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efcf492d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcf006b180 0x7efcf01f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:16.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efcf492d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcf006b180 0x7efcf01f5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40610/0 (socket says 172.21.15.82:40610) 2023-11-28T13:01:16.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efcf492d700 1 -- 172.21.15.82:0/2856900248 learned_addr learned my addr 172.21.15.82:0/2856900248 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:16.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efceffff700 1 --2- 172.21.15.82:0/2856900248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcf0070660 0x7efcf0156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:16.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efcf512e700 1 --2- 172.21.15.82:0/2856900248 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efcf0150ee0 0x7efcf00cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:16.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efcf512e700 1 -- 172.21.15.82:0/2856900248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcf0070660 msgr2=0x7efcf0156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:16.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efcf512e700 1 --2- 172.21.15.82:0/2856900248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcf0070660 0x7efcf0156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efcf512e700 1 -- 172.21.15.82:0/2856900248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcf006b180 msgr2=0x7efcf01f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:16.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efcf512e700 1 --2- 172.21.15.82:0/2856900248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcf006b180 0x7efcf01f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efcf512e700 1 -- 172.21.15.82:0/2856900248 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd8009570 con 0x7efcf0150ee0 2023-11-28T13:01:16.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efceffff700 1 --2- 172.21.15.82:0/2856900248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcf0070660 0x7efcf0156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:16.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efcf492d700 1 --2- 172.21.15.82:0/2856900248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcf006b180 0x7efcf01f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:16.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efcf512e700 1 --2- 172.21.15.82:0/2856900248 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efcf0150ee0 0x7efcf00cc000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efce00011e0 tx=0x7efce000c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:16.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efced7fa700 1 -- 172.21.15.82:0/2856900248 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce00054e0 con 0x7efcf0150ee0 2023-11-28T13:01:16.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efced7fa700 1 -- 172.21.15.82:0/2856900248 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce000ce30 con 0x7efcf0150ee0 2023-11-28T13:01:16.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efced7fa700 1 -- 172.21.15.82:0/2856900248 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce00038e0 con 0x7efcf0150ee0 2023-11-28T13:01:16.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efcf592f700 1 -- 172.21.15.82:0/2856900248 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf01512b0 con 0x7efcf0150ee0 2023-11-28T13:01:16.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.483+0000 7efcf592f700 1 -- 172.21.15.82:0/2856900248 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf006a720 con 0x7efcf0150ee0 2023-11-28T13:01:16.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.487+0000 7efcf592f700 1 -- 172.21.15.82:0/2856900248 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf0151440 con 0x7efcf0150ee0 2023-11-28T13:01:16.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.487+0000 7efced7fa700 1 -- 172.21.15.82:0/2856900248 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efce0019030 con 0x7efcf0150ee0 2023-11-28T13:01:16.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.487+0000 7efced7fa700 1 --2- 172.21.15.82:0/2856900248 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efcd4064f10 0x7efcd40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:16.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.487+0000 7efcf492d700 1 --2- 172.21.15.82:0/2856900248 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efcd4064f10 0x7efcd40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:16.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.487+0000 7efced7fa700 1 -- 172.21.15.82:0/2856900248 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7efce0081160 con 0x7efcf0150ee0 2023-11-28T13:01:16.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.487+0000 7efcf492d700 1 --2- 172.21.15.82:0/2856900248 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efcd4064f10 0x7efcd40673c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efce80094c0 tx=0x7efce800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:16.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.499+0000 7efced7fa700 1 -- 172.21.15.82:0/2856900248 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efce004f1d0 con 0x7efcf0150ee0 2023-11-28T13:01:16.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.663+0000 7efcf592f700 1 -- 172.21.15.82:0/2856900248 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efcf0154e70 con 0x7efcf0150ee0 2023-11-28T13:01:16.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.663+0000 7efced7fa700 1 -- 172.21.15.82:0/2856900248 <== mon.2 v2:172.21.15.114:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7efcf0154e70 con 0x7efcf0150ee0 2023-11-28T13:01:16.669 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-11-28T13:01:16.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.667+0000 7efcf592f700 1 -- 172.21.15.82:0/2856900248 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efcd4064f10 msgr2=0x7efcd40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:16.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.667+0000 7efcf592f700 1 --2- 172.21.15.82:0/2856900248 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efcd4064f10 0x7efcd40673c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efce80094c0 tx=0x7efce800b040 comp rx=0 tx=0).stop 2023-11-28T13:01:16.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.667+0000 7efcf592f700 1 -- 172.21.15.82:0/2856900248 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efcf0150ee0 msgr2=0x7efcf00cc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:16.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.667+0000 7efcf592f700 1 --2- 172.21.15.82:0/2856900248 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efcf0150ee0 0x7efcf00cc000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efce00011e0 tx=0x7efce000c730 comp rx=0 tx=0).stop 2023-11-28T13:01:16.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.667+0000 7efcf592f700 1 -- 172.21.15.82:0/2856900248 shutdown_connections 2023-11-28T13:01:16.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.667+0000 7efcf592f700 1 --2- 172.21.15.82:0/2856900248 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efcd4064f10 0x7efcd40673c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.667+0000 7efcf592f700 1 --2- 172.21.15.82:0/2856900248 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efcf0150ee0 0x7efcf00cc000 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.667+0000 7efcf592f700 1 --2- 172.21.15.82:0/2856900248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcf0070660 0x7efcf0156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.667+0000 7efcf592f700 1 --2- 172.21.15.82:0/2856900248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcf006b180 0x7efcf01f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.667+0000 7efcf592f700 1 -- 172.21.15.82:0/2856900248 >> 172.21.15.82:0/2856900248 conn(0x7efcf00ce630 msgr2=0x7efcf00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:16.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.667+0000 7efcf592f700 1 -- 172.21.15.82:0/2856900248 shutdown_connections 2023-11-28T13:01:16.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.667+0000 7efcf592f700 1 -- 172.21.15.82:0/2856900248 wait complete. 2023-11-28T13:01:16.683 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T13:01:16.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.795+0000 7f1f3f59e700 1 Processor -- start 2023-11-28T13:01:16.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.795+0000 7f1f3f59e700 1 -- start start 2023-11-28T13:01:16.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3f59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1f40158eb0 0x7f1f400c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:16.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3f59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1f400b0c70 0x7f1f4015c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:16.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3f59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f400ad9b0 con 0x7f1f400ae090 2023-11-28T13:01:16.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3f59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f400adee0 con 0x7f1f400b0c70 2023-11-28T13:01:16.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3f59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f40159280 con 0x7f1f40158eb0 2023-11-28T13:01:16.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3ed9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1f400b0c70 0x7f1f4015c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:16.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3dd9b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1f400ae090 0x7f1f400b0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45824/0 (socket says 172.21.15.82:45824) 2023-11-28T13:01:16.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3dd9b700 1 -- 172.21.15.82:0/917669766 learned_addr learned my addr 172.21.15.82:0/917669766 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:16.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3ed9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1f400b0c70 0x7f1f4015c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33480/0 (socket says 172.21.15.82:33480) 2023-11-28T13:01:16.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3e59c700 1 --2- 172.21.15.82:0/917669766 >> v2:172.21.15.114:3300/0 conn(0x7f1f40158eb0 0x7f1f400c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:16.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3ed9d700 1 -- 172.21.15.82:0/917669766 >> v2:172.21.15.114:3300/0 conn(0x7f1f40158eb0 msgr2=0x7f1f400c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:16.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3ed9d700 1 --2- 172.21.15.82:0/917669766 >> v2:172.21.15.114:3300/0 conn(0x7f1f40158eb0 0x7f1f400c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3ed9d700 1 -- 172.21.15.82:0/917669766 >> v1:172.21.15.82:6789/0 conn(0x7f1f400ae090 legacy=0x7f1f400b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:16.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3ed9d700 1 -- 172.21.15.82:0/917669766 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f40069e60 con 0x7f1f400b0c70 2023-11-28T13:01:16.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3ed9d700 1 --2- 172.21.15.82:0/917669766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f400b0c70 0x7f1f4015c9d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1f4006bef0 tx=0x7f1f38009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e731da9dd74b894f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:16.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3d59a700 1 -- 172.21.15.82:0/917669766 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f38011830 con 0x7f1f400b0c70 2023-11-28T13:01:16.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3d59a700 1 -- 172.21.15.82:0/917669766 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f38011990 con 0x7f1f400b0c70 2023-11-28T13:01:16.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3d59a700 1 -- 172.21.15.82:0/917669766 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f38011d40 con 0x7f1f400b0c70 2023-11-28T13:01:16.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3f59e700 1 -- 172.21.15.82:0/917669766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f400b0c70 msgr2=0x7f1f4015c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:16.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3f59e700 1 --2- 172.21.15.82:0/917669766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f400b0c70 0x7f1f4015c9d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1f4006bef0 tx=0x7f1f38009b30 comp rx=0 tx=0).stop 2023-11-28T13:01:16.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3f59e700 1 -- 172.21.15.82:0/917669766 shutdown_connections 2023-11-28T13:01:16.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3f59e700 1 --2- 172.21.15.82:0/917669766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f400b0c70 0x7f1f4015c9d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3f59e700 1 --2- 172.21.15.82:0/917669766 >> v2:172.21.15.114:3300/0 conn(0x7f1f40158eb0 0x7f1f400c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3f59e700 1 -- 172.21.15.82:0/917669766 >> 172.21.15.82:0/917669766 conn(0x7f1f400ce630 msgr2=0x7f1f400cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:16.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3f59e700 1 -- 172.21.15.82:0/917669766 shutdown_connections 2023-11-28T13:01:16.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.799+0000 7f1f3f59e700 1 -- 172.21.15.82:0/917669766 wait complete. 2023-11-28T13:01:16.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.803+0000 7f1f3f59e700 1 Processor -- start 2023-11-28T13:01:16.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.803+0000 7f1f3f59e700 1 -- start start 2023-11-28T13:01:16.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.803+0000 7f1f3f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f400ae090 0x7f1f4014b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:16.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.803+0000 7f1f3f59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f400b0c70 0x7f1f401481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:16.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.803+0000 7f1f3f59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f40158eb0 0x7f1f4015b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:16.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.803+0000 7f1f3f59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4014b380 con 0x7f1f400ae090 2023-11-28T13:01:16.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.803+0000 7f1f3f59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4014a7b0 con 0x7f1f400b0c70 2023-11-28T13:01:16.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.803+0000 7f1f3f59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f400b4380 con 0x7f1f40158eb0 2023-11-28T13:01:16.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.803+0000 7f1f3e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f400ae090 0x7f1f4014b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:16.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.803+0000 7f1f3e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f400ae090 0x7f1f4014b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33494/0 (socket says 172.21.15.82:33494) 2023-11-28T13:01:16.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.803+0000 7f1f3e59c700 1 -- 172.21.15.82:0/2019181773 learned_addr learned my addr 172.21.15.82:0/2019181773 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:16.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.807+0000 7f1f3dd9b700 1 --2- 172.21.15.82:0/2019181773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f400b0c70 0x7f1f401481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:16.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.807+0000 7f1f3ed9d700 1 --2- 172.21.15.82:0/2019181773 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f40158eb0 0x7f1f4015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:16.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.807+0000 7f1f3e59c700 1 -- 172.21.15.82:0/2019181773 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f40158eb0 msgr2=0x7f1f4015b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:16.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.807+0000 7f1f3e59c700 1 --2- 172.21.15.82:0/2019181773 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f40158eb0 0x7f1f4015b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.807+0000 7f1f3e59c700 1 -- 172.21.15.82:0/2019181773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f400b0c70 msgr2=0x7f1f401481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:16.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.807+0000 7f1f3e59c700 1 --2- 172.21.15.82:0/2019181773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f400b0c70 0x7f1f401481f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.807+0000 7f1f3e59c700 1 -- 172.21.15.82:0/2019181773 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f380094b0 con 0x7f1f400ae090 2023-11-28T13:01:16.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.807+0000 7f1f3e59c700 1 --2- 172.21.15.82:0/2019181773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f400ae090 0x7f1f4014b810 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1f3000e760 tx=0x7f1f3000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:16.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.807+0000 7f1f36ffd700 1 -- 172.21.15.82:0/2019181773 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3000c070 con 0x7f1f400ae090 2023-11-28T13:01:16.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.807+0000 7f1f36ffd700 1 -- 172.21.15.82:0/2019181773 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f30013610 con 0x7f1f400ae090 2023-11-28T13:01:16.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.807+0000 7f1f3f59e700 1 -- 172.21.15.82:0/2019181773 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f40071c90 con 0x7f1f400ae090 2023-11-28T13:01:16.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.807+0000 7f1f36ffd700 1 -- 172.21.15.82:0/2019181773 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f30013980 con 0x7f1f400ae090 2023-11-28T13:01:16.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.807+0000 7f1f3f59e700 1 -- 172.21.15.82:0/2019181773 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f400adc00 con 0x7f1f400ae090 2023-11-28T13:01:16.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.807+0000 7f1f3f59e700 1 -- 172.21.15.82:0/2019181773 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f40071f70 con 0x7f1f400ae090 2023-11-28T13:01:16.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.807+0000 7f1f36ffd700 1 -- 172.21.15.82:0/2019181773 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1f30023070 con 0x7f1f400ae090 2023-11-28T13:01:16.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.811+0000 7f1f36ffd700 1 --2- 172.21.15.82:0/2019181773 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1f20064ee0 0x7f1f20067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:16.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.811+0000 7f1f36ffd700 1 -- 172.21.15.82:0/2019181773 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1f30081d10 con 0x7f1f400ae090 2023-11-28T13:01:16.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.811+0000 7f1f3dd9b700 1 --2- 172.21.15.82:0/2019181773 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1f20064ee0 0x7f1f20067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:16.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.811+0000 7f1f3dd9b700 1 --2- 172.21.15.82:0/2019181773 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1f20064ee0 0x7f1f20067390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1f401578a0 tx=0x7f1f28009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:16.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.815+0000 7f1f36ffd700 1 -- 172.21.15.82:0/2019181773 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1f3004fde0 con 0x7f1f400ae090 2023-11-28T13:01:16.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.975+0000 7f1f3f59e700 1 -- 172.21.15.82:0/2019181773 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1f400b4780 con 0x7f1f400ae090 2023-11-28T13:01:16.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.975+0000 7f1f36ffd700 1 -- 172.21.15.82:0/2019181773 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1f3000f040 con 0x7f1f400ae090 2023-11-28T13:01:16.982 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-11-28T13:01:16.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.979+0000 7f1f3f59e700 1 -- 172.21.15.82:0/2019181773 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1f20064ee0 msgr2=0x7f1f20067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:16.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.979+0000 7f1f3f59e700 1 --2- 172.21.15.82:0/2019181773 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1f20064ee0 0x7f1f20067390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1f401578a0 tx=0x7f1f28009040 comp rx=0 tx=0).stop 2023-11-28T13:01:16.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.979+0000 7f1f3f59e700 1 -- 172.21.15.82:0/2019181773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f400ae090 msgr2=0x7f1f4014b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:16.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.979+0000 7f1f3f59e700 1 --2- 172.21.15.82:0/2019181773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f400ae090 0x7f1f4014b810 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1f3000e760 tx=0x7f1f3000ea70 comp rx=0 tx=0).stop 2023-11-28T13:01:16.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.979+0000 7f1f3f59e700 1 -- 172.21.15.82:0/2019181773 shutdown_connections 2023-11-28T13:01:16.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.979+0000 7f1f3f59e700 1 --2- 172.21.15.82:0/2019181773 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1f20064ee0 0x7f1f20067390 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.979+0000 7f1f3f59e700 1 --2- 172.21.15.82:0/2019181773 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f40158eb0 0x7f1f4015b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.979+0000 7f1f3f59e700 1 --2- 172.21.15.82:0/2019181773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f400b0c70 0x7f1f401481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.979+0000 7f1f3f59e700 1 --2- 172.21.15.82:0/2019181773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f400ae090 0x7f1f4014b810 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:16.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.979+0000 7f1f3f59e700 1 -- 172.21.15.82:0/2019181773 >> 172.21.15.82:0/2019181773 conn(0x7f1f400ce630 msgr2=0x7f1f401567d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:16.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.979+0000 7f1f3f59e700 1 -- 172.21.15.82:0/2019181773 shutdown_connections 2023-11-28T13:01:16.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:16.979+0000 7f1f3f59e700 1 -- 172.21.15.82:0/2019181773 wait complete. 2023-11-28T13:01:17.001 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:01:17.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.107+0000 7f818082a700 1 Processor -- start 2023-11-28T13:01:17.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.107+0000 7f818082a700 1 -- start start 2023-11-28T13:01:17.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.107+0000 7f818082a700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f817c0b3910 0x7f817c06b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:17.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.107+0000 7f818082a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817c06c480 con 0x7f817c070070 2023-11-28T13:01:17.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.107+0000 7f818082a700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817c06dbe0 con 0x7f817c06c910 2023-11-28T13:01:17.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.107+0000 7f818082a700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f817c06dec0 con 0x7f817c0b3910 2023-11-28T13:01:17.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.107+0000 7f817b59e700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f817c070070 0x7f817c070470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45826/0 (socket says 172.21.15.82:45826) 2023-11-28T13:01:17.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.107+0000 7f817b59e700 1 -- 172.21.15.82:0/4245447915 learned_addr learned my addr 172.21.15.82:0/4245447915 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:17.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.107+0000 7f817ad9d700 1 --2- 172.21.15.82:0/4245447915 >> v2:172.21.15.114:3300/0 conn(0x7f817c0b3910 0x7f817c06b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.107+0000 7f8179d9b700 1 -- 172.21.15.82:0/4245447915 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787687298 0 0) 0x7f817c06c480 con 0x7f817c070070 2023-11-28T13:01:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.107+0000 7f8179d9b700 1 -- 172.21.15.82:0/4245447915 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81640035d0 con 0x7f817c070070 2023-11-28T13:01:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.107+0000 7f8179d9b700 1 -- 172.21.15.82:0/4245447915 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274061497 0 0) 0x7f817c06dbe0 con 0x7f817c06c910 2023-11-28T13:01:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.107+0000 7f8179d9b700 1 -- 172.21.15.82:0/4245447915 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f817c06c480 con 0x7f817c06c910 2023-11-28T13:01:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.107+0000 7f8179d9b700 1 -- 172.21.15.82:0/4245447915 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 331177163 0 0) 0x7f81640035d0 con 0x7f817c070070 2023-11-28T13:01:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.107+0000 7f8179d9b700 1 -- 172.21.15.82:0/4245447915 >> v2:172.21.15.114:3300/0 conn(0x7f817c0b3910 msgr2=0x7f817c06b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f8179d9b700 1 --2- 172.21.15.82:0/4245447915 >> v2:172.21.15.114:3300/0 conn(0x7f817c0b3910 0x7f817c06b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f8179d9b700 1 -- 172.21.15.82:0/4245447915 >> v1:172.21.15.114:6789/0 conn(0x7f817c06c910 legacy=0x7f817c06d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f8179d9b700 1 -- 172.21.15.82:0/4245447915 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c06c110 con 0x7f817c070070 2023-11-28T13:01:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f8179d9b700 1 -- 172.21.15.82:0/4245447915 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f8174001670 con 0x7f817c070070 2023-11-28T13:01:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f8179d9b700 1 -- 172.21.15.82:0/4245447915 >> v1:172.21.15.82:6789/0 conn(0x7f817c070070 legacy=0x7f817c070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f8179d9b700 1 --2- 172.21.15.82:0/4245447915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8164003bb0 0x7f8164003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f8179d9b700 1 --2- 172.21.15.82:0/4245447915 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8164004870 0x7f8164004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f8179d9b700 1 --2- 172.21.15.82:0/4245447915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8164005220 0x7f816400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f8179d9b700 1 -- 172.21.15.82:0/4245447915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c06dec0 con 0x7f8164003bb0 2023-11-28T13:01:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f8179d9b700 1 -- 172.21.15.82:0/4245447915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816400c080 con 0x7f8164005220 2023-11-28T13:01:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f8179d9b700 1 -- 172.21.15.82:0/4245447915 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f816400c240 con 0x7f8164004870 2023-11-28T13:01:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f817ad9d700 1 --2- 172.21.15.82:0/4245447915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8164003bb0 0x7f8164003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f817a59c700 1 --2- 172.21.15.82:0/4245447915 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8164004870 0x7f8164004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f817b59e700 1 --2- 172.21.15.82:0/4245447915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8164005220 0x7f816400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f817ad9d700 1 -- 172.21.15.82:0/4245447915 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8164004870 msgr2=0x7f8164004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f817ad9d700 1 --2- 172.21.15.82:0/4245447915 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8164004870 0x7f8164004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f817ad9d700 1 -- 172.21.15.82:0/4245447915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8164005220 msgr2=0x7f816400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f817ad9d700 1 --2- 172.21.15.82:0/4245447915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8164005220 0x7f816400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f817ad9d700 1 -- 172.21.15.82:0/4245447915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81640035d0 con 0x7f8164003bb0 2023-11-28T13:01:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f817a59c700 1 --2- 172.21.15.82:0/4245447915 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8164004870 0x7f8164004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:01:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f817b59e700 1 --2- 172.21.15.82:0/4245447915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8164005220 0x7f816400ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:01:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f817b59e700 1 -- 172.21.15.82:0/4245447915 reap_dead start 2023-11-28T13:01:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f817ad9d700 1 --2- 172.21.15.82:0/4245447915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8164003bb0 0x7f8164003fa0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8170009b70 tx=0x7f81640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc0a9d6bc9c98de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f8179d9b700 1 -- 172.21.15.82:0/4245447915 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817000e6c0 con 0x7f8164003bb0 2023-11-28T13:01:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f8179d9b700 1 -- 172.21.15.82:0/4245447915 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817000e820 con 0x7f8164003bb0 2023-11-28T13:01:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f8179d9b700 1 -- 172.21.15.82:0/4245447915 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817000eb90 con 0x7f8164003bb0 2023-11-28T13:01:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f818082a700 1 -- 172.21.15.82:0/4245447915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8164003bb0 msgr2=0x7f8164003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f818082a700 1 --2- 172.21.15.82:0/4245447915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8164003bb0 0x7f8164003fa0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8170009b70 tx=0x7f81640058a0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f818082a700 1 -- 172.21.15.82:0/4245447915 shutdown_connections 2023-11-28T13:01:17.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f818082a700 1 --2- 172.21.15.82:0/4245447915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8164003bb0 0x7f8164003fa0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f818082a700 1 -- 172.21.15.82:0/4245447915 >> 172.21.15.82:0/4245447915 conn(0x7f817c0ce600 msgr2=0x7f817c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:17.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f818082a700 1 -- 172.21.15.82:0/4245447915 shutdown_connections 2023-11-28T13:01:17.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f818082a700 1 -- 172.21.15.82:0/4245447915 wait complete. 2023-11-28T13:01:17.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f818082a700 1 Processor -- start 2023-11-28T13:01:17.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.111+0000 7f818082a700 1 -- start start 2023-11-28T13:01:17.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f818082a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8164003bb0 0x7f817c157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:17.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f818082a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f817c0b02f0 0x7f817c1f9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:17.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f818082a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f817c0b0760 0x7f817c1f9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:17.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f818082a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c1578d0 con 0x7f817c0b02f0 2023-11-28T13:01:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f818082a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0af250 con 0x7f817c0b0760 2023-11-28T13:01:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f818082a700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0af530 con 0x7f8164003bb0 2023-11-28T13:01:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f817a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f817c0b02f0 0x7f817c1f9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f817a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f817c0b02f0 0x7f817c1f9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33510/0 (socket says 172.21.15.82:33510) 2023-11-28T13:01:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f817a59c700 1 -- 172.21.15.82:0/878301643 learned_addr learned my addr 172.21.15.82:0/878301643 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f817ad9d700 1 --2- 172.21.15.82:0/878301643 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8164003bb0 0x7f817c157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f817b59e700 1 --2- 172.21.15.82:0/878301643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f817c0b0760 0x7f817c1f9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f817a59c700 1 -- 172.21.15.82:0/878301643 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8164003bb0 msgr2=0x7f817c157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f817a59c700 1 --2- 172.21.15.82:0/878301643 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8164003bb0 0x7f817c157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f817a59c700 1 -- 172.21.15.82:0/878301643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f817c0b0760 msgr2=0x7f817c1f9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f817a59c700 1 --2- 172.21.15.82:0/878301643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f817c0b0760 0x7f817c1f9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f817a59c700 1 -- 172.21.15.82:0/878301643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c0b3ce0 con 0x7f817c0b02f0 2023-11-28T13:01:17.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f817a59c700 1 --2- 172.21.15.82:0/878301643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f817c0b02f0 0x7f817c1f9850 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f816c002000 tx=0x7f816c00b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:17.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f81637fe700 1 -- 172.21.15.82:0/878301643 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c00bd20 con 0x7f817c0b02f0 2023-11-28T13:01:17.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f81637fe700 1 -- 172.21.15.82:0/878301643 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c00be80 con 0x7f817c0b02f0 2023-11-28T13:01:17.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f818082a700 1 -- 172.21.15.82:0/878301643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817c0c8f80 con 0x7f817c0b02f0 2023-11-28T13:01:17.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f81637fe700 1 -- 172.21.15.82:0/878301643 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c012630 con 0x7f817c0b02f0 2023-11-28T13:01:17.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f818082a700 1 -- 172.21.15.82:0/878301643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817c0b3e70 con 0x7f817c0b02f0 2023-11-28T13:01:17.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.115+0000 7f818082a700 1 -- 172.21.15.82:0/878301643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f817c065fc0 con 0x7f817c0b02f0 2023-11-28T13:01:17.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.119+0000 7f81637fe700 1 -- 172.21.15.82:0/878301643 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f816c022070 con 0x7f817c0b02f0 2023-11-28T13:01:17.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.119+0000 7f81637fe700 1 --2- 172.21.15.82:0/878301643 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8168064f10 0x7f81680673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:17.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.119+0000 7f817ad9d700 1 --2- 172.21.15.82:0/878301643 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8168064f10 0x7f81680673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:17.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.119+0000 7f81637fe700 1 -- 172.21.15.82:0/878301643 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f816c082400 con 0x7f817c0b02f0 2023-11-28T13:01:17.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.119+0000 7f817ad9d700 1 --2- 172.21.15.82:0/878301643 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8168064f10 0x7f81680673c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f81700090b0 tx=0x7f817001e040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:17.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.127+0000 7f81637fe700 1 -- 172.21.15.82:0/878301643 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f816c050470 con 0x7f817c0b02f0 2023-11-28T13:01:17.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.327+0000 7f818082a700 1 -- 172.21.15.82:0/878301643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f817c158130 con 0x7f817c0b02f0 2023-11-28T13:01:17.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.327+0000 7f81637fe700 1 -- 172.21.15.82:0/878301643 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4648 (secure 0 0 0) 0x7f816c053a90 con 0x7f817c0b02f0 2023-11-28T13:01:17.333 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:17.333 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2058451312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2058451312},{"type":"v1","addr":"172.21.15.82:6835","nonce":2058451312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/4064345694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":4064345694},{"type":"v1","addr":"172.21.15.114:6833","nonce":4064345694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2802500604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2802500604},{"type":"v1","addr":"172.21.15.114:6835","nonce":2802500604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:00:25.978137+0000","modified":"2023-11-28T13:00:28.990262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2893797521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2893797521},{"type":"v1","addr":"172.21.15.82:6837","nonce":2893797521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T13:01:17.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.331+0000 7f818082a700 1 -- 172.21.15.82:0/878301643 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8168064f10 msgr2=0x7f81680673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:17.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.331+0000 7f818082a700 1 --2- 172.21.15.82:0/878301643 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8168064f10 0x7f81680673c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f81700090b0 tx=0x7f817001e040 comp rx=0 tx=0).stop 2023-11-28T13:01:17.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.331+0000 7f818082a700 1 -- 172.21.15.82:0/878301643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f817c0b02f0 msgr2=0x7f817c1f9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:17.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.331+0000 7f818082a700 1 --2- 172.21.15.82:0/878301643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f817c0b02f0 0x7f817c1f9850 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f816c002000 tx=0x7f816c00b3b0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.331+0000 7f818082a700 1 -- 172.21.15.82:0/878301643 shutdown_connections 2023-11-28T13:01:17.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.331+0000 7f818082a700 1 --2- 172.21.15.82:0/878301643 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8168064f10 0x7f81680673c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.331+0000 7f818082a700 1 --2- 172.21.15.82:0/878301643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f817c0b0760 0x7f817c1f9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.331+0000 7f818082a700 1 --2- 172.21.15.82:0/878301643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f817c0b02f0 0x7f817c1f9850 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.331+0000 7f818082a700 1 --2- 172.21.15.82:0/878301643 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8164003bb0 0x7f817c157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.331+0000 7f818082a700 1 -- 172.21.15.82:0/878301643 >> 172.21.15.82:0/878301643 conn(0x7f817c0ce600 msgr2=0x7f817c0cee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:17.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.331+0000 7f818082a700 1 -- 172.21.15.82:0/878301643 shutdown_connections 2023-11-28T13:01:17.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.331+0000 7f818082a700 1 -- 172.21.15.82:0/878301643 wait complete. 2023-11-28T13:01:17.337 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 7 2023-11-28T13:01:17.347 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:01:17.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.455+0000 7f91523ec700 1 Processor -- start 2023-11-28T13:01:17.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.455+0000 7f91523ec700 1 -- start start 2023-11-28T13:01:17.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f91523ec700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f914c159cb0 0x7f914c15c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:17.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f91523ec700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f914c0cae60 0x7f914c0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:17.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f91523ec700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f914c0cc210 con 0x7f914c0cfd50 2023-11-28T13:01:17.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f91523ec700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914c0d0150 con 0x7f914c0cae60 2023-11-28T13:01:17.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f91523ec700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914c0cb6b0 con 0x7f914c159cb0 2023-11-28T13:01:17.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f9150be9700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f914c0cae60 0x7f914c0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:17.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f9151beb700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f914c0cfd50 0x7f914c0ce3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45828/0 (socket says 172.21.15.82:45828) 2023-11-28T13:01:17.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f9151beb700 1 -- 172.21.15.82:0/922213628 learned_addr learned my addr 172.21.15.82:0/922213628 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:17.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f91513ea700 1 --2- 172.21.15.82:0/922213628 >> v2:172.21.15.114:3300/0 conn(0x7f914c159cb0 0x7f914c15c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:17.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f9150be9700 1 -- 172.21.15.82:0/922213628 >> v2:172.21.15.114:3300/0 conn(0x7f914c159cb0 msgr2=0x7f914c15c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:17.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f9150be9700 1 --2- 172.21.15.82:0/922213628 >> v2:172.21.15.114:3300/0 conn(0x7f914c159cb0 0x7f914c15c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f9150be9700 1 -- 172.21.15.82:0/922213628 >> v1:172.21.15.82:6789/0 conn(0x7f914c0cfd50 legacy=0x7f914c0ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:17.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f9150be9700 1 -- 172.21.15.82:0/922213628 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c0cb990 con 0x7f914c0cae60 2023-11-28T13:01:17.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f9143fff700 1 -- 172.21.15.82:0/922213628 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682275167 0 0) 0x7f914c0cc210 con 0x7f914c0cfd50 2023-11-28T13:01:17.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f9150be9700 1 --2- 172.21.15.82:0/922213628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f914c0cae60 0x7f914c0cf810 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f914c071c80 tx=0x7f913c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9109fa9a08c2ec server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:17.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f9143fff700 1 -- 172.21.15.82:0/922213628 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c011830 con 0x7f914c0cae60 2023-11-28T13:01:17.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f9143fff700 1 -- 172.21.15.82:0/922213628 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c011990 con 0x7f914c0cae60 2023-11-28T13:01:17.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f9143fff700 1 -- 172.21.15.82:0/922213628 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c011d20 con 0x7f914c0cae60 2023-11-28T13:01:17.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f91523ec700 1 -- 172.21.15.82:0/922213628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f914c0cae60 msgr2=0x7f914c0cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:17.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f91523ec700 1 --2- 172.21.15.82:0/922213628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f914c0cae60 0x7f914c0cf810 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f914c071c80 tx=0x7f913c009b30 comp rx=0 tx=0).stop 2023-11-28T13:01:17.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f91523ec700 1 -- 172.21.15.82:0/922213628 shutdown_connections 2023-11-28T13:01:17.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f91523ec700 1 --2- 172.21.15.82:0/922213628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f914c0cae60 0x7f914c0cf810 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f91523ec700 1 --2- 172.21.15.82:0/922213628 >> v2:172.21.15.114:3300/0 conn(0x7f914c159cb0 0x7f914c15c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f91523ec700 1 -- 172.21.15.82:0/922213628 >> 172.21.15.82:0/922213628 conn(0x7f914c0b2320 msgr2=0x7f914c0b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:17.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f91523ec700 1 -- 172.21.15.82:0/922213628 shutdown_connections 2023-11-28T13:01:17.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.459+0000 7f91523ec700 1 -- 172.21.15.82:0/922213628 wait complete. 2023-11-28T13:01:17.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f91523ec700 1 Processor -- start 2023-11-28T13:01:17.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f91523ec700 1 -- start start 2023-11-28T13:01:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f91523ec700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f914c0cae60 0x7f914c0ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f91523ec700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f914c0cfd50 0x7f914c15eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f91523ec700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f914c159cb0 0x7f914c14d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f91523ec700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c0c93a0 con 0x7f914c0cae60 2023-11-28T13:01:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f91523ec700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c0c9680 con 0x7f914c159cb0 2023-11-28T13:01:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f91523ec700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914c0c9960 con 0x7f914c0cfd50 2023-11-28T13:01:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f91513ea700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f914c0cae60 0x7f914c0ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f91513ea700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f914c0cae60 0x7f914c0ca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33530/0 (socket says 172.21.15.82:33530) 2023-11-28T13:01:17.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f91513ea700 1 -- 172.21.15.82:0/3639386345 learned_addr learned my addr 172.21.15.82:0/3639386345 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:17.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f9150be9700 1 --2- 172.21.15.82:0/3639386345 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f914c0cfd50 0x7f914c15eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:17.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f9151beb700 1 --2- 172.21.15.82:0/3639386345 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f914c159cb0 0x7f914c14d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:17.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f91513ea700 1 -- 172.21.15.82:0/3639386345 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f914c0cfd50 msgr2=0x7f914c15eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:17.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f91513ea700 1 --2- 172.21.15.82:0/3639386345 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f914c0cfd50 0x7f914c15eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f91513ea700 1 -- 172.21.15.82:0/3639386345 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f914c159cb0 msgr2=0x7f914c14d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:17.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f91513ea700 1 --2- 172.21.15.82:0/3639386345 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f914c159cb0 0x7f914c14d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f91513ea700 1 -- 172.21.15.82:0/3639386345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c0094b0 con 0x7f914c0cae60 2023-11-28T13:01:17.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f9151beb700 1 --2- 172.21.15.82:0/3639386345 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f914c159cb0 0x7f914c14d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:17.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f91513ea700 1 --2- 172.21.15.82:0/3639386345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f914c0cae60 0x7f914c0ca440 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f914800e840 tx=0x7f914800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:17.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f9141ffb700 1 -- 172.21.15.82:0/3639386345 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91480095a0 con 0x7f914c0cae60 2023-11-28T13:01:17.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f9141ffb700 1 -- 172.21.15.82:0/3639386345 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9148013680 con 0x7f914c0cae60 2023-11-28T13:01:17.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f9141ffb700 1 -- 172.21.15.82:0/3639386345 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91480139f0 con 0x7f914c0cae60 2023-11-28T13:01:17.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f91523ec700 1 -- 172.21.15.82:0/3639386345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914c0b50f0 con 0x7f914c0cae60 2023-11-28T13:01:17.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.463+0000 7f91523ec700 1 -- 172.21.15.82:0/3639386345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914c0cbc70 con 0x7f914c0cae60 2023-11-28T13:01:17.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.467+0000 7f9141ffb700 1 -- 172.21.15.82:0/3639386345 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9148019030 con 0x7f914c0cae60 2023-11-28T13:01:17.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.467+0000 7f91523ec700 1 -- 172.21.15.82:0/3639386345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914c0b4de0 con 0x7f914c0cae60 2023-11-28T13:01:17.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.467+0000 7f9141ffb700 1 --2- 172.21.15.82:0/3639386345 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9130064ee0 0x7f9130067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:17.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.467+0000 7f9150be9700 1 --2- 172.21.15.82:0/3639386345 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9130064ee0 0x7f9130067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:17.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.467+0000 7f9141ffb700 1 -- 172.21.15.82:0/3639386345 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9148081ca0 con 0x7f914c0cae60 2023-11-28T13:01:17.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.467+0000 7f9150be9700 1 --2- 172.21.15.82:0/3639386345 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9130064ee0 0x7f9130067390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f913c0090b0 tx=0x7f913c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:17.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.475+0000 7f9141ffb700 1 -- 172.21.15.82:0/3639386345 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9148086070 con 0x7f914c0cae60 2023-11-28T13:01:17.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.635+0000 7f91523ec700 1 -- 172.21.15.82:0/3639386345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f914c065fc0 con 0x7f914c0cae60 2023-11-28T13:01:17.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.635+0000 7f9141ffb700 1 -- 172.21.15.82:0/3639386345 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17907 (secure 0 0 0) 0x7f91480501d0 con 0x7f914c0cae60 2023-11-28T13:01:17.641 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:17.642 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:01:08.993802+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:00:24.360641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T13:00:24.960863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.26","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:01:17.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.639+0000 7f91523ec700 1 -- 172.21.15.82:0/3639386345 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9130064ee0 msgr2=0x7f9130067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:17.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.639+0000 7f91523ec700 1 --2- 172.21.15.82:0/3639386345 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9130064ee0 0x7f9130067390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f913c0090b0 tx=0x7f913c008030 comp rx=0 tx=0).stop 2023-11-28T13:01:17.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.639+0000 7f91523ec700 1 -- 172.21.15.82:0/3639386345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f914c0cae60 msgr2=0x7f914c0ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:17.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.639+0000 7f91523ec700 1 --2- 172.21.15.82:0/3639386345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f914c0cae60 0x7f914c0ca440 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f914800e840 tx=0x7f914800eb50 comp rx=0 tx=0).stop 2023-11-28T13:01:17.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.639+0000 7f91523ec700 1 -- 172.21.15.82:0/3639386345 shutdown_connections 2023-11-28T13:01:17.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.639+0000 7f91523ec700 1 --2- 172.21.15.82:0/3639386345 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9130064ee0 0x7f9130067390 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.639+0000 7f91523ec700 1 --2- 172.21.15.82:0/3639386345 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f914c159cb0 0x7f914c14d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.639+0000 7f91523ec700 1 --2- 172.21.15.82:0/3639386345 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f914c0cfd50 0x7f914c15eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.639+0000 7f91523ec700 1 --2- 172.21.15.82:0/3639386345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f914c0cae60 0x7f914c0ca440 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.639+0000 7f91523ec700 1 -- 172.21.15.82:0/3639386345 >> 172.21.15.82:0/3639386345 conn(0x7f914c0b2320 msgr2=0x7f914c0cce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:17.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.639+0000 7f91523ec700 1 -- 172.21.15.82:0/3639386345 shutdown_connections 2023-11-28T13:01:17.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.639+0000 7f91523ec700 1 -- 172.21.15.82:0/3639386345 wait complete. 2023-11-28T13:01:17.656 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T13:01:17.656 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:01:17.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.763+0000 7fe66a7c1700 1 Processor -- start 2023-11-28T13:01:17.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.763+0000 7fe66a7c1700 1 -- start start 2023-11-28T13:01:17.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.763+0000 7fe66a7c1700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe65c0dd280 0x7fe65c050760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:17.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.763+0000 7fe66a7c1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe65c036e80 0x7fe65c053080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:17.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.763+0000 7fe66a7c1700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65c052bf0 con 0x7fe65c0dfb70 2023-11-28T13:01:17.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.763+0000 7fe66a7c1700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe65c0dd650 con 0x7fe65c036e80 2023-11-28T13:01:17.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.763+0000 7fe66a7c1700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe65c0528c0 con 0x7fe65c0dd280 2023-11-28T13:01:17.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.767+0000 7fe669fc0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe65c036e80 0x7fe65c053080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:17.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.767+0000 7fe669fc0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe65c036e80 0x7fe65c053080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33540/0 (socket says 172.21.15.82:33540) 2023-11-28T13:01:17.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.767+0000 7fe669fc0700 1 -- 172.21.15.82:0/2324673951 learned_addr learned my addr 172.21.15.82:0/2324673951 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:17.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.767+0000 7fe6697bf700 1 --2- 172.21.15.82:0/2324673951 >> v2:172.21.15.114:3300/0 conn(0x7fe65c0dd280 0x7fe65c050760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:17.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.767+0000 7fe669fc0700 1 -- 172.21.15.82:0/2324673951 >> v2:172.21.15.114:3300/0 conn(0x7fe65c0dd280 msgr2=0x7fe65c050760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:17.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.767+0000 7fe669fc0700 1 --2- 172.21.15.82:0/2324673951 >> v2:172.21.15.114:3300/0 conn(0x7fe65c0dd280 0x7fe65c050760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.767+0000 7fe669fc0700 1 -- 172.21.15.82:0/2324673951 >> v1:172.21.15.114:6789/0 conn(0x7fe65c0dfb70 legacy=0x7fe65c036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:17.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.767+0000 7fe669fc0700 1 -- 172.21.15.82:0/2324673951 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c0e0430 con 0x7fe65c036e80 2023-11-28T13:01:17.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.767+0000 7fe669fc0700 1 --2- 172.21.15.82:0/2324673951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe65c036e80 0x7fe65c053080 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe66404ed50 tx=0x7fe664072430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ee088b53315209 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:17.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.767+0000 7fe65bfff700 1 -- 172.21.15.82:0/2324673951 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6640657e0 con 0x7fe65c036e80 2023-11-28T13:01:17.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.767+0000 7fe65bfff700 1 -- 172.21.15.82:0/2324673951 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe664065940 con 0x7fe65c036e80 2023-11-28T13:01:17.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.767+0000 7fe65bfff700 1 -- 172.21.15.82:0/2324673951 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe664066230 con 0x7fe65c036e80 2023-11-28T13:01:17.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.767+0000 7fe66a7c1700 1 -- 172.21.15.82:0/2324673951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe65c036e80 msgr2=0x7fe65c053080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:17.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.767+0000 7fe66a7c1700 1 --2- 172.21.15.82:0/2324673951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe65c036e80 0x7fe65c053080 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe66404ed50 tx=0x7fe664072430 comp rx=0 tx=0).stop 2023-11-28T13:01:17.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.767+0000 7fe66a7c1700 1 -- 172.21.15.82:0/2324673951 shutdown_connections 2023-11-28T13:01:17.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.767+0000 7fe66a7c1700 1 --2- 172.21.15.82:0/2324673951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe65c036e80 0x7fe65c053080 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.767+0000 7fe66a7c1700 1 --2- 172.21.15.82:0/2324673951 >> v2:172.21.15.114:3300/0 conn(0x7fe65c0dd280 0x7fe65c050760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.767+0000 7fe66a7c1700 1 -- 172.21.15.82:0/2324673951 >> 172.21.15.82:0/2324673951 conn(0x7fe65c051770 msgr2=0x7fe65c051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:17.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.767+0000 7fe66a7c1700 1 -- 172.21.15.82:0/2324673951 shutdown_connections 2023-11-28T13:01:17.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.767+0000 7fe66a7c1700 1 -- 172.21.15.82:0/2324673951 wait complete. 2023-11-28T13:01:17.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe66a7c1700 1 Processor -- start 2023-11-28T13:01:17.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe66a7c1700 1 -- start start 2023-11-28T13:01:17.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe66a7c1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe65c036e80 0x7fe65c0e1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:17.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe66a7c1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe65c0dd280 0x7fe65c006b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:17.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe66a7c1700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe65c0dfb70 0x7fe65c0d1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:17.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe66a7c1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c0d26f0 con 0x7fe65c036e80 2023-11-28T13:01:17.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe66a7c1700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c04df40 con 0x7fe65c0dd280 2023-11-28T13:01:17.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe66a7c1700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c04e220 con 0x7fe65c0dfb70 2023-11-28T13:01:17.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe6697bf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe65c036e80 0x7fe65c0e1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:17.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe6697bf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe65c036e80 0x7fe65c0e1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33550/0 (socket says 172.21.15.82:33550) 2023-11-28T13:01:17.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe668fbe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe65c0dd280 0x7fe65c006b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:17.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe6697bf700 1 -- 172.21.15.82:0/451237756 learned_addr learned my addr 172.21.15.82:0/451237756 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:17.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe669fc0700 1 --2- 172.21.15.82:0/451237756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe65c0dfb70 0x7fe65c0d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:17.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe6697bf700 1 -- 172.21.15.82:0/451237756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe65c0dfb70 msgr2=0x7fe65c0d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:17.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe6697bf700 1 --2- 172.21.15.82:0/451237756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe65c0dfb70 0x7fe65c0d1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe6697bf700 1 -- 172.21.15.82:0/451237756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe65c0dd280 msgr2=0x7fe65c006b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:17.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe6697bf700 1 --2- 172.21.15.82:0/451237756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe65c0dd280 0x7fe65c006b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe6697bf700 1 -- 172.21.15.82:0/451237756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c0e09f0 con 0x7fe65c036e80 2023-11-28T13:01:17.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe668fbe700 1 --2- 172.21.15.82:0/451237756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe65c0dd280 0x7fe65c006b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:17.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe6697bf700 1 --2- 172.21.15.82:0/451237756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe65c036e80 0x7fe65c0e1c70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe65400e840 tx=0x7fe65400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:17.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe659ffb700 1 -- 172.21.15.82:0/451237756 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6540095a0 con 0x7fe65c036e80 2023-11-28T13:01:17.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe659ffb700 1 -- 172.21.15.82:0/451237756 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe654013680 con 0x7fe65c036e80 2023-11-28T13:01:17.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe66a7c1700 1 -- 172.21.15.82:0/451237756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65c0e0710 con 0x7fe65c036e80 2023-11-28T13:01:17.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe659ffb700 1 -- 172.21.15.82:0/451237756 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6540139f0 con 0x7fe65c036e80 2023-11-28T13:01:17.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.771+0000 7fe66a7c1700 1 -- 172.21.15.82:0/451237756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65c0dffe0 con 0x7fe65c036e80 2023-11-28T13:01:17.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.775+0000 7fe66a7c1700 1 -- 172.21.15.82:0/451237756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe65c005570 con 0x7fe65c036e80 2023-11-28T13:01:17.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.775+0000 7fe659ffb700 1 -- 172.21.15.82:0/451237756 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe654019030 con 0x7fe65c036e80 2023-11-28T13:01:17.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.775+0000 7fe659ffb700 1 --2- 172.21.15.82:0/451237756 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe648064f10 0x7fe6480673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:17.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.775+0000 7fe659ffb700 1 -- 172.21.15.82:0/451237756 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe654081bf0 con 0x7fe65c036e80 2023-11-28T13:01:17.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.775+0000 7fe668fbe700 1 --2- 172.21.15.82:0/451237756 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe648064f10 0x7fe6480673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:17.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.775+0000 7fe668fbe700 1 --2- 172.21.15.82:0/451237756 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe648064f10 0x7fe6480673c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe65c04cf00 tx=0x7fe660009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:17.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.783+0000 7fe659ffb700 1 -- 172.21.15.82:0/451237756 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe65404fcd0 con 0x7fe65c036e80 2023-11-28T13:01:17.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.979+0000 7fe66a7c1700 1 -- 172.21.15.82:0/451237756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe65c0e3c40 con 0x7fe65c036e80 2023-11-28T13:01:17.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.979+0000 7fe659ffb700 1 -- 172.21.15.82:0/451237756 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4648 (secure 0 0 0) 0x7fe6540532f0 con 0x7fe65c036e80 2023-11-28T13:01:17.985 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:17.986 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2058451312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2058451312},{"type":"v1","addr":"172.21.15.82:6835","nonce":2058451312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/4064345694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":4064345694},{"type":"v1","addr":"172.21.15.114:6833","nonce":4064345694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2802500604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2802500604},{"type":"v1","addr":"172.21.15.114:6835","nonce":2802500604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:00:25.978137+0000","modified":"2023-11-28T13:00:28.990262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2893797521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2893797521},{"type":"v1","addr":"172.21.15.82:6837","nonce":2893797521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T13:01:17.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.983+0000 7fe66a7c1700 1 -- 172.21.15.82:0/451237756 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe648064f10 msgr2=0x7fe6480673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:17.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.983+0000 7fe66a7c1700 1 --2- 172.21.15.82:0/451237756 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe648064f10 0x7fe6480673c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe65c04cf00 tx=0x7fe660009040 comp rx=0 tx=0).stop 2023-11-28T13:01:17.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.983+0000 7fe66a7c1700 1 -- 172.21.15.82:0/451237756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe65c036e80 msgr2=0x7fe65c0e1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:17.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.983+0000 7fe66a7c1700 1 --2- 172.21.15.82:0/451237756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe65c036e80 0x7fe65c0e1c70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe65400e840 tx=0x7fe65400eb50 comp rx=0 tx=0).stop 2023-11-28T13:01:17.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.983+0000 7fe66a7c1700 1 -- 172.21.15.82:0/451237756 shutdown_connections 2023-11-28T13:01:17.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.983+0000 7fe66a7c1700 1 --2- 172.21.15.82:0/451237756 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe648064f10 0x7fe6480673c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.983+0000 7fe66a7c1700 1 --2- 172.21.15.82:0/451237756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe65c0dfb70 0x7fe65c0d1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.983+0000 7fe66a7c1700 1 --2- 172.21.15.82:0/451237756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe65c0dd280 0x7fe65c006b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.983+0000 7fe66a7c1700 1 --2- 172.21.15.82:0/451237756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe65c036e80 0x7fe65c0e1c70 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:17.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.983+0000 7fe66a7c1700 1 -- 172.21.15.82:0/451237756 >> 172.21.15.82:0/451237756 conn(0x7fe65c051770 msgr2=0x7fe65c0d2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:17.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.983+0000 7fe66a7c1700 1 -- 172.21.15.82:0/451237756 shutdown_connections 2023-11-28T13:01:17.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:17.983+0000 7fe66a7c1700 1 -- 172.21.15.82:0/451237756 wait complete. 2023-11-28T13:01:17.989 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 7 2023-11-28T13:01:18.000 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:01:18.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6db385700 1 Processor -- start 2023-11-28T13:01:18.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6db385700 1 -- start start 2023-11-28T13:01:18.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6db385700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6d4070070 0x7fc6d4070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:18.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6db385700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc6d4160900 0x7fc6d40cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:18.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6db385700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d4070980 con 0x7fc6d40c1910 2023-11-28T13:01:18.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6db385700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d40ce030 con 0x7fc6d4160900 2023-11-28T13:01:18.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6db385700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d40ce310 con 0x7fc6d4070070 2023-11-28T13:01:18.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6d9b82700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc6d4160900 0x7fc6d40cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:18.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6d9b82700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc6d4160900 0x7fc6d40cc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33562/0 (socket says 172.21.15.82:33562) 2023-11-28T13:01:18.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6d9b82700 1 -- 172.21.15.82:0/1165351751 learned_addr learned my addr 172.21.15.82:0/1165351751 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:18.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6dab84700 1 --1- 172.21.15.82:0/1165351751 >> v1:172.21.15.82:6789/0 conn(0x7fc6d40c1910 0x7fc6d41641e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45832/0 (socket says 172.21.15.82:45832) 2023-11-28T13:01:18.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6d9b82700 1 -- 172.21.15.82:0/1165351751 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6d4070070 msgr2=0x7fc6d4070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:18.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6da383700 1 --2- 172.21.15.82:0/1165351751 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6d4070070 0x7fc6d4070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:18.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6d9b82700 1 --2- 172.21.15.82:0/1165351751 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6d4070070 0x7fc6d4070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6d9b82700 1 -- 172.21.15.82:0/1165351751 >> v1:172.21.15.82:6789/0 conn(0x7fc6d40c1910 legacy=0x7fc6d41641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:18.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6d9381700 1 -- 172.21.15.82:0/1165351751 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156339158 0 0) 0x7fc6d4070980 con 0x7fc6d40c1910 2023-11-28T13:01:18.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6d9b82700 1 -- 172.21.15.82:0/1165351751 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d406a5d0 con 0x7fc6d4160900 2023-11-28T13:01:18.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6da383700 1 --2- 172.21.15.82:0/1165351751 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6d4070070 0x7fc6d4070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:01:18.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6d9b82700 1 --2- 172.21.15.82:0/1165351751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6d4160900 0x7fc6d40cc1d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009e50 tx=0x7fc6cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ed78487b36617 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:18.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6d9381700 1 -- 172.21.15.82:0/1165351751 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc00e070 con 0x7fc6d4160900 2023-11-28T13:01:18.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6d9381700 1 -- 172.21.15.82:0/1165351751 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6cc00b9c0 con 0x7fc6d4160900 2023-11-28T13:01:18.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6d9381700 1 -- 172.21.15.82:0/1165351751 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc00bd70 con 0x7fc6d4160900 2023-11-28T13:01:18.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6db385700 1 -- 172.21.15.82:0/1165351751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6d4160900 msgr2=0x7fc6d40cc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:18.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6db385700 1 --2- 172.21.15.82:0/1165351751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6d4160900 0x7fc6d40cc1d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009e50 tx=0x7fc6cc00b330 comp rx=0 tx=0).stop 2023-11-28T13:01:18.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6db385700 1 -- 172.21.15.82:0/1165351751 shutdown_connections 2023-11-28T13:01:18.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6db385700 1 --2- 172.21.15.82:0/1165351751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6d4160900 0x7fc6d40cc1d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6db385700 1 --2- 172.21.15.82:0/1165351751 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6d4070070 0x7fc6d4070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.111+0000 7fc6db385700 1 -- 172.21.15.82:0/1165351751 >> 172.21.15.82:0/1165351751 conn(0x7fc6d40ce600 msgr2=0x7fc6d40ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:18.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.115+0000 7fc6db385700 1 -- 172.21.15.82:0/1165351751 shutdown_connections 2023-11-28T13:01:18.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.115+0000 7fc6db385700 1 -- 172.21.15.82:0/1165351751 wait complete. 2023-11-28T13:01:18.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.115+0000 7fc6db385700 1 Processor -- start 2023-11-28T13:01:18.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.115+0000 7fc6db385700 1 -- start start 2023-11-28T13:01:18.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.115+0000 7fc6db385700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6d4070070 0x7fc6d40b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:18.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.115+0000 7fc6db385700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6d40b0cb0 0x7fc6d4151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:18.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.115+0000 7fc6db385700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6d41520a0 0x7fc6d40c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:18.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.115+0000 7fc6db385700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d40c89e0 con 0x7fc6d41520a0 2023-11-28T13:01:18.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.115+0000 7fc6db385700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d414f880 con 0x7fc6d4070070 2023-11-28T13:01:18.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.115+0000 7fc6db385700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d4152510 con 0x7fc6d40b0cb0 2023-11-28T13:01:18.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.115+0000 7fc6dab84700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6d41520a0 0x7fc6d40c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:18.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.115+0000 7fc6dab84700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6d41520a0 0x7fc6d40c74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33566/0 (socket says 172.21.15.82:33566) 2023-11-28T13:01:18.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.115+0000 7fc6dab84700 1 -- 172.21.15.82:0/3664523273 learned_addr learned my addr 172.21.15.82:0/3664523273 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:18.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.115+0000 7fc6d9b82700 1 --2- 172.21.15.82:0/3664523273 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6d40b0cb0 0x7fc6d4151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:18.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.115+0000 7fc6da383700 1 --2- 172.21.15.82:0/3664523273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6d4070070 0x7fc6d40b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:18.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.119+0000 7fc6dab84700 1 -- 172.21.15.82:0/3664523273 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6d40b0cb0 msgr2=0x7fc6d4151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:18.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.119+0000 7fc6dab84700 1 --2- 172.21.15.82:0/3664523273 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6d40b0cb0 0x7fc6d4151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.119+0000 7fc6dab84700 1 -- 172.21.15.82:0/3664523273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6d4070070 msgr2=0x7fc6d40b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:18.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.119+0000 7fc6dab84700 1 --2- 172.21.15.82:0/3664523273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6d4070070 0x7fc6d40b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.119+0000 7fc6dab84700 1 -- 172.21.15.82:0/3664523273 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc009b30 con 0x7fc6d41520a0 2023-11-28T13:01:18.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.119+0000 7fc6dab84700 1 --2- 172.21.15.82:0/3664523273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6d41520a0 0x7fc6d40c74d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c490 tx=0x7fc6d000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:18.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.119+0000 7fc6c6ffd700 1 -- 172.21.15.82:0/3664523273 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0004a90 con 0x7fc6d41520a0 2023-11-28T13:01:18.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.119+0000 7fc6c6ffd700 1 -- 172.21.15.82:0/3664523273 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d0004c10 con 0x7fc6d41520a0 2023-11-28T13:01:18.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.119+0000 7fc6db385700 1 -- 172.21.15.82:0/3664523273 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d406ab90 con 0x7fc6d41520a0 2023-11-28T13:01:18.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.119+0000 7fc6c6ffd700 1 -- 172.21.15.82:0/3664523273 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d00070d0 con 0x7fc6d41520a0 2023-11-28T13:01:18.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.119+0000 7fc6db385700 1 -- 172.21.15.82:0/3664523273 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d406a8b0 con 0x7fc6d41520a0 2023-11-28T13:01:18.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.119+0000 7fc6c6ffd700 1 -- 172.21.15.82:0/3664523273 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc6d001a020 con 0x7fc6d41520a0 2023-11-28T13:01:18.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.119+0000 7fc6db385700 1 -- 172.21.15.82:0/3664523273 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d40cc710 con 0x7fc6d41520a0 2023-11-28T13:01:18.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.119+0000 7fc6c6ffd700 1 --2- 172.21.15.82:0/3664523273 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc6b8064ee0 0x7fc6b8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:18.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.119+0000 7fc6c6ffd700 1 -- 172.21.15.82:0/3664523273 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc6d0081860 con 0x7fc6d41520a0 2023-11-28T13:01:18.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.119+0000 7fc6da383700 1 --2- 172.21.15.82:0/3664523273 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc6b8064ee0 0x7fc6b8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:18.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.123+0000 7fc6da383700 1 --2- 172.21.15.82:0/3664523273 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc6b8064ee0 0x7fc6b8067390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc6c800ab60 tx=0x7fc6c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:18.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.127+0000 7fc6c6ffd700 1 -- 172.21.15.82:0/3664523273 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc6d004f940 con 0x7fc6d41520a0 2023-11-28T13:01:18.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.323+0000 7fc6db385700 1 -- 172.21.15.82:0/3664523273 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6d4065fc0 con 0x7fc6d41520a0 2023-11-28T13:01:18.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.323+0000 7fc6c6ffd700 1 -- 172.21.15.82:0/3664523273 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4648 (secure 0 0 0) 0x7fc6d0052f60 con 0x7fc6d41520a0 2023-11-28T13:01:18.328 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:18.328 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2058451312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2058451312},{"type":"v1","addr":"172.21.15.82:6835","nonce":2058451312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/4064345694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":4064345694},{"type":"v1","addr":"172.21.15.114:6833","nonce":4064345694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2802500604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2802500604},{"type":"v1","addr":"172.21.15.114:6835","nonce":2802500604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:00:25.978137+0000","modified":"2023-11-28T13:00:28.990262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2893797521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2893797521},{"type":"v1","addr":"172.21.15.82:6837","nonce":2893797521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T13:01:18.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.323+0000 7fc6db385700 1 -- 172.21.15.82:0/3664523273 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc6b8064ee0 msgr2=0x7fc6b8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:18.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.323+0000 7fc6db385700 1 --2- 172.21.15.82:0/3664523273 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc6b8064ee0 0x7fc6b8067390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc6c800ab60 tx=0x7fc6c8008040 comp rx=0 tx=0).stop 2023-11-28T13:01:18.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.327+0000 7fc6db385700 1 -- 172.21.15.82:0/3664523273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6d41520a0 msgr2=0x7fc6d40c74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:18.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.327+0000 7fc6db385700 1 --2- 172.21.15.82:0/3664523273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6d41520a0 0x7fc6d40c74d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c490 tx=0x7fc6d000c7a0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.327+0000 7fc6db385700 1 -- 172.21.15.82:0/3664523273 shutdown_connections 2023-11-28T13:01:18.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.327+0000 7fc6db385700 1 --2- 172.21.15.82:0/3664523273 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc6b8064ee0 0x7fc6b8067390 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.327+0000 7fc6db385700 1 --2- 172.21.15.82:0/3664523273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6d41520a0 0x7fc6d40c74d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.327+0000 7fc6db385700 1 --2- 172.21.15.82:0/3664523273 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6d40b0cb0 0x7fc6d4151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.327+0000 7fc6db385700 1 --2- 172.21.15.82:0/3664523273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6d4070070 0x7fc6d40b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.327+0000 7fc6db385700 1 -- 172.21.15.82:0/3664523273 >> 172.21.15.82:0/3664523273 conn(0x7fc6d40ce600 msgr2=0x7fc6d40b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:18.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.327+0000 7fc6db385700 1 -- 172.21.15.82:0/3664523273 shutdown_connections 2023-11-28T13:01:18.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.327+0000 7fc6db385700 1 -- 172.21.15.82:0/3664523273 wait complete. 2023-11-28T13:01:18.335 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 7 2023-11-28T13:01:18.343 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:01:18.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.447+0000 7f48752e5700 1 Processor -- start 2023-11-28T13:01:18.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.447+0000 7f48752e5700 1 -- start start 2023-11-28T13:01:18.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.447+0000 7f48752e5700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4870158df0 0x7f487015d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:18.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.447+0000 7f48752e5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4870070070 0x7f48700704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:18.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.447+0000 7f48752e5700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487015da50 con 0x7f48701591c0 2023-11-28T13:01:18.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.447+0000 7f48752e5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4870070a30 con 0x7f4870070070 2023-11-28T13:01:18.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.447+0000 7f48752e5700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48700c9e20 con 0x7f4870158df0 2023-11-28T13:01:18.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.447+0000 7f4874ae4700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4870070070 0x7f48700704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:18.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.447+0000 7f4874ae4700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4870070070 0x7f48700704f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33576/0 (socket says 172.21.15.82:33576) 2023-11-28T13:01:18.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.451+0000 7f4874ae4700 1 -- 172.21.15.82:0/13208648 learned_addr learned my addr 172.21.15.82:0/13208648 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:18.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.451+0000 7f486ffff700 1 --2- 172.21.15.82:0/13208648 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4870158df0 0x7f487015d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:18.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.451+0000 7f4874ae4700 1 -- 172.21.15.82:0/13208648 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4870158df0 msgr2=0x7f487015d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:18.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.451+0000 7f4874ae4700 1 --2- 172.21.15.82:0/13208648 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4870158df0 0x7f487015d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.451+0000 7f4874ae4700 1 -- 172.21.15.82:0/13208648 >> v1:172.21.15.114:6789/0 conn(0x7f48701591c0 legacy=0x7f487006c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:18.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.451+0000 7f4874ae4700 1 -- 172.21.15.82:0/13208648 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48700cc640 con 0x7f4870070070 2023-11-28T13:01:18.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.451+0000 7f4874ae4700 1 --2- 172.21.15.82:0/13208648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4870070070 0x7f48700704f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4868009910 tx=0x7f4868009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c150fb40d1fdf8ed server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:18.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.451+0000 7f486effd700 1 -- 172.21.15.82:0/13208648 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486800ba60 con 0x7f4870070070 2023-11-28T13:01:18.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.451+0000 7f486effd700 1 -- 172.21.15.82:0/13208648 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486800bbc0 con 0x7f4870070070 2023-11-28T13:01:18.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.451+0000 7f486effd700 1 -- 172.21.15.82:0/13208648 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4868009e60 con 0x7f4870070070 2023-11-28T13:01:18.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.451+0000 7f48752e5700 1 -- 172.21.15.82:0/13208648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4870070070 msgr2=0x7f48700704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:18.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.451+0000 7f48752e5700 1 --2- 172.21.15.82:0/13208648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4870070070 0x7f48700704f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4868009910 tx=0x7f4868009c20 comp rx=0 tx=0).stop 2023-11-28T13:01:18.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.451+0000 7f48752e5700 1 -- 172.21.15.82:0/13208648 shutdown_connections 2023-11-28T13:01:18.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.451+0000 7f48752e5700 1 --2- 172.21.15.82:0/13208648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4870070070 0x7f48700704f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.451+0000 7f48752e5700 1 --2- 172.21.15.82:0/13208648 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4870158df0 0x7f487015d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.451+0000 7f48752e5700 1 -- 172.21.15.82:0/13208648 >> 172.21.15.82:0/13208648 conn(0x7f48700ce600 msgr2=0x7f48700ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:18.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.451+0000 7f48752e5700 1 -- 172.21.15.82:0/13208648 shutdown_connections 2023-11-28T13:01:18.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.451+0000 7f48752e5700 1 -- 172.21.15.82:0/13208648 wait complete. 2023-11-28T13:01:18.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.451+0000 7f48752e5700 1 Processor -- start 2023-11-28T13:01:18.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f48752e5700 1 -- start start 2023-11-28T13:01:18.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f48752e5700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4870070070 0x7f48700b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:18.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f48752e5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4870158df0 0x7f487006c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:18.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f48752e5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48701591c0 0x7f487006c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:18.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f48752e5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487014dcd0 con 0x7f4870158df0 2023-11-28T13:01:18.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f48752e5700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487014d150 con 0x7f48701591c0 2023-11-28T13:01:18.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f48752e5700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487014d430 con 0x7f4870070070 2023-11-28T13:01:18.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f486f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4870158df0 0x7f487006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:18.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f486f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4870158df0 0x7f487006c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33588/0 (socket says 172.21.15.82:33588) 2023-11-28T13:01:18.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f486f7fe700 1 -- 172.21.15.82:0/4235257500 learned_addr learned my addr 172.21.15.82:0/4235257500 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:18.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f486ffff700 1 --2- 172.21.15.82:0/4235257500 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4870070070 0x7f48700b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:18.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f4874ae4700 1 --2- 172.21.15.82:0/4235257500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48701591c0 0x7f487006c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:18.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f486f7fe700 1 -- 172.21.15.82:0/4235257500 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4870070070 msgr2=0x7f48700b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:18.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f486f7fe700 1 --2- 172.21.15.82:0/4235257500 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4870070070 0x7f48700b31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f486f7fe700 1 -- 172.21.15.82:0/4235257500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48701591c0 msgr2=0x7f487006c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:18.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f486f7fe700 1 --2- 172.21.15.82:0/4235257500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48701591c0 0x7f487006c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f486f7fe700 1 -- 172.21.15.82:0/4235257500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4868009570 con 0x7f4870158df0 2023-11-28T13:01:18.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f486f7fe700 1 --2- 172.21.15.82:0/4235257500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4870158df0 0x7f487006c070 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f486000cba0 tx=0x7f486000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:18.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f486cff9700 1 -- 172.21.15.82:0/4235257500 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860003c20 con 0x7f4870158df0 2023-11-28T13:01:18.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f486cff9700 1 -- 172.21.15.82:0/4235257500 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4860003d80 con 0x7f4870158df0 2023-11-28T13:01:18.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f486cff9700 1 -- 172.21.15.82:0/4235257500 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486000aae0 con 0x7f4870158df0 2023-11-28T13:01:18.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f48752e5700 1 -- 172.21.15.82:0/4235257500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48700c9ab0 con 0x7f4870158df0 2023-11-28T13:01:18.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.455+0000 7f48752e5700 1 -- 172.21.15.82:0/4235257500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48700c97d0 con 0x7f4870158df0 2023-11-28T13:01:18.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.459+0000 7f48752e5700 1 -- 172.21.15.82:0/4235257500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48700c9480 con 0x7f4870158df0 2023-11-28T13:01:18.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.459+0000 7f486cff9700 1 -- 172.21.15.82:0/4235257500 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4860010050 con 0x7f4870158df0 2023-11-28T13:01:18.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.459+0000 7f486cff9700 1 --2- 172.21.15.82:0/4235257500 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f485c064ee0 0x7f485c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:18.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.459+0000 7f486cff9700 1 -- 172.21.15.82:0/4235257500 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4860081ce0 con 0x7f4870158df0 2023-11-28T13:01:18.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.459+0000 7f486ffff700 1 --2- 172.21.15.82:0/4235257500 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f485c064ee0 0x7f485c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:18.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.459+0000 7f486ffff700 1 --2- 172.21.15.82:0/4235257500 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f485c064ee0 0x7f485c067390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4864009a00 tx=0x7f4864008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:18.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.467+0000 7f486cff9700 1 -- 172.21.15.82:0/4235257500 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f486004fc70 con 0x7f4870158df0 2023-11-28T13:01:18.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.631+0000 7f48752e5700 1 -- 172.21.15.82:0/4235257500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f487015da50 con 0x7f4870158df0 2023-11-28T13:01:18.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.631+0000 7f486cff9700 1 -- 172.21.15.82:0/4235257500 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17907 (secure 0 0 0) 0x7f487015da50 con 0x7f4870158df0 2023-11-28T13:01:18.638 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:18.639 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:01:08.993802+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:00:24.360641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T13:00:24.960863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.26","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:01:18.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.635+0000 7f48752e5700 1 -- 172.21.15.82:0/4235257500 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f485c064ee0 msgr2=0x7f485c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:18.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.635+0000 7f48752e5700 1 --2- 172.21.15.82:0/4235257500 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f485c064ee0 0x7f485c067390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4864009a00 tx=0x7f4864008040 comp rx=0 tx=0).stop 2023-11-28T13:01:18.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.635+0000 7f48752e5700 1 -- 172.21.15.82:0/4235257500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4870158df0 msgr2=0x7f487006c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:18.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.635+0000 7f48752e5700 1 --2- 172.21.15.82:0/4235257500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4870158df0 0x7f487006c070 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f486000cba0 tx=0x7f486000ceb0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.635+0000 7f48752e5700 1 -- 172.21.15.82:0/4235257500 shutdown_connections 2023-11-28T13:01:18.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.635+0000 7f48752e5700 1 --2- 172.21.15.82:0/4235257500 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f485c064ee0 0x7f485c067390 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.635+0000 7f48752e5700 1 --2- 172.21.15.82:0/4235257500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48701591c0 0x7f487006c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.635+0000 7f48752e5700 1 --2- 172.21.15.82:0/4235257500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4870158df0 0x7f487006c070 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.635+0000 7f48752e5700 1 --2- 172.21.15.82:0/4235257500 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4870070070 0x7f48700b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.635+0000 7f48752e5700 1 -- 172.21.15.82:0/4235257500 >> 172.21.15.82:0/4235257500 conn(0x7f48700ce600 msgr2=0x7f48700ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:18.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.635+0000 7f48752e5700 1 -- 172.21.15.82:0/4235257500 shutdown_connections 2023-11-28T13:01:18.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.635+0000 7f48752e5700 1 -- 172.21.15.82:0/4235257500 wait complete. 2023-11-28T13:01:18.654 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T13:01:18.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.767+0000 7f59f7544700 1 Processor -- start 2023-11-28T13:01:18.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.767+0000 7f59f7544700 1 -- start start 2023-11-28T13:01:18.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f7544700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f59f0158830 0x7f59f00c9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:18.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f7544700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f59f00cade0 0x7f59f006a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:18.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f7544700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f00cec30 con 0x7f59f0070850 2023-11-28T13:01:18.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f7544700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f00cb230 con 0x7f59f00cade0 2023-11-28T13:01:18.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f7544700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f00cb4c0 con 0x7f59f0158830 2023-11-28T13:01:18.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f5d41700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f59f00cade0 0x7f59f006a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:18.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f5d41700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f59f00cade0 0x7f59f006a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33600/0 (socket says 172.21.15.82:33600) 2023-11-28T13:01:18.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f5d41700 1 -- 172.21.15.82:0/925600611 learned_addr learned my addr 172.21.15.82:0/925600611 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:18.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f6d43700 1 --1- 172.21.15.82:0/925600611 >> v1:172.21.15.82:6789/0 conn(0x7f59f0070850 0x7f59f015c5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45848/0 (socket says 172.21.15.82:45848) 2023-11-28T13:01:18.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f6542700 1 --2- 172.21.15.82:0/925600611 >> v2:172.21.15.114:3300/0 conn(0x7f59f0158830 0x7f59f00c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:18.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f5d41700 1 -- 172.21.15.82:0/925600611 >> v2:172.21.15.114:3300/0 conn(0x7f59f0158830 msgr2=0x7f59f00c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:18.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f5d41700 1 --2- 172.21.15.82:0/925600611 >> v2:172.21.15.114:3300/0 conn(0x7f59f0158830 0x7f59f00c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f5d41700 1 -- 172.21.15.82:0/925600611 >> v1:172.21.15.82:6789/0 conn(0x7f59f0070850 legacy=0x7f59f015c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:18.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f5540700 1 -- 172.21.15.82:0/925600611 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3106445370 0 0) 0x7f59f00cec30 con 0x7f59f0070850 2023-11-28T13:01:18.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f5d41700 1 -- 172.21.15.82:0/925600611 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f006b630 con 0x7f59f00cade0 2023-11-28T13:01:18.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f5d41700 1 --2- 172.21.15.82:0/925600611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59f00cade0 0x7f59f006a450 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f59f0071be0 tx=0x7f59e0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78ce8d309e1ff0c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:18.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f5540700 1 -- 172.21.15.82:0/925600611 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0011830 con 0x7f59f00cade0 2023-11-28T13:01:18.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f5540700 1 -- 172.21.15.82:0/925600611 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e0011990 con 0x7f59f00cade0 2023-11-28T13:01:18.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f5540700 1 -- 172.21.15.82:0/925600611 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0011d20 con 0x7f59f00cade0 2023-11-28T13:01:18.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f7544700 1 -- 172.21.15.82:0/925600611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59f00cade0 msgr2=0x7f59f006a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:18.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f7544700 1 --2- 172.21.15.82:0/925600611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59f00cade0 0x7f59f006a450 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f59f0071be0 tx=0x7f59e0009bf0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f7544700 1 -- 172.21.15.82:0/925600611 shutdown_connections 2023-11-28T13:01:18.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f7544700 1 --2- 172.21.15.82:0/925600611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59f00cade0 0x7f59f006a450 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f7544700 1 --2- 172.21.15.82:0/925600611 >> v2:172.21.15.114:3300/0 conn(0x7f59f0158830 0x7f59f00c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f7544700 1 -- 172.21.15.82:0/925600611 >> 172.21.15.82:0/925600611 conn(0x7f59f00cedc0 msgr2=0x7f59f00cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:18.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f7544700 1 -- 172.21.15.82:0/925600611 shutdown_connections 2023-11-28T13:01:18.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.771+0000 7f59f7544700 1 -- 172.21.15.82:0/925600611 wait complete. 2023-11-28T13:01:18.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f7544700 1 Processor -- start 2023-11-28T13:01:18.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f7544700 1 -- start start 2023-11-28T13:01:18.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f7544700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59f0070850 0x7f59f01ef6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:18.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f7544700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59f00cade0 0x7f59f00c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:18.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f7544700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59f0158830 0x7f59f01f2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:18.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f7544700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f0158260 con 0x7f59f0070850 2023-11-28T13:01:18.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f7544700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f00c6590 con 0x7f59f00cade0 2023-11-28T13:01:18.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f7544700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f00c6870 con 0x7f59f0158830 2023-11-28T13:01:18.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f6542700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59f0070850 0x7f59f01ef6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:18.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f6542700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59f0070850 0x7f59f01ef6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33614/0 (socket says 172.21.15.82:33614) 2023-11-28T13:01:18.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f6542700 1 -- 172.21.15.82:0/2883042754 learned_addr learned my addr 172.21.15.82:0/2883042754 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:18.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f5d41700 1 --2- 172.21.15.82:0/2883042754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59f00cade0 0x7f59f00c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:18.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f6d43700 1 --2- 172.21.15.82:0/2883042754 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59f0158830 0x7f59f01f2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:18.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f6542700 1 -- 172.21.15.82:0/2883042754 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59f0158830 msgr2=0x7f59f01f2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:18.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f6542700 1 --2- 172.21.15.82:0/2883042754 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59f0158830 0x7f59f01f2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f6542700 1 -- 172.21.15.82:0/2883042754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59f00cade0 msgr2=0x7f59f00c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:18.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f6542700 1 --2- 172.21.15.82:0/2883042754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59f00cade0 0x7f59f00c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:18.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f6542700 1 -- 172.21.15.82:0/2883042754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e0009570 con 0x7f59f0070850 2023-11-28T13:01:18.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f6542700 1 --2- 172.21.15.82:0/2883042754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59f0070850 0x7f59f01ef6f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f59ec00e840 tx=0x7f59ec00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:18.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59e6ffd700 1 -- 172.21.15.82:0/2883042754 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec0095a0 con 0x7f59f0070850 2023-11-28T13:01:18.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59e6ffd700 1 -- 172.21.15.82:0/2883042754 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ec00c690 con 0x7f59f0070850 2023-11-28T13:01:18.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f7544700 1 -- 172.21.15.82:0/2883042754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f006bbf0 con 0x7f59f0070850 2023-11-28T13:01:18.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59e6ffd700 1 -- 172.21.15.82:0/2883042754 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec00ca00 con 0x7f59f0070850 2023-11-28T13:01:18.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f7544700 1 -- 172.21.15.82:0/2883042754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f006b910 con 0x7f59f0070850 2023-11-28T13:01:18.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.775+0000 7f59f7544700 1 -- 172.21.15.82:0/2883042754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f006a990 con 0x7f59f0070850 2023-11-28T13:01:18.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.779+0000 7f59e6ffd700 1 -- 172.21.15.82:0/2883042754 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f59ec019030 con 0x7f59f0070850 2023-11-28T13:01:18.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.779+0000 7f59e6ffd700 1 --2- 172.21.15.82:0/2883042754 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f59d4064ee0 0x7f59d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:18.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.779+0000 7f59f5d41700 1 --2- 172.21.15.82:0/2883042754 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f59d4064ee0 0x7f59d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:18.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.779+0000 7f59e6ffd700 1 -- 172.21.15.82:0/2883042754 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f59ec081da0 con 0x7f59f0070850 2023-11-28T13:01:18.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.779+0000 7f59f5d41700 1 --2- 172.21.15.82:0/2883042754 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f59d4064ee0 0x7f59d4067390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f59e0000c00 tx=0x7f59e0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:18.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.783+0000 7f59e6ffd700 1 -- 172.21.15.82:0/2883042754 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f59ec04fea0 con 0x7f59f0070850 2023-11-28T13:01:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:18.979+0000 7f59f7544700 1 -- 172.21.15.82:0/2883042754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f59f0065fc0 con 0x7f59f0070850 2023-11-28T13:01:19.071 INFO:tasks.ceph.mon.a.smithi082.stderr:2023-11-28T13:01:19.067+0000 7f1907e90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T13:01:19.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.075+0000 7f59e6ffd700 1 -- 172.21.15.82:0/2883042754 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f59ec0534c0 con 0x7f59f0070850 2023-11-28T13:01:19.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.079+0000 7f59f7544700 1 -- 172.21.15.82:0/2883042754 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f59d4064ee0 msgr2=0x7f59d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:19.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.079+0000 7f59f7544700 1 --2- 172.21.15.82:0/2883042754 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f59d4064ee0 0x7f59d4067390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f59e0000c00 tx=0x7f59e0008030 comp rx=0 tx=0).stop 2023-11-28T13:01:19.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.079+0000 7f59f7544700 1 -- 172.21.15.82:0/2883042754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59f0070850 msgr2=0x7f59f01ef6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:19.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.079+0000 7f59f7544700 1 --2- 172.21.15.82:0/2883042754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59f0070850 0x7f59f01ef6f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f59ec00e840 tx=0x7f59ec00ec00 comp rx=0 tx=0).stop 2023-11-28T13:01:19.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.079+0000 7f59f7544700 1 -- 172.21.15.82:0/2883042754 shutdown_connections 2023-11-28T13:01:19.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.079+0000 7f59f7544700 1 --2- 172.21.15.82:0/2883042754 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f59d4064ee0 0x7f59d4067390 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:19.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.079+0000 7f59f7544700 1 --2- 172.21.15.82:0/2883042754 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59f0158830 0x7f59f01f2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:19.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.079+0000 7f59f7544700 1 --2- 172.21.15.82:0/2883042754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59f00cade0 0x7f59f00c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:19.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.079+0000 7f59f7544700 1 --2- 172.21.15.82:0/2883042754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59f0070850 0x7f59f01ef6f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:19.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.079+0000 7f59f7544700 1 -- 172.21.15.82:0/2883042754 >> 172.21.15.82:0/2883042754 conn(0x7f59f00cedc0 msgr2=0x7f59f00af2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:19.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.079+0000 7f59f7544700 1 -- 172.21.15.82:0/2883042754 shutdown_connections 2023-11-28T13:01:19.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.079+0000 7f59f7544700 1 -- 172.21.15.82:0/2883042754 wait complete. 2023-11-28T13:01:19.088 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T13:01:19.101 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T13:01:19.120 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-11-28T13:01:19.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.211+0000 7fe15b4c7700 1 Processor -- start 2023-11-28T13:01:19.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.211+0000 7fe15b4c7700 1 -- start start 2023-11-28T13:01:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe15b4c7700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe15415c690 0x7fe15406aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe15b4c7700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe1540ca440 0x7fe154160270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe15b4c7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe1540cc340 0x7fe1540cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe15b4c7700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1540ce3c0 con 0x7fe1540cc340 2023-11-28T13:01:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe15b4c7700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1540ccd00 con 0x7fe1540ca440 2023-11-28T13:01:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe15b4c7700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1540ca2a0 con 0x7fe15415c690 2023-11-28T13:01:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe159a64700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe1540cc340 0x7fe1540cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe159a64700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe1540cc340 0x7fe1540cc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33638/0 (socket says 172.21.15.82:33638) 2023-11-28T13:01:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe159a64700 1 -- 172.21.15.82:0/2086861468 learned_addr learned my addr 172.21.15.82:0/2086861468 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe159263700 1 --2- 172.21.15.82:0/2086861468 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe15415c690 0x7fe15406aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe158a62700 1 --2- 172.21.15.82:0/2086861468 >> v2:172.21.15.114:3300/0 conn(0x7fe1540ca440 0x7fe154160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe159a64700 1 -- 172.21.15.82:0/2086861468 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe15415c690 msgr2=0x7fe15406aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe159a64700 1 --2- 172.21.15.82:0/2086861468 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe15415c690 0x7fe15406aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe159a64700 1 -- 172.21.15.82:0/2086861468 >> v2:172.21.15.114:3300/0 conn(0x7fe1540ca440 msgr2=0x7fe154160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe159a64700 1 --2- 172.21.15.82:0/2086861468 >> v2:172.21.15.114:3300/0 conn(0x7fe1540ca440 0x7fe154160270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe159a64700 1 -- 172.21.15.82:0/2086861468 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1541607b0 con 0x7fe1540cc340 2023-11-28T13:01:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe158a62700 1 --2- 172.21.15.82:0/2086861468 >> v2:172.21.15.114:3300/0 conn(0x7fe1540ca440 0x7fe154160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:01:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe159263700 1 --2- 172.21.15.82:0/2086861468 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe15415c690 0x7fe15406aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:01:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe159a64700 1 --2- 172.21.15.82:0/2086861468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1540cc340 0x7fe1540cc7c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe154072470 tx=0x7fe14c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cbe02d68a60f4a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe14bfff700 1 -- 172.21.15.82:0/2086861468 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c00e070 con 0x7fe1540cc340 2023-11-28T13:01:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe14bfff700 1 -- 172.21.15.82:0/2086861468 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c00b980 con 0x7fe1540cc340 2023-11-28T13:01:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe14bfff700 1 -- 172.21.15.82:0/2086861468 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c00bd30 con 0x7fe1540cc340 2023-11-28T13:01:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe15b4c7700 1 -- 172.21.15.82:0/2086861468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1540cc340 msgr2=0x7fe1540cc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe15b4c7700 1 --2- 172.21.15.82:0/2086861468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1540cc340 0x7fe1540cc7c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe154072470 tx=0x7fe14c00b330 comp rx=0 tx=0).stop 2023-11-28T13:01:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe15b4c7700 1 -- 172.21.15.82:0/2086861468 shutdown_connections 2023-11-28T13:01:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe15b4c7700 1 --2- 172.21.15.82:0/2086861468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1540cc340 0x7fe1540cc7c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:19.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe15b4c7700 1 --2- 172.21.15.82:0/2086861468 >> v2:172.21.15.114:3300/0 conn(0x7fe1540ca440 0x7fe154160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:19.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe15b4c7700 1 --2- 172.21.15.82:0/2086861468 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe15415c690 0x7fe15406aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:19.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe15b4c7700 1 -- 172.21.15.82:0/2086861468 >> 172.21.15.82:0/2086861468 conn(0x7fe1540b1480 msgr2=0x7fe1540b1850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:19.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe15b4c7700 1 -- 172.21.15.82:0/2086861468 shutdown_connections 2023-11-28T13:01:19.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.215+0000 7fe15b4c7700 1 -- 172.21.15.82:0/2086861468 wait complete. 2023-11-28T13:01:19.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe15b4c7700 1 Processor -- start 2023-11-28T13:01:19.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe15b4c7700 1 -- start start 2023-11-28T13:01:19.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe15b4c7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1540ca440 0x7fe15414f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:19.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe15b4c7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1540cc340 0x7fe1540c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:19.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe15b4c7700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe15415c690 0x7fe15415ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:19.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe15b4c7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1540c3590 con 0x7fe1540cc340 2023-11-28T13:01:19.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe15b4c7700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15414f830 con 0x7fe1540ca440 2023-11-28T13:01:19.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe15b4c7700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15414fd00 con 0x7fe15415c690 2023-11-28T13:01:19.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe158a62700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1540cc340 0x7fe1540c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:19.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe158a62700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1540cc340 0x7fe1540c4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33644/0 (socket says 172.21.15.82:33644) 2023-11-28T13:01:19.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe158a62700 1 -- 172.21.15.82:0/3372537580 learned_addr learned my addr 172.21.15.82:0/3372537580 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:19.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe159a64700 1 --2- 172.21.15.82:0/3372537580 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe15415c690 0x7fe15415ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:19.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe158a62700 1 -- 172.21.15.82:0/3372537580 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe15415c690 msgr2=0x7fe15415ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:19.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe159263700 1 --2- 172.21.15.82:0/3372537580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1540ca440 0x7fe15414f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:19.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe158a62700 1 --2- 172.21.15.82:0/3372537580 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe15415c690 0x7fe15415ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:19.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe158a62700 1 -- 172.21.15.82:0/3372537580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1540ca440 msgr2=0x7fe15414f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:19.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe158a62700 1 --2- 172.21.15.82:0/3372537580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1540ca440 0x7fe15414f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:19.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe158a62700 1 -- 172.21.15.82:0/3372537580 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c009b30 con 0x7fe1540cc340 2023-11-28T13:01:19.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe159a64700 1 --2- 172.21.15.82:0/3372537580 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe15415c690 0x7fe15415ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:01:19.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe159263700 1 --2- 172.21.15.82:0/3372537580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1540ca440 0x7fe15414f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:01:19.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe158a62700 1 --2- 172.21.15.82:0/3372537580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1540cc340 0x7fe1540c4f90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe14400c820 tx=0x7fe14400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:19.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe149ffb700 1 -- 172.21.15.82:0/3372537580 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe144011800 con 0x7fe1540cc340 2023-11-28T13:01:19.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe149ffb700 1 -- 172.21.15.82:0/3372537580 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe144011960 con 0x7fe1540cc340 2023-11-28T13:01:19.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe15b4c7700 1 -- 172.21.15.82:0/3372537580 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe154160cc0 con 0x7fe1540cc340 2023-11-28T13:01:19.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe149ffb700 1 -- 172.21.15.82:0/3372537580 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe144011d10 con 0x7fe1540cc340 2023-11-28T13:01:19.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.219+0000 7fe15b4c7700 1 -- 172.21.15.82:0/3372537580 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1541609e0 con 0x7fe1540cc340 2023-11-28T13:01:19.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.223+0000 7fe15b4c7700 1 -- 172.21.15.82:0/3372537580 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe154160fa0 con 0x7fe1540cc340 2023-11-28T13:01:19.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.223+0000 7fe149ffb700 1 -- 172.21.15.82:0/3372537580 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe144021070 con 0x7fe1540cc340 2023-11-28T13:01:19.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.223+0000 7fe149ffb700 1 --2- 172.21.15.82:0/3372537580 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe138064ee0 0x7fe138067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:19.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.223+0000 7fe159263700 1 --2- 172.21.15.82:0/3372537580 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe138064ee0 0x7fe138067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:19.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.223+0000 7fe149ffb700 1 -- 172.21.15.82:0/3372537580 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fe144081ec0 con 0x7fe1540cc340 2023-11-28T13:01:19.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.227+0000 7fe159263700 1 --2- 172.21.15.82:0/3372537580 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe138064ee0 0x7fe138067390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe1500089d0 tx=0x7fe150008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:19.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.231+0000 7fe149ffb700 1 -- 172.21.15.82:0/3372537580 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe14404fe50 con 0x7fe1540cc340 2023-11-28T13:01:19.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:19.427+0000 7fe15b4c7700 1 -- 172.21.15.82:0/3372537580 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe1540c33e0 con 0x7fe1540cc340 2023-11-28T13:01:20.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.099+0000 7fe149ffb700 1 -- 172.21.15.82:0/3372537580 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe1440150a0 con 0x7fe1540cc340 2023-11-28T13:01:20.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.103+0000 7fe15b4c7700 1 -- 172.21.15.82:0/3372537580 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe138064ee0 msgr2=0x7fe138067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:20.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.103+0000 7fe15b4c7700 1 --2- 172.21.15.82:0/3372537580 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe138064ee0 0x7fe138067390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe1500089d0 tx=0x7fe150008040 comp rx=0 tx=0).stop 2023-11-28T13:01:20.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.103+0000 7fe15b4c7700 1 -- 172.21.15.82:0/3372537580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1540cc340 msgr2=0x7fe1540c4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:20.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.103+0000 7fe15b4c7700 1 --2- 172.21.15.82:0/3372537580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1540cc340 0x7fe1540c4f90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe14400c820 tx=0x7fe14400cbe0 comp rx=0 tx=0).stop 2023-11-28T13:01:20.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.103+0000 7fe15b4c7700 1 -- 172.21.15.82:0/3372537580 shutdown_connections 2023-11-28T13:01:20.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.103+0000 7fe15b4c7700 1 --2- 172.21.15.82:0/3372537580 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe138064ee0 0x7fe138067390 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:20.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.103+0000 7fe15b4c7700 1 --2- 172.21.15.82:0/3372537580 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe15415c690 0x7fe15415ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:20.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.103+0000 7fe15b4c7700 1 --2- 172.21.15.82:0/3372537580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1540cc340 0x7fe1540c4f90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:20.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.103+0000 7fe15b4c7700 1 --2- 172.21.15.82:0/3372537580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1540ca440 0x7fe15414f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:20.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.103+0000 7fe15b4c7700 1 -- 172.21.15.82:0/3372537580 >> 172.21.15.82:0/3372537580 conn(0x7fe1540b1480 msgr2=0x7fe1540b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:20.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.103+0000 7fe15b4c7700 1 -- 172.21.15.82:0/3372537580 shutdown_connections 2023-11-28T13:01:20.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.103+0000 7fe15b4c7700 1 -- 172.21.15.82:0/3372537580 wait complete. 2023-11-28T13:01:20.126 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T13:01:20.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.251+0000 7f1d867ee700 1 Processor -- start 2023-11-28T13:01:20.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.251+0000 7f1d867ee700 1 -- start start 2023-11-28T13:01:20.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.251+0000 7f1d867ee700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d8015a170 0x7f1d800d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:20.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.251+0000 7f1d867ee700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1d8006e180 0x7f1d800b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:20.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.251+0000 7f1d867ee700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1d800b27e0 0x7f1d8015dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:20.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.251+0000 7f1d867ee700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d800b2c60 con 0x7f1d800b27e0 2023-11-28T13:01:20.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.251+0000 7f1d867ee700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d800b00d0 con 0x7f1d8006e180 2023-11-28T13:01:20.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.251+0000 7f1d867ee700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d800ce3f0 con 0x7f1d8015a170 2023-11-28T13:01:20.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d85fed700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1d800b27e0 0x7f1d8015dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:20.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d85fed700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1d800b27e0 0x7f1d8015dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33646/0 (socket says 172.21.15.82:33646) 2023-11-28T13:01:20.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d85fed700 1 -- 172.21.15.82:0/781100600 learned_addr learned my addr 172.21.15.82:0/781100600 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:20.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d857ec700 1 --2- 172.21.15.82:0/781100600 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d8015a170 0x7f1d800d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:20.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d84feb700 1 --2- 172.21.15.82:0/781100600 >> v2:172.21.15.114:3300/0 conn(0x7f1d8006e180 0x7f1d800b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:20.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d85fed700 1 -- 172.21.15.82:0/781100600 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d8015a170 msgr2=0x7f1d800d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:20.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d85fed700 1 --2- 172.21.15.82:0/781100600 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d8015a170 0x7f1d800d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:20.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d85fed700 1 -- 172.21.15.82:0/781100600 >> v2:172.21.15.114:3300/0 conn(0x7f1d8006e180 msgr2=0x7f1d800b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:20.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d85fed700 1 --2- 172.21.15.82:0/781100600 >> v2:172.21.15.114:3300/0 conn(0x7f1d8006e180 0x7f1d800b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:20.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d85fed700 1 -- 172.21.15.82:0/781100600 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d800d0660 con 0x7f1d800b27e0 2023-11-28T13:01:20.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d857ec700 1 --2- 172.21.15.82:0/781100600 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d8015a170 0x7f1d800d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:20.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d84feb700 1 --2- 172.21.15.82:0/781100600 >> v2:172.21.15.114:3300/0 conn(0x7f1d8006e180 0x7f1d800b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:20.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d85fed700 1 --2- 172.21.15.82:0/781100600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d800b27e0 0x7f1d8015dc30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1d800712a0 tx=0x7f1d7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2edbd4500931027d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:20.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d77fff700 1 -- 172.21.15.82:0/781100600 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7800e070 con 0x7f1d800b27e0 2023-11-28T13:01:20.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d77fff700 1 -- 172.21.15.82:0/781100600 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7800b9c0 con 0x7f1d800b27e0 2023-11-28T13:01:20.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d77fff700 1 -- 172.21.15.82:0/781100600 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7800bd70 con 0x7f1d800b27e0 2023-11-28T13:01:20.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d867ee700 1 -- 172.21.15.82:0/781100600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d800b27e0 msgr2=0x7f1d8015dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:20.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d867ee700 1 --2- 172.21.15.82:0/781100600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d800b27e0 0x7f1d8015dc30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1d800712a0 tx=0x7f1d7800b330 comp rx=0 tx=0).stop 2023-11-28T13:01:20.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d867ee700 1 -- 172.21.15.82:0/781100600 shutdown_connections 2023-11-28T13:01:20.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d867ee700 1 --2- 172.21.15.82:0/781100600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d800b27e0 0x7f1d8015dc30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:20.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d867ee700 1 --2- 172.21.15.82:0/781100600 >> v2:172.21.15.114:3300/0 conn(0x7f1d8006e180 0x7f1d800b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:20.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d867ee700 1 --2- 172.21.15.82:0/781100600 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d8015a170 0x7f1d800d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:20.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d867ee700 1 -- 172.21.15.82:0/781100600 >> 172.21.15.82:0/781100600 conn(0x7f1d800cd2a0 msgr2=0x7f1d800cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:20.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d867ee700 1 -- 172.21.15.82:0/781100600 shutdown_connections 2023-11-28T13:01:20.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.255+0000 7f1d867ee700 1 -- 172.21.15.82:0/781100600 wait complete. 2023-11-28T13:01:20.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d867ee700 1 Processor -- start 2023-11-28T13:01:20.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d867ee700 1 -- start start 2023-11-28T13:01:20.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d867ee700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d8006e180 0x7f1d801f2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:20.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d867ee700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d800b27e0 0x7f1d800b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:20.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d867ee700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d8015a170 0x7f1d80157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:20.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d867ee700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d800b4520 con 0x7f1d8006e180 2023-11-28T13:01:20.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d867ee700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d800b3670 con 0x7f1d800b27e0 2023-11-28T13:01:20.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d867ee700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d801f2990 con 0x7f1d8015a170 2023-11-28T13:01:20.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d857ec700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d8006e180 0x7f1d801f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:20.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d857ec700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d8006e180 0x7f1d801f2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33656/0 (socket says 172.21.15.82:33656) 2023-11-28T13:01:20.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d857ec700 1 -- 172.21.15.82:0/2164841099 learned_addr learned my addr 172.21.15.82:0/2164841099 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:20.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d84feb700 1 --2- 172.21.15.82:0/2164841099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d800b27e0 0x7f1d800b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:20.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d85fed700 1 --2- 172.21.15.82:0/2164841099 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d8015a170 0x7f1d80157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:20.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d857ec700 1 -- 172.21.15.82:0/2164841099 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d8015a170 msgr2=0x7f1d80157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:20.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d857ec700 1 --2- 172.21.15.82:0/2164841099 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d8015a170 0x7f1d80157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:20.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d857ec700 1 -- 172.21.15.82:0/2164841099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d800b27e0 msgr2=0x7f1d800b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:20.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d857ec700 1 --2- 172.21.15.82:0/2164841099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d800b27e0 0x7f1d800b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:20.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d857ec700 1 -- 172.21.15.82:0/2164841099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d78009b30 con 0x7f1d8006e180 2023-11-28T13:01:20.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d84feb700 1 --2- 172.21.15.82:0/2164841099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d800b27e0 0x7f1d800b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:20.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d857ec700 1 --2- 172.21.15.82:0/2164841099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d8006e180 0x7f1d801f2450 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000e880 tx=0x7f1d7000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:20.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d75ffb700 1 -- 172.21.15.82:0/2164841099 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7000c780 con 0x7f1d8006e180 2023-11-28T13:01:20.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d75ffb700 1 -- 172.21.15.82:0/2164841099 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7000c8e0 con 0x7f1d8006e180 2023-11-28T13:01:20.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d867ee700 1 -- 172.21.15.82:0/2164841099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8006e6d0 con 0x7f1d8006e180 2023-11-28T13:01:20.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d75ffb700 1 -- 172.21.15.82:0/2164841099 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7000cc70 con 0x7f1d8006e180 2023-11-28T13:01:20.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.259+0000 7f1d867ee700 1 -- 172.21.15.82:0/2164841099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8015a540 con 0x7f1d8006e180 2023-11-28T13:01:20.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.263+0000 7f1d867ee700 1 -- 172.21.15.82:0/2164841099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d800cc970 con 0x7f1d8006e180 2023-11-28T13:01:20.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.263+0000 7f1d75ffb700 1 -- 172.21.15.82:0/2164841099 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1d70023070 con 0x7f1d8006e180 2023-11-28T13:01:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.263+0000 7f1d75ffb700 1 --2- 172.21.15.82:0/2164841099 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1d64064ee0 0x7f1d64067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.263+0000 7f1d75ffb700 1 -- 172.21.15.82:0/2164841099 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f1d70081bf0 con 0x7f1d8006e180 2023-11-28T13:01:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.263+0000 7f1d84feb700 1 --2- 172.21.15.82:0/2164841099 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1d64064ee0 0x7f1d64067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:20.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.263+0000 7f1d84feb700 1 --2- 172.21.15.82:0/2164841099 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1d64064ee0 0x7f1d64067390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1d8015b3c0 tx=0x7f1d7c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:20.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.271+0000 7f1d75ffb700 1 -- 172.21.15.82:0/2164841099 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1d7004fc20 con 0x7f1d8006e180 2023-11-28T13:01:20.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:20.439+0000 7f1d867ee700 1 -- 172.21.15.82:0/2164841099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1d80065fc0 con 0x7f1d8006e180 2023-11-28T13:01:21.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.155+0000 7f1d75ffb700 1 -- 172.21.15.82:0/2164841099 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1d70053240 con 0x7f1d8006e180 2023-11-28T13:01:21.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.163+0000 7f1d867ee700 1 -- 172.21.15.82:0/2164841099 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1d64064ee0 msgr2=0x7f1d64067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:21.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.163+0000 7f1d867ee700 1 --2- 172.21.15.82:0/2164841099 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1d64064ee0 0x7f1d64067390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1d8015b3c0 tx=0x7f1d7c008040 comp rx=0 tx=0).stop 2023-11-28T13:01:21.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.163+0000 7f1d867ee700 1 -- 172.21.15.82:0/2164841099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d8006e180 msgr2=0x7f1d801f2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:21.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.163+0000 7f1d867ee700 1 --2- 172.21.15.82:0/2164841099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d8006e180 0x7f1d801f2450 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000e880 tx=0x7f1d7000ec40 comp rx=0 tx=0).stop 2023-11-28T13:01:21.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.163+0000 7f1d867ee700 1 -- 172.21.15.82:0/2164841099 shutdown_connections 2023-11-28T13:01:21.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.163+0000 7f1d867ee700 1 --2- 172.21.15.82:0/2164841099 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1d64064ee0 0x7f1d64067390 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:21.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.163+0000 7f1d867ee700 1 --2- 172.21.15.82:0/2164841099 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d8015a170 0x7f1d80157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:21.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.163+0000 7f1d867ee700 1 --2- 172.21.15.82:0/2164841099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d800b27e0 0x7f1d800b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:21.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.163+0000 7f1d867ee700 1 --2- 172.21.15.82:0/2164841099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d8006e180 0x7f1d801f2450 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:21.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.163+0000 7f1d867ee700 1 -- 172.21.15.82:0/2164841099 >> 172.21.15.82:0/2164841099 conn(0x7f1d800cd2a0 msgr2=0x7f1d800b0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:21.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.163+0000 7f1d867ee700 1 -- 172.21.15.82:0/2164841099 shutdown_connections 2023-11-28T13:01:21.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.163+0000 7f1d867ee700 1 -- 172.21.15.82:0/2164841099 wait complete. 2023-11-28T13:01:21.170 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2023-11-28T13:01:21.183 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T13:01:21.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4b071700 1 Processor -- start 2023-11-28T13:01:21.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4b071700 1 -- start start 2023-11-28T13:01:21.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4b071700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e4406a420 0x7f3e440b1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:21.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4b071700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4415a4b0 con 0x7f3e4415a0e0 2023-11-28T13:01:21.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4b071700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4415dfb0 con 0x7f3e441435b0 2023-11-28T13:01:21.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4b071700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4415eb50 con 0x7f3e4406a420 2023-11-28T13:01:21.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4a06f700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3e4415a0e0 0x7f3e4415e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45852/0 (socket says 172.21.15.82:45852) 2023-11-28T13:01:21.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4a06f700 1 -- 172.21.15.82:0/2015864138 learned_addr learned my addr 172.21.15.82:0/2015864138 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:21.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4986e700 1 --2- 172.21.15.82:0/2015864138 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e4406a420 0x7f3e440b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:21.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4906d700 1 -- 172.21.15.82:0/2015864138 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935046135 0 0) 0x7f3e4415a4b0 con 0x7f3e4415a0e0 2023-11-28T13:01:21.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4906d700 1 -- 172.21.15.82:0/2015864138 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e300035d0 con 0x7f3e4415a0e0 2023-11-28T13:01:21.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4906d700 1 -- 172.21.15.82:0/2015864138 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369820733 0 0) 0x7f3e4415dfb0 con 0x7f3e441435b0 2023-11-28T13:01:21.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4906d700 1 -- 172.21.15.82:0/2015864138 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e4415a4b0 con 0x7f3e441435b0 2023-11-28T13:01:21.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4906d700 1 -- 172.21.15.82:0/2015864138 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 163961126 0 0) 0x7f3e300035d0 con 0x7f3e4415a0e0 2023-11-28T13:01:21.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4906d700 1 -- 172.21.15.82:0/2015864138 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e4406a420 msgr2=0x7f3e440b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:21.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4906d700 1 --2- 172.21.15.82:0/2015864138 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e4406a420 0x7f3e440b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:21.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4906d700 1 -- 172.21.15.82:0/2015864138 >> v1:172.21.15.114:6789/0 conn(0x7f3e441435b0 legacy=0x7f3e440c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:21.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4906d700 1 -- 172.21.15.82:0/2015864138 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4406a990 con 0x7f3e4415a0e0 2023-11-28T13:01:21.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4906d700 1 -- 172.21.15.82:0/2015864138 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f3e40001670 con 0x7f3e4415a0e0 2023-11-28T13:01:21.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4906d700 1 -- 172.21.15.82:0/2015864138 >> v1:172.21.15.82:6789/0 conn(0x7f3e4415a0e0 legacy=0x7f3e4415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:21.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4906d700 1 --2- 172.21.15.82:0/2015864138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e30003be0 0x7f3e30003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:21.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4906d700 1 --2- 172.21.15.82:0/2015864138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e30004870 0x7f3e30004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:21.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4906d700 1 --2- 172.21.15.82:0/2015864138 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e4406a420 0x7f3e30005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:21.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4906d700 1 -- 172.21.15.82:0/2015864138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4415eb50 con 0x7f3e30004870 2023-11-28T13:01:21.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4906d700 1 -- 172.21.15.82:0/2015864138 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3000bae0 con 0x7f3e30003be0 2023-11-28T13:01:21.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4906d700 1 -- 172.21.15.82:0/2015864138 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3000bc50 con 0x7f3e4406a420 2023-11-28T13:01:21.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4986e700 1 --2- 172.21.15.82:0/2015864138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e30004870 0x7f3e30004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:21.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4a06f700 1 --2- 172.21.15.82:0/2015864138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e30003be0 0x7f3e30003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:21.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.295+0000 7f3e4a870700 1 --2- 172.21.15.82:0/2015864138 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e4406a420 0x7f3e30005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:21.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.299+0000 7f3e4986e700 1 -- 172.21.15.82:0/2015864138 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e4406a420 msgr2=0x7f3e30005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:21.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.299+0000 7f3e4986e700 1 --2- 172.21.15.82:0/2015864138 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e4406a420 0x7f3e30005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:21.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.299+0000 7f3e4986e700 1 -- 172.21.15.82:0/2015864138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e30003be0 msgr2=0x7f3e30003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:21.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.299+0000 7f3e4986e700 1 --2- 172.21.15.82:0/2015864138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e30003be0 0x7f3e30003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:21.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.299+0000 7f3e4986e700 1 -- 172.21.15.82:0/2015864138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e300035d0 con 0x7f3e30004870 2023-11-28T13:01:21.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.299+0000 7f3e4986e700 1 --2- 172.21.15.82:0/2015864138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e30004870 0x7f3e30004ce0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009b70 tx=0x7f3e300058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c16a44034b44b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:21.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.299+0000 7f3e4906d700 1 -- 172.21.15.82:0/2015864138 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400e6c0 con 0x7f3e30004870 2023-11-28T13:01:21.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.299+0000 7f3e4906d700 1 -- 172.21.15.82:0/2015864138 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3400e820 con 0x7f3e30004870 2023-11-28T13:01:21.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.299+0000 7f3e4906d700 1 -- 172.21.15.82:0/2015864138 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400eb90 con 0x7f3e30004870 2023-11-28T13:01:21.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.299+0000 7f3e4b071700 1 -- 172.21.15.82:0/2015864138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e30004870 msgr2=0x7f3e30004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:21.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.299+0000 7f3e4b071700 1 --2- 172.21.15.82:0/2015864138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e30004870 0x7f3e30004ce0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009b70 tx=0x7f3e300058a0 comp rx=0 tx=0).stop 2023-11-28T13:01:21.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.299+0000 7f3e4a870700 1 -- 172.21.15.82:0/2015864138 reap_dead start 2023-11-28T13:01:21.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.299+0000 7f3e4b071700 1 -- 172.21.15.82:0/2015864138 shutdown_connections 2023-11-28T13:01:21.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.299+0000 7f3e4b071700 1 -- 172.21.15.82:0/2015864138 >> 172.21.15.82:0/2015864138 conn(0x7f3e440cc120 msgr2=0x7f3e440cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:21.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.299+0000 7f3e4b071700 1 -- 172.21.15.82:0/2015864138 shutdown_connections 2023-11-28T13:01:21.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.299+0000 7f3e4b071700 1 -- 172.21.15.82:0/2015864138 wait complete. 2023-11-28T13:01:21.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.299+0000 7f3e4b071700 1 Processor -- start 2023-11-28T13:01:21.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.299+0000 7f3e4b071700 1 -- start start 2023-11-28T13:01:21.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e4b071700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e30004870 0x7f3e44151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:21.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e4b071700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e441569a0 0x7f3e4415c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:21.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e4b071700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e4415cdf0 0x7f3e441f2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:21.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e4b071700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e440b35a0 con 0x7f3e441569a0 2023-11-28T13:01:21.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e4b071700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4415c420 con 0x7f3e4415cdf0 2023-11-28T13:01:21.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e4b071700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e440b32c0 con 0x7f3e30004870 2023-11-28T13:01:21.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e4986e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e441569a0 0x7f3e4415c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:21.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e4986e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e441569a0 0x7f3e4415c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33676/0 (socket says 172.21.15.82:33676) 2023-11-28T13:01:21.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e4986e700 1 -- 172.21.15.82:0/1968015034 learned_addr learned my addr 172.21.15.82:0/1968015034 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:21.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e4a06f700 1 --2- 172.21.15.82:0/1968015034 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e30004870 0x7f3e44151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:21.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e4a870700 1 --2- 172.21.15.82:0/1968015034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e4415cdf0 0x7f3e441f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:21.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e4986e700 1 -- 172.21.15.82:0/1968015034 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e30004870 msgr2=0x7f3e44151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:21.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e4986e700 1 --2- 172.21.15.82:0/1968015034 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e30004870 0x7f3e44151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:21.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e4986e700 1 -- 172.21.15.82:0/1968015034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e4415cdf0 msgr2=0x7f3e441f2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:21.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e4986e700 1 --2- 172.21.15.82:0/1968015034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e4415cdf0 0x7f3e441f2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:21.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e4986e700 1 -- 172.21.15.82:0/1968015034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4415dc40 con 0x7f3e441569a0 2023-11-28T13:01:21.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e4986e700 1 --2- 172.21.15.82:0/1968015034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e441569a0 0x7f3e4415c8b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3e30004780 tx=0x7f3e340047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:21.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e3affd700 1 -- 172.21.15.82:0/1968015034 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400e6c0 con 0x7f3e441569a0 2023-11-28T13:01:21.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e3affd700 1 -- 172.21.15.82:0/1968015034 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e34013d80 con 0x7f3e441569a0 2023-11-28T13:01:21.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e4b071700 1 -- 172.21.15.82:0/1968015034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4406ac70 con 0x7f3e441569a0 2023-11-28T13:01:21.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e3affd700 1 -- 172.21.15.82:0/1968015034 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34028690 con 0x7f3e441569a0 2023-11-28T13:01:21.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e4b071700 1 -- 172.21.15.82:0/1968015034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e44143cc0 con 0x7f3e441569a0 2023-11-28T13:01:21.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.303+0000 7f3e4b071700 1 -- 172.21.15.82:0/1968015034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4415bc30 con 0x7f3e441569a0 2023-11-28T13:01:21.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.307+0000 7f3e3affd700 1 -- 172.21.15.82:0/1968015034 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3e34025070 con 0x7f3e441569a0 2023-11-28T13:01:21.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.307+0000 7f3e3affd700 1 --2- 172.21.15.82:0/1968015034 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3e28064f10 0x7f3e280673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:21.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.307+0000 7f3e3affd700 1 -- 172.21.15.82:0/1968015034 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f3e34083490 con 0x7f3e441569a0 2023-11-28T13:01:21.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.307+0000 7f3e4a06f700 1 --2- 172.21.15.82:0/1968015034 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3e28064f10 0x7f3e280673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:21.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.307+0000 7f3e4a06f700 1 --2- 172.21.15.82:0/1968015034 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3e28064f10 0x7f3e280673c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3e40001050 tx=0x7f3e40008db0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:21.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.315+0000 7f3e3affd700 1 -- 172.21.15.82:0/1968015034 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3e4415bc30 con 0x7f3e441569a0 2023-11-28T13:01:21.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:21.495+0000 7f3e4b071700 1 -- 172.21.15.82:0/1968015034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3e4415bc30 con 0x7f3e441569a0 2023-11-28T13:01:22.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.167+0000 7f3e3affd700 1 -- 172.21.15.82:0/1968015034 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3e4415bc30 con 0x7f3e441569a0 2023-11-28T13:01:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.175+0000 7f3e4b071700 1 -- 172.21.15.82:0/1968015034 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3e28064f10 msgr2=0x7f3e280673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:22.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.175+0000 7f3e4b071700 1 --2- 172.21.15.82:0/1968015034 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3e28064f10 0x7f3e280673c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3e40001050 tx=0x7f3e40008db0 comp rx=0 tx=0).stop 2023-11-28T13:01:22.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.175+0000 7f3e4b071700 1 -- 172.21.15.82:0/1968015034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e441569a0 msgr2=0x7f3e4415c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:22.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.175+0000 7f3e4b071700 1 --2- 172.21.15.82:0/1968015034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e441569a0 0x7f3e4415c8b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3e30004780 tx=0x7f3e340047e0 comp rx=0 tx=0).stop 2023-11-28T13:01:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.175+0000 7f3e4b071700 1 -- 172.21.15.82:0/1968015034 shutdown_connections 2023-11-28T13:01:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.175+0000 7f3e4b071700 1 --2- 172.21.15.82:0/1968015034 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3e28064f10 0x7f3e280673c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.175+0000 7f3e4b071700 1 --2- 172.21.15.82:0/1968015034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e4415cdf0 0x7f3e441f2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.175+0000 7f3e4b071700 1 --2- 172.21.15.82:0/1968015034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e441569a0 0x7f3e4415c8b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.175+0000 7f3e4b071700 1 --2- 172.21.15.82:0/1968015034 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e30004870 0x7f3e44151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.175+0000 7f3e4b071700 1 -- 172.21.15.82:0/1968015034 >> 172.21.15.82:0/1968015034 conn(0x7f3e440cc120 msgr2=0x7f3e44070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.175+0000 7f3e4b071700 1 -- 172.21.15.82:0/1968015034 shutdown_connections 2023-11-28T13:01:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.175+0000 7f3e4b071700 1 -- 172.21.15.82:0/1968015034 wait complete. 2023-11-28T13:01:22.184 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2023-11-28T13:01:22.196 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T13:01:22.196 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T13:01:22.197 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T13:01:22.197 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:01:22.198 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T13:01:22.198 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T13:01:22.198 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T13:01:22.198 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:01:22.198 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T13:01:22.198 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T13:01:22.198 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T13:01:22.199 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:01:22.199 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T13:01:22.199 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T13:01:22.199 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T13:01:22.199 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:01:22.209 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T13:01:22.209 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T13:01:22.210 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T13:01:22.210 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T13:01:22.211 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T13:01:22.211 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T13:01:22.213 INFO:tasks.ceph.mds.b:Started 2023-11-28T13:01:22.214 DEBUG:teuthology.parallel:result is None 2023-11-28T13:01:22.214 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T13:01:22.215 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T13:01:22.216 INFO:tasks.ceph.mds.d:Started 2023-11-28T13:01:22.217 DEBUG:teuthology.parallel:result is None 2023-11-28T13:01:22.252 INFO:tasks.ceph.mds.a:Started 2023-11-28T13:01:22.252 DEBUG:teuthology.parallel:result is None 2023-11-28T13:01:22.253 INFO:tasks.ceph.mds.c:Started 2023-11-28T13:01:22.253 DEBUG:teuthology.parallel:result is None 2023-11-28T13:01:22.253 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T13:01:22.276 INFO:tasks.ceph.mds.b.smithi114.stdout:starting mds.b at 2023-11-28T13:01:22.282 INFO:tasks.ceph.mds.d.smithi114.stdout:starting mds.d at 2023-11-28T13:01:22.334 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-11-28T13:01:22.344 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-11-28T13:01:22.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.375+0000 7f5cfcae4700 1 Processor -- start 2023-11-28T13:01:22.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.375+0000 7f5cfcae4700 1 -- start start 2023-11-28T13:01:22.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.375+0000 7f5cfcae4700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5cf8070900 0x7f5cf815cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:22.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.375+0000 7f5cfcae4700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf80cc520 con 0x7f5cf8070cd0 2023-11-28T13:01:22.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.375+0000 7f5cfcae4700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf8159b00 con 0x7f5cf8158f90 2023-11-28T13:01:22.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.375+0000 7f5cfcae4700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf8159820 con 0x7f5cf8070900 2023-11-28T13:01:22.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.375+0000 7f5cf77fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5cf8070900 0x7f5cf815cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:22.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.375+0000 7f5cf6ffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5cf8070cd0 0x7f5cf8158880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45878/0 (socket says 172.21.15.82:45878) 2023-11-28T13:01:22.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.375+0000 7f5cf6ffd700 1 -- 172.21.15.82:0/2109546862 learned_addr learned my addr 172.21.15.82:0/2109546862 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:22.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.375+0000 7f5cf77fe700 1 -- 172.21.15.82:0/2109546862 >> v1:172.21.15.114:6789/0 conn(0x7f5cf8158f90 legacy=0x7f5cf806c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:22.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.375+0000 7f5cf67fc700 1 -- 172.21.15.82:0/2109546862 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529864463 0 0) 0x7f5cf80cc520 con 0x7f5cf8070cd0 2023-11-28T13:01:22.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.375+0000 7f5cf77fe700 1 -- 172.21.15.82:0/2109546862 >> v1:172.21.15.82:6789/0 conn(0x7f5cf8070cd0 legacy=0x7f5cf8158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:22.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.375+0000 7f5cf77fe700 1 -- 172.21.15.82:0/2109546862 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf815c220 con 0x7f5cf8070900 2023-11-28T13:01:22.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.375+0000 7f5cf77fe700 1 --2- 172.21.15.82:0/2109546862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cf8070900 0x7f5cf815cd00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009850 tx=0x7f5ce8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61bf1e5b0e00a99 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:22.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.375+0000 7f5cf67fc700 1 -- 172.21.15.82:0/2109546862 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8011830 con 0x7f5cf8070900 2023-11-28T13:01:22.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.375+0000 7f5cf67fc700 1 -- 172.21.15.82:0/2109546862 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce8011990 con 0x7f5cf8070900 2023-11-28T13:01:22.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.375+0000 7f5cf67fc700 1 -- 172.21.15.82:0/2109546862 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8011d20 con 0x7f5cf8070900 2023-11-28T13:01:22.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cfcae4700 1 -- 172.21.15.82:0/2109546862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cf8070900 msgr2=0x7f5cf815cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:22.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cfcae4700 1 --2- 172.21.15.82:0/2109546862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cf8070900 0x7f5cf815cd00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009850 tx=0x7f5ce8009b60 comp rx=0 tx=0).stop 2023-11-28T13:01:22.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cfcae4700 1 -- 172.21.15.82:0/2109546862 shutdown_connections 2023-11-28T13:01:22.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cfcae4700 1 --2- 172.21.15.82:0/2109546862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cf8070900 0x7f5cf815cd00 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:22.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cfcae4700 1 -- 172.21.15.82:0/2109546862 >> 172.21.15.82:0/2109546862 conn(0x7f5cf80cbd10 msgr2=0x7f5cf80ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:22.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cfcae4700 1 -- 172.21.15.82:0/2109546862 shutdown_connections 2023-11-28T13:01:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cfcae4700 1 -- 172.21.15.82:0/2109546862 wait complete. 2023-11-28T13:01:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cfcae4700 1 Processor -- start 2023-11-28T13:01:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cfcae4700 1 -- start start 2023-11-28T13:01:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cfcae4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cf8070900 0x7f5cf814e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cfcae4700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5cf8070cd0 0x7f5cf80b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cfcae4700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cf8158f90 0x7f5cf80cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cfcae4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80b3a70 con 0x7f5cf8070900 2023-11-28T13:01:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cfcae4700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80b2e60 con 0x7f5cf8158f90 2023-11-28T13:01:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cfcae4700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80b3140 con 0x7f5cf8070cd0 2023-11-28T13:01:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cf77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cf8070900 0x7f5cf814e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cf77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cf8070900 0x7f5cf814e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33724/0 (socket says 172.21.15.82:33724) 2023-11-28T13:01:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cf77fe700 1 -- 172.21.15.82:0/1746761834 learned_addr learned my addr 172.21.15.82:0/1746761834 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cf6ffd700 1 --2- 172.21.15.82:0/1746761834 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5cf8070cd0 0x7f5cf80b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cf7fff700 1 --2- 172.21.15.82:0/1746761834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cf8158f90 0x7f5cf80cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cf77fe700 1 -- 172.21.15.82:0/1746761834 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5cf8070cd0 msgr2=0x7f5cf80b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cf77fe700 1 --2- 172.21.15.82:0/1746761834 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5cf8070cd0 0x7f5cf80b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cf77fe700 1 -- 172.21.15.82:0/1746761834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cf8158f90 msgr2=0x7f5cf80cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cf77fe700 1 --2- 172.21.15.82:0/1746761834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cf8158f90 0x7f5cf80cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cf77fe700 1 -- 172.21.15.82:0/1746761834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce80094b0 con 0x7f5cf8070900 2023-11-28T13:01:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cf6ffd700 1 --2- 172.21.15.82:0/1746761834 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5cf8070cd0 0x7f5cf80b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.379+0000 7f5cf7fff700 1 --2- 172.21.15.82:0/1746761834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cf8158f90 0x7f5cf80cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.383+0000 7f5cf77fe700 1 --2- 172.21.15.82:0/1746761834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cf8070900 0x7f5cf814e420 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80090b0 tx=0x7f5ce8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.383+0000 7f5ceffff700 1 -- 172.21.15.82:0/1746761834 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce800bc10 con 0x7f5cf8070900 2023-11-28T13:01:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.383+0000 7f5ceffff700 1 -- 172.21.15.82:0/1746761834 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce801f070 con 0x7f5cf8070900 2023-11-28T13:01:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.383+0000 7f5cfcae4700 1 -- 172.21.15.82:0/1746761834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf815c7e0 con 0x7f5cf8070900 2023-11-28T13:01:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.383+0000 7f5ceffff700 1 -- 172.21.15.82:0/1746761834 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce801a430 con 0x7f5cf8070900 2023-11-28T13:01:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.383+0000 7f5cfcae4700 1 -- 172.21.15.82:0/1746761834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf815c500 con 0x7f5cf8070900 2023-11-28T13:01:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.383+0000 7f5cfcae4700 1 -- 172.21.15.82:0/1746761834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf8071170 con 0x7f5cf8070900 2023-11-28T13:01:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.383+0000 7f5ceffff700 1 -- 172.21.15.82:0/1746761834 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5ce800f050 con 0x7f5cf8070900 2023-11-28T13:01:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.383+0000 7f5ceffff700 1 --2- 172.21.15.82:0/1746761834 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5cd8064ee0 0x7f5cd8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.383+0000 7f5ceffff700 1 -- 172.21.15.82:0/1746761834 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5ce8021070 con 0x7f5cf8070900 2023-11-28T13:01:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.383+0000 7f5cf6ffd700 1 --2- 172.21.15.82:0/1746761834 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5cd8064ee0 0x7f5cd8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.383+0000 7f5cf6ffd700 1 --2- 172.21.15.82:0/1746761834 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5cd8064ee0 0x7f5cd8067390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80b4470 tx=0x7f5ce0007d00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:22.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.391+0000 7f5ceffff700 1 -- 172.21.15.82:0/1746761834 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5ce8051870 con 0x7f5cf8070900 2023-11-28T13:01:22.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:22.559+0000 7f5cfcae4700 1 -- 172.21.15.82:0/1746761834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5cf8065fc0 con 0x7f5cf8070900 2023-11-28T13:01:23.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.367+0000 7f5ceffff700 1 -- 172.21.15.82:0/1746761834 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5ce8054e90 con 0x7f5cf8070900 2023-11-28T13:01:23.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.371+0000 7f5cfcae4700 1 -- 172.21.15.82:0/1746761834 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5cd8064ee0 msgr2=0x7f5cd8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:23.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.371+0000 7f5cfcae4700 1 --2- 172.21.15.82:0/1746761834 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5cd8064ee0 0x7f5cd8067390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80b4470 tx=0x7f5ce0007d00 comp rx=0 tx=0).stop 2023-11-28T13:01:23.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.371+0000 7f5cfcae4700 1 -- 172.21.15.82:0/1746761834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cf8070900 msgr2=0x7f5cf814e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:23.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.371+0000 7f5cfcae4700 1 --2- 172.21.15.82:0/1746761834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cf8070900 0x7f5cf814e420 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80090b0 tx=0x7f5ce8004770 comp rx=0 tx=0).stop 2023-11-28T13:01:23.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.371+0000 7f5cfcae4700 1 -- 172.21.15.82:0/1746761834 shutdown_connections 2023-11-28T13:01:23.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.371+0000 7f5cfcae4700 1 --2- 172.21.15.82:0/1746761834 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5cd8064ee0 0x7f5cd8067390 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:23.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.371+0000 7f5cfcae4700 1 --2- 172.21.15.82:0/1746761834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cf8158f90 0x7f5cf80cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:23.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.371+0000 7f5cfcae4700 1 --2- 172.21.15.82:0/1746761834 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5cf8070cd0 0x7f5cf80b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:23.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.371+0000 7f5cfcae4700 1 --2- 172.21.15.82:0/1746761834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cf8070900 0x7f5cf814e420 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:23.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.371+0000 7f5cfcae4700 1 -- 172.21.15.82:0/1746761834 >> 172.21.15.82:0/1746761834 conn(0x7f5cf80cbd10 msgr2=0x7f5cf8159d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:23.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.371+0000 7f5cfcae4700 1 -- 172.21.15.82:0/1746761834 shutdown_connections 2023-11-28T13:01:23.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.371+0000 7f5cfcae4700 1 -- 172.21.15.82:0/1746761834 wait complete. 2023-11-28T13:01:23.378 INFO:teuthology.orchestra.run.smithi082.stderr: removed all blocklist entries 2023-11-28T13:01:23.391 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T13:01:23.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.507+0000 7fd388dca700 1 Processor -- start 2023-11-28T13:01:23.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.507+0000 7fd388dca700 1 -- start start 2023-11-28T13:01:23.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.507+0000 7fd388dca700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd384070070 0x7fd3840704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:23.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.507+0000 7fd388dca700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd38406c480 con 0x7fd38406b0a0 2023-11-28T13:01:23.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.507+0000 7fd388dca700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3840709f0 con 0x7fd3840b3910 2023-11-28T13:01:23.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.507+0000 7fd388dca700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38406dbe0 con 0x7fd384070070 2023-11-28T13:01:23.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd37affd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd38406b0a0 0x7fd38406d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45888/0 (socket says 172.21.15.82:45888) 2023-11-28T13:01:23.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd37affd700 1 -- 172.21.15.82:0/3477584967 learned_addr learned my addr 172.21.15.82:0/3477584967 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:23.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd383fff700 1 --2- 172.21.15.82:0/3477584967 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd384070070 0x7fd3840704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:23.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd382ffd700 1 -- 172.21.15.82:0/3477584967 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242924532 0 0) 0x7fd38406c480 con 0x7fd38406b0a0 2023-11-28T13:01:23.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd382ffd700 1 -- 172.21.15.82:0/3477584967 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3700035d0 con 0x7fd38406b0a0 2023-11-28T13:01:23.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd382ffd700 1 -- 172.21.15.82:0/3477584967 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2785967885 0 0) 0x7fd3700035d0 con 0x7fd38406b0a0 2023-11-28T13:01:23.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd382ffd700 1 -- 172.21.15.82:0/3477584967 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd384070070 msgr2=0x7fd3840704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:23.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd382ffd700 1 --2- 172.21.15.82:0/3477584967 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd384070070 0x7fd3840704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:23.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd382ffd700 1 -- 172.21.15.82:0/3477584967 >> v1:172.21.15.114:6789/0 conn(0x7fd3840b3910 legacy=0x7fd38406c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:23.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd382ffd700 1 -- 172.21.15.82:0/3477584967 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38406dec0 con 0x7fd38406b0a0 2023-11-28T13:01:23.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd382ffd700 1 -- 172.21.15.82:0/3477584967 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7fd36c001670 con 0x7fd38406b0a0 2023-11-28T13:01:23.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd382ffd700 1 -- 172.21.15.82:0/3477584967 >> v1:172.21.15.82:6789/0 conn(0x7fd38406b0a0 legacy=0x7fd38406d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:23.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd382ffd700 1 --2- 172.21.15.82:0/3477584967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd370003a50 0x7fd370003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:23.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd382ffd700 1 --2- 172.21.15.82:0/3477584967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3700043f0 0x7fd3700048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:23.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd382ffd700 1 --2- 172.21.15.82:0/3477584967 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd384070070 0x7fd370005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:23.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd382ffd700 1 -- 172.21.15.82:0/3477584967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38406dbe0 con 0x7fd3700043f0 2023-11-28T13:01:23.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd382ffd700 1 -- 172.21.15.82:0/3477584967 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37000ba30 con 0x7fd370003a50 2023-11-28T13:01:23.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd382ffd700 1 -- 172.21.15.82:0/3477584967 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37000bbc0 con 0x7fd384070070 2023-11-28T13:01:23.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd37affd700 1 --2- 172.21.15.82:0/3477584967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3700043f0 0x7fd3700048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:23.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd383fff700 1 --2- 172.21.15.82:0/3477584967 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd384070070 0x7fd370005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:23.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd3837fe700 1 --2- 172.21.15.82:0/3477584967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd370003a50 0x7fd370003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:23.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd37affd700 1 -- 172.21.15.82:0/3477584967 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd384070070 msgr2=0x7fd370005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:23.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd37affd700 1 --2- 172.21.15.82:0/3477584967 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd384070070 0x7fd370005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:23.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd37affd700 1 -- 172.21.15.82:0/3477584967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd370003a50 msgr2=0x7fd370003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:23.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd37affd700 1 --2- 172.21.15.82:0/3477584967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd370003a50 0x7fd370003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:23.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd37affd700 1 -- 172.21.15.82:0/3477584967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3700035d0 con 0x7fd3700043f0 2023-11-28T13:01:23.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd37affd700 1 --2- 172.21.15.82:0/3477584967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3700043f0 0x7fd3700048b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00c2f0 tx=0x7fd3700058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8f18ec5920a92 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:23.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd382ffd700 1 -- 172.21.15.82:0/3477584967 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c00ce30 con 0x7fd3700043f0 2023-11-28T13:01:23.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd382ffd700 1 -- 172.21.15.82:0/3477584967 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c005980 con 0x7fd3700043f0 2023-11-28T13:01:23.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd382ffd700 1 -- 172.21.15.82:0/3477584967 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c005d10 con 0x7fd3700043f0 2023-11-28T13:01:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd388dca700 1 -- 172.21.15.82:0/3477584967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3700043f0 msgr2=0x7fd3700048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd388dca700 1 --2- 172.21.15.82:0/3477584967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3700043f0 0x7fd3700048b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00c2f0 tx=0x7fd3700058a0 comp rx=0 tx=0).stop 2023-11-28T13:01:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd383fff700 1 -- 172.21.15.82:0/3477584967 reap_dead start 2023-11-28T13:01:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd388dca700 1 -- 172.21.15.82:0/3477584967 shutdown_connections 2023-11-28T13:01:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd388dca700 1 -- 172.21.15.82:0/3477584967 >> 172.21.15.82:0/3477584967 conn(0x7fd3840ce600 msgr2=0x7fd3840ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd388dca700 1 -- 172.21.15.82:0/3477584967 shutdown_connections 2023-11-28T13:01:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.511+0000 7fd388dca700 1 -- 172.21.15.82:0/3477584967 wait complete. 2023-11-28T13:01:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd388dca700 1 Processor -- start 2023-11-28T13:01:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd388dca700 1 -- start start 2023-11-28T13:01:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd388dca700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3841f4a90 0x7fd3841f4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd388dca700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3840ab8b0 0x7fd3840abd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd388dca700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd3840c4540 0x7fd3840c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd388dca700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3840c4ef0 con 0x7fd3840ab8b0 2023-11-28T13:01:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd388dca700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3840b0e50 con 0x7fd3841f4a90 2023-11-28T13:01:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd388dca700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3840ac370 con 0x7fd3840c4540 2023-11-28T13:01:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd37affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3840ab8b0 0x7fd3840abd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd37affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3840ab8b0 0x7fd3840abd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33740/0 (socket says 172.21.15.82:33740) 2023-11-28T13:01:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd37affd700 1 -- 172.21.15.82:0/871441171 learned_addr learned my addr 172.21.15.82:0/871441171 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd3837fe700 1 --2- 172.21.15.82:0/871441171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3841f4a90 0x7fd3841f4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd383fff700 1 --2- 172.21.15.82:0/871441171 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd3840c4540 0x7fd3840c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd37affd700 1 -- 172.21.15.82:0/871441171 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd3840c4540 msgr2=0x7fd3840c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd37affd700 1 --2- 172.21.15.82:0/871441171 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd3840c4540 0x7fd3840c49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd37affd700 1 -- 172.21.15.82:0/871441171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3841f4a90 msgr2=0x7fd3841f4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd37affd700 1 --2- 172.21.15.82:0/871441171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3841f4a90 0x7fd3841f4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd37affd700 1 -- 172.21.15.82:0/871441171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3840c8f80 con 0x7fd3840ab8b0 2023-11-28T13:01:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd3837fe700 1 --2- 172.21.15.82:0/871441171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3841f4a90 0x7fd3841f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:01:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd383fff700 1 --2- 172.21.15.82:0/871441171 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd3840c4540 0x7fd3840c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:01:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd37affd700 1 --2- 172.21.15.82:0/871441171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3840ab8b0 0x7fd3840abd00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd36c011000 tx=0x7fd36c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:23.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd380ff9700 1 -- 172.21.15.82:0/871441171 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c001660 con 0x7fd3840ab8b0 2023-11-28T13:01:23.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd380ff9700 1 -- 172.21.15.82:0/871441171 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c0072e0 con 0x7fd3840ab8b0 2023-11-28T13:01:23.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd388dca700 1 -- 172.21.15.82:0/871441171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38406c110 con 0x7fd3840ab8b0 2023-11-28T13:01:23.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd380ff9700 1 -- 172.21.15.82:0/871441171 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c007690 con 0x7fd3840ab8b0 2023-11-28T13:01:23.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd388dca700 1 -- 172.21.15.82:0/871441171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3840b3ce0 con 0x7fd3840ab8b0 2023-11-28T13:01:23.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.515+0000 7fd388dca700 1 -- 172.21.15.82:0/871441171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd384065fc0 con 0x7fd3840ab8b0 2023-11-28T13:01:23.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.519+0000 7fd380ff9700 1 -- 172.21.15.82:0/871441171 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd36c02e070 con 0x7fd3840ab8b0 2023-11-28T13:01:23.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.519+0000 7fd380ff9700 1 --2- 172.21.15.82:0/871441171 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd364064f10 0x7fd3640673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:23.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.519+0000 7fd380ff9700 1 -- 172.21.15.82:0/871441171 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd36c082f70 con 0x7fd3840ab8b0 2023-11-28T13:01:23.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.519+0000 7fd3837fe700 1 --2- 172.21.15.82:0/871441171 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd364064f10 0x7fd3640673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:23.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.519+0000 7fd3837fe700 1 --2- 172.21.15.82:0/871441171 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd364064f10 0x7fd3640673c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd374007fd0 tx=0x7fd374001080 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:23.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.527+0000 7fd380ff9700 1 -- 172.21.15.82:0/871441171 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd36c0b3400 con 0x7fd3840ab8b0 2023-11-28T13:01:23.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.747+0000 7fd388dca700 1 -- 172.21.15.82:0/871441171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd3840c5390 con 0x7fd3840ab8b0 2023-11-28T13:01:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.747+0000 7fd380ff9700 1 -- 172.21.15.82:0/871441171 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fd36c0513e0 con 0x7fd3840ab8b0 2023-11-28T13:01:23.752 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:23.752 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:01:23.752 INFO:teuthology.orchestra.run.smithi082.stdout: "auth_dump": [ 2023-11-28T13:01:23.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.753 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.a", 2023-11-28T13:01:23.753 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlCdS5DxAA6mejkVFcUsLxQRj3VIVjiA==", 2023-11-28T13:01:23.753 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.753 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:01:23.753 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-11-28T13:01:23.753 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-11-28T13:01:23.753 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:01:23.753 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.753 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.b", 2023-11-28T13:01:23.753 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVls/voFhAAwSFuDQwvvCr9AWGJTcYVYA==", 2023-11-28T13:01:23.754 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.754 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:01:23.754 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-11-28T13:01:23.754 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-11-28T13:01:23.754 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:01:23.754 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.754 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.c", 2023-11-28T13:01:23.754 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVltTgvExAA5x6bGq3lWvWbwnvFAHNIHQ==", 2023-11-28T13:01:23.754 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.754 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:01:23.755 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-11-28T13:01:23.755 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-11-28T13:01:23.755 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:01:23.755 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.755 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.d", 2023-11-28T13:01:23.755 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlT4ecGhAA/S/lIx6fXgbKUmDq6TXAag==", 2023-11-28T13:01:23.755 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.755 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:01:23.755 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-11-28T13:01:23.755 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-11-28T13:01:23.755 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:01:23.756 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.756 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.0", 2023-11-28T13:01:23.756 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAz5GVlMpQBERAAim3Dp31FdCvBHZRLRmpUEA==", 2023-11-28T13:01:23.756 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.756 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:01:23.756 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:01:23.756 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:01:23.756 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.756 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.1", 2023-11-28T13:01:23.757 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA25GVlbynJJhAAVPGWlzi2gCbAx8A2CtTDew==", 2023-11-28T13:01:23.757 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.757 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:01:23.757 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:01:23.757 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:01:23.757 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.757 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.2", 2023-11-28T13:01:23.757 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA55GVl8le5OBAA6KTsYliyG4l1fqTHluWUgA==", 2023-11-28T13:01:23.757 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.757 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:01:23.757 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:01:23.758 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:01:23.758 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.758 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.3", 2023-11-28T13:01:23.758 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA95GVlupEwAxAAb2UOrNbiicmvMKlJkWrwVA==", 2023-11-28T13:01:23.758 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.758 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:01:23.758 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:01:23.758 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:01:23.758 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.759 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.4", 2023-11-28T13:01:23.759 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBC5GVlXgk5KhAAUhkPiT909nUDc/DQ2uITYQ==", 2023-11-28T13:01:23.759 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.759 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:01:23.759 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:01:23.759 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:01:23.759 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.759 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.5", 2023-11-28T13:01:23.759 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBG5GVloYsaBBAAn1PYxCBVxsjA6Mmq/cnUrQ==", 2023-11-28T13:01:23.759 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.760 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:01:23.760 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:01:23.760 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:01:23.760 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.760 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.6", 2023-11-28T13:01:23.760 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBJ5GVljJcAFhAAVy/GB5HhhbKfmXji0e+7sw==", 2023-11-28T13:01:23.760 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.760 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:01:23.760 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:01:23.760 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:01:23.760 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.761 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.7", 2023-11-28T13:01:23.761 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBM5GVlNcBbHhAAvMcutUUBiQEgLHGFK4Nb7Q==", 2023-11-28T13:01:23.761 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.761 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:01:23.761 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:01:23.761 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:01:23.761 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.761 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.0", 2023-11-28T13:01:23.761 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlK0wtHhAAALaA+R3pU9RtJq4wvijo3Q==", 2023-11-28T13:01:23.762 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.762 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:01:23.762 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-11-28T13:01:23.762 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-11-28T13:01:23.762 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-11-28T13:01:23.762 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.762 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.1", 2023-11-28T13:01:23.762 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlb19GJxAApBeChk0RMz7CTiIBPNn+kQ==", 2023-11-28T13:01:23.762 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.762 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:01:23.763 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-11-28T13:01:23.763 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-11-28T13:01:23.763 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-11-28T13:01:23.763 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.763 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.2", 2023-11-28T13:01:23.763 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlOosGJBAAO019e3SgRbOsmZWZdVihpA==", 2023-11-28T13:01:23.763 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.763 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:01:23.763 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-11-28T13:01:23.763 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-11-28T13:01:23.763 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-11-28T13:01:23.764 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.764 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.3", 2023-11-28T13:01:23.764 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlf59HKhAAvROZEH3qiOM8RLS2pgNGxw==", 2023-11-28T13:01:23.764 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.764 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:01:23.764 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-11-28T13:01:23.764 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-11-28T13:01:23.764 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-11-28T13:01:23.764 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.765 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.admin", 2023-11-28T13:01:23.765 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAv5GVlThU6NxAAKEg/veQS9Wg1PeZl3scbbQ==", 2023-11-28T13:01:23.765 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.765 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-11-28T13:01:23.765 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-11-28T13:01:23.765 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-11-28T13:01:23.765 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:01:23.765 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.765 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-mds", 2023-11-28T13:01:23.765 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBR5GVlLvCtMxAAOBzJ4f809GYRgU7+KzqJiA==", 2023-11-28T13:01:23.765 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.766 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-mds" 2023-11-28T13:01:23.766 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.766 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-mgr", 2023-11-28T13:01:23.766 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBR5GVl6gOuMxAAUcEDelxRpt8dc7686eIByg==", 2023-11-28T13:01:23.766 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.766 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-28T13:01:23.766 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.766 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-osd", 2023-11-28T13:01:23.767 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBR5GVlTROuMxAA7X8xRtFaG+21bUYAmE6Rgg==", 2023-11-28T13:01:23.767 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.767 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-osd" 2023-11-28T13:01:23.767 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.767 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-rbd", 2023-11-28T13:01:23.767 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBR5GVlQiKuMxAAkN0HYRIHEfMEcQivK+QyDg==", 2023-11-28T13:01:23.767 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.767 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-28T13:01:23.767 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.768 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-28T13:01:23.768 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBR5GVlpDGuMxAAb5M/NJgg2Av1faJnK7zRNg==", 2023-11-28T13:01:23.768 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.768 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-28T13:01:23.768 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.768 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-rgw", 2023-11-28T13:01:23.768 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBR5GVlokGuMxAA5MIj0HH+Q3cAnXutqn57dQ==", 2023-11-28T13:01:23.768 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.768 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-28T13:01:23.768 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.769 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.x", 2023-11-28T13:01:23.769 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlas3pCxAAHp82YHi3DweifxetdtSMQg==", 2023-11-28T13:01:23.769 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.769 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-11-28T13:01:23.769 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-11-28T13:01:23.769 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:01:23.769 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:23.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:23.769 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.y", 2023-11-28T13:01:23.769 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlpOu6CBAAlqY+m5+MrGgcRTUOT2+seQ==", 2023-11-28T13:01:23.770 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:01:23.770 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-11-28T13:01:23.770 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-11-28T13:01:23.770 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:01:23.770 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.770 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:23.770 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-11-28T13:01:23.770 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:01:23.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.751+0000 7fd388dca700 1 -- 172.21.15.82:0/871441171 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd364064f10 msgr2=0x7fd3640673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:23.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.751+0000 7fd388dca700 1 --2- 172.21.15.82:0/871441171 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd364064f10 0x7fd3640673c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd374007fd0 tx=0x7fd374001080 comp rx=0 tx=0).stop 2023-11-28T13:01:23.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.751+0000 7fd388dca700 1 -- 172.21.15.82:0/871441171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3840ab8b0 msgr2=0x7fd3840abd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:23.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.751+0000 7fd388dca700 1 --2- 172.21.15.82:0/871441171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3840ab8b0 0x7fd3840abd00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd36c011000 tx=0x7fd36c001a00 comp rx=0 tx=0).stop 2023-11-28T13:01:23.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.751+0000 7fd388dca700 1 -- 172.21.15.82:0/871441171 shutdown_connections 2023-11-28T13:01:23.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.751+0000 7fd388dca700 1 --2- 172.21.15.82:0/871441171 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd364064f10 0x7fd3640673c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:23.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.751+0000 7fd388dca700 1 --2- 172.21.15.82:0/871441171 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd3840c4540 0x7fd3840c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:23.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.751+0000 7fd388dca700 1 --2- 172.21.15.82:0/871441171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3840ab8b0 0x7fd3840abd00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:23.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.751+0000 7fd388dca700 1 --2- 172.21.15.82:0/871441171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3841f4a90 0x7fd3841f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:23.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.751+0000 7fd388dca700 1 -- 172.21.15.82:0/871441171 >> 172.21.15.82:0/871441171 conn(0x7fd3840ce600 msgr2=0x7fd3840b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:23.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.751+0000 7fd388dca700 1 -- 172.21.15.82:0/871441171 shutdown_connections 2023-11-28T13:01:23.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.751+0000 7fd388dca700 1 -- 172.21.15.82:0/871441171 wait complete. 2023-11-28T13:01:23.773 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-28T13:01:23.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.887+0000 7fd064eb6700 1 Processor -- start 2023-11-28T13:01:23.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.887+0000 7fd064eb6700 1 -- start start 2023-11-28T13:01:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd064eb6700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd060158f00 0x7fd06006b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd064eb6700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd06006c830 0x7fd06006cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd064eb6700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0600c9c30 con 0x7fd0600cac20 2023-11-28T13:01:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd064eb6700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06006d1c0 con 0x7fd06006c830 2023-11-28T13:01:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd064eb6700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06006ae20 con 0x7fd060158f00 2023-11-28T13:01:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd05ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd06006c830 0x7fd06006cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd05ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd06006c830 0x7fd06006cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33752/0 (socket says 172.21.15.82:33752) 2023-11-28T13:01:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd05ffff700 1 -- 172.21.15.82:0/3942434984 learned_addr learned my addr 172.21.15.82:0/3942434984 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd05f7fe700 1 --2- 172.21.15.82:0/3942434984 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd060158f00 0x7fd06006b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd05ffff700 1 -- 172.21.15.82:0/3942434984 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd060158f00 msgr2=0x7fd06006b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:23.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd05ffff700 1 --2- 172.21.15.82:0/3942434984 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd060158f00 0x7fd06006b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:23.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd05ffff700 1 -- 172.21.15.82:0/3942434984 >> v1:172.21.15.114:6789/0 conn(0x7fd0600cac20 legacy=0x7fd06006a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:23.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd05ffff700 1 -- 172.21.15.82:0/3942434984 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0600ca790 con 0x7fd06006c830 2023-11-28T13:01:23.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd05ffff700 1 --2- 172.21.15.82:0/3942434984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd06006c830 0x7fd06006cc80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd05800d150 tx=0x7fd05800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223791d1d3af0174 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:23.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd05effd700 1 -- 172.21.15.82:0/3942434984 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd058010070 con 0x7fd06006c830 2023-11-28T13:01:23.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd05effd700 1 -- 172.21.15.82:0/3942434984 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05800dd10 con 0x7fd06006c830 2023-11-28T13:01:23.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd05effd700 1 -- 172.21.15.82:0/3942434984 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05800b310 con 0x7fd06006c830 2023-11-28T13:01:23.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd064eb6700 1 -- 172.21.15.82:0/3942434984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd06006c830 msgr2=0x7fd06006cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:23.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd064eb6700 1 --2- 172.21.15.82:0/3942434984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd06006c830 0x7fd06006cc80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd05800d150 tx=0x7fd05800d460 comp rx=0 tx=0).stop 2023-11-28T13:01:23.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd064eb6700 1 -- 172.21.15.82:0/3942434984 shutdown_connections 2023-11-28T13:01:23.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd064eb6700 1 --2- 172.21.15.82:0/3942434984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd06006c830 0x7fd06006cc80 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:23.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd064eb6700 1 --2- 172.21.15.82:0/3942434984 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd060158f00 0x7fd06006b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:23.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd064eb6700 1 -- 172.21.15.82:0/3942434984 >> 172.21.15.82:0/3942434984 conn(0x7fd0600cb890 msgr2=0x7fd0600cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:23.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd064eb6700 1 -- 172.21.15.82:0/3942434984 shutdown_connections 2023-11-28T13:01:23.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.891+0000 7fd064eb6700 1 -- 172.21.15.82:0/3942434984 wait complete. 2023-11-28T13:01:23.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.895+0000 7fd064eb6700 1 Processor -- start 2023-11-28T13:01:23.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.895+0000 7fd064eb6700 1 -- start start 2023-11-28T13:01:23.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.895+0000 7fd064eb6700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd06006c830 0x7fd060148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:23.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.895+0000 7fd064eb6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0600cac20 0x7fd0600c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:23.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.895+0000 7fd064eb6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd060158f00 0x7fd0600c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:23.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.895+0000 7fd064eb6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600c81b0 con 0x7fd060158f00 2023-11-28T13:01:23.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.895+0000 7fd064eb6700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600c75a0 con 0x7fd0600cac20 2023-11-28T13:01:23.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.895+0000 7fd064eb6700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600c7880 con 0x7fd06006c830 2023-11-28T13:01:23.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.895+0000 7fd05ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd060158f00 0x7fd0600c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:23.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.895+0000 7fd05ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd060158f00 0x7fd0600c26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33766/0 (socket says 172.21.15.82:33766) 2023-11-28T13:01:23.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.895+0000 7fd05ffff700 1 -- 172.21.15.82:0/3811992188 learned_addr learned my addr 172.21.15.82:0/3811992188 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:23.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.895+0000 7fd05f7fe700 1 --2- 172.21.15.82:0/3811992188 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd06006c830 0x7fd060148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:23.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.895+0000 7fd056ffd700 1 --2- 172.21.15.82:0/3811992188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0600cac20 0x7fd0600c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:23.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.895+0000 7fd05ffff700 1 -- 172.21.15.82:0/3811992188 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd06006c830 msgr2=0x7fd060148830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:23.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.895+0000 7fd05ffff700 1 --2- 172.21.15.82:0/3811992188 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd06006c830 0x7fd060148830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:23.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.895+0000 7fd05ffff700 1 -- 172.21.15.82:0/3811992188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0600cac20 msgr2=0x7fd0600c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:23.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.895+0000 7fd05ffff700 1 --2- 172.21.15.82:0/3811992188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0600cac20 0x7fd0600c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:23.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.895+0000 7fd05ffff700 1 -- 172.21.15.82:0/3811992188 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05800bd40 con 0x7fd060158f00 2023-11-28T13:01:23.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.895+0000 7fd056ffd700 1 --2- 172.21.15.82:0/3811992188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0600cac20 0x7fd0600c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:23.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.895+0000 7fd05ffff700 1 --2- 172.21.15.82:0/3811992188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd060158f00 0x7fd0600c26a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd06006ff60 tx=0x7fd058004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:23.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.895+0000 7fd05cff9700 1 -- 172.21.15.82:0/3811992188 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd058009a10 con 0x7fd060158f00 2023-11-28T13:01:23.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.899+0000 7fd05cff9700 1 -- 172.21.15.82:0/3811992188 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd058009b70 con 0x7fd060158f00 2023-11-28T13:01:23.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.899+0000 7fd064eb6700 1 -- 172.21.15.82:0/3811992188 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0600c9e60 con 0x7fd060158f00 2023-11-28T13:01:23.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.899+0000 7fd05cff9700 1 -- 172.21.15.82:0/3811992188 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05800b4c0 con 0x7fd060158f00 2023-11-28T13:01:23.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.899+0000 7fd064eb6700 1 -- 172.21.15.82:0/3811992188 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0600cb070 con 0x7fd060158f00 2023-11-28T13:01:23.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.899+0000 7fd064eb6700 1 -- 172.21.15.82:0/3811992188 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0600ca140 con 0x7fd060158f00 2023-11-28T13:01:23.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.899+0000 7fd05cff9700 1 -- 172.21.15.82:0/3811992188 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd058004040 con 0x7fd060158f00 2023-11-28T13:01:23.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.899+0000 7fd05cff9700 1 --2- 172.21.15.82:0/3811992188 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd040064f10 0x7fd0400673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:23.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.899+0000 7fd05cff9700 1 -- 172.21.15.82:0/3811992188 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd058083f50 con 0x7fd060158f00 2023-11-28T13:01:23.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.899+0000 7fd05f7fe700 1 --2- 172.21.15.82:0/3811992188 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd040064f10 0x7fd0400673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:23.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.899+0000 7fd05f7fe700 1 --2- 172.21.15.82:0/3811992188 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd040064f10 0x7fd0400673c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd050009b50 tx=0x7fd050009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:23.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:23.907+0000 7fd05cff9700 1 -- 172.21.15.82:0/3811992188 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd058052370 con 0x7fd060158f00 2023-11-28T13:01:24.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.123+0000 7fd064eb6700 1 -- 172.21.15.82:0/3811992188 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fd060065fc0 con 0x7fd060158f00 2023-11-28T13:01:24.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.131+0000 7fd05cff9700 1 -- 172.21.15.82:0/3811992188 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd058055990 con 0x7fd060158f00 2023-11-28T13:01:24.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.135+0000 7fd064eb6700 1 -- 172.21.15.82:0/3811992188 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd040064f10 msgr2=0x7fd0400673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:24.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.135+0000 7fd064eb6700 1 --2- 172.21.15.82:0/3811992188 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd040064f10 0x7fd0400673c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd050009b50 tx=0x7fd050009240 comp rx=0 tx=0).stop 2023-11-28T13:01:24.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.135+0000 7fd064eb6700 1 -- 172.21.15.82:0/3811992188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd060158f00 msgr2=0x7fd0600c26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:24.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.135+0000 7fd064eb6700 1 --2- 172.21.15.82:0/3811992188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd060158f00 0x7fd0600c26a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd06006ff60 tx=0x7fd058004af0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.135+0000 7fd064eb6700 1 -- 172.21.15.82:0/3811992188 shutdown_connections 2023-11-28T13:01:24.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.135+0000 7fd064eb6700 1 --2- 172.21.15.82:0/3811992188 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd040064f10 0x7fd0400673c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.135+0000 7fd064eb6700 1 --2- 172.21.15.82:0/3811992188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd060158f00 0x7fd0600c26a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.135+0000 7fd064eb6700 1 --2- 172.21.15.82:0/3811992188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0600cac20 0x7fd0600c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.135+0000 7fd064eb6700 1 --2- 172.21.15.82:0/3811992188 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd06006c830 0x7fd060148830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.135+0000 7fd064eb6700 1 -- 172.21.15.82:0/3811992188 >> 172.21.15.82:0/3811992188 conn(0x7fd0600cb890 msgr2=0x7fd0600b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:24.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.135+0000 7fd064eb6700 1 -- 172.21.15.82:0/3811992188 shutdown_connections 2023-11-28T13:01:24.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.135+0000 7fd064eb6700 1 -- 172.21.15.82:0/3811992188 wait complete. 2023-11-28T13:01:24.158 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-28T13:01:24.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.263+0000 7fa452e48700 1 Processor -- start 2023-11-28T13:01:24.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.263+0000 7fa452e48700 1 -- start start 2023-11-28T13:01:24.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.263+0000 7fa452e48700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa44c0b3910 0x7fa44c06b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:24.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.263+0000 7fa452e48700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa44c06c910 0x7fa44c06d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:24.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.263+0000 7fa452e48700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44c06c480 con 0x7fa44c070070 2023-11-28T13:01:24.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.263+0000 7fa452e48700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44c06dbe0 con 0x7fa44c0b3910 2023-11-28T13:01:24.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.263+0000 7fa452e48700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c06dec0 con 0x7fa44c06c910 2023-11-28T13:01:24.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.263+0000 7fa452647700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa44c070070 0x7fa44c15db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45898/0 (socket says 172.21.15.82:45898) 2023-11-28T13:01:24.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.263+0000 7fa452647700 1 -- 172.21.15.82:0/235807315 learned_addr learned my addr 172.21.15.82:0/235807315 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:24.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.263+0000 7fa451645700 1 --2- 172.21.15.82:0/235807315 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa44c06c910 0x7fa44c06d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:24.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.263+0000 7fa451e46700 1 --2- 172.21.15.82:0/235807315 >> v2:172.21.15.114:3300/0 conn(0x7fa44c0b3910 0x7fa44c06b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:24.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.267+0000 7fa450e44700 1 -- 172.21.15.82:0/235807315 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4070506112 0 0) 0x7fa44c06c480 con 0x7fa44c070070 2023-11-28T13:01:24.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.267+0000 7fa450e44700 1 -- 172.21.15.82:0/235807315 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4340035d0 con 0x7fa44c070070 2023-11-28T13:01:24.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.267+0000 7fa451645700 1 -- 172.21.15.82:0/235807315 >> v2:172.21.15.114:3300/0 conn(0x7fa44c0b3910 msgr2=0x7fa44c06b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:24.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.267+0000 7fa451645700 1 --2- 172.21.15.82:0/235807315 >> v2:172.21.15.114:3300/0 conn(0x7fa44c0b3910 0x7fa44c06b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.267+0000 7fa451645700 1 -- 172.21.15.82:0/235807315 >> v1:172.21.15.82:6789/0 conn(0x7fa44c070070 legacy=0x7fa44c15db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:24.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.267+0000 7fa451645700 1 -- 172.21.15.82:0/235807315 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c06c110 con 0x7fa44c06c910 2023-11-28T13:01:24.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.267+0000 7fa451e46700 1 --2- 172.21.15.82:0/235807315 >> v2:172.21.15.114:3300/0 conn(0x7fa44c0b3910 0x7fa44c06b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:24.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.267+0000 7fa451645700 1 --2- 172.21.15.82:0/235807315 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa44c06c910 0x7fa44c06d320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009d90 tx=0x7fa43c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27c6efb1cc29c9e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:24.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.267+0000 7fa450e44700 1 -- 172.21.15.82:0/235807315 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c00e070 con 0x7fa44c06c910 2023-11-28T13:01:24.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.267+0000 7fa450e44700 1 -- 172.21.15.82:0/235807315 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c00bb20 con 0x7fa44c06c910 2023-11-28T13:01:24.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.267+0000 7fa450e44700 1 -- 172.21.15.82:0/235807315 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c00be90 con 0x7fa44c06c910 2023-11-28T13:01:24.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.267+0000 7fa452e48700 1 -- 172.21.15.82:0/235807315 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa44c06c910 msgr2=0x7fa44c06d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:24.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.267+0000 7fa452e48700 1 --2- 172.21.15.82:0/235807315 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa44c06c910 0x7fa44c06d320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009d90 tx=0x7fa43c00b330 comp rx=0 tx=0).stop 2023-11-28T13:01:24.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.267+0000 7fa452e48700 1 -- 172.21.15.82:0/235807315 shutdown_connections 2023-11-28T13:01:24.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.267+0000 7fa452e48700 1 --2- 172.21.15.82:0/235807315 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa44c06c910 0x7fa44c06d320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.267+0000 7fa452e48700 1 --2- 172.21.15.82:0/235807315 >> v2:172.21.15.114:3300/0 conn(0x7fa44c0b3910 0x7fa44c06b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.267+0000 7fa452e48700 1 -- 172.21.15.82:0/235807315 >> 172.21.15.82:0/235807315 conn(0x7fa44c0ce600 msgr2=0x7fa44c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:24.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.267+0000 7fa452e48700 1 -- 172.21.15.82:0/235807315 shutdown_connections 2023-11-28T13:01:24.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.267+0000 7fa452e48700 1 -- 172.21.15.82:0/235807315 wait complete. 2023-11-28T13:01:24.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.267+0000 7fa452e48700 1 Processor -- start 2023-11-28T13:01:24.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa452e48700 1 -- start start 2023-11-28T13:01:24.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa452e48700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa44c06c910 0x7fa44c148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:24.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa452e48700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa44c070070 0x7fa44c15a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:24.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa452e48700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa44c0b3910 0x7fa44c0c3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:24.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa452e48700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c148ff0 con 0x7fa44c070070 2023-11-28T13:01:24.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa452e48700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c149b40 con 0x7fa44c0b3910 2023-11-28T13:01:24.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa452e48700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c0b2fc0 con 0x7fa44c06c910 2023-11-28T13:01:24.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa451645700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa44c070070 0x7fa44c15a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:24.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa451645700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa44c070070 0x7fa44c15a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33782/0 (socket says 172.21.15.82:33782) 2023-11-28T13:01:24.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa451645700 1 -- 172.21.15.82:0/677294552 learned_addr learned my addr 172.21.15.82:0/677294552 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:24.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa451e46700 1 --2- 172.21.15.82:0/677294552 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa44c06c910 0x7fa44c148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:24.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa452647700 1 --2- 172.21.15.82:0/677294552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa44c0b3910 0x7fa44c0c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:24.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa451645700 1 -- 172.21.15.82:0/677294552 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa44c06c910 msgr2=0x7fa44c148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:24.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa451645700 1 --2- 172.21.15.82:0/677294552 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa44c06c910 0x7fa44c148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa451645700 1 -- 172.21.15.82:0/677294552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa44c0b3910 msgr2=0x7fa44c0c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:24.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa451645700 1 --2- 172.21.15.82:0/677294552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa44c0b3910 0x7fa44c0c3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa451645700 1 -- 172.21.15.82:0/677294552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4400094b0 con 0x7fa44c070070 2023-11-28T13:01:24.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa451645700 1 --2- 172.21.15.82:0/677294552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa44c070070 0x7fa44c15a820 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00b370 tx=0x7fa43c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:24.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa44a7fc700 1 -- 172.21.15.82:0/677294552 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c007000 con 0x7fa44c070070 2023-11-28T13:01:24.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa44a7fc700 1 -- 172.21.15.82:0/677294552 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c012840 con 0x7fa44c070070 2023-11-28T13:01:24.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa452e48700 1 -- 172.21.15.82:0/677294552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43c009a70 con 0x7fa44c070070 2023-11-28T13:01:24.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa44a7fc700 1 -- 172.21.15.82:0/677294552 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c012bf0 con 0x7fa44c070070 2023-11-28T13:01:24.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.271+0000 7fa452e48700 1 -- 172.21.15.82:0/677294552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa44c06d860 con 0x7fa44c070070 2023-11-28T13:01:24.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.275+0000 7fa452e48700 1 -- 172.21.15.82:0/677294552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44c0c8f80 con 0x7fa44c070070 2023-11-28T13:01:24.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.275+0000 7fa44a7fc700 1 -- 172.21.15.82:0/677294552 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa43c012d50 con 0x7fa44c070070 2023-11-28T13:01:24.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.275+0000 7fa44a7fc700 1 --2- 172.21.15.82:0/677294552 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa438064ee0 0x7fa438067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.275+0000 7fa44a7fc700 1 -- 172.21.15.82:0/677294552 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa43c0843d0 con 0x7fa44c070070 2023-11-28T13:01:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.275+0000 7fa451e46700 1 --2- 172.21.15.82:0/677294552 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa438064ee0 0x7fa438067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.275+0000 7fa451e46700 1 --2- 172.21.15.82:0/677294552 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa438064ee0 0x7fa438067390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa440009d10 tx=0x7fa440008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:24.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.283+0000 7fa44a7fc700 1 -- 172.21.15.82:0/677294552 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa43c0527d0 con 0x7fa44c070070 2023-11-28T13:01:24.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.507+0000 7fa452e48700 1 -- 172.21.15.82:0/677294552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fa44c0b3ce0 con 0x7fa44c070070 2023-11-28T13:01:24.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.515+0000 7fa44a7fc700 1 -- 172.21.15.82:0/677294552 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa43c055df0 con 0x7fa44c070070 2023-11-28T13:01:24.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.519+0000 7fa452e48700 1 -- 172.21.15.82:0/677294552 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa438064ee0 msgr2=0x7fa438067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:24.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.519+0000 7fa452e48700 1 --2- 172.21.15.82:0/677294552 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa438064ee0 0x7fa438067390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa440009d10 tx=0x7fa440008040 comp rx=0 tx=0).stop 2023-11-28T13:01:24.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.519+0000 7fa452e48700 1 -- 172.21.15.82:0/677294552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa44c070070 msgr2=0x7fa44c15a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:24.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.519+0000 7fa452e48700 1 --2- 172.21.15.82:0/677294552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa44c070070 0x7fa44c15a820 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00b370 tx=0x7fa43c004af0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.519+0000 7fa452e48700 1 -- 172.21.15.82:0/677294552 shutdown_connections 2023-11-28T13:01:24.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.519+0000 7fa452e48700 1 --2- 172.21.15.82:0/677294552 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa438064ee0 0x7fa438067390 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.519+0000 7fa452e48700 1 --2- 172.21.15.82:0/677294552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa44c0b3910 0x7fa44c0c3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.519+0000 7fa452e48700 1 --2- 172.21.15.82:0/677294552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa44c070070 0x7fa44c15a820 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.519+0000 7fa452e48700 1 --2- 172.21.15.82:0/677294552 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa44c06c910 0x7fa44c148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.519+0000 7fa452e48700 1 -- 172.21.15.82:0/677294552 >> 172.21.15.82:0/677294552 conn(0x7fa44c0ce600 msgr2=0x7fa44c0b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:24.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.519+0000 7fa452e48700 1 -- 172.21.15.82:0/677294552 shutdown_connections 2023-11-28T13:01:24.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.519+0000 7fa452e48700 1 -- 172.21.15.82:0/677294552 wait complete. 2023-11-28T13:01:24.537 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-28T13:01:24.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d909fd700 1 Processor -- start 2023-11-28T13:01:24.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d909fd700 1 -- start start 2023-11-28T13:01:24.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d909fd700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4d8c1586f0 0x7f4d8c15c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:24.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d909fd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4d8c0c8c50 0x7f4d8c06d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:24.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d909fd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8c06c3b0 con 0x7f4d8c070900 2023-11-28T13:01:24.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d909fd700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8c15c8b0 con 0x7f4d8c0c8c50 2023-11-28T13:01:24.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d909fd700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c15cb90 con 0x7f4d8c1586f0 2023-11-28T13:01:24.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d8bfff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4d8c070900 0x7f4d8c06c840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45904/0 (socket says 172.21.15.82:45904) 2023-11-28T13:01:24.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d8bfff700 1 -- 172.21.15.82:0/1027895186 learned_addr learned my addr 172.21.15.82:0/1027895186 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:24.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d8affd700 1 --2- 172.21.15.82:0/1027895186 >> v2:172.21.15.114:3300/0 conn(0x7f4d8c0c8c50 0x7f4d8c06d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:24.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d8b7fe700 1 --2- 172.21.15.82:0/1027895186 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4d8c1586f0 0x7f4d8c15c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:24.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d8a7fc700 1 -- 172.21.15.82:0/1027895186 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647474047 0 0) 0x7f4d8c06c3b0 con 0x7f4d8c070900 2023-11-28T13:01:24.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d8a7fc700 1 -- 172.21.15.82:0/1027895186 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d740034f0 con 0x7f4d8c070900 2023-11-28T13:01:24.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d8a7fc700 1 -- 172.21.15.82:0/1027895186 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3973561384 0 0) 0x7f4d740034f0 con 0x7f4d8c070900 2023-11-28T13:01:24.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d8a7fc700 1 -- 172.21.15.82:0/1027895186 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4d8c1586f0 msgr2=0x7f4d8c15c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:24.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d8a7fc700 1 --2- 172.21.15.82:0/1027895186 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4d8c1586f0 0x7f4d8c15c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d8a7fc700 1 -- 172.21.15.82:0/1027895186 >> v2:172.21.15.114:3300/0 conn(0x7f4d8c0c8c50 msgr2=0x7f4d8c06d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:24.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d8a7fc700 1 --2- 172.21.15.82:0/1027895186 >> v2:172.21.15.114:3300/0 conn(0x7f4d8c0c8c50 0x7f4d8c06d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d8a7fc700 1 -- 172.21.15.82:0/1027895186 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c15ce70 con 0x7f4d8c070900 2023-11-28T13:01:24.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d8a7fc700 1 -- 172.21.15.82:0/1027895186 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f4d84001670 con 0x7f4d8c070900 2023-11-28T13:01:24.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d8a7fc700 1 -- 172.21.15.82:0/1027895186 >> v1:172.21.15.82:6789/0 conn(0x7f4d8c070900 legacy=0x7f4d8c06c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:24.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.655+0000 7f4d8a7fc700 1 --2- 172.21.15.82:0/1027895186 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4d8c1586f0 0x7f4d74003b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:24.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d8a7fc700 1 --2- 172.21.15.82:0/1027895186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d74004090 0x7f4d7400a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:24.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d8a7fc700 1 --2- 172.21.15.82:0/1027895186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d74004730 0x7f4d74004b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:24.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d8a7fc700 1 -- 172.21.15.82:0/1027895186 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c15c8b0 con 0x7f4d74004090 2023-11-28T13:01:24.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d8a7fc700 1 -- 172.21.15.82:0/1027895186 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c15cb90 con 0x7f4d74004730 2023-11-28T13:01:24.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d8a7fc700 1 -- 172.21.15.82:0/1027895186 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d74005440 con 0x7f4d8c1586f0 2023-11-28T13:01:24.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d8affd700 1 --2- 172.21.15.82:0/1027895186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d74004090 0x7f4d7400a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:24.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d8b7fe700 1 --2- 172.21.15.82:0/1027895186 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4d8c1586f0 0x7f4d74003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:24.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d8bfff700 1 --2- 172.21.15.82:0/1027895186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d74004730 0x7f4d74004b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:24.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d8affd700 1 -- 172.21.15.82:0/1027895186 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4d8c1586f0 msgr2=0x7f4d74003b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:24.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d8affd700 1 --2- 172.21.15.82:0/1027895186 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4d8c1586f0 0x7f4d74003b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d8affd700 1 -- 172.21.15.82:0/1027895186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d74004730 msgr2=0x7f4d74004b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:24.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d8affd700 1 --2- 172.21.15.82:0/1027895186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d74004730 0x7f4d74004b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d8affd700 1 -- 172.21.15.82:0/1027895186 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d740034f0 con 0x7f4d74004090 2023-11-28T13:01:24.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d8affd700 1 --2- 172.21.15.82:0/1027895186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d74004090 0x7f4d7400a910 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009fc0 tx=0x7f4d740037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367f77467ae24914 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:24.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d8a7fc700 1 -- 172.21.15.82:0/1027895186 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c00ec30 con 0x7f4d74004090 2023-11-28T13:01:24.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d8a7fc700 1 -- 172.21.15.82:0/1027895186 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7c00f040 con 0x7f4d74004090 2023-11-28T13:01:24.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d8a7fc700 1 -- 172.21.15.82:0/1027895186 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c014480 con 0x7f4d74004090 2023-11-28T13:01:24.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d909fd700 1 -- 172.21.15.82:0/1027895186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d74004090 msgr2=0x7f4d7400a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:24.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d909fd700 1 --2- 172.21.15.82:0/1027895186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d74004090 0x7f4d7400a910 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009fc0 tx=0x7f4d740037a0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d8bfff700 1 -- 172.21.15.82:0/1027895186 reap_dead start 2023-11-28T13:01:24.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d909fd700 1 -- 172.21.15.82:0/1027895186 shutdown_connections 2023-11-28T13:01:24.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d909fd700 1 -- 172.21.15.82:0/1027895186 >> 172.21.15.82:0/1027895186 conn(0x7f4d8c0ce600 msgr2=0x7f4d8c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:24.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d909fd700 1 -- 172.21.15.82:0/1027895186 shutdown_connections 2023-11-28T13:01:24.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.659+0000 7f4d909fd700 1 -- 172.21.15.82:0/1027895186 wait complete. 2023-11-28T13:01:24.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d909fd700 1 Processor -- start 2023-11-28T13:01:24.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d909fd700 1 -- start start 2023-11-28T13:01:24.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d909fd700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4d74004090 0x7f4d8c150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:24.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d909fd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d8c150f90 0x7f4d8c159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:24.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d909fd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d8c155e00 0x7f4d8c0af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:24.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d909fd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c1559e0 con 0x7f4d8c155e00 2023-11-28T13:01:24.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d909fd700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c150cd0 con 0x7f4d8c150f90 2023-11-28T13:01:24.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d909fd700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c0c8280 con 0x7f4d74004090 2023-11-28T13:01:24.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d8bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d8c155e00 0x7f4d8c0af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:24.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d8b7fe700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4d74004090 0x7f4d8c150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:24.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d8bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d8c155e00 0x7f4d8c0af060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33810/0 (socket says 172.21.15.82:33810) 2023-11-28T13:01:24.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d8bfff700 1 -- 172.21.15.82:0/3054209220 learned_addr learned my addr 172.21.15.82:0/3054209220 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:24.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d8affd700 1 --2- 172.21.15.82:0/3054209220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d8c150f90 0x7f4d8c159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:24.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d8bfff700 1 -- 172.21.15.82:0/3054209220 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4d74004090 msgr2=0x7f4d8c150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:24.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d8bfff700 1 --2- 172.21.15.82:0/3054209220 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4d74004090 0x7f4d8c150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d8bfff700 1 -- 172.21.15.82:0/3054209220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d8c150f90 msgr2=0x7f4d8c159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:24.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d8bfff700 1 --2- 172.21.15.82:0/3054209220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d8c150f90 0x7f4d8c159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d8bfff700 1 -- 172.21.15.82:0/3054209220 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c06ddc0 con 0x7f4d8c155e00 2023-11-28T13:01:24.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d8b7fe700 1 --2- 172.21.15.82:0/3054209220 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4d74004090 0x7f4d8c150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:24.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d8affd700 1 --2- 172.21.15.82:0/3054209220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d8c150f90 0x7f4d8c159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:24.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d8bfff700 1 --2- 172.21.15.82:0/3054209220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d8c155e00 0x7f4d8c0af060 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4d84000c00 tx=0x7f4d84007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d73fff700 1 -- 172.21.15.82:0/3054209220 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84012560 con 0x7f4d8c155e00 2023-11-28T13:01:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d73fff700 1 -- 172.21.15.82:0/3054209220 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d84012720 con 0x7f4d8c155e00 2023-11-28T13:01:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.663+0000 7f4d909fd700 1 -- 172.21.15.82:0/3054209220 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8c15d150 con 0x7f4d8c155e00 2023-11-28T13:01:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.667+0000 7f4d73fff700 1 -- 172.21.15.82:0/3054209220 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84012ad0 con 0x7f4d8c155e00 2023-11-28T13:01:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.667+0000 7f4d909fd700 1 -- 172.21.15.82:0/3054209220 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8c158ac0 con 0x7f4d8c155e00 2023-11-28T13:01:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.667+0000 7f4d909fd700 1 -- 172.21.15.82:0/3054209220 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8c065fc0 con 0x7f4d8c155e00 2023-11-28T13:01:24.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.667+0000 7f4d73fff700 1 -- 172.21.15.82:0/3054209220 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4d84012c30 con 0x7f4d8c155e00 2023-11-28T13:01:24.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.667+0000 7f4d73fff700 1 --2- 172.21.15.82:0/3054209220 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4d78064ee0 0x7f4d78067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:24.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.667+0000 7f4d73fff700 1 -- 172.21.15.82:0/3054209220 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4d84081ae0 con 0x7f4d8c155e00 2023-11-28T13:01:24.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.667+0000 7f4d8b7fe700 1 --2- 172.21.15.82:0/3054209220 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4d78064ee0 0x7f4d78067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:24.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.667+0000 7f4d8b7fe700 1 --2- 172.21.15.82:0/3054209220 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4d78064ee0 0x7f4d78067390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4d80009f80 tx=0x7f4d80009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:24.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.679+0000 7f4d73fff700 1 -- 172.21.15.82:0/3054209220 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4d8404fef0 con 0x7f4d8c155e00 2023-11-28T13:01:24.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.891+0000 7f4d909fd700 1 -- 172.21.15.82:0/3054209220 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f4d8c0caa60 con 0x7f4d8c155e00 2023-11-28T13:01:24.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.899+0000 7f4d73fff700 1 -- 172.21.15.82:0/3054209220 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4d84053510 con 0x7f4d8c155e00 2023-11-28T13:01:24.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.903+0000 7f4d909fd700 1 -- 172.21.15.82:0/3054209220 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4d78064ee0 msgr2=0x7f4d78067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:24.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.903+0000 7f4d909fd700 1 --2- 172.21.15.82:0/3054209220 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4d78064ee0 0x7f4d78067390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4d80009f80 tx=0x7f4d80009240 comp rx=0 tx=0).stop 2023-11-28T13:01:24.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.903+0000 7f4d909fd700 1 -- 172.21.15.82:0/3054209220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d8c155e00 msgr2=0x7f4d8c0af060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:24.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.903+0000 7f4d909fd700 1 --2- 172.21.15.82:0/3054209220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d8c155e00 0x7f4d8c0af060 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4d84000c00 tx=0x7f4d84007340 comp rx=0 tx=0).stop 2023-11-28T13:01:24.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.903+0000 7f4d909fd700 1 -- 172.21.15.82:0/3054209220 shutdown_connections 2023-11-28T13:01:24.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.903+0000 7f4d909fd700 1 --2- 172.21.15.82:0/3054209220 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4d78064ee0 0x7f4d78067390 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.903+0000 7f4d909fd700 1 --2- 172.21.15.82:0/3054209220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d8c155e00 0x7f4d8c0af060 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.903+0000 7f4d909fd700 1 --2- 172.21.15.82:0/3054209220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d8c150f90 0x7f4d8c159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.903+0000 7f4d909fd700 1 --2- 172.21.15.82:0/3054209220 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4d74004090 0x7f4d8c150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:24.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.903+0000 7f4d909fd700 1 -- 172.21.15.82:0/3054209220 >> 172.21.15.82:0/3054209220 conn(0x7f4d8c0ce600 msgr2=0x7f4d8c0b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:24.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.903+0000 7f4d909fd700 1 -- 172.21.15.82:0/3054209220 shutdown_connections 2023-11-28T13:01:24.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:24.903+0000 7f4d909fd700 1 -- 172.21.15.82:0/3054209220 wait complete. 2023-11-28T13:01:24.922 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-28T13:01:25.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.035+0000 7fbfe6327700 1 Processor -- start 2023-11-28T13:01:25.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.035+0000 7fbfe6327700 1 -- start start 2023-11-28T13:01:25.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.035+0000 7fbfe6327700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe015c2d0 0x7fbfe006d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:25.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.035+0000 7fbfe6327700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbfe0070900 0x7fbfe0070d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:25.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.035+0000 7fbfe6327700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe006c3b0 con 0x7fbfe01586f0 2023-11-28T13:01:25.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.035+0000 7fbfe6327700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe00712c0 con 0x7fbfe0070900 2023-11-28T13:01:25.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.035+0000 7fbfe6327700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe015c8b0 con 0x7fbfe015c2d0 2023-11-28T13:01:25.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.035+0000 7fbfe5b26700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbfe0070900 0x7fbfe0070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:25.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.035+0000 7fbfe5b26700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbfe0070900 0x7fbfe0070d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33820/0 (socket says 172.21.15.82:33820) 2023-11-28T13:01:25.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.035+0000 7fbfe5b26700 1 -- 172.21.15.82:0/2833088307 learned_addr learned my addr 172.21.15.82:0/2833088307 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:25.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.035+0000 7fbfe4b24700 1 --2- 172.21.15.82:0/2833088307 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe015c2d0 0x7fbfe006d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:25.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.035+0000 7fbfe5b26700 1 -- 172.21.15.82:0/2833088307 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe015c2d0 msgr2=0x7fbfe006d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:25.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.035+0000 7fbfe5b26700 1 --2- 172.21.15.82:0/2833088307 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe015c2d0 0x7fbfe006d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.035+0000 7fbfe5b26700 1 -- 172.21.15.82:0/2833088307 >> v1:172.21.15.114:6789/0 conn(0x7fbfe01586f0 legacy=0x7fbfe00c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:25.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.035+0000 7fbfe5b26700 1 -- 172.21.15.82:0/2833088307 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe015cb90 con 0x7fbfe0070900 2023-11-28T13:01:25.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.035+0000 7fbfe4b24700 1 --2- 172.21.15.82:0/2833088307 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe015c2d0 0x7fbfe006d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:25.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe5b26700 1 --2- 172.21.15.82:0/2833088307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfe0070900 0x7fbfe0070d80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009e50 tx=0x7fbfd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a3e35c52ba028 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:25.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfd3fff700 1 -- 172.21.15.82:0/2833088307 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd800e070 con 0x7fbfe0070900 2023-11-28T13:01:25.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfd3fff700 1 -- 172.21.15.82:0/2833088307 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd800b9c0 con 0x7fbfe0070900 2023-11-28T13:01:25.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfd3fff700 1 -- 172.21.15.82:0/2833088307 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd800bd70 con 0x7fbfe0070900 2023-11-28T13:01:25.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe6327700 1 -- 172.21.15.82:0/2833088307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfe0070900 msgr2=0x7fbfe0070d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:25.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe6327700 1 --2- 172.21.15.82:0/2833088307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfe0070900 0x7fbfe0070d80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009e50 tx=0x7fbfd800b330 comp rx=0 tx=0).stop 2023-11-28T13:01:25.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe6327700 1 -- 172.21.15.82:0/2833088307 shutdown_connections 2023-11-28T13:01:25.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe6327700 1 --2- 172.21.15.82:0/2833088307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfe0070900 0x7fbfe0070d80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe6327700 1 --2- 172.21.15.82:0/2833088307 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe015c2d0 0x7fbfe006d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe6327700 1 -- 172.21.15.82:0/2833088307 >> 172.21.15.82:0/2833088307 conn(0x7fbfe00ce600 msgr2=0x7fbfe00ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:25.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe6327700 1 -- 172.21.15.82:0/2833088307 shutdown_connections 2023-11-28T13:01:25.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe6327700 1 -- 172.21.15.82:0/2833088307 wait complete. 2023-11-28T13:01:25.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe6327700 1 Processor -- start 2023-11-28T13:01:25.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe6327700 1 -- start start 2023-11-28T13:01:25.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe6327700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfe0070900 0x7fbfe01483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:25.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe6327700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe01586f0 0x7fbfe0167030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:25.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe6327700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe015c2d0 0x7fbfe01578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:25.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe6327700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe01488e0 con 0x7fbfe0070900 2023-11-28T13:01:25.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe6327700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe0165720 con 0x7fbfe015c2d0 2023-11-28T13:01:25.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe6327700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe0165970 con 0x7fbfe01586f0 2023-11-28T13:01:25.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe5325700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfe0070900 0x7fbfe01483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:25.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe5325700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfe0070900 0x7fbfe01483a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33822/0 (socket says 172.21.15.82:33822) 2023-11-28T13:01:25.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe5325700 1 -- 172.21.15.82:0/991413730 learned_addr learned my addr 172.21.15.82:0/991413730 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:25.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe4b24700 1 --2- 172.21.15.82:0/991413730 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe01586f0 0x7fbfe0167030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:25.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe5b26700 1 --2- 172.21.15.82:0/991413730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe015c2d0 0x7fbfe01578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:25.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe5325700 1 -- 172.21.15.82:0/991413730 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe01586f0 msgr2=0x7fbfe0167030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:25.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe5325700 1 --2- 172.21.15.82:0/991413730 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe01586f0 0x7fbfe0167030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe5325700 1 -- 172.21.15.82:0/991413730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe015c2d0 msgr2=0x7fbfe01578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:25.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe5325700 1 --2- 172.21.15.82:0/991413730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe015c2d0 0x7fbfe01578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.039+0000 7fbfe5325700 1 -- 172.21.15.82:0/991413730 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd8009b30 con 0x7fbfe0070900 2023-11-28T13:01:25.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.043+0000 7fbfe5325700 1 --2- 172.21.15.82:0/991413730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfe0070900 0x7fbfe01483a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbfd400c500 tx=0x7fbfd400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:25.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.043+0000 7fbfd1ffb700 1 -- 172.21.15.82:0/991413730 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd40052d0 con 0x7fbfe0070900 2023-11-28T13:01:25.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.043+0000 7fbfd1ffb700 1 -- 172.21.15.82:0/991413730 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd4005430 con 0x7fbfe0070900 2023-11-28T13:01:25.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.043+0000 7fbfe6327700 1 -- 172.21.15.82:0/991413730 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe015d150 con 0x7fbfe0070900 2023-11-28T13:01:25.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.043+0000 7fbfd1ffb700 1 -- 172.21.15.82:0/991413730 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd40055a0 con 0x7fbfe0070900 2023-11-28T13:01:25.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.043+0000 7fbfe6327700 1 -- 172.21.15.82:0/991413730 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe015ce70 con 0x7fbfe0070900 2023-11-28T13:01:25.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.043+0000 7fbfe6327700 1 -- 172.21.15.82:0/991413730 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe006ddc0 con 0x7fbfe0070900 2023-11-28T13:01:25.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.043+0000 7fbfd1ffb700 1 -- 172.21.15.82:0/991413730 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbfd4019030 con 0x7fbfe0070900 2023-11-28T13:01:25.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.043+0000 7fbfd1ffb700 1 --2- 172.21.15.82:0/991413730 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbfc4064ee0 0x7fbfc4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:25.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.043+0000 7fbfe4b24700 1 --2- 172.21.15.82:0/991413730 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbfc4064ee0 0x7fbfc4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:25.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.043+0000 7fbfd1ffb700 1 -- 172.21.15.82:0/991413730 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbfd4080e10 con 0x7fbfe0070900 2023-11-28T13:01:25.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.047+0000 7fbfe4b24700 1 --2- 172.21.15.82:0/991413730 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbfc4064ee0 0x7fbfc4067390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbfe014edb0 tx=0x7fbfdc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:25.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.051+0000 7fbfd1ffb700 1 -- 172.21.15.82:0/991413730 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbfd404f2a0 con 0x7fbfe0070900 2023-11-28T13:01:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.275+0000 7fbfe6327700 1 -- 172.21.15.82:0/991413730 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fbfe0065fc0 con 0x7fbfe0070900 2023-11-28T13:01:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.279+0000 7fbfd1ffb700 1 -- 172.21.15.82:0/991413730 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbfd40528c0 con 0x7fbfe0070900 2023-11-28T13:01:25.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.283+0000 7fbfe6327700 1 -- 172.21.15.82:0/991413730 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbfc4064ee0 msgr2=0x7fbfc4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:25.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.283+0000 7fbfe6327700 1 --2- 172.21.15.82:0/991413730 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbfc4064ee0 0x7fbfc4067390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbfe014edb0 tx=0x7fbfdc008040 comp rx=0 tx=0).stop 2023-11-28T13:01:25.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.283+0000 7fbfe6327700 1 -- 172.21.15.82:0/991413730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfe0070900 msgr2=0x7fbfe01483a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:25.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.283+0000 7fbfe6327700 1 --2- 172.21.15.82:0/991413730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfe0070900 0x7fbfe01483a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbfd400c500 tx=0x7fbfd400c810 comp rx=0 tx=0).stop 2023-11-28T13:01:25.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.283+0000 7fbfe6327700 1 -- 172.21.15.82:0/991413730 shutdown_connections 2023-11-28T13:01:25.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.283+0000 7fbfe6327700 1 --2- 172.21.15.82:0/991413730 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbfc4064ee0 0x7fbfc4067390 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.283+0000 7fbfe6327700 1 --2- 172.21.15.82:0/991413730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe015c2d0 0x7fbfe01578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.283+0000 7fbfe6327700 1 --2- 172.21.15.82:0/991413730 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe01586f0 0x7fbfe0167030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.283+0000 7fbfe6327700 1 --2- 172.21.15.82:0/991413730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfe0070900 0x7fbfe01483a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.283+0000 7fbfe6327700 1 -- 172.21.15.82:0/991413730 >> 172.21.15.82:0/991413730 conn(0x7fbfe00ce600 msgr2=0x7fbfe0069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:25.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.283+0000 7fbfe6327700 1 -- 172.21.15.82:0/991413730 shutdown_connections 2023-11-28T13:01:25.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.283+0000 7fbfe6327700 1 -- 172.21.15.82:0/991413730 wait complete. 2023-11-28T13:01:25.305 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-28T13:01:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.415+0000 7fa8a6e52700 1 Processor -- start 2023-11-28T13:01:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.415+0000 7fa8a6e52700 1 -- start start 2023-11-28T13:01:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a6e52700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa8a0159cb0 0x7fa8a015c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a6e52700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa8a00cae60 0x7fa8a00cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a6e52700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a00cc210 con 0x7fa8a00cfd50 2023-11-28T13:01:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a6e52700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a00d0170 con 0x7fa8a00cae60 2023-11-28T13:01:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a6e52700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00cb6b0 con 0x7fa8a0159cb0 2023-11-28T13:01:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a564f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa8a00cae60 0x7fa8a00cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a5e50700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa8a0159cb0 0x7fa8a015c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a564f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa8a00cae60 0x7fa8a00cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:59418/0 (socket says 172.21.15.82:59418) 2023-11-28T13:01:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a564f700 1 -- 172.21.15.82:0/4158853894 learned_addr learned my addr 172.21.15.82:0/4158853894 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a564f700 1 -- 172.21.15.82:0/4158853894 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa8a0159cb0 msgr2=0x7fa8a015c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a564f700 1 --2- 172.21.15.82:0/4158853894 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa8a0159cb0 0x7fa8a015c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a564f700 1 -- 172.21.15.82:0/4158853894 >> v1:172.21.15.114:6789/0 conn(0x7fa8a00cfd50 legacy=0x7fa8a00ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a564f700 1 -- 172.21.15.82:0/4158853894 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a00cb990 con 0x7fa8a00cae60 2023-11-28T13:01:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a564f700 1 --2- 172.21.15.82:0/4158853894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8a00cae60 0x7fa8a00cf810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa888009910 tx=0x7fa888009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edc5c49b6eca2d7b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a4e4e700 1 -- 172.21.15.82:0/4158853894 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa888004230 con 0x7fa8a00cae60 2023-11-28T13:01:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a4e4e700 1 -- 172.21.15.82:0/4158853894 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa888004390 con 0x7fa8a00cae60 2023-11-28T13:01:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a4e4e700 1 -- 172.21.15.82:0/4158853894 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8880036c0 con 0x7fa8a00cae60 2023-11-28T13:01:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a6e52700 1 -- 172.21.15.82:0/4158853894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8a00cae60 msgr2=0x7fa8a00cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:25.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a6e52700 1 --2- 172.21.15.82:0/4158853894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8a00cae60 0x7fa8a00cf810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa888009910 tx=0x7fa888009c20 comp rx=0 tx=0).stop 2023-11-28T13:01:25.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a6e52700 1 -- 172.21.15.82:0/4158853894 shutdown_connections 2023-11-28T13:01:25.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a6e52700 1 --2- 172.21.15.82:0/4158853894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8a00cae60 0x7fa8a00cf810 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a6e52700 1 --2- 172.21.15.82:0/4158853894 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa8a0159cb0 0x7fa8a015c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a6e52700 1 -- 172.21.15.82:0/4158853894 >> 172.21.15.82:0/4158853894 conn(0x7fa8a00b2320 msgr2=0x7fa8a00b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:25.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a6e52700 1 -- 172.21.15.82:0/4158853894 shutdown_connections 2023-11-28T13:01:25.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.419+0000 7fa8a6e52700 1 -- 172.21.15.82:0/4158853894 wait complete. 2023-11-28T13:01:25.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa8a6e52700 1 Processor -- start 2023-11-28T13:01:25.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa8a6e52700 1 -- start start 2023-11-28T13:01:25.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa8a6e52700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8a00cae60 0x7fa8a00c5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:25.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa8a6e52700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa8a00cfd50 0x7fa8a00c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa8a6e52700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a0159cb0 0x7fa8a00c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa8a6e52700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00c78e0 con 0x7fa8a0159cb0 2023-11-28T13:01:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa8a6e52700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00c5860 con 0x7fa8a00cae60 2023-11-28T13:01:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa8a6e52700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00c6f60 con 0x7fa8a00cfd50 2023-11-28T13:01:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa8a6651700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a0159cb0 0x7fa8a00c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa8a6651700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a0159cb0 0x7fa8a00c5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33836/0 (socket says 172.21.15.82:33836) 2023-11-28T13:01:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa8a6651700 1 -- 172.21.15.82:0/1107064922 learned_addr learned my addr 172.21.15.82:0/1107064922 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa8a5e50700 1 --2- 172.21.15.82:0/1107064922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8a00cae60 0x7fa8a00c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa8a564f700 1 --2- 172.21.15.82:0/1107064922 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa8a00cfd50 0x7fa8a00c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa8a6651700 1 -- 172.21.15.82:0/1107064922 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa8a00cfd50 msgr2=0x7fa8a00c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa8a6651700 1 --2- 172.21.15.82:0/1107064922 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa8a00cfd50 0x7fa8a00c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa8a6651700 1 -- 172.21.15.82:0/1107064922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8a00cae60 msgr2=0x7fa8a00c5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:25.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa8a6651700 1 --2- 172.21.15.82:0/1107064922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8a00cae60 0x7fa8a00c5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa8a6651700 1 -- 172.21.15.82:0/1107064922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa888009570 con 0x7fa8a0159cb0 2023-11-28T13:01:25.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa8a6651700 1 --2- 172.21.15.82:0/1107064922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a0159cb0 0x7fa8a00c5dd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa898002080 tx=0x7fa89800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:25.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa89e7fc700 1 -- 172.21.15.82:0/1107064922 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898003e50 con 0x7fa8a0159cb0 2023-11-28T13:01:25.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa89e7fc700 1 -- 172.21.15.82:0/1107064922 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89800a880 con 0x7fa8a0159cb0 2023-11-28T13:01:25.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa8a6e52700 1 -- 172.21.15.82:0/1107064922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a00b50f0 con 0x7fa8a0159cb0 2023-11-28T13:01:25.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa89e7fc700 1 -- 172.21.15.82:0/1107064922 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89800ac30 con 0x7fa8a0159cb0 2023-11-28T13:01:25.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.423+0000 7fa8a6e52700 1 -- 172.21.15.82:0/1107064922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a00cbc70 con 0x7fa8a0159cb0 2023-11-28T13:01:25.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.427+0000 7fa8a6e52700 1 -- 172.21.15.82:0/1107064922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a00b4de0 con 0x7fa8a0159cb0 2023-11-28T13:01:25.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.427+0000 7fa89e7fc700 1 -- 172.21.15.82:0/1107064922 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa898010070 con 0x7fa8a0159cb0 2023-11-28T13:01:25.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.427+0000 7fa89e7fc700 1 --2- 172.21.15.82:0/1107064922 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa880064f10 0x7fa8800673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:25.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.427+0000 7fa89e7fc700 1 -- 172.21.15.82:0/1107064922 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa898081bc0 con 0x7fa8a0159cb0 2023-11-28T13:01:25.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.427+0000 7fa8a5e50700 1 --2- 172.21.15.82:0/1107064922 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa880064f10 0x7fa8800673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:25.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.427+0000 7fa8a5e50700 1 --2- 172.21.15.82:0/1107064922 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa880064f10 0x7fa8800673c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa890009b50 tx=0x7fa890009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:25.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.435+0000 7fa89e7fc700 1 -- 172.21.15.82:0/1107064922 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa898050070 con 0x7fa8a0159cb0 2023-11-28T13:01:25.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.655+0000 7fa8a6e52700 1 -- 172.21.15.82:0/1107064922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fa8a00c7a20 con 0x7fa8a0159cb0 2023-11-28T13:01:25.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.663+0000 7fa89e7fc700 1 -- 172.21.15.82:0/1107064922 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa8a00c7a20 con 0x7fa8a0159cb0 2023-11-28T13:01:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.663+0000 7fa8a6e52700 1 -- 172.21.15.82:0/1107064922 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa880064f10 msgr2=0x7fa8800673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.663+0000 7fa8a6e52700 1 --2- 172.21.15.82:0/1107064922 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa880064f10 0x7fa8800673c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa890009b50 tx=0x7fa890009240 comp rx=0 tx=0).stop 2023-11-28T13:01:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.663+0000 7fa8a6e52700 1 -- 172.21.15.82:0/1107064922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a0159cb0 msgr2=0x7fa8a00c5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.663+0000 7fa8a6e52700 1 --2- 172.21.15.82:0/1107064922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a0159cb0 0x7fa8a00c5dd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa898002080 tx=0x7fa89800a340 comp rx=0 tx=0).stop 2023-11-28T13:01:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.663+0000 7fa8a6e52700 1 -- 172.21.15.82:0/1107064922 shutdown_connections 2023-11-28T13:01:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.663+0000 7fa8a6e52700 1 --2- 172.21.15.82:0/1107064922 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa880064f10 0x7fa8800673c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.663+0000 7fa8a6e52700 1 --2- 172.21.15.82:0/1107064922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a0159cb0 0x7fa8a00c5dd0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.663+0000 7fa8a6e52700 1 --2- 172.21.15.82:0/1107064922 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa8a00cfd50 0x7fa8a00c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.663+0000 7fa8a6e52700 1 --2- 172.21.15.82:0/1107064922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8a00cae60 0x7fa8a00c5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.663+0000 7fa8a6e52700 1 -- 172.21.15.82:0/1107064922 >> 172.21.15.82:0/1107064922 conn(0x7fa8a00b2320 msgr2=0x7fa8a00b5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:25.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.663+0000 7fa8a6e52700 1 -- 172.21.15.82:0/1107064922 shutdown_connections 2023-11-28T13:01:25.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.663+0000 7fa8a6e52700 1 -- 172.21.15.82:0/1107064922 wait complete. 2023-11-28T13:01:25.685 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-28T13:01:25.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.795+0000 7efda759e700 1 Processor -- start 2023-11-28T13:01:25.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.795+0000 7efda759e700 1 -- start start 2023-11-28T13:01:25.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efda815c4b0 0x7efda80ae400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:25.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda759e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efda80ce550 0x7efda8070730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:25.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda759e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda80cc950 con 0x7efda815c0e0 2023-11-28T13:01:25.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda759e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda815fe00 con 0x7efda80ce550 2023-11-28T13:01:25.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda806cf40 con 0x7efda815c4b0 2023-11-28T13:01:25.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda659c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efda815c0e0 0x7efda806c830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45914/0 (socket says 172.21.15.82:45914) 2023-11-28T13:01:25.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda659c700 1 -- 172.21.15.82:0/65069827 learned_addr learned my addr 172.21.15.82:0/65069827 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:25.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efd9ffff700 1 --2- 172.21.15.82:0/65069827 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efda815c4b0 0x7efda80ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:25.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda6d9d700 1 --2- 172.21.15.82:0/65069827 >> v2:172.21.15.114:3300/0 conn(0x7efda80ce550 0x7efda8070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:25.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda5d9b700 1 -- 172.21.15.82:0/65069827 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905940010 0 0) 0x7efda80cc950 con 0x7efda815c0e0 2023-11-28T13:01:25.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda5d9b700 1 -- 172.21.15.82:0/65069827 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd940035d0 con 0x7efda815c0e0 2023-11-28T13:01:25.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda5d9b700 1 -- 172.21.15.82:0/65069827 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3774933940 0 0) 0x7efd940035d0 con 0x7efda815c0e0 2023-11-28T13:01:25.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda5d9b700 1 -- 172.21.15.82:0/65069827 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efda815c4b0 msgr2=0x7efda80ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:25.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda5d9b700 1 --2- 172.21.15.82:0/65069827 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efda815c4b0 0x7efda80ae400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda5d9b700 1 -- 172.21.15.82:0/65069827 >> v2:172.21.15.114:3300/0 conn(0x7efda80ce550 msgr2=0x7efda8070730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:25.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda5d9b700 1 --2- 172.21.15.82:0/65069827 >> v2:172.21.15.114:3300/0 conn(0x7efda80ce550 0x7efda8070730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda5d9b700 1 -- 172.21.15.82:0/65069827 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda80ceac0 con 0x7efda815c0e0 2023-11-28T13:01:25.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda5d9b700 1 -- 172.21.15.82:0/65069827 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7efd98001670 con 0x7efda815c0e0 2023-11-28T13:01:25.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda6d9d700 1 --2- 172.21.15.82:0/65069827 >> v2:172.21.15.114:3300/0 conn(0x7efda80ce550 0x7efda8070730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:25.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda5d9b700 1 -- 172.21.15.82:0/65069827 >> v1:172.21.15.82:6789/0 conn(0x7efda815c0e0 legacy=0x7efda806c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:25.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda5d9b700 1 --2- 172.21.15.82:0/65069827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd94003a20 0x7efd94003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:25.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda5d9b700 1 --2- 172.21.15.82:0/65069827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd94004450 0x7efd94004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:25.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda5d9b700 1 --2- 172.21.15.82:0/65069827 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efda815c4b0 0x7efd94004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:25.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda5d9b700 1 -- 172.21.15.82:0/65069827 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda815fe00 con 0x7efd94004450 2023-11-28T13:01:25.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda5d9b700 1 -- 172.21.15.82:0/65069827 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda806cf40 con 0x7efd94003a20 2023-11-28T13:01:25.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda5d9b700 1 -- 172.21.15.82:0/65069827 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9400ba30 con 0x7efda815c4b0 2023-11-28T13:01:25.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efd9ffff700 1 --2- 172.21.15.82:0/65069827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd94004450 0x7efd94004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:25.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda659c700 1 --2- 172.21.15.82:0/65069827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd94003a20 0x7efd94003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:25.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda6d9d700 1 --2- 172.21.15.82:0/65069827 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efda815c4b0 0x7efd94004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efd9ffff700 1 -- 172.21.15.82:0/65069827 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efda815c4b0 msgr2=0x7efd94004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efd9ffff700 1 --2- 172.21.15.82:0/65069827 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efda815c4b0 0x7efd94004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efd9ffff700 1 -- 172.21.15.82:0/65069827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd94003a20 msgr2=0x7efd94003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efd9ffff700 1 --2- 172.21.15.82:0/65069827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd94003a20 0x7efd94003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efd9ffff700 1 -- 172.21.15.82:0/65069827 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd940035d0 con 0x7efd94004450 2023-11-28T13:01:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda659c700 1 --2- 172.21.15.82:0/65069827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd94003a20 0x7efd94003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efd9ffff700 1 --2- 172.21.15.82:0/65069827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd94004450 0x7efd94004910 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efd90009b70 tx=0x7efd940058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8655c0c4b6709ba3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda5d9b700 1 -- 172.21.15.82:0/65069827 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9000e6c0 con 0x7efd94004450 2023-11-28T13:01:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda5d9b700 1 -- 172.21.15.82:0/65069827 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9000e820 con 0x7efd94004450 2023-11-28T13:01:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda5d9b700 1 -- 172.21.15.82:0/65069827 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9000eb90 con 0x7efd94004450 2023-11-28T13:01:25.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda759e700 1 -- 172.21.15.82:0/65069827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd94004450 msgr2=0x7efd94004910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:25.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda759e700 1 --2- 172.21.15.82:0/65069827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd94004450 0x7efd94004910 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efd90009b70 tx=0x7efd940058a0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda6d9d700 1 -- 172.21.15.82:0/65069827 reap_dead start 2023-11-28T13:01:25.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda759e700 1 -- 172.21.15.82:0/65069827 shutdown_connections 2023-11-28T13:01:25.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda759e700 1 -- 172.21.15.82:0/65069827 >> 172.21.15.82:0/65069827 conn(0x7efda80cb890 msgr2=0x7efda80cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:25.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda759e700 1 -- 172.21.15.82:0/65069827 shutdown_connections 2023-11-28T13:01:25.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.799+0000 7efda759e700 1 -- 172.21.15.82:0/65069827 wait complete. 2023-11-28T13:01:25.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.803+0000 7efda759e700 1 Processor -- start 2023-11-28T13:01:25.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.803+0000 7efda759e700 1 -- start start 2023-11-28T13:01:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.803+0000 7efda759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd94004450 0x7efda8155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.803+0000 7efda759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efda80af800 0x7efda80c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.803+0000 7efda759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efda80c6390 0x7efda80b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.803+0000 7efda759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda80c6800 con 0x7efd94004450 2023-11-28T13:01:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.803+0000 7efda759e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda8155f70 con 0x7efda80af800 2023-11-28T13:01:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.803+0000 7efda759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda80b0580 con 0x7efda80c6390 2023-11-28T13:01:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.803+0000 7efda659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd94004450 0x7efda8155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.803+0000 7efda659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd94004450 0x7efda8155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33846/0 (socket says 172.21.15.82:33846) 2023-11-28T13:01:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.803+0000 7efda659c700 1 -- 172.21.15.82:0/1659233673 learned_addr learned my addr 172.21.15.82:0/1659233673 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.803+0000 7efda6d9d700 1 --2- 172.21.15.82:0/1659233673 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efda80c6390 0x7efda80b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.803+0000 7efd9ffff700 1 --2- 172.21.15.82:0/1659233673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efda80af800 0x7efda80c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.807+0000 7efda659c700 1 -- 172.21.15.82:0/1659233673 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efda80c6390 msgr2=0x7efda80b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.807+0000 7efda659c700 1 --2- 172.21.15.82:0/1659233673 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efda80c6390 0x7efda80b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.807+0000 7efda659c700 1 -- 172.21.15.82:0/1659233673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efda80af800 msgr2=0x7efda80c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.807+0000 7efda659c700 1 --2- 172.21.15.82:0/1659233673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efda80af800 0x7efda80c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.807+0000 7efda659c700 1 -- 172.21.15.82:0/1659233673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda80cce80 con 0x7efd94004450 2023-11-28T13:01:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.807+0000 7efda659c700 1 --2- 172.21.15.82:0/1659233673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd94004450 0x7efda8155a30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efd98000ff0 tx=0x7efd9800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.807+0000 7efd9effd700 1 -- 172.21.15.82:0/1659233673 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd98005e40 con 0x7efd94004450 2023-11-28T13:01:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.807+0000 7efd9effd700 1 -- 172.21.15.82:0/1659233673 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9800c780 con 0x7efd94004450 2023-11-28T13:01:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.807+0000 7efd9effd700 1 -- 172.21.15.82:0/1659233673 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9800caf0 con 0x7efd94004450 2023-11-28T13:01:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.807+0000 7efda759e700 1 -- 172.21.15.82:0/1659233673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda80ccba0 con 0x7efd94004450 2023-11-28T13:01:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.807+0000 7efda759e700 1 -- 172.21.15.82:0/1659233673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda80ada80 con 0x7efd94004450 2023-11-28T13:01:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.807+0000 7efda759e700 1 -- 172.21.15.82:0/1659233673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda8065fc0 con 0x7efd94004450 2023-11-28T13:01:25.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.807+0000 7efd9effd700 1 -- 172.21.15.82:0/1659233673 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efd9800cc50 con 0x7efd94004450 2023-11-28T13:01:25.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.807+0000 7efd9effd700 1 --2- 172.21.15.82:0/1659233673 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efd88064f10 0x7efd880673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:25.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.807+0000 7efd9ffff700 1 --2- 172.21.15.82:0/1659233673 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efd88064f10 0x7efd880673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:25.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.807+0000 7efd9effd700 1 -- 172.21.15.82:0/1659233673 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7efd98081b60 con 0x7efd94004450 2023-11-28T13:01:25.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.811+0000 7efd9ffff700 1 --2- 172.21.15.82:0/1659233673 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efd88064f10 0x7efd880673c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efd900090b0 tx=0x7efd90008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:25.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:25.815+0000 7efd9effd700 1 -- 172.21.15.82:0/1659233673 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efd9804ff60 con 0x7efd94004450 2023-11-28T13:01:26.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.031+0000 7efda759e700 1 -- 172.21.15.82:0/1659233673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7efda8071560 con 0x7efd94004450 2023-11-28T13:01:26.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.039+0000 7efd9effd700 1 -- 172.21.15.82:0/1659233673 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7efd98001560 con 0x7efd94004450 2023-11-28T13:01:26.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.043+0000 7efda759e700 1 -- 172.21.15.82:0/1659233673 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efd88064f10 msgr2=0x7efd880673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:26.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.043+0000 7efda759e700 1 --2- 172.21.15.82:0/1659233673 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efd88064f10 0x7efd880673c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efd900090b0 tx=0x7efd90008030 comp rx=0 tx=0).stop 2023-11-28T13:01:26.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.043+0000 7efda759e700 1 -- 172.21.15.82:0/1659233673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd94004450 msgr2=0x7efda8155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:26.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.043+0000 7efda759e700 1 --2- 172.21.15.82:0/1659233673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd94004450 0x7efda8155a30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efd98000ff0 tx=0x7efd9800ee80 comp rx=0 tx=0).stop 2023-11-28T13:01:26.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.043+0000 7efda759e700 1 -- 172.21.15.82:0/1659233673 shutdown_connections 2023-11-28T13:01:26.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.043+0000 7efda759e700 1 --2- 172.21.15.82:0/1659233673 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efd88064f10 0x7efd880673c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.043+0000 7efda759e700 1 --2- 172.21.15.82:0/1659233673 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efda80c6390 0x7efda80b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.043+0000 7efda759e700 1 --2- 172.21.15.82:0/1659233673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efda80af800 0x7efda80c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.043+0000 7efda759e700 1 --2- 172.21.15.82:0/1659233673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd94004450 0x7efda8155a30 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.043+0000 7efda759e700 1 -- 172.21.15.82:0/1659233673 >> 172.21.15.82:0/1659233673 conn(0x7efda80cb890 msgr2=0x7efda815c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:26.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.043+0000 7efda759e700 1 -- 172.21.15.82:0/1659233673 shutdown_connections 2023-11-28T13:01:26.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.043+0000 7efda759e700 1 -- 172.21.15.82:0/1659233673 wait complete. 2023-11-28T13:01:26.066 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:01:26.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb60e243700 1 Processor -- start 2023-11-28T13:01:26.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb60e243700 1 -- start start 2023-11-28T13:01:26.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb60e243700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb6080c2d20 0x7fb60806c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb60e243700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb60806c870 0x7fb6080b1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb60e243700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6080cc400 con 0x7fb6080c30f0 2023-11-28T13:01:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb60e243700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6080cd460 con 0x7fb6080c2d20 2023-11-28T13:01:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb60e243700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6080cc6a0 con 0x7fb60806c870 2023-11-28T13:01:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb6077fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb6080c2d20 0x7fb60806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb6077fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb6080c2d20 0x7fb60806c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33850/0 (socket says 172.21.15.82:33850) 2023-11-28T13:01:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb6077fe700 1 -- 172.21.15.82:0/3487640767 learned_addr learned my addr 172.21.15.82:0/3487640767 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb6077fe700 1 -- 172.21.15.82:0/3487640767 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb60806c870 msgr2=0x7fb6080b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb606ffd700 1 --2- 172.21.15.82:0/3487640767 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb60806c870 0x7fb6080b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb6077fe700 1 --2- 172.21.15.82:0/3487640767 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb60806c870 0x7fb6080b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb6077fe700 1 -- 172.21.15.82:0/3487640767 >> v1:172.21.15.82:6789/0 conn(0x7fb6080c30f0 legacy=0x7fb6080b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb6077fe700 1 -- 172.21.15.82:0/3487640767 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6080cc980 con 0x7fb6080c2d20 2023-11-28T13:01:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb606ffd700 1 --2- 172.21.15.82:0/3487640767 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb60806c870 0x7fb6080b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:01:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb6077fe700 1 --2- 172.21.15.82:0/3487640767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6080c2d20 0x7fb60806c330 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009910 tx=0x7fb5fc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa58bb62a5a8c4e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb6067fc700 1 -- 172.21.15.82:0/3487640767 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc005e50 con 0x7fb6080c2d20 2023-11-28T13:01:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb6067fc700 1 -- 172.21.15.82:0/3487640767 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5fc009e60 con 0x7fb6080c2d20 2023-11-28T13:01:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb6067fc700 1 -- 172.21.15.82:0/3487640767 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc00b870 con 0x7fb6080c2d20 2023-11-28T13:01:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb60e243700 1 -- 172.21.15.82:0/3487640767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6080c2d20 msgr2=0x7fb60806c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb60e243700 1 --2- 172.21.15.82:0/3487640767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6080c2d20 0x7fb60806c330 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009910 tx=0x7fb5fc009c20 comp rx=0 tx=0).stop 2023-11-28T13:01:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb60e243700 1 -- 172.21.15.82:0/3487640767 shutdown_connections 2023-11-28T13:01:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb60e243700 1 --2- 172.21.15.82:0/3487640767 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb60806c870 0x7fb6080b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb60e243700 1 --2- 172.21.15.82:0/3487640767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6080c2d20 0x7fb60806c330 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb60e243700 1 -- 172.21.15.82:0/3487640767 >> 172.21.15.82:0/3487640767 conn(0x7fb6080b2a30 msgr2=0x7fb6080b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb60e243700 1 -- 172.21.15.82:0/3487640767 shutdown_connections 2023-11-28T13:01:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.175+0000 7fb60e243700 1 -- 172.21.15.82:0/3487640767 wait complete. 2023-11-28T13:01:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.179+0000 7fb60e243700 1 Processor -- start 2023-11-28T13:01:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.179+0000 7fb60e243700 1 -- start start 2023-11-28T13:01:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.179+0000 7fb60e243700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb60806c870 0x7fb60809d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.179+0000 7fb60e243700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6080c2d20 0x7fb6080c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.179+0000 7fb60e243700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6080c30f0 0x7fb60806e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.179+0000 7fb60e243700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6080c6f70 con 0x7fb6080c2d20 2023-11-28T13:01:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.179+0000 7fb60e243700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6080c64d0 con 0x7fb6080c30f0 2023-11-28T13:01:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.179+0000 7fb60e243700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6080c5c30 con 0x7fb60806c870 2023-11-28T13:01:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.179+0000 7fb606ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6080c2d20 0x7fb6080c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.179+0000 7fb606ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6080c2d20 0x7fb6080c51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33854/0 (socket says 172.21.15.82:33854) 2023-11-28T13:01:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.179+0000 7fb606ffd700 1 -- 172.21.15.82:0/392456597 learned_addr learned my addr 172.21.15.82:0/392456597 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.179+0000 7fb6077fe700 1 --2- 172.21.15.82:0/392456597 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb60806c870 0x7fb60809d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.179+0000 7fb607fff700 1 --2- 172.21.15.82:0/392456597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6080c30f0 0x7fb60806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.179+0000 7fb606ffd700 1 -- 172.21.15.82:0/392456597 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb60806c870 msgr2=0x7fb60809d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.179+0000 7fb606ffd700 1 --2- 172.21.15.82:0/392456597 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb60806c870 0x7fb60809d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.179+0000 7fb606ffd700 1 -- 172.21.15.82:0/392456597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6080c30f0 msgr2=0x7fb60806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:26.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.179+0000 7fb606ffd700 1 --2- 172.21.15.82:0/392456597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6080c30f0 0x7fb60806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.179+0000 7fb606ffd700 1 -- 172.21.15.82:0/392456597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc009520 con 0x7fb6080c2d20 2023-11-28T13:01:26.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.183+0000 7fb606ffd700 1 --2- 172.21.15.82:0/392456597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6080c2d20 0x7fb6080c51e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb60000cf60 tx=0x7fb60000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:26.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.183+0000 7fb5effff700 1 -- 172.21.15.82:0/392456597 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60000ada0 con 0x7fb6080c2d20 2023-11-28T13:01:26.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.183+0000 7fb60e243700 1 -- 172.21.15.82:0/392456597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6080ccf40 con 0x7fb6080c2d20 2023-11-28T13:01:26.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.187+0000 7fb60e243700 1 -- 172.21.15.82:0/392456597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6080ccc60 con 0x7fb6080c2d20 2023-11-28T13:01:26.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.187+0000 7fb5effff700 1 -- 172.21.15.82:0/392456597 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb600015440 con 0x7fb6080c2d20 2023-11-28T13:01:26.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.187+0000 7fb5effff700 1 -- 172.21.15.82:0/392456597 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6000157b0 con 0x7fb6080c2d20 2023-11-28T13:01:26.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.187+0000 7fb5effff700 1 -- 172.21.15.82:0/392456597 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb60001c030 con 0x7fb6080c2d20 2023-11-28T13:01:26.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.187+0000 7fb60e243700 1 -- 172.21.15.82:0/392456597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e8005310 con 0x7fb6080c2d20 2023-11-28T13:01:26.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.187+0000 7fb5effff700 1 --2- 172.21.15.82:0/392456597 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb5f4064ee0 0x7fb5f4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:26.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.187+0000 7fb6077fe700 1 --2- 172.21.15.82:0/392456597 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb5f4064ee0 0x7fb5f4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:26.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.187+0000 7fb5effff700 1 -- 172.21.15.82:0/392456597 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb600081d90 con 0x7fb6080c2d20 2023-11-28T13:01:26.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.187+0000 7fb6077fe700 1 --2- 172.21.15.82:0/392456597 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb5f4064ee0 0x7fb5f4067390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009c60 tx=0x7fb5fc008070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:26.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.195+0000 7fb5effff700 1 -- 172.21.15.82:0/392456597 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb60004d400 con 0x7fb6080c2d20 2023-11-28T13:01:26.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.359+0000 7fb60e243700 1 -- 172.21.15.82:0/392456597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5e80055c0 con 0x7fb6080c2d20 2023-11-28T13:01:26.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.359+0000 7fb5effff700 1 -- 172.21.15.82:0/392456597 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+14171 (secure 0 0 0) 0x7fb60001a090 con 0x7fb6080c2d20 2023-11-28T13:01:26.366 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:26.366 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":34,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:01:23.361798+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:01:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.363+0000 7fb60e243700 1 -- 172.21.15.82:0/392456597 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb5f4064ee0 msgr2=0x7fb5f4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.363+0000 7fb60e243700 1 --2- 172.21.15.82:0/392456597 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb5f4064ee0 0x7fb5f4067390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009c60 tx=0x7fb5fc008070 comp rx=0 tx=0).stop 2023-11-28T13:01:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.363+0000 7fb60e243700 1 -- 172.21.15.82:0/392456597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6080c2d20 msgr2=0x7fb6080c51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.363+0000 7fb60e243700 1 --2- 172.21.15.82:0/392456597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6080c2d20 0x7fb6080c51e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb60000cf60 tx=0x7fb60000cf90 comp rx=0 tx=0).stop 2023-11-28T13:01:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.363+0000 7fb60e243700 1 -- 172.21.15.82:0/392456597 shutdown_connections 2023-11-28T13:01:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.363+0000 7fb60e243700 1 --2- 172.21.15.82:0/392456597 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb5f4064ee0 0x7fb5f4067390 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.363+0000 7fb60e243700 1 --2- 172.21.15.82:0/392456597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6080c30f0 0x7fb60806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.363+0000 7fb60e243700 1 --2- 172.21.15.82:0/392456597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6080c2d20 0x7fb6080c51e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.363+0000 7fb60e243700 1 --2- 172.21.15.82:0/392456597 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb60806c870 0x7fb60809d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.363+0000 7fb60e243700 1 -- 172.21.15.82:0/392456597 >> 172.21.15.82:0/392456597 conn(0x7fb6080b2a30 msgr2=0x7fb60806b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:26.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.363+0000 7fb60e243700 1 -- 172.21.15.82:0/392456597 shutdown_connections 2023-11-28T13:01:26.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.363+0000 7fb60e243700 1 -- 172.21.15.82:0/392456597 wait complete. 2023-11-28T13:01:26.381 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:01:26.382 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:01:26.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.499+0000 7f710508b700 1 Processor -- start 2023-11-28T13:01:26.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.499+0000 7f710508b700 1 -- start start 2023-11-28T13:01:26.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.499+0000 7f710508b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7100070910 0x7f7100070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:26.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.499+0000 7f710508b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f71000ad820 0x7f710006a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:26.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.499+0000 7f710508b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71000c93a0 con 0x7f71001640a0 2023-11-28T13:01:26.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.499+0000 7f710508b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71000c96f0 con 0x7f71000ad820 2023-11-28T13:01:26.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.499+0000 7f710508b700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7100071580 con 0x7f7100070910 2023-11-28T13:01:26.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f70ff7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f71000ad820 0x7f710006a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:26.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f710488a700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f71001640a0 0x7f7100164540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45926/0 (socket says 172.21.15.82:45926) 2023-11-28T13:01:26.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f710488a700 1 -- 172.21.15.82:0/290337997 learned_addr learned my addr 172.21.15.82:0/290337997 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:26.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f70fffff700 1 --2- 172.21.15.82:0/290337997 >> v2:172.21.15.114:3300/0 conn(0x7f7100070910 0x7f7100070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:26.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f70ff7fe700 1 -- 172.21.15.82:0/290337997 >> v2:172.21.15.114:3300/0 conn(0x7f7100070910 msgr2=0x7f7100070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:26.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f70ff7fe700 1 --2- 172.21.15.82:0/290337997 >> v2:172.21.15.114:3300/0 conn(0x7f7100070910 0x7f7100070ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f70ff7fe700 1 -- 172.21.15.82:0/290337997 >> v1:172.21.15.82:6789/0 conn(0x7f71001640a0 legacy=0x7f7100164540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:26.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f70feffd700 1 -- 172.21.15.82:0/290337997 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329268486 0 0) 0x7f71000c93a0 con 0x7f71001640a0 2023-11-28T13:01:26.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f70ff7fe700 1 -- 172.21.15.82:0/290337997 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7100071220 con 0x7f71000ad820 2023-11-28T13:01:26.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f70fffff700 1 --2- 172.21.15.82:0/290337997 >> v2:172.21.15.114:3300/0 conn(0x7f7100070910 0x7f7100070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:26.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f70ff7fe700 1 --2- 172.21.15.82:0/290337997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71000ad820 0x7f710006a5d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f71000adeb0 tx=0x7f70e8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35cfca81e2b1ca13 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f70feffd700 1 -- 172.21.15.82:0/290337997 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e8011830 con 0x7f71000ad820 2023-11-28T13:01:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f70feffd700 1 -- 172.21.15.82:0/290337997 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e8011990 con 0x7f71000ad820 2023-11-28T13:01:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f70feffd700 1 -- 172.21.15.82:0/290337997 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e8011d20 con 0x7f71000ad820 2023-11-28T13:01:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f710508b700 1 -- 172.21.15.82:0/290337997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71000ad820 msgr2=0x7f710006a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f710508b700 1 --2- 172.21.15.82:0/290337997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71000ad820 0x7f710006a5d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f71000adeb0 tx=0x7f70e8009b60 comp rx=0 tx=0).stop 2023-11-28T13:01:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f710508b700 1 -- 172.21.15.82:0/290337997 shutdown_connections 2023-11-28T13:01:26.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f710508b700 1 --2- 172.21.15.82:0/290337997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71000ad820 0x7f710006a5d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f710508b700 1 --2- 172.21.15.82:0/290337997 >> v2:172.21.15.114:3300/0 conn(0x7f7100070910 0x7f7100070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f710508b700 1 -- 172.21.15.82:0/290337997 >> 172.21.15.82:0/290337997 conn(0x7f71000ce630 msgr2=0x7f71000cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:26.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f710508b700 1 -- 172.21.15.82:0/290337997 shutdown_connections 2023-11-28T13:01:26.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.503+0000 7f710508b700 1 -- 172.21.15.82:0/290337997 wait complete. 2023-11-28T13:01:26.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f710508b700 1 Processor -- start 2023-11-28T13:01:26.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f710508b700 1 -- start start 2023-11-28T13:01:26.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f710508b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7100070910 0x7f71001f9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:26.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f710508b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71001640a0 0x7f710015d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:26.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f710508b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f710015d5d0 0x7f7100162f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:26.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f710508b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710015eb60 con 0x7f71001640a0 2023-11-28T13:01:26.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f710508b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710015dac0 con 0x7f7100070910 2023-11-28T13:01:26.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f710508b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710015dda0 con 0x7f710015d5d0 2023-11-28T13:01:26.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f70ff7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71001640a0 0x7f710015d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:26.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f70ff7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71001640a0 0x7f710015d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33868/0 (socket says 172.21.15.82:33868) 2023-11-28T13:01:26.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f70ff7fe700 1 -- 172.21.15.82:0/552837342 learned_addr learned my addr 172.21.15.82:0/552837342 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:26.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f70fffff700 1 --2- 172.21.15.82:0/552837342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7100070910 0x7f71001f9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:26.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f710488a700 1 --2- 172.21.15.82:0/552837342 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f710015d5d0 0x7f7100162f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:26.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f70ff7fe700 1 -- 172.21.15.82:0/552837342 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f710015d5d0 msgr2=0x7f7100162f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:26.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f70ff7fe700 1 --2- 172.21.15.82:0/552837342 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f710015d5d0 0x7f7100162f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f70ff7fe700 1 -- 172.21.15.82:0/552837342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7100070910 msgr2=0x7f71001f9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:26.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f70ff7fe700 1 --2- 172.21.15.82:0/552837342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7100070910 0x7f71001f9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f70ff7fe700 1 -- 172.21.15.82:0/552837342 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e80094b0 con 0x7f71001640a0 2023-11-28T13:01:26.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f70ff7fe700 1 --2- 172.21.15.82:0/552837342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71001640a0 0x7f710015d090 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f70e8000c00 tx=0x7f70e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:26.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f70fcff9700 1 -- 172.21.15.82:0/552837342 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e80043c0 con 0x7f71001640a0 2023-11-28T13:01:26.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f70fcff9700 1 -- 172.21.15.82:0/552837342 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e801f070 con 0x7f71001640a0 2023-11-28T13:01:26.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f710508b700 1 -- 172.21.15.82:0/552837342 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710006ade0 con 0x7f71001640a0 2023-11-28T13:01:26.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f70fcff9700 1 -- 172.21.15.82:0/552837342 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e80036c0 con 0x7f71001640a0 2023-11-28T13:01:26.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.507+0000 7f710508b700 1 -- 172.21.15.82:0/552837342 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710006ab10 con 0x7f71001640a0 2023-11-28T13:01:26.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.511+0000 7f710508b700 1 -- 172.21.15.82:0/552837342 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710006b0c0 con 0x7f71001640a0 2023-11-28T13:01:26.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.511+0000 7f70fcff9700 1 -- 172.21.15.82:0/552837342 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f70e802a020 con 0x7f71001640a0 2023-11-28T13:01:26.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.511+0000 7f70fcff9700 1 --2- 172.21.15.82:0/552837342 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f70e4064ee0 0x7f70e4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:26.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.511+0000 7f70fffff700 1 --2- 172.21.15.82:0/552837342 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f70e4064ee0 0x7f70e4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:26.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.511+0000 7f70fcff9700 1 -- 172.21.15.82:0/552837342 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f70e80833b0 con 0x7f71001640a0 2023-11-28T13:01:26.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.511+0000 7f70fffff700 1 --2- 172.21.15.82:0/552837342 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f70e4064ee0 0x7f70e4067390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009fd0 tx=0x7f70f80097f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:26.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.515+0000 7f70fcff9700 1 -- 172.21.15.82:0/552837342 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f70e8051940 con 0x7f71001640a0 2023-11-28T13:01:26.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.671+0000 7f710508b700 1 -- 172.21.15.82:0/552837342 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7100065fc0 con 0x7f71001640a0 2023-11-28T13:01:26.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.671+0000 7f70fcff9700 1 -- 172.21.15.82:0/552837342 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f70e8054f60 con 0x7f71001640a0 2023-11-28T13:01:26.678 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:01:26.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.675+0000 7f710508b700 1 -- 172.21.15.82:0/552837342 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f70e4064ee0 msgr2=0x7f70e4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:26.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.675+0000 7f710508b700 1 --2- 172.21.15.82:0/552837342 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f70e4064ee0 0x7f70e4067390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009fd0 tx=0x7f70f80097f0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.675+0000 7f710508b700 1 -- 172.21.15.82:0/552837342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71001640a0 msgr2=0x7f710015d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:26.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.675+0000 7f710508b700 1 --2- 172.21.15.82:0/552837342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71001640a0 0x7f710015d090 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f70e8000c00 tx=0x7f70e8004770 comp rx=0 tx=0).stop 2023-11-28T13:01:26.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.675+0000 7f710508b700 1 -- 172.21.15.82:0/552837342 shutdown_connections 2023-11-28T13:01:26.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.675+0000 7f710508b700 1 --2- 172.21.15.82:0/552837342 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f70e4064ee0 0x7f70e4067390 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.675+0000 7f710508b700 1 --2- 172.21.15.82:0/552837342 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f710015d5d0 0x7f7100162f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.675+0000 7f710508b700 1 --2- 172.21.15.82:0/552837342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71001640a0 0x7f710015d090 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.675+0000 7f710508b700 1 --2- 172.21.15.82:0/552837342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7100070910 0x7f71001f9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.675+0000 7f710508b700 1 -- 172.21.15.82:0/552837342 >> 172.21.15.82:0/552837342 conn(0x7f71000ce630 msgr2=0x7f71000afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:26.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.675+0000 7f710508b700 1 -- 172.21.15.82:0/552837342 shutdown_connections 2023-11-28T13:01:26.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.675+0000 7f710508b700 1 -- 172.21.15.82:0/552837342 wait complete. 2023-11-28T13:01:26.692 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:01:26.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.807+0000 7f969aeae700 1 Processor -- start 2023-11-28T13:01:26.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.807+0000 7f969aeae700 1 -- start start 2023-11-28T13:01:26.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f969aeae700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f968c00f010 0x7f968c0e3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:26.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f969aeae700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f968c0578c0 0x7f968c0060c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:26.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f969aeae700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968c057430 con 0x7f968c0e03c0 2023-11-28T13:01:26.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f969aeae700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968c0e3e70 con 0x7f968c0578c0 2023-11-28T13:01:26.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f969aeae700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968c053b80 con 0x7f968c00f010 2023-11-28T13:01:26.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f969a6ad700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f968c0578c0 0x7f968c0060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:26.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f96996ab700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f968c00f010 0x7f968c0e3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:26.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f969a6ad700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f968c0578c0 0x7f968c0060c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:42234/0 (socket says 172.21.15.82:42234) 2023-11-28T13:01:26.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f969a6ad700 1 -- 172.21.15.82:0/3291166837 learned_addr learned my addr 172.21.15.82:0/3291166837 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:26.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f96996ab700 1 -- 172.21.15.82:0/3291166837 >> v2:172.21.15.114:3300/0 conn(0x7f968c0578c0 msgr2=0x7f968c0060c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:26.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f96996ab700 1 --2- 172.21.15.82:0/3291166837 >> v2:172.21.15.114:3300/0 conn(0x7f968c0578c0 0x7f968c0060c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f96996ab700 1 -- 172.21.15.82:0/3291166837 >> v1:172.21.15.114:6789/0 conn(0x7f968c0e03c0 legacy=0x7f968c00e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:26.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f96996ab700 1 -- 172.21.15.82:0/3291166837 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c056de0 con 0x7f968c00f010 2023-11-28T13:01:26.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f96996ab700 1 --2- 172.21.15.82:0/3291166837 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f968c00f010 0x7f968c0e3930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9690009850 tx=0x7f9690009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b4a89ab07feaa13 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:26.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f9698eaa700 1 -- 172.21.15.82:0/3291166837 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690011830 con 0x7f968c00f010 2023-11-28T13:01:26.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f9698eaa700 1 -- 172.21.15.82:0/3291166837 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9690011990 con 0x7f968c00f010 2023-11-28T13:01:26.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f9698eaa700 1 -- 172.21.15.82:0/3291166837 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690011d40 con 0x7f968c00f010 2023-11-28T13:01:26.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f969aeae700 1 -- 172.21.15.82:0/3291166837 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f968c00f010 msgr2=0x7f968c0e3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:26.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f969aeae700 1 --2- 172.21.15.82:0/3291166837 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f968c00f010 0x7f968c0e3930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9690009850 tx=0x7f9690009b60 comp rx=0 tx=0).stop 2023-11-28T13:01:26.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f969aeae700 1 -- 172.21.15.82:0/3291166837 shutdown_connections 2023-11-28T13:01:26.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f969aeae700 1 --2- 172.21.15.82:0/3291166837 >> v2:172.21.15.114:3300/0 conn(0x7f968c0578c0 0x7f968c0060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f969aeae700 1 --2- 172.21.15.82:0/3291166837 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f968c00f010 0x7f968c0e3930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f969aeae700 1 -- 172.21.15.82:0/3291166837 >> 172.21.15.82:0/3291166837 conn(0x7f968c059170 msgr2=0x7f968c059570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:26.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f969aeae700 1 -- 172.21.15.82:0/3291166837 shutdown_connections 2023-11-28T13:01:26.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.811+0000 7f969aeae700 1 -- 172.21.15.82:0/3291166837 wait complete. 2023-11-28T13:01:26.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f969aeae700 1 Processor -- start 2023-11-28T13:01:26.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f969aeae700 1 -- start start 2023-11-28T13:01:26.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f969aeae700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f968c00f010 0x7f968c0d7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:26.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f969aeae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f968c0578c0 0x7f968c04f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:26.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f969aeae700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f968c0e03c0 0x7f968c059540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:26.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f969aeae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c03cce0 con 0x7f968c0578c0 2023-11-28T13:01:26.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f969aeae700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c03c0d0 con 0x7f968c0e03c0 2023-11-28T13:01:26.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f969aeae700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968c03c3b0 con 0x7f968c00f010 2023-11-28T13:01:26.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f96996ab700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f968c0578c0 0x7f968c04f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:26.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f96996ab700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f968c0578c0 0x7f968c04f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47394/0 (socket says 172.21.15.82:47394) 2023-11-28T13:01:26.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f96996ab700 1 -- 172.21.15.82:0/4251493969 learned_addr learned my addr 172.21.15.82:0/4251493969 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:26.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f969a6ad700 1 --2- 172.21.15.82:0/4251493969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f968c0e03c0 0x7f968c059540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:26.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f9699eac700 1 --2- 172.21.15.82:0/4251493969 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f968c00f010 0x7f968c0d7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:26.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f96996ab700 1 -- 172.21.15.82:0/4251493969 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f968c00f010 msgr2=0x7f968c0d7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:26.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f96996ab700 1 --2- 172.21.15.82:0/4251493969 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f968c00f010 0x7f968c0d7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f96996ab700 1 -- 172.21.15.82:0/4251493969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f968c0e03c0 msgr2=0x7f968c059540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:26.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f96996ab700 1 --2- 172.21.15.82:0/4251493969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f968c0e03c0 0x7f968c059540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f96996ab700 1 -- 172.21.15.82:0/4251493969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96900094b0 con 0x7f968c0578c0 2023-11-28T13:01:26.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f96996ab700 1 --2- 172.21.15.82:0/4251493969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f968c0578c0 0x7f968c04f4c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f96900090b0 tx=0x7f9690004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:26.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f968a7fc700 1 -- 172.21.15.82:0/4251493969 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96900036c0 con 0x7f968c0578c0 2023-11-28T13:01:26.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f968a7fc700 1 -- 172.21.15.82:0/4251493969 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969001f070 con 0x7f968c0578c0 2023-11-28T13:01:26.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f969aeae700 1 -- 172.21.15.82:0/4251493969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968c057d40 con 0x7f968c0578c0 2023-11-28T13:01:26.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f968a7fc700 1 -- 172.21.15.82:0/4251493969 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690003a60 con 0x7f968c0578c0 2023-11-28T13:01:26.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.815+0000 7f969aeae700 1 -- 172.21.15.82:0/4251493969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968c0570c0 con 0x7f968c0578c0 2023-11-28T13:01:26.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.819+0000 7f969aeae700 1 -- 172.21.15.82:0/4251493969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968c053e60 con 0x7f968c0578c0 2023-11-28T13:01:26.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.819+0000 7f968a7fc700 1 -- 172.21.15.82:0/4251493969 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f969000f050 con 0x7f968c0578c0 2023-11-28T13:01:26.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.819+0000 7f968a7fc700 1 --2- 172.21.15.82:0/4251493969 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9678064f10 0x7f96780673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:26.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.819+0000 7f968a7fc700 1 -- 172.21.15.82:0/4251493969 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9690021070 con 0x7f968c0578c0 2023-11-28T13:01:26.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.819+0000 7f9699eac700 1 --2- 172.21.15.82:0/4251493969 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9678064f10 0x7f96780673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:26.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.819+0000 7f9699eac700 1 --2- 172.21.15.82:0/4251493969 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9678064f10 0x7f96780673c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9684000f60 tx=0x7f9684009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:26.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.827+0000 7f968a7fc700 1 -- 172.21.15.82:0/4251493969 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9690051ac0 con 0x7f968c0578c0 2023-11-28T13:01:26.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.983+0000 7f969aeae700 1 -- 172.21.15.82:0/4251493969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f968c005570 con 0x7f968c0578c0 2023-11-28T13:01:26.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.983+0000 7f968a7fc700 1 -- 172.21.15.82:0/4251493969 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v34) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9690015020 con 0x7f968c0578c0 2023-11-28T13:01:26.988 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:01:26.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.987+0000 7f969aeae700 1 -- 172.21.15.82:0/4251493969 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9678064f10 msgr2=0x7f96780673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:26.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.987+0000 7f969aeae700 1 --2- 172.21.15.82:0/4251493969 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9678064f10 0x7f96780673c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9684000f60 tx=0x7f9684009040 comp rx=0 tx=0).stop 2023-11-28T13:01:26.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.987+0000 7f969aeae700 1 -- 172.21.15.82:0/4251493969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f968c0578c0 msgr2=0x7f968c04f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:26.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.987+0000 7f969aeae700 1 --2- 172.21.15.82:0/4251493969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f968c0578c0 0x7f968c04f4c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f96900090b0 tx=0x7f9690004770 comp rx=0 tx=0).stop 2023-11-28T13:01:26.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.987+0000 7f969aeae700 1 -- 172.21.15.82:0/4251493969 shutdown_connections 2023-11-28T13:01:26.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.987+0000 7f969aeae700 1 --2- 172.21.15.82:0/4251493969 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9678064f10 0x7f96780673c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.987+0000 7f969aeae700 1 --2- 172.21.15.82:0/4251493969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f968c0e03c0 0x7f968c059540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.987+0000 7f969aeae700 1 --2- 172.21.15.82:0/4251493969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f968c0578c0 0x7f968c04f4c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.987+0000 7f969aeae700 1 --2- 172.21.15.82:0/4251493969 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f968c00f010 0x7f968c0d7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:26.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.987+0000 7f969aeae700 1 -- 172.21.15.82:0/4251493969 >> 172.21.15.82:0/4251493969 conn(0x7f968c059170 msgr2=0x7f968c0e2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:26.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.987+0000 7f969aeae700 1 -- 172.21.15.82:0/4251493969 shutdown_connections 2023-11-28T13:01:26.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:26.987+0000 7f969aeae700 1 -- 172.21.15.82:0/4251493969 wait complete. 2023-11-28T13:01:27.003 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T13:01:27.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.103+0000 7f6c50a50700 1 Processor -- start 2023-11-28T13:01:27.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.103+0000 7f6c50a50700 1 -- start start 2023-11-28T13:01:27.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.103+0000 7f6c50a50700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6c4c1591c0 0x7f6c4c15d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:27.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.103+0000 7f6c50a50700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6c4c070070 0x7f6c4c0704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:27.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.103+0000 7f6c50a50700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c4c070a10 con 0x7f6c4c158df0 2023-11-28T13:01:27.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.103+0000 7f6c50a50700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4c15da50 con 0x7f6c4c1591c0 2023-11-28T13:01:27.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.103+0000 7f6c50a50700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4c0c9e20 con 0x7f6c4c070070 2023-11-28T13:01:27.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c4a59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6c4c1591c0 0x7f6c4c15d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:27.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c4a59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6c4c1591c0 0x7f6c4c15d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47400/0 (socket says 172.21.15.82:47400) 2023-11-28T13:01:27.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c4a59c700 1 -- 172.21.15.82:0/2001250744 learned_addr learned my addr 172.21.15.82:0/2001250744 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:27.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c4b59e700 1 --2- 172.21.15.82:0/2001250744 >> v2:172.21.15.114:3300/0 conn(0x7f6c4c070070 0x7f6c4c0704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:27.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c4a59c700 1 -- 172.21.15.82:0/2001250744 >> v2:172.21.15.114:3300/0 conn(0x7f6c4c070070 msgr2=0x7f6c4c0704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:27.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c4a59c700 1 --2- 172.21.15.82:0/2001250744 >> v2:172.21.15.114:3300/0 conn(0x7f6c4c070070 0x7f6c4c0704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:27.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c4a59c700 1 -- 172.21.15.82:0/2001250744 >> v1:172.21.15.114:6789/0 conn(0x7f6c4c158df0 legacy=0x7f6c4c06c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:27.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c4a59c700 1 -- 172.21.15.82:0/2001250744 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c0cc640 con 0x7f6c4c1591c0 2023-11-28T13:01:27.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c4a59c700 1 --2- 172.21.15.82:0/2001250744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4c1591c0 0x7f6c4c15d510 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c06fe20 tx=0x7f6c34009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f46adb79568f96 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:27.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c49d9b700 1 -- 172.21.15.82:0/2001250744 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c34004230 con 0x7f6c4c1591c0 2023-11-28T13:01:27.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c49d9b700 1 -- 172.21.15.82:0/2001250744 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c34004390 con 0x7f6c4c1591c0 2023-11-28T13:01:27.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c49d9b700 1 -- 172.21.15.82:0/2001250744 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c340036c0 con 0x7f6c4c1591c0 2023-11-28T13:01:27.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c50a50700 1 -- 172.21.15.82:0/2001250744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4c1591c0 msgr2=0x7f6c4c15d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:27.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c50a50700 1 --2- 172.21.15.82:0/2001250744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4c1591c0 0x7f6c4c15d510 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c06fe20 tx=0x7f6c34009bf0 comp rx=0 tx=0).stop 2023-11-28T13:01:27.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c50a50700 1 -- 172.21.15.82:0/2001250744 shutdown_connections 2023-11-28T13:01:27.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c50a50700 1 --2- 172.21.15.82:0/2001250744 >> v2:172.21.15.114:3300/0 conn(0x7f6c4c070070 0x7f6c4c0704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:27.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c50a50700 1 --2- 172.21.15.82:0/2001250744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4c1591c0 0x7f6c4c15d510 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:27.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c50a50700 1 -- 172.21.15.82:0/2001250744 >> 172.21.15.82:0/2001250744 conn(0x7f6c4c0ce600 msgr2=0x7f6c4c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:27.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c50a50700 1 -- 172.21.15.82:0/2001250744 shutdown_connections 2023-11-28T13:01:27.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c50a50700 1 -- 172.21.15.82:0/2001250744 wait complete. 2023-11-28T13:01:27.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c50a50700 1 Processor -- start 2023-11-28T13:01:27.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.107+0000 7f6c50a50700 1 -- start start 2023-11-28T13:01:27.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c50a50700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c4c070070 0x7f6c4c0c3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:27.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c50a50700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4c158df0 0x7f6c4c0c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:27.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c50a50700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c4c1591c0 0x7f6c4c157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:27.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c50a50700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c1f0740 con 0x7f6c4c158df0 2023-11-28T13:01:27.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c50a50700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c0c43d0 con 0x7f6c4c070070 2023-11-28T13:01:27.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c50a50700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c157a70 con 0x7f6c4c1591c0 2023-11-28T13:01:27.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c4a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4c158df0 0x7f6c4c0c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:27.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c4a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4c158df0 0x7f6c4c0c3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47404/0 (socket says 172.21.15.82:47404) 2023-11-28T13:01:27.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c4a59c700 1 -- 172.21.15.82:0/4035315333 learned_addr learned my addr 172.21.15.82:0/4035315333 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:27.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c4ad9d700 1 --2- 172.21.15.82:0/4035315333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c4c070070 0x7f6c4c0c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:27.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c4b59e700 1 --2- 172.21.15.82:0/4035315333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c4c1591c0 0x7f6c4c157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:27.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c4a59c700 1 -- 172.21.15.82:0/4035315333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c4c1591c0 msgr2=0x7f6c4c157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:27.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c4a59c700 1 --2- 172.21.15.82:0/4035315333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c4c1591c0 0x7f6c4c157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:27.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c4a59c700 1 -- 172.21.15.82:0/4035315333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c4c070070 msgr2=0x7f6c4c0c3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:27.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c4a59c700 1 --2- 172.21.15.82:0/4035315333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c4c070070 0x7f6c4c0c3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:27.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c4a59c700 1 -- 172.21.15.82:0/4035315333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c34009570 con 0x7f6c4c158df0 2023-11-28T13:01:27.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c4ad9d700 1 --2- 172.21.15.82:0/4035315333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c4c070070 0x7f6c4c0c3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:27.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c4a59c700 1 --2- 172.21.15.82:0/4035315333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4c158df0 0x7f6c4c0c3e90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6c34004000 tx=0x7f6c34004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:27.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c437fe700 1 -- 172.21.15.82:0/4035315333 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c340036e0 con 0x7f6c4c158df0 2023-11-28T13:01:27.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c50a50700 1 -- 172.21.15.82:0/4035315333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4c0c9ab0 con 0x7f6c4c158df0 2023-11-28T13:01:27.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c437fe700 1 -- 172.21.15.82:0/4035315333 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3401f070 con 0x7f6c4c158df0 2023-11-28T13:01:27.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c50a50700 1 -- 172.21.15.82:0/4035315333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4c0c97d0 con 0x7f6c4c158df0 2023-11-28T13:01:27.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.111+0000 7f6c437fe700 1 -- 172.21.15.82:0/4035315333 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3400b860 con 0x7f6c4c158df0 2023-11-28T13:01:27.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.115+0000 7f6c50a50700 1 -- 172.21.15.82:0/4035315333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4c0c9480 con 0x7f6c4c158df0 2023-11-28T13:01:27.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.115+0000 7f6c437fe700 1 -- 172.21.15.82:0/4035315333 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6c3402a020 con 0x7f6c4c158df0 2023-11-28T13:01:27.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.115+0000 7f6c437fe700 1 --2- 172.21.15.82:0/4035315333 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c2c064ee0 0x7f6c2c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:27.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.115+0000 7f6c4ad9d700 1 --2- 172.21.15.82:0/4035315333 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c2c064ee0 0x7f6c2c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:27.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.115+0000 7f6c437fe700 1 -- 172.21.15.82:0/4035315333 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6c340835c0 con 0x7f6c4c158df0 2023-11-28T13:01:27.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.115+0000 7f6c4ad9d700 1 --2- 172.21.15.82:0/4035315333 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c2c064ee0 0x7f6c2c067390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c00e270 tx=0x7f6c3c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:27.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.119+0000 7f6c437fe700 1 -- 172.21.15.82:0/4035315333 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6c34051940 con 0x7f6c4c158df0 2023-11-28T13:01:27.196 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:01:27.198 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:01:27.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.283+0000 7f6c50a50700 1 -- 172.21.15.82:0/4035315333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6c4c0c9480 con 0x7f6c4c158df0 2023-11-28T13:01:27.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.283+0000 7f6c437fe700 1 -- 172.21.15.82:0/4035315333 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+126 (secure 0 0 0) 0x7f6c34003e60 con 0x7f6c4c158df0 2023-11-28T13:01:27.289 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:27.289 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-11-28T13:01:27.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:27.290 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2023-11-28T13:01:27.290 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2023-11-28T13:01:27.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:27.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:01:27.291 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 2, 2023-11-28T13:01:27.291 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "rbd" 2023-11-28T13:01:27.291 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:27.291 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-11-28T13:01:27.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.287+0000 7f6c50a50700 1 -- 172.21.15.82:0/4035315333 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c2c064ee0 msgr2=0x7f6c2c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:27.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.287+0000 7f6c50a50700 1 --2- 172.21.15.82:0/4035315333 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c2c064ee0 0x7f6c2c067390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c00e270 tx=0x7f6c3c009040 comp rx=0 tx=0).stop 2023-11-28T13:01:27.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.287+0000 7f6c50a50700 1 -- 172.21.15.82:0/4035315333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4c158df0 msgr2=0x7f6c4c0c3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:27.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.287+0000 7f6c50a50700 1 --2- 172.21.15.82:0/4035315333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4c158df0 0x7f6c4c0c3e90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6c34004000 tx=0x7f6c34004770 comp rx=0 tx=0).stop 2023-11-28T13:01:27.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.287+0000 7f6c50a50700 1 -- 172.21.15.82:0/4035315333 shutdown_connections 2023-11-28T13:01:27.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.287+0000 7f6c50a50700 1 --2- 172.21.15.82:0/4035315333 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c2c064ee0 0x7f6c2c067390 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:27.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.287+0000 7f6c50a50700 1 --2- 172.21.15.82:0/4035315333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c4c1591c0 0x7f6c4c157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:27.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.287+0000 7f6c50a50700 1 --2- 172.21.15.82:0/4035315333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4c158df0 0x7f6c4c0c3e90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:27.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.287+0000 7f6c50a50700 1 --2- 172.21.15.82:0/4035315333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c4c070070 0x7f6c4c0c3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:27.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.287+0000 7f6c50a50700 1 -- 172.21.15.82:0/4035315333 >> 172.21.15.82:0/4035315333 conn(0x7f6c4c0ce600 msgr2=0x7f6c4c0b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:27.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.287+0000 7f6c50a50700 1 -- 172.21.15.82:0/4035315333 shutdown_connections 2023-11-28T13:01:27.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.287+0000 7f6c50a50700 1 -- 172.21.15.82:0/4035315333 wait complete. 2023-11-28T13:01:27.304 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T13:01:27.304 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T13:01:27.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.419+0000 7f753cd29700 1 Processor -- start 2023-11-28T13:01:27.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.419+0000 7f753cd29700 1 -- start start 2023-11-28T13:01:27.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f753cd29700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f75380b1830 0x7f75380c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:27.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f753cd29700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753815a4b0 con 0x7f753806a420 2023-11-28T13:01:27.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f753cd29700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753815dfb0 con 0x7f753815a0e0 2023-11-28T13:01:27.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f753cd29700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f753815eb50 con 0x7f75380b1830 2023-11-28T13:01:27.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f7537fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f75380b1830 0x7f75380c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:27.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f752effd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f753806a420 0x7f75380b1120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52236/0 (socket says 172.21.15.82:52236) 2023-11-28T13:01:27.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f752effd700 1 -- 172.21.15.82:0/1301926543 learned_addr learned my addr 172.21.15.82:0/1301926543 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:27.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f7537fff700 1 -- 172.21.15.82:0/1301926543 >> v1:172.21.15.114:6789/0 conn(0x7f753815a0e0 legacy=0x7f753815e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:27.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f7537fff700 1 -- 172.21.15.82:0/1301926543 >> v1:172.21.15.82:6789/0 conn(0x7f753806a420 legacy=0x7f75380b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:27.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f7536ffd700 1 -- 172.21.15.82:0/1301926543 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176364058 0 0) 0x7f753815a4b0 con 0x7f753806a420 2023-11-28T13:01:27.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f7537fff700 1 -- 172.21.15.82:0/1301926543 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753806a990 con 0x7f75380b1830 2023-11-28T13:01:27.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f7537fff700 1 --2- 172.21.15.82:0/1301926543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75380b1830 0x7f75380c9cf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7530009d90 tx=0x7f753000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2bf536e1315eb5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:27.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f7536ffd700 1 -- 172.21.15.82:0/1301926543 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753000e070 con 0x7f75380b1830 2023-11-28T13:01:27.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f7536ffd700 1 -- 172.21.15.82:0/1301926543 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753000bbd0 con 0x7f75380b1830 2023-11-28T13:01:27.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f7536ffd700 1 -- 172.21.15.82:0/1301926543 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7530012430 con 0x7f75380b1830 2023-11-28T13:01:27.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f753cd29700 1 -- 172.21.15.82:0/1301926543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75380b1830 msgr2=0x7f75380c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:27.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f753cd29700 1 --2- 172.21.15.82:0/1301926543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75380b1830 0x7f75380c9cf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7530009d90 tx=0x7f753000b330 comp rx=0 tx=0).stop 2023-11-28T13:01:27.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f753cd29700 1 -- 172.21.15.82:0/1301926543 shutdown_connections 2023-11-28T13:01:27.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f753cd29700 1 --2- 172.21.15.82:0/1301926543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75380b1830 0x7f75380c9cf0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:27.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f753cd29700 1 -- 172.21.15.82:0/1301926543 >> 172.21.15.82:0/1301926543 conn(0x7f75380cc120 msgr2=0x7f75380cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:27.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f753cd29700 1 -- 172.21.15.82:0/1301926543 shutdown_connections 2023-11-28T13:01:27.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.423+0000 7f753cd29700 1 -- 172.21.15.82:0/1301926543 wait complete. 2023-11-28T13:01:27.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.427+0000 7f753cd29700 1 Processor -- start 2023-11-28T13:01:27.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.427+0000 7f753cd29700 1 -- start start 2023-11-28T13:01:27.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.427+0000 7f753cd29700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f753806a420 0x7f75381542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:27.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.427+0000 7f753cd29700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75380b1830 0x7f75380b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:27.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.427+0000 7f753cd29700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f753815a0e0 0x7f7538158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.427+0000 7f753cd29700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753815b6b0 con 0x7f75380b1830 2023-11-28T13:01:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.427+0000 7f753cd29700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753815b900 con 0x7f753815a0e0 2023-11-28T13:01:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.427+0000 7f753cd29700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753815bbe0 con 0x7f753806a420 2023-11-28T13:01:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.427+0000 7f752effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75380b1830 0x7f75380b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.427+0000 7f752effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75380b1830 0x7f75380b24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47416/0 (socket says 172.21.15.82:47416) 2023-11-28T13:01:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.427+0000 7f752effd700 1 -- 172.21.15.82:0/1521585649 learned_addr learned my addr 172.21.15.82:0/1521585649 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.427+0000 7f7537fff700 1 --2- 172.21.15.82:0/1521585649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f753815a0e0 0x7f7538158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.427+0000 7f75377fe700 1 --2- 172.21.15.82:0/1521585649 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f753806a420 0x7f75381542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.431+0000 7f752effd700 1 -- 172.21.15.82:0/1521585649 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f753806a420 msgr2=0x7f75381542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.431+0000 7f752effd700 1 --2- 172.21.15.82:0/1521585649 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f753806a420 0x7f75381542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:27.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.431+0000 7f752effd700 1 -- 172.21.15.82:0/1521585649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f753815a0e0 msgr2=0x7f7538158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:27.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.431+0000 7f752effd700 1 --2- 172.21.15.82:0/1521585649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f753815a0e0 0x7f7538158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:27.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.431+0000 7f752effd700 1 -- 172.21.15.82:0/1521585649 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7530009a70 con 0x7f75380b1830 2023-11-28T13:01:27.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.431+0000 7f752effd700 1 --2- 172.21.15.82:0/1521585649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75380b1830 0x7f75380b24d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f752000c550 tx=0x7f752000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:27.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.431+0000 7f7534ff9700 1 -- 172.21.15.82:0/1521585649 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520004ca0 con 0x7f75380b1830 2023-11-28T13:01:27.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.431+0000 7f7534ff9700 1 -- 172.21.15.82:0/1521585649 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7520004e00 con 0x7f75380b1830 2023-11-28T13:01:27.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.431+0000 7f753cd29700 1 -- 172.21.15.82:0/1521585649 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753815dc40 con 0x7f75380b1830 2023-11-28T13:01:27.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.431+0000 7f7534ff9700 1 -- 172.21.15.82:0/1521585649 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520007310 con 0x7f75380b1830 2023-11-28T13:01:27.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.431+0000 7f753cd29700 1 -- 172.21.15.82:0/1521585649 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753806ac70 con 0x7f75380b1830 2023-11-28T13:01:27.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.431+0000 7f753cd29700 1 -- 172.21.15.82:0/1521585649 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7538065fc0 con 0x7f75380b1830 2023-11-28T13:01:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.431+0000 7f7534ff9700 1 -- 172.21.15.82:0/1521585649 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f752001a020 con 0x7f75380b1830 2023-11-28T13:01:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.431+0000 7f7534ff9700 1 --2- 172.21.15.82:0/1521585649 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f751c064ee0 0x7f751c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:27.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.435+0000 7f75377fe700 1 --2- 172.21.15.82:0/1521585649 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f751c064ee0 0x7f751c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:27.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.435+0000 7f7534ff9700 1 -- 172.21.15.82:0/1521585649 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7520081610 con 0x7f75380b1830 2023-11-28T13:01:27.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.435+0000 7f75377fe700 1 --2- 172.21.15.82:0/1521585649 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f751c064ee0 0x7f751c067390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7528000f60 tx=0x7f7528009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:27.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.443+0000 7f7534ff9700 1 -- 172.21.15.82:0/1521585649 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f752004fb00 con 0x7f75380b1830 2023-11-28T13:01:27.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:27.603+0000 7f753cd29700 1 -- 172.21.15.82:0/1521585649 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7538143c40 con 0x7f75380b1830 2023-11-28T13:01:28.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.199+0000 7f7534ff9700 1 -- 172.21.15.82:0/1521585649 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7520053120 con 0x7f75380b1830 2023-11-28T13:01:28.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.207+0000 7f753cd29700 1 -- 172.21.15.82:0/1521585649 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f751c064ee0 msgr2=0x7f751c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.207+0000 7f753cd29700 1 --2- 172.21.15.82:0/1521585649 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f751c064ee0 0x7f751c067390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7528000f60 tx=0x7f7528009040 comp rx=0 tx=0).stop 2023-11-28T13:01:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.207+0000 7f753cd29700 1 -- 172.21.15.82:0/1521585649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75380b1830 msgr2=0x7f75380b24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.207+0000 7f753cd29700 1 --2- 172.21.15.82:0/1521585649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75380b1830 0x7f75380b24d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f752000c550 tx=0x7f752000c860 comp rx=0 tx=0).stop 2023-11-28T13:01:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.207+0000 7f753cd29700 1 -- 172.21.15.82:0/1521585649 shutdown_connections 2023-11-28T13:01:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.207+0000 7f753cd29700 1 --2- 172.21.15.82:0/1521585649 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f751c064ee0 0x7f751c067390 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:28.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.207+0000 7f753cd29700 1 --2- 172.21.15.82:0/1521585649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f753815a0e0 0x7f7538158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:28.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.207+0000 7f753cd29700 1 --2- 172.21.15.82:0/1521585649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75380b1830 0x7f75380b24d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:28.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.207+0000 7f753cd29700 1 --2- 172.21.15.82:0/1521585649 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f753806a420 0x7f75381542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:28.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.207+0000 7f753cd29700 1 -- 172.21.15.82:0/1521585649 >> 172.21.15.82:0/1521585649 conn(0x7f75380cc120 msgr2=0x7f75380b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:28.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.207+0000 7f753cd29700 1 -- 172.21.15.82:0/1521585649 shutdown_connections 2023-11-28T13:01:28.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.207+0000 7f753cd29700 1 -- 172.21.15.82:0/1521585649 wait complete. 2023-11-28T13:01:28.216 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2023-11-28T13:01:28.229 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T13:01:28.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.351+0000 7feb9b59e700 1 Processor -- start 2023-11-28T13:01:28.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.351+0000 7feb9b59e700 1 -- start start 2023-11-28T13:01:28.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.351+0000 7feb9b59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feb9c0cf060 0x7feb9c1607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:28.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.351+0000 7feb9b59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feb9c0caaa0 0x7feb9c15c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:28.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.351+0000 7feb9b59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9c15d840 con 0x7feb9c15cd90 2023-11-28T13:01:28.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.351+0000 7feb9b59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9c06a450 con 0x7feb9c0cf060 2023-11-28T13:01:28.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.351+0000 7feb9b59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9c15d280 con 0x7feb9c0caaa0 2023-11-28T13:01:28.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb9a59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feb9c0cf060 0x7feb9c1607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:28.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb9ad9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7feb9c15cd90 0x7feb9c071110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52244/0 (socket says 172.21.15.82:52244) 2023-11-28T13:01:28.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb9ad9d700 1 -- 172.21.15.82:0/950039360 learned_addr learned my addr 172.21.15.82:0/950039360 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:28.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb99d9b700 1 --2- 172.21.15.82:0/950039360 >> v2:172.21.15.114:3300/0 conn(0x7feb9c0caaa0 0x7feb9c15c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:28.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb9a59c700 1 -- 172.21.15.82:0/950039360 >> v2:172.21.15.114:3300/0 conn(0x7feb9c0caaa0 msgr2=0x7feb9c15c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:28.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb9959a700 1 -- 172.21.15.82:0/950039360 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527817862 0 0) 0x7feb9c15d840 con 0x7feb9c15cd90 2023-11-28T13:01:28.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb9a59c700 1 --2- 172.21.15.82:0/950039360 >> v2:172.21.15.114:3300/0 conn(0x7feb9c0caaa0 0x7feb9c15c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:28.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb9a59c700 1 -- 172.21.15.82:0/950039360 >> v1:172.21.15.82:6789/0 conn(0x7feb9c15cd90 legacy=0x7feb9c071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:28.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb9a59c700 1 -- 172.21.15.82:0/950039360 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c15d560 con 0x7feb9c0cf060 2023-11-28T13:01:28.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb9a59c700 1 --2- 172.21.15.82:0/950039360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb9c0cf060 0x7feb9c1607c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0d0460 tx=0x7feb94009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa57de53542ed190 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:28.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb9959a700 1 -- 172.21.15.82:0/950039360 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94011830 con 0x7feb9c0cf060 2023-11-28T13:01:28.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb9959a700 1 -- 172.21.15.82:0/950039360 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb94011990 con 0x7feb9c0cf060 2023-11-28T13:01:28.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb9959a700 1 -- 172.21.15.82:0/950039360 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94011d20 con 0x7feb9c0cf060 2023-11-28T13:01:28.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb9b59e700 1 -- 172.21.15.82:0/950039360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb9c0cf060 msgr2=0x7feb9c1607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:28.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb9b59e700 1 --2- 172.21.15.82:0/950039360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb9c0cf060 0x7feb9c1607c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0d0460 tx=0x7feb94009b30 comp rx=0 tx=0).stop 2023-11-28T13:01:28.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb9b59e700 1 -- 172.21.15.82:0/950039360 shutdown_connections 2023-11-28T13:01:28.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb9b59e700 1 --2- 172.21.15.82:0/950039360 >> v2:172.21.15.114:3300/0 conn(0x7feb9c0caaa0 0x7feb9c15c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:28.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb9b59e700 1 --2- 172.21.15.82:0/950039360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb9c0cf060 0x7feb9c1607c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:28.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb9b59e700 1 -- 172.21.15.82:0/950039360 >> 172.21.15.82:0/950039360 conn(0x7feb9c0b1f50 msgr2=0x7feb9c0cf790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:28.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb9b59e700 1 -- 172.21.15.82:0/950039360 shutdown_connections 2023-11-28T13:01:28.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb9b59e700 1 -- 172.21.15.82:0/950039360 wait complete. 2023-11-28T13:01:28.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.355+0000 7feb9b59e700 1 Processor -- start 2023-11-28T13:01:28.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb9b59e700 1 -- start start 2023-11-28T13:01:28.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb9b59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb9c0caaa0 0x7feb9c1560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:28.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb9b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb9c0cf060 0x7feb9c0c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:28.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb9b59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb9c15cd90 0x7feb9c15f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:28.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb9b59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c158930 con 0x7feb9c0cf060 2023-11-28T13:01:28.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb9b59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c15da10 con 0x7feb9c0caaa0 2023-11-28T13:01:28.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb9b59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0c8ed0 con 0x7feb9c15cd90 2023-11-28T13:01:28.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb99d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb9c0cf060 0x7feb9c0c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:28.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb99d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb9c0cf060 0x7feb9c0c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47430/0 (socket says 172.21.15.82:47430) 2023-11-28T13:01:28.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb99d9b700 1 -- 172.21.15.82:0/284087725 learned_addr learned my addr 172.21.15.82:0/284087725 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:28.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb9a59c700 1 --2- 172.21.15.82:0/284087725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb9c0caaa0 0x7feb9c1560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:28.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb9ad9d700 1 --2- 172.21.15.82:0/284087725 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb9c15cd90 0x7feb9c15f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:28.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb99d9b700 1 -- 172.21.15.82:0/284087725 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb9c15cd90 msgr2=0x7feb9c15f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:28.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb99d9b700 1 --2- 172.21.15.82:0/284087725 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb9c15cd90 0x7feb9c15f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:28.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb99d9b700 1 -- 172.21.15.82:0/284087725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb9c0caaa0 msgr2=0x7feb9c1560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:28.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb99d9b700 1 --2- 172.21.15.82:0/284087725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb9c0caaa0 0x7feb9c1560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:28.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb99d9b700 1 -- 172.21.15.82:0/284087725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb940094b0 con 0x7feb9c0cf060 2023-11-28T13:01:28.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb9ad9d700 1 --2- 172.21.15.82:0/284087725 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb9c15cd90 0x7feb9c15f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:01:28.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb9a59c700 1 --2- 172.21.15.82:0/284087725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb9c0caaa0 0x7feb9c1560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:28.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb99d9b700 1 --2- 172.21.15.82:0/284087725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb9c0cf060 0x7feb9c0c8810 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7feb8400e9d0 tx=0x7feb8400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:28.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb92ffd700 1 -- 172.21.15.82:0/284087725 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb84009720 con 0x7feb9c0cf060 2023-11-28T13:01:28.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb92ffd700 1 -- 172.21.15.82:0/284087725 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8400c850 con 0x7feb9c0cf060 2023-11-28T13:01:28.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb9b59e700 1 -- 172.21.15.82:0/284087725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9c1602a0 con 0x7feb9c0cf060 2023-11-28T13:01:28.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb92ffd700 1 -- 172.21.15.82:0/284087725 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8400cbc0 con 0x7feb9c0cf060 2023-11-28T13:01:28.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.359+0000 7feb9b59e700 1 -- 172.21.15.82:0/284087725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9c15ffc0 con 0x7feb9c0cf060 2023-11-28T13:01:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.363+0000 7feb9b59e700 1 -- 172.21.15.82:0/284087725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9c160d00 con 0x7feb9c0cf060 2023-11-28T13:01:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.363+0000 7feb92ffd700 1 -- 172.21.15.82:0/284087725 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7feb84019030 con 0x7feb9c0cf060 2023-11-28T13:01:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.363+0000 7feb92ffd700 1 --2- 172.21.15.82:0/284087725 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feb7c064ee0 0x7feb7c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.363+0000 7feb92ffd700 1 -- 172.21.15.82:0/284087725 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5580+0+0 (secure 0 0 0) 0x7feb84081ce0 con 0x7feb9c0cf060 2023-11-28T13:01:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.363+0000 7feb9a59c700 1 --2- 172.21.15.82:0/284087725 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feb7c064ee0 0x7feb7c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:28.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.363+0000 7feb9a59c700 1 --2- 172.21.15.82:0/284087725 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feb7c064ee0 0x7feb7c067390 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feb94000c00 tx=0x7feb94008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:28.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.371+0000 7feb92ffd700 1 -- 172.21.15.82:0/284087725 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7feb84050060 con 0x7feb9c0cf060 2023-11-28T13:01:28.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:28.535+0000 7feb9b59e700 1 -- 172.21.15.82:0/284087725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7feb9c065fc0 con 0x7feb9c0cf060 2023-11-28T13:01:29.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.215+0000 7feb92ffd700 1 -- 172.21.15.82:0/284087725 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7feb84053680 con 0x7feb9c0cf060 2023-11-28T13:01:29.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.231+0000 7feb9b59e700 1 -- 172.21.15.82:0/284087725 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feb7c064ee0 msgr2=0x7feb7c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:29.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.231+0000 7feb9b59e700 1 --2- 172.21.15.82:0/284087725 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feb7c064ee0 0x7feb7c067390 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feb94000c00 tx=0x7feb94008030 comp rx=0 tx=0).stop 2023-11-28T13:01:29.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.231+0000 7feb9b59e700 1 -- 172.21.15.82:0/284087725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb9c0cf060 msgr2=0x7feb9c0c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:29.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.231+0000 7feb9b59e700 1 --2- 172.21.15.82:0/284087725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb9c0cf060 0x7feb9c0c8810 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7feb8400e9d0 tx=0x7feb8400ed90 comp rx=0 tx=0).stop 2023-11-28T13:01:29.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.235+0000 7feb9b59e700 1 -- 172.21.15.82:0/284087725 shutdown_connections 2023-11-28T13:01:29.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.235+0000 7feb9b59e700 1 --2- 172.21.15.82:0/284087725 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feb7c064ee0 0x7feb7c067390 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:29.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.235+0000 7feb9b59e700 1 --2- 172.21.15.82:0/284087725 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb9c15cd90 0x7feb9c15f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:29.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.235+0000 7feb9b59e700 1 --2- 172.21.15.82:0/284087725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb9c0cf060 0x7feb9c0c8810 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:29.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.235+0000 7feb9b59e700 1 --2- 172.21.15.82:0/284087725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb9c0caaa0 0x7feb9c1560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:29.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.235+0000 7feb9b59e700 1 -- 172.21.15.82:0/284087725 >> 172.21.15.82:0/284087725 conn(0x7feb9c0b1f50 msgr2=0x7feb9c0cf760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:29.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.235+0000 7feb9b59e700 1 -- 172.21.15.82:0/284087725 shutdown_connections 2023-11-28T13:01:29.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.235+0000 7feb9b59e700 1 -- 172.21.15.82:0/284087725 wait complete. 2023-11-28T13:01:29.250 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2023-11-28T13:01:29.254 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T13:01:29.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.359+0000 7f2316522700 1 Processor -- start 2023-11-28T13:01:29.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.363+0000 7f2316522700 1 -- start start 2023-11-28T13:01:29.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.363+0000 7f2316522700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f23100d25b0 0x7f23100cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:29.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.363+0000 7f2316522700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2310069bc0 con 0x7f23100b1d10 2023-11-28T13:01:29.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.363+0000 7f2316522700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23100d1480 con 0x7f231006c140 2023-11-28T13:01:29.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.363+0000 7f2316522700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23100cd280 con 0x7f23100d25b0 2023-11-28T13:01:29.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.363+0000 7f2315d21700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f23100d25b0 0x7f23100cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:29.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.363+0000 7f2315d21700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f23100d25b0 0x7f23100cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47438/0 (socket says 172.21.15.82:47438) 2023-11-28T13:01:29.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.363+0000 7f2315d21700 1 -- 172.21.15.82:0/3449749296 learned_addr learned my addr 172.21.15.82:0/3449749296 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:29.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.363+0000 7f2315520700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f23100b1d10 0x7f231006ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52252/0 (socket says 172.21.15.82:52252) 2023-11-28T13:01:29.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.363+0000 7f2315d21700 1 -- 172.21.15.82:0/3449749296 >> v1:172.21.15.114:6789/0 conn(0x7f231006c140 legacy=0x7f231006a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:29.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.363+0000 7f2315d21700 1 -- 172.21.15.82:0/3449749296 >> v1:172.21.15.82:6789/0 conn(0x7f23100b1d10 legacy=0x7f231006ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:29.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.363+0000 7f2303fff700 1 -- 172.21.15.82:0/3449749296 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153884850 0 0) 0x7f2310069bc0 con 0x7f23100b1d10 2023-11-28T13:01:29.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.363+0000 7f2315d21700 1 -- 172.21.15.82:0/3449749296 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23100cd560 con 0x7f23100d25b0 2023-11-28T13:01:29.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.363+0000 7f2315d21700 1 --2- 172.21.15.82:0/3449749296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23100d25b0 0x7f23100cec20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2308009e50 tx=0x7f230800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978bb5744c3f782b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:29.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.363+0000 7f2303fff700 1 -- 172.21.15.82:0/3449749296 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230800e070 con 0x7f23100d25b0 2023-11-28T13:01:29.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.363+0000 7f2303fff700 1 -- 172.21.15.82:0/3449749296 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230800b9c0 con 0x7f23100d25b0 2023-11-28T13:01:29.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.363+0000 7f2303fff700 1 -- 172.21.15.82:0/3449749296 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230800bd70 con 0x7f23100d25b0 2023-11-28T13:01:29.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.367+0000 7f2316522700 1 -- 172.21.15.82:0/3449749296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23100d25b0 msgr2=0x7f23100cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:29.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.367+0000 7f2316522700 1 --2- 172.21.15.82:0/3449749296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23100d25b0 0x7f23100cec20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2308009e50 tx=0x7f230800b330 comp rx=0 tx=0).stop 2023-11-28T13:01:29.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.367+0000 7f2316522700 1 -- 172.21.15.82:0/3449749296 shutdown_connections 2023-11-28T13:01:29.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.367+0000 7f2316522700 1 --2- 172.21.15.82:0/3449749296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23100d25b0 0x7f23100cec20 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:29.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.367+0000 7f2316522700 1 -- 172.21.15.82:0/3449749296 >> 172.21.15.82:0/3449749296 conn(0x7f23100b52a0 msgr2=0x7f23100d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:29.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.367+0000 7f2316522700 1 -- 172.21.15.82:0/3449749296 shutdown_connections 2023-11-28T13:01:29.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.367+0000 7f2316522700 1 -- 172.21.15.82:0/3449749296 wait complete. 2023-11-28T13:01:29.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.367+0000 7f2316522700 1 Processor -- start 2023-11-28T13:01:29.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.367+0000 7f2316522700 1 -- start start 2023-11-28T13:01:29.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.367+0000 7f2316522700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f231006c140 0x7f231015e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:29.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.367+0000 7f2316522700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23100b1d10 0x7f231015edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:29.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.367+0000 7f2316522700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23100d25b0 0x7f23101f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:29.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.367+0000 7f2316522700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231014adb0 con 0x7f23100d25b0 2023-11-28T13:01:29.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.367+0000 7f2316522700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23100a95b0 con 0x7f231006c140 2023-11-28T13:01:29.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.367+0000 7f2316522700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231014db70 con 0x7f23100b1d10 2023-11-28T13:01:29.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.367+0000 7f2315d21700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23100d25b0 0x7f23101f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:29.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.367+0000 7f2315d21700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23100d25b0 0x7f23101f4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47442/0 (socket says 172.21.15.82:47442) 2023-11-28T13:01:29.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.367+0000 7f2315d21700 1 -- 172.21.15.82:0/3688720949 learned_addr learned my addr 172.21.15.82:0/3688720949 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:29.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.367+0000 7f2315520700 1 --2- 172.21.15.82:0/3688720949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f231006c140 0x7f231015e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:29.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.371+0000 7f2314d1f700 1 --2- 172.21.15.82:0/3688720949 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23100b1d10 0x7f231015edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.371+0000 7f2315d21700 1 -- 172.21.15.82:0/3688720949 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23100b1d10 msgr2=0x7f231015edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.371+0000 7f2315d21700 1 --2- 172.21.15.82:0/3688720949 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23100b1d10 0x7f231015edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.371+0000 7f2315d21700 1 -- 172.21.15.82:0/3688720949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f231006c140 msgr2=0x7f231015e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.371+0000 7f2315d21700 1 --2- 172.21.15.82:0/3688720949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f231006c140 0x7f231015e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.371+0000 7f2315d21700 1 -- 172.21.15.82:0/3688720949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2308009b30 con 0x7f23100d25b0 2023-11-28T13:01:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.371+0000 7f2315d21700 1 --2- 172.21.15.82:0/3688720949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23100d25b0 0x7f23101f4fb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f230800b370 tx=0x7f2308004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.371+0000 7f2301ffb700 1 -- 172.21.15.82:0/3688720949 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23080092e0 con 0x7f23100d25b0 2023-11-28T13:01:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.371+0000 7f2301ffb700 1 -- 172.21.15.82:0/3688720949 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230801b430 con 0x7f23100d25b0 2023-11-28T13:01:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.371+0000 7f2316522700 1 -- 172.21.15.82:0/3688720949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23100d1050 con 0x7f23100d25b0 2023-11-28T13:01:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.371+0000 7f2301ffb700 1 -- 172.21.15.82:0/3688720949 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230801b7e0 con 0x7f23100d25b0 2023-11-28T13:01:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.371+0000 7f2316522700 1 -- 172.21.15.82:0/3688720949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23100b20e0 con 0x7f23100d25b0 2023-11-28T13:01:29.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.371+0000 7f2316522700 1 -- 172.21.15.82:0/3688720949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23100d11e0 con 0x7f23100d25b0 2023-11-28T13:01:29.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.371+0000 7f2301ffb700 1 -- 172.21.15.82:0/3688720949 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2308021030 con 0x7f23100d25b0 2023-11-28T13:01:29.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.375+0000 7f2301ffb700 1 --2- 172.21.15.82:0/3688720949 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f22f4064ee0 0x7f22f4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:29.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.375+0000 7f2301ffb700 1 -- 172.21.15.82:0/3688720949 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f2308083540 con 0x7f23100d25b0 2023-11-28T13:01:29.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.375+0000 7f2315520700 1 --2- 172.21.15.82:0/3688720949 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f22f4064ee0 0x7f22f4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:29.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.375+0000 7f2315520700 1 --2- 172.21.15.82:0/3688720949 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f22f4064ee0 0x7f22f4067390 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f230c000f60 tx=0x7f230c007c60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:29.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.379+0000 7f2301ffb700 1 -- 172.21.15.82:0/3688720949 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2308051740 con 0x7f23100d25b0 2023-11-28T13:01:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.579+0000 7f2316522700 1 -- 172.21.15.82:0/3688720949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2310065fc0 con 0x7f23100d25b0 2023-11-28T13:01:29.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.591+0000 7f2301ffb700 1 -- 172.21.15.82:0/3688720949 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2308054d60 con 0x7f23100d25b0 2023-11-28T13:01:29.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.595+0000 7f2316522700 1 -- 172.21.15.82:0/3688720949 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f22f4064ee0 msgr2=0x7f22f4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:29.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.595+0000 7f2316522700 1 --2- 172.21.15.82:0/3688720949 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f22f4064ee0 0x7f22f4067390 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f230c000f60 tx=0x7f230c007c60 comp rx=0 tx=0).stop 2023-11-28T13:01:29.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.595+0000 7f2316522700 1 -- 172.21.15.82:0/3688720949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23100d25b0 msgr2=0x7f23101f4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:29.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.595+0000 7f2316522700 1 --2- 172.21.15.82:0/3688720949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23100d25b0 0x7f23101f4fb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f230800b370 tx=0x7f2308004af0 comp rx=0 tx=0).stop 2023-11-28T13:01:29.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.595+0000 7f2316522700 1 -- 172.21.15.82:0/3688720949 shutdown_connections 2023-11-28T13:01:29.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.595+0000 7f2316522700 1 --2- 172.21.15.82:0/3688720949 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f22f4064ee0 0x7f22f4067390 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:29.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.595+0000 7f2316522700 1 --2- 172.21.15.82:0/3688720949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23100d25b0 0x7f23101f4fb0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:29.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.595+0000 7f2316522700 1 --2- 172.21.15.82:0/3688720949 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23100b1d10 0x7f231015edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:29.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.595+0000 7f2316522700 1 --2- 172.21.15.82:0/3688720949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f231006c140 0x7f231015e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:29.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.595+0000 7f2316522700 1 -- 172.21.15.82:0/3688720949 >> 172.21.15.82:0/3688720949 conn(0x7f23100b52a0 msgr2=0x7f23100b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:29.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.595+0000 7f2316522700 1 -- 172.21.15.82:0/3688720949 shutdown_connections 2023-11-28T13:01:29.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.595+0000 7f2316522700 1 -- 172.21.15.82:0/3688720949 wait complete. 2023-11-28T13:01:29.608 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 5 and data pool 6 2023-11-28T13:01:29.628 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:01:29.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.723+0000 7f5fd6705700 1 Processor -- start 2023-11-28T13:01:29.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.723+0000 7f5fd6705700 1 -- start start 2023-11-28T13:01:29.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.723+0000 7f5fd6705700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5fd01591c0 0x7f5fd015d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:29.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.723+0000 7f5fd6705700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5fd0070070 0x7f5fd00704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:29.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.723+0000 7f5fd6705700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd015da50 con 0x7f5fd0158df0 2023-11-28T13:01:29.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.723+0000 7f5fd6705700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd0070a30 con 0x7f5fd01591c0 2023-11-28T13:01:29.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.723+0000 7f5fd6705700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd00c9e20 con 0x7f5fd0070070 2023-11-28T13:01:29.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.723+0000 7f5fd5703700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5fd0158df0 0x7f5fd006c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52260/0 (socket says 172.21.15.82:52260) 2023-11-28T13:01:29.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.723+0000 7f5fd5703700 1 -- 172.21.15.82:0/197415614 learned_addr learned my addr 172.21.15.82:0/197415614 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:29.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.723+0000 7f5fd5f04700 1 --2- 172.21.15.82:0/197415614 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5fd0070070 0x7f5fd00704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:29.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.723+0000 7f5fd4f02700 1 --2- 172.21.15.82:0/197415614 >> v2:172.21.15.114:3300/0 conn(0x7f5fd01591c0 0x7f5fd015d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:29.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.723+0000 7f5fc7fff700 1 -- 172.21.15.82:0/197415614 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28048910 0 0) 0x7f5fc8001490 con 0x7f5fd0158df0 2023-11-28T13:01:29.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.723+0000 7f5fc7fff700 1 -- 172.21.15.82:0/197415614 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fbc0035d0 con 0x7f5fd0158df0 2023-11-28T13:01:29.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.723+0000 7f5fc7fff700 1 -- 172.21.15.82:0/197415614 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3462367737 0 0) 0x7f5fbc0035d0 con 0x7f5fd0158df0 2023-11-28T13:01:29.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.723+0000 7f5fd5f04700 1 -- 172.21.15.82:0/197415614 >> v2:172.21.15.114:3300/0 conn(0x7f5fd01591c0 msgr2=0x7f5fd015d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:29.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.723+0000 7f5fd5f04700 1 --2- 172.21.15.82:0/197415614 >> v2:172.21.15.114:3300/0 conn(0x7f5fd01591c0 0x7f5fd015d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:29.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.723+0000 7f5fd5f04700 1 -- 172.21.15.82:0/197415614 >> v1:172.21.15.82:6789/0 conn(0x7f5fd0158df0 legacy=0x7f5fd006c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:29.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.723+0000 7f5fd5f04700 1 -- 172.21.15.82:0/197415614 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd00cc640 con 0x7f5fd0070070 2023-11-28T13:01:29.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.727+0000 7f5fd5f04700 1 --2- 172.21.15.82:0/197415614 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5fd0070070 0x7f5fd00704f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009850 tx=0x7f5fcc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f21ab7baa7c155e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.727+0000 7f5fc7fff700 1 -- 172.21.15.82:0/197415614 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8001b80 con 0x7f5fd0070070 2023-11-28T13:01:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.727+0000 7f5fc7fff700 1 -- 172.21.15.82:0/197415614 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc004030 con 0x7f5fd0070070 2023-11-28T13:01:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.727+0000 7f5fc7fff700 1 -- 172.21.15.82:0/197415614 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc0043e0 con 0x7f5fd0070070 2023-11-28T13:01:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.727+0000 7f5fd6705700 1 -- 172.21.15.82:0/197415614 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5fd0070070 msgr2=0x7f5fd00704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.727+0000 7f5fd6705700 1 --2- 172.21.15.82:0/197415614 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5fd0070070 0x7f5fd00704f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009850 tx=0x7f5fcc009b60 comp rx=0 tx=0).stop 2023-11-28T13:01:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.727+0000 7f5fd6705700 1 -- 172.21.15.82:0/197415614 shutdown_connections 2023-11-28T13:01:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.727+0000 7f5fd6705700 1 --2- 172.21.15.82:0/197415614 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5fd0070070 0x7f5fd00704f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.727+0000 7f5fd6705700 1 --2- 172.21.15.82:0/197415614 >> v2:172.21.15.114:3300/0 conn(0x7f5fd01591c0 0x7f5fd015d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.727+0000 7f5fd6705700 1 -- 172.21.15.82:0/197415614 >> 172.21.15.82:0/197415614 conn(0x7f5fd00ce600 msgr2=0x7f5fd00ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.727+0000 7f5fd6705700 1 -- 172.21.15.82:0/197415614 shutdown_connections 2023-11-28T13:01:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.727+0000 7f5fd6705700 1 -- 172.21.15.82:0/197415614 wait complete. 2023-11-28T13:01:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.727+0000 7f5fd6705700 1 Processor -- start 2023-11-28T13:01:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.727+0000 7f5fd6705700 1 -- start start 2023-11-28T13:01:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fd6705700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fd0070070 0x7f5fd01537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fd6705700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5fd0158df0 0x7f5fd0156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fd6705700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fd01591c0 0x7f5fd0152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fd6705700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd0157190 con 0x7f5fd0070070 2023-11-28T13:01:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fd6705700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd01f1e30 con 0x7f5fd01591c0 2023-11-28T13:01:29.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fd6705700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd0156170 con 0x7f5fd0158df0 2023-11-28T13:01:29.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fd5703700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fd0070070 0x7f5fd01537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:29.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fd5703700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fd0070070 0x7f5fd01537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47458/0 (socket says 172.21.15.82:47458) 2023-11-28T13:01:29.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fd5703700 1 -- 172.21.15.82:0/1814137712 learned_addr learned my addr 172.21.15.82:0/1814137712 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:29.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fd4f02700 1 --2- 172.21.15.82:0/1814137712 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5fd0158df0 0x7f5fd0156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:29.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fd5f04700 1 --2- 172.21.15.82:0/1814137712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fd01591c0 0x7f5fd0152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:29.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fd5703700 1 -- 172.21.15.82:0/1814137712 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5fd0158df0 msgr2=0x7f5fd0156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:29.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fd5703700 1 --2- 172.21.15.82:0/1814137712 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5fd0158df0 0x7f5fd0156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:29.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fd5703700 1 -- 172.21.15.82:0/1814137712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fd01591c0 msgr2=0x7f5fd0152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:29.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fd5703700 1 --2- 172.21.15.82:0/1814137712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fd01591c0 0x7f5fd0152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:29.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fd5703700 1 -- 172.21.15.82:0/1814137712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc0094b0 con 0x7f5fd0070070 2023-11-28T13:01:29.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fd5703700 1 --2- 172.21.15.82:0/1814137712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fd0070070 0x7f5fd01537c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8001b10 tx=0x7f5fc800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:29.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fc5ffb700 1 -- 172.21.15.82:0/1814137712 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc800ada0 con 0x7f5fd0070070 2023-11-28T13:01:29.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fc5ffb700 1 -- 172.21.15.82:0/1814137712 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc80070d0 con 0x7f5fd0070070 2023-11-28T13:01:29.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fd6705700 1 -- 172.21.15.82:0/1814137712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd00c9ab0 con 0x7f5fd0070070 2023-11-28T13:01:29.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fc5ffb700 1 -- 172.21.15.82:0/1814137712 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8007480 con 0x7f5fd0070070 2023-11-28T13:01:29.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fd6705700 1 -- 172.21.15.82:0/1814137712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd00c97d0 con 0x7f5fd0070070 2023-11-28T13:01:29.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fd6705700 1 -- 172.21.15.82:0/1814137712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd00c9480 con 0x7f5fd0070070 2023-11-28T13:01:29.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fc5ffb700 1 -- 172.21.15.82:0/1814137712 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5fc801a030 con 0x7f5fd0070070 2023-11-28T13:01:29.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fc5ffb700 1 --2- 172.21.15.82:0/1814137712 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5fb4064ee0 0x7f5fb4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:29.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fd4f02700 1 --2- 172.21.15.82:0/1814137712 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5fb4064ee0 0x7f5fb4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:29.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.731+0000 7f5fc5ffb700 1 -- 172.21.15.82:0/1814137712 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5fc8081c60 con 0x7f5fd0070070 2023-11-28T13:01:29.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.735+0000 7f5fd4f02700 1 --2- 172.21.15.82:0/1814137712 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5fb4064ee0 0x7f5fb4067390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00c82f0 tx=0x7f5fc000f040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.739+0000 7f5fc5ffb700 1 -- 172.21.15.82:0/1814137712 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5fc804fe00 con 0x7f5fd0070070 2023-11-28T13:01:29.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.903+0000 7f5fd6705700 1 -- 172.21.15.82:0/1814137712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fd015da50 con 0x7f5fd0070070 2023-11-28T13:01:29.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.907+0000 7f5fc5ffb700 1 -- 172.21.15.82:0/1814137712 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+17896 (secure 0 0 0) 0x7f5fd015da50 con 0x7f5fd0070070 2023-11-28T13:01:29.912 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:29.912 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":37,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:01:29.585189+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:01:27.651123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T13:01:28.580057+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:01:29.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.907+0000 7f5fd6705700 1 -- 172.21.15.82:0/1814137712 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5fb4064ee0 msgr2=0x7f5fb4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:29.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.907+0000 7f5fd6705700 1 --2- 172.21.15.82:0/1814137712 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5fb4064ee0 0x7f5fb4067390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00c82f0 tx=0x7f5fc000f040 comp rx=0 tx=0).stop 2023-11-28T13:01:29.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.907+0000 7f5fd6705700 1 -- 172.21.15.82:0/1814137712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fd0070070 msgr2=0x7f5fd01537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:29.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.907+0000 7f5fd6705700 1 --2- 172.21.15.82:0/1814137712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fd0070070 0x7f5fd01537c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8001b10 tx=0x7f5fc800a340 comp rx=0 tx=0).stop 2023-11-28T13:01:29.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.907+0000 7f5fd6705700 1 -- 172.21.15.82:0/1814137712 shutdown_connections 2023-11-28T13:01:29.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.907+0000 7f5fd6705700 1 --2- 172.21.15.82:0/1814137712 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5fb4064ee0 0x7f5fb4067390 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:29.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.907+0000 7f5fd6705700 1 --2- 172.21.15.82:0/1814137712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fd01591c0 0x7f5fd0152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:29.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.907+0000 7f5fd6705700 1 --2- 172.21.15.82:0/1814137712 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5fd0158df0 0x7f5fd0156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:29.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.907+0000 7f5fd6705700 1 --2- 172.21.15.82:0/1814137712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fd0070070 0x7f5fd01537c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:29.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.907+0000 7f5fd6705700 1 -- 172.21.15.82:0/1814137712 >> 172.21.15.82:0/1814137712 conn(0x7f5fd00ce600 msgr2=0x7f5fd00b16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:29.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.907+0000 7f5fd6705700 1 -- 172.21.15.82:0/1814137712 shutdown_connections 2023-11-28T13:01:29.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:29.907+0000 7f5fd6705700 1 -- 172.21.15.82:0/1814137712 wait complete. 2023-11-28T13:01:29.927 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:01:30.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e9a4700 1 Processor -- start 2023-11-28T13:01:30.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e9a4700 1 -- start start 2023-11-28T13:01:30.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e9a4700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f38780aea40 0x7f387806b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:30.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e9a4700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f387806dae0 0x7f387806bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:30.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e9a4700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38780aeed0 con 0x7f387815c710 2023-11-28T13:01:30.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e9a4700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387815ce60 con 0x7f387806dae0 2023-11-28T13:01:30.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e9a4700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387815d140 con 0x7f38780aea40 2023-11-28T13:01:30.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e1a3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f387806dae0 0x7f387806bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:30.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e1a3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f387806dae0 0x7f387806bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47462/0 (socket says 172.21.15.82:47462) 2023-11-28T13:01:30.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e1a3700 1 -- 172.21.15.82:0/1199127316 learned_addr learned my addr 172.21.15.82:0/1199127316 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:30.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387d1a1700 1 --2- 172.21.15.82:0/1199127316 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f38780aea40 0x7f387806b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:30.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e1a3700 1 -- 172.21.15.82:0/1199127316 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f38780aea40 msgr2=0x7f387806b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:30.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e1a3700 1 --2- 172.21.15.82:0/1199127316 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f38780aea40 0x7f387806b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:30.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e1a3700 1 -- 172.21.15.82:0/1199127316 >> v1:172.21.15.114:6789/0 conn(0x7f387815c710 legacy=0x7f387806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:30.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e1a3700 1 -- 172.21.15.82:0/1199127316 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387815d420 con 0x7f387806dae0 2023-11-28T13:01:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e1a3700 1 --2- 172.21.15.82:0/1199127316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f387806dae0 0x7f387806bc70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3870009e50 tx=0x7f387000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6425ab37398251de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387c9a0700 1 -- 172.21.15.82:0/1199127316 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387000bb10 con 0x7f387806dae0 2023-11-28T13:01:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387c9a0700 1 -- 172.21.15.82:0/1199127316 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387000bc70 con 0x7f387806dae0 2023-11-28T13:01:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387c9a0700 1 -- 172.21.15.82:0/1199127316 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3870011460 con 0x7f387806dae0 2023-11-28T13:01:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e9a4700 1 -- 172.21.15.82:0/1199127316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f387806dae0 msgr2=0x7f387806bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e9a4700 1 --2- 172.21.15.82:0/1199127316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f387806dae0 0x7f387806bc70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3870009e50 tx=0x7f387000b330 comp rx=0 tx=0).stop 2023-11-28T13:01:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e9a4700 1 -- 172.21.15.82:0/1199127316 shutdown_connections 2023-11-28T13:01:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e9a4700 1 --2- 172.21.15.82:0/1199127316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f387806dae0 0x7f387806bc70 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e9a4700 1 --2- 172.21.15.82:0/1199127316 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f38780aea40 0x7f387806b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e9a4700 1 -- 172.21.15.82:0/1199127316 >> 172.21.15.82:0/1199127316 conn(0x7f38780cce90 msgr2=0x7f38780cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e9a4700 1 -- 172.21.15.82:0/1199127316 shutdown_connections 2023-11-28T13:01:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.043+0000 7f387e9a4700 1 -- 172.21.15.82:0/1199127316 wait complete. 2023-11-28T13:01:30.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.047+0000 7f387e9a4700 1 Processor -- start 2023-11-28T13:01:30.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.047+0000 7f387e9a4700 1 -- start start 2023-11-28T13:01:30.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.047+0000 7f387e9a4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f387806dae0 0x7f38780cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:30.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.047+0000 7f387e9a4700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38780aea40 0x7f38780c2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:30.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.047+0000 7f387e9a4700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f387815c710 0x7f38780c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:30.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.047+0000 7f387e9a4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38781416a0 con 0x7f387806dae0 2023-11-28T13:01:30.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.047+0000 7f387e9a4700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3878141c60 con 0x7f38780aea40 2023-11-28T13:01:30.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.047+0000 7f387e9a4700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38780c5ca0 con 0x7f387815c710 2023-11-28T13:01:30.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.047+0000 7f387d9a2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f387806dae0 0x7f38780cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.047+0000 7f387d1a1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38780aea40 0x7f38780c2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.047+0000 7f387d9a2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f387806dae0 0x7f38780cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47478/0 (socket says 172.21.15.82:47478) 2023-11-28T13:01:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.047+0000 7f387d9a2700 1 -- 172.21.15.82:0/2964753466 learned_addr learned my addr 172.21.15.82:0/2964753466 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.047+0000 7f387e1a3700 1 --2- 172.21.15.82:0/2964753466 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f387815c710 0x7f38780c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.047+0000 7f387d9a2700 1 -- 172.21.15.82:0/2964753466 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f387815c710 msgr2=0x7f38780c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.047+0000 7f387d9a2700 1 --2- 172.21.15.82:0/2964753466 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f387815c710 0x7f38780c5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.047+0000 7f387d9a2700 1 -- 172.21.15.82:0/2964753466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38780aea40 msgr2=0x7f38780c2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.047+0000 7f387d9a2700 1 --2- 172.21.15.82:0/2964753466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38780aea40 0x7f38780c2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.047+0000 7f387d9a2700 1 -- 172.21.15.82:0/2964753466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3870009b30 con 0x7f387806dae0 2023-11-28T13:01:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.047+0000 7f387d9a2700 1 --2- 172.21.15.82:0/2964753466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f387806dae0 0x7f38780cbb70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f386800c530 tx=0x7f386800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.051+0000 7f386e7fc700 1 -- 172.21.15.82:0/2964753466 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386800cea0 con 0x7f387806dae0 2023-11-28T13:01:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.051+0000 7f386e7fc700 1 -- 172.21.15.82:0/2964753466 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38680052d0 con 0x7f387806dae0 2023-11-28T13:01:30.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.051+0000 7f387e9a4700 1 -- 172.21.15.82:0/2964753466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387815cae0 con 0x7f387806dae0 2023-11-28T13:01:30.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.051+0000 7f386e7fc700 1 -- 172.21.15.82:0/2964753466 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38680036a0 con 0x7f387806dae0 2023-11-28T13:01:30.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.051+0000 7f387e9a4700 1 -- 172.21.15.82:0/2964753466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38780cd620 con 0x7f387806dae0 2023-11-28T13:01:30.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.051+0000 7f387e9a4700 1 -- 172.21.15.82:0/2964753466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387815d940 con 0x7f387806dae0 2023-11-28T13:01:30.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.051+0000 7f386e7fc700 1 -- 172.21.15.82:0/2964753466 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3868019030 con 0x7f387806dae0 2023-11-28T13:01:30.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.055+0000 7f386e7fc700 1 --2- 172.21.15.82:0/2964753466 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f385c064ee0 0x7f385c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:30.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.055+0000 7f387d1a1700 1 --2- 172.21.15.82:0/2964753466 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f385c064ee0 0x7f385c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:30.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.055+0000 7f386e7fc700 1 -- 172.21.15.82:0/2964753466 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f38680811d0 con 0x7f387806dae0 2023-11-28T13:01:30.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.055+0000 7f387d1a1700 1 --2- 172.21.15.82:0/2964753466 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f385c064ee0 0x7f385c067390 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f387806b0a0 tx=0x7f3874009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:30.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.063+0000 7f386e7fc700 1 -- 172.21.15.82:0/2964753466 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f386804f1a0 con 0x7f387806dae0 2023-11-28T13:01:30.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.227+0000 7f387e9a4700 1 -- 172.21.15.82:0/2964753466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3878065fc0 con 0x7f387806dae0 2023-11-28T13:01:30.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.227+0000 7f386e7fc700 1 -- 172.21.15.82:0/2964753466 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+17896 (secure 0 0 0) 0x7f38680527c0 con 0x7f387806dae0 2023-11-28T13:01:30.234 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:30.234 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":37,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:01:29.585189+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:01:27.651123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T13:01:28.580057+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:01:30.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.231+0000 7f387e9a4700 1 -- 172.21.15.82:0/2964753466 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f385c064ee0 msgr2=0x7f385c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:30.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.231+0000 7f387e9a4700 1 --2- 172.21.15.82:0/2964753466 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f385c064ee0 0x7f385c067390 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f387806b0a0 tx=0x7f3874009240 comp rx=0 tx=0).stop 2023-11-28T13:01:30.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.231+0000 7f387e9a4700 1 -- 172.21.15.82:0/2964753466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f387806dae0 msgr2=0x7f38780cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.231+0000 7f387e9a4700 1 --2- 172.21.15.82:0/2964753466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f387806dae0 0x7f38780cbb70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f386800c530 tx=0x7f386800c840 comp rx=0 tx=0).stop 2023-11-28T13:01:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.231+0000 7f387e9a4700 1 -- 172.21.15.82:0/2964753466 shutdown_connections 2023-11-28T13:01:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.231+0000 7f387e9a4700 1 --2- 172.21.15.82:0/2964753466 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f385c064ee0 0x7f385c067390 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.231+0000 7f387e9a4700 1 --2- 172.21.15.82:0/2964753466 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f387815c710 0x7f38780c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.231+0000 7f387e9a4700 1 --2- 172.21.15.82:0/2964753466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38780aea40 0x7f38780c2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.231+0000 7f387e9a4700 1 --2- 172.21.15.82:0/2964753466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f387806dae0 0x7f38780cbb70 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.231+0000 7f387e9a4700 1 -- 172.21.15.82:0/2964753466 >> 172.21.15.82:0/2964753466 conn(0x7f38780cce90 msgr2=0x7f38780ca9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.231+0000 7f387e9a4700 1 -- 172.21.15.82:0/2964753466 shutdown_connections 2023-11-28T13:01:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.231+0000 7f387e9a4700 1 -- 172.21.15.82:0/2964753466 wait complete. 2023-11-28T13:01:30.249 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T13:01:30.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.367+0000 7f08bbfff700 1 Processor -- start 2023-11-28T13:01:30.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.367+0000 7f08bbfff700 1 -- start start 2023-11-28T13:01:30.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.367+0000 7f08bbfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f08bc158720 0x7f08bc0b0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:30.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.367+0000 7f08bbfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f08bc06a450 0x7f08bc06a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:30.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.367+0000 7f08bbfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08bc069bc0 0x7f08bc071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:30.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.367+0000 7f08bbfff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08bc06ae30 con 0x7f08bc158720 2023-11-28T13:01:30.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.367+0000 7f08bbfff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08bc0b0790 con 0x7f08bc06a450 2023-11-28T13:01:30.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.367+0000 7f08bbfff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc158af0 con 0x7f08bc069bc0 2023-11-28T13:01:30.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.367+0000 7f08baffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f08bc158720 0x7f08bc0b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:30.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.367+0000 7f08baffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f08bc158720 0x7f08bc0b0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47490/0 (socket says 172.21.15.82:47490) 2023-11-28T13:01:30.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.367+0000 7f08ba7fc700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f08bc06a450 0x7f08bc06a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:30.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.367+0000 7f08bb7fe700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08bc069bc0 0x7f08bc071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:30.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.367+0000 7f08baffd700 1 -- 172.21.15.82:0/4150126358 learned_addr learned my addr 172.21.15.82:0/4150126358 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:30.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.371+0000 7f08baffd700 1 -- 172.21.15.82:0/4150126358 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08bc069bc0 msgr2=0x7f08bc071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:30.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.371+0000 7f08baffd700 1 --2- 172.21.15.82:0/4150126358 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08bc069bc0 0x7f08bc071130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:30.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.371+0000 7f08baffd700 1 -- 172.21.15.82:0/4150126358 >> v2:172.21.15.114:3300/0 conn(0x7f08bc06a450 msgr2=0x7f08bc06a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:30.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.371+0000 7f08baffd700 1 --2- 172.21.15.82:0/4150126358 >> v2:172.21.15.114:3300/0 conn(0x7f08bc06a450 0x7f08bc06a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:30.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.371+0000 7f08baffd700 1 -- 172.21.15.82:0/4150126358 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc0af490 con 0x7f08bc158720 2023-11-28T13:01:30.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.371+0000 7f08ba7fc700 1 --2- 172.21.15.82:0/4150126358 >> v2:172.21.15.114:3300/0 conn(0x7f08bc06a450 0x7f08bc06a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:30.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.371+0000 7f08baffd700 1 --2- 172.21.15.82:0/4150126358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08bc158720 0x7f08bc0b0250 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0cf530 tx=0x7f08a400be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8791484a8837c65 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:30.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.371+0000 7f08b9ffb700 1 -- 172.21.15.82:0/4150126358 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a400dd30 con 0x7f08bc158720 2023-11-28T13:01:30.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.371+0000 7f08b9ffb700 1 -- 172.21.15.82:0/4150126358 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a400de90 con 0x7f08bc158720 2023-11-28T13:01:30.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.371+0000 7f08b9ffb700 1 -- 172.21.15.82:0/4150126358 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4010690 con 0x7f08bc158720 2023-11-28T13:01:30.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.371+0000 7f08bbfff700 1 -- 172.21.15.82:0/4150126358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08bc158720 msgr2=0x7f08bc0b0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:30.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.371+0000 7f08bbfff700 1 --2- 172.21.15.82:0/4150126358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08bc158720 0x7f08bc0b0250 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0cf530 tx=0x7f08a400be90 comp rx=0 tx=0).stop 2023-11-28T13:01:30.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.371+0000 7f08bbfff700 1 -- 172.21.15.82:0/4150126358 shutdown_connections 2023-11-28T13:01:30.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.371+0000 7f08bbfff700 1 --2- 172.21.15.82:0/4150126358 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08bc069bc0 0x7f08bc071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:30.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.371+0000 7f08bbfff700 1 --2- 172.21.15.82:0/4150126358 >> v2:172.21.15.114:3300/0 conn(0x7f08bc06a450 0x7f08bc06a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:30.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.371+0000 7f08bbfff700 1 --2- 172.21.15.82:0/4150126358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08bc158720 0x7f08bc0b0250 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:30.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.371+0000 7f08bbfff700 1 -- 172.21.15.82:0/4150126358 >> 172.21.15.82:0/4150126358 conn(0x7f08bc0ce630 msgr2=0x7f08bc0cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:30.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.371+0000 7f08bbfff700 1 -- 172.21.15.82:0/4150126358 shutdown_connections 2023-11-28T13:01:30.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.371+0000 7f08bbfff700 1 -- 172.21.15.82:0/4150126358 wait complete. 2023-11-28T13:01:30.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.371+0000 7f08bbfff700 1 Processor -- start 2023-11-28T13:01:30.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.371+0000 7f08bbfff700 1 -- start start 2023-11-28T13:01:30.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08bbfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08bc069bc0 0x7f08bc13f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:30.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08bbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08bc06a450 0x7f08bc138bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:30.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08bbfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08bc158720 0x7f08bc139110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:30.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08bbfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc155e70 con 0x7f08bc06a450 2023-11-28T13:01:30.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08bbfff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc155b90 con 0x7f08bc158720 2023-11-28T13:01:30.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08bbfff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc13ce40 con 0x7f08bc069bc0 2023-11-28T13:01:30.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08ba7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08bc06a450 0x7f08bc138bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:30.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08ba7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08bc06a450 0x7f08bc138bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47500/0 (socket says 172.21.15.82:47500) 2023-11-28T13:01:30.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08ba7fc700 1 -- 172.21.15.82:0/1234870247 learned_addr learned my addr 172.21.15.82:0/1234870247 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:30.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08baffd700 1 --2- 172.21.15.82:0/1234870247 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08bc069bc0 0x7f08bc13f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:30.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08bb7fe700 1 --2- 172.21.15.82:0/1234870247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08bc158720 0x7f08bc139110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:30.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08ba7fc700 1 -- 172.21.15.82:0/1234870247 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08bc069bc0 msgr2=0x7f08bc13f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:30.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08ba7fc700 1 --2- 172.21.15.82:0/1234870247 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08bc069bc0 0x7f08bc13f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:30.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08ba7fc700 1 -- 172.21.15.82:0/1234870247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08bc158720 msgr2=0x7f08bc139110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:30.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08ba7fc700 1 --2- 172.21.15.82:0/1234870247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08bc158720 0x7f08bc139110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:30.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08ba7fc700 1 -- 172.21.15.82:0/1234870247 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ac0094b0 con 0x7f08bc06a450 2023-11-28T13:01:30.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08bb7fe700 1 --2- 172.21.15.82:0/1234870247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08bc158720 0x7f08bc139110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:01:30.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08ba7fc700 1 --2- 172.21.15.82:0/1234870247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08bc06a450 0x7f08bc138bd0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00ebe0 tx=0x7f08ac009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:30.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08b37fe700 1 -- 172.21.15.82:0/1234870247 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac00c910 con 0x7f08bc06a450 2023-11-28T13:01:30.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08b37fe700 1 -- 172.21.15.82:0/1234870247 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac00ca70 con 0x7f08bc06a450 2023-11-28T13:01:30.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08bbfff700 1 -- 172.21.15.82:0/1234870247 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a400b810 con 0x7f08bc06a450 2023-11-28T13:01:30.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08b37fe700 1 -- 172.21.15.82:0/1234870247 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac00ce00 con 0x7f08bc06a450 2023-11-28T13:01:30.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.375+0000 7f08bbfff700 1 -- 172.21.15.82:0/1234870247 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc0afa50 con 0x7f08bc06a450 2023-11-28T13:01:30.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.379+0000 7f08bbfff700 1 -- 172.21.15.82:0/1234870247 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08bc0af770 con 0x7f08bc06a450 2023-11-28T13:01:30.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.379+0000 7f08b37fe700 1 -- 172.21.15.82:0/1234870247 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f08ac019030 con 0x7f08bc06a450 2023-11-28T13:01:30.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.379+0000 7f08b37fe700 1 --2- 172.21.15.82:0/1234870247 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f089c064ee0 0x7f089c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:30.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.379+0000 7f08b37fe700 1 -- 172.21.15.82:0/1234870247 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f08ac0820a0 con 0x7f08bc06a450 2023-11-28T13:01:30.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.379+0000 7f08baffd700 1 --2- 172.21.15.82:0/1234870247 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f089c064ee0 0x7f089c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:30.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.379+0000 7f08baffd700 1 --2- 172.21.15.82:0/1234870247 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f089c064ee0 0x7f089c067390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f08a4000c00 tx=0x7f08a4013000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:30.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.387+0000 7f08b37fe700 1 -- 172.21.15.82:0/1234870247 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f08ac0500d0 con 0x7f08bc06a450 2023-11-28T13:01:30.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:30.587+0000 7f08bbfff700 1 -- 172.21.15.82:0/1234870247 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f08bc0afd30 con 0x7f08bc06a450 2023-11-28T13:01:31.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.607+0000 7f08b37fe700 1 -- 172.21.15.82:0/1234870247 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7f08ac0536f0 con 0x7f08bc06a450 2023-11-28T13:01:31.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.611+0000 7f08bbfff700 1 -- 172.21.15.82:0/1234870247 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f089c064ee0 msgr2=0x7f089c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:31.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.611+0000 7f08bbfff700 1 --2- 172.21.15.82:0/1234870247 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f089c064ee0 0x7f089c067390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f08a4000c00 tx=0x7f08a4013000 comp rx=0 tx=0).stop 2023-11-28T13:01:31.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.611+0000 7f08bbfff700 1 -- 172.21.15.82:0/1234870247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08bc06a450 msgr2=0x7f08bc138bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:31.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.611+0000 7f08bbfff700 1 --2- 172.21.15.82:0/1234870247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08bc06a450 0x7f08bc138bd0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00ebe0 tx=0x7f08ac009ed0 comp rx=0 tx=0).stop 2023-11-28T13:01:31.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.611+0000 7f08bbfff700 1 -- 172.21.15.82:0/1234870247 shutdown_connections 2023-11-28T13:01:31.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.611+0000 7f08bbfff700 1 --2- 172.21.15.82:0/1234870247 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f089c064ee0 0x7f089c067390 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:31.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.611+0000 7f08bbfff700 1 --2- 172.21.15.82:0/1234870247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08bc158720 0x7f08bc139110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:31.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.611+0000 7f08bbfff700 1 --2- 172.21.15.82:0/1234870247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08bc06a450 0x7f08bc138bd0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:31.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.611+0000 7f08bbfff700 1 --2- 172.21.15.82:0/1234870247 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08bc069bc0 0x7f08bc13f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:31.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.611+0000 7f08bbfff700 1 -- 172.21.15.82:0/1234870247 >> 172.21.15.82:0/1234870247 conn(0x7f08bc0ce630 msgr2=0x7f08bc158cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:31.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.611+0000 7f08bbfff700 1 -- 172.21.15.82:0/1234870247 shutdown_connections 2023-11-28T13:01:31.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.611+0000 7f08bbfff700 1 -- 172.21.15.82:0/1234870247 wait complete. 2023-11-28T13:01:31.633 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T13:01:31.633 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T13:01:31.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e332bf700 1 Processor -- start 2023-11-28T13:01:31.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e332bf700 1 -- start start 2023-11-28T13:01:31.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e332bf700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5e2c156c50 0x7f5e2c159f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:31.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e332bf700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5e2c06e2d0 0x7f5e2c069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:31.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e332bf700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e2c0b2330 con 0x7f5e2c0b1de0 2023-11-28T13:01:31.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e332bf700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e2c0b3400 con 0x7f5e2c06e2d0 2023-11-28T13:01:31.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e332bf700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c15a480 con 0x7f5e2c156c50 2023-11-28T13:01:31.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e31abc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5e2c0b1de0 0x7f5e2c06dbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52276/0 (socket says 172.21.15.82:52276) 2023-11-28T13:01:31.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e31abc700 1 -- 172.21.15.82:0/1227326572 learned_addr learned my addr 172.21.15.82:0/1227326572 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:31.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e32abe700 1 --2- 172.21.15.82:0/1227326572 >> v2:172.21.15.114:3300/0 conn(0x7f5e2c06e2d0 0x7f5e2c069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:31.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e322bd700 1 --2- 172.21.15.82:0/1227326572 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5e2c156c50 0x7f5e2c159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:31.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e312bb700 1 -- 172.21.15.82:0/1227326572 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1872937687 0 0) 0x7f5e2c0b2330 con 0x7f5e2c0b1de0 2023-11-28T13:01:31.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e312bb700 1 -- 172.21.15.82:0/1227326572 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e180035d0 con 0x7f5e2c0b1de0 2023-11-28T13:01:31.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e32abe700 1 -- 172.21.15.82:0/1227326572 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5e2c156c50 msgr2=0x7f5e2c159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:31.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e32abe700 1 --2- 172.21.15.82:0/1227326572 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5e2c156c50 0x7f5e2c159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:31.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e32abe700 1 -- 172.21.15.82:0/1227326572 >> v1:172.21.15.82:6789/0 conn(0x7f5e2c0b1de0 legacy=0x7f5e2c06dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:31.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e32abe700 1 -- 172.21.15.82:0/1227326572 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2c0b2610 con 0x7f5e2c06e2d0 2023-11-28T13:01:31.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e322bd700 1 --2- 172.21.15.82:0/1227326572 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5e2c156c50 0x7f5e2c159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:31.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e32abe700 1 --2- 172.21.15.82:0/1227326572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e2c06e2d0 0x7f5e2c069f30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009d90 tx=0x7f5e2400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35bc929d078972cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:31.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e312bb700 1 -- 172.21.15.82:0/1227326572 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2400e070 con 0x7f5e2c06e2d0 2023-11-28T13:01:31.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e312bb700 1 -- 172.21.15.82:0/1227326572 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2400bb20 con 0x7f5e2c06e2d0 2023-11-28T13:01:31.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e312bb700 1 -- 172.21.15.82:0/1227326572 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e24012430 con 0x7f5e2c06e2d0 2023-11-28T13:01:31.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e332bf700 1 -- 172.21.15.82:0/1227326572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e2c06e2d0 msgr2=0x7f5e2c069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:31.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e332bf700 1 --2- 172.21.15.82:0/1227326572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e2c06e2d0 0x7f5e2c069f30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009d90 tx=0x7f5e2400b330 comp rx=0 tx=0).stop 2023-11-28T13:01:31.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e332bf700 1 -- 172.21.15.82:0/1227326572 shutdown_connections 2023-11-28T13:01:31.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e332bf700 1 --2- 172.21.15.82:0/1227326572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e2c06e2d0 0x7f5e2c069f30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:31.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e332bf700 1 --2- 172.21.15.82:0/1227326572 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5e2c156c50 0x7f5e2c159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:31.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e332bf700 1 -- 172.21.15.82:0/1227326572 >> 172.21.15.82:0/1227326572 conn(0x7f5e2c0cee90 msgr2=0x7f5e2c0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:31.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e332bf700 1 -- 172.21.15.82:0/1227326572 shutdown_connections 2023-11-28T13:01:31.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.755+0000 7f5e332bf700 1 -- 172.21.15.82:0/1227326572 wait complete. 2023-11-28T13:01:31.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e332bf700 1 Processor -- start 2023-11-28T13:01:31.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e332bf700 1 -- start start 2023-11-28T13:01:31.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e332bf700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e2c06e2d0 0x7f5e2c13f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:31.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e332bf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e2c0b1de0 0x7f5e2c1576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:31.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e332bf700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5e2c156c50 0x7f5e2c0afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:31.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e332bf700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c13fcd0 con 0x7f5e2c0b1de0 2023-11-28T13:01:31.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e332bf700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c1581b0 con 0x7f5e2c06e2d0 2023-11-28T13:01:31.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e332bf700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c158490 con 0x7f5e2c156c50 2023-11-28T13:01:31.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e31abc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e2c0b1de0 0x7f5e2c1576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:31.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e31abc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e2c0b1de0 0x7f5e2c1576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47508/0 (socket says 172.21.15.82:47508) 2023-11-28T13:01:31.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e322bd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e2c06e2d0 0x7f5e2c13f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:31.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e31abc700 1 -- 172.21.15.82:0/2083884589 learned_addr learned my addr 172.21.15.82:0/2083884589 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:31.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e32abe700 1 --2- 172.21.15.82:0/2083884589 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5e2c156c50 0x7f5e2c0afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:31.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e31abc700 1 -- 172.21.15.82:0/2083884589 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5e2c156c50 msgr2=0x7f5e2c0afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:31.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e31abc700 1 --2- 172.21.15.82:0/2083884589 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5e2c156c50 0x7f5e2c0afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:31.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e31abc700 1 -- 172.21.15.82:0/2083884589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e2c06e2d0 msgr2=0x7f5e2c13f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:31.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e31abc700 1 --2- 172.21.15.82:0/2083884589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e2c06e2d0 0x7f5e2c13f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:31.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e31abc700 1 -- 172.21.15.82:0/2083884589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e280094b0 con 0x7f5e2c0b1de0 2023-11-28T13:01:31.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e31abc700 1 --2- 172.21.15.82:0/2083884589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e2c0b1de0 0x7f5e2c1576f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00c700 tx=0x7f5e1c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:31.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e22ffd700 1 -- 172.21.15.82:0/2083884589 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c005d90 con 0x7f5e2c0b1de0 2023-11-28T13:01:31.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e22ffd700 1 -- 172.21.15.82:0/2083884589 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1c0070d0 con 0x7f5e2c0b1de0 2023-11-28T13:01:31.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e332bf700 1 -- 172.21.15.82:0/2083884589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e24009a70 con 0x7f5e2c0b1de0 2023-11-28T13:01:31.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e22ffd700 1 -- 172.21.15.82:0/2083884589 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c007480 con 0x7f5e2c0b1de0 2023-11-28T13:01:31.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.759+0000 7f5e332bf700 1 -- 172.21.15.82:0/2083884589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2c0b2bd0 con 0x7f5e2c0b1de0 2023-11-28T13:01:31.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.763+0000 7f5e332bf700 1 -- 172.21.15.82:0/2083884589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2c0b28f0 con 0x7f5e2c0b1de0 2023-11-28T13:01:31.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.763+0000 7f5e22ffd700 1 -- 172.21.15.82:0/2083884589 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5e1c019030 con 0x7f5e2c0b1de0 2023-11-28T13:01:31.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.763+0000 7f5e22ffd700 1 --2- 172.21.15.82:0/2083884589 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5e10064f10 0x7f5e100673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:31.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.763+0000 7f5e22ffd700 1 -- 172.21.15.82:0/2083884589 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5e1c0811e0 con 0x7f5e2c0b1de0 2023-11-28T13:01:31.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.763+0000 7f5e322bd700 1 --2- 172.21.15.82:0/2083884589 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5e10064f10 0x7f5e100673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:31.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.763+0000 7f5e322bd700 1 --2- 172.21.15.82:0/2083884589 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5e10064f10 0x7f5e100673c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5e28009cc0 tx=0x7f5e28009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:31.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.771+0000 7f5e22ffd700 1 -- 172.21.15.82:0/2083884589 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5e1c04f2a0 con 0x7f5e2c0b1de0 2023-11-28T13:01:31.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:31.967+0000 7f5e332bf700 1 -- 172.21.15.82:0/2083884589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5e2c06a470 con 0x7f5e2c0b1de0 2023-11-28T13:01:32.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.839+0000 7f5e22ffd700 1 -- 172.21.15.82:0/2083884589 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5e1c0528c0 con 0x7f5e2c0b1de0 2023-11-28T13:01:32.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.843+0000 7f5e332bf700 1 -- 172.21.15.82:0/2083884589 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5e10064f10 msgr2=0x7f5e100673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:32.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.843+0000 7f5e332bf700 1 --2- 172.21.15.82:0/2083884589 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5e10064f10 0x7f5e100673c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5e28009cc0 tx=0x7f5e28009240 comp rx=0 tx=0).stop 2023-11-28T13:01:32.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.843+0000 7f5e332bf700 1 -- 172.21.15.82:0/2083884589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e2c0b1de0 msgr2=0x7f5e2c1576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:32.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.843+0000 7f5e332bf700 1 --2- 172.21.15.82:0/2083884589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e2c0b1de0 0x7f5e2c1576f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00c700 tx=0x7f5e1c00ca10 comp rx=0 tx=0).stop 2023-11-28T13:01:32.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.843+0000 7f5e332bf700 1 -- 172.21.15.82:0/2083884589 shutdown_connections 2023-11-28T13:01:32.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.843+0000 7f5e332bf700 1 --2- 172.21.15.82:0/2083884589 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5e10064f10 0x7f5e100673c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:32.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.843+0000 7f5e332bf700 1 --2- 172.21.15.82:0/2083884589 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5e2c156c50 0x7f5e2c0afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:32.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.843+0000 7f5e332bf700 1 --2- 172.21.15.82:0/2083884589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e2c0b1de0 0x7f5e2c1576f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:32.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.843+0000 7f5e332bf700 1 --2- 172.21.15.82:0/2083884589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e2c06e2d0 0x7f5e2c13f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:32.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.843+0000 7f5e332bf700 1 -- 172.21.15.82:0/2083884589 >> 172.21.15.82:0/2083884589 conn(0x7f5e2c0cee90 msgr2=0x7f5e2c15a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:32.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.843+0000 7f5e332bf700 1 -- 172.21.15.82:0/2083884589 shutdown_connections 2023-11-28T13:01:32.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.843+0000 7f5e332bf700 1 -- 172.21.15.82:0/2083884589 wait complete. 2023-11-28T13:01:32.864 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T13:01:32.864 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:01:32.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.979+0000 7fba6f114700 1 Processor -- start 2023-11-28T13:01:32.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.979+0000 7fba6f114700 1 -- start start 2023-11-28T13:01:32.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.979+0000 7fba6f114700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fba680ced70 0x7fba6806bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:32.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.979+0000 7fba6f114700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba680d28e0 con 0x7fba6806b910 2023-11-28T13:01:32.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.979+0000 7fba6f114700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba6806c220 con 0x7fba680d06f0 2023-11-28T13:01:32.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.979+0000 7fba6f114700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba680cdfe0 con 0x7fba680ced70 2023-11-28T13:01:32.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.979+0000 7fba6e112700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fba6806b910 0x7fba68160780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52282/0 (socket says 172.21.15.82:52282) 2023-11-28T13:01:32.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.979+0000 7fba6e112700 1 -- 172.21.15.82:0/1155321253 learned_addr learned my addr 172.21.15.82:0/1155321253 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:32.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.979+0000 7fba6d911700 1 --2- 172.21.15.82:0/1155321253 >> v2:172.21.15.114:3300/0 conn(0x7fba680ced70 0x7fba6806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:32.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.979+0000 7fba6d110700 1 -- 172.21.15.82:0/1155321253 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541651082 0 0) 0x7fba58001110 con 0x7fba6806b910 2023-11-28T13:01:32.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.979+0000 7fba6d110700 1 -- 172.21.15.82:0/1155321253 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba500035d0 con 0x7fba6806b910 2023-11-28T13:01:32.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.979+0000 7fba6d110700 1 -- 172.21.15.82:0/1155321253 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2341820127 0 0) 0x7fba500035d0 con 0x7fba6806b910 2023-11-28T13:01:32.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.979+0000 7fba6d110700 1 -- 172.21.15.82:0/1155321253 >> v2:172.21.15.114:3300/0 conn(0x7fba680ced70 msgr2=0x7fba6806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:32.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.979+0000 7fba6d110700 1 --2- 172.21.15.82:0/1155321253 >> v2:172.21.15.114:3300/0 conn(0x7fba680ced70 0x7fba6806bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:32.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.979+0000 7fba6d110700 1 -- 172.21.15.82:0/1155321253 >> v1:172.21.15.114:6789/0 conn(0x7fba680d06f0 legacy=0x7fba680d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:32.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.979+0000 7fba6d110700 1 -- 172.21.15.82:0/1155321253 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba680b2040 con 0x7fba6806b910 2023-11-28T13:01:32.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.979+0000 7fba6d110700 1 -- 172.21.15.82:0/1155321253 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7fba58001800 con 0x7fba6806b910 2023-11-28T13:01:32.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.979+0000 7fba6d110700 1 -- 172.21.15.82:0/1155321253 >> v1:172.21.15.82:6789/0 conn(0x7fba6806b910 legacy=0x7fba68160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:32.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.979+0000 7fba6d110700 1 --2- 172.21.15.82:0/1155321253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba50003a20 0x7fba50003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:32.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.979+0000 7fba6d110700 1 --2- 172.21.15.82:0/1155321253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba50004870 0x7fba50004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:32.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.979+0000 7fba6d110700 1 --2- 172.21.15.82:0/1155321253 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba50005220 0x7fba5000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:32.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6d110700 1 -- 172.21.15.82:0/1155321253 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba680cdfe0 con 0x7fba50003a20 2023-11-28T13:01:32.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6d110700 1 -- 172.21.15.82:0/1155321253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5000c0a0 con 0x7fba50004870 2023-11-28T13:01:32.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6d110700 1 -- 172.21.15.82:0/1155321253 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5000c260 con 0x7fba50005220 2023-11-28T13:01:32.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6e112700 1 --2- 172.21.15.82:0/1155321253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba50003a20 0x7fba50003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:32.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6d911700 1 --2- 172.21.15.82:0/1155321253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba50004870 0x7fba50004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:32.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6e913700 1 --2- 172.21.15.82:0/1155321253 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba50005220 0x7fba5000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:32.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6d911700 1 -- 172.21.15.82:0/1155321253 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba50005220 msgr2=0x7fba5000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:32.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6d911700 1 --2- 172.21.15.82:0/1155321253 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba50005220 0x7fba5000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:32.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6d911700 1 -- 172.21.15.82:0/1155321253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba50003a20 msgr2=0x7fba50003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:32.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6d911700 1 --2- 172.21.15.82:0/1155321253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba50003a20 0x7fba50003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:32.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6d911700 1 -- 172.21.15.82:0/1155321253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba500035d0 con 0x7fba50004870 2023-11-28T13:01:32.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6e112700 1 --2- 172.21.15.82:0/1155321253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba50003a20 0x7fba50003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:32.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6e913700 1 -- 172.21.15.82:0/1155321253 reap_dead start 2023-11-28T13:01:32.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6d911700 1 --2- 172.21.15.82:0/1155321253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba50004870 0x7fba50004ce0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fba64009f70 tx=0x7fba500058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52c1f48c2c35aff4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:32.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6d110700 1 -- 172.21.15.82:0/1155321253 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba64003a40 con 0x7fba50004870 2023-11-28T13:01:32.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6d110700 1 -- 172.21.15.82:0/1155321253 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6400f040 con 0x7fba50004870 2023-11-28T13:01:32.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6d110700 1 -- 172.21.15.82:0/1155321253 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba64003de0 con 0x7fba50004870 2023-11-28T13:01:32.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6f114700 1 -- 172.21.15.82:0/1155321253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba50004870 msgr2=0x7fba50004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:32.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6f114700 1 --2- 172.21.15.82:0/1155321253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba50004870 0x7fba50004ce0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fba64009f70 tx=0x7fba500058a0 comp rx=0 tx=0).stop 2023-11-28T13:01:32.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6f114700 1 -- 172.21.15.82:0/1155321253 shutdown_connections 2023-11-28T13:01:32.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6f114700 1 --2- 172.21.15.82:0/1155321253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba50004870 0x7fba50004ce0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:32.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6f114700 1 -- 172.21.15.82:0/1155321253 >> 172.21.15.82:0/1155321253 conn(0x7fba680d2b20 msgr2=0x7fba680d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:32.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6f114700 1 -- 172.21.15.82:0/1155321253 shutdown_connections 2023-11-28T13:01:32.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.983+0000 7fba6f114700 1 -- 172.21.15.82:0/1155321253 wait complete. 2023-11-28T13:01:32.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6f114700 1 Processor -- start 2023-11-28T13:01:32.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6f114700 1 -- start start 2023-11-28T13:01:32.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6f114700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba50004870 0x7fba68156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:32.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6f114700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba6815e980 0x7fba6815edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:32.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6f114700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba680c9d40 0x7fba680ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:32.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6f114700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba68154910 con 0x7fba680c9d40 2023-11-28T13:01:32.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6f114700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6815f330 con 0x7fba50004870 2023-11-28T13:01:32.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6f114700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba680cb6c0 con 0x7fba6815e980 2023-11-28T13:01:32.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6e913700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba680c9d40 0x7fba680ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:32.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6e913700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba680c9d40 0x7fba680ca1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47526/0 (socket says 172.21.15.82:47526) 2023-11-28T13:01:32.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6e913700 1 -- 172.21.15.82:0/2792106607 learned_addr learned my addr 172.21.15.82:0/2792106607 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:32.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6d911700 1 --2- 172.21.15.82:0/2792106607 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba6815e980 0x7fba6815edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:32.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6e112700 1 --2- 172.21.15.82:0/2792106607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba50004870 0x7fba68156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:32.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6e913700 1 -- 172.21.15.82:0/2792106607 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba6815e980 msgr2=0x7fba6815edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:32.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6e913700 1 --2- 172.21.15.82:0/2792106607 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba6815e980 0x7fba6815edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:32.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6e913700 1 -- 172.21.15.82:0/2792106607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba50004870 msgr2=0x7fba68156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:32.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6e913700 1 --2- 172.21.15.82:0/2792106607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba50004870 0x7fba68156320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:32.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6e913700 1 -- 172.21.15.82:0/2792106607 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba680d2320 con 0x7fba680c9d40 2023-11-28T13:01:32.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6d911700 1 --2- 172.21.15.82:0/2792106607 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba6815e980 0x7fba6815edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:32.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6e913700 1 --2- 172.21.15.82:0/2792106607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba680c9d40 0x7fba680ca1b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fba6000f770 tx=0x7fba6000fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:32.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba5effd700 1 -- 172.21.15.82:0/2792106607 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba600052e0 con 0x7fba680c9d40 2023-11-28T13:01:32.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba5effd700 1 -- 172.21.15.82:0/2792106607 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba60005440 con 0x7fba680c9d40 2023-11-28T13:01:32.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6f114700 1 -- 172.21.15.82:0/2792106607 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba680cf2c0 con 0x7fba680c9d40 2023-11-28T13:01:32.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba5effd700 1 -- 172.21.15.82:0/2792106607 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba600038e0 con 0x7fba680c9d40 2023-11-28T13:01:32.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.987+0000 7fba6f114700 1 -- 172.21.15.82:0/2792106607 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba680d2600 con 0x7fba680c9d40 2023-11-28T13:01:32.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.991+0000 7fba6f114700 1 -- 172.21.15.82:0/2792106607 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba680cb870 con 0x7fba680c9d40 2023-11-28T13:01:32.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.991+0000 7fba5effd700 1 -- 172.21.15.82:0/2792106607 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fba60003a40 con 0x7fba680c9d40 2023-11-28T13:01:32.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.991+0000 7fba5effd700 1 --2- 172.21.15.82:0/2792106607 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fba54064f10 0x7fba540673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:32.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.991+0000 7fba6e112700 1 --2- 172.21.15.82:0/2792106607 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fba54064f10 0x7fba540673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:32.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.991+0000 7fba5effd700 1 -- 172.21.15.82:0/2792106607 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba60081af0 con 0x7fba680c9d40 2023-11-28T13:01:32.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.991+0000 7fba6e112700 1 --2- 172.21.15.82:0/2792106607 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fba54064f10 0x7fba540673c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fba58000c00 tx=0x7fba58007df0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:33.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:32.999+0000 7fba5effd700 1 -- 172.21.15.82:0/2792106607 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fba680cb870 con 0x7fba680c9d40 2023-11-28T13:01:33.190 INFO:tasks.ceph.mds.a.smithi082.stderr:2023-11-28T13:01:33.183+0000 7f1e7d7eb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T13:01:33.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.199+0000 7fba6f114700 1 -- 172.21.15.82:0/2792106607 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba680cb870 con 0x7fba680c9d40 2023-11-28T13:01:33.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.203+0000 7fba5effd700 1 -- 172.21.15.82:0/2792106607 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4651 (secure 0 0 0) 0x7fba680cb870 con 0x7fba680c9d40 2023-11-28T13:01:33.207 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:33.207 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2975361458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2975361458},{"type":"v1","addr":"172.21.15.114:6833","nonce":2975361458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3412196002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3412196002},{"type":"v1","addr":"172.21.15.114:6835","nonce":3412196002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/167093290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":167093290},{"type":"v1","addr":"172.21.15.82:6835","nonce":167093290}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:01:29.585949+0000","modified":"2023-11-28T13:01:32.836050+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/3448846386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3448846386},{"type":"v1","addr":"172.21.15.82:6837","nonce":3448846386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T13:01:33.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.207+0000 7fba6f114700 1 -- 172.21.15.82:0/2792106607 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fba54064f10 msgr2=0x7fba540673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:33.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.207+0000 7fba6f114700 1 --2- 172.21.15.82:0/2792106607 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fba54064f10 0x7fba540673c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fba58000c00 tx=0x7fba58007df0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.207+0000 7fba6f114700 1 -- 172.21.15.82:0/2792106607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba680c9d40 msgr2=0x7fba680ca1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:33.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.207+0000 7fba6f114700 1 --2- 172.21.15.82:0/2792106607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba680c9d40 0x7fba680ca1b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fba6000f770 tx=0x7fba6000fb30 comp rx=0 tx=0).stop 2023-11-28T13:01:33.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.207+0000 7fba6f114700 1 -- 172.21.15.82:0/2792106607 shutdown_connections 2023-11-28T13:01:33.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.207+0000 7fba6f114700 1 --2- 172.21.15.82:0/2792106607 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fba54064f10 0x7fba540673c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.207+0000 7fba6f114700 1 --2- 172.21.15.82:0/2792106607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba680c9d40 0x7fba680ca1b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.207+0000 7fba6f114700 1 --2- 172.21.15.82:0/2792106607 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba6815e980 0x7fba6815edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.207+0000 7fba6f114700 1 --2- 172.21.15.82:0/2792106607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba50004870 0x7fba68156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.207+0000 7fba6f114700 1 -- 172.21.15.82:0/2792106607 >> 172.21.15.82:0/2792106607 conn(0x7fba680d2b20 msgr2=0x7fba68158150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:33.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.207+0000 7fba6f114700 1 -- 172.21.15.82:0/2792106607 shutdown_connections 2023-11-28T13:01:33.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.207+0000 7fba6f114700 1 -- 172.21.15.82:0/2792106607 wait complete. 2023-11-28T13:01:33.212 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2023-11-28T13:01:33.226 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:01:33.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.331+0000 7fa41aa3d700 1 Processor -- start 2023-11-28T13:01:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.331+0000 7fa41aa3d700 1 -- start start 2023-11-28T13:01:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.335+0000 7fa41aa3d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa414158df0 0x7fa41415d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.335+0000 7fa41aa3d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa414070070 0x7fa4140704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.335+0000 7fa41aa3d700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41415da50 con 0x7fa4141591c0 2023-11-28T13:01:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.335+0000 7fa41aa3d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa414070a30 con 0x7fa414158df0 2023-11-28T13:01:33.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.335+0000 7fa41aa3d700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4140c9e20 con 0x7fa414070070 2023-11-28T13:01:33.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.335+0000 7fa41a23c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa414070070 0x7fa4140704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:33.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.335+0000 7fa419a3b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa414158df0 0x7fa41415d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:33.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.335+0000 7fa41a23c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa414070070 0x7fa4140704f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:39114/0 (socket says 172.21.15.82:39114) 2023-11-28T13:01:33.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.335+0000 7fa41a23c700 1 -- 172.21.15.82:0/178789111 learned_addr learned my addr 172.21.15.82:0/178789111 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:33.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.335+0000 7fa419a3b700 1 -- 172.21.15.82:0/178789111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa414070070 msgr2=0x7fa4140704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:33.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.335+0000 7fa419a3b700 1 --2- 172.21.15.82:0/178789111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa414070070 0x7fa4140704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.335+0000 7fa419a3b700 1 -- 172.21.15.82:0/178789111 >> v1:172.21.15.114:6789/0 conn(0x7fa4141591c0 legacy=0x7fa41406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:33.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.335+0000 7fa419a3b700 1 -- 172.21.15.82:0/178789111 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4140cc640 con 0x7fa414158df0 2023-11-28T13:01:33.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.335+0000 7fa419a3b700 1 --2- 172.21.15.82:0/178789111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa414158df0 0x7fa41415d510 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa410009850 tx=0x7fa410009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6540a235d7b1f411 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:33.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.335+0000 7fa418a39700 1 -- 172.21.15.82:0/178789111 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410011830 con 0x7fa414158df0 2023-11-28T13:01:33.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.335+0000 7fa418a39700 1 -- 172.21.15.82:0/178789111 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa410011990 con 0x7fa414158df0 2023-11-28T13:01:33.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.335+0000 7fa418a39700 1 -- 172.21.15.82:0/178789111 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410011d40 con 0x7fa414158df0 2023-11-28T13:01:33.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.339+0000 7fa41aa3d700 1 -- 172.21.15.82:0/178789111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa414158df0 msgr2=0x7fa41415d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:33.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.339+0000 7fa41aa3d700 1 --2- 172.21.15.82:0/178789111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa414158df0 0x7fa41415d510 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa410009850 tx=0x7fa410009b60 comp rx=0 tx=0).stop 2023-11-28T13:01:33.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.339+0000 7fa41aa3d700 1 -- 172.21.15.82:0/178789111 shutdown_connections 2023-11-28T13:01:33.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.339+0000 7fa41aa3d700 1 --2- 172.21.15.82:0/178789111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa414070070 0x7fa4140704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.339+0000 7fa41aa3d700 1 --2- 172.21.15.82:0/178789111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa414158df0 0x7fa41415d510 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.339+0000 7fa41aa3d700 1 -- 172.21.15.82:0/178789111 >> 172.21.15.82:0/178789111 conn(0x7fa4140ce600 msgr2=0x7fa4140ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:33.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.339+0000 7fa41aa3d700 1 -- 172.21.15.82:0/178789111 shutdown_connections 2023-11-28T13:01:33.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.339+0000 7fa41aa3d700 1 -- 172.21.15.82:0/178789111 wait complete. 2023-11-28T13:01:33.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.339+0000 7fa41aa3d700 1 Processor -- start 2023-11-28T13:01:33.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.339+0000 7fa41aa3d700 1 -- start start 2023-11-28T13:01:33.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa41aa3d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa414070070 0x7fa4140c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:33.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa41aa3d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa414158df0 0x7fa414158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:33.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa41aa3d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4141591c0 0x7fa4140c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:33.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa41aa3d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4140c4cd0 con 0x7fa414070070 2023-11-28T13:01:33.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa41aa3d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4140c4710 con 0x7fa414158df0 2023-11-28T13:01:33.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa41aa3d700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4140c49f0 con 0x7fa4141591c0 2023-11-28T13:01:33.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa419a3b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa414070070 0x7fa4140c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:33.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa419a3b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa414070070 0x7fa4140c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47538/0 (socket says 172.21.15.82:47538) 2023-11-28T13:01:33.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa419a3b700 1 -- 172.21.15.82:0/523221624 learned_addr learned my addr 172.21.15.82:0/523221624 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:33.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa41923a700 1 --2- 172.21.15.82:0/523221624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa414158df0 0x7fa414158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:33.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa41a23c700 1 --2- 172.21.15.82:0/523221624 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4141591c0 0x7fa4140c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:33.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa419a3b700 1 -- 172.21.15.82:0/523221624 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4141591c0 msgr2=0x7fa4140c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:33.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa419a3b700 1 --2- 172.21.15.82:0/523221624 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4141591c0 0x7fa4140c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa419a3b700 1 -- 172.21.15.82:0/523221624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa414158df0 msgr2=0x7fa414158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:33.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa419a3b700 1 --2- 172.21.15.82:0/523221624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa414158df0 0x7fa414158090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa419a3b700 1 -- 172.21.15.82:0/523221624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4100094b0 con 0x7fa414070070 2023-11-28T13:01:33.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa419a3b700 1 --2- 172.21.15.82:0/523221624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa414070070 0x7fa4140c40e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa4100090b0 tx=0x7fa410004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:33.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa40a7fc700 1 -- 172.21.15.82:0/523221624 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4100036c0 con 0x7fa414070070 2023-11-28T13:01:33.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa40a7fc700 1 -- 172.21.15.82:0/523221624 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41001f070 con 0x7fa414070070 2023-11-28T13:01:33.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa41aa3d700 1 -- 172.21.15.82:0/523221624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4140c9ab0 con 0x7fa414070070 2023-11-28T13:01:33.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa40a7fc700 1 -- 172.21.15.82:0/523221624 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410003a60 con 0x7fa414070070 2023-11-28T13:01:33.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.343+0000 7fa41aa3d700 1 -- 172.21.15.82:0/523221624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4140c97d0 con 0x7fa414070070 2023-11-28T13:01:33.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.347+0000 7fa41aa3d700 1 -- 172.21.15.82:0/523221624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4140c9480 con 0x7fa414070070 2023-11-28T13:01:33.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.347+0000 7fa40a7fc700 1 -- 172.21.15.82:0/523221624 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa41000f050 con 0x7fa414070070 2023-11-28T13:01:33.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.347+0000 7fa40a7fc700 1 --2- 172.21.15.82:0/523221624 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa3f8064ee0 0x7fa3f8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:33.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.347+0000 7fa40a7fc700 1 -- 172.21.15.82:0/523221624 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa410021070 con 0x7fa414070070 2023-11-28T13:01:33.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.347+0000 7fa41923a700 1 --2- 172.21.15.82:0/523221624 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa3f8064ee0 0x7fa3f8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:33.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.347+0000 7fa41923a700 1 --2- 172.21.15.82:0/523221624 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa3f8064ee0 0x7fa3f8067390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa4141f1c10 tx=0x7fa404009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:33.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.351+0000 7fa40a7fc700 1 -- 172.21.15.82:0/523221624 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa410051840 con 0x7fa414070070 2023-11-28T13:01:33.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.515+0000 7fa41aa3d700 1 -- 172.21.15.82:0/523221624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa414065fc0 con 0x7fa414070070 2023-11-28T13:01:33.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.515+0000 7fa40a7fc700 1 -- 172.21.15.82:0/523221624 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+17883 (secure 0 0 0) 0x7fa410054e60 con 0x7fa414070070 2023-11-28T13:01:33.521 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:33.522 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":38,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:01:30.589673+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:01:27.651123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T13:01:28.580057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:01:33.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.519+0000 7fa41aa3d700 1 -- 172.21.15.82:0/523221624 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa3f8064ee0 msgr2=0x7fa3f8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:33.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.519+0000 7fa41aa3d700 1 --2- 172.21.15.82:0/523221624 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa3f8064ee0 0x7fa3f8067390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa4141f1c10 tx=0x7fa404009040 comp rx=0 tx=0).stop 2023-11-28T13:01:33.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.519+0000 7fa41aa3d700 1 -- 172.21.15.82:0/523221624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa414070070 msgr2=0x7fa4140c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:33.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.519+0000 7fa41aa3d700 1 --2- 172.21.15.82:0/523221624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa414070070 0x7fa4140c40e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa4100090b0 tx=0x7fa410004770 comp rx=0 tx=0).stop 2023-11-28T13:01:33.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.519+0000 7fa41aa3d700 1 -- 172.21.15.82:0/523221624 shutdown_connections 2023-11-28T13:01:33.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.519+0000 7fa41aa3d700 1 --2- 172.21.15.82:0/523221624 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa3f8064ee0 0x7fa3f8067390 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.519+0000 7fa41aa3d700 1 --2- 172.21.15.82:0/523221624 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4141591c0 0x7fa4140c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.519+0000 7fa41aa3d700 1 --2- 172.21.15.82:0/523221624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa414158df0 0x7fa414158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.519+0000 7fa41aa3d700 1 --2- 172.21.15.82:0/523221624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa414070070 0x7fa4140c40e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.519+0000 7fa41aa3d700 1 -- 172.21.15.82:0/523221624 >> 172.21.15.82:0/523221624 conn(0x7fa4140ce600 msgr2=0x7fa4140ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:33.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.519+0000 7fa41aa3d700 1 -- 172.21.15.82:0/523221624 shutdown_connections 2023-11-28T13:01:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.519+0000 7fa41aa3d700 1 -- 172.21.15.82:0/523221624 wait complete. 2023-11-28T13:01:33.536 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T13:01:33.536 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:01:33.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.643+0000 7ff177fff700 1 Processor -- start 2023-11-28T13:01:33.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff177fff700 1 -- start start 2023-11-28T13:01:33.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff177fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff178070070 0x7ff178070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:33.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff177fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff1780c1910 0x7ff17806c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:33.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff177fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff178070980 con 0x7ff178160900 2023-11-28T13:01:33.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff177fff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1780ce030 con 0x7ff178070070 2023-11-28T13:01:33.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff177fff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1780ce310 con 0x7ff1780c1910 2023-11-28T13:01:33.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff176ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff178070070 0x7ff178070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:33.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff176ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff178070070 0x7ff178070440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47546/0 (socket says 172.21.15.82:47546) 2023-11-28T13:01:33.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff176ffd700 1 -- 172.21.15.82:0/2258550645 learned_addr learned my addr 172.21.15.82:0/2258550645 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:33.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff1777fe700 1 --2- 172.21.15.82:0/2258550645 >> v2:172.21.15.114:3300/0 conn(0x7ff1780c1910 0x7ff17806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:33.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff176ffd700 1 -- 172.21.15.82:0/2258550645 >> v2:172.21.15.114:3300/0 conn(0x7ff1780c1910 msgr2=0x7ff17806c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:33.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff176ffd700 1 --2- 172.21.15.82:0/2258550645 >> v2:172.21.15.114:3300/0 conn(0x7ff1780c1910 0x7ff17806c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff176ffd700 1 -- 172.21.15.82:0/2258550645 >> v1:172.21.15.114:6789/0 conn(0x7ff178160900 legacy=0x7ff1780cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:33.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff176ffd700 1 -- 172.21.15.82:0/2258550645 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17806a5d0 con 0x7ff178070070 2023-11-28T13:01:33.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff176ffd700 1 --2- 172.21.15.82:0/2258550645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff178070070 0x7ff178070440 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff1780b4530 tx=0x7ff16800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba367c43b55983db server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:33.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff175ffb700 1 -- 172.21.15.82:0/2258550645 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16800e070 con 0x7ff178070070 2023-11-28T13:01:33.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff175ffb700 1 -- 172.21.15.82:0/2258550645 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16800b9c0 con 0x7ff178070070 2023-11-28T13:01:33.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff175ffb700 1 -- 172.21.15.82:0/2258550645 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16800bd70 con 0x7ff178070070 2023-11-28T13:01:33.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff177fff700 1 -- 172.21.15.82:0/2258550645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff178070070 msgr2=0x7ff178070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:33.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff177fff700 1 --2- 172.21.15.82:0/2258550645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff178070070 0x7ff178070440 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff1780b4530 tx=0x7ff16800b330 comp rx=0 tx=0).stop 2023-11-28T13:01:33.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff177fff700 1 -- 172.21.15.82:0/2258550645 shutdown_connections 2023-11-28T13:01:33.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff177fff700 1 --2- 172.21.15.82:0/2258550645 >> v2:172.21.15.114:3300/0 conn(0x7ff1780c1910 0x7ff17806c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff177fff700 1 --2- 172.21.15.82:0/2258550645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff178070070 0x7ff178070440 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff177fff700 1 -- 172.21.15.82:0/2258550645 >> 172.21.15.82:0/2258550645 conn(0x7ff1780ce600 msgr2=0x7ff1780ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:33.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff177fff700 1 -- 172.21.15.82:0/2258550645 shutdown_connections 2023-11-28T13:01:33.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.647+0000 7ff177fff700 1 -- 172.21.15.82:0/2258550645 wait complete. 2023-11-28T13:01:33.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff177fff700 1 Processor -- start 2023-11-28T13:01:33.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff177fff700 1 -- start start 2023-11-28T13:01:33.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff177fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff178070070 0x7ff178161c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:33.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff177fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff17815c250 0x7ff1781634f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:33.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff177fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1780c42d0 0x7ff1780c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:33.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff177fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1780c3270 con 0x7ff17815c250 2023-11-28T13:01:33.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff177fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1780c3510 con 0x7ff178070070 2023-11-28T13:01:33.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff177fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1780c37f0 con 0x7ff1780c42d0 2023-11-28T13:01:33.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff1767fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff17815c250 0x7ff1781634f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:33.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff1767fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff17815c250 0x7ff1781634f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47554/0 (socket says 172.21.15.82:47554) 2023-11-28T13:01:33.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff1767fc700 1 -- 172.21.15.82:0/2787035351 learned_addr learned my addr 172.21.15.82:0/2787035351 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:33.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff176ffd700 1 --2- 172.21.15.82:0/2787035351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff178070070 0x7ff178161c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:33.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff1777fe700 1 --2- 172.21.15.82:0/2787035351 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1780c42d0 0x7ff1780c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:33.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff1767fc700 1 -- 172.21.15.82:0/2787035351 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1780c42d0 msgr2=0x7ff1780c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:33.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff1767fc700 1 --2- 172.21.15.82:0/2787035351 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1780c42d0 0x7ff1780c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff1767fc700 1 -- 172.21.15.82:0/2787035351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff178070070 msgr2=0x7ff178161c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:33.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff1767fc700 1 --2- 172.21.15.82:0/2787035351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff178070070 0x7ff178161c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff1767fc700 1 -- 172.21.15.82:0/2787035351 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff168009b30 con 0x7ff17815c250 2023-11-28T13:01:33.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff176ffd700 1 --2- 172.21.15.82:0/2787035351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff178070070 0x7ff178161c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:33.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff1767fc700 1 --2- 172.21.15.82:0/2787035351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff17815c250 0x7ff1781634f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff16000c500 tx=0x7ff16000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:33.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff16f7fe700 1 -- 172.21.15.82:0/2787035351 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1600052d0 con 0x7ff17815c250 2023-11-28T13:01:33.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff16f7fe700 1 -- 172.21.15.82:0/2787035351 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff160005430 con 0x7ff17815c250 2023-11-28T13:01:33.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff177fff700 1 -- 172.21.15.82:0/2787035351 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff17806ab90 con 0x7ff17815c250 2023-11-28T13:01:33.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff16f7fe700 1 -- 172.21.15.82:0/2787035351 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1600055a0 con 0x7ff17815c250 2023-11-28T13:01:33.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.651+0000 7ff177fff700 1 -- 172.21.15.82:0/2787035351 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff17806a8b0 con 0x7ff17815c250 2023-11-28T13:01:33.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.655+0000 7ff177fff700 1 -- 172.21.15.82:0/2787035351 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1780cdc50 con 0x7ff17815c250 2023-11-28T13:01:33.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.655+0000 7ff16f7fe700 1 -- 172.21.15.82:0/2787035351 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff160019030 con 0x7ff17815c250 2023-11-28T13:01:33.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.655+0000 7ff16f7fe700 1 --2- 172.21.15.82:0/2787035351 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff158064ee0 0x7ff158067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:33.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.655+0000 7ff16f7fe700 1 -- 172.21.15.82:0/2787035351 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff160081280 con 0x7ff17815c250 2023-11-28T13:01:33.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.655+0000 7ff176ffd700 1 --2- 172.21.15.82:0/2787035351 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff158064ee0 0x7ff158067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:33.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.655+0000 7ff176ffd700 1 --2- 172.21.15.82:0/2787035351 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff158064ee0 0x7ff158067390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff168000f80 tx=0x7ff168009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:33.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.663+0000 7ff16f7fe700 1 -- 172.21.15.82:0/2787035351 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff16004f3a0 con 0x7ff17815c250 2023-11-28T13:01:33.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.819+0000 7ff177fff700 1 -- 172.21.15.82:0/2787035351 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff178065fc0 con 0x7ff158064ee0 2023-11-28T13:01:33.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.835+0000 7ff16f7fe700 1 -- 172.21.15.82:0/2787035351 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299123 (secure 0 0 0) 0x7ff178065fc0 con 0x7ff158064ee0 2023-11-28T13:01:33.844 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:33.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.839+0000 7ff177fff700 1 -- 172.21.15.82:0/2787035351 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff158064ee0 msgr2=0x7ff158067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:33.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.839+0000 7ff177fff700 1 --2- 172.21.15.82:0/2787035351 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff158064ee0 0x7ff158067390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff168000f80 tx=0x7ff168009000 comp rx=0 tx=0).stop 2023-11-28T13:01:33.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.839+0000 7ff177fff700 1 -- 172.21.15.82:0/2787035351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff17815c250 msgr2=0x7ff1781634f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:33.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.839+0000 7ff177fff700 1 --2- 172.21.15.82:0/2787035351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff17815c250 0x7ff1781634f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff16000c500 tx=0x7ff16000c8c0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.839+0000 7ff177fff700 1 -- 172.21.15.82:0/2787035351 shutdown_connections 2023-11-28T13:01:33.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.839+0000 7ff177fff700 1 --2- 172.21.15.82:0/2787035351 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff158064ee0 0x7ff158067390 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.839+0000 7ff177fff700 1 --2- 172.21.15.82:0/2787035351 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1780c42d0 0x7ff1780c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.839+0000 7ff177fff700 1 --2- 172.21.15.82:0/2787035351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff17815c250 0x7ff1781634f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.839+0000 7ff177fff700 1 --2- 172.21.15.82:0/2787035351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff178070070 0x7ff178161c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.839+0000 7ff177fff700 1 -- 172.21.15.82:0/2787035351 >> 172.21.15.82:0/2787035351 conn(0x7ff1780ce600 msgr2=0x7ff17806d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:33.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.839+0000 7ff177fff700 1 -- 172.21.15.82:0/2787035351 shutdown_connections 2023-11-28T13:01:33.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.839+0000 7ff177fff700 1 -- 172.21.15.82:0/2787035351 wait complete. 2023-11-28T13:01:33.848 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:01:33.860 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-11-28T13:01:33.178747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":68712,"kb_used_data":4264,"kb_used_omap":0,"kb_used_meta":64384,"kb_avail":754906008,"statfs":{"total":773094113280,"available":773023752192,"internally_reserved":0,"allocated":4366336,"data_stored":2457936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65929216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.978000"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.209096+0000","last_change":"2023-11-28T13:01:28.209096+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.209096+0000","last_undegraded":"2023-11-28T13:01:28.209096+0000","last_fullsized":"2023-11-28T13:01:28.209096+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:10.621678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.216358+0000","last_change":"2023-11-28T13:01:28.216358+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.216358+0000","last_undegraded":"2023-11-28T13:01:28.216358+0000","last_fullsized":"2023-11-28T13:01:28.216358+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:12.505253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.207862+0000","last_change":"2023-11-28T13:01:28.207862+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.207862+0000","last_undegraded":"2023-11-28T13:01:28.207862+0000","last_fullsized":"2023-11-28T13:01:28.207862+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:16.854220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.206667+0000","last_change":"2023-11-28T13:01:28.206667+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.206667+0000","last_undegraded":"2023-11-28T13:01:28.206667+0000","last_fullsized":"2023-11-28T13:01:28.206667+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:15:15.549631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.210511+0000","last_change":"2023-11-28T13:01:28.210511+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.210511+0000","last_undegraded":"2023-11-28T13:01:28.210511+0000","last_fullsized":"2023-11-28T13:01:28.210511+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:09:46.508882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.205219+0000","last_change":"2023-11-28T13:01:28.205219+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.205219+0000","last_undegraded":"2023-11-28T13:01:28.205219+0000","last_fullsized":"2023-11-28T13:01:28.205219+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:47.130802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.207317+0000","last_change":"2023-11-28T13:01:28.207317+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.207317+0000","last_undegraded":"2023-11-28T13:01:28.207317+0000","last_fullsized":"2023-11-28T13:01:28.207317+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:19.124556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.204505+0000","last_change":"2023-11-28T13:01:28.204505+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.204505+0000","last_undegraded":"2023-11-28T13:01:28.204505+0000","last_fullsized":"2023-11-28T13:01:28.204505+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:55.167964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.212634+0000","last_change":"2023-11-28T13:01:28.212634+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.212634+0000","last_undegraded":"2023-11-28T13:01:28.212634+0000","last_fullsized":"2023-11-28T13:01:28.212634+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:12.505253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.210023+0000","last_change":"2023-11-28T13:01:28.210023+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.210023+0000","last_undegraded":"2023-11-28T13:01:28.210023+0000","last_fullsized":"2023-11-28T13:01:28.210023+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:35.486834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.210087+0000","last_change":"2023-11-28T13:01:28.210087+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.210087+0000","last_undegraded":"2023-11-28T13:01:28.210087+0000","last_fullsized":"2023-11-28T13:01:28.210087+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:06.881393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.212051+0000","last_change":"2023-11-28T13:01:28.212051+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.212051+0000","last_undegraded":"2023-11-28T13:01:28.212051+0000","last_fullsized":"2023-11-28T13:01:28.212051+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:35.486834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.212157+0000","last_change":"2023-11-28T13:01:28.212157+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.212157+0000","last_undegraded":"2023-11-28T13:01:28.212157+0000","last_fullsized":"2023-11-28T13:01:28.212157+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:06.881393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.207555+0000","last_change":"2023-11-28T13:01:28.207555+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.207555+0000","last_undegraded":"2023-11-28T13:01:28.207555+0000","last_fullsized":"2023-11-28T13:01:28.207555+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:34.884855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.208225+0000","last_change":"2023-11-28T13:01:28.208225+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.208225+0000","last_undegraded":"2023-11-28T13:01:28.208225+0000","last_fullsized":"2023-11-28T13:01:28.208225+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:15:31.600456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.204831+0000","last_change":"2023-11-28T13:01:28.204831+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.204831+0000","last_undegraded":"2023-11-28T13:01:28.204831+0000","last_fullsized":"2023-11-28T13:01:28.204831+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:16.854220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.211191+0000","last_change":"2023-11-28T13:01:28.211191+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.211191+0000","last_undegraded":"2023-11-28T13:01:28.211191+0000","last_fullsized":"2023-11-28T13:01:28.211191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:08.725526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.207008+0000","last_change":"2023-11-28T13:01:28.207008+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.207008+0000","last_undegraded":"2023-11-28T13:01:28.207008+0000","last_fullsized":"2023-11-28T13:01:28.207008+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:22:36.945966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.215029+0000","last_change":"2023-11-28T13:01:28.215029+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.215029+0000","last_undegraded":"2023-11-28T13:01:28.215029+0000","last_fullsized":"2023-11-28T13:01:28.215029+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:50.711987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.206715+0000","last_change":"2023-11-28T13:01:28.206715+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.206715+0000","last_undegraded":"2023-11-28T13:01:28.206715+0000","last_fullsized":"2023-11-28T13:01:28.206715+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:47.130802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.216172+0000","last_change":"2023-11-28T13:01:28.216172+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.216172+0000","last_undegraded":"2023-11-28T13:01:28.216172+0000","last_fullsized":"2023-11-28T13:01:28.216172+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:33.041552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.214997+0000","last_change":"2023-11-28T13:01:28.214997+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.214997+0000","last_undegraded":"2023-11-28T13:01:28.214997+0000","last_fullsized":"2023-11-28T13:01:28.214997+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:15:31.600456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.205267+0000","last_change":"2023-11-28T13:01:28.205267+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.205267+0000","last_undegraded":"2023-11-28T13:01:28.205267+0000","last_fullsized":"2023-11-28T13:01:28.205267+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:19.124556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.214886+0000","last_change":"2023-11-28T13:01:28.214886+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.214886+0000","last_undegraded":"2023-11-28T13:01:28.214886+0000","last_fullsized":"2023-11-28T13:01:28.214886+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:06:16.368208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.205762+0000","last_change":"2023-11-28T13:01:28.205762+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.205762+0000","last_undegraded":"2023-11-28T13:01:28.205762+0000","last_fullsized":"2023-11-28T13:01:28.205762+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:34.884855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.371214+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:01:23.371214+0000","last_peered":"2023-11-28T13:01:23.371214+0000","last_clean":"2023-11-28T13:01:23.371214+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:01:23.371214+0000","last_undegraded":"2023-11-28T13:01:23.371214+0000","last_fullsized":"2023-11-28T13:01:23.371214+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.379419+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:01:23.379419+0000","last_peered":"2023-11-28T13:01:23.379419+0000","last_clean":"2023-11-28T13:01:23.379419+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:01:23.379419+0000","last_undegraded":"2023-11-28T13:01:23.379419+0000","last_fullsized":"2023-11-28T13:01:23.379419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.210522+0000","last_change":"2023-11-28T13:01:28.210522+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.210522+0000","last_undegraded":"2023-11-28T13:01:28.210522+0000","last_fullsized":"2023-11-28T13:01:28.210522+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:12.505253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.371192+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:01:23.371192+0000","last_peered":"2023-11-28T13:01:23.371192+0000","last_clean":"2023-11-28T13:01:23.371192+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:01:23.371192+0000","last_undegraded":"2023-11-28T13:01:23.371192+0000","last_fullsized":"2023-11-28T13:01:23.371192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.215746+0000","last_change":"2023-11-28T13:01:28.215746+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.215746+0000","last_undegraded":"2023-11-28T13:01:28.215746+0000","last_fullsized":"2023-11-28T13:01:28.215746+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:10.621678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.425397+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:01:23.425397+0000","last_peered":"2023-11-28T13:01:23.425397+0000","last_clean":"2023-11-28T13:01:23.425397+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:01:23.425397+0000","last_undegraded":"2023-11-28T13:01:23.425397+0000","last_fullsized":"2023-11-28T13:01:23.425397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.215720+0000","last_change":"2023-11-28T13:01:28.215720+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.215720+0000","last_undegraded":"2023-11-28T13:01:28.215720+0000","last_fullsized":"2023-11-28T13:01:28.215720+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:06.881393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.383349+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:01:23.383349+0000","last_peered":"2023-11-28T13:01:23.383349+0000","last_clean":"2023-11-28T13:01:23.383349+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:01:23.383349+0000","last_undegraded":"2023-11-28T13:01:23.383349+0000","last_fullsized":"2023-11-28T13:01:23.383349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.215058+0000","last_change":"2023-11-28T13:01:28.215058+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.215058+0000","last_undegraded":"2023-11-28T13:01:28.215058+0000","last_fullsized":"2023-11-28T13:01:28.215058+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:08.725526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.514873+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:01:23.514873+0000","last_peered":"2023-11-28T13:01:23.514873+0000","last_clean":"2023-11-28T13:01:23.514873+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:01:23.514873+0000","last_undegraded":"2023-11-28T13:01:23.514873+0000","last_fullsized":"2023-11-28T13:01:23.514873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.209135+0000","last_change":"2023-11-28T13:01:28.209135+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.209135+0000","last_undegraded":"2023-11-28T13:01:28.209135+0000","last_fullsized":"2023-11-28T13:01:28.209135+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:33.041552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.371232+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:01:23.371232+0000","last_peered":"2023-11-28T13:01:23.371232+0000","last_clean":"2023-11-28T13:01:23.371232+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:01:23.371232+0000","last_undegraded":"2023-11-28T13:01:23.371232+0000","last_fullsized":"2023-11-28T13:01:23.371232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.205078+0000","last_change":"2023-11-28T13:01:28.205078+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.205078+0000","last_undegraded":"2023-11-28T13:01:28.205078+0000","last_fullsized":"2023-11-28T13:01:28.205078+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:17.121645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.514718+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:01:23.514718+0000","last_peered":"2023-11-28T13:01:23.514718+0000","last_clean":"2023-11-28T13:01:23.514718+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:01:23.514718+0000","last_undegraded":"2023-11-28T13:01:23.514718+0000","last_fullsized":"2023-11-28T13:01:23.514718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.211945+0000","last_change":"2023-11-28T13:01:28.211945+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.211945+0000","last_undegraded":"2023-11-28T13:01:28.211945+0000","last_fullsized":"2023-11-28T13:01:28.211945+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:08.725526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.516142+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:01:23.516142+0000","last_peered":"2023-11-28T13:01:23.516142+0000","last_clean":"2023-11-28T13:01:23.516142+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:01:23.516142+0000","last_undegraded":"2023-11-28T13:01:23.516142+0000","last_fullsized":"2023-11-28T13:01:23.516142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9424,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362416,"statfs":{"total":96636764160,"available":96627113984,"internally_reserved":0,"allocated":991232,"data_stored":750018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.56000000000000005}]},{"osd":1,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.80200000000000005}]},{"osd":2,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.008}]},{"osd":3,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.1080000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.84699999999999998}]},{"osd":5,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.88400000000000001}]},{"osd":6,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.044},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.0700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8268,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363572,"statfs":{"total":96636764160,"available":96628297728,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.79600000000000004}]},{"osd":1,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.69099999999999995}]},{"osd":2,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.73299999999999998}]},{"osd":3,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.94099999999999995}]},{"osd":4,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":10.566000000000001,"5min":10.566000000000001,"15min":10.566000000000001},"last":0.82599999999999996}]},{"osd":5,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.91500000000000004}]},{"osd":7,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":3.4980000000000002,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":3.593,"5min":3.593,"15min":3.593},"last":1.1499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8268,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363572,"statfs":{"total":96636764160,"available":96628297728,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.88900000000000001}]},{"osd":1,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.83299999999999996}]},{"osd":2,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0580000000000001}]},{"osd":3,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.79400000000000004}]},{"osd":4,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":1.111},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.0349999999999999}]},{"osd":6,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.448}]},{"osd":7,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.196}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8396,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363444,"statfs":{"total":96636764160,"available":96628166656,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.69199999999999995}]},{"osd":1,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.81000000000000005}]},{"osd":2,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.85599999999999998}]},{"osd":3,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.97799999999999998}]},{"osd":5,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.23},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.006}]},{"osd":6,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":1.1839999999999999}]},{"osd":7,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.046},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.1359999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8332,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363508,"statfs":{"total":96636764160,"available":96628232192,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.54800000000000004}]},{"osd":1,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.52700000000000002}]},{"osd":2,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.624},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.64100000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.57899999999999996}]},{"osd":5,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.751}]},{"osd":6,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.82499999999999996}]},{"osd":7,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.002}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8268,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363572,"statfs":{"total":96636764160,"available":96628297728,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.75900000000000001}]},{"osd":1,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.58999999999999997}]},{"osd":3,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.83799999999999997}]},{"osd":4,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.95399999999999996}]},{"osd":5,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.871},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.92300000000000004}]},{"osd":6,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":1.085}]},{"osd":7,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.024},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.0720000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8332,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363508,"statfs":{"total":96636764160,"available":96628232192,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.63400000000000001}]},{"osd":2,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.621},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.76400000000000001}]},{"osd":3,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.69899999999999995}]},{"osd":4,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":0.83899999999999997}]},{"osd":5,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.91600000000000004}]},{"osd":6,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.96099999999999997}]},{"osd":7,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.0109999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9424,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362416,"statfs":{"total":96636764160,"available":96627113984,"internally_reserved":0,"allocated":991232,"data_stored":750018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.53200000000000003}]},{"osd":2,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.81000000000000005}]},{"osd":3,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.78000000000000003}]},{"osd":4,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":1.044}]},{"osd":5,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.71799999999999997}]},{"osd":6,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.89700000000000002}]},{"osd":7,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.96599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:01:33.866 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:01:33.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabfafd3700 1 Processor -- start 2023-11-28T13:01:33.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabfafd3700 1 -- start start 2023-11-28T13:01:33.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabfafd3700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fabf4070070 0x7fabf4070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:33.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabfafd3700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabf4160900 0x7fabf40cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:33.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabfafd3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf4070980 con 0x7fabf40c1910 2023-11-28T13:01:33.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabfafd3700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf40ce030 con 0x7fabf4070070 2023-11-28T13:01:33.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabfafd3700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf40ce310 con 0x7fabf4160900 2023-11-28T13:01:33.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabfa7d2700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fabf40c1910 0x7fabf41641e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52286/0 (socket says 172.21.15.82:52286) 2023-11-28T13:01:33.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabfa7d2700 1 -- 172.21.15.82:0/1701046056 learned_addr learned my addr 172.21.15.82:0/1701046056 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:33.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabf9fd1700 1 --2- 172.21.15.82:0/1701046056 >> v2:172.21.15.114:3300/0 conn(0x7fabf4070070 0x7fabf4070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:33.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabf97d0700 1 --2- 172.21.15.82:0/1701046056 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabf4160900 0x7fabf40cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:33.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabf8fcf700 1 -- 172.21.15.82:0/1701046056 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217196752 0 0) 0x7fabf4070980 con 0x7fabf40c1910 2023-11-28T13:01:33.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabf8fcf700 1 -- 172.21.15.82:0/1701046056 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabe00035d0 con 0x7fabf40c1910 2023-11-28T13:01:33.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabf8fcf700 1 -- 172.21.15.82:0/1701046056 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3041384018 0 0) 0x7fabe00035d0 con 0x7fabf40c1910 2023-11-28T13:01:33.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabf8fcf700 1 -- 172.21.15.82:0/1701046056 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabf4160900 msgr2=0x7fabf40cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:33.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabf8fcf700 1 --2- 172.21.15.82:0/1701046056 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabf4160900 0x7fabf40cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabf8fcf700 1 -- 172.21.15.82:0/1701046056 >> v2:172.21.15.114:3300/0 conn(0x7fabf4070070 msgr2=0x7fabf4070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:33.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabf8fcf700 1 --2- 172.21.15.82:0/1701046056 >> v2:172.21.15.114:3300/0 conn(0x7fabf4070070 0x7fabf4070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabf8fcf700 1 -- 172.21.15.82:0/1701046056 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf406a5d0 con 0x7fabf40c1910 2023-11-28T13:01:33.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabf8fcf700 1 -- 172.21.15.82:0/1701046056 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7fabec001670 con 0x7fabf40c1910 2023-11-28T13:01:33.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabf9fd1700 1 --2- 172.21.15.82:0/1701046056 >> v2:172.21.15.114:3300/0 conn(0x7fabf4070070 0x7fabf4070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:33.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabf8fcf700 1 -- 172.21.15.82:0/1701046056 >> v1:172.21.15.82:6789/0 conn(0x7fabf40c1910 legacy=0x7fabf41641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:33.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabf8fcf700 1 --2- 172.21.15.82:0/1701046056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe0003a20 0x7fabe0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:33.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabf8fcf700 1 --2- 172.21.15.82:0/1701046056 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabe0004450 0x7fabe00048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabf8fcf700 1 --2- 172.21.15.82:0/1701046056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabe0004ea0 0x7fabe0005310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabf8fcf700 1 -- 172.21.15.82:0/1701046056 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf40ce030 con 0x7fabe0003a20 2023-11-28T13:01:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabf8fcf700 1 -- 172.21.15.82:0/1701046056 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf40ce310 con 0x7fabe0004ea0 2023-11-28T13:01:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabf8fcf700 1 -- 172.21.15.82:0/1701046056 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe000bd60 con 0x7fabe0004450 2023-11-28T13:01:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabf9fd1700 1 --2- 172.21.15.82:0/1701046056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe0003a20 0x7fabe0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabf97d0700 1 --2- 172.21.15.82:0/1701046056 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabe0004450 0x7fabe00048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.975+0000 7fabfa7d2700 1 --2- 172.21.15.82:0/1701046056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabe0004ea0 0x7fabe0005310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabf9fd1700 1 -- 172.21.15.82:0/1701046056 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabe0004450 msgr2=0x7fabe00048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabf9fd1700 1 --2- 172.21.15.82:0/1701046056 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabe0004450 0x7fabe00048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabf9fd1700 1 -- 172.21.15.82:0/1701046056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabe0004ea0 msgr2=0x7fabe0005310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabf9fd1700 1 --2- 172.21.15.82:0/1701046056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabe0004ea0 0x7fabe0005310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabf9fd1700 1 -- 172.21.15.82:0/1701046056 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe00035d0 con 0x7fabe0003a20 2023-11-28T13:01:33.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabf9fd1700 1 --2- 172.21.15.82:0/1701046056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe0003a20 0x7fabe0003e30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fabf000e350 tx=0x7fabe00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7c633740ba767e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:33.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabf8fcf700 1 -- 172.21.15.82:0/1701046056 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf000edf0 con 0x7fabe0003a20 2023-11-28T13:01:33.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabf8fcf700 1 -- 172.21.15.82:0/1701046056 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf000f040 con 0x7fabe0003a20 2023-11-28T13:01:33.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabf8fcf700 1 -- 172.21.15.82:0/1701046056 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf00146a0 con 0x7fabe0003a20 2023-11-28T13:01:33.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabfafd3700 1 -- 172.21.15.82:0/1701046056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe0003a20 msgr2=0x7fabe0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:33.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabfafd3700 1 --2- 172.21.15.82:0/1701046056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe0003a20 0x7fabe0003e30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fabf000e350 tx=0x7fabe00058a0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabfa7d2700 1 -- 172.21.15.82:0/1701046056 reap_dead start 2023-11-28T13:01:33.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabfafd3700 1 -- 172.21.15.82:0/1701046056 shutdown_connections 2023-11-28T13:01:33.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabfafd3700 1 -- 172.21.15.82:0/1701046056 >> 172.21.15.82:0/1701046056 conn(0x7fabf40ce600 msgr2=0x7fabf40ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:33.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabfafd3700 1 -- 172.21.15.82:0/1701046056 shutdown_connections 2023-11-28T13:01:33.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabfafd3700 1 -- 172.21.15.82:0/1701046056 wait complete. 2023-11-28T13:01:33.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabfafd3700 1 Processor -- start 2023-11-28T13:01:33.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabfafd3700 1 -- start start 2023-11-28T13:01:33.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabfafd3700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabe0003a20 0x7fabf4163060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:33.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabfafd3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabf415cd70 0x7fabf41614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:33.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabfafd3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabf40b2040 0x7fabf406c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:33.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabfafd3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf4163980 con 0x7fabf415cd70 2023-11-28T13:01:33.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabfafd3700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf41636a0 con 0x7fabf40b2040 2023-11-28T13:01:33.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabfafd3700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf40b1560 con 0x7fabe0003a20 2023-11-28T13:01:33.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabf97d0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabf415cd70 0x7fabf41614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:33.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabf97d0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabf415cd70 0x7fabf41614c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47566/0 (socket says 172.21.15.82:47566) 2023-11-28T13:01:33.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabf97d0700 1 -- 172.21.15.82:0/1409645445 learned_addr learned my addr 172.21.15.82:0/1409645445 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:33.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.979+0000 7fabf9fd1700 1 --2- 172.21.15.82:0/1409645445 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabe0003a20 0x7fabf4163060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:33.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.983+0000 7fabfa7d2700 1 --2- 172.21.15.82:0/1409645445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabf40b2040 0x7fabf406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:33.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.983+0000 7fabf97d0700 1 -- 172.21.15.82:0/1409645445 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabe0003a20 msgr2=0x7fabf4163060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:33.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.983+0000 7fabf97d0700 1 --2- 172.21.15.82:0/1409645445 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabe0003a20 0x7fabf4163060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.983+0000 7fabf97d0700 1 -- 172.21.15.82:0/1409645445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabf40b2040 msgr2=0x7fabf406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:33.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.983+0000 7fabf97d0700 1 --2- 172.21.15.82:0/1409645445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabf40b2040 0x7fabf406c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:33.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.983+0000 7fabf97d0700 1 -- 172.21.15.82:0/1409645445 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf406ab90 con 0x7fabf415cd70 2023-11-28T13:01:33.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.983+0000 7fabf97d0700 1 --2- 172.21.15.82:0/1409645445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabf415cd70 0x7fabf41614c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fabe40119b0 tx=0x7fabe4011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:33.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.983+0000 7fabea7fc700 1 -- 172.21.15.82:0/1409645445 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe400f940 con 0x7fabf415cd70 2023-11-28T13:01:33.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.983+0000 7fabea7fc700 1 -- 172.21.15.82:0/1409645445 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe400faa0 con 0x7fabf415cd70 2023-11-28T13:01:33.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.983+0000 7fabfafd3700 1 -- 172.21.15.82:0/1409645445 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf406a8b0 con 0x7fabf415cd70 2023-11-28T13:01:33.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.983+0000 7fabea7fc700 1 -- 172.21.15.82:0/1409645445 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe400fe30 con 0x7fabf415cd70 2023-11-28T13:01:33.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.983+0000 7fabfafd3700 1 -- 172.21.15.82:0/1409645445 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf40cdc50 con 0x7fabf415cd70 2023-11-28T13:01:33.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.983+0000 7fabfafd3700 1 -- 172.21.15.82:0/1409645445 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf4065fc0 con 0x7fabf415cd70 2023-11-28T13:01:33.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.987+0000 7fabea7fc700 1 -- 172.21.15.82:0/1409645445 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fabe4014440 con 0x7fabf415cd70 2023-11-28T13:01:33.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.987+0000 7fabea7fc700 1 --2- 172.21.15.82:0/1409645445 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fabd8064ee0 0x7fabd8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:33.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.987+0000 7fabea7fc700 1 -- 172.21.15.82:0/1409645445 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fabe40827f0 con 0x7fabf415cd70 2023-11-28T13:01:33.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.987+0000 7fabf9fd1700 1 --2- 172.21.15.82:0/1409645445 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fabd8064ee0 0x7fabd8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:33.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.987+0000 7fabf9fd1700 1 --2- 172.21.15.82:0/1409645445 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fabd8064ee0 0x7fabd8067390 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fabf0000f80 tx=0x7fabf0013000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:33.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:33.995+0000 7fabea7fc700 1 -- 172.21.15.82:0/1409645445 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fabe40509e0 con 0x7fabf415cd70 2023-11-28T13:01:34.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.150+0000 7fabfafd3700 1 -- 172.21.15.82:0/1409645445 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fabf40c8930 con 0x7fabd8064ee0 2023-11-28T13:01:34.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.166+0000 7fabea7fc700 1 -- 172.21.15.82:0/1409645445 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299123 (secure 0 0 0) 0x7fabf40c8930 con 0x7fabd8064ee0 2023-11-28T13:01:34.177 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:34.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.170+0000 7fabfafd3700 1 -- 172.21.15.82:0/1409645445 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fabd8064ee0 msgr2=0x7fabd8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:34.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.170+0000 7fabfafd3700 1 --2- 172.21.15.82:0/1409645445 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fabd8064ee0 0x7fabd8067390 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fabf0000f80 tx=0x7fabf0013000 comp rx=0 tx=0).stop 2023-11-28T13:01:34.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.170+0000 7fabfafd3700 1 -- 172.21.15.82:0/1409645445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabf415cd70 msgr2=0x7fabf41614c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:34.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.170+0000 7fabfafd3700 1 --2- 172.21.15.82:0/1409645445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabf415cd70 0x7fabf41614c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fabe40119b0 tx=0x7fabe4011d70 comp rx=0 tx=0).stop 2023-11-28T13:01:34.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.170+0000 7fabfafd3700 1 -- 172.21.15.82:0/1409645445 shutdown_connections 2023-11-28T13:01:34.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.170+0000 7fabfafd3700 1 --2- 172.21.15.82:0/1409645445 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fabd8064ee0 0x7fabd8067390 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.170+0000 7fabfafd3700 1 --2- 172.21.15.82:0/1409645445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabf40b2040 0x7fabf406c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.170+0000 7fabfafd3700 1 --2- 172.21.15.82:0/1409645445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabf415cd70 0x7fabf41614c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.170+0000 7fabfafd3700 1 --2- 172.21.15.82:0/1409645445 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabe0003a20 0x7fabf4163060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.170+0000 7fabfafd3700 1 -- 172.21.15.82:0/1409645445 >> 172.21.15.82:0/1409645445 conn(0x7fabf40ce600 msgr2=0x7fabf40ca400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:34.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.170+0000 7fabfafd3700 1 -- 172.21.15.82:0/1409645445 shutdown_connections 2023-11-28T13:01:34.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.170+0000 7fabfafd3700 1 -- 172.21.15.82:0/1409645445 wait complete. 2023-11-28T13:01:34.181 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:01:34.191 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-11-28T13:01:33.178747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":68712,"kb_used_data":4264,"kb_used_omap":0,"kb_used_meta":64384,"kb_avail":754906008,"statfs":{"total":773094113280,"available":773023752192,"internally_reserved":0,"allocated":4366336,"data_stored":2457936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65929216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.978000"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.209096+0000","last_change":"2023-11-28T13:01:28.209096+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.209096+0000","last_undegraded":"2023-11-28T13:01:28.209096+0000","last_fullsized":"2023-11-28T13:01:28.209096+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:10.621678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.216358+0000","last_change":"2023-11-28T13:01:28.216358+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.216358+0000","last_undegraded":"2023-11-28T13:01:28.216358+0000","last_fullsized":"2023-11-28T13:01:28.216358+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:12.505253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.207862+0000","last_change":"2023-11-28T13:01:28.207862+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.207862+0000","last_undegraded":"2023-11-28T13:01:28.207862+0000","last_fullsized":"2023-11-28T13:01:28.207862+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:16.854220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.206667+0000","last_change":"2023-11-28T13:01:28.206667+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.206667+0000","last_undegraded":"2023-11-28T13:01:28.206667+0000","last_fullsized":"2023-11-28T13:01:28.206667+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:15:15.549631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.210511+0000","last_change":"2023-11-28T13:01:28.210511+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.210511+0000","last_undegraded":"2023-11-28T13:01:28.210511+0000","last_fullsized":"2023-11-28T13:01:28.210511+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:09:46.508882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.205219+0000","last_change":"2023-11-28T13:01:28.205219+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.205219+0000","last_undegraded":"2023-11-28T13:01:28.205219+0000","last_fullsized":"2023-11-28T13:01:28.205219+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:47.130802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.207317+0000","last_change":"2023-11-28T13:01:28.207317+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.207317+0000","last_undegraded":"2023-11-28T13:01:28.207317+0000","last_fullsized":"2023-11-28T13:01:28.207317+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:19.124556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.204505+0000","last_change":"2023-11-28T13:01:28.204505+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.204505+0000","last_undegraded":"2023-11-28T13:01:28.204505+0000","last_fullsized":"2023-11-28T13:01:28.204505+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:55.167964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.212634+0000","last_change":"2023-11-28T13:01:28.212634+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.212634+0000","last_undegraded":"2023-11-28T13:01:28.212634+0000","last_fullsized":"2023-11-28T13:01:28.212634+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:12.505253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.210023+0000","last_change":"2023-11-28T13:01:28.210023+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.210023+0000","last_undegraded":"2023-11-28T13:01:28.210023+0000","last_fullsized":"2023-11-28T13:01:28.210023+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:35.486834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.210087+0000","last_change":"2023-11-28T13:01:28.210087+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.210087+0000","last_undegraded":"2023-11-28T13:01:28.210087+0000","last_fullsized":"2023-11-28T13:01:28.210087+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:06.881393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.212051+0000","last_change":"2023-11-28T13:01:28.212051+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.212051+0000","last_undegraded":"2023-11-28T13:01:28.212051+0000","last_fullsized":"2023-11-28T13:01:28.212051+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:35.486834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.212157+0000","last_change":"2023-11-28T13:01:28.212157+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.212157+0000","last_undegraded":"2023-11-28T13:01:28.212157+0000","last_fullsized":"2023-11-28T13:01:28.212157+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:06.881393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.207555+0000","last_change":"2023-11-28T13:01:28.207555+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.207555+0000","last_undegraded":"2023-11-28T13:01:28.207555+0000","last_fullsized":"2023-11-28T13:01:28.207555+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:34.884855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.208225+0000","last_change":"2023-11-28T13:01:28.208225+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.208225+0000","last_undegraded":"2023-11-28T13:01:28.208225+0000","last_fullsized":"2023-11-28T13:01:28.208225+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:15:31.600456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.204831+0000","last_change":"2023-11-28T13:01:28.204831+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.204831+0000","last_undegraded":"2023-11-28T13:01:28.204831+0000","last_fullsized":"2023-11-28T13:01:28.204831+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:16.854220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.211191+0000","last_change":"2023-11-28T13:01:28.211191+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.211191+0000","last_undegraded":"2023-11-28T13:01:28.211191+0000","last_fullsized":"2023-11-28T13:01:28.211191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:08.725526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.207008+0000","last_change":"2023-11-28T13:01:28.207008+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.207008+0000","last_undegraded":"2023-11-28T13:01:28.207008+0000","last_fullsized":"2023-11-28T13:01:28.207008+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:22:36.945966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.215029+0000","last_change":"2023-11-28T13:01:28.215029+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.215029+0000","last_undegraded":"2023-11-28T13:01:28.215029+0000","last_fullsized":"2023-11-28T13:01:28.215029+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:50.711987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.206715+0000","last_change":"2023-11-28T13:01:28.206715+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.206715+0000","last_undegraded":"2023-11-28T13:01:28.206715+0000","last_fullsized":"2023-11-28T13:01:28.206715+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:47.130802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.216172+0000","last_change":"2023-11-28T13:01:28.216172+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.216172+0000","last_undegraded":"2023-11-28T13:01:28.216172+0000","last_fullsized":"2023-11-28T13:01:28.216172+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:33.041552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.214997+0000","last_change":"2023-11-28T13:01:28.214997+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.214997+0000","last_undegraded":"2023-11-28T13:01:28.214997+0000","last_fullsized":"2023-11-28T13:01:28.214997+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:15:31.600456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.205267+0000","last_change":"2023-11-28T13:01:28.205267+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.205267+0000","last_undegraded":"2023-11-28T13:01:28.205267+0000","last_fullsized":"2023-11-28T13:01:28.205267+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:19.124556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.214886+0000","last_change":"2023-11-28T13:01:28.214886+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.214886+0000","last_undegraded":"2023-11-28T13:01:28.214886+0000","last_fullsized":"2023-11-28T13:01:28.214886+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:06:16.368208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.205762+0000","last_change":"2023-11-28T13:01:28.205762+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.205762+0000","last_undegraded":"2023-11-28T13:01:28.205762+0000","last_fullsized":"2023-11-28T13:01:28.205762+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:34.884855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.371214+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:01:23.371214+0000","last_peered":"2023-11-28T13:01:23.371214+0000","last_clean":"2023-11-28T13:01:23.371214+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:01:23.371214+0000","last_undegraded":"2023-11-28T13:01:23.371214+0000","last_fullsized":"2023-11-28T13:01:23.371214+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.379419+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:01:23.379419+0000","last_peered":"2023-11-28T13:01:23.379419+0000","last_clean":"2023-11-28T13:01:23.379419+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:01:23.379419+0000","last_undegraded":"2023-11-28T13:01:23.379419+0000","last_fullsized":"2023-11-28T13:01:23.379419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.210522+0000","last_change":"2023-11-28T13:01:28.210522+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.210522+0000","last_undegraded":"2023-11-28T13:01:28.210522+0000","last_fullsized":"2023-11-28T13:01:28.210522+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:12.505253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.371192+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:01:23.371192+0000","last_peered":"2023-11-28T13:01:23.371192+0000","last_clean":"2023-11-28T13:01:23.371192+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:01:23.371192+0000","last_undegraded":"2023-11-28T13:01:23.371192+0000","last_fullsized":"2023-11-28T13:01:23.371192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.215746+0000","last_change":"2023-11-28T13:01:28.215746+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.215746+0000","last_undegraded":"2023-11-28T13:01:28.215746+0000","last_fullsized":"2023-11-28T13:01:28.215746+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:10.621678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.425397+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:01:23.425397+0000","last_peered":"2023-11-28T13:01:23.425397+0000","last_clean":"2023-11-28T13:01:23.425397+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:01:23.425397+0000","last_undegraded":"2023-11-28T13:01:23.425397+0000","last_fullsized":"2023-11-28T13:01:23.425397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.215720+0000","last_change":"2023-11-28T13:01:28.215720+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.215720+0000","last_undegraded":"2023-11-28T13:01:28.215720+0000","last_fullsized":"2023-11-28T13:01:28.215720+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:06.881393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.383349+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:01:23.383349+0000","last_peered":"2023-11-28T13:01:23.383349+0000","last_clean":"2023-11-28T13:01:23.383349+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:01:23.383349+0000","last_undegraded":"2023-11-28T13:01:23.383349+0000","last_fullsized":"2023-11-28T13:01:23.383349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.215058+0000","last_change":"2023-11-28T13:01:28.215058+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.215058+0000","last_undegraded":"2023-11-28T13:01:28.215058+0000","last_fullsized":"2023-11-28T13:01:28.215058+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:08.725526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.514873+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:01:23.514873+0000","last_peered":"2023-11-28T13:01:23.514873+0000","last_clean":"2023-11-28T13:01:23.514873+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:01:23.514873+0000","last_undegraded":"2023-11-28T13:01:23.514873+0000","last_fullsized":"2023-11-28T13:01:23.514873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.209135+0000","last_change":"2023-11-28T13:01:28.209135+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.209135+0000","last_undegraded":"2023-11-28T13:01:28.209135+0000","last_fullsized":"2023-11-28T13:01:28.209135+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:33.041552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.371232+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:01:23.371232+0000","last_peered":"2023-11-28T13:01:23.371232+0000","last_clean":"2023-11-28T13:01:23.371232+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:01:23.371232+0000","last_undegraded":"2023-11-28T13:01:23.371232+0000","last_fullsized":"2023-11-28T13:01:23.371232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.205078+0000","last_change":"2023-11-28T13:01:28.205078+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.205078+0000","last_undegraded":"2023-11-28T13:01:28.205078+0000","last_fullsized":"2023-11-28T13:01:28.205078+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:17.121645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.514718+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:01:23.514718+0000","last_peered":"2023-11-28T13:01:23.514718+0000","last_clean":"2023-11-28T13:01:23.514718+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:01:23.514718+0000","last_undegraded":"2023-11-28T13:01:23.514718+0000","last_fullsized":"2023-11-28T13:01:23.514718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.211945+0000","last_change":"2023-11-28T13:01:28.211945+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.211945+0000","last_undegraded":"2023-11-28T13:01:28.211945+0000","last_fullsized":"2023-11-28T13:01:28.211945+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:08.725526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.516142+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:01:23.516142+0000","last_peered":"2023-11-28T13:01:23.516142+0000","last_clean":"2023-11-28T13:01:23.516142+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:01:23.516142+0000","last_undegraded":"2023-11-28T13:01:23.516142+0000","last_fullsized":"2023-11-28T13:01:23.516142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9424,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362416,"statfs":{"total":96636764160,"available":96627113984,"internally_reserved":0,"allocated":991232,"data_stored":750018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.56000000000000005}]},{"osd":1,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.80200000000000005}]},{"osd":2,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.008}]},{"osd":3,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.1080000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.84699999999999998}]},{"osd":5,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.88400000000000001}]},{"osd":6,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.044},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.0700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8268,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363572,"statfs":{"total":96636764160,"available":96628297728,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.79600000000000004}]},{"osd":1,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.69099999999999995}]},{"osd":2,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.73299999999999998}]},{"osd":3,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.94099999999999995}]},{"osd":4,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":10.566000000000001,"5min":10.566000000000001,"15min":10.566000000000001},"last":0.82599999999999996}]},{"osd":5,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.91500000000000004}]},{"osd":7,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":3.4980000000000002,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":3.593,"5min":3.593,"15min":3.593},"last":1.1499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8268,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363572,"statfs":{"total":96636764160,"available":96628297728,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.88900000000000001}]},{"osd":1,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.83299999999999996}]},{"osd":2,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0580000000000001}]},{"osd":3,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.79400000000000004}]},{"osd":4,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":1.111},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.0349999999999999}]},{"osd":6,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.448}]},{"osd":7,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.196}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8396,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363444,"statfs":{"total":96636764160,"available":96628166656,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.69199999999999995}]},{"osd":1,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.81000000000000005}]},{"osd":2,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.85599999999999998}]},{"osd":3,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.97799999999999998}]},{"osd":5,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.23},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.006}]},{"osd":6,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":1.1839999999999999}]},{"osd":7,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.046},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.1359999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8332,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363508,"statfs":{"total":96636764160,"available":96628232192,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.54800000000000004}]},{"osd":1,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.52700000000000002}]},{"osd":2,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.624},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.64100000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.57899999999999996}]},{"osd":5,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.751}]},{"osd":6,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.82499999999999996}]},{"osd":7,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.002}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8268,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363572,"statfs":{"total":96636764160,"available":96628297728,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.75900000000000001}]},{"osd":1,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.58999999999999997}]},{"osd":3,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.83799999999999997}]},{"osd":4,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.95399999999999996}]},{"osd":5,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.871},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.92300000000000004}]},{"osd":6,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":1.085}]},{"osd":7,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.024},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.0720000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8332,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363508,"statfs":{"total":96636764160,"available":96628232192,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.63400000000000001}]},{"osd":2,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.621},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.76400000000000001}]},{"osd":3,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.69899999999999995}]},{"osd":4,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":0.83899999999999997}]},{"osd":5,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.91600000000000004}]},{"osd":6,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.96099999999999997}]},{"osd":7,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.0109999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9424,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362416,"statfs":{"total":96636764160,"available":96627113984,"internally_reserved":0,"allocated":991232,"data_stored":750018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.53200000000000003}]},{"osd":2,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.81000000000000005}]},{"osd":3,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.78000000000000003}]},{"osd":4,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":1.044}]},{"osd":5,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.71799999999999997}]},{"osd":6,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.89700000000000002}]},{"osd":7,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.96599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:01:34.197 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:01:34.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.306+0000 7fe0f1374700 1 Processor -- start 2023-11-28T13:01:34.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.306+0000 7fe0f1374700 1 -- start start 2023-11-28T13:01:34.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0f1374700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0ec070070 0x7fe0ec070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:34.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0f1374700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0ec0c1910 0x7fe0ec06c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:34.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0f1374700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ec070980 con 0x7fe0ec160900 2023-11-28T13:01:34.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0f1374700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ec0ce030 con 0x7fe0ec070070 2023-11-28T13:01:34.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0f1374700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec0ce310 con 0x7fe0ec0c1910 2023-11-28T13:01:34.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0f0b73700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0ec0c1910 0x7fe0ec06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:34.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0ebfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0ec070070 0x7fe0ec070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:34.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0f0b73700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0ec0c1910 0x7fe0ec06c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:39180/0 (socket says 172.21.15.82:39180) 2023-11-28T13:01:34.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0eb7fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe0ec160900 0x7fe0ec0cc1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:43886/0 (socket says 172.21.15.82:43886) 2023-11-28T13:01:34.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0f0b73700 1 -- 172.21.15.82:0/3988609633 learned_addr learned my addr 172.21.15.82:0/3988609633 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:34.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0ebfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0ec070070 0x7fe0ec070440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:42430/0 (socket says 172.21.15.82:42430) 2023-11-28T13:01:34.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0eaffd700 1 -- 172.21.15.82:0/3988609633 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520734120 0 0) 0x7fe0ec070980 con 0x7fe0ec160900 2023-11-28T13:01:34.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0eaffd700 1 -- 172.21.15.82:0/3988609633 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0d40035d0 con 0x7fe0ec160900 2023-11-28T13:01:34.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0ebfff700 1 -- 172.21.15.82:0/3988609633 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0ec0c1910 msgr2=0x7fe0ec06c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:34.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0ebfff700 1 --2- 172.21.15.82:0/3988609633 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0ec0c1910 0x7fe0ec06c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0ebfff700 1 -- 172.21.15.82:0/3988609633 >> v1:172.21.15.114:6789/0 conn(0x7fe0ec160900 legacy=0x7fe0ec0cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:34.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0ebfff700 1 -- 172.21.15.82:0/3988609633 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec06a5d0 con 0x7fe0ec070070 2023-11-28T13:01:34.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0f0b73700 1 --2- 172.21.15.82:0/3988609633 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0ec0c1910 0x7fe0ec06c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:34.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0ebfff700 1 --2- 172.21.15.82:0/3988609633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0ec070070 0x7fe0ec070440 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0009850 tx=0x7fe0e0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb544bcee92e452 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:34.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0eaffd700 1 -- 172.21.15.82:0/3988609633 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0011830 con 0x7fe0ec070070 2023-11-28T13:01:34.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0eaffd700 1 -- 172.21.15.82:0/3988609633 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e0011990 con 0x7fe0ec070070 2023-11-28T13:01:34.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0eaffd700 1 -- 172.21.15.82:0/3988609633 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0011d40 con 0x7fe0ec070070 2023-11-28T13:01:34.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0f1374700 1 -- 172.21.15.82:0/3988609633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0ec070070 msgr2=0x7fe0ec070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:34.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0f1374700 1 --2- 172.21.15.82:0/3988609633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0ec070070 0x7fe0ec070440 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0009850 tx=0x7fe0e0009b60 comp rx=0 tx=0).stop 2023-11-28T13:01:34.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0f1374700 1 -- 172.21.15.82:0/3988609633 shutdown_connections 2023-11-28T13:01:34.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0f1374700 1 --2- 172.21.15.82:0/3988609633 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0ec0c1910 0x7fe0ec06c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0f1374700 1 --2- 172.21.15.82:0/3988609633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0ec070070 0x7fe0ec070440 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0f1374700 1 -- 172.21.15.82:0/3988609633 >> 172.21.15.82:0/3988609633 conn(0x7fe0ec0ce600 msgr2=0x7fe0ec0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:34.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0f1374700 1 -- 172.21.15.82:0/3988609633 shutdown_connections 2023-11-28T13:01:34.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.310+0000 7fe0f1374700 1 -- 172.21.15.82:0/3988609633 wait complete. 2023-11-28T13:01:34.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.314+0000 7fe0f1374700 1 Processor -- start 2023-11-28T13:01:34.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.314+0000 7fe0f1374700 1 -- start start 2023-11-28T13:01:34.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.314+0000 7fe0f1374700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0ec160f10 0x7fe0ec1624e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:34.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.314+0000 7fe0f1374700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0ec1f5f20 0x7fe0ec1612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:34.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.314+0000 7fe0f1374700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0ec161820 0x7fe0ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:34.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.314+0000 7fe0f1374700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec1f9510 con 0x7fe0ec161820 2023-11-28T13:01:34.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.314+0000 7fe0f1374700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec1f63c0 con 0x7fe0ec160f10 2023-11-28T13:01:34.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.314+0000 7fe0f1374700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec1f66a0 con 0x7fe0ec1f5f20 2023-11-28T13:01:34.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.314+0000 7fe0f0b73700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0ec161820 0x7fe0ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:34.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.314+0000 7fe0f0b73700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0ec161820 0x7fe0ec06d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47582/0 (socket says 172.21.15.82:47582) 2023-11-28T13:01:34.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.314+0000 7fe0f0b73700 1 -- 172.21.15.82:0/1735887619 learned_addr learned my addr 172.21.15.82:0/1735887619 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:34.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.314+0000 7fe0eb7fe700 1 --2- 172.21.15.82:0/1735887619 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0ec1f5f20 0x7fe0ec1612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:34.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.314+0000 7fe0ebfff700 1 --2- 172.21.15.82:0/1735887619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0ec160f10 0x7fe0ec1624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:34.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.314+0000 7fe0f0b73700 1 -- 172.21.15.82:0/1735887619 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0ec1f5f20 msgr2=0x7fe0ec1612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:34.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.314+0000 7fe0f0b73700 1 --2- 172.21.15.82:0/1735887619 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0ec1f5f20 0x7fe0ec1612e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.314+0000 7fe0f0b73700 1 -- 172.21.15.82:0/1735887619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0ec160f10 msgr2=0x7fe0ec1624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:34.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.314+0000 7fe0f0b73700 1 --2- 172.21.15.82:0/1735887619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0ec160f10 0x7fe0ec1624e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.314+0000 7fe0f0b73700 1 -- 172.21.15.82:0/1735887619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e4009570 con 0x7fe0ec161820 2023-11-28T13:01:34.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.314+0000 7fe0ebfff700 1 --2- 172.21.15.82:0/1735887619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0ec160f10 0x7fe0ec1624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:34.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.314+0000 7fe0f0b73700 1 --2- 172.21.15.82:0/1735887619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0ec161820 0x7fe0ec06d0c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400e950 tx=0x7fe0e400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:34.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.314+0000 7fe0e8ff9700 1 -- 172.21.15.82:0/1735887619 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e400eea0 con 0x7fe0ec161820 2023-11-28T13:01:34.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.318+0000 7fe0e8ff9700 1 -- 172.21.15.82:0/1735887619 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e400c850 con 0x7fe0ec161820 2023-11-28T13:01:34.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.318+0000 7fe0e8ff9700 1 -- 172.21.15.82:0/1735887619 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e400cc00 con 0x7fe0ec161820 2023-11-28T13:01:34.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.318+0000 7fe0f1374700 1 -- 172.21.15.82:0/1735887619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e00094b0 con 0x7fe0ec161820 2023-11-28T13:01:34.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.318+0000 7fe0f1374700 1 -- 172.21.15.82:0/1735887619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ec06ab90 con 0x7fe0ec161820 2023-11-28T13:01:34.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.318+0000 7fe0f1374700 1 -- 172.21.15.82:0/1735887619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ec06a8b0 con 0x7fe0ec161820 2023-11-28T13:01:34.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.318+0000 7fe0e8ff9700 1 -- 172.21.15.82:0/1735887619 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe0e4019030 con 0x7fe0ec161820 2023-11-28T13:01:34.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.318+0000 7fe0e8ff9700 1 --2- 172.21.15.82:0/1735887619 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe0d8064ee0 0x7fe0d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:34.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.318+0000 7fe0ebfff700 1 --2- 172.21.15.82:0/1735887619 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe0d8064ee0 0x7fe0d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:34.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.318+0000 7fe0e8ff9700 1 -- 172.21.15.82:0/1735887619 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe0e4081f10 con 0x7fe0ec161820 2023-11-28T13:01:34.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.322+0000 7fe0ebfff700 1 --2- 172.21.15.82:0/1735887619 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe0d8064ee0 0x7fe0d8067390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec06be20 tx=0x7fe0e0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:34.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.326+0000 7fe0e8ff9700 1 -- 172.21.15.82:0/1735887619 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe0e404ffc0 con 0x7fe0ec161820 2023-11-28T13:01:34.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.478+0000 7fe0f1374700 1 -- 172.21.15.82:0/1735887619 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0ec0cdc50 con 0x7fe0d8064ee0 2023-11-28T13:01:34.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.494+0000 7fe0e8ff9700 1 -- 172.21.15.82:0/1735887619 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299123 (secure 0 0 0) 0x7fe0ec0cdc50 con 0x7fe0d8064ee0 2023-11-28T13:01:34.504 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:34.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.498+0000 7fe0f1374700 1 -- 172.21.15.82:0/1735887619 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe0d8064ee0 msgr2=0x7fe0d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:34.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.498+0000 7fe0f1374700 1 --2- 172.21.15.82:0/1735887619 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe0d8064ee0 0x7fe0d8067390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec06be20 tx=0x7fe0e0008030 comp rx=0 tx=0).stop 2023-11-28T13:01:34.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.498+0000 7fe0f1374700 1 -- 172.21.15.82:0/1735887619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0ec161820 msgr2=0x7fe0ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:34.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.498+0000 7fe0f1374700 1 --2- 172.21.15.82:0/1735887619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0ec161820 0x7fe0ec06d0c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400e950 tx=0x7fe0e400ec60 comp rx=0 tx=0).stop 2023-11-28T13:01:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.498+0000 7fe0f1374700 1 -- 172.21.15.82:0/1735887619 shutdown_connections 2023-11-28T13:01:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.498+0000 7fe0f1374700 1 --2- 172.21.15.82:0/1735887619 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe0d8064ee0 0x7fe0d8067390 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.498+0000 7fe0f1374700 1 --2- 172.21.15.82:0/1735887619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0ec161820 0x7fe0ec06d0c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.498+0000 7fe0f1374700 1 --2- 172.21.15.82:0/1735887619 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0ec1f5f20 0x7fe0ec1612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.498+0000 7fe0f1374700 1 --2- 172.21.15.82:0/1735887619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0ec160f10 0x7fe0ec1624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.498+0000 7fe0f1374700 1 -- 172.21.15.82:0/1735887619 >> 172.21.15.82:0/1735887619 conn(0x7fe0ec0ce600 msgr2=0x7fe0ec0cc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.498+0000 7fe0f1374700 1 -- 172.21.15.82:0/1735887619 shutdown_connections 2023-11-28T13:01:34.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.498+0000 7fe0f1374700 1 -- 172.21.15.82:0/1735887619 wait complete. 2023-11-28T13:01:34.508 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:01:34.520 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-11-28T13:01:33.178747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":68712,"kb_used_data":4264,"kb_used_omap":0,"kb_used_meta":64384,"kb_avail":754906008,"statfs":{"total":773094113280,"available":773023752192,"internally_reserved":0,"allocated":4366336,"data_stored":2457936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65929216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.978000"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.209096+0000","last_change":"2023-11-28T13:01:28.209096+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.209096+0000","last_undegraded":"2023-11-28T13:01:28.209096+0000","last_fullsized":"2023-11-28T13:01:28.209096+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:10.621678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.216358+0000","last_change":"2023-11-28T13:01:28.216358+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.216358+0000","last_undegraded":"2023-11-28T13:01:28.216358+0000","last_fullsized":"2023-11-28T13:01:28.216358+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:12.505253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.207862+0000","last_change":"2023-11-28T13:01:28.207862+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.207862+0000","last_undegraded":"2023-11-28T13:01:28.207862+0000","last_fullsized":"2023-11-28T13:01:28.207862+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:16.854220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.206667+0000","last_change":"2023-11-28T13:01:28.206667+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.206667+0000","last_undegraded":"2023-11-28T13:01:28.206667+0000","last_fullsized":"2023-11-28T13:01:28.206667+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:15:15.549631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.210511+0000","last_change":"2023-11-28T13:01:28.210511+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.210511+0000","last_undegraded":"2023-11-28T13:01:28.210511+0000","last_fullsized":"2023-11-28T13:01:28.210511+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:09:46.508882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.205219+0000","last_change":"2023-11-28T13:01:28.205219+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.205219+0000","last_undegraded":"2023-11-28T13:01:28.205219+0000","last_fullsized":"2023-11-28T13:01:28.205219+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:47.130802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.207317+0000","last_change":"2023-11-28T13:01:28.207317+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.207317+0000","last_undegraded":"2023-11-28T13:01:28.207317+0000","last_fullsized":"2023-11-28T13:01:28.207317+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:19.124556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.204505+0000","last_change":"2023-11-28T13:01:28.204505+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.204505+0000","last_undegraded":"2023-11-28T13:01:28.204505+0000","last_fullsized":"2023-11-28T13:01:28.204505+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:55.167964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.212634+0000","last_change":"2023-11-28T13:01:28.212634+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.212634+0000","last_undegraded":"2023-11-28T13:01:28.212634+0000","last_fullsized":"2023-11-28T13:01:28.212634+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:12.505253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.210023+0000","last_change":"2023-11-28T13:01:28.210023+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.210023+0000","last_undegraded":"2023-11-28T13:01:28.210023+0000","last_fullsized":"2023-11-28T13:01:28.210023+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:35.486834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.210087+0000","last_change":"2023-11-28T13:01:28.210087+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.210087+0000","last_undegraded":"2023-11-28T13:01:28.210087+0000","last_fullsized":"2023-11-28T13:01:28.210087+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:06.881393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.212051+0000","last_change":"2023-11-28T13:01:28.212051+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.212051+0000","last_undegraded":"2023-11-28T13:01:28.212051+0000","last_fullsized":"2023-11-28T13:01:28.212051+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:35.486834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.212157+0000","last_change":"2023-11-28T13:01:28.212157+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.212157+0000","last_undegraded":"2023-11-28T13:01:28.212157+0000","last_fullsized":"2023-11-28T13:01:28.212157+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:06.881393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.207555+0000","last_change":"2023-11-28T13:01:28.207555+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.207555+0000","last_undegraded":"2023-11-28T13:01:28.207555+0000","last_fullsized":"2023-11-28T13:01:28.207555+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:34.884855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.208225+0000","last_change":"2023-11-28T13:01:28.208225+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.208225+0000","last_undegraded":"2023-11-28T13:01:28.208225+0000","last_fullsized":"2023-11-28T13:01:28.208225+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:15:31.600456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.204831+0000","last_change":"2023-11-28T13:01:28.204831+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.204831+0000","last_undegraded":"2023-11-28T13:01:28.204831+0000","last_fullsized":"2023-11-28T13:01:28.204831+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:16.854220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.211191+0000","last_change":"2023-11-28T13:01:28.211191+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.211191+0000","last_undegraded":"2023-11-28T13:01:28.211191+0000","last_fullsized":"2023-11-28T13:01:28.211191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:08.725526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.207008+0000","last_change":"2023-11-28T13:01:28.207008+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.207008+0000","last_undegraded":"2023-11-28T13:01:28.207008+0000","last_fullsized":"2023-11-28T13:01:28.207008+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:22:36.945966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.215029+0000","last_change":"2023-11-28T13:01:28.215029+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.215029+0000","last_undegraded":"2023-11-28T13:01:28.215029+0000","last_fullsized":"2023-11-28T13:01:28.215029+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:50.711987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.206715+0000","last_change":"2023-11-28T13:01:28.206715+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.206715+0000","last_undegraded":"2023-11-28T13:01:28.206715+0000","last_fullsized":"2023-11-28T13:01:28.206715+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:47.130802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.216172+0000","last_change":"2023-11-28T13:01:28.216172+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.216172+0000","last_undegraded":"2023-11-28T13:01:28.216172+0000","last_fullsized":"2023-11-28T13:01:28.216172+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:33.041552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.214997+0000","last_change":"2023-11-28T13:01:28.214997+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.214997+0000","last_undegraded":"2023-11-28T13:01:28.214997+0000","last_fullsized":"2023-11-28T13:01:28.214997+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:15:31.600456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.205267+0000","last_change":"2023-11-28T13:01:28.205267+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.205267+0000","last_undegraded":"2023-11-28T13:01:28.205267+0000","last_fullsized":"2023-11-28T13:01:28.205267+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:19.124556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.214886+0000","last_change":"2023-11-28T13:01:28.214886+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.214886+0000","last_undegraded":"2023-11-28T13:01:28.214886+0000","last_fullsized":"2023-11-28T13:01:28.214886+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:06:16.368208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.205762+0000","last_change":"2023-11-28T13:01:28.205762+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.205762+0000","last_undegraded":"2023-11-28T13:01:28.205762+0000","last_fullsized":"2023-11-28T13:01:28.205762+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:34.884855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.371214+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:01:23.371214+0000","last_peered":"2023-11-28T13:01:23.371214+0000","last_clean":"2023-11-28T13:01:23.371214+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:01:23.371214+0000","last_undegraded":"2023-11-28T13:01:23.371214+0000","last_fullsized":"2023-11-28T13:01:23.371214+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.379419+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:01:23.379419+0000","last_peered":"2023-11-28T13:01:23.379419+0000","last_clean":"2023-11-28T13:01:23.379419+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:01:23.379419+0000","last_undegraded":"2023-11-28T13:01:23.379419+0000","last_fullsized":"2023-11-28T13:01:23.379419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.210522+0000","last_change":"2023-11-28T13:01:28.210522+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.210522+0000","last_undegraded":"2023-11-28T13:01:28.210522+0000","last_fullsized":"2023-11-28T13:01:28.210522+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:12.505253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.371192+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:01:23.371192+0000","last_peered":"2023-11-28T13:01:23.371192+0000","last_clean":"2023-11-28T13:01:23.371192+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:01:23.371192+0000","last_undegraded":"2023-11-28T13:01:23.371192+0000","last_fullsized":"2023-11-28T13:01:23.371192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.215746+0000","last_change":"2023-11-28T13:01:28.215746+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.215746+0000","last_undegraded":"2023-11-28T13:01:28.215746+0000","last_fullsized":"2023-11-28T13:01:28.215746+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:10.621678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.425397+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:01:23.425397+0000","last_peered":"2023-11-28T13:01:23.425397+0000","last_clean":"2023-11-28T13:01:23.425397+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:01:23.425397+0000","last_undegraded":"2023-11-28T13:01:23.425397+0000","last_fullsized":"2023-11-28T13:01:23.425397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.215720+0000","last_change":"2023-11-28T13:01:28.215720+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.215720+0000","last_undegraded":"2023-11-28T13:01:28.215720+0000","last_fullsized":"2023-11-28T13:01:28.215720+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:06.881393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.383349+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:01:23.383349+0000","last_peered":"2023-11-28T13:01:23.383349+0000","last_clean":"2023-11-28T13:01:23.383349+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:01:23.383349+0000","last_undegraded":"2023-11-28T13:01:23.383349+0000","last_fullsized":"2023-11-28T13:01:23.383349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.215058+0000","last_change":"2023-11-28T13:01:28.215058+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.215058+0000","last_undegraded":"2023-11-28T13:01:28.215058+0000","last_fullsized":"2023-11-28T13:01:28.215058+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:08.725526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.514873+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:01:23.514873+0000","last_peered":"2023-11-28T13:01:23.514873+0000","last_clean":"2023-11-28T13:01:23.514873+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:01:23.514873+0000","last_undegraded":"2023-11-28T13:01:23.514873+0000","last_fullsized":"2023-11-28T13:01:23.514873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.209135+0000","last_change":"2023-11-28T13:01:28.209135+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.209135+0000","last_undegraded":"2023-11-28T13:01:28.209135+0000","last_fullsized":"2023-11-28T13:01:28.209135+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:33.041552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.371232+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:01:23.371232+0000","last_peered":"2023-11-28T13:01:23.371232+0000","last_clean":"2023-11-28T13:01:23.371232+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:01:23.371232+0000","last_undegraded":"2023-11-28T13:01:23.371232+0000","last_fullsized":"2023-11-28T13:01:23.371232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.205078+0000","last_change":"2023-11-28T13:01:28.205078+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.205078+0000","last_undegraded":"2023-11-28T13:01:28.205078+0000","last_fullsized":"2023-11-28T13:01:28.205078+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:17.121645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.514718+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:01:23.514718+0000","last_peered":"2023-11-28T13:01:23.514718+0000","last_clean":"2023-11-28T13:01:23.514718+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:01:23.514718+0000","last_undegraded":"2023-11-28T13:01:23.514718+0000","last_fullsized":"2023-11-28T13:01:23.514718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:01:29.200289+0000","last_change":"2023-11-28T13:01:29.200289+0000","last_active":"2023-11-28T13:01:29.200289+0000","last_peered":"2023-11-28T13:01:29.200289+0000","last_clean":"2023-11-28T13:01:29.200289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:29.200289+0000","last_undegraded":"2023-11-28T13:01:29.200289+0000","last_fullsized":"2023-11-28T13:01:29.200289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-11-28T13:01:28.211945+0000","last_change":"2023-11-28T13:01:28.211945+0000","last_active":"2023-11-28T13:01:28.189044+0000","last_peered":"2023-11-28T13:01:28.189044+0000","last_clean":"2023-11-28T13:01:28.189044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:01:28.211945+0000","last_undegraded":"2023-11-28T13:01:28.211945+0000","last_fullsized":"2023-11-28T13:01:28.211945+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:08.725526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T13:01:23.516142+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:01:23.516142+0000","last_peered":"2023-11-28T13:01:23.516142+0000","last_clean":"2023-11-28T13:01:23.516142+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:01:23.516142+0000","last_undegraded":"2023-11-28T13:01:23.516142+0000","last_fullsized":"2023-11-28T13:01:23.516142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9424,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362416,"statfs":{"total":96636764160,"available":96627113984,"internally_reserved":0,"allocated":991232,"data_stored":750018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.56000000000000005}]},{"osd":1,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.80200000000000005}]},{"osd":2,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.008}]},{"osd":3,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.1080000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.84699999999999998}]},{"osd":5,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.88400000000000001}]},{"osd":6,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.044},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.0700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8268,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363572,"statfs":{"total":96636764160,"available":96628297728,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.79600000000000004}]},{"osd":1,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.69099999999999995}]},{"osd":2,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.73299999999999998}]},{"osd":3,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.94099999999999995}]},{"osd":4,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":10.566000000000001,"5min":10.566000000000001,"15min":10.566000000000001},"last":0.82599999999999996}]},{"osd":5,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.91500000000000004}]},{"osd":7,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":3.4980000000000002,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":3.593,"5min":3.593,"15min":3.593},"last":1.1499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8268,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363572,"statfs":{"total":96636764160,"available":96628297728,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.88900000000000001}]},{"osd":1,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.83299999999999996}]},{"osd":2,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0580000000000001}]},{"osd":3,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.79400000000000004}]},{"osd":4,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":1.111},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.0349999999999999}]},{"osd":6,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.448}]},{"osd":7,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.196}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8396,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363444,"statfs":{"total":96636764160,"available":96628166656,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.69199999999999995}]},{"osd":1,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.81000000000000005}]},{"osd":2,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.85599999999999998}]},{"osd":3,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.97799999999999998}]},{"osd":5,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.23},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.006}]},{"osd":6,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":1.1839999999999999}]},{"osd":7,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.046},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.1359999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8332,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363508,"statfs":{"total":96636764160,"available":96628232192,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.54800000000000004}]},{"osd":1,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.52700000000000002}]},{"osd":2,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.624},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.64100000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.57899999999999996}]},{"osd":5,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.751}]},{"osd":6,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.82499999999999996}]},{"osd":7,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.002}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8268,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363572,"statfs":{"total":96636764160,"available":96628297728,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.75900000000000001}]},{"osd":1,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.58999999999999997}]},{"osd":3,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.83799999999999997}]},{"osd":4,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.95399999999999996}]},{"osd":5,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.871},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.92300000000000004}]},{"osd":6,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":1.085}]},{"osd":7,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.024},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.0720000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8332,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363508,"statfs":{"total":96636764160,"available":96628232192,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.63400000000000001}]},{"osd":2,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.621},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.76400000000000001}]},{"osd":3,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.69899999999999995}]},{"osd":4,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":0.83899999999999997}]},{"osd":5,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.91600000000000004}]},{"osd":6,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.96099999999999997}]},{"osd":7,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.0109999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9424,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362416,"statfs":{"total":96636764160,"available":96627113984,"internally_reserved":0,"allocated":991232,"data_stored":750018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.53200000000000003}]},{"osd":2,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.81000000000000005}]},{"osd":3,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.78000000000000003}]},{"osd":4,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":1.044}]},{"osd":5,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.71799999999999997}]},{"osd":6,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.89700000000000002}]},{"osd":7,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.96599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:01:34.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-11-28T13:01:34.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-11-28T13:01:34.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-11-28T13:01:34.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-11-28T13:01:34.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-11-28T13:01:34.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-11-28T13:01:34.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-11-28T13:01:34.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-11-28T13:01:34.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-11-28T13:01:34.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-11-28T13:01:34.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-11-28T13:01:34.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-11-28T13:01:34.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-11-28T13:01:34.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-11-28T13:01:34.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-11-28T13:01:34.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-11-28T13:01:34.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-11-28T13:01:34.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-11-28T13:01:34.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-11-28T13:01:34.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-11-28T13:01:34.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-11-28T13:01:34.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-11-28T13:01:34.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-11-28T13:01:34.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-11-28T13:01:34.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-11-28T13:01:34.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-11-28T13:01:34.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-11-28T13:01:34.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-11-28T13:01:34.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-11-28T13:01:34.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-11-28T13:01:34.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-11-28T13:01:34.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-11-28T13:01:34.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-11-28T13:01:34.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-11-28T13:01:34.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.209096+0000', 'last_change': '2023-11-28T13:01:28.209096+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.209096+0000', 'last_undegraded': '2023-11-28T13:01:28.209096+0000', 'last_fullsized': '2023-11-28T13:01:28.209096+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T22:25:10.621678+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T13:01:34.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-11-28T13:01:34.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-11-28T13:01:34.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.216358+0000', 'last_change': '2023-11-28T13:01:28.216358+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.216358+0000', 'last_undegraded': '2023-11-28T13:01:28.216358+0000', 'last_fullsized': '2023-11-28T13:01:28.216358+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T13:32:12.505253+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T13:01:34.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-11-28T13:01:34.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-11-28T13:01:34.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.207862+0000', 'last_change': '2023-11-28T13:01:28.207862+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.207862+0000', 'last_undegraded': '2023-11-28T13:01:28.207862+0000', 'last_fullsized': '2023-11-28T13:01:28.207862+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:37:16.854220+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T13:01:34.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-11-28T13:01:34.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-11-28T13:01:34.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.206667+0000', 'last_change': '2023-11-28T13:01:28.206667+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.206667+0000', 'last_undegraded': '2023-11-28T13:01:28.206667+0000', 'last_fullsized': '2023-11-28T13:01:28.206667+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T15:15:15.549631+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T13:01:34.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-11-28T13:01:34.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-11-28T13:01:34.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.210511+0000', 'last_change': '2023-11-28T13:01:28.210511+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.210511+0000', 'last_undegraded': '2023-11-28T13:01:28.210511+0000', 'last_fullsized': '2023-11-28T13:01:28.210511+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T19:09:46.508882+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T13:01:34.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-11-28T13:01:34.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-11-28T13:01:34.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.205219+0000', 'last_change': '2023-11-28T13:01:28.205219+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.205219+0000', 'last_undegraded': '2023-11-28T13:01:28.205219+0000', 'last_fullsized': '2023-11-28T13:01:28.205219+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T14:21:47.130802+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T13:01:34.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-11-28T13:01:34.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-11-28T13:01:34.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.207317+0000', 'last_change': '2023-11-28T13:01:28.207317+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.207317+0000', 'last_undegraded': '2023-11-28T13:01:28.207317+0000', 'last_fullsized': '2023-11-28T13:01:28.207317+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T21:49:19.124556+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T13:01:34.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-11-28T13:01:34.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-11-28T13:01:34.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.204505+0000', 'last_change': '2023-11-28T13:01:28.204505+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.204505+0000', 'last_undegraded': '2023-11-28T13:01:28.204505+0000', 'last_fullsized': '2023-11-28T13:01:28.204505+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T22:54:55.167964+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T13:01:34.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-11-28T13:01:34.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-11-28T13:01:34.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.212634+0000', 'last_change': '2023-11-28T13:01:28.212634+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.212634+0000', 'last_undegraded': '2023-11-28T13:01:28.212634+0000', 'last_fullsized': '2023-11-28T13:01:28.212634+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T13:32:12.505253+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T13:01:34.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-11-28T13:01:34.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-11-28T13:01:34.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.210023+0000', 'last_change': '2023-11-28T13:01:28.210023+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.210023+0000', 'last_undegraded': '2023-11-28T13:01:28.210023+0000', 'last_fullsized': '2023-11-28T13:01:28.210023+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:10:35.486834+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T13:01:34.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-11-28T13:01:34.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-11-28T13:01:34.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.210087+0000', 'last_change': '2023-11-28T13:01:28.210087+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.210087+0000', 'last_undegraded': '2023-11-28T13:01:28.210087+0000', 'last_fullsized': '2023-11-28T13:01:28.210087+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:11:06.881393+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T13:01:34.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-11-28T13:01:34.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-11-28T13:01:34.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.212051+0000', 'last_change': '2023-11-28T13:01:28.212051+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.212051+0000', 'last_undegraded': '2023-11-28T13:01:28.212051+0000', 'last_fullsized': '2023-11-28T13:01:28.212051+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:10:35.486834+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T13:01:34.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-11-28T13:01:34.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-11-28T13:01:34.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.212157+0000', 'last_change': '2023-11-28T13:01:28.212157+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.212157+0000', 'last_undegraded': '2023-11-28T13:01:28.212157+0000', 'last_fullsized': '2023-11-28T13:01:28.212157+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:11:06.881393+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T13:01:34.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-11-28T13:01:34.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-11-28T13:01:34.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.207555+0000', 'last_change': '2023-11-28T13:01:28.207555+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.207555+0000', 'last_undegraded': '2023-11-28T13:01:28.207555+0000', 'last_fullsized': '2023-11-28T13:01:28.207555+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:10:34.884855+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T13:01:34.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-11-28T13:01:34.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-11-28T13:01:34.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.208225+0000', 'last_change': '2023-11-28T13:01:28.208225+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.208225+0000', 'last_undegraded': '2023-11-28T13:01:28.208225+0000', 'last_fullsized': '2023-11-28T13:01:28.208225+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:15:31.600456+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T13:01:34.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-11-28T13:01:34.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-11-28T13:01:34.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.204831+0000', 'last_change': '2023-11-28T13:01:28.204831+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.204831+0000', 'last_undegraded': '2023-11-28T13:01:28.204831+0000', 'last_fullsized': '2023-11-28T13:01:28.204831+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:37:16.854220+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T13:01:34.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-11-28T13:01:34.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-11-28T13:01:34.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.211191+0000', 'last_change': '2023-11-28T13:01:28.211191+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.211191+0000', 'last_undegraded': '2023-11-28T13:01:28.211191+0000', 'last_fullsized': '2023-11-28T13:01:28.211191+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T19:42:08.725526+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T13:01:34.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-11-28T13:01:34.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-11-28T13:01:34.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.207008+0000', 'last_change': '2023-11-28T13:01:28.207008+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.207008+0000', 'last_undegraded': '2023-11-28T13:01:28.207008+0000', 'last_fullsized': '2023-11-28T13:01:28.207008+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:22:36.945966+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T13:01:34.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-11-28T13:01:34.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-11-28T13:01:34.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.215029+0000', 'last_change': '2023-11-28T13:01:28.215029+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.215029+0000', 'last_undegraded': '2023-11-28T13:01:28.215029+0000', 'last_fullsized': '2023-11-28T13:01:28.215029+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:13:50.711987+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T13:01:34.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-11-28T13:01:34.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-11-28T13:01:34.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.206715+0000', 'last_change': '2023-11-28T13:01:28.206715+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.206715+0000', 'last_undegraded': '2023-11-28T13:01:28.206715+0000', 'last_fullsized': '2023-11-28T13:01:28.206715+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T14:21:47.130802+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T13:01:34.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-11-28T13:01:34.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-11-28T13:01:34.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.216172+0000', 'last_change': '2023-11-28T13:01:28.216172+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.216172+0000', 'last_undegraded': '2023-11-28T13:01:28.216172+0000', 'last_fullsized': '2023-11-28T13:01:28.216172+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T14:29:33.041552+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T13:01:34.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-11-28T13:01:34.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-11-28T13:01:34.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.214997+0000', 'last_change': '2023-11-28T13:01:28.214997+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.214997+0000', 'last_undegraded': '2023-11-28T13:01:28.214997+0000', 'last_fullsized': '2023-11-28T13:01:28.214997+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:15:31.600456+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T13:01:34.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-11-28T13:01:34.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-11-28T13:01:34.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.205267+0000', 'last_change': '2023-11-28T13:01:28.205267+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.205267+0000', 'last_undegraded': '2023-11-28T13:01:28.205267+0000', 'last_fullsized': '2023-11-28T13:01:28.205267+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T21:49:19.124556+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T13:01:34.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-11-28T13:01:34.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-11-28T13:01:34.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.214886+0000', 'last_change': '2023-11-28T13:01:28.214886+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.214886+0000', 'last_undegraded': '2023-11-28T13:01:28.214886+0000', 'last_fullsized': '2023-11-28T13:01:28.214886+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T20:06:16.368208+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T13:01:34.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-11-28T13:01:34.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-11-28T13:01:34.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.205762+0000', 'last_change': '2023-11-28T13:01:28.205762+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.205762+0000', 'last_undegraded': '2023-11-28T13:01:28.205762+0000', 'last_fullsized': '2023-11-28T13:01:28.205762+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:10:34.884855+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T13:01:34.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-11-28T13:01:34.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-11-28T13:01:34.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.210522+0000', 'last_change': '2023-11-28T13:01:28.210522+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.210522+0000', 'last_undegraded': '2023-11-28T13:01:28.210522+0000', 'last_fullsized': '2023-11-28T13:01:28.210522+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T13:32:12.505253+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T13:01:34.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-11-28T13:01:34.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-11-28T13:01:34.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.215746+0000', 'last_change': '2023-11-28T13:01:28.215746+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.215746+0000', 'last_undegraded': '2023-11-28T13:01:28.215746+0000', 'last_fullsized': '2023-11-28T13:01:28.215746+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T22:25:10.621678+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T13:01:34.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-11-28T13:01:34.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-11-28T13:01:34.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.215720+0000', 'last_change': '2023-11-28T13:01:28.215720+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.215720+0000', 'last_undegraded': '2023-11-28T13:01:28.215720+0000', 'last_fullsized': '2023-11-28T13:01:28.215720+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:11:06.881393+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T13:01:34.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-11-28T13:01:34.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-11-28T13:01:34.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.215058+0000', 'last_change': '2023-11-28T13:01:28.215058+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.215058+0000', 'last_undegraded': '2023-11-28T13:01:28.215058+0000', 'last_fullsized': '2023-11-28T13:01:28.215058+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T19:42:08.725526+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T13:01:34.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-11-28T13:01:34.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-11-28T13:01:34.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.209135+0000', 'last_change': '2023-11-28T13:01:28.209135+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.209135+0000', 'last_undegraded': '2023-11-28T13:01:28.209135+0000', 'last_fullsized': '2023-11-28T13:01:28.209135+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T14:29:33.041552+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T13:01:34.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-11-28T13:01:34.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-11-28T13:01:34.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.205078+0000', 'last_change': '2023-11-28T13:01:28.205078+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.205078+0000', 'last_undegraded': '2023-11-28T13:01:28.205078+0000', 'last_fullsized': '2023-11-28T13:01:28.205078+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T21:22:17.121645+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T13:01:34.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-11-28T13:01:34.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:01:29.200289+0000', 'last_change': '2023-11-28T13:01:29.200289+0000', 'last_active': '2023-11-28T13:01:29.200289+0000', 'last_peered': '2023-11-28T13:01:29.200289+0000', 'last_clean': '2023-11-28T13:01:29.200289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:29.200289+0000', 'last_undegraded': '2023-11-28T13:01:29.200289+0000', 'last_fullsized': '2023-11-28T13:01:29.200289+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:29.200289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:01:34.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-11-28T13:01:34.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:01:28.211945+0000', 'last_change': '2023-11-28T13:01:28.211945+0000', 'last_active': '2023-11-28T13:01:28.189044+0000', 'last_peered': '2023-11-28T13:01:28.189044+0000', 'last_clean': '2023-11-28T13:01:28.189044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:01:28.211945+0000', 'last_undegraded': '2023-11-28T13:01:28.211945+0000', 'last_fullsized': '2023-11-28T13:01:28.211945+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'last_clean_scrub_stamp': '2023-11-28T13:01:28.189044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T19:42:08.725526+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T13:01:34.550 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T13:01:34.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.658+0000 7eff42c74700 1 Processor -- start 2023-11-28T13:01:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.658+0000 7eff42c74700 1 -- start start 2023-11-28T13:01:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff42c74700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7eff3c0b3910 0x7eff3c06b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff42c74700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7eff3c070070 0x7eff3c070470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff42c74700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3c06c480 con 0x7eff3c06c910 2023-11-28T13:01:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff42c74700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c0709b0 con 0x7eff3c0b3910 2023-11-28T13:01:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff42c74700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c06dbe0 con 0x7eff3c070070 2023-11-28T13:01:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff41471700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7eff3c06c910 0x7eff3c06d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52300/0 (socket says 172.21.15.82:52300) 2023-11-28T13:01:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff41471700 1 -- 172.21.15.82:0/3732286749 learned_addr learned my addr 172.21.15.82:0/3732286749 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:34.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff41c72700 1 --2- 172.21.15.82:0/3732286749 >> v2:172.21.15.82:3300/0 conn(0x7eff3c0b3910 0x7eff3c06b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:34.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff42473700 1 --2- 172.21.15.82:0/3732286749 >> v2:172.21.15.114:3300/0 conn(0x7eff3c070070 0x7eff3c070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:34.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff40c70700 1 -- 172.21.15.82:0/3732286749 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3926236943 0 0) 0x7eff3c06c480 con 0x7eff3c06c910 2023-11-28T13:01:34.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff40c70700 1 -- 172.21.15.82:0/3732286749 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff240035d0 con 0x7eff3c06c910 2023-11-28T13:01:34.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff40c70700 1 -- 172.21.15.82:0/3732286749 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2408010270 0 0) 0x7eff240035d0 con 0x7eff3c06c910 2023-11-28T13:01:34.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff40c70700 1 -- 172.21.15.82:0/3732286749 >> v2:172.21.15.114:3300/0 conn(0x7eff3c070070 msgr2=0x7eff3c070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:34.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff40c70700 1 --2- 172.21.15.82:0/3732286749 >> v2:172.21.15.114:3300/0 conn(0x7eff3c070070 0x7eff3c070470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff40c70700 1 -- 172.21.15.82:0/3732286749 >> v2:172.21.15.82:3300/0 conn(0x7eff3c0b3910 msgr2=0x7eff3c06b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff40c70700 1 --2- 172.21.15.82:0/3732286749 >> v2:172.21.15.82:3300/0 conn(0x7eff3c0b3910 0x7eff3c06b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff40c70700 1 -- 172.21.15.82:0/3732286749 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c06dec0 con 0x7eff3c06c910 2023-11-28T13:01:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff40c70700 1 -- 172.21.15.82:0/3732286749 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7eff2c0019f0 con 0x7eff3c06c910 2023-11-28T13:01:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff40c70700 1 -- 172.21.15.82:0/3732286749 >> v1:172.21.15.82:6789/0 conn(0x7eff3c06c910 legacy=0x7eff3c06d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff40c70700 1 --2- 172.21.15.82:0/3732286749 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff24003a20 0x7eff24003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff40c70700 1 --2- 172.21.15.82:0/3732286749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff24004870 0x7eff24004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff40c70700 1 --2- 172.21.15.82:0/3732286749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff24005220 0x7eff2400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:34.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff40c70700 1 -- 172.21.15.82:0/3732286749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c0709b0 con 0x7eff24005220 2023-11-28T13:01:34.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff40c70700 1 -- 172.21.15.82:0/3732286749 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c06dbe0 con 0x7eff24004870 2023-11-28T13:01:34.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff40c70700 1 -- 172.21.15.82:0/3732286749 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2400bfa0 con 0x7eff24003a20 2023-11-28T13:01:34.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff41c72700 1 --2- 172.21.15.82:0/3732286749 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff24003a20 0x7eff24003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:34.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff41471700 1 --2- 172.21.15.82:0/3732286749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff24004870 0x7eff24004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:34.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff42473700 1 --2- 172.21.15.82:0/3732286749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff24005220 0x7eff2400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:34.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff41471700 1 -- 172.21.15.82:0/3732286749 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff24003a20 msgr2=0x7eff24003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:34.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff41471700 1 --2- 172.21.15.82:0/3732286749 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff24003a20 0x7eff24003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff41471700 1 -- 172.21.15.82:0/3732286749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff24005220 msgr2=0x7eff2400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:34.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff41471700 1 --2- 172.21.15.82:0/3732286749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff24005220 0x7eff2400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff41471700 1 -- 172.21.15.82:0/3732286749 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff240035d0 con 0x7eff24004870 2023-11-28T13:01:34.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff42473700 1 --2- 172.21.15.82:0/3732286749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff24005220 0x7eff2400ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff42473700 1 -- 172.21.15.82:0/3732286749 reap_dead start 2023-11-28T13:01:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff41471700 1 --2- 172.21.15.82:0/3732286749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff24004870 0x7eff24004ce0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00a830 tx=0x7eff240058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fa6a0a66a6212ef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:34.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff40c70700 1 -- 172.21.15.82:0/3732286749 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c0072d0 con 0x7eff24004870 2023-11-28T13:01:34.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff40c70700 1 -- 172.21.15.82:0/3732286749 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c007450 con 0x7eff24004870 2023-11-28T13:01:34.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff40c70700 1 -- 172.21.15.82:0/3732286749 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c007800 con 0x7eff24004870 2023-11-28T13:01:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff42c74700 1 -- 172.21.15.82:0/3732286749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff24004870 msgr2=0x7eff24004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff42c74700 1 --2- 172.21.15.82:0/3732286749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff24004870 0x7eff24004ce0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00a830 tx=0x7eff240058a0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff42c74700 1 -- 172.21.15.82:0/3732286749 shutdown_connections 2023-11-28T13:01:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff42c74700 1 --2- 172.21.15.82:0/3732286749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff24004870 0x7eff24004ce0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff42c74700 1 -- 172.21.15.82:0/3732286749 >> 172.21.15.82:0/3732286749 conn(0x7eff3c0ce600 msgr2=0x7eff3c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff42c74700 1 -- 172.21.15.82:0/3732286749 shutdown_connections 2023-11-28T13:01:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.662+0000 7eff42c74700 1 -- 172.21.15.82:0/3732286749 wait complete. 2023-11-28T13:01:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff42c74700 1 Processor -- start 2023-11-28T13:01:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff42c74700 1 -- start start 2023-11-28T13:01:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff42c74700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff24004870 0x7eff3c0c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff42c74700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff3c154460 0x7eff3c0b0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff42c74700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff3c0afe10 0x7eff3c0c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff42c74700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c1548d0 con 0x7eff3c0afe10 2023-11-28T13:01:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff42c74700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c0b0f70 con 0x7eff24004870 2023-11-28T13:01:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff42c74700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c0c4e00 con 0x7eff3c154460 2023-11-28T13:01:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff42473700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff3c0afe10 0x7eff3c0c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff42473700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff3c0afe10 0x7eff3c0c7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47616/0 (socket says 172.21.15.82:47616) 2023-11-28T13:01:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff42473700 1 -- 172.21.15.82:0/3081927324 learned_addr learned my addr 172.21.15.82:0/3081927324 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff41c72700 1 --2- 172.21.15.82:0/3081927324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff24004870 0x7eff3c0c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff41471700 1 --2- 172.21.15.82:0/3081927324 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff3c154460 0x7eff3c0b0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff42473700 1 -- 172.21.15.82:0/3081927324 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff3c154460 msgr2=0x7eff3c0b0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff42473700 1 --2- 172.21.15.82:0/3081927324 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff3c154460 0x7eff3c0b0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff42473700 1 -- 172.21.15.82:0/3081927324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff24004870 msgr2=0x7eff3c0c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff42473700 1 --2- 172.21.15.82:0/3081927324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff24004870 0x7eff3c0c4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff42473700 1 -- 172.21.15.82:0/3081927324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c0c8f80 con 0x7eff3c0afe10 2023-11-28T13:01:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff42473700 1 --2- 172.21.15.82:0/3081927324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff3c0afe10 0x7eff3c0c7620 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7eff3c06e580 tx=0x7eff34011eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff3a7fc700 1 -- 172.21.15.82:0/3081927324 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3401b070 con 0x7eff3c0afe10 2023-11-28T13:01:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff3a7fc700 1 -- 172.21.15.82:0/3081927324 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff34004020 con 0x7eff3c0afe10 2023-11-28T13:01:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff42c74700 1 -- 172.21.15.82:0/3081927324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3c06c110 con 0x7eff3c0afe10 2023-11-28T13:01:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff3a7fc700 1 -- 172.21.15.82:0/3081927324 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff34009ea0 con 0x7eff3c0afe10 2023-11-28T13:01:34.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.666+0000 7eff42c74700 1 -- 172.21.15.82:0/3081927324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3c0b3ce0 con 0x7eff3c0afe10 2023-11-28T13:01:34.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.670+0000 7eff42c74700 1 -- 172.21.15.82:0/3081927324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3c065fc0 con 0x7eff3c0afe10 2023-11-28T13:01:34.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.670+0000 7eff3a7fc700 1 -- 172.21.15.82:0/3081927324 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7eff340041d0 con 0x7eff3c0afe10 2023-11-28T13:01:34.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.670+0000 7eff3a7fc700 1 --2- 172.21.15.82:0/3081927324 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7eff28064f10 0x7eff280673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:34.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.670+0000 7eff41c72700 1 --2- 172.21.15.82:0/3081927324 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7eff28064f10 0x7eff280673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:34.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.670+0000 7eff3a7fc700 1 -- 172.21.15.82:0/3081927324 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff340819a0 con 0x7eff3c0afe10 2023-11-28T13:01:34.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.670+0000 7eff41c72700 1 --2- 172.21.15.82:0/3081927324 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7eff28064f10 0x7eff280673c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7eff30009c70 tx=0x7eff30009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:34.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.674+0000 7eff3a7fc700 1 -- 172.21.15.82:0/3081927324 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7eff3404fa50 con 0x7eff3c0afe10 2023-11-28T13:01:34.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.894+0000 7eff42c74700 1 -- 172.21.15.82:0/3081927324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7eff3c0711d0 con 0x7eff3c0afe10 2023-11-28T13:01:34.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.894+0000 7eff3a7fc700 1 -- 172.21.15.82:0/3081927324 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1268 (secure 0 0 0) 0x7eff34053070 con 0x7eff3c0afe10 2023-11-28T13:01:34.899 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:34.900 INFO:teuthology.orchestra.run.smithi082.stdout:{"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":93,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":38,"num_osds":8,"num_up_osds":8,"osd_up_since":1701176413,"num_in_osds":8,"osd_in_since":1701176404,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":70361088,"bytes_avail":773023752192,"bytes_total":773094113280,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":14,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5277}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-11-28T13:01:23.176112+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-28T13:01:34.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.894+0000 7eff42c74700 1 -- 172.21.15.82:0/3081927324 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7eff28064f10 msgr2=0x7eff280673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:34.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.894+0000 7eff42c74700 1 --2- 172.21.15.82:0/3081927324 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7eff28064f10 0x7eff280673c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7eff30009c70 tx=0x7eff30009240 comp rx=0 tx=0).stop 2023-11-28T13:01:34.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.894+0000 7eff42c74700 1 -- 172.21.15.82:0/3081927324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff3c0afe10 msgr2=0x7eff3c0c7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:34.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.894+0000 7eff42c74700 1 --2- 172.21.15.82:0/3081927324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff3c0afe10 0x7eff3c0c7620 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7eff3c06e580 tx=0x7eff34011eb0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.894+0000 7eff42c74700 1 -- 172.21.15.82:0/3081927324 shutdown_connections 2023-11-28T13:01:34.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.894+0000 7eff42c74700 1 --2- 172.21.15.82:0/3081927324 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7eff28064f10 0x7eff280673c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.894+0000 7eff42c74700 1 --2- 172.21.15.82:0/3081927324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff3c0afe10 0x7eff3c0c7620 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.894+0000 7eff42c74700 1 --2- 172.21.15.82:0/3081927324 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff3c154460 0x7eff3c0b0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.894+0000 7eff42c74700 1 --2- 172.21.15.82:0/3081927324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff24004870 0x7eff3c0c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:34.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.894+0000 7eff42c74700 1 -- 172.21.15.82:0/3081927324 >> 172.21.15.82:0/3081927324 conn(0x7eff3c0ce600 msgr2=0x7eff3c0ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:34.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.898+0000 7eff42c74700 1 -- 172.21.15.82:0/3081927324 shutdown_connections 2023-11-28T13:01:34.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:34.898+0000 7eff42c74700 1 -- 172.21.15.82:0/3081927324 wait complete. 2023-11-28T13:01:34.914 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T13:01:34.915 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:01:35.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f070c8ac700 1 Processor -- start 2023-11-28T13:01:35.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f070c8ac700 1 -- start start 2023-11-28T13:01:35.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f070c8ac700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f07080b3910 0x7f070806b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:35.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f070c8ac700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f070806c910 0x7f070806d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:35.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f070c8ac700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0708070070 0x7f07080704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:35.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f070c8ac700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f070806c480 con 0x7f070806c910 2023-11-28T13:01:35.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f070c8ac700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07080709f0 con 0x7f07080b3910 2023-11-28T13:01:35.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f070c8ac700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070806dbe0 con 0x7f0708070070 2023-11-28T13:01:35.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f070659c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f070806c910 0x7f070806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:35.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f070659c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f070806c910 0x7f070806d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47632/0 (socket says 172.21.15.82:47632) 2023-11-28T13:01:35.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f070659c700 1 -- 172.21.15.82:0/1654721711 learned_addr learned my addr 172.21.15.82:0/1654721711 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:35.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f070759e700 1 --2- 172.21.15.82:0/1654721711 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0708070070 0x7f07080704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:35.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f0706d9d700 1 --2- 172.21.15.82:0/1654721711 >> v2:172.21.15.114:3300/0 conn(0x7f07080b3910 0x7f070806b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:35.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f070659c700 1 -- 172.21.15.82:0/1654721711 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0708070070 msgr2=0x7f07080704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:35.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f070659c700 1 --2- 172.21.15.82:0/1654721711 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0708070070 0x7f07080704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:35.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f070659c700 1 -- 172.21.15.82:0/1654721711 >> v2:172.21.15.114:3300/0 conn(0x7f07080b3910 msgr2=0x7f070806b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:35.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f070659c700 1 --2- 172.21.15.82:0/1654721711 >> v2:172.21.15.114:3300/0 conn(0x7f07080b3910 0x7f070806b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:35.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f070659c700 1 -- 172.21.15.82:0/1654721711 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070806dec0 con 0x7f070806c910 2023-11-28T13:01:35.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f070659c700 1 --2- 172.21.15.82:0/1654721711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f070806c910 0x7f070806d320 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f07080cf630 tx=0x7f070000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456f2908f422c56c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:35.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f0705d9b700 1 -- 172.21.15.82:0/1654721711 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070000e070 con 0x7f070806c910 2023-11-28T13:01:35.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f0705d9b700 1 -- 172.21.15.82:0/1654721711 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070000b9c0 con 0x7f070806c910 2023-11-28T13:01:35.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.022+0000 7f0705d9b700 1 -- 172.21.15.82:0/1654721711 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070000bd70 con 0x7f070806c910 2023-11-28T13:01:35.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.026+0000 7f070c8ac700 1 -- 172.21.15.82:0/1654721711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f070806c910 msgr2=0x7f070806d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:35.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.026+0000 7f070c8ac700 1 --2- 172.21.15.82:0/1654721711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f070806c910 0x7f070806d320 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f07080cf630 tx=0x7f070000b330 comp rx=0 tx=0).stop 2023-11-28T13:01:35.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.026+0000 7f070c8ac700 1 -- 172.21.15.82:0/1654721711 shutdown_connections 2023-11-28T13:01:35.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.026+0000 7f070c8ac700 1 --2- 172.21.15.82:0/1654721711 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0708070070 0x7f07080704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:35.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.026+0000 7f070c8ac700 1 --2- 172.21.15.82:0/1654721711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f070806c910 0x7f070806d320 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:35.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.026+0000 7f070c8ac700 1 --2- 172.21.15.82:0/1654721711 >> v2:172.21.15.114:3300/0 conn(0x7f07080b3910 0x7f070806b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:35.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.026+0000 7f070c8ac700 1 -- 172.21.15.82:0/1654721711 >> 172.21.15.82:0/1654721711 conn(0x7f07080ce600 msgr2=0x7f07080ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:35.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.026+0000 7f070c8ac700 1 -- 172.21.15.82:0/1654721711 shutdown_connections 2023-11-28T13:01:35.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.026+0000 7f070c8ac700 1 -- 172.21.15.82:0/1654721711 wait complete. 2023-11-28T13:01:35.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f070c8ac700 1 Processor -- start 2023-11-28T13:01:35.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f070c8ac700 1 -- start start 2023-11-28T13:01:35.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f070c8ac700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f070806c910 0x7f07080ad390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:35.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f070c8ac700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0708070070 0x7f0708154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:35.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f070c8ac700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f07080b3910 0x7f07080c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:35.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f070c8ac700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07080afab0 con 0x7f0708070070 2023-11-28T13:01:35.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f070c8ac700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07080aece0 con 0x7f070806c910 2023-11-28T13:01:35.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f070c8ac700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07080ae060 con 0x7f07080b3910 2023-11-28T13:01:35.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f070659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0708070070 0x7f0708154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:35.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f070659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0708070070 0x7f0708154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47642/0 (socket says 172.21.15.82:47642) 2023-11-28T13:01:35.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f070659c700 1 -- 172.21.15.82:0/2205934798 learned_addr learned my addr 172.21.15.82:0/2205934798 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:35.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f070759e700 1 --2- 172.21.15.82:0/2205934798 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f07080b3910 0x7f07080c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:35.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f0706d9d700 1 --2- 172.21.15.82:0/2205934798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f070806c910 0x7f07080ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:35.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f070659c700 1 -- 172.21.15.82:0/2205934798 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f07080b3910 msgr2=0x7f07080c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:35.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f070659c700 1 --2- 172.21.15.82:0/2205934798 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f07080b3910 0x7f07080c4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:35.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f070659c700 1 -- 172.21.15.82:0/2205934798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f070806c910 msgr2=0x7f07080ad390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:35.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f070659c700 1 --2- 172.21.15.82:0/2205934798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f070806c910 0x7f07080ad390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:35.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f070659c700 1 -- 172.21.15.82:0/2205934798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0700009b30 con 0x7f0708070070 2023-11-28T13:01:35.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f0706d9d700 1 --2- 172.21.15.82:0/2205934798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f070806c910 0x7f07080ad390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:35.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f070659c700 1 --2- 172.21.15.82:0/2205934798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0708070070 0x7f0708154db0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f070000b370 tx=0x7f0700004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:35.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f06ff7fe700 1 -- 172.21.15.82:0/2205934798 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0700004250 con 0x7f0708070070 2023-11-28T13:01:35.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f06ff7fe700 1 -- 172.21.15.82:0/2205934798 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07000043b0 con 0x7f0708070070 2023-11-28T13:01:35.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f070c8ac700 1 -- 172.21.15.82:0/2205934798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07080c8f80 con 0x7f0708070070 2023-11-28T13:01:35.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f06ff7fe700 1 -- 172.21.15.82:0/2205934798 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0700004760 con 0x7f0708070070 2023-11-28T13:01:35.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.030+0000 7f070c8ac700 1 -- 172.21.15.82:0/2205934798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f070806c110 con 0x7f0708070070 2023-11-28T13:01:35.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.034+0000 7f070c8ac700 1 -- 172.21.15.82:0/2205934798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f070806d860 con 0x7f0708070070 2023-11-28T13:01:35.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.034+0000 7f06ff7fe700 1 -- 172.21.15.82:0/2205934798 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f070001c440 con 0x7f0708070070 2023-11-28T13:01:35.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.034+0000 7f06ff7fe700 1 --2- 172.21.15.82:0/2205934798 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f06e8064ee0 0x7f06e8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:35.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.034+0000 7f0706d9d700 1 --2- 172.21.15.82:0/2205934798 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f06e8064ee0 0x7f06e8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:35.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.034+0000 7f06ff7fe700 1 -- 172.21.15.82:0/2205934798 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0700083590 con 0x7f0708070070 2023-11-28T13:01:35.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.034+0000 7f0706d9d700 1 --2- 172.21.15.82:0/2205934798 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f06e8064ee0 0x7f06e8067390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f070815a1a0 tx=0x7f06f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:35.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.038+0000 7f06ff7fe700 1 -- 172.21.15.82:0/2205934798 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f07000516d0 con 0x7f0708070070 2023-11-28T13:01:35.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.194+0000 7f070c8ac700 1 -- 172.21.15.82:0/2205934798 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07080aee20 con 0x7f06e8064ee0 2023-11-28T13:01:35.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.210+0000 7f06ff7fe700 1 -- 172.21.15.82:0/2205934798 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309768 (secure 0 0 0) 0x7f07080aee20 con 0x7f06e8064ee0 2023-11-28T13:01:35.221 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:35.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.218+0000 7f070c8ac700 1 -- 172.21.15.82:0/2205934798 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f06e8064ee0 msgr2=0x7f06e8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:35.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.218+0000 7f070c8ac700 1 --2- 172.21.15.82:0/2205934798 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f06e8064ee0 0x7f06e8067390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f070815a1a0 tx=0x7f06f0008040 comp rx=0 tx=0).stop 2023-11-28T13:01:35.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.218+0000 7f070c8ac700 1 -- 172.21.15.82:0/2205934798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0708070070 msgr2=0x7f0708154db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:35.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.218+0000 7f070c8ac700 1 --2- 172.21.15.82:0/2205934798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0708070070 0x7f0708154db0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f070000b370 tx=0x7f0700004af0 comp rx=0 tx=0).stop 2023-11-28T13:01:35.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.218+0000 7f070c8ac700 1 -- 172.21.15.82:0/2205934798 shutdown_connections 2023-11-28T13:01:35.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.218+0000 7f070c8ac700 1 --2- 172.21.15.82:0/2205934798 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f06e8064ee0 0x7f06e8067390 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:35.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.218+0000 7f070c8ac700 1 --2- 172.21.15.82:0/2205934798 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f07080b3910 0x7f07080c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:35.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.218+0000 7f070c8ac700 1 --2- 172.21.15.82:0/2205934798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0708070070 0x7f0708154db0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:35.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.218+0000 7f070c8ac700 1 --2- 172.21.15.82:0/2205934798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f070806c910 0x7f07080ad390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:35.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.218+0000 7f070c8ac700 1 -- 172.21.15.82:0/2205934798 >> 172.21.15.82:0/2205934798 conn(0x7f07080ce600 msgr2=0x7f07080abf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:35.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.218+0000 7f070c8ac700 1 -- 172.21.15.82:0/2205934798 shutdown_connections 2023-11-28T13:01:35.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:35.218+0000 7f070c8ac700 1 -- 172.21.15.82:0/2205934798 wait complete. 2023-11-28T13:01:35.225 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:01:35.236 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-11-28T13:01:35.179237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":70280,"kb_used_data":4616,"kb_used_omap":0,"kb_used_meta":65600,"kb_avail":754904440,"statfs":{"total":773094113280,"available":773022146560,"internally_reserved":0,"allocated":4726784,"data_stored":2625868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":67174400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001686"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.019488+0000","last_change":"2023-11-28T13:01:29.612573+0000","last_active":"2023-11-28T13:01:31.019488+0000","last_peered":"2023-11-28T13:01:31.019488+0000","last_clean":"2023-11-28T13:01:31.019488+0000","last_became_active":"2023-11-28T13:01:29.612318+0000","last_became_peered":"2023-11-28T13:01:29.612318+0000","last_unstale":"2023-11-28T13:01:31.019488+0000","last_undegraded":"2023-11-28T13:01:31.019488+0000","last_fullsized":"2023-11-28T13:01:31.019488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:26.374397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.019141+0000","last_change":"2023-11-28T13:01:29.617086+0000","last_active":"2023-11-28T13:01:31.019141+0000","last_peered":"2023-11-28T13:01:31.019141+0000","last_clean":"2023-11-28T13:01:31.019141+0000","last_became_active":"2023-11-28T13:01:29.616817+0000","last_became_peered":"2023-11-28T13:01:29.616817+0000","last_unstale":"2023-11-28T13:01:31.019141+0000","last_undegraded":"2023-11-28T13:01:31.019141+0000","last_fullsized":"2023-11-28T13:01:31.019141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:55:59.390386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.020608+0000","last_change":"2023-11-28T13:01:29.624649+0000","last_active":"2023-11-28T13:01:31.020608+0000","last_peered":"2023-11-28T13:01:31.020608+0000","last_clean":"2023-11-28T13:01:31.020608+0000","last_became_active":"2023-11-28T13:01:29.624347+0000","last_became_peered":"2023-11-28T13:01:29.624347+0000","last_unstale":"2023-11-28T13:01:31.020608+0000","last_undegraded":"2023-11-28T13:01:31.020608+0000","last_fullsized":"2023-11-28T13:01:31.020608+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:31.598116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.595991+0000","last_change":"2023-11-28T13:01:29.632299+0000","last_active":"2023-11-28T13:01:30.595991+0000","last_peered":"2023-11-28T13:01:30.595991+0000","last_clean":"2023-11-28T13:01:30.595991+0000","last_became_active":"2023-11-28T13:01:29.631942+0000","last_became_peered":"2023-11-28T13:01:29.631942+0000","last_unstale":"2023-11-28T13:01:30.595991+0000","last_undegraded":"2023-11-28T13:01:30.595991+0000","last_fullsized":"2023-11-28T13:01:30.595991+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:17.865464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.596045+0000","last_change":"2023-11-28T13:01:29.629415+0000","last_active":"2023-11-28T13:01:30.596045+0000","last_peered":"2023-11-28T13:01:30.596045+0000","last_clean":"2023-11-28T13:01:30.596045+0000","last_became_active":"2023-11-28T13:01:29.629116+0000","last_became_peered":"2023-11-28T13:01:29.629116+0000","last_unstale":"2023-11-28T13:01:30.596045+0000","last_undegraded":"2023-11-28T13:01:30.596045+0000","last_fullsized":"2023-11-28T13:01:30.596045+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:01.100881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.018277+0000","last_change":"2023-11-28T13:01:29.607265+0000","last_active":"2023-11-28T13:01:31.018277+0000","last_peered":"2023-11-28T13:01:31.018277+0000","last_clean":"2023-11-28T13:01:31.018277+0000","last_became_active":"2023-11-28T13:01:29.607007+0000","last_became_peered":"2023-11-28T13:01:29.607007+0000","last_unstale":"2023-11-28T13:01:31.018277+0000","last_undegraded":"2023-11-28T13:01:31.018277+0000","last_fullsized":"2023-11-28T13:01:31.018277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:50:48.744668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.598077+0000","last_change":"2023-11-28T13:01:29.622341+0000","last_active":"2023-11-28T13:01:30.598077+0000","last_peered":"2023-11-28T13:01:30.598077+0000","last_clean":"2023-11-28T13:01:30.598077+0000","last_became_active":"2023-11-28T13:01:29.621924+0000","last_became_peered":"2023-11-28T13:01:29.621924+0000","last_unstale":"2023-11-28T13:01:30.598077+0000","last_undegraded":"2023-11-28T13:01:30.598077+0000","last_fullsized":"2023-11-28T13:01:30.598077+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:43:59.891152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.019729+0000","last_change":"2023-11-28T13:01:29.621805+0000","last_active":"2023-11-28T13:01:31.019729+0000","last_peered":"2023-11-28T13:01:31.019729+0000","last_clean":"2023-11-28T13:01:31.019729+0000","last_became_active":"2023-11-28T13:01:29.621535+0000","last_became_peered":"2023-11-28T13:01:29.621535+0000","last_unstale":"2023-11-28T13:01:31.019729+0000","last_undegraded":"2023-11-28T13:01:31.019729+0000","last_fullsized":"2023-11-28T13:01:31.019729+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:50.377067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.020818+0000","last_change":"2023-11-28T13:01:29.621682+0000","last_active":"2023-11-28T13:01:31.020818+0000","last_peered":"2023-11-28T13:01:31.020818+0000","last_clean":"2023-11-28T13:01:31.020818+0000","last_became_active":"2023-11-28T13:01:29.621426+0000","last_became_peered":"2023-11-28T13:01:29.621426+0000","last_unstale":"2023-11-28T13:01:31.020818+0000","last_undegraded":"2023-11-28T13:01:31.020818+0000","last_fullsized":"2023-11-28T13:01:31.020818+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:50:48.744668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.599722+0000","last_change":"2023-11-28T13:01:29.617196+0000","last_active":"2023-11-28T13:01:30.599722+0000","last_peered":"2023-11-28T13:01:30.599722+0000","last_clean":"2023-11-28T13:01:30.599722+0000","last_became_active":"2023-11-28T13:01:29.616930+0000","last_became_peered":"2023-11-28T13:01:29.616930+0000","last_unstale":"2023-11-28T13:01:30.599722+0000","last_undegraded":"2023-11-28T13:01:30.599722+0000","last_fullsized":"2023-11-28T13:01:30.599722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:14.159846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.599924+0000","last_change":"2023-11-28T13:01:29.617192+0000","last_active":"2023-11-28T13:01:30.599924+0000","last_peered":"2023-11-28T13:01:30.599924+0000","last_clean":"2023-11-28T13:01:30.599924+0000","last_became_active":"2023-11-28T13:01:29.616202+0000","last_became_peered":"2023-11-28T13:01:29.616202+0000","last_unstale":"2023-11-28T13:01:30.599924+0000","last_undegraded":"2023-11-28T13:01:30.599924+0000","last_fullsized":"2023-11-28T13:01:30.599924+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:55:59.390386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017505+0000","last_change":"2023-11-28T13:01:29.619077+0000","last_active":"2023-11-28T13:01:31.017505+0000","last_peered":"2023-11-28T13:01:31.017505+0000","last_clean":"2023-11-28T13:01:31.017505+0000","last_became_active":"2023-11-28T13:01:29.618799+0000","last_became_peered":"2023-11-28T13:01:29.618799+0000","last_unstale":"2023-11-28T13:01:31.017505+0000","last_undegraded":"2023-11-28T13:01:31.017505+0000","last_fullsized":"2023-11-28T13:01:31.017505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:49:55.310389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.599401+0000","last_change":"2023-11-28T13:01:29.618015+0000","last_active":"2023-11-28T13:01:30.599401+0000","last_peered":"2023-11-28T13:01:30.599401+0000","last_clean":"2023-11-28T13:01:30.599401+0000","last_became_active":"2023-11-28T13:01:29.617727+0000","last_became_peered":"2023-11-28T13:01:29.617727+0000","last_unstale":"2023-11-28T13:01:30.599401+0000","last_undegraded":"2023-11-28T13:01:30.599401+0000","last_fullsized":"2023-11-28T13:01:30.599401+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:27.779870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017381+0000","last_change":"2023-11-28T13:01:29.622956+0000","last_active":"2023-11-28T13:01:31.017381+0000","last_peered":"2023-11-28T13:01:31.017381+0000","last_clean":"2023-11-28T13:01:31.017381+0000","last_became_active":"2023-11-28T13:01:29.622703+0000","last_became_peered":"2023-11-28T13:01:29.622703+0000","last_unstale":"2023-11-28T13:01:31.017381+0000","last_undegraded":"2023-11-28T13:01:31.017381+0000","last_fullsized":"2023-11-28T13:01:31.017381+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:01:07.652325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.598323+0000","last_change":"2023-11-28T13:01:29.621971+0000","last_active":"2023-11-28T13:01:30.598323+0000","last_peered":"2023-11-28T13:01:30.598323+0000","last_clean":"2023-11-28T13:01:30.598323+0000","last_became_active":"2023-11-28T13:01:29.620123+0000","last_became_peered":"2023-11-28T13:01:29.620123+0000","last_unstale":"2023-11-28T13:01:30.598323+0000","last_undegraded":"2023-11-28T13:01:30.598323+0000","last_fullsized":"2023-11-28T13:01:30.598323+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:00.647375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.598369+0000","last_change":"2023-11-28T13:01:29.621123+0000","last_active":"2023-11-28T13:01:30.598369+0000","last_peered":"2023-11-28T13:01:30.598369+0000","last_clean":"2023-11-28T13:01:30.598369+0000","last_became_active":"2023-11-28T13:01:29.620697+0000","last_became_peered":"2023-11-28T13:01:29.620697+0000","last_unstale":"2023-11-28T13:01:30.598369+0000","last_undegraded":"2023-11-28T13:01:30.598369+0000","last_fullsized":"2023-11-28T13:01:30.598369+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:46:46.127788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.601049+0000","last_change":"2023-11-28T13:01:29.625739+0000","last_active":"2023-11-28T13:01:30.601049+0000","last_peered":"2023-11-28T13:01:30.601049+0000","last_clean":"2023-11-28T13:01:30.601049+0000","last_became_active":"2023-11-28T13:01:29.625420+0000","last_became_peered":"2023-11-28T13:01:29.625420+0000","last_unstale":"2023-11-28T13:01:30.601049+0000","last_undegraded":"2023-11-28T13:01:30.601049+0000","last_fullsized":"2023-11-28T13:01:30.601049+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:50:48.744668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017262+0000","last_change":"2023-11-28T13:01:29.623557+0000","last_active":"2023-11-28T13:01:31.017262+0000","last_peered":"2023-11-28T13:01:31.017262+0000","last_clean":"2023-11-28T13:01:31.017262+0000","last_became_active":"2023-11-28T13:01:29.623269+0000","last_became_peered":"2023-11-28T13:01:29.623269+0000","last_unstale":"2023-11-28T13:01:31.017262+0000","last_undegraded":"2023-11-28T13:01:31.017262+0000","last_fullsized":"2023-11-28T13:01:31.017262+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:23.976550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.596285+0000","last_change":"2023-11-28T13:01:29.620341+0000","last_active":"2023-11-28T13:01:30.596285+0000","last_peered":"2023-11-28T13:01:30.596285+0000","last_clean":"2023-11-28T13:01:30.596285+0000","last_became_active":"2023-11-28T13:01:29.620054+0000","last_became_peered":"2023-11-28T13:01:29.620054+0000","last_unstale":"2023-11-28T13:01:30.596285+0000","last_undegraded":"2023-11-28T13:01:30.596285+0000","last_fullsized":"2023-11-28T13:01:30.596285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:02.717064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017982+0000","last_change":"2023-11-28T13:01:29.616295+0000","last_active":"2023-11-28T13:01:31.017982+0000","last_peered":"2023-11-28T13:01:31.017982+0000","last_clean":"2023-11-28T13:01:31.017982+0000","last_became_active":"2023-11-28T13:01:29.616024+0000","last_became_peered":"2023-11-28T13:01:29.616024+0000","last_unstale":"2023-11-28T13:01:31.017982+0000","last_undegraded":"2023-11-28T13:01:31.017982+0000","last_fullsized":"2023-11-28T13:01:31.017982+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:41.542245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.598544+0000","last_change":"2023-11-28T13:01:29.615417+0000","last_active":"2023-11-28T13:01:30.598544+0000","last_peered":"2023-11-28T13:01:30.598544+0000","last_clean":"2023-11-28T13:01:30.598544+0000","last_became_active":"2023-11-28T13:01:29.609734+0000","last_became_peered":"2023-11-28T13:01:29.609734+0000","last_unstale":"2023-11-28T13:01:30.598544+0000","last_undegraded":"2023-11-28T13:01:30.598544+0000","last_fullsized":"2023-11-28T13:01:30.598544+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:38:46.060418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.018262+0000","last_change":"2023-11-28T13:01:29.625629+0000","last_active":"2023-11-28T13:01:31.018262+0000","last_peered":"2023-11-28T13:01:31.018262+0000","last_clean":"2023-11-28T13:01:31.018262+0000","last_became_active":"2023-11-28T13:01:29.625352+0000","last_became_peered":"2023-11-28T13:01:29.625352+0000","last_unstale":"2023-11-28T13:01:31.018262+0000","last_undegraded":"2023-11-28T13:01:31.018262+0000","last_fullsized":"2023-11-28T13:01:31.018262+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:31.598116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.598428+0000","last_change":"2023-11-28T13:01:29.618987+0000","last_active":"2023-11-28T13:01:30.598428+0000","last_peered":"2023-11-28T13:01:30.598428+0000","last_clean":"2023-11-28T13:01:30.598428+0000","last_became_active":"2023-11-28T13:01:29.618714+0000","last_became_peered":"2023-11-28T13:01:29.618714+0000","last_unstale":"2023-11-28T13:01:30.598428+0000","last_undegraded":"2023-11-28T13:01:30.598428+0000","last_fullsized":"2023-11-28T13:01:30.598428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:31.598116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.595644+0000","last_change":"2023-11-28T13:01:29.613743+0000","last_active":"2023-11-28T13:01:30.595644+0000","last_peered":"2023-11-28T13:01:30.595644+0000","last_clean":"2023-11-28T13:01:30.595644+0000","last_became_active":"2023-11-28T13:01:29.613508+0000","last_became_peered":"2023-11-28T13:01:29.613508+0000","last_unstale":"2023-11-28T13:01:30.595644+0000","last_undegraded":"2023-11-28T13:01:30.595644+0000","last_fullsized":"2023-11-28T13:01:30.595644+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:41.542245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.016812+0000","last_change":"2023-11-28T13:01:29.617021+0000","last_active":"2023-11-28T13:01:31.016812+0000","last_peered":"2023-11-28T13:01:31.016812+0000","last_clean":"2023-11-28T13:01:31.016812+0000","last_became_active":"2023-11-28T13:01:29.616773+0000","last_became_peered":"2023-11-28T13:01:29.616773+0000","last_unstale":"2023-11-28T13:01:31.016812+0000","last_undegraded":"2023-11-28T13:01:31.016812+0000","last_fullsized":"2023-11-28T13:01:31.016812+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:09.651953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.019859+0000","last_change":"2023-11-28T13:01:29.626968+0000","last_active":"2023-11-28T13:01:31.019859+0000","last_peered":"2023-11-28T13:01:31.019859+0000","last_clean":"2023-11-28T13:01:31.019859+0000","last_became_active":"2023-11-28T13:01:29.626737+0000","last_became_peered":"2023-11-28T13:01:29.626737+0000","last_unstale":"2023-11-28T13:01:31.019859+0000","last_undegraded":"2023-11-28T13:01:31.019859+0000","last_fullsized":"2023-11-28T13:01:31.019859+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:49:03.891545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017001+0000","last_change":"2023-11-28T13:01:29.616071+0000","last_active":"2023-11-28T13:01:31.017001+0000","last_peered":"2023-11-28T13:01:31.017001+0000","last_clean":"2023-11-28T13:01:31.017001+0000","last_became_active":"2023-11-28T13:01:29.615787+0000","last_became_peered":"2023-11-28T13:01:29.615787+0000","last_unstale":"2023-11-28T13:01:31.017001+0000","last_undegraded":"2023-11-28T13:01:31.017001+0000","last_fullsized":"2023-11-28T13:01:31.017001+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:02.717064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.599646+0000","last_change":"2023-11-28T13:01:29.615182+0000","last_active":"2023-11-28T13:01:30.599646+0000","last_peered":"2023-11-28T13:01:30.599646+0000","last_clean":"2023-11-28T13:01:30.599646+0000","last_became_active":"2023-11-28T13:01:29.609494+0000","last_became_peered":"2023-11-28T13:01:29.609494+0000","last_unstale":"2023-11-28T13:01:30.599646+0000","last_undegraded":"2023-11-28T13:01:30.599646+0000","last_fullsized":"2023-11-28T13:01:30.599646+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:01:07.652325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.016760+0000","last_change":"2023-11-28T13:01:29.615462+0000","last_active":"2023-11-28T13:01:31.016760+0000","last_peered":"2023-11-28T13:01:31.016760+0000","last_clean":"2023-11-28T13:01:31.016760+0000","last_became_active":"2023-11-28T13:01:29.615080+0000","last_became_peered":"2023-11-28T13:01:29.615080+0000","last_unstale":"2023-11-28T13:01:31.016760+0000","last_undegraded":"2023-11-28T13:01:31.016760+0000","last_fullsized":"2023-11-28T13:01:31.016760+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:53:43.787266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.016442+0000","last_change":"2023-11-28T13:01:29.606596+0000","last_active":"2023-11-28T13:01:31.016442+0000","last_peered":"2023-11-28T13:01:31.016442+0000","last_clean":"2023-11-28T13:01:31.016442+0000","last_became_active":"2023-11-28T13:01:29.606272+0000","last_became_peered":"2023-11-28T13:01:29.606272+0000","last_unstale":"2023-11-28T13:01:31.016442+0000","last_undegraded":"2023-11-28T13:01:31.016442+0000","last_fullsized":"2023-11-28T13:01:31.016442+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:48.142047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.598658+0000","last_change":"2023-11-28T13:01:29.614302+0000","last_active":"2023-11-28T13:01:30.598658+0000","last_peered":"2023-11-28T13:01:30.598658+0000","last_clean":"2023-11-28T13:01:30.598658+0000","last_became_active":"2023-11-28T13:01:29.613934+0000","last_became_peered":"2023-11-28T13:01:29.613934+0000","last_unstale":"2023-11-28T13:01:30.598658+0000","last_undegraded":"2023-11-28T13:01:30.598658+0000","last_fullsized":"2023-11-28T13:01:30.598658+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:49:55.310389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.018138+0000","last_change":"2023-11-28T13:01:29.616490+0000","last_active":"2023-11-28T13:01:31.018138+0000","last_peered":"2023-11-28T13:01:31.018138+0000","last_clean":"2023-11-28T13:01:31.018138+0000","last_became_active":"2023-11-28T13:01:29.616167+0000","last_became_peered":"2023-11-28T13:01:29.616167+0000","last_unstale":"2023-11-28T13:01:31.018138+0000","last_undegraded":"2023-11-28T13:01:31.018138+0000","last_fullsized":"2023-11-28T13:01:31.018138+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:18.132890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.600608+0000","last_change":"2023-11-28T13:01:29.620968+0000","last_active":"2023-11-28T13:01:30.600608+0000","last_peered":"2023-11-28T13:01:30.600608+0000","last_clean":"2023-11-28T13:01:30.600608+0000","last_became_active":"2023-11-28T13:01:29.620583+0000","last_became_peered":"2023-11-28T13:01:29.620583+0000","last_unstale":"2023-11-28T13:01:30.600608+0000","last_undegraded":"2023-11-28T13:01:30.600608+0000","last_fullsized":"2023-11-28T13:01:30.600608+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:55:59.390386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.628699+0000","last_change":"2023-11-28T13:01:29.235318+0000","last_active":"2023-11-28T13:01:29.628699+0000","last_peered":"2023-11-28T13:01:29.628699+0000","last_clean":"2023-11-28T13:01:29.628699+0000","last_became_active":"2023-11-28T13:01:29.235039+0000","last_became_peered":"2023-11-28T13:01:29.235039+0000","last_unstale":"2023-11-28T13:01:29.628699+0000","last_undegraded":"2023-11-28T13:01:29.628699+0000","last_fullsized":"2023-11-28T13:01:29.628699+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:10.621678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.019151+0000","last_change":"2023-11-28T13:01:29.624879+0000","last_active":"2023-11-28T13:01:31.019151+0000","last_peered":"2023-11-28T13:01:31.019151+0000","last_clean":"2023-11-28T13:01:31.019151+0000","last_became_active":"2023-11-28T13:01:29.624578+0000","last_became_peered":"2023-11-28T13:01:29.624578+0000","last_unstale":"2023-11-28T13:01:31.019151+0000","last_undegraded":"2023-11-28T13:01:31.019151+0000","last_fullsized":"2023-11-28T13:01:31.019151+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:46:46.127788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.625435+0000","last_change":"2023-11-28T13:01:29.235468+0000","last_active":"2023-11-28T13:01:29.625435+0000","last_peered":"2023-11-28T13:01:29.625435+0000","last_clean":"2023-11-28T13:01:29.625435+0000","last_became_active":"2023-11-28T13:01:29.235176+0000","last_became_peered":"2023-11-28T13:01:29.235176+0000","last_unstale":"2023-11-28T13:01:29.625435+0000","last_undegraded":"2023-11-28T13:01:29.625435+0000","last_fullsized":"2023-11-28T13:01:29.625435+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:12.505253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017870+0000","last_change":"2023-11-28T13:01:29.617048+0000","last_active":"2023-11-28T13:01:31.017870+0000","last_peered":"2023-11-28T13:01:31.017870+0000","last_clean":"2023-11-28T13:01:31.017870+0000","last_became_active":"2023-11-28T13:01:29.616430+0000","last_became_peered":"2023-11-28T13:01:29.616430+0000","last_unstale":"2023-11-28T13:01:31.017870+0000","last_undegraded":"2023-11-28T13:01:31.017870+0000","last_fullsized":"2023-11-28T13:01:31.017870+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:38:46.060418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.632346+0000","last_change":"2023-11-28T13:01:29.233323+0000","last_active":"2023-11-28T13:01:29.632346+0000","last_peered":"2023-11-28T13:01:29.632346+0000","last_clean":"2023-11-28T13:01:29.632346+0000","last_became_active":"2023-11-28T13:01:29.233004+0000","last_became_peered":"2023-11-28T13:01:29.233004+0000","last_unstale":"2023-11-28T13:01:29.632346+0000","last_undegraded":"2023-11-28T13:01:29.632346+0000","last_fullsized":"2023-11-28T13:01:29.632346+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:16.854220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.019369+0000","last_change":"2023-11-28T13:01:29.618080+0000","last_active":"2023-11-28T13:01:31.019369+0000","last_peered":"2023-11-28T13:01:31.019369+0000","last_clean":"2023-11-28T13:01:31.019369+0000","last_became_active":"2023-11-28T13:01:29.617750+0000","last_became_peered":"2023-11-28T13:01:29.617750+0000","last_unstale":"2023-11-28T13:01:31.019369+0000","last_undegraded":"2023-11-28T13:01:31.019369+0000","last_fullsized":"2023-11-28T13:01:31.019369+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:00.647375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.628017+0000","last_change":"2023-11-28T13:01:29.238492+0000","last_active":"2023-11-28T13:01:29.628017+0000","last_peered":"2023-11-28T13:01:29.628017+0000","last_clean":"2023-11-28T13:01:29.628017+0000","last_became_active":"2023-11-28T13:01:29.238215+0000","last_became_peered":"2023-11-28T13:01:29.238215+0000","last_unstale":"2023-11-28T13:01:29.628017+0000","last_undegraded":"2023-11-28T13:01:29.628017+0000","last_fullsized":"2023-11-28T13:01:29.628017+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:15:15.549631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017011+0000","last_change":"2023-11-28T13:01:29.614047+0000","last_active":"2023-11-28T13:01:31.017011+0000","last_peered":"2023-11-28T13:01:31.017011+0000","last_clean":"2023-11-28T13:01:31.017011+0000","last_became_active":"2023-11-28T13:01:29.613804+0000","last_became_peered":"2023-11-28T13:01:29.613804+0000","last_unstale":"2023-11-28T13:01:31.017011+0000","last_undegraded":"2023-11-28T13:01:31.017011+0000","last_fullsized":"2023-11-28T13:01:31.017011+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:55:59.390386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.625647+0000","last_change":"2023-11-28T13:01:29.235088+0000","last_active":"2023-11-28T13:01:29.625647+0000","last_peered":"2023-11-28T13:01:29.625647+0000","last_clean":"2023-11-28T13:01:29.625647+0000","last_became_active":"2023-11-28T13:01:29.234778+0000","last_became_peered":"2023-11-28T13:01:29.234778+0000","last_unstale":"2023-11-28T13:01:29.625647+0000","last_undegraded":"2023-11-28T13:01:29.625647+0000","last_fullsized":"2023-11-28T13:01:29.625647+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:09:46.508882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.598557+0000","last_change":"2023-11-28T13:01:29.620026+0000","last_active":"2023-11-28T13:01:30.598557+0000","last_peered":"2023-11-28T13:01:30.598557+0000","last_clean":"2023-11-28T13:01:30.598557+0000","last_became_active":"2023-11-28T13:01:29.619675+0000","last_became_peered":"2023-11-28T13:01:29.619675+0000","last_unstale":"2023-11-28T13:01:30.598557+0000","last_undegraded":"2023-11-28T13:01:30.598557+0000","last_fullsized":"2023-11-28T13:01:30.598557+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:51:19.589153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.630928+0000","last_change":"2023-11-28T13:01:29.234311+0000","last_active":"2023-11-28T13:01:29.630928+0000","last_peered":"2023-11-28T13:01:29.630928+0000","last_clean":"2023-11-28T13:01:29.630928+0000","last_became_active":"2023-11-28T13:01:29.233940+0000","last_became_peered":"2023-11-28T13:01:29.233940+0000","last_unstale":"2023-11-28T13:01:29.630928+0000","last_undegraded":"2023-11-28T13:01:29.630928+0000","last_fullsized":"2023-11-28T13:01:29.630928+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:47.130802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017876+0000","last_change":"2023-11-28T13:01:29.626235+0000","last_active":"2023-11-28T13:01:31.017876+0000","last_peered":"2023-11-28T13:01:31.017876+0000","last_clean":"2023-11-28T13:01:31.017876+0000","last_became_active":"2023-11-28T13:01:29.625813+0000","last_became_peered":"2023-11-28T13:01:29.625813+0000","last_unstale":"2023-11-28T13:01:31.017876+0000","last_undegraded":"2023-11-28T13:01:31.017876+0000","last_fullsized":"2023-11-28T13:01:31.017876+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:26.374397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.602947+0000","last_change":"2023-11-28T13:01:29.240694+0000","last_active":"2023-11-28T13:01:29.602947+0000","last_peered":"2023-11-28T13:01:29.602947+0000","last_clean":"2023-11-28T13:01:29.602947+0000","last_became_active":"2023-11-28T13:01:29.240381+0000","last_became_peered":"2023-11-28T13:01:29.240381+0000","last_unstale":"2023-11-28T13:01:29.602947+0000","last_undegraded":"2023-11-28T13:01:29.602947+0000","last_fullsized":"2023-11-28T13:01:29.602947+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:19.124556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.018629+0000","last_change":"2023-11-28T13:01:29.612131+0000","last_active":"2023-11-28T13:01:31.018629+0000","last_peered":"2023-11-28T13:01:31.018629+0000","last_clean":"2023-11-28T13:01:31.018629+0000","last_became_active":"2023-11-28T13:01:29.611875+0000","last_became_peered":"2023-11-28T13:01:29.611875+0000","last_unstale":"2023-11-28T13:01:31.018629+0000","last_undegraded":"2023-11-28T13:01:31.018629+0000","last_fullsized":"2023-11-28T13:01:31.018629+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:38:46.060418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.605227+0000","last_change":"2023-11-28T13:01:29.228753+0000","last_active":"2023-11-28T13:01:29.605227+0000","last_peered":"2023-11-28T13:01:29.605227+0000","last_clean":"2023-11-28T13:01:29.605227+0000","last_became_active":"2023-11-28T13:01:29.228454+0000","last_became_peered":"2023-11-28T13:01:29.228454+0000","last_unstale":"2023-11-28T13:01:29.605227+0000","last_undegraded":"2023-11-28T13:01:29.605227+0000","last_fullsized":"2023-11-28T13:01:29.605227+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:55.167964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.596099+0000","last_change":"2023-11-28T13:01:29.616825+0000","last_active":"2023-11-28T13:01:30.596099+0000","last_peered":"2023-11-28T13:01:30.596099+0000","last_clean":"2023-11-28T13:01:30.596099+0000","last_became_active":"2023-11-28T13:01:29.616530+0000","last_became_peered":"2023-11-28T13:01:29.616530+0000","last_unstale":"2023-11-28T13:01:30.596099+0000","last_undegraded":"2023-11-28T13:01:30.596099+0000","last_fullsized":"2023-11-28T13:01:30.596099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:48.142047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.600242+0000","last_change":"2023-11-28T13:01:29.238933+0000","last_active":"2023-11-28T13:01:29.600242+0000","last_peered":"2023-11-28T13:01:29.600242+0000","last_clean":"2023-11-28T13:01:29.600242+0000","last_became_active":"2023-11-28T13:01:29.238678+0000","last_became_peered":"2023-11-28T13:01:29.238678+0000","last_unstale":"2023-11-28T13:01:29.600242+0000","last_undegraded":"2023-11-28T13:01:29.600242+0000","last_fullsized":"2023-11-28T13:01:29.600242+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:12.505253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.600728+0000","last_change":"2023-11-28T13:01:29.616974+0000","last_active":"2023-11-28T13:01:30.600728+0000","last_peered":"2023-11-28T13:01:30.600728+0000","last_clean":"2023-11-28T13:01:30.600728+0000","last_became_active":"2023-11-28T13:01:29.616662+0000","last_became_peered":"2023-11-28T13:01:29.616662+0000","last_unstale":"2023-11-28T13:01:30.600728+0000","last_undegraded":"2023-11-28T13:01:30.600728+0000","last_fullsized":"2023-11-28T13:01:30.600728+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:50.980296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.597918+0000","last_change":"2023-11-28T13:01:29.240013+0000","last_active":"2023-11-28T13:01:29.597918+0000","last_peered":"2023-11-28T13:01:29.597918+0000","last_clean":"2023-11-28T13:01:29.597918+0000","last_became_active":"2023-11-28T13:01:29.239717+0000","last_became_peered":"2023-11-28T13:01:29.239717+0000","last_unstale":"2023-11-28T13:01:29.597918+0000","last_undegraded":"2023-11-28T13:01:29.597918+0000","last_fullsized":"2023-11-28T13:01:29.597918+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:35.486834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.020782+0000","last_change":"2023-11-28T13:01:29.612440+0000","last_active":"2023-11-28T13:01:31.020782+0000","last_peered":"2023-11-28T13:01:31.020782+0000","last_clean":"2023-11-28T13:01:31.020782+0000","last_became_active":"2023-11-28T13:01:29.612156+0000","last_became_peered":"2023-11-28T13:01:29.612156+0000","last_unstale":"2023-11-28T13:01:31.020782+0000","last_undegraded":"2023-11-28T13:01:31.020782+0000","last_fullsized":"2023-11-28T13:01:31.020782+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:14.159846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.628147+0000","last_change":"2023-11-28T13:01:29.238090+0000","last_active":"2023-11-28T13:01:29.628147+0000","last_peered":"2023-11-28T13:01:29.628147+0000","last_clean":"2023-11-28T13:01:29.628147+0000","last_became_active":"2023-11-28T13:01:29.237838+0000","last_became_peered":"2023-11-28T13:01:29.237838+0000","last_unstale":"2023-11-28T13:01:29.628147+0000","last_undegraded":"2023-11-28T13:01:29.628147+0000","last_fullsized":"2023-11-28T13:01:29.628147+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:06.881393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.018353+0000","last_change":"2023-11-28T13:01:29.617989+0000","last_active":"2023-11-28T13:01:31.018353+0000","last_peered":"2023-11-28T13:01:31.018353+0000","last_clean":"2023-11-28T13:01:31.018353+0000","last_became_active":"2023-11-28T13:01:29.617733+0000","last_became_peered":"2023-11-28T13:01:29.617733+0000","last_unstale":"2023-11-28T13:01:31.018353+0000","last_undegraded":"2023-11-28T13:01:31.018353+0000","last_fullsized":"2023-11-28T13:01:31.018353+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:27.779870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.629961+0000","last_change":"2023-11-28T13:01:29.237869+0000","last_active":"2023-11-28T13:01:29.629961+0000","last_peered":"2023-11-28T13:01:29.629961+0000","last_clean":"2023-11-28T13:01:29.629961+0000","last_became_active":"2023-11-28T13:01:29.237534+0000","last_became_peered":"2023-11-28T13:01:29.237534+0000","last_unstale":"2023-11-28T13:01:29.629961+0000","last_undegraded":"2023-11-28T13:01:29.629961+0000","last_fullsized":"2023-11-28T13:01:29.629961+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:35.486834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017036+0000","last_change":"2023-11-28T13:01:29.622023+0000","last_active":"2023-11-28T13:01:31.017036+0000","last_peered":"2023-11-28T13:01:31.017036+0000","last_clean":"2023-11-28T13:01:31.017036+0000","last_became_active":"2023-11-28T13:01:29.621762+0000","last_became_peered":"2023-11-28T13:01:29.621762+0000","last_unstale":"2023-11-28T13:01:31.017036+0000","last_undegraded":"2023-11-28T13:01:31.017036+0000","last_fullsized":"2023-11-28T13:01:31.017036+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:50.377067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.616678+0000","last_change":"2023-11-28T13:01:29.235730+0000","last_active":"2023-11-28T13:01:29.616678+0000","last_peered":"2023-11-28T13:01:29.616678+0000","last_clean":"2023-11-28T13:01:29.616678+0000","last_became_active":"2023-11-28T13:01:29.235456+0000","last_became_peered":"2023-11-28T13:01:29.235456+0000","last_unstale":"2023-11-28T13:01:29.616678+0000","last_undegraded":"2023-11-28T13:01:29.616678+0000","last_fullsized":"2023-11-28T13:01:29.616678+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:06.881393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.018572+0000","last_change":"2023-11-28T13:01:29.612720+0000","last_active":"2023-11-28T13:01:31.018572+0000","last_peered":"2023-11-28T13:01:31.018572+0000","last_clean":"2023-11-28T13:01:31.018572+0000","last_became_active":"2023-11-28T13:01:29.612468+0000","last_became_peered":"2023-11-28T13:01:29.612468+0000","last_unstale":"2023-11-28T13:01:31.018572+0000","last_undegraded":"2023-11-28T13:01:31.018572+0000","last_fullsized":"2023-11-28T13:01:31.018572+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:27.779870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.604368+0000","last_change":"2023-11-28T13:01:29.235872+0000","last_active":"2023-11-28T13:01:29.604368+0000","last_peered":"2023-11-28T13:01:29.604368+0000","last_clean":"2023-11-28T13:01:29.604368+0000","last_became_active":"2023-11-28T13:01:29.235614+0000","last_became_peered":"2023-11-28T13:01:29.235614+0000","last_unstale":"2023-11-28T13:01:29.604368+0000","last_undegraded":"2023-11-28T13:01:29.604368+0000","last_fullsized":"2023-11-28T13:01:29.604368+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:34.884855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.599111+0000","last_change":"2023-11-28T13:01:29.618010+0000","last_active":"2023-11-28T13:01:30.599111+0000","last_peered":"2023-11-28T13:01:30.599111+0000","last_clean":"2023-11-28T13:01:30.599111+0000","last_became_active":"2023-11-28T13:01:29.617768+0000","last_became_peered":"2023-11-28T13:01:29.617768+0000","last_unstale":"2023-11-28T13:01:30.599111+0000","last_undegraded":"2023-11-28T13:01:30.599111+0000","last_fullsized":"2023-11-28T13:01:30.599111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:50.377067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.606966+0000","last_change":"2023-11-28T13:01:29.232087+0000","last_active":"2023-11-28T13:01:29.606966+0000","last_peered":"2023-11-28T13:01:29.606966+0000","last_clean":"2023-11-28T13:01:29.606966+0000","last_became_active":"2023-11-28T13:01:29.231827+0000","last_became_peered":"2023-11-28T13:01:29.231827+0000","last_unstale":"2023-11-28T13:01:29.606966+0000","last_undegraded":"2023-11-28T13:01:29.606966+0000","last_fullsized":"2023-11-28T13:01:29.606966+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:15:31.600456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.018777+0000","last_change":"2023-11-28T13:01:29.617659+0000","last_active":"2023-11-28T13:01:31.018777+0000","last_peered":"2023-11-28T13:01:31.018777+0000","last_clean":"2023-11-28T13:01:31.018777+0000","last_became_active":"2023-11-28T13:01:29.617274+0000","last_became_peered":"2023-11-28T13:01:29.617274+0000","last_unstale":"2023-11-28T13:01:31.018777+0000","last_undegraded":"2023-11-28T13:01:31.018777+0000","last_fullsized":"2023-11-28T13:01:31.018777+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:50.980296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.630900+0000","last_change":"2023-11-28T13:01:29.234651+0000","last_active":"2023-11-28T13:01:29.630900+0000","last_peered":"2023-11-28T13:01:29.630900+0000","last_clean":"2023-11-28T13:01:29.630900+0000","last_became_active":"2023-11-28T13:01:29.234354+0000","last_became_peered":"2023-11-28T13:01:29.234354+0000","last_unstale":"2023-11-28T13:01:29.630900+0000","last_undegraded":"2023-11-28T13:01:29.630900+0000","last_fullsized":"2023-11-28T13:01:29.630900+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:16.854220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.019357+0000","last_change":"2023-11-28T13:01:29.619877+0000","last_active":"2023-11-28T13:01:31.019357+0000","last_peered":"2023-11-28T13:01:31.019357+0000","last_clean":"2023-11-28T13:01:31.019357+0000","last_became_active":"2023-11-28T13:01:29.619639+0000","last_became_peered":"2023-11-28T13:01:29.619639+0000","last_unstale":"2023-11-28T13:01:31.019357+0000","last_undegraded":"2023-11-28T13:01:31.019357+0000","last_fullsized":"2023-11-28T13:01:31.019357+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:01:07.652325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.631348+0000","last_change":"2023-11-28T13:01:29.239337+0000","last_active":"2023-11-28T13:01:29.631348+0000","last_peered":"2023-11-28T13:01:29.631348+0000","last_clean":"2023-11-28T13:01:29.631348+0000","last_became_active":"2023-11-28T13:01:29.239047+0000","last_became_peered":"2023-11-28T13:01:29.239047+0000","last_unstale":"2023-11-28T13:01:29.631348+0000","last_undegraded":"2023-11-28T13:01:29.631348+0000","last_fullsized":"2023-11-28T13:01:29.631348+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:08.725526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.599945+0000","last_change":"2023-11-28T13:01:29.609457+0000","last_active":"2023-11-28T13:01:30.599945+0000","last_peered":"2023-11-28T13:01:30.599945+0000","last_clean":"2023-11-28T13:01:30.599945+0000","last_became_active":"2023-11-28T13:01:29.609146+0000","last_became_peered":"2023-11-28T13:01:29.609146+0000","last_unstale":"2023-11-28T13:01:30.599945+0000","last_undegraded":"2023-11-28T13:01:30.599945+0000","last_fullsized":"2023-11-28T13:01:30.599945+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:26.374397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.627935+0000","last_change":"2023-11-28T13:01:29.234537+0000","last_active":"2023-11-28T13:01:29.627935+0000","last_peered":"2023-11-28T13:01:29.627935+0000","last_clean":"2023-11-28T13:01:29.627935+0000","last_became_active":"2023-11-28T13:01:29.234282+0000","last_became_peered":"2023-11-28T13:01:29.234282+0000","last_unstale":"2023-11-28T13:01:29.627935+0000","last_undegraded":"2023-11-28T13:01:29.627935+0000","last_fullsized":"2023-11-28T13:01:29.627935+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:22:36.945966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017613+0000","last_change":"2023-11-28T13:01:29.617207+0000","last_active":"2023-11-28T13:01:31.017613+0000","last_peered":"2023-11-28T13:01:31.017613+0000","last_clean":"2023-11-28T13:01:31.017613+0000","last_became_active":"2023-11-28T13:01:29.616740+0000","last_became_peered":"2023-11-28T13:01:29.616740+0000","last_unstale":"2023-11-28T13:01:31.017613+0000","last_undegraded":"2023-11-28T13:01:31.017613+0000","last_fullsized":"2023-11-28T13:01:31.017613+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:49:55.310389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.626248+0000","last_change":"2023-11-28T13:01:29.240381+0000","last_active":"2023-11-28T13:01:29.626248+0000","last_peered":"2023-11-28T13:01:29.626248+0000","last_clean":"2023-11-28T13:01:29.626248+0000","last_became_active":"2023-11-28T13:01:29.235778+0000","last_became_peered":"2023-11-28T13:01:29.235778+0000","last_unstale":"2023-11-28T13:01:29.626248+0000","last_undegraded":"2023-11-28T13:01:29.626248+0000","last_fullsized":"2023-11-28T13:01:29.626248+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:50.711987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.596414+0000","last_change":"2023-11-28T13:01:29.617898+0000","last_active":"2023-11-28T13:01:30.596414+0000","last_peered":"2023-11-28T13:01:30.596414+0000","last_clean":"2023-11-28T13:01:30.596414+0000","last_became_active":"2023-11-28T13:01:29.617400+0000","last_became_peered":"2023-11-28T13:01:29.617400+0000","last_unstale":"2023-11-28T13:01:30.596414+0000","last_undegraded":"2023-11-28T13:01:30.596414+0000","last_fullsized":"2023-11-28T13:01:30.596414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:09.651953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.602363+0000","last_change":"2023-11-28T13:01:29.236854+0000","last_active":"2023-11-28T13:01:29.602363+0000","last_peered":"2023-11-28T13:01:29.602363+0000","last_clean":"2023-11-28T13:01:29.602363+0000","last_became_active":"2023-11-28T13:01:29.236603+0000","last_became_peered":"2023-11-28T13:01:29.236603+0000","last_unstale":"2023-11-28T13:01:29.602363+0000","last_undegraded":"2023-11-28T13:01:29.602363+0000","last_fullsized":"2023-11-28T13:01:29.602363+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:47.130802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.598781+0000","last_change":"2023-11-28T13:01:29.614605+0000","last_active":"2023-11-28T13:01:30.598781+0000","last_peered":"2023-11-28T13:01:30.598781+0000","last_clean":"2023-11-28T13:01:30.598781+0000","last_became_active":"2023-11-28T13:01:29.613943+0000","last_became_peered":"2023-11-28T13:01:29.613943+0000","last_unstale":"2023-11-28T13:01:30.598781+0000","last_undegraded":"2023-11-28T13:01:30.598781+0000","last_fullsized":"2023-11-28T13:01:30.598781+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:14.159846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.625857+0000","last_change":"2023-11-28T13:01:29.234946+0000","last_active":"2023-11-28T13:01:29.625857+0000","last_peered":"2023-11-28T13:01:29.625857+0000","last_clean":"2023-11-28T13:01:29.625857+0000","last_became_active":"2023-11-28T13:01:29.234651+0000","last_became_peered":"2023-11-28T13:01:29.234651+0000","last_unstale":"2023-11-28T13:01:29.625857+0000","last_undegraded":"2023-11-28T13:01:29.625857+0000","last_fullsized":"2023-11-28T13:01:29.625857+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:33.041552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.020280+0000","last_change":"2023-11-28T13:01:29.612454+0000","last_active":"2023-11-28T13:01:31.020280+0000","last_peered":"2023-11-28T13:01:31.020280+0000","last_clean":"2023-11-28T13:01:31.020280+0000","last_became_active":"2023-11-28T13:01:29.612188+0000","last_became_peered":"2023-11-28T13:01:29.612188+0000","last_unstale":"2023-11-28T13:01:31.020280+0000","last_undegraded":"2023-11-28T13:01:31.020280+0000","last_fullsized":"2023-11-28T13:01:31.020280+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:27.779870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.612022+0000","last_change":"2023-11-28T13:01:29.233140+0000","last_active":"2023-11-28T13:01:29.612022+0000","last_peered":"2023-11-28T13:01:29.612022+0000","last_clean":"2023-11-28T13:01:29.612022+0000","last_became_active":"2023-11-28T13:01:29.232886+0000","last_became_peered":"2023-11-28T13:01:29.232886+0000","last_unstale":"2023-11-28T13:01:29.612022+0000","last_undegraded":"2023-11-28T13:01:29.612022+0000","last_fullsized":"2023-11-28T13:01:29.612022+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:15:31.600456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.598507+0000","last_change":"2023-11-28T13:01:29.616437+0000","last_active":"2023-11-28T13:01:30.598507+0000","last_peered":"2023-11-28T13:01:30.598507+0000","last_clean":"2023-11-28T13:01:30.598507+0000","last_became_active":"2023-11-28T13:01:29.616062+0000","last_became_peered":"2023-11-28T13:01:29.616062+0000","last_unstale":"2023-11-28T13:01:30.598507+0000","last_undegraded":"2023-11-28T13:01:30.598507+0000","last_fullsized":"2023-11-28T13:01:30.598507+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:50.980296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.599701+0000","last_change":"2023-11-28T13:01:29.235345+0000","last_active":"2023-11-28T13:01:29.599701+0000","last_peered":"2023-11-28T13:01:29.599701+0000","last_clean":"2023-11-28T13:01:29.599701+0000","last_became_active":"2023-11-28T13:01:29.233917+0000","last_became_peered":"2023-11-28T13:01:29.233917+0000","last_unstale":"2023-11-28T13:01:29.599701+0000","last_undegraded":"2023-11-28T13:01:29.599701+0000","last_fullsized":"2023-11-28T13:01:29.599701+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:19.124556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.018895+0000","last_change":"2023-11-28T13:01:29.612054+0000","last_active":"2023-11-28T13:01:31.018895+0000","last_peered":"2023-11-28T13:01:31.018895+0000","last_clean":"2023-11-28T13:01:31.018895+0000","last_became_active":"2023-11-28T13:01:29.611791+0000","last_became_peered":"2023-11-28T13:01:29.611791+0000","last_unstale":"2023-11-28T13:01:31.018895+0000","last_undegraded":"2023-11-28T13:01:31.018895+0000","last_fullsized":"2023-11-28T13:01:31.018895+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:31.598116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.611314+0000","last_change":"2023-11-28T13:01:29.236633+0000","last_active":"2023-11-28T13:01:29.611314+0000","last_peered":"2023-11-28T13:01:29.611314+0000","last_clean":"2023-11-28T13:01:29.611314+0000","last_became_active":"2023-11-28T13:01:29.236353+0000","last_became_peered":"2023-11-28T13:01:29.236353+0000","last_unstale":"2023-11-28T13:01:29.611314+0000","last_undegraded":"2023-11-28T13:01:29.611314+0000","last_fullsized":"2023-11-28T13:01:29.611314+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:06:16.368208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.599721+0000","last_change":"2023-11-28T13:01:29.616664+0000","last_active":"2023-11-28T13:01:30.599721+0000","last_peered":"2023-11-28T13:01:30.599721+0000","last_clean":"2023-11-28T13:01:30.599721+0000","last_became_active":"2023-11-28T13:01:29.615630+0000","last_became_peered":"2023-11-28T13:01:29.615630+0000","last_unstale":"2023-11-28T13:01:30.599721+0000","last_undegraded":"2023-11-28T13:01:30.599721+0000","last_fullsized":"2023-11-28T13:01:30.599721+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:29:48.103969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.599267+0000","last_change":"2023-11-28T13:01:29.234500+0000","last_active":"2023-11-28T13:01:29.599267+0000","last_peered":"2023-11-28T13:01:29.599267+0000","last_clean":"2023-11-28T13:01:29.599267+0000","last_became_active":"2023-11-28T13:01:29.234169+0000","last_became_peered":"2023-11-28T13:01:29.234169+0000","last_unstale":"2023-11-28T13:01:29.599267+0000","last_undegraded":"2023-11-28T13:01:29.599267+0000","last_fullsized":"2023-11-28T13:01:29.599267+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:34.884855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.598051+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:01:29.598051+0000","last_peered":"2023-11-28T13:01:29.598051+0000","last_clean":"2023-11-28T13:01:29.598051+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:01:29.598051+0000","last_undegraded":"2023-11-28T13:01:29.598051+0000","last_fullsized":"2023-11-28T13:01:29.598051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.598128+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:01:29.598128+0000","last_peered":"2023-11-28T13:01:29.598128+0000","last_clean":"2023-11-28T13:01:29.598128+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:01:29.598128+0000","last_undegraded":"2023-11-28T13:01:29.598128+0000","last_fullsized":"2023-11-28T13:01:29.598128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.019243+0000","last_change":"2023-11-28T13:01:29.621465+0000","last_active":"2023-11-28T13:01:31.019243+0000","last_peered":"2023-11-28T13:01:31.019243+0000","last_clean":"2023-11-28T13:01:31.019243+0000","last_became_active":"2023-11-28T13:01:29.621234+0000","last_became_peered":"2023-11-28T13:01:29.621234+0000","last_unstale":"2023-11-28T13:01:31.019243+0000","last_undegraded":"2023-11-28T13:01:31.019243+0000","last_fullsized":"2023-11-28T13:01:31.019243+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:27:06.312034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.626176+0000","last_change":"2023-11-28T13:01:29.238864+0000","last_active":"2023-11-28T13:01:29.626176+0000","last_peered":"2023-11-28T13:01:29.626176+0000","last_clean":"2023-11-28T13:01:29.626176+0000","last_became_active":"2023-11-28T13:01:29.238612+0000","last_became_peered":"2023-11-28T13:01:29.238612+0000","last_unstale":"2023-11-28T13:01:29.626176+0000","last_undegraded":"2023-11-28T13:01:29.626176+0000","last_fullsized":"2023-11-28T13:01:29.626176+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:12.505253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.596819+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:01:29.596819+0000","last_peered":"2023-11-28T13:01:29.596819+0000","last_clean":"2023-11-28T13:01:29.596819+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:01:29.596819+0000","last_undegraded":"2023-11-28T13:01:29.596819+0000","last_fullsized":"2023-11-28T13:01:29.596819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.600907+0000","last_change":"2023-11-28T13:01:29.616842+0000","last_active":"2023-11-28T13:01:30.600907+0000","last_peered":"2023-11-28T13:01:30.600907+0000","last_clean":"2023-11-28T13:01:30.600907+0000","last_became_active":"2023-11-28T13:01:29.616553+0000","last_became_peered":"2023-11-28T13:01:29.616553+0000","last_unstale":"2023-11-28T13:01:30.600907+0000","last_undegraded":"2023-11-28T13:01:30.600907+0000","last_fullsized":"2023-11-28T13:01:30.600907+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:49:03.891545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.596346+0000","last_change":"2023-11-28T13:01:29.240513+0000","last_active":"2023-11-28T13:01:30.596346+0000","last_peered":"2023-11-28T13:01:30.596346+0000","last_clean":"2023-11-28T13:01:30.596346+0000","last_became_active":"2023-11-28T13:01:29.240210+0000","last_became_peered":"2023-11-28T13:01:29.240210+0000","last_unstale":"2023-11-28T13:01:30.596346+0000","last_undegraded":"2023-11-28T13:01:30.596346+0000","last_fullsized":"2023-11-28T13:01:30.596346+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:10.621678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.611279+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:01:29.611279+0000","last_peered":"2023-11-28T13:01:29.611279+0000","last_clean":"2023-11-28T13:01:29.611279+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:01:29.611279+0000","last_undegraded":"2023-11-28T13:01:29.611279+0000","last_fullsized":"2023-11-28T13:01:29.611279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.019380+0000","last_change":"2023-11-28T13:01:29.629449+0000","last_active":"2023-11-28T13:01:31.019380+0000","last_peered":"2023-11-28T13:01:31.019380+0000","last_clean":"2023-11-28T13:01:31.019380+0000","last_became_active":"2023-11-28T13:01:29.629160+0000","last_became_peered":"2023-11-28T13:01:29.629160+0000","last_unstale":"2023-11-28T13:01:31.019380+0000","last_undegraded":"2023-11-28T13:01:31.019380+0000","last_fullsized":"2023-11-28T13:01:31.019380+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:49:55.310389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.598733+0000","last_change":"2023-11-28T13:01:29.236952+0000","last_active":"2023-11-28T13:01:29.598733+0000","last_peered":"2023-11-28T13:01:29.598733+0000","last_clean":"2023-11-28T13:01:29.598733+0000","last_became_active":"2023-11-28T13:01:29.236677+0000","last_became_peered":"2023-11-28T13:01:29.236677+0000","last_unstale":"2023-11-28T13:01:29.598733+0000","last_undegraded":"2023-11-28T13:01:29.598733+0000","last_fullsized":"2023-11-28T13:01:29.598733+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:06.881393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.597046+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:01:29.597046+0000","last_peered":"2023-11-28T13:01:29.597046+0000","last_clean":"2023-11-28T13:01:29.597046+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:01:29.597046+0000","last_undegraded":"2023-11-28T13:01:29.597046+0000","last_fullsized":"2023-11-28T13:01:29.597046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017290+0000","last_change":"2023-11-28T13:01:29.614272+0000","last_active":"2023-11-28T13:01:31.017290+0000","last_peered":"2023-11-28T13:01:31.017290+0000","last_clean":"2023-11-28T13:01:31.017290+0000","last_became_active":"2023-11-28T13:01:29.609788+0000","last_became_peered":"2023-11-28T13:01:29.609788+0000","last_unstale":"2023-11-28T13:01:31.017290+0000","last_undegraded":"2023-11-28T13:01:31.017290+0000","last_fullsized":"2023-11-28T13:01:31.017290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:50.980296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.598469+0000","last_change":"2023-11-28T13:01:29.238339+0000","last_active":"2023-11-28T13:01:29.598469+0000","last_peered":"2023-11-28T13:01:29.598469+0000","last_clean":"2023-11-28T13:01:29.598469+0000","last_became_active":"2023-11-28T13:01:29.238074+0000","last_became_peered":"2023-11-28T13:01:29.238074+0000","last_unstale":"2023-11-28T13:01:29.598469+0000","last_undegraded":"2023-11-28T13:01:29.598469+0000","last_fullsized":"2023-11-28T13:01:29.598469+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:08.725526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.602452+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:01:29.602452+0000","last_peered":"2023-11-28T13:01:29.602452+0000","last_clean":"2023-11-28T13:01:29.602452+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:01:29.602452+0000","last_undegraded":"2023-11-28T13:01:29.602452+0000","last_fullsized":"2023-11-28T13:01:29.602452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.018136+0000","last_change":"2023-11-28T13:01:29.614958+0000","last_active":"2023-11-28T13:01:31.018136+0000","last_peered":"2023-11-28T13:01:31.018136+0000","last_clean":"2023-11-28T13:01:31.018136+0000","last_became_active":"2023-11-28T13:01:29.614711+0000","last_became_peered":"2023-11-28T13:01:29.614711+0000","last_unstale":"2023-11-28T13:01:31.018136+0000","last_undegraded":"2023-11-28T13:01:31.018136+0000","last_fullsized":"2023-11-28T13:01:31.018136+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:15:16.560876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.610684+0000","last_change":"2023-11-28T13:01:29.237421+0000","last_active":"2023-11-28T13:01:29.610684+0000","last_peered":"2023-11-28T13:01:29.610684+0000","last_clean":"2023-11-28T13:01:29.610684+0000","last_became_active":"2023-11-28T13:01:29.237074+0000","last_became_peered":"2023-11-28T13:01:29.237074+0000","last_unstale":"2023-11-28T13:01:29.610684+0000","last_undegraded":"2023-11-28T13:01:29.610684+0000","last_fullsized":"2023-11-28T13:01:29.610684+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:33.041552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.599716+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:01:29.599716+0000","last_peered":"2023-11-28T13:01:29.599716+0000","last_clean":"2023-11-28T13:01:29.599716+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:01:29.599716+0000","last_undegraded":"2023-11-28T13:01:29.599716+0000","last_fullsized":"2023-11-28T13:01:29.599716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017605+0000","last_change":"2023-11-28T13:01:29.615807+0000","last_active":"2023-11-28T13:01:31.017605+0000","last_peered":"2023-11-28T13:01:31.017605+0000","last_clean":"2023-11-28T13:01:31.017605+0000","last_became_active":"2023-11-28T13:01:29.615507+0000","last_became_peered":"2023-11-28T13:01:29.615507+0000","last_unstale":"2023-11-28T13:01:31.017605+0000","last_undegraded":"2023-11-28T13:01:31.017605+0000","last_fullsized":"2023-11-28T13:01:31.017605+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:00.647375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.605236+0000","last_change":"2023-11-28T13:01:29.238348+0000","last_active":"2023-11-28T13:01:29.605236+0000","last_peered":"2023-11-28T13:01:29.605236+0000","last_clean":"2023-11-28T13:01:29.605236+0000","last_became_active":"2023-11-28T13:01:29.238121+0000","last_became_peered":"2023-11-28T13:01:29.238121+0000","last_unstale":"2023-11-28T13:01:29.605236+0000","last_undegraded":"2023-11-28T13:01:29.605236+0000","last_fullsized":"2023-11-28T13:01:29.605236+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:17.121645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.604092+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:01:29.604092+0000","last_peered":"2023-11-28T13:01:29.604092+0000","last_clean":"2023-11-28T13:01:29.604092+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:01:29.604092+0000","last_undegraded":"2023-11-28T13:01:29.604092+0000","last_fullsized":"2023-11-28T13:01:29.604092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.600039+0000","last_change":"2023-11-28T13:01:29.613446+0000","last_active":"2023-11-28T13:01:30.600039+0000","last_peered":"2023-11-28T13:01:30.600039+0000","last_clean":"2023-11-28T13:01:30.600039+0000","last_became_active":"2023-11-28T13:01:29.613188+0000","last_became_peered":"2023-11-28T13:01:29.613188+0000","last_unstale":"2023-11-28T13:01:30.600039+0000","last_undegraded":"2023-11-28T13:01:30.600039+0000","last_fullsized":"2023-11-28T13:01:30.600039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:27.779870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.600654+0000","last_change":"2023-11-28T13:01:29.238820+0000","last_active":"2023-11-28T13:01:29.600654+0000","last_peered":"2023-11-28T13:01:29.600654+0000","last_clean":"2023-11-28T13:01:29.600654+0000","last_became_active":"2023-11-28T13:01:29.238538+0000","last_became_peered":"2023-11-28T13:01:29.238538+0000","last_unstale":"2023-11-28T13:01:29.600654+0000","last_undegraded":"2023-11-28T13:01:29.600654+0000","last_fullsized":"2023-11-28T13:01:29.600654+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:08.725526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.607593+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:01:29.607593+0000","last_peered":"2023-11-28T13:01:29.607593+0000","last_clean":"2023-11-28T13:01:29.607593+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:01:29.607593+0000","last_undegraded":"2023-11-28T13:01:29.607593+0000","last_fullsized":"2023-11-28T13:01:29.607593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9668,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362172,"statfs":{"total":96636764160,"available":96626864128,"internally_reserved":0,"allocated":1044480,"data_stored":772045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.625},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.72199999999999998}]},{"osd":1,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":1.004}]},{"osd":2,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.86199999999999999}]},{"osd":3,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.95199999999999996}]},{"osd":4,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.90500000000000003}]},{"osd":5,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.081},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.272}]},{"osd":6,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.3100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8372,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363468,"statfs":{"total":96636764160,"available":96628191232,"internally_reserved":0,"allocated":438272,"data_stored":180625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.88300000000000001}]},{"osd":1,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.034},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.95899999999999996}]},{"osd":2,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.1559999999999999}]},{"osd":3,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.119}]},{"osd":4,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.095},{"interface":"front","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":10.566000000000001,"5min":10.566000000000001,"15min":10.566000000000001},"last":1.2310000000000001}]},{"osd":5,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.202}]},{"osd":7,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":3.4980000000000002,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":3.593,"5min":3.593,"15min":3.593},"last":1.1839999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8504,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363336,"statfs":{"total":96636764160,"available":96628056064,"internally_reserved":0,"allocated":442368,"data_stored":180171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":1.018}]},{"osd":1,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.92100000000000004}]},{"osd":2,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":1.232},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.1819999999999999}]},{"osd":3,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":1.097}]},{"osd":4,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.157}]},{"osd":6,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.0620000000000001}]},{"osd":7,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.98199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8632,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363208,"statfs":{"total":96636764160,"available":96627924992,"internally_reserved":0,"allocated":442368,"data_stored":180647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.69199999999999995}]},{"osd":1,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.81000000000000005}]},{"osd":2,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.85599999999999998}]},{"osd":3,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.97799999999999998}]},{"osd":5,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.23},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.006}]},{"osd":6,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":1.1839999999999999}]},{"osd":7,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.046},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.1359999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8576,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363264,"statfs":{"total":96636764160,"available":96627982336,"internally_reserved":0,"allocated":450560,"data_stored":181641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.47599999999999998}]},{"osd":1,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.70499999999999996}]},{"osd":2,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.60299999999999998}]},{"osd":4,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.877}]},{"osd":5,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.98599999999999999}]},{"osd":6,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.96099999999999997}]},{"osd":7,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.84199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8436,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363404,"statfs":{"total":96636764160,"available":96628125696,"internally_reserved":0,"allocated":438272,"data_stored":180129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59399999999999997}]},{"osd":1,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.52600000000000002}]},{"osd":3,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.75600000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.173}]},{"osd":5,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.014},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.88700000000000001}]},{"osd":6,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.141},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":1.0649999999999999}]},{"osd":7,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.0389999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8500,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363340,"statfs":{"total":96636764160,"available":96628060160,"internally_reserved":0,"allocated":438272,"data_stored":180149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.66400000000000003}]},{"osd":2,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.73899999999999999}]},{"osd":3,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.50700000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.002},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":0.69199999999999995}]},{"osd":5,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.84799999999999998}]},{"osd":6,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.0469999999999999}]},{"osd":7,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.91200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9592,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362248,"statfs":{"total":96636764160,"available":96626941952,"internally_reserved":0,"allocated":1032192,"data_stored":770461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.65000000000000002}]},{"osd":2,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.47699999999999998}]},{"osd":3,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.67200000000000004}]},{"osd":4,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.86599999999999999}]},{"osd":5,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.91000000000000003}]},{"osd":6,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.0840000000000001}]},{"osd":7,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":1.147},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.95799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:01:38.242 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:01:38.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.362+0000 7fd9fa032700 1 Processor -- start 2023-11-28T13:01:38.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.362+0000 7fd9fa032700 1 -- start start 2023-11-28T13:01:38.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.362+0000 7fd9fa032700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd9f4160b20 0x7fd9f40ad710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:38.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.362+0000 7fd9fa032700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f40ae090 con 0x7fd9f40703e0 2023-11-28T13:01:38.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.362+0000 7fd9fa032700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f40ce680 con 0x7fd9f40adc50 2023-11-28T13:01:38.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.362+0000 7fd9fa032700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f4069c60 con 0x7fd9f4160b20 2023-11-28T13:01:38.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.362+0000 7fd9f37fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd9f40703e0 0x7fd9f40707b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48390/0 (socket says 172.21.15.82:48390) 2023-11-28T13:01:38.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.362+0000 7fd9f37fe700 1 -- 172.21.15.82:0/2635221078 learned_addr learned my addr 172.21.15.82:0/2635221078 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:38.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.362+0000 7fd9f2ffd700 1 --2- 172.21.15.82:0/2635221078 >> v2:172.21.15.114:3300/0 conn(0x7fd9f4160b20 0x7fd9f40ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:38.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.362+0000 7fd9f27fc700 1 -- 172.21.15.82:0/2635221078 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570764684 0 0) 0x7fd9f40ae090 con 0x7fd9f40703e0 2023-11-28T13:01:38.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.362+0000 7fd9f27fc700 1 -- 172.21.15.82:0/2635221078 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9dc0035d0 con 0x7fd9f40703e0 2023-11-28T13:01:38.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.362+0000 7fd9f2ffd700 1 -- 172.21.15.82:0/2635221078 >> v1:172.21.15.114:6789/0 conn(0x7fd9f40adc50 legacy=0x7fd9f40ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:38.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.362+0000 7fd9f2ffd700 1 -- 172.21.15.82:0/2635221078 >> v1:172.21.15.82:6789/0 conn(0x7fd9f40703e0 legacy=0x7fd9f40707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:38.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.362+0000 7fd9f2ffd700 1 -- 172.21.15.82:0/2635221078 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f4069f40 con 0x7fd9f4160b20 2023-11-28T13:01:38.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.362+0000 7fd9f2ffd700 1 --2- 172.21.15.82:0/2635221078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9f4160b20 0x7fd9f40ad710 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec009d90 tx=0x7fd9ec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8db14a6cae5765bf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:38.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.362+0000 7fd9f27fc700 1 -- 172.21.15.82:0/2635221078 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec00e070 con 0x7fd9f4160b20 2023-11-28T13:01:38.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.362+0000 7fd9f27fc700 1 -- 172.21.15.82:0/2635221078 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ec00bb20 con 0x7fd9f4160b20 2023-11-28T13:01:38.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.362+0000 7fd9f27fc700 1 -- 172.21.15.82:0/2635221078 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec012430 con 0x7fd9f4160b20 2023-11-28T13:01:38.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.366+0000 7fd9fa032700 1 -- 172.21.15.82:0/2635221078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9f4160b20 msgr2=0x7fd9f40ad710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:38.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.366+0000 7fd9fa032700 1 --2- 172.21.15.82:0/2635221078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9f4160b20 0x7fd9f40ad710 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec009d90 tx=0x7fd9ec00b330 comp rx=0 tx=0).stop 2023-11-28T13:01:38.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.366+0000 7fd9fa032700 1 -- 172.21.15.82:0/2635221078 shutdown_connections 2023-11-28T13:01:38.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.366+0000 7fd9fa032700 1 --2- 172.21.15.82:0/2635221078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9f4160b20 0x7fd9f40ad710 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:38.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.366+0000 7fd9fa032700 1 -- 172.21.15.82:0/2635221078 >> 172.21.15.82:0/2635221078 conn(0x7fd9f40ce9b0 msgr2=0x7fd9f40ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:38.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.366+0000 7fd9fa032700 1 -- 172.21.15.82:0/2635221078 shutdown_connections 2023-11-28T13:01:38.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.366+0000 7fd9fa032700 1 -- 172.21.15.82:0/2635221078 wait complete. 2023-11-28T13:01:38.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.366+0000 7fd9fa032700 1 Processor -- start 2023-11-28T13:01:38.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.366+0000 7fd9fa032700 1 -- start start 2023-11-28T13:01:38.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.366+0000 7fd9fa032700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f40703e0 0x7fd9f415f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:38.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.366+0000 7fd9fa032700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9f40adc50 0x7fd9f40c4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:38.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.366+0000 7fd9fa032700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f4160b20 0x7fd9f415c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:38.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.366+0000 7fd9fa032700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40b2db0 con 0x7fd9f40703e0 2023-11-28T13:01:38.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.366+0000 7fd9fa032700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40c43e0 con 0x7fd9f40adc50 2023-11-28T13:01:38.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.366+0000 7fd9fa032700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f415d0e0 con 0x7fd9f4160b20 2023-11-28T13:01:38.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.366+0000 7fd9f37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f40703e0 0x7fd9f415f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:38.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.366+0000 7fd9f37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f40703e0 0x7fd9f415f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59626/0 (socket says 172.21.15.82:59626) 2023-11-28T13:01:38.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.366+0000 7fd9f37fe700 1 -- 172.21.15.82:0/2939274045 learned_addr learned my addr 172.21.15.82:0/2939274045 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:38.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.366+0000 7fd9f2ffd700 1 --2- 172.21.15.82:0/2939274045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9f40adc50 0x7fd9f40c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:38.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.366+0000 7fd9f3fff700 1 --2- 172.21.15.82:0/2939274045 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f4160b20 0x7fd9f415c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:38.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.370+0000 7fd9f37fe700 1 -- 172.21.15.82:0/2939274045 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f4160b20 msgr2=0x7fd9f415c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:38.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.370+0000 7fd9f37fe700 1 --2- 172.21.15.82:0/2939274045 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f4160b20 0x7fd9f415c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:38.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.370+0000 7fd9f37fe700 1 -- 172.21.15.82:0/2939274045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9f40adc50 msgr2=0x7fd9f40c4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:38.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.370+0000 7fd9f37fe700 1 --2- 172.21.15.82:0/2939274045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9f40adc50 0x7fd9f40c4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:38.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.370+0000 7fd9f37fe700 1 -- 172.21.15.82:0/2939274045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ec009a70 con 0x7fd9f40703e0 2023-11-28T13:01:38.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.370+0000 7fd9f37fe700 1 --2- 172.21.15.82:0/2939274045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f40703e0 0x7fd9f415f9a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800c500 tx=0x7fd9e800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:38.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.370+0000 7fd9dbfff700 1 -- 172.21.15.82:0/2939274045 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8005d90 con 0x7fd9f40703e0 2023-11-28T13:01:38.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.370+0000 7fd9dbfff700 1 -- 172.21.15.82:0/2939274045 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e80070d0 con 0x7fd9f40703e0 2023-11-28T13:01:38.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.370+0000 7fd9dbfff700 1 -- 172.21.15.82:0/2939274045 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8007480 con 0x7fd9f40703e0 2023-11-28T13:01:38.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.370+0000 7fd9fa032700 1 -- 172.21.15.82:0/2939274045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f406a500 con 0x7fd9f40703e0 2023-11-28T13:01:38.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.370+0000 7fd9fa032700 1 -- 172.21.15.82:0/2939274045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f406a220 con 0x7fd9f40703e0 2023-11-28T13:01:38.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.370+0000 7fd9fa032700 1 -- 172.21.15.82:0/2939274045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f406a7e0 con 0x7fd9f40703e0 2023-11-28T13:01:38.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.374+0000 7fd9dbfff700 1 -- 172.21.15.82:0/2939274045 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd9e8019030 con 0x7fd9f40703e0 2023-11-28T13:01:38.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.374+0000 7fd9dbfff700 1 --2- 172.21.15.82:0/2939274045 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9e0064f10 0x7fd9e00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:38.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.374+0000 7fd9dbfff700 1 -- 172.21.15.82:0/2939274045 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd9e8081280 con 0x7fd9f40703e0 2023-11-28T13:01:38.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.374+0000 7fd9f2ffd700 1 --2- 172.21.15.82:0/2939274045 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9e0064f10 0x7fd9e00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:38.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.374+0000 7fd9f2ffd700 1 --2- 172.21.15.82:0/2939274045 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9e0064f10 0x7fd9e00673c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4160f10 tx=0x7fd9ec011000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:38.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.382+0000 7fd9dbfff700 1 -- 172.21.15.82:0/2939274045 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd9e804f330 con 0x7fd9f40703e0 2023-11-28T13:01:38.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.542+0000 7fd9fa032700 1 -- 172.21.15.82:0/2939274045 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9f40c4520 con 0x7fd9e0064f10 2023-11-28T13:01:38.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.558+0000 7fd9dbfff700 1 -- 172.21.15.82:0/2939274045 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309768 (secure 0 0 0) 0x7fd9ec003d50 con 0x7fd9e0064f10 2023-11-28T13:01:38.569 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:38.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.562+0000 7fd9fa032700 1 -- 172.21.15.82:0/2939274045 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9e0064f10 msgr2=0x7fd9e00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:38.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.562+0000 7fd9fa032700 1 --2- 172.21.15.82:0/2939274045 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9e0064f10 0x7fd9e00673c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4160f10 tx=0x7fd9ec011000 comp rx=0 tx=0).stop 2023-11-28T13:01:38.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.562+0000 7fd9fa032700 1 -- 172.21.15.82:0/2939274045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f40703e0 msgr2=0x7fd9f415f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:38.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.562+0000 7fd9fa032700 1 --2- 172.21.15.82:0/2939274045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f40703e0 0x7fd9f415f9a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800c500 tx=0x7fd9e800c810 comp rx=0 tx=0).stop 2023-11-28T13:01:38.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.566+0000 7fd9fa032700 1 -- 172.21.15.82:0/2939274045 shutdown_connections 2023-11-28T13:01:38.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.566+0000 7fd9fa032700 1 --2- 172.21.15.82:0/2939274045 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9e0064f10 0x7fd9e00673c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:38.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.566+0000 7fd9fa032700 1 --2- 172.21.15.82:0/2939274045 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f4160b20 0x7fd9f415c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:38.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.566+0000 7fd9fa032700 1 --2- 172.21.15.82:0/2939274045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9f40adc50 0x7fd9f40c4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:38.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.566+0000 7fd9fa032700 1 --2- 172.21.15.82:0/2939274045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f40703e0 0x7fd9f415f9a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:38.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.566+0000 7fd9fa032700 1 -- 172.21.15.82:0/2939274045 >> 172.21.15.82:0/2939274045 conn(0x7fd9f40ce9b0 msgr2=0x7fd9f406d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:38.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.566+0000 7fd9fa032700 1 -- 172.21.15.82:0/2939274045 shutdown_connections 2023-11-28T13:01:38.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.566+0000 7fd9fa032700 1 -- 172.21.15.82:0/2939274045 wait complete. 2023-11-28T13:01:38.572 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:01:38.584 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-11-28T13:01:37.179931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":70280,"kb_used_data":4616,"kb_used_omap":0,"kb_used_meta":65600,"kb_avail":754904440,"statfs":{"total":773094113280,"available":773022146560,"internally_reserved":0,"allocated":4726784,"data_stored":2625868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":67174400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.966788"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.019488+0000","last_change":"2023-11-28T13:01:29.612573+0000","last_active":"2023-11-28T13:01:31.019488+0000","last_peered":"2023-11-28T13:01:31.019488+0000","last_clean":"2023-11-28T13:01:31.019488+0000","last_became_active":"2023-11-28T13:01:29.612318+0000","last_became_peered":"2023-11-28T13:01:29.612318+0000","last_unstale":"2023-11-28T13:01:31.019488+0000","last_undegraded":"2023-11-28T13:01:31.019488+0000","last_fullsized":"2023-11-28T13:01:31.019488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:26.374397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.019141+0000","last_change":"2023-11-28T13:01:29.617086+0000","last_active":"2023-11-28T13:01:31.019141+0000","last_peered":"2023-11-28T13:01:31.019141+0000","last_clean":"2023-11-28T13:01:31.019141+0000","last_became_active":"2023-11-28T13:01:29.616817+0000","last_became_peered":"2023-11-28T13:01:29.616817+0000","last_unstale":"2023-11-28T13:01:31.019141+0000","last_undegraded":"2023-11-28T13:01:31.019141+0000","last_fullsized":"2023-11-28T13:01:31.019141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:55:59.390386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.020608+0000","last_change":"2023-11-28T13:01:29.624649+0000","last_active":"2023-11-28T13:01:31.020608+0000","last_peered":"2023-11-28T13:01:31.020608+0000","last_clean":"2023-11-28T13:01:31.020608+0000","last_became_active":"2023-11-28T13:01:29.624347+0000","last_became_peered":"2023-11-28T13:01:29.624347+0000","last_unstale":"2023-11-28T13:01:31.020608+0000","last_undegraded":"2023-11-28T13:01:31.020608+0000","last_fullsized":"2023-11-28T13:01:31.020608+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:31.598116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.595991+0000","last_change":"2023-11-28T13:01:29.632299+0000","last_active":"2023-11-28T13:01:30.595991+0000","last_peered":"2023-11-28T13:01:30.595991+0000","last_clean":"2023-11-28T13:01:30.595991+0000","last_became_active":"2023-11-28T13:01:29.631942+0000","last_became_peered":"2023-11-28T13:01:29.631942+0000","last_unstale":"2023-11-28T13:01:30.595991+0000","last_undegraded":"2023-11-28T13:01:30.595991+0000","last_fullsized":"2023-11-28T13:01:30.595991+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:17.865464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.596045+0000","last_change":"2023-11-28T13:01:29.629415+0000","last_active":"2023-11-28T13:01:30.596045+0000","last_peered":"2023-11-28T13:01:30.596045+0000","last_clean":"2023-11-28T13:01:30.596045+0000","last_became_active":"2023-11-28T13:01:29.629116+0000","last_became_peered":"2023-11-28T13:01:29.629116+0000","last_unstale":"2023-11-28T13:01:30.596045+0000","last_undegraded":"2023-11-28T13:01:30.596045+0000","last_fullsized":"2023-11-28T13:01:30.596045+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:01.100881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.018277+0000","last_change":"2023-11-28T13:01:29.607265+0000","last_active":"2023-11-28T13:01:31.018277+0000","last_peered":"2023-11-28T13:01:31.018277+0000","last_clean":"2023-11-28T13:01:31.018277+0000","last_became_active":"2023-11-28T13:01:29.607007+0000","last_became_peered":"2023-11-28T13:01:29.607007+0000","last_unstale":"2023-11-28T13:01:31.018277+0000","last_undegraded":"2023-11-28T13:01:31.018277+0000","last_fullsized":"2023-11-28T13:01:31.018277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:50:48.744668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.598077+0000","last_change":"2023-11-28T13:01:29.622341+0000","last_active":"2023-11-28T13:01:30.598077+0000","last_peered":"2023-11-28T13:01:30.598077+0000","last_clean":"2023-11-28T13:01:30.598077+0000","last_became_active":"2023-11-28T13:01:29.621924+0000","last_became_peered":"2023-11-28T13:01:29.621924+0000","last_unstale":"2023-11-28T13:01:30.598077+0000","last_undegraded":"2023-11-28T13:01:30.598077+0000","last_fullsized":"2023-11-28T13:01:30.598077+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:43:59.891152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.019729+0000","last_change":"2023-11-28T13:01:29.621805+0000","last_active":"2023-11-28T13:01:31.019729+0000","last_peered":"2023-11-28T13:01:31.019729+0000","last_clean":"2023-11-28T13:01:31.019729+0000","last_became_active":"2023-11-28T13:01:29.621535+0000","last_became_peered":"2023-11-28T13:01:29.621535+0000","last_unstale":"2023-11-28T13:01:31.019729+0000","last_undegraded":"2023-11-28T13:01:31.019729+0000","last_fullsized":"2023-11-28T13:01:31.019729+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:50.377067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.020818+0000","last_change":"2023-11-28T13:01:29.621682+0000","last_active":"2023-11-28T13:01:31.020818+0000","last_peered":"2023-11-28T13:01:31.020818+0000","last_clean":"2023-11-28T13:01:31.020818+0000","last_became_active":"2023-11-28T13:01:29.621426+0000","last_became_peered":"2023-11-28T13:01:29.621426+0000","last_unstale":"2023-11-28T13:01:31.020818+0000","last_undegraded":"2023-11-28T13:01:31.020818+0000","last_fullsized":"2023-11-28T13:01:31.020818+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:50:48.744668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.599722+0000","last_change":"2023-11-28T13:01:29.617196+0000","last_active":"2023-11-28T13:01:30.599722+0000","last_peered":"2023-11-28T13:01:30.599722+0000","last_clean":"2023-11-28T13:01:30.599722+0000","last_became_active":"2023-11-28T13:01:29.616930+0000","last_became_peered":"2023-11-28T13:01:29.616930+0000","last_unstale":"2023-11-28T13:01:30.599722+0000","last_undegraded":"2023-11-28T13:01:30.599722+0000","last_fullsized":"2023-11-28T13:01:30.599722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:14.159846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.599924+0000","last_change":"2023-11-28T13:01:29.617192+0000","last_active":"2023-11-28T13:01:30.599924+0000","last_peered":"2023-11-28T13:01:30.599924+0000","last_clean":"2023-11-28T13:01:30.599924+0000","last_became_active":"2023-11-28T13:01:29.616202+0000","last_became_peered":"2023-11-28T13:01:29.616202+0000","last_unstale":"2023-11-28T13:01:30.599924+0000","last_undegraded":"2023-11-28T13:01:30.599924+0000","last_fullsized":"2023-11-28T13:01:30.599924+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:55:59.390386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017505+0000","last_change":"2023-11-28T13:01:29.619077+0000","last_active":"2023-11-28T13:01:31.017505+0000","last_peered":"2023-11-28T13:01:31.017505+0000","last_clean":"2023-11-28T13:01:31.017505+0000","last_became_active":"2023-11-28T13:01:29.618799+0000","last_became_peered":"2023-11-28T13:01:29.618799+0000","last_unstale":"2023-11-28T13:01:31.017505+0000","last_undegraded":"2023-11-28T13:01:31.017505+0000","last_fullsized":"2023-11-28T13:01:31.017505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:49:55.310389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.599401+0000","last_change":"2023-11-28T13:01:29.618015+0000","last_active":"2023-11-28T13:01:30.599401+0000","last_peered":"2023-11-28T13:01:30.599401+0000","last_clean":"2023-11-28T13:01:30.599401+0000","last_became_active":"2023-11-28T13:01:29.617727+0000","last_became_peered":"2023-11-28T13:01:29.617727+0000","last_unstale":"2023-11-28T13:01:30.599401+0000","last_undegraded":"2023-11-28T13:01:30.599401+0000","last_fullsized":"2023-11-28T13:01:30.599401+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:27.779870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017381+0000","last_change":"2023-11-28T13:01:29.622956+0000","last_active":"2023-11-28T13:01:31.017381+0000","last_peered":"2023-11-28T13:01:31.017381+0000","last_clean":"2023-11-28T13:01:31.017381+0000","last_became_active":"2023-11-28T13:01:29.622703+0000","last_became_peered":"2023-11-28T13:01:29.622703+0000","last_unstale":"2023-11-28T13:01:31.017381+0000","last_undegraded":"2023-11-28T13:01:31.017381+0000","last_fullsized":"2023-11-28T13:01:31.017381+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:01:07.652325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.598323+0000","last_change":"2023-11-28T13:01:29.621971+0000","last_active":"2023-11-28T13:01:30.598323+0000","last_peered":"2023-11-28T13:01:30.598323+0000","last_clean":"2023-11-28T13:01:30.598323+0000","last_became_active":"2023-11-28T13:01:29.620123+0000","last_became_peered":"2023-11-28T13:01:29.620123+0000","last_unstale":"2023-11-28T13:01:30.598323+0000","last_undegraded":"2023-11-28T13:01:30.598323+0000","last_fullsized":"2023-11-28T13:01:30.598323+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:00.647375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.598369+0000","last_change":"2023-11-28T13:01:29.621123+0000","last_active":"2023-11-28T13:01:30.598369+0000","last_peered":"2023-11-28T13:01:30.598369+0000","last_clean":"2023-11-28T13:01:30.598369+0000","last_became_active":"2023-11-28T13:01:29.620697+0000","last_became_peered":"2023-11-28T13:01:29.620697+0000","last_unstale":"2023-11-28T13:01:30.598369+0000","last_undegraded":"2023-11-28T13:01:30.598369+0000","last_fullsized":"2023-11-28T13:01:30.598369+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:46:46.127788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.601049+0000","last_change":"2023-11-28T13:01:29.625739+0000","last_active":"2023-11-28T13:01:30.601049+0000","last_peered":"2023-11-28T13:01:30.601049+0000","last_clean":"2023-11-28T13:01:30.601049+0000","last_became_active":"2023-11-28T13:01:29.625420+0000","last_became_peered":"2023-11-28T13:01:29.625420+0000","last_unstale":"2023-11-28T13:01:30.601049+0000","last_undegraded":"2023-11-28T13:01:30.601049+0000","last_fullsized":"2023-11-28T13:01:30.601049+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:50:48.744668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017262+0000","last_change":"2023-11-28T13:01:29.623557+0000","last_active":"2023-11-28T13:01:31.017262+0000","last_peered":"2023-11-28T13:01:31.017262+0000","last_clean":"2023-11-28T13:01:31.017262+0000","last_became_active":"2023-11-28T13:01:29.623269+0000","last_became_peered":"2023-11-28T13:01:29.623269+0000","last_unstale":"2023-11-28T13:01:31.017262+0000","last_undegraded":"2023-11-28T13:01:31.017262+0000","last_fullsized":"2023-11-28T13:01:31.017262+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:23.976550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.596285+0000","last_change":"2023-11-28T13:01:29.620341+0000","last_active":"2023-11-28T13:01:30.596285+0000","last_peered":"2023-11-28T13:01:30.596285+0000","last_clean":"2023-11-28T13:01:30.596285+0000","last_became_active":"2023-11-28T13:01:29.620054+0000","last_became_peered":"2023-11-28T13:01:29.620054+0000","last_unstale":"2023-11-28T13:01:30.596285+0000","last_undegraded":"2023-11-28T13:01:30.596285+0000","last_fullsized":"2023-11-28T13:01:30.596285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:02.717064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017982+0000","last_change":"2023-11-28T13:01:29.616295+0000","last_active":"2023-11-28T13:01:31.017982+0000","last_peered":"2023-11-28T13:01:31.017982+0000","last_clean":"2023-11-28T13:01:31.017982+0000","last_became_active":"2023-11-28T13:01:29.616024+0000","last_became_peered":"2023-11-28T13:01:29.616024+0000","last_unstale":"2023-11-28T13:01:31.017982+0000","last_undegraded":"2023-11-28T13:01:31.017982+0000","last_fullsized":"2023-11-28T13:01:31.017982+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:41.542245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.598544+0000","last_change":"2023-11-28T13:01:29.615417+0000","last_active":"2023-11-28T13:01:30.598544+0000","last_peered":"2023-11-28T13:01:30.598544+0000","last_clean":"2023-11-28T13:01:30.598544+0000","last_became_active":"2023-11-28T13:01:29.609734+0000","last_became_peered":"2023-11-28T13:01:29.609734+0000","last_unstale":"2023-11-28T13:01:30.598544+0000","last_undegraded":"2023-11-28T13:01:30.598544+0000","last_fullsized":"2023-11-28T13:01:30.598544+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:38:46.060418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.018262+0000","last_change":"2023-11-28T13:01:29.625629+0000","last_active":"2023-11-28T13:01:31.018262+0000","last_peered":"2023-11-28T13:01:31.018262+0000","last_clean":"2023-11-28T13:01:31.018262+0000","last_became_active":"2023-11-28T13:01:29.625352+0000","last_became_peered":"2023-11-28T13:01:29.625352+0000","last_unstale":"2023-11-28T13:01:31.018262+0000","last_undegraded":"2023-11-28T13:01:31.018262+0000","last_fullsized":"2023-11-28T13:01:31.018262+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:31.598116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.598428+0000","last_change":"2023-11-28T13:01:29.618987+0000","last_active":"2023-11-28T13:01:30.598428+0000","last_peered":"2023-11-28T13:01:30.598428+0000","last_clean":"2023-11-28T13:01:30.598428+0000","last_became_active":"2023-11-28T13:01:29.618714+0000","last_became_peered":"2023-11-28T13:01:29.618714+0000","last_unstale":"2023-11-28T13:01:30.598428+0000","last_undegraded":"2023-11-28T13:01:30.598428+0000","last_fullsized":"2023-11-28T13:01:30.598428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:31.598116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.595644+0000","last_change":"2023-11-28T13:01:29.613743+0000","last_active":"2023-11-28T13:01:30.595644+0000","last_peered":"2023-11-28T13:01:30.595644+0000","last_clean":"2023-11-28T13:01:30.595644+0000","last_became_active":"2023-11-28T13:01:29.613508+0000","last_became_peered":"2023-11-28T13:01:29.613508+0000","last_unstale":"2023-11-28T13:01:30.595644+0000","last_undegraded":"2023-11-28T13:01:30.595644+0000","last_fullsized":"2023-11-28T13:01:30.595644+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:41.542245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.016812+0000","last_change":"2023-11-28T13:01:29.617021+0000","last_active":"2023-11-28T13:01:31.016812+0000","last_peered":"2023-11-28T13:01:31.016812+0000","last_clean":"2023-11-28T13:01:31.016812+0000","last_became_active":"2023-11-28T13:01:29.616773+0000","last_became_peered":"2023-11-28T13:01:29.616773+0000","last_unstale":"2023-11-28T13:01:31.016812+0000","last_undegraded":"2023-11-28T13:01:31.016812+0000","last_fullsized":"2023-11-28T13:01:31.016812+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:09.651953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.019859+0000","last_change":"2023-11-28T13:01:29.626968+0000","last_active":"2023-11-28T13:01:31.019859+0000","last_peered":"2023-11-28T13:01:31.019859+0000","last_clean":"2023-11-28T13:01:31.019859+0000","last_became_active":"2023-11-28T13:01:29.626737+0000","last_became_peered":"2023-11-28T13:01:29.626737+0000","last_unstale":"2023-11-28T13:01:31.019859+0000","last_undegraded":"2023-11-28T13:01:31.019859+0000","last_fullsized":"2023-11-28T13:01:31.019859+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:49:03.891545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017001+0000","last_change":"2023-11-28T13:01:29.616071+0000","last_active":"2023-11-28T13:01:31.017001+0000","last_peered":"2023-11-28T13:01:31.017001+0000","last_clean":"2023-11-28T13:01:31.017001+0000","last_became_active":"2023-11-28T13:01:29.615787+0000","last_became_peered":"2023-11-28T13:01:29.615787+0000","last_unstale":"2023-11-28T13:01:31.017001+0000","last_undegraded":"2023-11-28T13:01:31.017001+0000","last_fullsized":"2023-11-28T13:01:31.017001+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:02.717064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.599646+0000","last_change":"2023-11-28T13:01:29.615182+0000","last_active":"2023-11-28T13:01:30.599646+0000","last_peered":"2023-11-28T13:01:30.599646+0000","last_clean":"2023-11-28T13:01:30.599646+0000","last_became_active":"2023-11-28T13:01:29.609494+0000","last_became_peered":"2023-11-28T13:01:29.609494+0000","last_unstale":"2023-11-28T13:01:30.599646+0000","last_undegraded":"2023-11-28T13:01:30.599646+0000","last_fullsized":"2023-11-28T13:01:30.599646+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:01:07.652325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.016760+0000","last_change":"2023-11-28T13:01:29.615462+0000","last_active":"2023-11-28T13:01:31.016760+0000","last_peered":"2023-11-28T13:01:31.016760+0000","last_clean":"2023-11-28T13:01:31.016760+0000","last_became_active":"2023-11-28T13:01:29.615080+0000","last_became_peered":"2023-11-28T13:01:29.615080+0000","last_unstale":"2023-11-28T13:01:31.016760+0000","last_undegraded":"2023-11-28T13:01:31.016760+0000","last_fullsized":"2023-11-28T13:01:31.016760+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:53:43.787266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.016442+0000","last_change":"2023-11-28T13:01:29.606596+0000","last_active":"2023-11-28T13:01:31.016442+0000","last_peered":"2023-11-28T13:01:31.016442+0000","last_clean":"2023-11-28T13:01:31.016442+0000","last_became_active":"2023-11-28T13:01:29.606272+0000","last_became_peered":"2023-11-28T13:01:29.606272+0000","last_unstale":"2023-11-28T13:01:31.016442+0000","last_undegraded":"2023-11-28T13:01:31.016442+0000","last_fullsized":"2023-11-28T13:01:31.016442+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:48.142047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.598658+0000","last_change":"2023-11-28T13:01:29.614302+0000","last_active":"2023-11-28T13:01:30.598658+0000","last_peered":"2023-11-28T13:01:30.598658+0000","last_clean":"2023-11-28T13:01:30.598658+0000","last_became_active":"2023-11-28T13:01:29.613934+0000","last_became_peered":"2023-11-28T13:01:29.613934+0000","last_unstale":"2023-11-28T13:01:30.598658+0000","last_undegraded":"2023-11-28T13:01:30.598658+0000","last_fullsized":"2023-11-28T13:01:30.598658+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:49:55.310389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.018138+0000","last_change":"2023-11-28T13:01:29.616490+0000","last_active":"2023-11-28T13:01:31.018138+0000","last_peered":"2023-11-28T13:01:31.018138+0000","last_clean":"2023-11-28T13:01:31.018138+0000","last_became_active":"2023-11-28T13:01:29.616167+0000","last_became_peered":"2023-11-28T13:01:29.616167+0000","last_unstale":"2023-11-28T13:01:31.018138+0000","last_undegraded":"2023-11-28T13:01:31.018138+0000","last_fullsized":"2023-11-28T13:01:31.018138+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:18.132890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.600608+0000","last_change":"2023-11-28T13:01:29.620968+0000","last_active":"2023-11-28T13:01:30.600608+0000","last_peered":"2023-11-28T13:01:30.600608+0000","last_clean":"2023-11-28T13:01:30.600608+0000","last_became_active":"2023-11-28T13:01:29.620583+0000","last_became_peered":"2023-11-28T13:01:29.620583+0000","last_unstale":"2023-11-28T13:01:30.600608+0000","last_undegraded":"2023-11-28T13:01:30.600608+0000","last_fullsized":"2023-11-28T13:01:30.600608+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:55:59.390386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.628699+0000","last_change":"2023-11-28T13:01:29.235318+0000","last_active":"2023-11-28T13:01:29.628699+0000","last_peered":"2023-11-28T13:01:29.628699+0000","last_clean":"2023-11-28T13:01:29.628699+0000","last_became_active":"2023-11-28T13:01:29.235039+0000","last_became_peered":"2023-11-28T13:01:29.235039+0000","last_unstale":"2023-11-28T13:01:29.628699+0000","last_undegraded":"2023-11-28T13:01:29.628699+0000","last_fullsized":"2023-11-28T13:01:29.628699+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:10.621678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.019151+0000","last_change":"2023-11-28T13:01:29.624879+0000","last_active":"2023-11-28T13:01:31.019151+0000","last_peered":"2023-11-28T13:01:31.019151+0000","last_clean":"2023-11-28T13:01:31.019151+0000","last_became_active":"2023-11-28T13:01:29.624578+0000","last_became_peered":"2023-11-28T13:01:29.624578+0000","last_unstale":"2023-11-28T13:01:31.019151+0000","last_undegraded":"2023-11-28T13:01:31.019151+0000","last_fullsized":"2023-11-28T13:01:31.019151+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:46:46.127788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.625435+0000","last_change":"2023-11-28T13:01:29.235468+0000","last_active":"2023-11-28T13:01:29.625435+0000","last_peered":"2023-11-28T13:01:29.625435+0000","last_clean":"2023-11-28T13:01:29.625435+0000","last_became_active":"2023-11-28T13:01:29.235176+0000","last_became_peered":"2023-11-28T13:01:29.235176+0000","last_unstale":"2023-11-28T13:01:29.625435+0000","last_undegraded":"2023-11-28T13:01:29.625435+0000","last_fullsized":"2023-11-28T13:01:29.625435+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:12.505253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017870+0000","last_change":"2023-11-28T13:01:29.617048+0000","last_active":"2023-11-28T13:01:31.017870+0000","last_peered":"2023-11-28T13:01:31.017870+0000","last_clean":"2023-11-28T13:01:31.017870+0000","last_became_active":"2023-11-28T13:01:29.616430+0000","last_became_peered":"2023-11-28T13:01:29.616430+0000","last_unstale":"2023-11-28T13:01:31.017870+0000","last_undegraded":"2023-11-28T13:01:31.017870+0000","last_fullsized":"2023-11-28T13:01:31.017870+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:38:46.060418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.632346+0000","last_change":"2023-11-28T13:01:29.233323+0000","last_active":"2023-11-28T13:01:29.632346+0000","last_peered":"2023-11-28T13:01:29.632346+0000","last_clean":"2023-11-28T13:01:29.632346+0000","last_became_active":"2023-11-28T13:01:29.233004+0000","last_became_peered":"2023-11-28T13:01:29.233004+0000","last_unstale":"2023-11-28T13:01:29.632346+0000","last_undegraded":"2023-11-28T13:01:29.632346+0000","last_fullsized":"2023-11-28T13:01:29.632346+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:16.854220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.019369+0000","last_change":"2023-11-28T13:01:29.618080+0000","last_active":"2023-11-28T13:01:31.019369+0000","last_peered":"2023-11-28T13:01:31.019369+0000","last_clean":"2023-11-28T13:01:31.019369+0000","last_became_active":"2023-11-28T13:01:29.617750+0000","last_became_peered":"2023-11-28T13:01:29.617750+0000","last_unstale":"2023-11-28T13:01:31.019369+0000","last_undegraded":"2023-11-28T13:01:31.019369+0000","last_fullsized":"2023-11-28T13:01:31.019369+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:00.647375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.628017+0000","last_change":"2023-11-28T13:01:29.238492+0000","last_active":"2023-11-28T13:01:29.628017+0000","last_peered":"2023-11-28T13:01:29.628017+0000","last_clean":"2023-11-28T13:01:29.628017+0000","last_became_active":"2023-11-28T13:01:29.238215+0000","last_became_peered":"2023-11-28T13:01:29.238215+0000","last_unstale":"2023-11-28T13:01:29.628017+0000","last_undegraded":"2023-11-28T13:01:29.628017+0000","last_fullsized":"2023-11-28T13:01:29.628017+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:15:15.549631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017011+0000","last_change":"2023-11-28T13:01:29.614047+0000","last_active":"2023-11-28T13:01:31.017011+0000","last_peered":"2023-11-28T13:01:31.017011+0000","last_clean":"2023-11-28T13:01:31.017011+0000","last_became_active":"2023-11-28T13:01:29.613804+0000","last_became_peered":"2023-11-28T13:01:29.613804+0000","last_unstale":"2023-11-28T13:01:31.017011+0000","last_undegraded":"2023-11-28T13:01:31.017011+0000","last_fullsized":"2023-11-28T13:01:31.017011+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:55:59.390386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.625647+0000","last_change":"2023-11-28T13:01:29.235088+0000","last_active":"2023-11-28T13:01:29.625647+0000","last_peered":"2023-11-28T13:01:29.625647+0000","last_clean":"2023-11-28T13:01:29.625647+0000","last_became_active":"2023-11-28T13:01:29.234778+0000","last_became_peered":"2023-11-28T13:01:29.234778+0000","last_unstale":"2023-11-28T13:01:29.625647+0000","last_undegraded":"2023-11-28T13:01:29.625647+0000","last_fullsized":"2023-11-28T13:01:29.625647+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:09:46.508882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.598557+0000","last_change":"2023-11-28T13:01:29.620026+0000","last_active":"2023-11-28T13:01:30.598557+0000","last_peered":"2023-11-28T13:01:30.598557+0000","last_clean":"2023-11-28T13:01:30.598557+0000","last_became_active":"2023-11-28T13:01:29.619675+0000","last_became_peered":"2023-11-28T13:01:29.619675+0000","last_unstale":"2023-11-28T13:01:30.598557+0000","last_undegraded":"2023-11-28T13:01:30.598557+0000","last_fullsized":"2023-11-28T13:01:30.598557+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:51:19.589153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.630928+0000","last_change":"2023-11-28T13:01:29.234311+0000","last_active":"2023-11-28T13:01:29.630928+0000","last_peered":"2023-11-28T13:01:29.630928+0000","last_clean":"2023-11-28T13:01:29.630928+0000","last_became_active":"2023-11-28T13:01:29.233940+0000","last_became_peered":"2023-11-28T13:01:29.233940+0000","last_unstale":"2023-11-28T13:01:29.630928+0000","last_undegraded":"2023-11-28T13:01:29.630928+0000","last_fullsized":"2023-11-28T13:01:29.630928+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:47.130802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017876+0000","last_change":"2023-11-28T13:01:29.626235+0000","last_active":"2023-11-28T13:01:31.017876+0000","last_peered":"2023-11-28T13:01:31.017876+0000","last_clean":"2023-11-28T13:01:31.017876+0000","last_became_active":"2023-11-28T13:01:29.625813+0000","last_became_peered":"2023-11-28T13:01:29.625813+0000","last_unstale":"2023-11-28T13:01:31.017876+0000","last_undegraded":"2023-11-28T13:01:31.017876+0000","last_fullsized":"2023-11-28T13:01:31.017876+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:26.374397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.602947+0000","last_change":"2023-11-28T13:01:29.240694+0000","last_active":"2023-11-28T13:01:29.602947+0000","last_peered":"2023-11-28T13:01:29.602947+0000","last_clean":"2023-11-28T13:01:29.602947+0000","last_became_active":"2023-11-28T13:01:29.240381+0000","last_became_peered":"2023-11-28T13:01:29.240381+0000","last_unstale":"2023-11-28T13:01:29.602947+0000","last_undegraded":"2023-11-28T13:01:29.602947+0000","last_fullsized":"2023-11-28T13:01:29.602947+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:19.124556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.018629+0000","last_change":"2023-11-28T13:01:29.612131+0000","last_active":"2023-11-28T13:01:31.018629+0000","last_peered":"2023-11-28T13:01:31.018629+0000","last_clean":"2023-11-28T13:01:31.018629+0000","last_became_active":"2023-11-28T13:01:29.611875+0000","last_became_peered":"2023-11-28T13:01:29.611875+0000","last_unstale":"2023-11-28T13:01:31.018629+0000","last_undegraded":"2023-11-28T13:01:31.018629+0000","last_fullsized":"2023-11-28T13:01:31.018629+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:38:46.060418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.605227+0000","last_change":"2023-11-28T13:01:29.228753+0000","last_active":"2023-11-28T13:01:29.605227+0000","last_peered":"2023-11-28T13:01:29.605227+0000","last_clean":"2023-11-28T13:01:29.605227+0000","last_became_active":"2023-11-28T13:01:29.228454+0000","last_became_peered":"2023-11-28T13:01:29.228454+0000","last_unstale":"2023-11-28T13:01:29.605227+0000","last_undegraded":"2023-11-28T13:01:29.605227+0000","last_fullsized":"2023-11-28T13:01:29.605227+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:55.167964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.596099+0000","last_change":"2023-11-28T13:01:29.616825+0000","last_active":"2023-11-28T13:01:30.596099+0000","last_peered":"2023-11-28T13:01:30.596099+0000","last_clean":"2023-11-28T13:01:30.596099+0000","last_became_active":"2023-11-28T13:01:29.616530+0000","last_became_peered":"2023-11-28T13:01:29.616530+0000","last_unstale":"2023-11-28T13:01:30.596099+0000","last_undegraded":"2023-11-28T13:01:30.596099+0000","last_fullsized":"2023-11-28T13:01:30.596099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:48.142047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.600242+0000","last_change":"2023-11-28T13:01:29.238933+0000","last_active":"2023-11-28T13:01:29.600242+0000","last_peered":"2023-11-28T13:01:29.600242+0000","last_clean":"2023-11-28T13:01:29.600242+0000","last_became_active":"2023-11-28T13:01:29.238678+0000","last_became_peered":"2023-11-28T13:01:29.238678+0000","last_unstale":"2023-11-28T13:01:29.600242+0000","last_undegraded":"2023-11-28T13:01:29.600242+0000","last_fullsized":"2023-11-28T13:01:29.600242+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:12.505253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.600728+0000","last_change":"2023-11-28T13:01:29.616974+0000","last_active":"2023-11-28T13:01:30.600728+0000","last_peered":"2023-11-28T13:01:30.600728+0000","last_clean":"2023-11-28T13:01:30.600728+0000","last_became_active":"2023-11-28T13:01:29.616662+0000","last_became_peered":"2023-11-28T13:01:29.616662+0000","last_unstale":"2023-11-28T13:01:30.600728+0000","last_undegraded":"2023-11-28T13:01:30.600728+0000","last_fullsized":"2023-11-28T13:01:30.600728+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:50.980296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.597918+0000","last_change":"2023-11-28T13:01:29.240013+0000","last_active":"2023-11-28T13:01:29.597918+0000","last_peered":"2023-11-28T13:01:29.597918+0000","last_clean":"2023-11-28T13:01:29.597918+0000","last_became_active":"2023-11-28T13:01:29.239717+0000","last_became_peered":"2023-11-28T13:01:29.239717+0000","last_unstale":"2023-11-28T13:01:29.597918+0000","last_undegraded":"2023-11-28T13:01:29.597918+0000","last_fullsized":"2023-11-28T13:01:29.597918+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:35.486834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.020782+0000","last_change":"2023-11-28T13:01:29.612440+0000","last_active":"2023-11-28T13:01:31.020782+0000","last_peered":"2023-11-28T13:01:31.020782+0000","last_clean":"2023-11-28T13:01:31.020782+0000","last_became_active":"2023-11-28T13:01:29.612156+0000","last_became_peered":"2023-11-28T13:01:29.612156+0000","last_unstale":"2023-11-28T13:01:31.020782+0000","last_undegraded":"2023-11-28T13:01:31.020782+0000","last_fullsized":"2023-11-28T13:01:31.020782+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:14.159846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.628147+0000","last_change":"2023-11-28T13:01:29.238090+0000","last_active":"2023-11-28T13:01:29.628147+0000","last_peered":"2023-11-28T13:01:29.628147+0000","last_clean":"2023-11-28T13:01:29.628147+0000","last_became_active":"2023-11-28T13:01:29.237838+0000","last_became_peered":"2023-11-28T13:01:29.237838+0000","last_unstale":"2023-11-28T13:01:29.628147+0000","last_undegraded":"2023-11-28T13:01:29.628147+0000","last_fullsized":"2023-11-28T13:01:29.628147+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:06.881393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.018353+0000","last_change":"2023-11-28T13:01:29.617989+0000","last_active":"2023-11-28T13:01:31.018353+0000","last_peered":"2023-11-28T13:01:31.018353+0000","last_clean":"2023-11-28T13:01:31.018353+0000","last_became_active":"2023-11-28T13:01:29.617733+0000","last_became_peered":"2023-11-28T13:01:29.617733+0000","last_unstale":"2023-11-28T13:01:31.018353+0000","last_undegraded":"2023-11-28T13:01:31.018353+0000","last_fullsized":"2023-11-28T13:01:31.018353+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:27.779870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.629961+0000","last_change":"2023-11-28T13:01:29.237869+0000","last_active":"2023-11-28T13:01:29.629961+0000","last_peered":"2023-11-28T13:01:29.629961+0000","last_clean":"2023-11-28T13:01:29.629961+0000","last_became_active":"2023-11-28T13:01:29.237534+0000","last_became_peered":"2023-11-28T13:01:29.237534+0000","last_unstale":"2023-11-28T13:01:29.629961+0000","last_undegraded":"2023-11-28T13:01:29.629961+0000","last_fullsized":"2023-11-28T13:01:29.629961+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:35.486834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017036+0000","last_change":"2023-11-28T13:01:29.622023+0000","last_active":"2023-11-28T13:01:31.017036+0000","last_peered":"2023-11-28T13:01:31.017036+0000","last_clean":"2023-11-28T13:01:31.017036+0000","last_became_active":"2023-11-28T13:01:29.621762+0000","last_became_peered":"2023-11-28T13:01:29.621762+0000","last_unstale":"2023-11-28T13:01:31.017036+0000","last_undegraded":"2023-11-28T13:01:31.017036+0000","last_fullsized":"2023-11-28T13:01:31.017036+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:50.377067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.616678+0000","last_change":"2023-11-28T13:01:29.235730+0000","last_active":"2023-11-28T13:01:29.616678+0000","last_peered":"2023-11-28T13:01:29.616678+0000","last_clean":"2023-11-28T13:01:29.616678+0000","last_became_active":"2023-11-28T13:01:29.235456+0000","last_became_peered":"2023-11-28T13:01:29.235456+0000","last_unstale":"2023-11-28T13:01:29.616678+0000","last_undegraded":"2023-11-28T13:01:29.616678+0000","last_fullsized":"2023-11-28T13:01:29.616678+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:06.881393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.018572+0000","last_change":"2023-11-28T13:01:29.612720+0000","last_active":"2023-11-28T13:01:31.018572+0000","last_peered":"2023-11-28T13:01:31.018572+0000","last_clean":"2023-11-28T13:01:31.018572+0000","last_became_active":"2023-11-28T13:01:29.612468+0000","last_became_peered":"2023-11-28T13:01:29.612468+0000","last_unstale":"2023-11-28T13:01:31.018572+0000","last_undegraded":"2023-11-28T13:01:31.018572+0000","last_fullsized":"2023-11-28T13:01:31.018572+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:27.779870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.604368+0000","last_change":"2023-11-28T13:01:29.235872+0000","last_active":"2023-11-28T13:01:29.604368+0000","last_peered":"2023-11-28T13:01:29.604368+0000","last_clean":"2023-11-28T13:01:29.604368+0000","last_became_active":"2023-11-28T13:01:29.235614+0000","last_became_peered":"2023-11-28T13:01:29.235614+0000","last_unstale":"2023-11-28T13:01:29.604368+0000","last_undegraded":"2023-11-28T13:01:29.604368+0000","last_fullsized":"2023-11-28T13:01:29.604368+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:34.884855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.599111+0000","last_change":"2023-11-28T13:01:29.618010+0000","last_active":"2023-11-28T13:01:30.599111+0000","last_peered":"2023-11-28T13:01:30.599111+0000","last_clean":"2023-11-28T13:01:30.599111+0000","last_became_active":"2023-11-28T13:01:29.617768+0000","last_became_peered":"2023-11-28T13:01:29.617768+0000","last_unstale":"2023-11-28T13:01:30.599111+0000","last_undegraded":"2023-11-28T13:01:30.599111+0000","last_fullsized":"2023-11-28T13:01:30.599111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:50.377067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.606966+0000","last_change":"2023-11-28T13:01:29.232087+0000","last_active":"2023-11-28T13:01:29.606966+0000","last_peered":"2023-11-28T13:01:29.606966+0000","last_clean":"2023-11-28T13:01:29.606966+0000","last_became_active":"2023-11-28T13:01:29.231827+0000","last_became_peered":"2023-11-28T13:01:29.231827+0000","last_unstale":"2023-11-28T13:01:29.606966+0000","last_undegraded":"2023-11-28T13:01:29.606966+0000","last_fullsized":"2023-11-28T13:01:29.606966+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:15:31.600456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.018777+0000","last_change":"2023-11-28T13:01:29.617659+0000","last_active":"2023-11-28T13:01:31.018777+0000","last_peered":"2023-11-28T13:01:31.018777+0000","last_clean":"2023-11-28T13:01:31.018777+0000","last_became_active":"2023-11-28T13:01:29.617274+0000","last_became_peered":"2023-11-28T13:01:29.617274+0000","last_unstale":"2023-11-28T13:01:31.018777+0000","last_undegraded":"2023-11-28T13:01:31.018777+0000","last_fullsized":"2023-11-28T13:01:31.018777+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:50.980296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.630900+0000","last_change":"2023-11-28T13:01:29.234651+0000","last_active":"2023-11-28T13:01:29.630900+0000","last_peered":"2023-11-28T13:01:29.630900+0000","last_clean":"2023-11-28T13:01:29.630900+0000","last_became_active":"2023-11-28T13:01:29.234354+0000","last_became_peered":"2023-11-28T13:01:29.234354+0000","last_unstale":"2023-11-28T13:01:29.630900+0000","last_undegraded":"2023-11-28T13:01:29.630900+0000","last_fullsized":"2023-11-28T13:01:29.630900+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:16.854220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.019357+0000","last_change":"2023-11-28T13:01:29.619877+0000","last_active":"2023-11-28T13:01:31.019357+0000","last_peered":"2023-11-28T13:01:31.019357+0000","last_clean":"2023-11-28T13:01:31.019357+0000","last_became_active":"2023-11-28T13:01:29.619639+0000","last_became_peered":"2023-11-28T13:01:29.619639+0000","last_unstale":"2023-11-28T13:01:31.019357+0000","last_undegraded":"2023-11-28T13:01:31.019357+0000","last_fullsized":"2023-11-28T13:01:31.019357+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:01:07.652325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.631348+0000","last_change":"2023-11-28T13:01:29.239337+0000","last_active":"2023-11-28T13:01:29.631348+0000","last_peered":"2023-11-28T13:01:29.631348+0000","last_clean":"2023-11-28T13:01:29.631348+0000","last_became_active":"2023-11-28T13:01:29.239047+0000","last_became_peered":"2023-11-28T13:01:29.239047+0000","last_unstale":"2023-11-28T13:01:29.631348+0000","last_undegraded":"2023-11-28T13:01:29.631348+0000","last_fullsized":"2023-11-28T13:01:29.631348+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:08.725526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.599945+0000","last_change":"2023-11-28T13:01:29.609457+0000","last_active":"2023-11-28T13:01:30.599945+0000","last_peered":"2023-11-28T13:01:30.599945+0000","last_clean":"2023-11-28T13:01:30.599945+0000","last_became_active":"2023-11-28T13:01:29.609146+0000","last_became_peered":"2023-11-28T13:01:29.609146+0000","last_unstale":"2023-11-28T13:01:30.599945+0000","last_undegraded":"2023-11-28T13:01:30.599945+0000","last_fullsized":"2023-11-28T13:01:30.599945+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:26.374397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.627935+0000","last_change":"2023-11-28T13:01:29.234537+0000","last_active":"2023-11-28T13:01:29.627935+0000","last_peered":"2023-11-28T13:01:29.627935+0000","last_clean":"2023-11-28T13:01:29.627935+0000","last_became_active":"2023-11-28T13:01:29.234282+0000","last_became_peered":"2023-11-28T13:01:29.234282+0000","last_unstale":"2023-11-28T13:01:29.627935+0000","last_undegraded":"2023-11-28T13:01:29.627935+0000","last_fullsized":"2023-11-28T13:01:29.627935+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:22:36.945966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017613+0000","last_change":"2023-11-28T13:01:29.617207+0000","last_active":"2023-11-28T13:01:31.017613+0000","last_peered":"2023-11-28T13:01:31.017613+0000","last_clean":"2023-11-28T13:01:31.017613+0000","last_became_active":"2023-11-28T13:01:29.616740+0000","last_became_peered":"2023-11-28T13:01:29.616740+0000","last_unstale":"2023-11-28T13:01:31.017613+0000","last_undegraded":"2023-11-28T13:01:31.017613+0000","last_fullsized":"2023-11-28T13:01:31.017613+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:49:55.310389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.626248+0000","last_change":"2023-11-28T13:01:29.240381+0000","last_active":"2023-11-28T13:01:29.626248+0000","last_peered":"2023-11-28T13:01:29.626248+0000","last_clean":"2023-11-28T13:01:29.626248+0000","last_became_active":"2023-11-28T13:01:29.235778+0000","last_became_peered":"2023-11-28T13:01:29.235778+0000","last_unstale":"2023-11-28T13:01:29.626248+0000","last_undegraded":"2023-11-28T13:01:29.626248+0000","last_fullsized":"2023-11-28T13:01:29.626248+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:50.711987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.596414+0000","last_change":"2023-11-28T13:01:29.617898+0000","last_active":"2023-11-28T13:01:30.596414+0000","last_peered":"2023-11-28T13:01:30.596414+0000","last_clean":"2023-11-28T13:01:30.596414+0000","last_became_active":"2023-11-28T13:01:29.617400+0000","last_became_peered":"2023-11-28T13:01:29.617400+0000","last_unstale":"2023-11-28T13:01:30.596414+0000","last_undegraded":"2023-11-28T13:01:30.596414+0000","last_fullsized":"2023-11-28T13:01:30.596414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:09.651953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.602363+0000","last_change":"2023-11-28T13:01:29.236854+0000","last_active":"2023-11-28T13:01:29.602363+0000","last_peered":"2023-11-28T13:01:29.602363+0000","last_clean":"2023-11-28T13:01:29.602363+0000","last_became_active":"2023-11-28T13:01:29.236603+0000","last_became_peered":"2023-11-28T13:01:29.236603+0000","last_unstale":"2023-11-28T13:01:29.602363+0000","last_undegraded":"2023-11-28T13:01:29.602363+0000","last_fullsized":"2023-11-28T13:01:29.602363+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:47.130802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.598781+0000","last_change":"2023-11-28T13:01:29.614605+0000","last_active":"2023-11-28T13:01:30.598781+0000","last_peered":"2023-11-28T13:01:30.598781+0000","last_clean":"2023-11-28T13:01:30.598781+0000","last_became_active":"2023-11-28T13:01:29.613943+0000","last_became_peered":"2023-11-28T13:01:29.613943+0000","last_unstale":"2023-11-28T13:01:30.598781+0000","last_undegraded":"2023-11-28T13:01:30.598781+0000","last_fullsized":"2023-11-28T13:01:30.598781+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:14.159846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.625857+0000","last_change":"2023-11-28T13:01:29.234946+0000","last_active":"2023-11-28T13:01:29.625857+0000","last_peered":"2023-11-28T13:01:29.625857+0000","last_clean":"2023-11-28T13:01:29.625857+0000","last_became_active":"2023-11-28T13:01:29.234651+0000","last_became_peered":"2023-11-28T13:01:29.234651+0000","last_unstale":"2023-11-28T13:01:29.625857+0000","last_undegraded":"2023-11-28T13:01:29.625857+0000","last_fullsized":"2023-11-28T13:01:29.625857+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:33.041552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.020280+0000","last_change":"2023-11-28T13:01:29.612454+0000","last_active":"2023-11-28T13:01:31.020280+0000","last_peered":"2023-11-28T13:01:31.020280+0000","last_clean":"2023-11-28T13:01:31.020280+0000","last_became_active":"2023-11-28T13:01:29.612188+0000","last_became_peered":"2023-11-28T13:01:29.612188+0000","last_unstale":"2023-11-28T13:01:31.020280+0000","last_undegraded":"2023-11-28T13:01:31.020280+0000","last_fullsized":"2023-11-28T13:01:31.020280+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:27.779870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.612022+0000","last_change":"2023-11-28T13:01:29.233140+0000","last_active":"2023-11-28T13:01:29.612022+0000","last_peered":"2023-11-28T13:01:29.612022+0000","last_clean":"2023-11-28T13:01:29.612022+0000","last_became_active":"2023-11-28T13:01:29.232886+0000","last_became_peered":"2023-11-28T13:01:29.232886+0000","last_unstale":"2023-11-28T13:01:29.612022+0000","last_undegraded":"2023-11-28T13:01:29.612022+0000","last_fullsized":"2023-11-28T13:01:29.612022+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:15:31.600456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.598507+0000","last_change":"2023-11-28T13:01:29.616437+0000","last_active":"2023-11-28T13:01:30.598507+0000","last_peered":"2023-11-28T13:01:30.598507+0000","last_clean":"2023-11-28T13:01:30.598507+0000","last_became_active":"2023-11-28T13:01:29.616062+0000","last_became_peered":"2023-11-28T13:01:29.616062+0000","last_unstale":"2023-11-28T13:01:30.598507+0000","last_undegraded":"2023-11-28T13:01:30.598507+0000","last_fullsized":"2023-11-28T13:01:30.598507+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:50.980296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.599701+0000","last_change":"2023-11-28T13:01:29.235345+0000","last_active":"2023-11-28T13:01:29.599701+0000","last_peered":"2023-11-28T13:01:29.599701+0000","last_clean":"2023-11-28T13:01:29.599701+0000","last_became_active":"2023-11-28T13:01:29.233917+0000","last_became_peered":"2023-11-28T13:01:29.233917+0000","last_unstale":"2023-11-28T13:01:29.599701+0000","last_undegraded":"2023-11-28T13:01:29.599701+0000","last_fullsized":"2023-11-28T13:01:29.599701+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:19.124556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.018895+0000","last_change":"2023-11-28T13:01:29.612054+0000","last_active":"2023-11-28T13:01:31.018895+0000","last_peered":"2023-11-28T13:01:31.018895+0000","last_clean":"2023-11-28T13:01:31.018895+0000","last_became_active":"2023-11-28T13:01:29.611791+0000","last_became_peered":"2023-11-28T13:01:29.611791+0000","last_unstale":"2023-11-28T13:01:31.018895+0000","last_undegraded":"2023-11-28T13:01:31.018895+0000","last_fullsized":"2023-11-28T13:01:31.018895+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:31.598116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.611314+0000","last_change":"2023-11-28T13:01:29.236633+0000","last_active":"2023-11-28T13:01:29.611314+0000","last_peered":"2023-11-28T13:01:29.611314+0000","last_clean":"2023-11-28T13:01:29.611314+0000","last_became_active":"2023-11-28T13:01:29.236353+0000","last_became_peered":"2023-11-28T13:01:29.236353+0000","last_unstale":"2023-11-28T13:01:29.611314+0000","last_undegraded":"2023-11-28T13:01:29.611314+0000","last_fullsized":"2023-11-28T13:01:29.611314+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:06:16.368208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.599721+0000","last_change":"2023-11-28T13:01:29.616664+0000","last_active":"2023-11-28T13:01:30.599721+0000","last_peered":"2023-11-28T13:01:30.599721+0000","last_clean":"2023-11-28T13:01:30.599721+0000","last_became_active":"2023-11-28T13:01:29.615630+0000","last_became_peered":"2023-11-28T13:01:29.615630+0000","last_unstale":"2023-11-28T13:01:30.599721+0000","last_undegraded":"2023-11-28T13:01:30.599721+0000","last_fullsized":"2023-11-28T13:01:30.599721+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:29:48.103969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.599267+0000","last_change":"2023-11-28T13:01:29.234500+0000","last_active":"2023-11-28T13:01:29.599267+0000","last_peered":"2023-11-28T13:01:29.599267+0000","last_clean":"2023-11-28T13:01:29.599267+0000","last_became_active":"2023-11-28T13:01:29.234169+0000","last_became_peered":"2023-11-28T13:01:29.234169+0000","last_unstale":"2023-11-28T13:01:29.599267+0000","last_undegraded":"2023-11-28T13:01:29.599267+0000","last_fullsized":"2023-11-28T13:01:29.599267+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:34.884855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.598051+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:01:29.598051+0000","last_peered":"2023-11-28T13:01:29.598051+0000","last_clean":"2023-11-28T13:01:29.598051+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:01:29.598051+0000","last_undegraded":"2023-11-28T13:01:29.598051+0000","last_fullsized":"2023-11-28T13:01:29.598051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.598128+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:01:29.598128+0000","last_peered":"2023-11-28T13:01:29.598128+0000","last_clean":"2023-11-28T13:01:29.598128+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:01:29.598128+0000","last_undegraded":"2023-11-28T13:01:29.598128+0000","last_fullsized":"2023-11-28T13:01:29.598128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.019243+0000","last_change":"2023-11-28T13:01:29.621465+0000","last_active":"2023-11-28T13:01:31.019243+0000","last_peered":"2023-11-28T13:01:31.019243+0000","last_clean":"2023-11-28T13:01:31.019243+0000","last_became_active":"2023-11-28T13:01:29.621234+0000","last_became_peered":"2023-11-28T13:01:29.621234+0000","last_unstale":"2023-11-28T13:01:31.019243+0000","last_undegraded":"2023-11-28T13:01:31.019243+0000","last_fullsized":"2023-11-28T13:01:31.019243+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:27:06.312034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.626176+0000","last_change":"2023-11-28T13:01:29.238864+0000","last_active":"2023-11-28T13:01:29.626176+0000","last_peered":"2023-11-28T13:01:29.626176+0000","last_clean":"2023-11-28T13:01:29.626176+0000","last_became_active":"2023-11-28T13:01:29.238612+0000","last_became_peered":"2023-11-28T13:01:29.238612+0000","last_unstale":"2023-11-28T13:01:29.626176+0000","last_undegraded":"2023-11-28T13:01:29.626176+0000","last_fullsized":"2023-11-28T13:01:29.626176+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:32:12.505253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.596819+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:01:29.596819+0000","last_peered":"2023-11-28T13:01:29.596819+0000","last_clean":"2023-11-28T13:01:29.596819+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:01:29.596819+0000","last_undegraded":"2023-11-28T13:01:29.596819+0000","last_fullsized":"2023-11-28T13:01:29.596819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.600907+0000","last_change":"2023-11-28T13:01:29.616842+0000","last_active":"2023-11-28T13:01:30.600907+0000","last_peered":"2023-11-28T13:01:30.600907+0000","last_clean":"2023-11-28T13:01:30.600907+0000","last_became_active":"2023-11-28T13:01:29.616553+0000","last_became_peered":"2023-11-28T13:01:29.616553+0000","last_unstale":"2023-11-28T13:01:30.600907+0000","last_undegraded":"2023-11-28T13:01:30.600907+0000","last_fullsized":"2023-11-28T13:01:30.600907+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:49:03.891545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.596346+0000","last_change":"2023-11-28T13:01:29.240513+0000","last_active":"2023-11-28T13:01:30.596346+0000","last_peered":"2023-11-28T13:01:30.596346+0000","last_clean":"2023-11-28T13:01:30.596346+0000","last_became_active":"2023-11-28T13:01:29.240210+0000","last_became_peered":"2023-11-28T13:01:29.240210+0000","last_unstale":"2023-11-28T13:01:30.596346+0000","last_undegraded":"2023-11-28T13:01:30.596346+0000","last_fullsized":"2023-11-28T13:01:30.596346+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:10.621678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.611279+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:01:29.611279+0000","last_peered":"2023-11-28T13:01:29.611279+0000","last_clean":"2023-11-28T13:01:29.611279+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:01:29.611279+0000","last_undegraded":"2023-11-28T13:01:29.611279+0000","last_fullsized":"2023-11-28T13:01:29.611279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.019380+0000","last_change":"2023-11-28T13:01:29.629449+0000","last_active":"2023-11-28T13:01:31.019380+0000","last_peered":"2023-11-28T13:01:31.019380+0000","last_clean":"2023-11-28T13:01:31.019380+0000","last_became_active":"2023-11-28T13:01:29.629160+0000","last_became_peered":"2023-11-28T13:01:29.629160+0000","last_unstale":"2023-11-28T13:01:31.019380+0000","last_undegraded":"2023-11-28T13:01:31.019380+0000","last_fullsized":"2023-11-28T13:01:31.019380+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:49:55.310389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.598733+0000","last_change":"2023-11-28T13:01:29.236952+0000","last_active":"2023-11-28T13:01:29.598733+0000","last_peered":"2023-11-28T13:01:29.598733+0000","last_clean":"2023-11-28T13:01:29.598733+0000","last_became_active":"2023-11-28T13:01:29.236677+0000","last_became_peered":"2023-11-28T13:01:29.236677+0000","last_unstale":"2023-11-28T13:01:29.598733+0000","last_undegraded":"2023-11-28T13:01:29.598733+0000","last_fullsized":"2023-11-28T13:01:29.598733+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:11:06.881393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.597046+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:01:29.597046+0000","last_peered":"2023-11-28T13:01:29.597046+0000","last_clean":"2023-11-28T13:01:29.597046+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:01:29.597046+0000","last_undegraded":"2023-11-28T13:01:29.597046+0000","last_fullsized":"2023-11-28T13:01:29.597046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017290+0000","last_change":"2023-11-28T13:01:29.614272+0000","last_active":"2023-11-28T13:01:31.017290+0000","last_peered":"2023-11-28T13:01:31.017290+0000","last_clean":"2023-11-28T13:01:31.017290+0000","last_became_active":"2023-11-28T13:01:29.609788+0000","last_became_peered":"2023-11-28T13:01:29.609788+0000","last_unstale":"2023-11-28T13:01:31.017290+0000","last_undegraded":"2023-11-28T13:01:31.017290+0000","last_fullsized":"2023-11-28T13:01:31.017290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:50.980296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.598469+0000","last_change":"2023-11-28T13:01:29.238339+0000","last_active":"2023-11-28T13:01:29.598469+0000","last_peered":"2023-11-28T13:01:29.598469+0000","last_clean":"2023-11-28T13:01:29.598469+0000","last_became_active":"2023-11-28T13:01:29.238074+0000","last_became_peered":"2023-11-28T13:01:29.238074+0000","last_unstale":"2023-11-28T13:01:29.598469+0000","last_undegraded":"2023-11-28T13:01:29.598469+0000","last_fullsized":"2023-11-28T13:01:29.598469+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:08.725526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.602452+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:01:29.602452+0000","last_peered":"2023-11-28T13:01:29.602452+0000","last_clean":"2023-11-28T13:01:29.602452+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:01:29.602452+0000","last_undegraded":"2023-11-28T13:01:29.602452+0000","last_fullsized":"2023-11-28T13:01:29.602452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.018136+0000","last_change":"2023-11-28T13:01:29.614958+0000","last_active":"2023-11-28T13:01:31.018136+0000","last_peered":"2023-11-28T13:01:31.018136+0000","last_clean":"2023-11-28T13:01:31.018136+0000","last_became_active":"2023-11-28T13:01:29.614711+0000","last_became_peered":"2023-11-28T13:01:29.614711+0000","last_unstale":"2023-11-28T13:01:31.018136+0000","last_undegraded":"2023-11-28T13:01:31.018136+0000","last_fullsized":"2023-11-28T13:01:31.018136+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:15:16.560876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.610684+0000","last_change":"2023-11-28T13:01:29.237421+0000","last_active":"2023-11-28T13:01:29.610684+0000","last_peered":"2023-11-28T13:01:29.610684+0000","last_clean":"2023-11-28T13:01:29.610684+0000","last_became_active":"2023-11-28T13:01:29.237074+0000","last_became_peered":"2023-11-28T13:01:29.237074+0000","last_unstale":"2023-11-28T13:01:29.610684+0000","last_undegraded":"2023-11-28T13:01:29.610684+0000","last_fullsized":"2023-11-28T13:01:29.610684+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:33.041552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.599716+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:01:29.599716+0000","last_peered":"2023-11-28T13:01:29.599716+0000","last_clean":"2023-11-28T13:01:29.599716+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:01:29.599716+0000","last_undegraded":"2023-11-28T13:01:29.599716+0000","last_fullsized":"2023-11-28T13:01:29.599716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:31.017605+0000","last_change":"2023-11-28T13:01:29.615807+0000","last_active":"2023-11-28T13:01:31.017605+0000","last_peered":"2023-11-28T13:01:31.017605+0000","last_clean":"2023-11-28T13:01:31.017605+0000","last_became_active":"2023-11-28T13:01:29.615507+0000","last_became_peered":"2023-11-28T13:01:29.615507+0000","last_unstale":"2023-11-28T13:01:31.017605+0000","last_undegraded":"2023-11-28T13:01:31.017605+0000","last_fullsized":"2023-11-28T13:01:31.017605+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:00.647375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.605236+0000","last_change":"2023-11-28T13:01:29.238348+0000","last_active":"2023-11-28T13:01:29.605236+0000","last_peered":"2023-11-28T13:01:29.605236+0000","last_clean":"2023-11-28T13:01:29.605236+0000","last_became_active":"2023-11-28T13:01:29.238121+0000","last_became_peered":"2023-11-28T13:01:29.238121+0000","last_unstale":"2023-11-28T13:01:29.605236+0000","last_undegraded":"2023-11-28T13:01:29.605236+0000","last_fullsized":"2023-11-28T13:01:29.605236+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:17.121645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.604092+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:01:29.604092+0000","last_peered":"2023-11-28T13:01:29.604092+0000","last_clean":"2023-11-28T13:01:29.604092+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:01:29.604092+0000","last_undegraded":"2023-11-28T13:01:29.604092+0000","last_fullsized":"2023-11-28T13:01:29.604092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T13:01:30.600039+0000","last_change":"2023-11-28T13:01:29.613446+0000","last_active":"2023-11-28T13:01:30.600039+0000","last_peered":"2023-11-28T13:01:30.600039+0000","last_clean":"2023-11-28T13:01:30.600039+0000","last_became_active":"2023-11-28T13:01:29.613188+0000","last_became_peered":"2023-11-28T13:01:29.613188+0000","last_unstale":"2023-11-28T13:01:30.600039+0000","last_undegraded":"2023-11-28T13:01:30.600039+0000","last_fullsized":"2023-11-28T13:01:30.600039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:29.200289+0000","last_clean_scrub_stamp":"2023-11-28T13:01:29.200289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:27.779870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.600654+0000","last_change":"2023-11-28T13:01:29.238820+0000","last_active":"2023-11-28T13:01:29.600654+0000","last_peered":"2023-11-28T13:01:29.600654+0000","last_clean":"2023-11-28T13:01:29.600654+0000","last_became_active":"2023-11-28T13:01:29.238538+0000","last_became_peered":"2023-11-28T13:01:29.238538+0000","last_unstale":"2023-11-28T13:01:29.600654+0000","last_undegraded":"2023-11-28T13:01:29.600654+0000","last_fullsized":"2023-11-28T13:01:29.600654+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:01:28.189044+0000","last_clean_scrub_stamp":"2023-11-28T13:01:28.189044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:08.725526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T13:01:29.607593+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:01:29.607593+0000","last_peered":"2023-11-28T13:01:29.607593+0000","last_clean":"2023-11-28T13:01:29.607593+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:01:29.607593+0000","last_undegraded":"2023-11-28T13:01:29.607593+0000","last_fullsized":"2023-11-28T13:01:29.607593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9668,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362172,"statfs":{"total":96636764160,"available":96626864128,"internally_reserved":0,"allocated":1044480,"data_stored":772045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.625},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.72199999999999998}]},{"osd":1,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":1.004}]},{"osd":2,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.86199999999999999}]},{"osd":3,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.95199999999999996}]},{"osd":4,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.90500000000000003}]},{"osd":5,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.081},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.272}]},{"osd":6,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.3100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8372,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363468,"statfs":{"total":96636764160,"available":96628191232,"internally_reserved":0,"allocated":438272,"data_stored":180625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.88300000000000001}]},{"osd":1,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.034},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.95899999999999996}]},{"osd":2,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.1559999999999999}]},{"osd":3,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.119}]},{"osd":4,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.095},{"interface":"front","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":10.566000000000001,"5min":10.566000000000001,"15min":10.566000000000001},"last":1.2310000000000001}]},{"osd":5,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.202}]},{"osd":7,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":3.4980000000000002,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":3.593,"5min":3.593,"15min":3.593},"last":1.1839999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8504,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363336,"statfs":{"total":96636764160,"available":96628056064,"internally_reserved":0,"allocated":442368,"data_stored":180171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":1.018}]},{"osd":1,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.92100000000000004}]},{"osd":2,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":1.232},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.1819999999999999}]},{"osd":3,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":1.097}]},{"osd":4,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.157}]},{"osd":6,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.0620000000000001}]},{"osd":7,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.98199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8632,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363208,"statfs":{"total":96636764160,"available":96627924992,"internally_reserved":0,"allocated":442368,"data_stored":180647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.69199999999999995}]},{"osd":1,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.81000000000000005}]},{"osd":2,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.85599999999999998}]},{"osd":3,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.97799999999999998}]},{"osd":5,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.23},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.006}]},{"osd":6,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":1.1839999999999999}]},{"osd":7,"last update":"Tue Nov 28 13:01:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.046},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.1359999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8576,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363264,"statfs":{"total":96636764160,"available":96627982336,"internally_reserved":0,"allocated":450560,"data_stored":181641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.47599999999999998}]},{"osd":1,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.70499999999999996}]},{"osd":2,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.60299999999999998}]},{"osd":4,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.877}]},{"osd":5,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.98599999999999999}]},{"osd":6,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.96099999999999997}]},{"osd":7,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.84199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8436,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363404,"statfs":{"total":96636764160,"available":96628125696,"internally_reserved":0,"allocated":438272,"data_stored":180129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59399999999999997}]},{"osd":1,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.52600000000000002}]},{"osd":3,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.75600000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.173}]},{"osd":5,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.014},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.88700000000000001}]},{"osd":6,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.141},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":1.0649999999999999}]},{"osd":7,"last update":"Tue Nov 28 13:01:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.0389999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8500,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363340,"statfs":{"total":96636764160,"available":96628060160,"internally_reserved":0,"allocated":438272,"data_stored":180149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.66400000000000003}]},{"osd":2,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.73899999999999999}]},{"osd":3,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.50700000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.002},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":0.69199999999999995}]},{"osd":5,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.84799999999999998}]},{"osd":6,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.0469999999999999}]},{"osd":7,"last update":"Tue Nov 28 13:01:15 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.91200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9592,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362248,"statfs":{"total":96636764160,"available":96626941952,"internally_reserved":0,"allocated":1032192,"data_stored":770461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.65000000000000002}]},{"osd":2,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.47699999999999998}]},{"osd":3,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.67200000000000004}]},{"osd":4,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.86599999999999999}]},{"osd":5,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.91000000000000003}]},{"osd":6,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.0840000000000001}]},{"osd":7,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":1.147},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.95799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:01:38.590 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T13:01:38.590 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-28T13:01:38.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.710+0000 7ff682fb3700 1 Processor -- start 2023-11-28T13:01:38.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.710+0000 7ff682fb3700 1 -- start start 2023-11-28T13:01:38.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.710+0000 7ff682fb3700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff67c06c140 0x7ff67c0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:38.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.710+0000 7ff682fb3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff67c0d25b0 0x7ff67c06a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:38.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.710+0000 7ff682fb3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff67c069bc0 con 0x7ff67c0b1d10 2023-11-28T13:01:38.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.710+0000 7ff682fb3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff67c0d1480 con 0x7ff67c0d25b0 2023-11-28T13:01:38.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.710+0000 7ff682fb3700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff67c0cd280 con 0x7ff67c06c140 2023-11-28T13:01:38.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.710+0000 7ff6827b2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff67c0d25b0 0x7ff67c06a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:38.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.710+0000 7ff6827b2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff67c0d25b0 0x7ff67c06a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59632/0 (socket says 172.21.15.82:59632) 2023-11-28T13:01:38.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.710+0000 7ff6827b2700 1 -- 172.21.15.82:0/3583057651 learned_addr learned my addr 172.21.15.82:0/3583057651 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:38.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.710+0000 7ff681fb1700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff67c0b1d10 0x7ff67c06ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48394/0 (socket says 172.21.15.82:48394) 2023-11-28T13:01:38.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.710+0000 7ff6817b0700 1 --2- 172.21.15.82:0/3583057651 >> v2:172.21.15.114:3300/0 conn(0x7ff67c06c140 0x7ff67c0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:38.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.710+0000 7ff6827b2700 1 -- 172.21.15.82:0/3583057651 >> v2:172.21.15.114:3300/0 conn(0x7ff67c06c140 msgr2=0x7ff67c0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:38.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.710+0000 7ff6827b2700 1 --2- 172.21.15.82:0/3583057651 >> v2:172.21.15.114:3300/0 conn(0x7ff67c06c140 0x7ff67c0cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:38.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.714+0000 7ff6827b2700 1 -- 172.21.15.82:0/3583057651 >> v1:172.21.15.82:6789/0 conn(0x7ff67c0b1d10 legacy=0x7ff67c06ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:38.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.714+0000 7ff6827b2700 1 -- 172.21.15.82:0/3583057651 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67c0cd560 con 0x7ff67c0d25b0 2023-11-28T13:01:38.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.714+0000 7ff6817b0700 1 --2- 172.21.15.82:0/3583057651 >> v2:172.21.15.114:3300/0 conn(0x7ff67c06c140 0x7ff67c0cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:38.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.714+0000 7ff6827b2700 1 --2- 172.21.15.82:0/3583057651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c0d25b0 0x7ff67c06a050 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff67c0d2490 tx=0x7ff67400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e70099a21675f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:38.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.714+0000 7ff680faf700 1 -- 172.21.15.82:0/3583057651 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67400e070 con 0x7ff67c0d25b0 2023-11-28T13:01:38.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.714+0000 7ff680faf700 1 -- 172.21.15.82:0/3583057651 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67400b9c0 con 0x7ff67c0d25b0 2023-11-28T13:01:38.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.714+0000 7ff680faf700 1 -- 172.21.15.82:0/3583057651 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67400bd70 con 0x7ff67c0d25b0 2023-11-28T13:01:38.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.714+0000 7ff682fb3700 1 -- 172.21.15.82:0/3583057651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c0d25b0 msgr2=0x7ff67c06a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:38.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.714+0000 7ff682fb3700 1 --2- 172.21.15.82:0/3583057651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c0d25b0 0x7ff67c06a050 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff67c0d2490 tx=0x7ff67400b330 comp rx=0 tx=0).stop 2023-11-28T13:01:38.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.714+0000 7ff682fb3700 1 -- 172.21.15.82:0/3583057651 shutdown_connections 2023-11-28T13:01:38.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.714+0000 7ff682fb3700 1 --2- 172.21.15.82:0/3583057651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c0d25b0 0x7ff67c06a050 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:38.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.714+0000 7ff682fb3700 1 --2- 172.21.15.82:0/3583057651 >> v2:172.21.15.114:3300/0 conn(0x7ff67c06c140 0x7ff67c0cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:38.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.714+0000 7ff682fb3700 1 -- 172.21.15.82:0/3583057651 >> 172.21.15.82:0/3583057651 conn(0x7ff67c0b52a0 msgr2=0x7ff67c0d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:38.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.714+0000 7ff682fb3700 1 -- 172.21.15.82:0/3583057651 shutdown_connections 2023-11-28T13:01:38.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.714+0000 7ff682fb3700 1 -- 172.21.15.82:0/3583057651 wait complete. 2023-11-28T13:01:38.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff682fb3700 1 Processor -- start 2023-11-28T13:01:38.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff682fb3700 1 -- start start 2023-11-28T13:01:38.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff682fb3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c06c140 0x7ff67c15dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:38.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff682fb3700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff67c0b1d10 0x7ff67c1f10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:38.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff682fb3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c0d25b0 0x7ff67c0cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:38.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff682fb3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c151440 con 0x7ff67c0d25b0 2023-11-28T13:01:38.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff682fb3700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c15f4a0 con 0x7ff67c06c140 2023-11-28T13:01:38.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff682fb3700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c15d0f0 con 0x7ff67c0b1d10 2023-11-28T13:01:38.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff6827b2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c0d25b0 0x7ff67c0cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:38.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff6827b2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c0d25b0 0x7ff67c0cbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59642/0 (socket says 172.21.15.82:59642) 2023-11-28T13:01:38.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff6827b2700 1 -- 172.21.15.82:0/534206775 learned_addr learned my addr 172.21.15.82:0/534206775 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:38.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff681fb1700 1 --2- 172.21.15.82:0/534206775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c06c140 0x7ff67c15dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:38.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff6817b0700 1 --2- 172.21.15.82:0/534206775 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff67c0b1d10 0x7ff67c1f10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:38.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff6827b2700 1 -- 172.21.15.82:0/534206775 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff67c0b1d10 msgr2=0x7ff67c1f10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:38.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff6827b2700 1 --2- 172.21.15.82:0/534206775 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff67c0b1d10 0x7ff67c1f10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:38.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff6827b2700 1 -- 172.21.15.82:0/534206775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c06c140 msgr2=0x7ff67c15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:38.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff6827b2700 1 --2- 172.21.15.82:0/534206775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c06c140 0x7ff67c15dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:38.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff6827b2700 1 -- 172.21.15.82:0/534206775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff674009b30 con 0x7ff67c0d25b0 2023-11-28T13:01:38.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff6827b2700 1 --2- 172.21.15.82:0/534206775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c0d25b0 0x7ff67c0cbb50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff674012000 tx=0x7ff674004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:38.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff6727fc700 1 -- 172.21.15.82:0/534206775 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff674004880 con 0x7ff67c0d25b0 2023-11-28T13:01:38.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff6727fc700 1 -- 172.21.15.82:0/534206775 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6740092e0 con 0x7ff67c0d25b0 2023-11-28T13:01:38.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff6727fc700 1 -- 172.21.15.82:0/534206775 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67401b650 con 0x7ff67c0d25b0 2023-11-28T13:01:38.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff682fb3700 1 -- 172.21.15.82:0/534206775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67c0d1050 con 0x7ff67c0d25b0 2023-11-28T13:01:38.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.718+0000 7ff682fb3700 1 -- 172.21.15.82:0/534206775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff67c0b20e0 con 0x7ff67c0d25b0 2023-11-28T13:01:38.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.722+0000 7ff682fb3700 1 -- 172.21.15.82:0/534206775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67c0d11e0 con 0x7ff67c0d25b0 2023-11-28T13:01:38.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.722+0000 7ff6727fc700 1 -- 172.21.15.82:0/534206775 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff674021030 con 0x7ff67c0d25b0 2023-11-28T13:01:38.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.722+0000 7ff6727fc700 1 --2- 172.21.15.82:0/534206775 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff660064ee0 0x7ff660067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:38.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.722+0000 7ff6727fc700 1 -- 172.21.15.82:0/534206775 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff674083210 con 0x7ff67c0d25b0 2023-11-28T13:01:38.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.722+0000 7ff681fb1700 1 --2- 172.21.15.82:0/534206775 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff660064ee0 0x7ff660067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:38.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.722+0000 7ff681fb1700 1 --2- 172.21.15.82:0/534206775 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff660064ee0 0x7ff660067390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff66c000f60 tx=0x7ff66c007ef0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:38.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.730+0000 7ff6727fc700 1 -- 172.21.15.82:0/534206775 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff6740513b0 con 0x7ff67c0d25b0 2023-11-28T13:01:38.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.950+0000 7ff682fb3700 1 -- 172.21.15.82:0/534206775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7ff67c065fc0 con 0x7ff67c0d25b0 2023-11-28T13:01:38.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.958+0000 7ff6727fc700 1 -- 172.21.15.82:0/534206775 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff6740549d0 con 0x7ff67c0d25b0 2023-11-28T13:01:38.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.958+0000 7ff682fb3700 1 -- 172.21.15.82:0/534206775 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff660064ee0 msgr2=0x7ff660067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:38.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.958+0000 7ff682fb3700 1 --2- 172.21.15.82:0/534206775 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff660064ee0 0x7ff660067390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff66c000f60 tx=0x7ff66c007ef0 comp rx=0 tx=0).stop 2023-11-28T13:01:38.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.958+0000 7ff682fb3700 1 -- 172.21.15.82:0/534206775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c0d25b0 msgr2=0x7ff67c0cbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:38.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.958+0000 7ff682fb3700 1 --2- 172.21.15.82:0/534206775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c0d25b0 0x7ff67c0cbb50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff674012000 tx=0x7ff674004af0 comp rx=0 tx=0).stop 2023-11-28T13:01:38.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.958+0000 7ff682fb3700 1 -- 172.21.15.82:0/534206775 shutdown_connections 2023-11-28T13:01:38.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.958+0000 7ff682fb3700 1 --2- 172.21.15.82:0/534206775 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff660064ee0 0x7ff660067390 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:38.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.958+0000 7ff682fb3700 1 --2- 172.21.15.82:0/534206775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c0d25b0 0x7ff67c0cbb50 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:38.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.958+0000 7ff682fb3700 1 --2- 172.21.15.82:0/534206775 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff67c0b1d10 0x7ff67c1f10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:38.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.958+0000 7ff682fb3700 1 --2- 172.21.15.82:0/534206775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c06c140 0x7ff67c15dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:38.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.958+0000 7ff682fb3700 1 -- 172.21.15.82:0/534206775 >> 172.21.15.82:0/534206775 conn(0x7ff67c0b52a0 msgr2=0x7ff67c0b5940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:38.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.962+0000 7ff682fb3700 1 -- 172.21.15.82:0/534206775 shutdown_connections 2023-11-28T13:01:38.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:38.962+0000 7ff682fb3700 1 -- 172.21.15.82:0/534206775 wait complete. 2023-11-28T13:01:38.968 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2023-11-28T13:01:38.980 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:01:39.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.086+0000 7f35d9ea6700 1 Processor -- start 2023-11-28T13:01:39.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.086+0000 7f35d9ea6700 1 -- start start 2023-11-28T13:01:39.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d9ea6700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f35d415a3c0 0x7f35d40ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d9ea6700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f35d40b1c70 0x7f35d40700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d9ea6700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35d40705e0 0x7f35d40ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d9ea6700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d415a790 con 0x7f35d40b1c70 2023-11-28T13:01:39.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d9ea6700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d415de70 con 0x7f35d415a3c0 2023-11-28T13:01:39.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d9ea6700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d4070a00 con 0x7f35d40705e0 2023-11-28T13:01:39.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d2ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f35d40b1c70 0x7f35d40700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d2ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f35d40b1c70 0x7f35d40700a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59644/0 (socket says 172.21.15.82:59644) 2023-11-28T13:01:39.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d2ffd700 1 -- 172.21.15.82:0/2741097502 learned_addr learned my addr 172.21.15.82:0/2741097502 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:39.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d3fff700 1 --2- 172.21.15.82:0/2741097502 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35d40705e0 0x7f35d40ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d37fe700 1 --2- 172.21.15.82:0/2741097502 >> v2:172.21.15.114:3300/0 conn(0x7f35d415a3c0 0x7f35d40ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d2ffd700 1 -- 172.21.15.82:0/2741097502 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35d40705e0 msgr2=0x7f35d40ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:39.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d2ffd700 1 --2- 172.21.15.82:0/2741097502 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35d40705e0 0x7f35d40ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d2ffd700 1 -- 172.21.15.82:0/2741097502 >> v2:172.21.15.114:3300/0 conn(0x7f35d415a3c0 msgr2=0x7f35d40ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:39.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d2ffd700 1 --2- 172.21.15.82:0/2741097502 >> v2:172.21.15.114:3300/0 conn(0x7f35d415a3c0 0x7f35d40ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d2ffd700 1 -- 172.21.15.82:0/2741097502 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d415e0c0 con 0x7f35d40b1c70 2023-11-28T13:01:39.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d2ffd700 1 --2- 172.21.15.82:0/2741097502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d40b1c70 0x7f35d40700a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f35d4073730 tx=0x7f35c4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f27d145419a24bc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:39.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d27fc700 1 -- 172.21.15.82:0/2741097502 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4011830 con 0x7f35d40b1c70 2023-11-28T13:01:39.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d27fc700 1 -- 172.21.15.82:0/2741097502 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c4011990 con 0x7f35d40b1c70 2023-11-28T13:01:39.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d27fc700 1 -- 172.21.15.82:0/2741097502 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4011d20 con 0x7f35d40b1c70 2023-11-28T13:01:39.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d9ea6700 1 -- 172.21.15.82:0/2741097502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d40b1c70 msgr2=0x7f35d40700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:39.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d9ea6700 1 --2- 172.21.15.82:0/2741097502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d40b1c70 0x7f35d40700a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f35d4073730 tx=0x7f35c4009bf0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d9ea6700 1 -- 172.21.15.82:0/2741097502 shutdown_connections 2023-11-28T13:01:39.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d9ea6700 1 --2- 172.21.15.82:0/2741097502 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35d40705e0 0x7f35d40ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d9ea6700 1 --2- 172.21.15.82:0/2741097502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d40b1c70 0x7f35d40700a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d9ea6700 1 --2- 172.21.15.82:0/2741097502 >> v2:172.21.15.114:3300/0 conn(0x7f35d415a3c0 0x7f35d40ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d9ea6700 1 -- 172.21.15.82:0/2741097502 >> 172.21.15.82:0/2741097502 conn(0x7f35d40d0be0 msgr2=0x7f35d40d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:39.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d9ea6700 1 -- 172.21.15.82:0/2741097502 shutdown_connections 2023-11-28T13:01:39.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.090+0000 7f35d9ea6700 1 -- 172.21.15.82:0/2741097502 wait complete. 2023-11-28T13:01:39.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35d9ea6700 1 Processor -- start 2023-11-28T13:01:39.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35d9ea6700 1 -- start start 2023-11-28T13:01:39.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35d9ea6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d40705e0 0x7f35d41ef300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35d9ea6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35d40b1c70 0x7f35d41521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35d9ea6700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35d415a3c0 0x7f35d40c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35d9ea6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40c7cb0 con 0x7f35d40705e0 2023-11-28T13:01:39.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35d9ea6700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d4152ab0 con 0x7f35d40b1c70 2023-11-28T13:01:39.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35d9ea6700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d4152d90 con 0x7f35d415a3c0 2023-11-28T13:01:39.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35d37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d40705e0 0x7f35d41ef300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35d37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d40705e0 0x7f35d41ef300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59654/0 (socket says 172.21.15.82:59654) 2023-11-28T13:01:39.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35d37fe700 1 -- 172.21.15.82:0/2348621692 learned_addr learned my addr 172.21.15.82:0/2348621692 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:39.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35d3fff700 1 --2- 172.21.15.82:0/2348621692 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35d415a3c0 0x7f35d40c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35d2ffd700 1 --2- 172.21.15.82:0/2348621692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35d40b1c70 0x7f35d41521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35d37fe700 1 -- 172.21.15.82:0/2348621692 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35d415a3c0 msgr2=0x7f35d40c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:39.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35d37fe700 1 --2- 172.21.15.82:0/2348621692 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35d415a3c0 0x7f35d40c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35d37fe700 1 -- 172.21.15.82:0/2348621692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35d40b1c70 msgr2=0x7f35d41521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:39.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35d37fe700 1 --2- 172.21.15.82:0/2348621692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35d40b1c70 0x7f35d41521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35d37fe700 1 -- 172.21.15.82:0/2348621692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c4009570 con 0x7f35d40705e0 2023-11-28T13:01:39.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35d37fe700 1 --2- 172.21.15.82:0/2348621692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d40705e0 0x7f35d41ef300 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f35c800e840 tx=0x7f35c800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:39.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35bbfff700 1 -- 172.21.15.82:0/2348621692 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c80095a0 con 0x7f35d40705e0 2023-11-28T13:01:39.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35bbfff700 1 -- 172.21.15.82:0/2348621692 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c8013680 con 0x7f35d40705e0 2023-11-28T13:01:39.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35d9ea6700 1 -- 172.21.15.82:0/2348621692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d415e680 con 0x7f35d40705e0 2023-11-28T13:01:39.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35bbfff700 1 -- 172.21.15.82:0/2348621692 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c80139f0 con 0x7f35d40705e0 2023-11-28T13:01:39.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.094+0000 7f35d9ea6700 1 -- 172.21.15.82:0/2348621692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d415e3a0 con 0x7f35d40705e0 2023-11-28T13:01:39.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.098+0000 7f35d9ea6700 1 -- 172.21.15.82:0/2348621692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d415e960 con 0x7f35d40705e0 2023-11-28T13:01:39.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.098+0000 7f35bbfff700 1 -- 172.21.15.82:0/2348621692 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f35c8019030 con 0x7f35d40705e0 2023-11-28T13:01:39.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.098+0000 7f35bbfff700 1 --2- 172.21.15.82:0/2348621692 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f35c0064f10 0x7f35c00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.098+0000 7f35bbfff700 1 -- 172.21.15.82:0/2348621692 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f35c8081ad0 con 0x7f35d40705e0 2023-11-28T13:01:39.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.098+0000 7f35d2ffd700 1 --2- 172.21.15.82:0/2348621692 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f35c0064f10 0x7f35c00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.102+0000 7f35d2ffd700 1 --2- 172.21.15.82:0/2348621692 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f35c0064f10 0x7f35c00673c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f35c4000c00 tx=0x7f35c4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:39.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.106+0000 7f35bbfff700 1 -- 172.21.15.82:0/2348621692 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f35c804fc70 con 0x7f35d40705e0 2023-11-28T13:01:39.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.302+0000 7f35d9ea6700 1 -- 172.21.15.82:0/2348621692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35d4073e20 con 0x7f35d40705e0 2023-11-28T13:01:39.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.306+0000 7f35bbfff700 1 -- 172.21.15.82:0/2348621692 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f35c8053290 con 0x7f35d40705e0 2023-11-28T13:01:39.311 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:39.311 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2975361458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2975361458},{"type":"v1","addr":"172.21.15.114:6833","nonce":2975361458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3412196002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3412196002},{"type":"v1","addr":"172.21.15.114:6835","nonce":3412196002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/167093290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":167093290},{"type":"v1","addr":"172.21.15.82:6835","nonce":167093290}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:01:29.585949+0000","modified":"2023-11-28T13:01:32.836050+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/3448846386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3448846386},{"type":"v1","addr":"172.21.15.82:6837","nonce":3448846386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T13:01:39.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.306+0000 7f35d9ea6700 1 -- 172.21.15.82:0/2348621692 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f35c0064f10 msgr2=0x7f35c00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:39.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.306+0000 7f35d9ea6700 1 --2- 172.21.15.82:0/2348621692 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f35c0064f10 0x7f35c00673c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f35c4000c00 tx=0x7f35c4008030 comp rx=0 tx=0).stop 2023-11-28T13:01:39.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.306+0000 7f35d9ea6700 1 -- 172.21.15.82:0/2348621692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d40705e0 msgr2=0x7f35d41ef300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:39.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.306+0000 7f35d9ea6700 1 --2- 172.21.15.82:0/2348621692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d40705e0 0x7f35d41ef300 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f35c800e840 tx=0x7f35c800eb50 comp rx=0 tx=0).stop 2023-11-28T13:01:39.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.306+0000 7f35d9ea6700 1 -- 172.21.15.82:0/2348621692 shutdown_connections 2023-11-28T13:01:39.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.306+0000 7f35d9ea6700 1 --2- 172.21.15.82:0/2348621692 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f35c0064f10 0x7f35c00673c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.306+0000 7f35d9ea6700 1 --2- 172.21.15.82:0/2348621692 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35d415a3c0 0x7f35d40c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.306+0000 7f35d9ea6700 1 --2- 172.21.15.82:0/2348621692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35d40b1c70 0x7f35d41521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.306+0000 7f35d9ea6700 1 --2- 172.21.15.82:0/2348621692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d40705e0 0x7f35d41ef300 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.306+0000 7f35d9ea6700 1 -- 172.21.15.82:0/2348621692 >> 172.21.15.82:0/2348621692 conn(0x7f35d40d0be0 msgr2=0x7f35d40ccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:39.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.306+0000 7f35d9ea6700 1 -- 172.21.15.82:0/2348621692 shutdown_connections 2023-11-28T13:01:39.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.306+0000 7f35d9ea6700 1 -- 172.21.15.82:0/2348621692 wait complete. 2023-11-28T13:01:39.315 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2023-11-28T13:01:39.728 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T13:01:29.585949+0000', 'modified': '2023-11-28T13:01:32.836050+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5277}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5277': {'gid': 5277, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6837/3448846386', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6836', 'nonce': 3448846386}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 3448846386}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T13:01:39.728 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T13:01:39.728 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-28T13:01:39.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.846+0000 7fd3830f7700 1 Processor -- start 2023-11-28T13:01:39.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.846+0000 7fd3830f7700 1 -- start start 2023-11-28T13:01:39.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3830f7700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd3740dd280 0x7fd374050760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3830f7700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd374036e80 0x7fd374053080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3830f7700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd374052bf0 con 0x7fd3740dfb70 2023-11-28T13:01:39.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3830f7700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3740dd650 con 0x7fd374036e80 2023-11-28T13:01:39.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3830f7700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740528c0 con 0x7fd3740dd280 2023-11-28T13:01:39.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3818f4700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd3740dfb70 0x7fd374036770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48406/0 (socket says 172.21.15.82:48406) 2023-11-28T13:01:39.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3818f4700 1 -- 172.21.15.82:0/4085260195 learned_addr learned my addr 172.21.15.82:0/4085260195 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:39.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3828f6700 1 --2- 172.21.15.82:0/4085260195 >> v2:172.21.15.114:3300/0 conn(0x7fd374036e80 0x7fd374053080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3820f5700 1 --2- 172.21.15.82:0/4085260195 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd3740dd280 0x7fd374050760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3810f3700 1 -- 172.21.15.82:0/4085260195 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726109477 0 0) 0x7fd374052bf0 con 0x7fd3740dfb70 2023-11-28T13:01:39.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3810f3700 1 -- 172.21.15.82:0/4085260195 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3680057e0 con 0x7fd3740dfb70 2023-11-28T13:01:39.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3828f6700 1 -- 172.21.15.82:0/4085260195 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd3740dd280 msgr2=0x7fd374050760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:39.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3828f6700 1 --2- 172.21.15.82:0/4085260195 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd3740dd280 0x7fd374050760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3828f6700 1 -- 172.21.15.82:0/4085260195 >> v1:172.21.15.82:6789/0 conn(0x7fd3740dfb70 legacy=0x7fd374036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:39.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3828f6700 1 -- 172.21.15.82:0/4085260195 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3740e0430 con 0x7fd374036e80 2023-11-28T13:01:39.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3828f6700 1 --2- 172.21.15.82:0/4085260195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd374036e80 0x7fd374053080 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd37c04f8c0 tx=0x7fd37c072430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3238d16997963bcf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:39.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3810f3700 1 -- 172.21.15.82:0/4085260195 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c0657e0 con 0x7fd374036e80 2023-11-28T13:01:39.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3810f3700 1 -- 172.21.15.82:0/4085260195 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c065940 con 0x7fd374036e80 2023-11-28T13:01:39.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3810f3700 1 -- 172.21.15.82:0/4085260195 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c066230 con 0x7fd374036e80 2023-11-28T13:01:39.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3830f7700 1 -- 172.21.15.82:0/4085260195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd374036e80 msgr2=0x7fd374053080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:39.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3830f7700 1 --2- 172.21.15.82:0/4085260195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd374036e80 0x7fd374053080 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd37c04f8c0 tx=0x7fd37c072430 comp rx=0 tx=0).stop 2023-11-28T13:01:39.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3830f7700 1 -- 172.21.15.82:0/4085260195 shutdown_connections 2023-11-28T13:01:39.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3830f7700 1 --2- 172.21.15.82:0/4085260195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd374036e80 0x7fd374053080 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3830f7700 1 --2- 172.21.15.82:0/4085260195 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd3740dd280 0x7fd374050760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3830f7700 1 -- 172.21.15.82:0/4085260195 >> 172.21.15.82:0/4085260195 conn(0x7fd374051770 msgr2=0x7fd374051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:39.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3830f7700 1 -- 172.21.15.82:0/4085260195 shutdown_connections 2023-11-28T13:01:39.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.850+0000 7fd3830f7700 1 -- 172.21.15.82:0/4085260195 wait complete. 2023-11-28T13:01:39.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.854+0000 7fd3830f7700 1 Processor -- start 2023-11-28T13:01:39.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.854+0000 7fd3830f7700 1 -- start start 2023-11-28T13:01:39.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd3830f7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd374036e80 0x7fd3740db5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd3830f7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3740dd280 0x7fd3740dc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd3830f7700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd3740dfb70 0x7fd3740d99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd3830f7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37404c920 con 0x7fd374036e80 2023-11-28T13:01:39.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd3830f7700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740da540 con 0x7fd3740dd280 2023-11-28T13:01:39.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd3830f7700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740da820 con 0x7fd3740dfb70 2023-11-28T13:01:39.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd3820f5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd374036e80 0x7fd3740db5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd3820f5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd374036e80 0x7fd3740db5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59668/0 (socket says 172.21.15.82:59668) 2023-11-28T13:01:39.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd3820f5700 1 -- 172.21.15.82:0/2968485182 learned_addr learned my addr 172.21.15.82:0/2968485182 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:39.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd3818f4700 1 --2- 172.21.15.82:0/2968485182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3740dd280 0x7fd3740dc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd3828f6700 1 --2- 172.21.15.82:0/2968485182 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd3740dfb70 0x7fd3740d99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd3820f5700 1 -- 172.21.15.82:0/2968485182 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd3740dfb70 msgr2=0x7fd3740d99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:39.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd3820f5700 1 --2- 172.21.15.82:0/2968485182 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd3740dfb70 0x7fd3740d99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd3820f5700 1 -- 172.21.15.82:0/2968485182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3740dd280 msgr2=0x7fd3740dc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:39.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd3820f5700 1 --2- 172.21.15.82:0/2968485182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3740dd280 0x7fd3740dc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd3820f5700 1 -- 172.21.15.82:0/2968485182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3740e09f0 con 0x7fd374036e80 2023-11-28T13:01:39.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd3818f4700 1 --2- 172.21.15.82:0/2968485182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3740dd280 0x7fd3740dc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:39.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd3820f5700 1 --2- 172.21.15.82:0/2968485182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd374036e80 0x7fd3740db5e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd37800e840 tx=0x7fd37800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:39.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd36effd700 1 -- 172.21.15.82:0/2968485182 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3780095a0 con 0x7fd374036e80 2023-11-28T13:01:39.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd36effd700 1 -- 172.21.15.82:0/2968485182 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37800c690 con 0x7fd374036e80 2023-11-28T13:01:39.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd3830f7700 1 -- 172.21.15.82:0/2968485182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3740e0710 con 0x7fd374036e80 2023-11-28T13:01:39.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd36effd700 1 -- 172.21.15.82:0/2968485182 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37800ca00 con 0x7fd374036e80 2023-11-28T13:01:39.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd3830f7700 1 -- 172.21.15.82:0/2968485182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3740dffe0 con 0x7fd374036e80 2023-11-28T13:01:39.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.858+0000 7fd36effd700 1 -- 172.21.15.82:0/2968485182 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd378019030 con 0x7fd374036e80 2023-11-28T13:01:39.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.862+0000 7fd36effd700 1 --2- 172.21.15.82:0/2968485182 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd360064ee0 0x7fd360067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.862+0000 7fd36effd700 1 -- 172.21.15.82:0/2968485182 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd378081d50 con 0x7fd374036e80 2023-11-28T13:01:39.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.862+0000 7fd3818f4700 1 --2- 172.21.15.82:0/2968485182 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd360064ee0 0x7fd360067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.862+0000 7fd3818f4700 1 --2- 172.21.15.82:0/2968485182 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd360064ee0 0x7fd360067390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd37403a5f0 tx=0x7fd370009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:39.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.862+0000 7fd3875d9740 1 Processor -- start 2023-11-28T13:01:39.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.862+0000 7fd3875d9740 1 -- start start 2023-11-28T13:01:39.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3875d9740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2ae0 0x11a2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3875d9740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xef2710 0x11a3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3875d9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xf3d790 0x11a3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3875d9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1061ae0 con 0xf3d790 2023-11-28T13:01:39.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3875d9740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x10d1bd0 con 0xef2710 2023-11-28T13:01:39.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3875d9740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x10caed0 con 0xef2ae0 2023-11-28T13:01:39.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3828f6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xf3d790 0x11a3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3828f6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xf3d790 0x11a3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59684/0 (socket says 172.21.15.82:59684) 2023-11-28T13:01:39.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3820f5700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2ae0 0x11a2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3828f6700 1 -- 172.21.15.82:0/2971633423 learned_addr learned my addr 172.21.15.82:0/2971633423 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:39.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3818f4700 1 --2- 172.21.15.82:0/2971633423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xef2710 0x11a3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3828f6700 1 -- 172.21.15.82:0/2971633423 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2ae0 msgr2=0x11a2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:39.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3828f6700 1 --2- 172.21.15.82:0/2971633423 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2ae0 0x11a2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3828f6700 1 -- 172.21.15.82:0/2971633423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xef2710 msgr2=0x11a3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3828f6700 1 --2- 172.21.15.82:0/2971633423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xef2710 0x11a3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3828f6700 1 -- 172.21.15.82:0/2971633423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10f0cc0 con 0xf3d790 2023-11-28T13:01:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3820f5700 1 --2- 172.21.15.82:0/2971633423 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2ae0 0x11a2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3818f4700 1 --2- 172.21.15.82:0/2971633423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xef2710 0x11a3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3828f6700 1 --2- 172.21.15.82:0/2971633423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xf3d790 0x11a3880 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd37c067e40 tx=0x7fd37c08b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78366a81183c8fd7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd35ffff700 1 -- 172.21.15.82:0/2971633423 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c0657e0 con 0xf3d790 2023-11-28T13:01:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd35ffff700 1 -- 172.21.15.82:0/2971633423 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c099070 con 0xf3d790 2023-11-28T13:01:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd35ffff700 1 -- 172.21.15.82:0/2971633423 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c066230 con 0xf3d790 2023-11-28T13:01:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3875d9740 1 -- 172.21.15.82:0/2971633423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xf3d790 msgr2=0x11a3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3875d9740 1 --2- 172.21.15.82:0/2971633423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xf3d790 0x11a3880 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd37c067e40 tx=0x7fd37c08b000 comp rx=0 tx=0).stop 2023-11-28T13:01:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3875d9740 1 -- 172.21.15.82:0/2971633423 shutdown_connections 2023-11-28T13:01:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3875d9740 1 --2- 172.21.15.82:0/2971633423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xf3d790 0x11a3880 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3875d9740 1 --2- 172.21.15.82:0/2971633423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xef2710 0x11a3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3875d9740 1 --2- 172.21.15.82:0/2971633423 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2ae0 0x11a2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3875d9740 1 -- 172.21.15.82:0/2971633423 >> 172.21.15.82:0/2971633423 conn(0xef2eb0 msgr2=0x118b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3875d9740 1 -- 172.21.15.82:0/2971633423 shutdown_connections 2023-11-28T13:01:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3875d9740 1 -- 172.21.15.82:0/2971633423 wait complete. 2023-11-28T13:01:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.866+0000 7fd3875d9740 1 -- start start 2023-11-28T13:01:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3875d9740 1 Processor -- start 2023-11-28T13:01:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3875d9740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xef2710 0x118c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3875d9740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2ae0 0x1189c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3875d9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xf3d790 0x11641f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3875d9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0xf77b20 con 0xf3d790 2023-11-28T13:01:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3875d9740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x11b2c10 con 0xef2710 2023-11-28T13:01:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3875d9740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x1162c10 con 0xef2ae0 2023-11-28T13:01:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3875d9740 10 client.0 _ll_register_callbacks cb 0x11270d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:01:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3828f6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xf3d790 0x11641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3828f6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xf3d790 0x11641f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59688/0 (socket says 172.21.15.82:59688) 2023-11-28T13:01:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3828f6700 1 -- 172.21.15.82:0/3120229218 learned_addr learned my addr 172.21.15.82:0/3120229218 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3820f5700 1 --2- 172.21.15.82:0/3120229218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xef2710 0x118c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3818f4700 1 --2- 172.21.15.82:0/3120229218 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2ae0 0x1189c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3828f6700 1 -- 172.21.15.82:0/3120229218 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2ae0 msgr2=0x1189c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:39.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3828f6700 1 --2- 172.21.15.82:0/3120229218 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2ae0 0x1189c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3828f6700 1 -- 172.21.15.82:0/3120229218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xef2710 msgr2=0x118c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:39.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3828f6700 1 --2- 172.21.15.82:0/3120229218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xef2710 0x118c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3828f6700 1 -- 172.21.15.82:0/3120229218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3740e0430 con 0xf3d790 2023-11-28T13:01:39.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3828f6700 1 --2- 172.21.15.82:0/3120229218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xf3d790 0x11641f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd37c069740 tx=0x7fd37c067f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9e890ca5f6063d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:39.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd35d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-11-28T13:01:39.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd35d7fa700 1 -- 172.21.15.82:0/3120229218 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c000990 con 0xf3d790 2023-11-28T13:01:39.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd35d7fa700 1 -- 172.21.15.82:0/3120229218 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd37c065ab0 con 0xf3d790 2023-11-28T13:01:39.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3875d9740 1 -- 172.21.15.82:0/3120229218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x10c3f50 con 0xf3d790 2023-11-28T13:01:39.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd35d7fa700 1 -- 172.21.15.82:0/3120229218 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd37c065c70 con 0xf3d790 2023-11-28T13:01:39.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3875d9740 10 client.5472 fetch_fsmap learned FSMap version 14 2023-11-28T13:01:39.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.870+0000 7fd3875d9740 1 -- 172.21.15.82:0/3120229218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0xf3e9e0 con 0xf3d790 2023-11-28T13:01:39.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd35d7fa700 1 -- 172.21.15.82:0/3120229218 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x10c3f50 con 0xf3d790 2023-11-28T13:01:39.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd35d7fa700 1 -- 172.21.15.82:0/3120229218 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 14) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fd37c066230 con 0xf3d790 2023-11-28T13:01:39.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd3875d9740 10 client.5472 fetch_fsmap finished waiting for FSMap version 14 2023-11-28T13:01:39.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd3875d9740 10 client.5472 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T13:01:39.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd3875d9740 20 client.5472 populate_metadata read hostname 'smithi082' 2023-11-28T13:01:39.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd3875d9740 1 --2- 172.21.15.82:0/3120229218 >> [v2:172.21.15.82:6836/3448846386,v1:172.21.15.82:6837/3448846386] conn(0x11a48e0 0x1161740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd3875d9740 4 client.5472 mds_command: new command op to 5277 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T13:01:39.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd3875d9740 1 -- 172.21.15.82:0/3120229218 --> [v2:172.21.15.82:6836/3448846386,v1:172.21.15.82:6837/3448846386] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x10c3c70 con 0x11a48e0 2023-11-28T13:01:39.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd3820f5700 1 --2- 172.21.15.82:0/3120229218 >> [v2:172.21.15.82:6836/3448846386,v1:172.21.15.82:6837/3448846386] conn(0x11a48e0 0x1161740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd35d7fa700 10 client.5472 ms_handle_connect on v2:172.21.15.82:6836/3448846386 2023-11-28T13:01:39.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd3820f5700 1 --2- 172.21.15.82:0/3120229218 >> [v2:172.21.15.82:6836/3448846386,v1:172.21.15.82:6837/3448846386] conn(0x11a48e0 0x1161740 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=366c3b699db0e41e server_cookie=8f0c1349875e8e05 in_seq=0 out_seq=0 2023-11-28T13:01:39.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd35d7fa700 1 -- 172.21.15.82:0/3120229218 <== mds.0 v2:172.21.15.82:6836/3448846386 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x10c3c70 con 0x11a48e0 2023-11-28T13:01:39.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd35d7fa700 10 client.5472 handle_command_reply: tid=0 2023-11-28T13:01:39.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd3875d9740 1 client.5472 shutdown 2023-11-28T13:01:39.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd3875d9740 1 -- 172.21.15.82:0/3120229218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xf3d790 msgr2=0x11641f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:39.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd3875d9740 1 --2- 172.21.15.82:0/3120229218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xf3d790 0x11641f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd37c069740 tx=0x7fd37c067f60 comp rx=0 tx=0).stop 2023-11-28T13:01:39.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd3875d9740 1 -- 172.21.15.82:0/3120229218 shutdown_connections 2023-11-28T13:01:39.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd3875d9740 1 --2- 172.21.15.82:0/3120229218 >> [v2:172.21.15.82:6836/3448846386,v1:172.21.15.82:6837/3448846386] conn(0x11a48e0 0x1161740 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd3875d9740 1 --2- 172.21.15.82:0/3120229218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xf3d790 0x11641f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd35d7fa700 0 client.5472 ms_handle_reset on v2:172.21.15.82:6836/3448846386 2023-11-28T13:01:39.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd3875d9740 1 --2- 172.21.15.82:0/3120229218 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2ae0 0x1189c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd3875d9740 1 --2- 172.21.15.82:0/3120229218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xef2710 0x118c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd3875d9740 1 -- 172.21.15.82:0/3120229218 >> 172.21.15.82:0/3120229218 conn(0xef2eb0 msgr2=0x118b740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:39.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd3875d9740 1 -- 172.21.15.82:0/3120229218 shutdown_connections 2023-11-28T13:01:39.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd3875d9740 1 -- 172.21.15.82:0/3120229218 wait complete. 2023-11-28T13:01:39.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.874+0000 7fd3875d9740 20 client.5472 trim_cache size 0 max 16384 2023-11-28T13:01:39.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd3875d9740 1 Processor -- start 2023-11-28T13:01:39.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd3875d9740 1 -- start start 2023-11-28T13:01:39.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd3875d9740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2710 0x11b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd3875d9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xef2ae0 0x119ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd3875d9740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xf3d790 0x11a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd3875d9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x10ca6e0 con 0xef2ae0 2023-11-28T13:01:39.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd3875d9740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x107b260 con 0xf3d790 2023-11-28T13:01:39.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd3875d9740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x10c9b80 con 0xef2710 2023-11-28T13:01:39.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd3818f4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xef2ae0 0x119ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd3818f4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xef2ae0 0x119ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59690/0 (socket says 172.21.15.82:59690) 2023-11-28T13:01:39.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd3818f4700 1 -- 172.21.15.82:0/644265106 learned_addr learned my addr 172.21.15.82:0/644265106 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:39.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd3820f5700 1 --2- 172.21.15.82:0/644265106 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2710 0x11b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd3828f6700 1 --2- 172.21.15.82:0/644265106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xf3d790 0x11a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd3818f4700 1 -- 172.21.15.82:0/644265106 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2710 msgr2=0x11b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:39.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd3818f4700 1 --2- 172.21.15.82:0/644265106 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2710 0x11b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd3818f4700 1 -- 172.21.15.82:0/644265106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xf3d790 msgr2=0x11a04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:39.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd3818f4700 1 --2- 172.21.15.82:0/644265106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xf3d790 0x11a04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd3818f4700 1 -- 172.21.15.82:0/644265106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10918a0 con 0xef2ae0 2023-11-28T13:01:39.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd3820f5700 1 --2- 172.21.15.82:0/644265106 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2710 0x11b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:39.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd3818f4700 1 --2- 172.21.15.82:0/644265106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xef2ae0 0x119ffa0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd370009010 tx=0x7fd370012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c0627dca055272 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:39.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd36cdb8700 1 -- 172.21.15.82:0/644265106 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd370007560 con 0xef2ae0 2023-11-28T13:01:39.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd36cdb8700 1 -- 172.21.15.82:0/644265106 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3700076c0 con 0xef2ae0 2023-11-28T13:01:39.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.894+0000 7fd36cdb8700 1 -- 172.21.15.82:0/644265106 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd370007830 con 0xef2ae0 2023-11-28T13:01:39.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.898+0000 7fd3875d9740 1 -- 172.21.15.82:0/644265106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xef2ae0 msgr2=0x119ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:39.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.898+0000 7fd3875d9740 1 --2- 172.21.15.82:0/644265106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xef2ae0 0x119ffa0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd370009010 tx=0x7fd370012000 comp rx=0 tx=0).stop 2023-11-28T13:01:39.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.898+0000 7fd3875d9740 1 -- 172.21.15.82:0/644265106 shutdown_connections 2023-11-28T13:01:39.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.898+0000 7fd3875d9740 1 --2- 172.21.15.82:0/644265106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xf3d790 0x11a04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.898+0000 7fd3875d9740 1 --2- 172.21.15.82:0/644265106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xef2ae0 0x119ffa0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.898+0000 7fd3875d9740 1 --2- 172.21.15.82:0/644265106 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2710 0x11b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.898+0000 7fd3875d9740 1 -- 172.21.15.82:0/644265106 >> 172.21.15.82:0/644265106 conn(0xef2eb0 msgr2=0x11b8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:39.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.898+0000 7fd3875d9740 1 -- 172.21.15.82:0/644265106 shutdown_connections 2023-11-28T13:01:39.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.898+0000 7fd3875d9740 1 -- 172.21.15.82:0/644265106 wait complete. 2023-11-28T13:01:39.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.898+0000 7fd3875d9740 1 -- start start 2023-11-28T13:01:39.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.898+0000 7fd3875d9740 1 Processor -- start 2023-11-28T13:01:39.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.898+0000 7fd3875d9740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2710 0x11c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.898+0000 7fd3875d9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xef2ae0 0x120e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.898+0000 7fd3875d9740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xf3d790 0x120e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.898+0000 7fd3875d9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x11a1580 con 0xef2ae0 2023-11-28T13:01:39.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.898+0000 7fd3875d9740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x11bfc50 con 0xf3d790 2023-11-28T13:01:39.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.898+0000 7fd3875d9740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x11a12e0 con 0xef2710 2023-11-28T13:01:39.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3818f4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xef2ae0 0x120e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3875d9740 10 client.0 _ll_register_callbacks cb 0x10772d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:01:39.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3818f4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xef2ae0 0x120e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59702/0 (socket says 172.21.15.82:59702) 2023-11-28T13:01:39.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3818f4700 1 -- 172.21.15.82:0/2572039743 learned_addr learned my addr 172.21.15.82:0/2572039743 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:39.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3820f5700 1 --2- 172.21.15.82:0/2572039743 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2710 0x11c04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3828f6700 1 --2- 172.21.15.82:0/2572039743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xf3d790 0x120e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3818f4700 1 -- 172.21.15.82:0/2572039743 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2710 msgr2=0x11c04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:39.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3818f4700 1 --2- 172.21.15.82:0/2572039743 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2710 0x11c04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3818f4700 1 -- 172.21.15.82:0/2572039743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xf3d790 msgr2=0x120e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:39.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3818f4700 1 --2- 172.21.15.82:0/2572039743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xf3d790 0x120e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3818f4700 1 -- 172.21.15.82:0/2572039743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37001d040 con 0xef2ae0 2023-11-28T13:01:39.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3818f4700 1 --2- 172.21.15.82:0/2572039743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xef2ae0 0x120e210 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd3700011e0 tx=0x7fd370000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ea12249ef33749 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:39.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd35d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-11-28T13:01:39.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd35d7fa700 1 -- 172.21.15.82:0/2572039743 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd370031070 con 0xef2ae0 2023-11-28T13:01:39.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3875d9740 1 -- 172.21.15.82:0/2572039743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd37c099070 con 0xef2ae0 2023-11-28T13:01:39.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd35d7fa700 1 -- 172.21.15.82:0/2572039743 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd3700015d0 con 0xef2ae0 2023-11-28T13:01:39.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd35d7fa700 1 -- 172.21.15.82:0/2572039743 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd370007560 con 0xef2ae0 2023-11-28T13:01:39.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3875d9740 10 client.5478 fetch_fsmap learned FSMap version 14 2023-11-28T13:01:39.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3875d9740 1 -- 172.21.15.82:0/2572039743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x1077380 con 0xef2ae0 2023-11-28T13:01:39.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd35d7fa700 1 -- 172.21.15.82:0/2572039743 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37003a020 con 0xef2ae0 2023-11-28T13:01:39.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd35d7fa700 1 -- 172.21.15.82:0/2572039743 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 14) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fd370034020 con 0xef2ae0 2023-11-28T13:01:39.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3875d9740 10 client.5478 fetch_fsmap finished waiting for FSMap version 14 2023-11-28T13:01:39.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3875d9740 10 client.5478 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T13:01:39.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3875d9740 20 client.5478 populate_metadata read hostname 'smithi082' 2023-11-28T13:01:39.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3875d9740 1 --2- 172.21.15.82:0/2572039743 >> [v2:172.21.15.82:6836/3448846386,v1:172.21.15.82:6837/3448846386] conn(0x11bc670 0x11bca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:39.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3875d9740 4 client.5478 mds_command: new command op to 5277 tid=0[{"prefix": "status"}] 2023-11-28T13:01:39.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3875d9740 1 -- 172.21.15.82:0/2572039743 --> [v2:172.21.15.82:6836/3448846386,v1:172.21.15.82:6837/3448846386] -- command(tid 0: {"prefix": "status"}) v1 -- 0xf6f260 con 0x11bc670 2023-11-28T13:01:39.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3820f5700 1 --2- 172.21.15.82:0/2572039743 >> [v2:172.21.15.82:6836/3448846386,v1:172.21.15.82:6837/3448846386] conn(0x11bc670 0x11bca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:39.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd35d7fa700 10 client.5478 ms_handle_connect on v2:172.21.15.82:6836/3448846386 2023-11-28T13:01:39.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3820f5700 1 --2- 172.21.15.82:0/2572039743 >> [v2:172.21.15.82:6836/3448846386,v1:172.21.15.82:6837/3448846386] conn(0x11bc670 0x11bca40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=590b34b27937c0a server_cookie=f6556b266a897b71 in_seq=0 out_seq=0 2023-11-28T13:01:39.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd35d7fa700 1 -- 172.21.15.82:0/2572039743 <== mds.0 v2:172.21.15.82:6836/3448846386 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0xf6f260 con 0x11bc670 2023-11-28T13:01:39.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd35d7fa700 10 client.5478 handle_command_reply: tid=0 2023-11-28T13:01:39.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3875d9740 1 client.5478 shutdown 2023-11-28T13:01:39.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3875d9740 1 -- 172.21.15.82:0/2572039743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xef2ae0 msgr2=0x120e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:39.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3875d9740 1 --2- 172.21.15.82:0/2572039743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xef2ae0 0x120e210 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd3700011e0 tx=0x7fd370000ed0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3875d9740 1 -- 172.21.15.82:0/2572039743 shutdown_connections 2023-11-28T13:01:39.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3875d9740 1 --2- 172.21.15.82:0/2572039743 >> [v2:172.21.15.82:6836/3448846386,v1:172.21.15.82:6837/3448846386] conn(0x11bc670 0x11bca40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3875d9740 1 --2- 172.21.15.82:0/2572039743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xf3d790 0x120e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd35d7fa700 0 client.5478 ms_handle_reset on v2:172.21.15.82:6836/3448846386 2023-11-28T13:01:39.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3875d9740 1 --2- 172.21.15.82:0/2572039743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xef2ae0 0x120e210 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3875d9740 1 --2- 172.21.15.82:0/2572039743 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xef2710 0x11c04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3875d9740 1 -- 172.21.15.82:0/2572039743 >> 172.21.15.82:0/2572039743 conn(0xef2eb0 msgr2=0x11b8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:39.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3875d9740 1 -- 172.21.15.82:0/2572039743 shutdown_connections 2023-11-28T13:01:39.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.902+0000 7fd3875d9740 1 -- 172.21.15.82:0/2572039743 wait complete. 2023-11-28T13:01:39.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.906+0000 7fd3875d9740 20 client.5478 trim_cache size 0 max 16384 2023-11-28T13:01:39.914 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:01:39.914 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "aef8a97f-1d6c-4a2b-9410-16861b3e9e35", 2023-11-28T13:01:39.914 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-11-28T13:01:39.915 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 5277, 2023-11-28T13:01:39.915 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-11-28T13:01:39.915 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-11-28T13:01:39.915 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-11-28T13:01:39.915 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 10.318423900000001, 2023-11-28T13:01:39.915 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 14, 2023-11-28T13:01:39.915 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 38, 2023-11-28T13:01:39.915 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 38, 2023-11-28T13:01:39.915 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 17.562998726 2023-11-28T13:01:39.915 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:01:39.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.906+0000 7fd3830f7700 1 -- 172.21.15.82:0/2968485182 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd360064ee0 msgr2=0x7fd360067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:39.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.906+0000 7fd3830f7700 1 --2- 172.21.15.82:0/2968485182 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd360064ee0 0x7fd360067390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd37403a5f0 tx=0x7fd370009040 comp rx=0 tx=0).stop 2023-11-28T13:01:39.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.906+0000 7fd3830f7700 1 -- 172.21.15.82:0/2968485182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd374036e80 msgr2=0x7fd3740db5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:39.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.906+0000 7fd3830f7700 1 --2- 172.21.15.82:0/2968485182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd374036e80 0x7fd3740db5e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd37800e840 tx=0x7fd37800ec00 comp rx=0 tx=0).stop 2023-11-28T13:01:39.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.906+0000 7fd3830f7700 1 -- 172.21.15.82:0/2968485182 shutdown_connections 2023-11-28T13:01:39.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.906+0000 7fd3830f7700 1 --2- 172.21.15.82:0/2968485182 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd360064ee0 0x7fd360067390 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.906+0000 7fd3830f7700 1 --2- 172.21.15.82:0/2968485182 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd3740dfb70 0x7fd3740d99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.906+0000 7fd3830f7700 1 --2- 172.21.15.82:0/2968485182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3740dd280 0x7fd3740dc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.906+0000 7fd3830f7700 1 --2- 172.21.15.82:0/2968485182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd374036e80 0x7fd3740db5e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:39.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.906+0000 7fd3830f7700 1 -- 172.21.15.82:0/2968485182 >> 172.21.15.82:0/2968485182 conn(0x7fd374051770 msgr2=0x7fd3740dedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:39.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.906+0000 7fd3830f7700 1 -- 172.21.15.82:0/2968485182 shutdown_connections 2023-11-28T13:01:39.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:39.906+0000 7fd3830f7700 1 -- 172.21.15.82:0/2968485182 wait complete. 2023-11-28T13:01:39.926 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T13:01:40.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb972c0700 1 Processor -- start 2023-11-28T13:01:40.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb972c0700 1 -- start start 2023-11-28T13:01:40.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb972c0700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdb90162370 0x7fdb90164750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:40.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb972c0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb900c9b10 con 0x7fdb900703e0 2023-11-28T13:01:40.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb972c0700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb900c9db0 con 0x7fdb9015dd60 2023-11-28T13:01:40.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb972c0700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb901599d0 con 0x7fdb90162370 2023-11-28T13:01:40.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb9505c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdb900703e0 0x7fdb900707b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48410/0 (socket says 172.21.15.82:48410) 2023-11-28T13:01:40.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb9505c700 1 -- 172.21.15.82:0/2210759590 learned_addr learned my addr 172.21.15.82:0/2210759590 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:40.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb9585d700 1 --2- 172.21.15.82:0/2210759590 >> v2:172.21.15.114:3300/0 conn(0x7fdb90162370 0x7fdb90164750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:40.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb87fff700 1 -- 172.21.15.82:0/2210759590 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2145270505 0 0) 0x7fdb900c9b10 con 0x7fdb900703e0 2023-11-28T13:01:40.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb87fff700 1 -- 172.21.15.82:0/2210759590 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb7c0035d0 con 0x7fdb900703e0 2023-11-28T13:01:40.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb9585d700 1 -- 172.21.15.82:0/2210759590 >> v1:172.21.15.114:6789/0 conn(0x7fdb9015dd60 legacy=0x7fdb900cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:40.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb9585d700 1 -- 172.21.15.82:0/2210759590 >> v1:172.21.15.82:6789/0 conn(0x7fdb900703e0 legacy=0x7fdb900707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:40.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb9585d700 1 -- 172.21.15.82:0/2210759590 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb900ca090 con 0x7fdb90162370 2023-11-28T13:01:40.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb9585d700 1 --2- 172.21.15.82:0/2210759590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb90162370 0x7fdb90164750 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009850 tx=0x7fdb8c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7760ae96fb873f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:40.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb87fff700 1 -- 172.21.15.82:0/2210759590 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c011830 con 0x7fdb90162370 2023-11-28T13:01:40.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb87fff700 1 -- 172.21.15.82:0/2210759590 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c011990 con 0x7fdb90162370 2023-11-28T13:01:40.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb87fff700 1 -- 172.21.15.82:0/2210759590 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c011d40 con 0x7fdb90162370 2023-11-28T13:01:40.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb972c0700 1 -- 172.21.15.82:0/2210759590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb90162370 msgr2=0x7fdb90164750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:40.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb972c0700 1 --2- 172.21.15.82:0/2210759590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb90162370 0x7fdb90164750 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009850 tx=0x7fdb8c009b60 comp rx=0 tx=0).stop 2023-11-28T13:01:40.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb972c0700 1 -- 172.21.15.82:0/2210759590 shutdown_connections 2023-11-28T13:01:40.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb972c0700 1 --2- 172.21.15.82:0/2210759590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb90162370 0x7fdb90164750 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:40.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb972c0700 1 -- 172.21.15.82:0/2210759590 >> 172.21.15.82:0/2210759590 conn(0x7fdb900ce9b0 msgr2=0x7fdb900ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:40.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb972c0700 1 -- 172.21.15.82:0/2210759590 shutdown_connections 2023-11-28T13:01:40.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.042+0000 7fdb972c0700 1 -- 172.21.15.82:0/2210759590 wait complete. 2023-11-28T13:01:40.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb972c0700 1 Processor -- start 2023-11-28T13:01:40.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb972c0700 1 -- start start 2023-11-28T13:01:40.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb972c0700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb900703e0 0x7fdb900b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:40.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb972c0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb90162370 0x7fdb90158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:40.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb972c0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb9014d970 0x7fdb9014e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:40.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb972c0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb900b17e0 con 0x7fdb9014d970 2023-11-28T13:01:40.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb972c0700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb900b2320 con 0x7fdb90162370 2023-11-28T13:01:40.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb972c0700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb901594c0 con 0x7fdb900703e0 2023-11-28T13:01:40.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb9585d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb9014d970 0x7fdb9014e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:40.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb9585d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb9014d970 0x7fdb9014e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59718/0 (socket says 172.21.15.82:59718) 2023-11-28T13:01:40.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb9585d700 1 -- 172.21.15.82:0/2112261786 learned_addr learned my addr 172.21.15.82:0/2112261786 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:40.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb9505c700 1 --2- 172.21.15.82:0/2112261786 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb900703e0 0x7fdb900b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:40.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb9485b700 1 --2- 172.21.15.82:0/2112261786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb90162370 0x7fdb90158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:40.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb9585d700 1 -- 172.21.15.82:0/2112261786 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb900703e0 msgr2=0x7fdb900b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:40.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb9585d700 1 --2- 172.21.15.82:0/2112261786 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb900703e0 0x7fdb900b27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:40.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb9585d700 1 -- 172.21.15.82:0/2112261786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb90162370 msgr2=0x7fdb90158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:40.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb9585d700 1 --2- 172.21.15.82:0/2112261786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb90162370 0x7fdb90158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:40.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb9585d700 1 -- 172.21.15.82:0/2112261786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8c0094b0 con 0x7fdb9014d970 2023-11-28T13:01:40.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb9585d700 1 --2- 172.21.15.82:0/2112261786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb9014d970 0x7fdb9014e6d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c014040 tx=0x7fdb8c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:40.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb85ffb700 1 -- 172.21.15.82:0/2112261786 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c019ba0 con 0x7fdb9014d970 2023-11-28T13:01:40.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb85ffb700 1 -- 172.21.15.82:0/2112261786 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c01e070 con 0x7fdb9014d970 2023-11-28T13:01:40.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb972c0700 1 -- 172.21.15.82:0/2112261786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb900ca650 con 0x7fdb9014d970 2023-11-28T13:01:40.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.046+0000 7fdb85ffb700 1 -- 172.21.15.82:0/2112261786 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c01a420 con 0x7fdb9014d970 2023-11-28T13:01:40.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.050+0000 7fdb972c0700 1 -- 172.21.15.82:0/2112261786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb900ca370 con 0x7fdb9014d970 2023-11-28T13:01:40.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.050+0000 7fdb972c0700 1 -- 172.21.15.82:0/2112261786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb900ca930 con 0x7fdb9014d970 2023-11-28T13:01:40.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.050+0000 7fdb85ffb700 1 -- 172.21.15.82:0/2112261786 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdb8c00f050 con 0x7fdb9014d970 2023-11-28T13:01:40.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.050+0000 7fdb85ffb700 1 --2- 172.21.15.82:0/2112261786 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdb74064ee0 0x7fdb74067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:40.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.050+0000 7fdb85ffb700 1 -- 172.21.15.82:0/2112261786 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb8c082fe0 con 0x7fdb9014d970 2023-11-28T13:01:40.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.050+0000 7fdb9505c700 1 --2- 172.21.15.82:0/2112261786 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdb74064ee0 0x7fdb74067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:40.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.054+0000 7fdb9505c700 1 --2- 172.21.15.82:0/2112261786 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdb74064ee0 0x7fdb74067390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdb88001560 tx=0x7fdb88009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:40.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.058+0000 7fdb85ffb700 1 -- 172.21.15.82:0/2112261786 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdb8c051050 con 0x7fdb9014d970 2023-11-28T13:01:40.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.250+0000 7fdb972c0700 1 -- 172.21.15.82:0/2112261786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdb9006e310 con 0x7fdb9014d970 2023-11-28T13:01:40.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.250+0000 7fdb85ffb700 1 -- 172.21.15.82:0/2112261786 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdb8c015070 con 0x7fdb9014d970 2023-11-28T13:01:40.257 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T13:01:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.254+0000 7fdb972c0700 1 -- 172.21.15.82:0/2112261786 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdb74064ee0 msgr2=0x7fdb74067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.254+0000 7fdb972c0700 1 --2- 172.21.15.82:0/2112261786 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdb74064ee0 0x7fdb74067390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdb88001560 tx=0x7fdb88009040 comp rx=0 tx=0).stop 2023-11-28T13:01:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.254+0000 7fdb972c0700 1 -- 172.21.15.82:0/2112261786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb9014d970 msgr2=0x7fdb9014e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.254+0000 7fdb972c0700 1 --2- 172.21.15.82:0/2112261786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb9014d970 0x7fdb9014e6d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c014040 tx=0x7fdb8c004770 comp rx=0 tx=0).stop 2023-11-28T13:01:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.254+0000 7fdb972c0700 1 -- 172.21.15.82:0/2112261786 shutdown_connections 2023-11-28T13:01:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.254+0000 7fdb972c0700 1 --2- 172.21.15.82:0/2112261786 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdb74064ee0 0x7fdb74067390 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.254+0000 7fdb972c0700 1 --2- 172.21.15.82:0/2112261786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb9014d970 0x7fdb9014e6d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.254+0000 7fdb972c0700 1 --2- 172.21.15.82:0/2112261786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb90162370 0x7fdb90158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.254+0000 7fdb972c0700 1 --2- 172.21.15.82:0/2112261786 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb900703e0 0x7fdb900b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.254+0000 7fdb972c0700 1 -- 172.21.15.82:0/2112261786 >> 172.21.15.82:0/2112261786 conn(0x7fdb900ce9b0 msgr2=0x7fdb900707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:40.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.254+0000 7fdb972c0700 1 -- 172.21.15.82:0/2112261786 shutdown_connections 2023-11-28T13:01:40.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:40.254+0000 7fdb972c0700 1 -- 172.21.15.82:0/2112261786 wait complete. 2023-11-28T13:01:40.270 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T13:01:40.270 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T13:01:40.270 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-11-28T13:01:40.270 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T13:01:40.270 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T13:01:40.270 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T13:01:40.271 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T13:01:40.271 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T13:01:40.271 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T13:01:40.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:40.271 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-11-28T13:01:40.276 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T13:01:40.276 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T13:01:40.276 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T13:01:40.276 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:01:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-11-28T13:01:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:01:40.277 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T13:01:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:01:40.277 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T13:01:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:01:40.277 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T13:01:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-11-28T13:01:40.277 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T13:01:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-11-28T13:01:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T13:01:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42481sec preferred_lft 42481sec 2023-11-28T13:01:40.278 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-11-28T13:01:40.278 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:01:40.278 INFO:teuthology.orchestra.run.smithi082.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T13:01:40.278 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:42:02:22:90:39 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:01:40.278 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T13:01:40.278 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:01:40.278 INFO:teuthology.orchestra.run.smithi082.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T13:01:40.278 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether ba:e2:2a:24:1a:10 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:01:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T13:01:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:01:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::78c5:d7ff:fe17:75c8/64 scope link 2023-11-28T13:01:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:01:40.279 INFO:teuthology.orchestra.run.smithi082.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T13:01:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether f2:23:62:63:4a:4e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T13:01:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::f023:62ff:fe63:4a4e/64 scope link 2023-11-28T13:01:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:01:40.279 INFO:teuthology.orchestra.run.smithi082.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T13:01:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether ba:e2:2a:24:1a:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T13:01:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::b8e2:2aff:fe24:1a10/64 scope link 2023-11-28T13:01:40.280 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:01:40.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:40.280 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T13:01:40.295 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-11-28T13:01:40.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:40.296 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-11-28T13:01:40.346 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-11-28T13:01:40.347 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T13:01:40.347 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T13:01:40.347 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T13:01:40.347 INFO:teuthology.orchestra.run.smithi082.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T13:01:40.347 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-28T13:01:40.347 INFO:teuthology.orchestra.run.smithi082.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T13:01:40.347 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T13:01:40.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:40.348 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-11-28T13:01:40.348 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-11-28T13:01:40.348 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T13:01:40.348 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T13:01:40.348 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T13:01:40.348 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-11-28T13:01:40.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:40.382 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-11-28T13:01:40.388 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T13:01:40.389 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T13:01:40.389 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T13:01:40.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:40.389 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-11-28T13:01:40.401 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T13:01:40.401 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T13:01:40.402 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T13:01:40.407 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T13:01:40.407 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T13:01:40.407 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T13:01:40.456 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2023-11-28T13:01:40.474 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T13:01:40.474 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T13:01:40.489 INFO:teuthology.orchestra.run.smithi082.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T13:01:40.490 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T13:01:40.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:40.490 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2023-11-28T13:01:40.498 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T13:01:40.498 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-28T13:01:40.544 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2023-11-28T13:01:40.560 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T13:01:40.560 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T13:01:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T13:01:40.572 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T13:01:40.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:40.573 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2023-11-28T13:01:40.637 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:2023-11-28T13:01:40.630+0000 7f6c74d08640 -1 init, newargv = 0x562d2651f800 newargc=15 2023-11-28T13:01:40.637 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[48038]: starting ceph client 2023-11-28T13:01:40.646 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[48038]: starting fuse 2023-11-28T13:01:41.679 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2023-11-28T13:01:41.699 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T13:01:41.699 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T13:01:41.715 INFO:teuthology.orchestra.run.smithi082.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T13:01:41.717 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T13:01:41.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:41.718 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2023-11-28T13:01:41.722 INFO:teuthology.orchestra.run.smithi082.stdout:52 2023-11-28T13:01:41.722 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-28T13:01:41.723 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T13:01:41.723 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2023-11-28T13:01:41.723 DEBUG:teuthology.orchestra.run.smithi082:> import re 2023-11-28T13:01:41.723 DEBUG:teuthology.orchestra.run.smithi082:> import os 2023-11-28T13:01:41.723 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2023-11-28T13:01:41.723 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:01:41.723 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2023-11-28T13:01:41.723 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T13:01:41.723 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2023-11-28T13:01:41.723 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T13:01:41.723 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:01:41.723 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2023-11-28T13:01:41.724 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2023-11-28T13:01:41.724 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2023-11-28T13:01:41.724 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2023-11-28T13:01:41.724 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:01:41.724 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2023-11-28T13:01:41.724 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T13:01:41.724 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T13:01:41.724 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T13:01:41.724 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2023-11-28T13:01:41.724 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2023-11-28T13:01:41.724 DEBUG:teuthology.orchestra.run.smithi082:> return f 2023-11-28T13:01:41.725 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T13:01:41.725 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:01:41.725 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.0")) 2023-11-28T13:01:41.725 DEBUG:teuthology.orchestra.run.smithi082:> ' 2023-11-28T13:01:41.851 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.0.48038.asok 2023-11-28T13:01:42.036 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48038.asok 2023-11-28T13:01:42.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:42.036 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48038.asok status 2023-11-28T13:01:42.133 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:01:42.133 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2023-11-28T13:01:42.133 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T13:01:42.133 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T13:01:42.133 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "0", 2023-11-28T13:01:42.133 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2023-11-28T13:01:42.133 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T13:01:42.133 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "48038", 2023-11-28T13:01:42.134 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/" 2023-11-28T13:01:42.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:42.134 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2023-11-28T13:01:42.134 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2023-11-28T13:01:42.134 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 5493, 2023-11-28T13:01:42.134 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2023-11-28T13:01:42.134 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2023-11-28T13:01:42.134 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2023-11-28T13:01:42.134 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 5493 2023-11-28T13:01:42.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:42.134 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2023-11-28T13:01:42.134 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2023-11-28T13:01:42.135 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2023-11-28T13:01:42.135 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 2036325889 2023-11-28T13:01:42.135 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:01:42.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:42.135 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2023-11-28T13:01:42.135 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2023-11-28T13:01:42.135 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2023-11-28T13:01:42.135 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 2036325889 2023-11-28T13:01:42.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:01:42.135 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.5493 192.168.0.1:0/2036325889", 2023-11-28T13:01:42.135 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "192.168.0.1:0/2036325889", 2023-11-28T13:01:42.135 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 1, 2023-11-28T13:01:42.136 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 14, 2023-11-28T13:01:42.136 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 38, 2023-11-28T13:01:42.136 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2023-11-28T13:01:42.136 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2023-11-28T13:01:42.136 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2023-11-28T13:01:42.136 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:01:42.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:42.142 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2023-11-28T13:01:42.142 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T13:01:42.150 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2023-11-28T13:01:42.150 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T13:01:42.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:42.150 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T13:01:42.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:42.164 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2023-11-28T13:01:42.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:42.225 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2023-11-28T13:01:42.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:42.238 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2023-11-28T13:01:42.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:42.250 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2023-11-28T13:01:42.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:42.308 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2023-11-28T13:01:42.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:42.321 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2023-11-28T13:01:42.348 INFO:teuthology.orchestra.run.smithi082.stdout:./ 2023-11-28T13:01:42.348 INFO:teuthology.orchestra.run.smithi082.stdout:./rfile 2023-11-28T13:01:42.349 INFO:teuthology.orchestra.run.smithi082.stdout:./parentdir 2023-11-28T13:01:42.349 INFO:teuthology.orchestra.run.smithi082.stdout:./parentdir/pfile 2023-11-28T13:01:42.349 INFO:teuthology.orchestra.run.smithi082.stdout:./parentdir/childdir 2023-11-28T13:01:42.349 INFO:teuthology.orchestra.run.smithi082.stdout:./parentdir/childdir/cfile 2023-11-28T13:01:42.350 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T13:01:42.350 DEBUG:teuthology.orchestra.run.smithi082:> import os 2023-11-28T13:01:42.350 DEBUG:teuthology.orchestra.run.smithi082:> import stat 2023-11-28T13:01:42.350 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:01:42.350 DEBUG:teuthology.orchestra.run.smithi082:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2023-11-28T13:01:42.350 DEBUG:teuthology.orchestra.run.smithi082:> ' 2023-11-28T13:01:42.415 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-11-28T13:01:42.604 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T13:01:42.605 DEBUG:teuthology.orchestra.run.smithi082:> import os 2023-11-28T13:01:42.605 DEBUG:teuthology.orchestra.run.smithi082:> import stat 2023-11-28T13:01:42.605 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:01:42.605 DEBUG:teuthology.orchestra.run.smithi082:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2023-11-28T13:01:42.605 DEBUG:teuthology.orchestra.run.smithi082:> ' 2023-11-28T13:01:42.712 INFO:teuthology.orchestra.run.smithi082.stdout:1099511627778 2023-11-28T13:01:42.900 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T13:01:42.901 DEBUG:teuthology.orchestra.run.smithi082:> import os 2023-11-28T13:01:42.901 DEBUG:teuthology.orchestra.run.smithi082:> import stat 2023-11-28T13:01:42.901 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:01:42.901 DEBUG:teuthology.orchestra.run.smithi082:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2023-11-28T13:01:42.901 DEBUG:teuthology.orchestra.run.smithi082:> ' 2023-11-28T13:01:42.970 INFO:teuthology.orchestra.run.smithi082.stdout:1099511627776 2023-11-28T13:01:43.158 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T13:01:43.158 DEBUG:teuthology.orchestra.run.smithi082:> import os 2023-11-28T13:01:43.158 DEBUG:teuthology.orchestra.run.smithi082:> import stat 2023-11-28T13:01:43.158 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:01:43.159 DEBUG:teuthology.orchestra.run.smithi082:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2023-11-28T13:01:43.159 DEBUG:teuthology.orchestra.run.smithi082:> ' 2023-11-28T13:01:43.229 INFO:teuthology.orchestra.run.smithi082.stdout:1099511628279 2023-11-28T13:01:43.418 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T13:01:43.418 DEBUG:teuthology.orchestra.run.smithi082:> import os 2023-11-28T13:01:43.418 DEBUG:teuthology.orchestra.run.smithi082:> import stat 2023-11-28T13:01:43.418 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:01:43.419 DEBUG:teuthology.orchestra.run.smithi082:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2023-11-28T13:01:43.419 DEBUG:teuthology.orchestra.run.smithi082:> ' 2023-11-28T13:01:43.533 INFO:teuthology.orchestra.run.smithi082.stdout:1099511627777 2023-11-28T13:01:43.720 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T13:01:43.720 DEBUG:teuthology.orchestra.run.smithi082:> import os 2023-11-28T13:01:43.721 DEBUG:teuthology.orchestra.run.smithi082:> import stat 2023-11-28T13:01:43.721 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:01:43.721 DEBUG:teuthology.orchestra.run.smithi082:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2023-11-28T13:01:43.721 DEBUG:teuthology.orchestra.run.smithi082:> ' 2023-11-28T13:01:43.789 INFO:teuthology.orchestra.run.smithi082.stdout:1099511628280 2023-11-28T13:01:43.978 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:01:43.978 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:01:43.985 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:01:44.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.142+0000 7f0b3e634700 1 Processor -- start 2023-11-28T13:01:44.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.142+0000 7f0b3e634700 1 -- start start 2023-11-28T13:01:44.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3e634700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0b300df6e0 0x7f0b30038580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:44.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3e634700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0b30034690 0x7f0b30054cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:44.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3e634700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b300dfab0 con 0x7f0b3003ad70 2023-11-28T13:01:44.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3e634700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b30038ac0 con 0x7f0b300df6e0 2023-11-28T13:01:44.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3e634700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3003b330 con 0x7f0b30034690 2023-11-28T13:01:44.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3ce31700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0b3003ad70 0x7f0b300545e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48420/0 (socket says 172.21.15.82:48420) 2023-11-28T13:01:44.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3ce31700 1 -- 172.21.15.82:0/311346497 learned_addr learned my addr 172.21.15.82:0/311346497 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:44.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3d632700 1 --2- 172.21.15.82:0/311346497 >> v2:172.21.15.114:3300/0 conn(0x7f0b300df6e0 0x7f0b30038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:44.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3de33700 1 --2- 172.21.15.82:0/311346497 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0b30034690 0x7f0b30054cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:44.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b2ffff700 1 -- 172.21.15.82:0/311346497 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965333151 0 0) 0x7f0b300dfab0 con 0x7f0b3003ad70 2023-11-28T13:01:44.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b2ffff700 1 -- 172.21.15.82:0/311346497 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b240035d0 con 0x7f0b3003ad70 2023-11-28T13:01:44.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3d632700 1 -- 172.21.15.82:0/311346497 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0b30034690 msgr2=0x7f0b30054cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:44.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3d632700 1 --2- 172.21.15.82:0/311346497 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0b30034690 0x7f0b30054cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3d632700 1 -- 172.21.15.82:0/311346497 >> v1:172.21.15.82:6789/0 conn(0x7f0b3003ad70 legacy=0x7f0b300545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:44.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3d632700 1 -- 172.21.15.82:0/311346497 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b30053b20 con 0x7f0b300df6e0 2023-11-28T13:01:44.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3de33700 1 --2- 172.21.15.82:0/311346497 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0b30034690 0x7f0b30054cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:44.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3d632700 1 --2- 172.21.15.82:0/311346497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b300df6e0 0x7f0b30038580 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009850 tx=0x7f0b34009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=155d358fdf5a8331 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:44.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b2ffff700 1 -- 172.21.15.82:0/311346497 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b34011830 con 0x7f0b300df6e0 2023-11-28T13:01:44.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b2ffff700 1 -- 172.21.15.82:0/311346497 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b34011990 con 0x7f0b300df6e0 2023-11-28T13:01:44.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b2ffff700 1 -- 172.21.15.82:0/311346497 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b34011d00 con 0x7f0b300df6e0 2023-11-28T13:01:44.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3e634700 1 -- 172.21.15.82:0/311346497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b300df6e0 msgr2=0x7f0b30038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:44.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3e634700 1 --2- 172.21.15.82:0/311346497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b300df6e0 0x7f0b30038580 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009850 tx=0x7f0b34009b60 comp rx=0 tx=0).stop 2023-11-28T13:01:44.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3e634700 1 -- 172.21.15.82:0/311346497 shutdown_connections 2023-11-28T13:01:44.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3e634700 1 --2- 172.21.15.82:0/311346497 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0b30034690 0x7f0b30054cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3e634700 1 --2- 172.21.15.82:0/311346497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b300df6e0 0x7f0b30038580 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3e634700 1 -- 172.21.15.82:0/311346497 >> 172.21.15.82:0/311346497 conn(0x7f0b30052000 msgr2=0x7f0b30052400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:44.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3e634700 1 -- 172.21.15.82:0/311346497 shutdown_connections 2023-11-28T13:01:44.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.146+0000 7f0b3e634700 1 -- 172.21.15.82:0/311346497 wait complete. 2023-11-28T13:01:44.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.150+0000 7f0b3e634700 1 Processor -- start 2023-11-28T13:01:44.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.150+0000 7f0b3e634700 1 -- start start 2023-11-28T13:01:44.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.150+0000 7f0b3e634700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0b30034690 0x7f0b300d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.150+0000 7f0b3e634700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3003ad70 0x7f0b30038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.150+0000 7f0b3e634700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b300df6e0 0x7f0b30039140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.150+0000 7f0b3e634700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3004d9d0 con 0x7f0b3003ad70 2023-11-28T13:01:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.150+0000 7f0b3e634700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b300dd1f0 con 0x7f0b300df6e0 2023-11-28T13:01:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.150+0000 7f0b3e634700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3004d070 con 0x7f0b30034690 2023-11-28T13:01:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.150+0000 7f0b3ce31700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3003ad70 0x7f0b30038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.150+0000 7f0b3ce31700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3003ad70 0x7f0b30038c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59730/0 (socket says 172.21.15.82:59730) 2023-11-28T13:01:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.150+0000 7f0b3ce31700 1 -- 172.21.15.82:0/911337579 learned_addr learned my addr 172.21.15.82:0/911337579 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.150+0000 7f0b3d632700 1 --2- 172.21.15.82:0/911337579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0b30034690 0x7f0b300d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.154+0000 7f0b3de33700 1 --2- 172.21.15.82:0/911337579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b300df6e0 0x7f0b30039140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:44.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.154+0000 7f0b3ce31700 1 -- 172.21.15.82:0/911337579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0b30034690 msgr2=0x7f0b300d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:44.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.154+0000 7f0b3ce31700 1 --2- 172.21.15.82:0/911337579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0b30034690 0x7f0b300d2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.154+0000 7f0b3ce31700 1 -- 172.21.15.82:0/911337579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b300df6e0 msgr2=0x7f0b30039140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:44.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.154+0000 7f0b3ce31700 1 --2- 172.21.15.82:0/911337579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b300df6e0 0x7f0b30039140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.154+0000 7f0b3ce31700 1 -- 172.21.15.82:0/911337579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b340094b0 con 0x7f0b3003ad70 2023-11-28T13:01:44.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.154+0000 7f0b3ce31700 1 --2- 172.21.15.82:0/911337579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3003ad70 0x7f0b30038c00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800c700 tx=0x7f0b2800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:44.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.154+0000 7f0b2dffb700 1 -- 172.21.15.82:0/911337579 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b28005d90 con 0x7f0b3003ad70 2023-11-28T13:01:44.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.154+0000 7f0b2dffb700 1 -- 172.21.15.82:0/911337579 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b280070d0 con 0x7f0b3003ad70 2023-11-28T13:01:44.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.154+0000 7f0b3e634700 1 -- 172.21.15.82:0/911337579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b300540e0 con 0x7f0b3003ad70 2023-11-28T13:01:44.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.154+0000 7f0b2dffb700 1 -- 172.21.15.82:0/911337579 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b28007440 con 0x7f0b3003ad70 2023-11-28T13:01:44.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.154+0000 7f0b3e634700 1 -- 172.21.15.82:0/911337579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b30053e00 con 0x7f0b3003ad70 2023-11-28T13:01:44.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.154+0000 7f0b3e634700 1 -- 172.21.15.82:0/911337579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b30034da0 con 0x7f0b3003ad70 2023-11-28T13:01:44.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.154+0000 7f0b2dffb700 1 -- 172.21.15.82:0/911337579 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0b28019030 con 0x7f0b3003ad70 2023-11-28T13:01:44.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.154+0000 7f0b2dffb700 1 --2- 172.21.15.82:0/911337579 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0b1c064ee0 0x7f0b1c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:44.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.158+0000 7f0b2dffb700 1 -- 172.21.15.82:0/911337579 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b28080fb0 con 0x7f0b3003ad70 2023-11-28T13:01:44.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.158+0000 7f0b3d632700 1 --2- 172.21.15.82:0/911337579 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0b1c064ee0 0x7f0b1c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:44.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.158+0000 7f0b3d632700 1 --2- 172.21.15.82:0/911337579 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0b1c064ee0 0x7f0b1c067390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0b340090b0 tx=0x7f0b34008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:44.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.162+0000 7f0b2dffb700 1 -- 172.21.15.82:0/911337579 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0b2804a400 con 0x7f0b3003ad70 2023-11-28T13:01:44.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.330+0000 7f0b3e634700 1 -- 172.21.15.82:0/911337579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b3004db10 con 0x7f0b3003ad70 2023-11-28T13:01:44.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.334+0000 7f0b2dffb700 1 -- 172.21.15.82:0/911337579 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+17883 (secure 0 0 0) 0x7f0b28017020 con 0x7f0b3003ad70 2023-11-28T13:01:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:44.339 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":38,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:01:30.589673+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:01:27.651123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T13:01:28.580057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:01:44.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.334+0000 7f0b3e634700 1 -- 172.21.15.82:0/911337579 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0b1c064ee0 msgr2=0x7f0b1c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:44.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.334+0000 7f0b3e634700 1 --2- 172.21.15.82:0/911337579 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0b1c064ee0 0x7f0b1c067390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0b340090b0 tx=0x7f0b34008030 comp rx=0 tx=0).stop 2023-11-28T13:01:44.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.334+0000 7f0b3e634700 1 -- 172.21.15.82:0/911337579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3003ad70 msgr2=0x7f0b30038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:44.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.334+0000 7f0b3e634700 1 --2- 172.21.15.82:0/911337579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3003ad70 0x7f0b30038c00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800c700 tx=0x7f0b2800ca10 comp rx=0 tx=0).stop 2023-11-28T13:01:44.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.334+0000 7f0b3e634700 1 -- 172.21.15.82:0/911337579 shutdown_connections 2023-11-28T13:01:44.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.334+0000 7f0b3e634700 1 --2- 172.21.15.82:0/911337579 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0b1c064ee0 0x7f0b1c067390 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.334+0000 7f0b3e634700 1 --2- 172.21.15.82:0/911337579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b300df6e0 0x7f0b30039140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.334+0000 7f0b3e634700 1 --2- 172.21.15.82:0/911337579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3003ad70 0x7f0b30038c00 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.334+0000 7f0b3e634700 1 --2- 172.21.15.82:0/911337579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0b30034690 0x7f0b300d2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.334+0000 7f0b3e634700 1 -- 172.21.15.82:0/911337579 >> 172.21.15.82:0/911337579 conn(0x7f0b30052000 msgr2=0x7f0b300d4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:44.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.334+0000 7f0b3e634700 1 -- 172.21.15.82:0/911337579 shutdown_connections 2023-11-28T13:01:44.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.334+0000 7f0b3e634700 1 -- 172.21.15.82:0/911337579 wait complete. 2023-11-28T13:01:44.354 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T13:01:27.651123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T13:01:28.580057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:01:44.354 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:01:44.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.462+0000 7fdc6cc52700 1 Processor -- start 2023-11-28T13:01:44.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.462+0000 7fdc6cc52700 1 -- start start 2023-11-28T13:01:44.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc6cc52700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc680b1d10 0x7fdc680cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:44.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc6cc52700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc68069bc0 con 0x7fdc6806c140 2023-11-28T13:01:44.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc6cc52700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc680d1480 con 0x7fdc680d25b0 2023-11-28T13:01:44.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc6cc52700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc680cd280 con 0x7fdc680b1d10 2023-11-28T13:01:44.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc67fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdc6806c140 0x7fdc6806a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48422/0 (socket says 172.21.15.82:48422) 2023-11-28T13:01:44.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc67fff700 1 -- 172.21.15.82:0/144710088 learned_addr learned my addr 172.21.15.82:0/144710088 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc677fe700 1 --2- 172.21.15.82:0/144710088 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc680b1d10 0x7fdc680cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc667fc700 1 -- 172.21.15.82:0/144710088 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560182554 0 0) 0x7fdc68069bc0 con 0x7fdc6806c140 2023-11-28T13:01:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc667fc700 1 -- 172.21.15.82:0/144710088 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc500035d0 con 0x7fdc6806c140 2023-11-28T13:01:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc667fc700 1 -- 172.21.15.82:0/144710088 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495431299 0 0) 0x7fdc680d1480 con 0x7fdc680d25b0 2023-11-28T13:01:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc667fc700 1 -- 172.21.15.82:0/144710088 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc68069bc0 con 0x7fdc680d25b0 2023-11-28T13:01:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc667fc700 1 -- 172.21.15.82:0/144710088 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3919617374 0 0) 0x7fdc500035d0 con 0x7fdc6806c140 2023-11-28T13:01:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc667fc700 1 -- 172.21.15.82:0/144710088 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc680b1d10 msgr2=0x7fdc680cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc667fc700 1 --2- 172.21.15.82:0/144710088 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc680b1d10 0x7fdc680cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc667fc700 1 -- 172.21.15.82:0/144710088 >> v1:172.21.15.114:6789/0 conn(0x7fdc680d25b0 legacy=0x7fdc6806ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc667fc700 1 -- 172.21.15.82:0/144710088 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc680cd560 con 0x7fdc6806c140 2023-11-28T13:01:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc667fc700 1 -- 172.21.15.82:0/144710088 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7fdc600019f0 con 0x7fdc6806c140 2023-11-28T13:01:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc667fc700 1 -- 172.21.15.82:0/144710088 >> v1:172.21.15.82:6789/0 conn(0x7fdc6806c140 legacy=0x7fdc6806a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc667fc700 1 --2- 172.21.15.82:0/144710088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc50003be0 0x7fdc50003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc667fc700 1 --2- 172.21.15.82:0/144710088 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc680b1d10 0x7fdc50004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc667fc700 1 --2- 172.21.15.82:0/144710088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc50004db0 0x7fdc50005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc667fc700 1 -- 172.21.15.82:0/144710088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc680cd280 con 0x7fdc50003be0 2023-11-28T13:01:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc667fc700 1 -- 172.21.15.82:0/144710088 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5000bae0 con 0x7fdc50004db0 2023-11-28T13:01:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc667fc700 1 -- 172.21.15.82:0/144710088 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5000bca0 con 0x7fdc680b1d10 2023-11-28T13:01:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc677fe700 1 --2- 172.21.15.82:0/144710088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc50003be0 0x7fdc50003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc67fff700 1 --2- 172.21.15.82:0/144710088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc50004db0 0x7fdc50005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc66ffd700 1 --2- 172.21.15.82:0/144710088 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc680b1d10 0x7fdc50004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc677fe700 1 -- 172.21.15.82:0/144710088 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc680b1d10 msgr2=0x7fdc50004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:44.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc677fe700 1 --2- 172.21.15.82:0/144710088 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc680b1d10 0x7fdc50004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc677fe700 1 -- 172.21.15.82:0/144710088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc50004db0 msgr2=0x7fdc50005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc677fe700 1 --2- 172.21.15.82:0/144710088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc50004db0 0x7fdc50005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc677fe700 1 -- 172.21.15.82:0/144710088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc500035d0 con 0x7fdc50003be0 2023-11-28T13:01:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc677fe700 1 --2- 172.21.15.82:0/144710088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc50003be0 0x7fdc50003fd0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c009b40 tx=0x7fdc500058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ee5ac5435b62eb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc667fc700 1 -- 172.21.15.82:0/144710088 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c00e6c0 con 0x7fdc50003be0 2023-11-28T13:01:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc667fc700 1 -- 172.21.15.82:0/144710088 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c00e820 con 0x7fdc50003be0 2023-11-28T13:01:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc667fc700 1 -- 172.21.15.82:0/144710088 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c00eb90 con 0x7fdc50003be0 2023-11-28T13:01:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc6cc52700 1 -- 172.21.15.82:0/144710088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc50003be0 msgr2=0x7fdc50003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc6cc52700 1 --2- 172.21.15.82:0/144710088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc50003be0 0x7fdc50003fd0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c009b40 tx=0x7fdc500058a0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc67fff700 1 -- 172.21.15.82:0/144710088 reap_dead start 2023-11-28T13:01:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc6cc52700 1 -- 172.21.15.82:0/144710088 shutdown_connections 2023-11-28T13:01:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc6cc52700 1 -- 172.21.15.82:0/144710088 >> 172.21.15.82:0/144710088 conn(0x7fdc680b52a0 msgr2=0x7fdc680d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc6cc52700 1 -- 172.21.15.82:0/144710088 shutdown_connections 2023-11-28T13:01:44.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.466+0000 7fdc6cc52700 1 -- 172.21.15.82:0/144710088 wait complete. 2023-11-28T13:01:44.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.470+0000 7fdc6cc52700 1 Processor -- start 2023-11-28T13:01:44.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.470+0000 7fdc6cc52700 1 -- start start 2023-11-28T13:01:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc6cc52700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc50003be0 0x7fdc680cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc6cc52700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc680b77f0 0x7fdc680b6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc6cc52700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc680b7c40 0x7fdc680b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc6cc52700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc680cca90 con 0x7fdc50003be0 2023-11-28T13:01:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc6cc52700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6815ead0 con 0x7fdc680b77f0 2023-11-28T13:01:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc6cc52700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc680c9b40 con 0x7fdc680b7c40 2023-11-28T13:01:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc677fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc50003be0 0x7fdc680cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc677fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc50003be0 0x7fdc680cc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59742/0 (socket says 172.21.15.82:59742) 2023-11-28T13:01:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc677fe700 1 -- 172.21.15.82:0/594132844 learned_addr learned my addr 172.21.15.82:0/594132844 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc66ffd700 1 --2- 172.21.15.82:0/594132844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc680b77f0 0x7fdc680b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc67fff700 1 --2- 172.21.15.82:0/594132844 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc680b7c40 0x7fdc680b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc677fe700 1 -- 172.21.15.82:0/594132844 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc680b7c40 msgr2=0x7fdc680b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc677fe700 1 --2- 172.21.15.82:0/594132844 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc680b7c40 0x7fdc680b6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc677fe700 1 -- 172.21.15.82:0/594132844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc680b77f0 msgr2=0x7fdc680b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc677fe700 1 --2- 172.21.15.82:0/594132844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc680b77f0 0x7fdc680b6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc677fe700 1 -- 172.21.15.82:0/594132844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc680d1050 con 0x7fdc50003be0 2023-11-28T13:01:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc677fe700 1 --2- 172.21.15.82:0/594132844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc50003be0 0x7fdc680cc550 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00a010 tx=0x7fdc5c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc4ffff700 1 -- 172.21.15.82:0/594132844 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c00e6c0 con 0x7fdc50003be0 2023-11-28T13:01:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc4ffff700 1 -- 172.21.15.82:0/594132844 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c01c690 con 0x7fdc50003be0 2023-11-28T13:01:44.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc6cc52700 1 -- 172.21.15.82:0/594132844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc680b20e0 con 0x7fdc50003be0 2023-11-28T13:01:44.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc4ffff700 1 -- 172.21.15.82:0/594132844 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c01ca40 con 0x7fdc50003be0 2023-11-28T13:01:44.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.474+0000 7fdc6cc52700 1 -- 172.21.15.82:0/594132844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc680d11e0 con 0x7fdc50003be0 2023-11-28T13:01:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.478+0000 7fdc6cc52700 1 -- 172.21.15.82:0/594132844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc68065fc0 con 0x7fdc50003be0 2023-11-28T13:01:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.478+0000 7fdc4ffff700 1 -- 172.21.15.82:0/594132844 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdc5c019030 con 0x7fdc50003be0 2023-11-28T13:01:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.478+0000 7fdc4ffff700 1 --2- 172.21.15.82:0/594132844 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdc54064f10 0x7fdc540673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.478+0000 7fdc4ffff700 1 -- 172.21.15.82:0/594132844 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdc5c0835d0 con 0x7fdc50003be0 2023-11-28T13:01:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.478+0000 7fdc66ffd700 1 --2- 172.21.15.82:0/594132844 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdc54064f10 0x7fdc540673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.478+0000 7fdc66ffd700 1 --2- 172.21.15.82:0/594132844 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdc54064f10 0x7fdc540673c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdc6815afe0 tx=0x7fdc58009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:44.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.486+0000 7fdc4ffff700 1 -- 172.21.15.82:0/594132844 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdc5c051770 con 0x7fdc50003be0 2023-11-28T13:01:44.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.646+0000 7fdc6cc52700 1 -- 172.21.15.82:0/594132844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdc6815ad30 con 0x7fdc50003be0 2023-11-28T13:01:44.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.646+0000 7fdc4ffff700 1 -- 172.21.15.82:0/594132844 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdc5c054d90 con 0x7fdc50003be0 2023-11-28T13:01:44.652 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:01:44.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.646+0000 7fdc6cc52700 1 -- 172.21.15.82:0/594132844 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdc54064f10 msgr2=0x7fdc540673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:44.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.646+0000 7fdc6cc52700 1 --2- 172.21.15.82:0/594132844 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdc54064f10 0x7fdc540673c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdc6815afe0 tx=0x7fdc58009040 comp rx=0 tx=0).stop 2023-11-28T13:01:44.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.646+0000 7fdc6cc52700 1 -- 172.21.15.82:0/594132844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc50003be0 msgr2=0x7fdc680cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:44.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.646+0000 7fdc6cc52700 1 --2- 172.21.15.82:0/594132844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc50003be0 0x7fdc680cc550 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00a010 tx=0x7fdc5c0047e0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.650+0000 7fdc6cc52700 1 -- 172.21.15.82:0/594132844 shutdown_connections 2023-11-28T13:01:44.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.650+0000 7fdc6cc52700 1 --2- 172.21.15.82:0/594132844 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdc54064f10 0x7fdc540673c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.650+0000 7fdc6cc52700 1 --2- 172.21.15.82:0/594132844 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdc680b7c40 0x7fdc680b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.650+0000 7fdc6cc52700 1 --2- 172.21.15.82:0/594132844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc680b77f0 0x7fdc680b6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.650+0000 7fdc6cc52700 1 --2- 172.21.15.82:0/594132844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc50003be0 0x7fdc680cc550 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.650+0000 7fdc6cc52700 1 -- 172.21.15.82:0/594132844 >> 172.21.15.82:0/594132844 conn(0x7fdc680b52a0 msgr2=0x7fdc680b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:44.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.650+0000 7fdc6cc52700 1 -- 172.21.15.82:0/594132844 shutdown_connections 2023-11-28T13:01:44.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.650+0000 7fdc6cc52700 1 -- 172.21.15.82:0/594132844 wait complete. 2023-11-28T13:01:44.669 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:01:44.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.778+0000 7fc682717700 1 Processor -- start 2023-11-28T13:01:44.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.778+0000 7fc682717700 1 -- start start 2023-11-28T13:01:44.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc682717700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc67c0b1d10 0x7fc67c0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:44.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc682717700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc67c06c140 0x7fc67c06a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:44.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc682717700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc67c069bc0 con 0x7fc67c0d25b0 2023-11-28T13:01:44.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc682717700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc67c0d1480 con 0x7fc67c0b1d10 2023-11-28T13:01:44.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc682717700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc67c0cd280 con 0x7fc67c06c140 2023-11-28T13:01:44.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc681715700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc67c0b1d10 0x7fc67c0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:44.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc681715700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc67c0b1d10 0x7fc67c0cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59744/0 (socket says 172.21.15.82:59744) 2023-11-28T13:01:44.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc681715700 1 -- 172.21.15.82:0/1190999169 learned_addr learned my addr 172.21.15.82:0/1190999169 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:44.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc681f16700 1 --2- 172.21.15.82:0/1190999169 >> v2:172.21.15.114:3300/0 conn(0x7fc67c06c140 0x7fc67c06a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:44.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc681715700 1 -- 172.21.15.82:0/1190999169 >> v2:172.21.15.114:3300/0 conn(0x7fc67c06c140 msgr2=0x7fc67c06a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:44.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc681715700 1 --2- 172.21.15.82:0/1190999169 >> v2:172.21.15.114:3300/0 conn(0x7fc67c06c140 0x7fc67c06a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc681715700 1 -- 172.21.15.82:0/1190999169 >> v1:172.21.15.114:6789/0 conn(0x7fc67c0d25b0 legacy=0x7fc67c06ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc681715700 1 -- 172.21.15.82:0/1190999169 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67c0cd560 con 0x7fc67c0b1d10 2023-11-28T13:01:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc681f16700 1 --2- 172.21.15.82:0/1190999169 >> v2:172.21.15.114:3300/0 conn(0x7fc67c06c140 0x7fc67c06a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc681715700 1 --2- 172.21.15.82:0/1190999169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c0b1d10 0x7fc67c0cec20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0c9af0 tx=0x7fc66c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7abb440f4e22761 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc673fff700 1 -- 172.21.15.82:0/1190999169 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c011830 con 0x7fc67c0b1d10 2023-11-28T13:01:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc673fff700 1 -- 172.21.15.82:0/1190999169 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66c011990 con 0x7fc67c0b1d10 2023-11-28T13:01:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc673fff700 1 -- 172.21.15.82:0/1190999169 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c011d20 con 0x7fc67c0b1d10 2023-11-28T13:01:44.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc682717700 1 -- 172.21.15.82:0/1190999169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c0b1d10 msgr2=0x7fc67c0cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:44.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc682717700 1 --2- 172.21.15.82:0/1190999169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c0b1d10 0x7fc67c0cec20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0c9af0 tx=0x7fc66c009bf0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc682717700 1 -- 172.21.15.82:0/1190999169 shutdown_connections 2023-11-28T13:01:44.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc682717700 1 --2- 172.21.15.82:0/1190999169 >> v2:172.21.15.114:3300/0 conn(0x7fc67c06c140 0x7fc67c06a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc682717700 1 --2- 172.21.15.82:0/1190999169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c0b1d10 0x7fc67c0cec20 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc682717700 1 -- 172.21.15.82:0/1190999169 >> 172.21.15.82:0/1190999169 conn(0x7fc67c0b52a0 msgr2=0x7fc67c0d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:44.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc682717700 1 -- 172.21.15.82:0/1190999169 shutdown_connections 2023-11-28T13:01:44.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.782+0000 7fc682717700 1 -- 172.21.15.82:0/1190999169 wait complete. 2023-11-28T13:01:44.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.786+0000 7fc682717700 1 Processor -- start 2023-11-28T13:01:44.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.786+0000 7fc682717700 1 -- start start 2023-11-28T13:01:44.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.786+0000 7fc682717700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c06c140 0x7fc67c150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:44.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.786+0000 7fc682717700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc67c0b1d10 0x7fc67c15c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:44.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.786+0000 7fc682717700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc67c0d25b0 0x7fc67c0cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:44.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.786+0000 7fc682717700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c1597b0 con 0x7fc67c06c140 2023-11-28T13:01:44.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.786+0000 7fc682717700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c15cc90 con 0x7fc67c0b1d10 2023-11-28T13:01:44.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.786+0000 7fc682717700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c15cf70 con 0x7fc67c0d25b0 2023-11-28T13:01:44.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.786+0000 7fc681715700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c06c140 0x7fc67c150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:44.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.786+0000 7fc681715700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c06c140 0x7fc67c150dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59746/0 (socket says 172.21.15.82:59746) 2023-11-28T13:01:44.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.786+0000 7fc681715700 1 -- 172.21.15.82:0/532119225 learned_addr learned my addr 172.21.15.82:0/532119225 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:44.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.786+0000 7fc680f14700 1 --2- 172.21.15.82:0/532119225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc67c0b1d10 0x7fc67c15c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:44.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.786+0000 7fc681f16700 1 --2- 172.21.15.82:0/532119225 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc67c0d25b0 0x7fc67c0cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:44.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.786+0000 7fc681715700 1 -- 172.21.15.82:0/532119225 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc67c0d25b0 msgr2=0x7fc67c0cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:44.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.786+0000 7fc681715700 1 --2- 172.21.15.82:0/532119225 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc67c0d25b0 0x7fc67c0cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.786+0000 7fc681715700 1 -- 172.21.15.82:0/532119225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc67c0b1d10 msgr2=0x7fc67c15c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:44.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.786+0000 7fc681715700 1 --2- 172.21.15.82:0/532119225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc67c0b1d10 0x7fc67c15c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.786+0000 7fc681715700 1 -- 172.21.15.82:0/532119225 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc674009a70 con 0x7fc67c06c140 2023-11-28T13:01:44.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.786+0000 7fc681f16700 1 --2- 172.21.15.82:0/532119225 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc67c0d25b0 0x7fc67c0cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:01:44.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.790+0000 7fc681715700 1 --2- 172.21.15.82:0/532119225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c06c140 0x7fc67c150dc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc67c06c790 tx=0x7fc66c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:44.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.790+0000 7fc671ffb700 1 -- 172.21.15.82:0/532119225 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c004480 con 0x7fc67c06c140 2023-11-28T13:01:44.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.790+0000 7fc671ffb700 1 -- 172.21.15.82:0/532119225 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66c01f070 con 0x7fc67c06c140 2023-11-28T13:01:44.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.790+0000 7fc682717700 1 -- 172.21.15.82:0/532119225 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66c009570 con 0x7fc67c06c140 2023-11-28T13:01:44.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.790+0000 7fc671ffb700 1 -- 172.21.15.82:0/532119225 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c0038e0 con 0x7fc67c06c140 2023-11-28T13:01:44.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.790+0000 7fc682717700 1 -- 172.21.15.82:0/532119225 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc67c0d1050 con 0x7fc67c06c140 2023-11-28T13:01:44.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.790+0000 7fc682717700 1 -- 172.21.15.82:0/532119225 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc67c0b20e0 con 0x7fc67c06c140 2023-11-28T13:01:44.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.790+0000 7fc671ffb700 1 -- 172.21.15.82:0/532119225 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc66c02a020 con 0x7fc67c06c140 2023-11-28T13:01:44.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.794+0000 7fc671ffb700 1 --2- 172.21.15.82:0/532119225 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc660064ee0 0x7fc660067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:44.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.794+0000 7fc680f14700 1 --2- 172.21.15.82:0/532119225 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc660064ee0 0x7fc660067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:44.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.794+0000 7fc671ffb700 1 -- 172.21.15.82:0/532119225 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc66c083550 con 0x7fc67c06c140 2023-11-28T13:01:44.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.794+0000 7fc680f14700 1 --2- 172.21.15.82:0/532119225 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc660064ee0 0x7fc660067390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0cf040 tx=0x7fc678009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:44.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.798+0000 7fc671ffb700 1 -- 172.21.15.82:0/532119225 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc66c0516f0 con 0x7fc67c06c140 2023-11-28T13:01:44.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.962+0000 7fc682717700 1 -- 172.21.15.82:0/532119225 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc67c0d11e0 con 0x7fc67c06c140 2023-11-28T13:01:44.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.962+0000 7fc671ffb700 1 -- 172.21.15.82:0/532119225 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc66c054d10 con 0x7fc67c06c140 2023-11-28T13:01:44.968 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:01:44.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.966+0000 7fc682717700 1 -- 172.21.15.82:0/532119225 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc660064ee0 msgr2=0x7fc660067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:44.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.966+0000 7fc682717700 1 --2- 172.21.15.82:0/532119225 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc660064ee0 0x7fc660067390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0cf040 tx=0x7fc678009040 comp rx=0 tx=0).stop 2023-11-28T13:01:44.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.966+0000 7fc682717700 1 -- 172.21.15.82:0/532119225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c06c140 msgr2=0x7fc67c150dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:44.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.966+0000 7fc682717700 1 --2- 172.21.15.82:0/532119225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c06c140 0x7fc67c150dc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc67c06c790 tx=0x7fc66c004770 comp rx=0 tx=0).stop 2023-11-28T13:01:44.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.966+0000 7fc682717700 1 -- 172.21.15.82:0/532119225 shutdown_connections 2023-11-28T13:01:44.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.966+0000 7fc682717700 1 --2- 172.21.15.82:0/532119225 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc660064ee0 0x7fc660067390 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.966+0000 7fc682717700 1 --2- 172.21.15.82:0/532119225 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc67c0d25b0 0x7fc67c0cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.966+0000 7fc682717700 1 --2- 172.21.15.82:0/532119225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc67c0b1d10 0x7fc67c15c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.966+0000 7fc682717700 1 --2- 172.21.15.82:0/532119225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67c06c140 0x7fc67c150dc0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:44.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.966+0000 7fc682717700 1 -- 172.21.15.82:0/532119225 >> 172.21.15.82:0/532119225 conn(0x7fc67c0b52a0 msgr2=0x7fc67c15fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:44.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.966+0000 7fc682717700 1 -- 172.21.15.82:0/532119225 shutdown_connections 2023-11-28T13:01:44.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:44.966+0000 7fc682717700 1 -- 172.21.15.82:0/532119225 wait complete. 2023-11-28T13:01:44.987 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T13:01:45.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.102+0000 7f8b1ca41700 1 Processor -- start 2023-11-28T13:01:45.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.102+0000 7f8b1ca41700 1 -- start start 2023-11-28T13:01:45.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.102+0000 7f8b1ca41700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8b1806be60 0x7f8b180b6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:45.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.102+0000 7f8b1ca41700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b180d1050 con 0x7f8b1806ba30 2023-11-28T13:01:45.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.102+0000 7f8b1ca41700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b180cd0c0 con 0x7f8b180b1f30 2023-11-28T13:01:45.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.102+0000 7f8b1ca41700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b180b2300 con 0x7f8b1806be60 2023-11-28T13:01:45.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.102+0000 7f8b1659c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8b1806ba30 0x7f8b180b5c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48436/0 (socket says 172.21.15.82:48436) 2023-11-28T13:01:45.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.102+0000 7f8b1659c700 1 -- 172.21.15.82:0/3362990363 learned_addr learned my addr 172.21.15.82:0/3362990363 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:45.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.102+0000 7f8b1759e700 1 --2- 172.21.15.82:0/3362990363 >> v2:172.21.15.114:3300/0 conn(0x7f8b1806be60 0x7f8b180b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:45.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.102+0000 7f8b15d9b700 1 -- 172.21.15.82:0/3362990363 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080603897 0 0) 0x7f8b180d1050 con 0x7f8b1806ba30 2023-11-28T13:01:45.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.102+0000 7f8b15d9b700 1 -- 172.21.15.82:0/3362990363 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b000035d0 con 0x7f8b1806ba30 2023-11-28T13:01:45.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.102+0000 7f8b1759e700 1 -- 172.21.15.82:0/3362990363 >> v1:172.21.15.114:6789/0 conn(0x7f8b180b1f30 legacy=0x7f8b180d2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:45.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.102+0000 7f8b1759e700 1 -- 172.21.15.82:0/3362990363 >> v1:172.21.15.82:6789/0 conn(0x7f8b1806ba30 legacy=0x7f8b180b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:45.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.102+0000 7f8b1759e700 1 -- 172.21.15.82:0/3362990363 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b180d12a0 con 0x7f8b1806be60 2023-11-28T13:01:45.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.106+0000 7f8b1759e700 1 --2- 172.21.15.82:0/3362990363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b1806be60 0x7f8b180b6330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8b10009d90 tx=0x7f8b1000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a904eb505fec2d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:45.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.106+0000 7f8b15d9b700 1 -- 172.21.15.82:0/3362990363 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1000e070 con 0x7f8b1806be60 2023-11-28T13:01:45.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.106+0000 7f8b15d9b700 1 -- 172.21.15.82:0/3362990363 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1000bb20 con 0x7f8b1806be60 2023-11-28T13:01:45.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.106+0000 7f8b15d9b700 1 -- 172.21.15.82:0/3362990363 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b10012430 con 0x7f8b1806be60 2023-11-28T13:01:45.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.106+0000 7f8b1ca41700 1 -- 172.21.15.82:0/3362990363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b1806be60 msgr2=0x7f8b180b6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:45.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.106+0000 7f8b1ca41700 1 --2- 172.21.15.82:0/3362990363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b1806be60 0x7f8b180b6330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8b10009d90 tx=0x7f8b1000b330 comp rx=0 tx=0).stop 2023-11-28T13:01:45.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.106+0000 7f8b1ca41700 1 -- 172.21.15.82:0/3362990363 shutdown_connections 2023-11-28T13:01:45.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.106+0000 7f8b1ca41700 1 --2- 172.21.15.82:0/3362990363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b1806be60 0x7f8b180b6330 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.106+0000 7f8b1ca41700 1 -- 172.21.15.82:0/3362990363 >> 172.21.15.82:0/3362990363 conn(0x7f8b180b52d0 msgr2=0x7f8b180d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:45.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.106+0000 7f8b1ca41700 1 -- 172.21.15.82:0/3362990363 shutdown_connections 2023-11-28T13:01:45.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.106+0000 7f8b1ca41700 1 -- 172.21.15.82:0/3362990363 wait complete. 2023-11-28T13:01:45.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.106+0000 7f8b1ca41700 1 Processor -- start 2023-11-28T13:01:45.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.106+0000 7f8b1ca41700 1 -- start start 2023-11-28T13:01:45.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8b1ca41700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b1806ba30 0x7f8b181560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:45.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8b1ca41700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b1806be60 0x7f8b180c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:45.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8b1ca41700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8b180b1f30 0x7f8b180b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:45.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8b1ca41700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b180cb1a0 con 0x7f8b1806be60 2023-11-28T13:01:45.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8b1ca41700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b18156610 con 0x7f8b1806ba30 2023-11-28T13:01:45.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8b1ca41700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b180ca440 con 0x7f8b180b1f30 2023-11-28T13:01:45.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8b1659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b1806be60 0x7f8b180c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:45.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8b1659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b1806be60 0x7f8b180c9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59752/0 (socket says 172.21.15.82:59752) 2023-11-28T13:01:45.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8b1659c700 1 -- 172.21.15.82:0/2566097456 learned_addr learned my addr 172.21.15.82:0/2566097456 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:45.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8b16d9d700 1 --2- 172.21.15.82:0/2566097456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b1806ba30 0x7f8b181560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:45.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8b1759e700 1 --2- 172.21.15.82:0/2566097456 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8b180b1f30 0x7f8b180b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:45.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8b1659c700 1 -- 172.21.15.82:0/2566097456 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8b180b1f30 msgr2=0x7f8b180b68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:45.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8b1659c700 1 --2- 172.21.15.82:0/2566097456 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8b180b1f30 0x7f8b180b68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8b1659c700 1 -- 172.21.15.82:0/2566097456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b1806ba30 msgr2=0x7f8b181560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:45.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8b1659c700 1 --2- 172.21.15.82:0/2566097456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b1806ba30 0x7f8b181560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8b1659c700 1 -- 172.21.15.82:0/2566097456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b10009a70 con 0x7f8b1806be60 2023-11-28T13:01:45.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8b1659c700 1 --2- 172.21.15.82:0/2566097456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b1806be60 0x7f8b180c9b40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8b0800c4d0 tx=0x7f8b0800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:45.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8aff7fe700 1 -- 172.21.15.82:0/2566097456 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b08005d90 con 0x7f8b1806be60 2023-11-28T13:01:45.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8aff7fe700 1 -- 172.21.15.82:0/2566097456 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b080070d0 con 0x7f8b1806be60 2023-11-28T13:01:45.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8b1ca41700 1 -- 172.21.15.82:0/2566097456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b180cd380 con 0x7f8b1806be60 2023-11-28T13:01:45.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8aff7fe700 1 -- 172.21.15.82:0/2566097456 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b08007480 con 0x7f8b1806be60 2023-11-28T13:01:45.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.110+0000 7f8b1ca41700 1 -- 172.21.15.82:0/2566097456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b180d1580 con 0x7f8b1806be60 2023-11-28T13:01:45.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.114+0000 7f8b1ca41700 1 -- 172.21.15.82:0/2566097456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b180cd660 con 0x7f8b1806be60 2023-11-28T13:01:45.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.114+0000 7f8aff7fe700 1 -- 172.21.15.82:0/2566097456 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8b08019030 con 0x7f8b1806be60 2023-11-28T13:01:45.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.114+0000 7f8aff7fe700 1 --2- 172.21.15.82:0/2566097456 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8b04064ee0 0x7f8b04067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:45.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.114+0000 7f8aff7fe700 1 -- 172.21.15.82:0/2566097456 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8b08081120 con 0x7f8b1806be60 2023-11-28T13:01:45.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.114+0000 7f8b16d9d700 1 --2- 172.21.15.82:0/2566097456 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8b04064ee0 0x7f8b04067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:45.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.114+0000 7f8b16d9d700 1 --2- 172.21.15.82:0/2566097456 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8b04064ee0 0x7f8b04067390 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c000f60 tx=0x7f8b0c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:45.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.122+0000 7f8aff7fe700 1 -- 172.21.15.82:0/2566097456 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8b0804f2c0 con 0x7f8b1806be60 2023-11-28T13:01:45.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.286+0000 7f8b1ca41700 1 -- 172.21.15.82:0/2566097456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8b1806c280 con 0x7f8b1806be60 2023-11-28T13:01:45.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.286+0000 7f8aff7fe700 1 -- 172.21.15.82:0/2566097456 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8b080528e0 con 0x7f8b1806be60 2023-11-28T13:01:45.292 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-11-28T13:01:45.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.290+0000 7f8b1ca41700 1 -- 172.21.15.82:0/2566097456 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8b04064ee0 msgr2=0x7f8b04067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:45.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.290+0000 7f8b1ca41700 1 --2- 172.21.15.82:0/2566097456 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8b04064ee0 0x7f8b04067390 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c000f60 tx=0x7f8b0c009040 comp rx=0 tx=0).stop 2023-11-28T13:01:45.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.290+0000 7f8b1ca41700 1 -- 172.21.15.82:0/2566097456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b1806be60 msgr2=0x7f8b180c9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:45.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.290+0000 7f8b1ca41700 1 --2- 172.21.15.82:0/2566097456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b1806be60 0x7f8b180c9b40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8b0800c4d0 tx=0x7f8b0800c7e0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.290+0000 7f8b1ca41700 1 -- 172.21.15.82:0/2566097456 shutdown_connections 2023-11-28T13:01:45.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.290+0000 7f8b1ca41700 1 --2- 172.21.15.82:0/2566097456 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8b04064ee0 0x7f8b04067390 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.290+0000 7f8b1ca41700 1 --2- 172.21.15.82:0/2566097456 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8b180b1f30 0x7f8b180b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.290+0000 7f8b1ca41700 1 --2- 172.21.15.82:0/2566097456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b1806be60 0x7f8b180c9b40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.290+0000 7f8b1ca41700 1 --2- 172.21.15.82:0/2566097456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b1806ba30 0x7f8b181560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.290+0000 7f8b1ca41700 1 -- 172.21.15.82:0/2566097456 >> 172.21.15.82:0/2566097456 conn(0x7f8b180b52d0 msgr2=0x7f8b180cec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:45.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.290+0000 7f8b1ca41700 1 -- 172.21.15.82:0/2566097456 shutdown_connections 2023-11-28T13:01:45.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.290+0000 7f8b1ca41700 1 -- 172.21.15.82:0/2566097456 wait complete. 2023-11-28T13:01:45.307 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T13:01:45.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.418+0000 7f1fb9d4d700 1 Processor -- start 2023-11-28T13:01:45.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.418+0000 7f1fb9d4d700 1 -- start start 2023-11-28T13:01:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.418+0000 7f1fb9d4d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1fb406c140 0x7f1fb40cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.418+0000 7f1fb9d4d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1fb40d25b0 0x7f1fb406a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.418+0000 7f1fb9d4d700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb4069bc0 con 0x7f1fb40b1d10 2023-11-28T13:01:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.418+0000 7f1fb9d4d700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb40d1480 con 0x7f1fb406c140 2023-11-28T13:01:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.418+0000 7f1fb9d4d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb40cd280 con 0x7f1fb40d25b0 2023-11-28T13:01:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.418+0000 7f1fb3fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1fb406c140 0x7f1fb40cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.418+0000 7f1fb3fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1fb406c140 0x7f1fb40cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59756/0 (socket says 172.21.15.82:59756) 2023-11-28T13:01:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.418+0000 7f1fb8d4b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1fb40b1d10 0x7f1fb406ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48452/0 (socket says 172.21.15.82:48452) 2023-11-28T13:01:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.418+0000 7f1fb3fff700 1 -- 172.21.15.82:0/3312417634 learned_addr learned my addr 172.21.15.82:0/3312417634 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.418+0000 7f1fb954c700 1 --2- 172.21.15.82:0/3312417634 >> v2:172.21.15.114:3300/0 conn(0x7f1fb40d25b0 0x7f1fb406a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.418+0000 7f1fb37fe700 1 -- 172.21.15.82:0/3312417634 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778144042 0 0) 0x7f1fb4069bc0 con 0x7f1fb40b1d10 2023-11-28T13:01:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.418+0000 7f1fb3fff700 1 -- 172.21.15.82:0/3312417634 >> v2:172.21.15.114:3300/0 conn(0x7f1fb40d25b0 msgr2=0x7f1fb406a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.418+0000 7f1fb3fff700 1 --2- 172.21.15.82:0/3312417634 >> v2:172.21.15.114:3300/0 conn(0x7f1fb40d25b0 0x7f1fb406a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.418+0000 7f1fb3fff700 1 -- 172.21.15.82:0/3312417634 >> v1:172.21.15.82:6789/0 conn(0x7f1fb40b1d10 legacy=0x7f1fb406ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:45.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.418+0000 7f1fb3fff700 1 -- 172.21.15.82:0/3312417634 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb40cd560 con 0x7f1fb406c140 2023-11-28T13:01:45.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.422+0000 7f1fb3fff700 1 --2- 172.21.15.82:0/3312417634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb406c140 0x7f1fb40cec20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1fb40c9af0 tx=0x7f1fa4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b38695e1c4fa88 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:45.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.422+0000 7f1fb37fe700 1 -- 172.21.15.82:0/3312417634 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4011830 con 0x7f1fb406c140 2023-11-28T13:01:45.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.422+0000 7f1fb37fe700 1 -- 172.21.15.82:0/3312417634 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa4011990 con 0x7f1fb406c140 2023-11-28T13:01:45.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.422+0000 7f1fb37fe700 1 -- 172.21.15.82:0/3312417634 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4011d20 con 0x7f1fb406c140 2023-11-28T13:01:45.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.422+0000 7f1fb9d4d700 1 -- 172.21.15.82:0/3312417634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb406c140 msgr2=0x7f1fb40cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:45.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.422+0000 7f1fb9d4d700 1 --2- 172.21.15.82:0/3312417634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb406c140 0x7f1fb40cec20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1fb40c9af0 tx=0x7f1fa4009bf0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.422+0000 7f1fb9d4d700 1 -- 172.21.15.82:0/3312417634 shutdown_connections 2023-11-28T13:01:45.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.422+0000 7f1fb9d4d700 1 --2- 172.21.15.82:0/3312417634 >> v2:172.21.15.114:3300/0 conn(0x7f1fb40d25b0 0x7f1fb406a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.422+0000 7f1fb9d4d700 1 --2- 172.21.15.82:0/3312417634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb406c140 0x7f1fb40cec20 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.422+0000 7f1fb9d4d700 1 -- 172.21.15.82:0/3312417634 >> 172.21.15.82:0/3312417634 conn(0x7f1fb40b52a0 msgr2=0x7f1fb40d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:45.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.422+0000 7f1fb9d4d700 1 -- 172.21.15.82:0/3312417634 shutdown_connections 2023-11-28T13:01:45.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.422+0000 7f1fb9d4d700 1 -- 172.21.15.82:0/3312417634 wait complete. 2023-11-28T13:01:45.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.422+0000 7f1fb9d4d700 1 Processor -- start 2023-11-28T13:01:45.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.422+0000 7f1fb9d4d700 1 -- start start 2023-11-28T13:01:45.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb9d4d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fb406c140 0x7f1fb41539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:45.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb9d4d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb40b1d10 0x7f1fb415e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:45.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb9d4d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1fb40d25b0 0x7f1fb40b6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:45.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb9d4d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb415d1c0 con 0x7f1fb40b1d10 2023-11-28T13:01:45.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb9d4d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb4151140 con 0x7f1fb406c140 2023-11-28T13:01:45.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb9d4d700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb415cc00 con 0x7f1fb40d25b0 2023-11-28T13:01:45.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb40b1d10 0x7f1fb415e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:45.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb40b1d10 0x7f1fb415e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59758/0 (socket says 172.21.15.82:59758) 2023-11-28T13:01:45.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb3fff700 1 -- 172.21.15.82:0/582872389 learned_addr learned my addr 172.21.15.82:0/582872389 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:45.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb8d4b700 1 --2- 172.21.15.82:0/582872389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fb406c140 0x7f1fb41539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:45.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb954c700 1 --2- 172.21.15.82:0/582872389 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1fb40d25b0 0x7f1fb40b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:45.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb3fff700 1 -- 172.21.15.82:0/582872389 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1fb40d25b0 msgr2=0x7f1fb40b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:45.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb3fff700 1 --2- 172.21.15.82:0/582872389 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1fb40d25b0 0x7f1fb40b6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb3fff700 1 -- 172.21.15.82:0/582872389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fb406c140 msgr2=0x7f1fb41539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:45.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb3fff700 1 --2- 172.21.15.82:0/582872389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fb406c140 0x7f1fb41539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb3fff700 1 -- 172.21.15.82:0/582872389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa4009570 con 0x7f1fb40b1d10 2023-11-28T13:01:45.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb3fff700 1 --2- 172.21.15.82:0/582872389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb40b1d10 0x7f1fb415e670 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4000c00 tx=0x7f1fa4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:45.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb17fa700 1 -- 172.21.15.82:0/582872389 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa40044d0 con 0x7f1fb40b1d10 2023-11-28T13:01:45.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb17fa700 1 -- 172.21.15.82:0/582872389 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa401f070 con 0x7f1fb40b1d10 2023-11-28T13:01:45.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb9d4d700 1 -- 172.21.15.82:0/582872389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb40d1050 con 0x7f1fb40b1d10 2023-11-28T13:01:45.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb17fa700 1 -- 172.21.15.82:0/582872389 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4003900 con 0x7f1fb40b1d10 2023-11-28T13:01:45.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb9d4d700 1 -- 172.21.15.82:0/582872389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb40b20e0 con 0x7f1fb40b1d10 2023-11-28T13:01:45.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.426+0000 7f1fb9d4d700 1 -- 172.21.15.82:0/582872389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb40d11e0 con 0x7f1fb40b1d10 2023-11-28T13:01:45.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.430+0000 7f1fb17fa700 1 -- 172.21.15.82:0/582872389 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1fa400f050 con 0x7f1fb40b1d10 2023-11-28T13:01:45.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.430+0000 7f1fb17fa700 1 --2- 172.21.15.82:0/582872389 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1fa0064f10 0x7f1fa00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:45.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.430+0000 7f1fb17fa700 1 -- 172.21.15.82:0/582872389 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1fa4021070 con 0x7f1fb40b1d10 2023-11-28T13:01:45.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.430+0000 7f1fb8d4b700 1 --2- 172.21.15.82:0/582872389 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1fa0064f10 0x7f1fa00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:45.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.430+0000 7f1fb8d4b700 1 --2- 172.21.15.82:0/582872389 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1fa0064f10 0x7f1fa00673c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8000f60 tx=0x7f1fa8007e00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:45.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.438+0000 7f1fb17fa700 1 -- 172.21.15.82:0/582872389 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1fa4051880 con 0x7f1fb40b1d10 2023-11-28T13:01:45.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.598+0000 7f1fb9d4d700 1 -- 172.21.15.82:0/582872389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1fb4065fc0 con 0x7f1fb40b1d10 2023-11-28T13:01:45.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.598+0000 7f1fb17fa700 1 -- 172.21.15.82:0/582872389 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1fa4054ea0 con 0x7f1fb40b1d10 2023-11-28T13:01:45.605 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-11-28T13:01:45.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.602+0000 7f1fb9d4d700 1 -- 172.21.15.82:0/582872389 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1fa0064f10 msgr2=0x7f1fa00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:45.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.602+0000 7f1fb9d4d700 1 --2- 172.21.15.82:0/582872389 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1fa0064f10 0x7f1fa00673c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8000f60 tx=0x7f1fa8007e00 comp rx=0 tx=0).stop 2023-11-28T13:01:45.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.602+0000 7f1fb9d4d700 1 -- 172.21.15.82:0/582872389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb40b1d10 msgr2=0x7f1fb415e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:45.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.602+0000 7f1fb9d4d700 1 --2- 172.21.15.82:0/582872389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb40b1d10 0x7f1fb415e670 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4000c00 tx=0x7f1fa4004770 comp rx=0 tx=0).stop 2023-11-28T13:01:45.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.602+0000 7f1fb9d4d700 1 -- 172.21.15.82:0/582872389 shutdown_connections 2023-11-28T13:01:45.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.602+0000 7f1fb9d4d700 1 --2- 172.21.15.82:0/582872389 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1fa0064f10 0x7f1fa00673c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.602+0000 7f1fb9d4d700 1 --2- 172.21.15.82:0/582872389 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1fb40d25b0 0x7f1fb40b6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.602+0000 7f1fb9d4d700 1 --2- 172.21.15.82:0/582872389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb40b1d10 0x7f1fb415e670 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.602+0000 7f1fb9d4d700 1 --2- 172.21.15.82:0/582872389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fb406c140 0x7f1fb41539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.602+0000 7f1fb9d4d700 1 -- 172.21.15.82:0/582872389 >> 172.21.15.82:0/582872389 conn(0x7f1fb40b52a0 msgr2=0x7f1fb40b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:45.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.602+0000 7f1fb9d4d700 1 -- 172.21.15.82:0/582872389 shutdown_connections 2023-11-28T13:01:45.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.602+0000 7f1fb9d4d700 1 -- 172.21.15.82:0/582872389 wait complete. 2023-11-28T13:01:45.621 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T13:01:45.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.726+0000 7f50c4bd7700 1 Processor -- start 2023-11-28T13:01:45.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.726+0000 7f50c4bd7700 1 -- start start 2023-11-28T13:01:45.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.726+0000 7f50c4bd7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f50c00c1910 0x7f50c016b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:45.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.726+0000 7f50c4bd7700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c00ce030 con 0x7f50c0070070 2023-11-28T13:01:45.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.726+0000 7f50c4bd7700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c00ce310 con 0x7f50c0160900 2023-11-28T13:01:45.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.726+0000 7f50c4bd7700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c006a5d0 con 0x7f50c00c1910 2023-11-28T13:01:45.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.726+0000 7f50bf7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f50c0070070 0x7f50c0070440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48466/0 (socket says 172.21.15.82:48466) 2023-11-28T13:01:45.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.726+0000 7f50bf7fe700 1 -- 172.21.15.82:0/4125881398 learned_addr learned my addr 172.21.15.82:0/4125881398 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:45.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.726+0000 7f50bffff700 1 --2- 172.21.15.82:0/4125881398 >> v2:172.21.15.82:3300/0 conn(0x7f50c00c1910 0x7f50c016b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:45.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.726+0000 7f50be7fc700 1 -- 172.21.15.82:0/4125881398 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 149051985 0 0) 0x7f50c00ce030 con 0x7f50c0070070 2023-11-28T13:01:45.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.726+0000 7f50be7fc700 1 -- 172.21.15.82:0/4125881398 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50ac0035d0 con 0x7f50c0070070 2023-11-28T13:01:45.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.726+0000 7f50be7fc700 1 -- 172.21.15.82:0/4125881398 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918530422 0 0) 0x7f50c00ce310 con 0x7f50c0160900 2023-11-28T13:01:45.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.726+0000 7f50bffff700 1 -- 172.21.15.82:0/4125881398 >> v1:172.21.15.114:6789/0 conn(0x7f50c0160900 legacy=0x7f50c00cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:45.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.726+0000 7f50bffff700 1 -- 172.21.15.82:0/4125881398 >> v1:172.21.15.82:6789/0 conn(0x7f50c0070070 legacy=0x7f50c0070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:45.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.726+0000 7f50bffff700 1 -- 172.21.15.82:0/4125881398 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c006a8b0 con 0x7f50c00c1910 2023-11-28T13:01:45.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.726+0000 7f50bffff700 1 --2- 172.21.15.82:0/4125881398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50c00c1910 0x7f50c016b570 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009850 tx=0x7f50b0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd542afd0c57994c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:45.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.726+0000 7f50be7fc700 1 -- 172.21.15.82:0/4125881398 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a8001670 con 0x7f50c00c1910 2023-11-28T13:01:45.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.726+0000 7f50be7fc700 1 -- 172.21.15.82:0/4125881398 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b0010590 con 0x7f50c00c1910 2023-11-28T13:01:45.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.726+0000 7f50be7fc700 1 -- 172.21.15.82:0/4125881398 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0010940 con 0x7f50c00c1910 2023-11-28T13:01:45.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.730+0000 7f50c4bd7700 1 -- 172.21.15.82:0/4125881398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50c00c1910 msgr2=0x7f50c016b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:45.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.730+0000 7f50c4bd7700 1 --2- 172.21.15.82:0/4125881398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50c00c1910 0x7f50c016b570 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009850 tx=0x7f50b0009b60 comp rx=0 tx=0).stop 2023-11-28T13:01:45.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.730+0000 7f50c4bd7700 1 -- 172.21.15.82:0/4125881398 shutdown_connections 2023-11-28T13:01:45.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.730+0000 7f50c4bd7700 1 --2- 172.21.15.82:0/4125881398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50c00c1910 0x7f50c016b570 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.730+0000 7f50c4bd7700 1 -- 172.21.15.82:0/4125881398 >> 172.21.15.82:0/4125881398 conn(0x7f50c00ce600 msgr2=0x7f50c00ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:45.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.730+0000 7f50c4bd7700 1 -- 172.21.15.82:0/4125881398 shutdown_connections 2023-11-28T13:01:45.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.730+0000 7f50c4bd7700 1 -- 172.21.15.82:0/4125881398 wait complete. 2023-11-28T13:01:45.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.730+0000 7f50c4bd7700 1 Processor -- start 2023-11-28T13:01:45.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.730+0000 7f50c4bd7700 1 -- start start 2023-11-28T13:01:45.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.730+0000 7f50c4bd7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c0070070 0x7f50c0157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:45.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.730+0000 7f50c4bd7700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50c0159350 0x7f50c00c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:45.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.730+0000 7f50c4bd7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50c00c34d0 0x7f50c006c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:45.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.730+0000 7f50c4bd7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00b2a60 con 0x7f50c00c34d0 2023-11-28T13:01:45.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.730+0000 7f50c4bd7700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00b2d40 con 0x7f50c0070070 2023-11-28T13:01:45.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.730+0000 7f50c4bd7700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00b3020 con 0x7f50c0159350 2023-11-28T13:01:45.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.730+0000 7f50bffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50c00c34d0 0x7f50c006c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:45.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.730+0000 7f50bffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50c00c34d0 0x7f50c006c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59766/0 (socket says 172.21.15.82:59766) 2023-11-28T13:01:45.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.730+0000 7f50bffff700 1 -- 172.21.15.82:0/1589576611 learned_addr learned my addr 172.21.15.82:0/1589576611 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:45.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.730+0000 7f50bf7fe700 1 --2- 172.21.15.82:0/1589576611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c0070070 0x7f50c0157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:45.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.730+0000 7f50beffd700 1 --2- 172.21.15.82:0/1589576611 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50c0159350 0x7f50c00c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:45.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.734+0000 7f50bffff700 1 -- 172.21.15.82:0/1589576611 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50c0159350 msgr2=0x7f50c00c2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:45.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.734+0000 7f50bffff700 1 --2- 172.21.15.82:0/1589576611 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50c0159350 0x7f50c00c2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.734+0000 7f50bffff700 1 -- 172.21.15.82:0/1589576611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c0070070 msgr2=0x7f50c0157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:45.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.734+0000 7f50bffff700 1 --2- 172.21.15.82:0/1589576611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c0070070 0x7f50c0157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.734+0000 7f50bffff700 1 -- 172.21.15.82:0/1589576611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b00094b0 con 0x7f50c00c34d0 2023-11-28T13:01:45.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.734+0000 7f50bffff700 1 --2- 172.21.15.82:0/1589576611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50c00c34d0 0x7f50c006c6e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f50c0071980 tx=0x7f50b0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:45.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.734+0000 7f50b7fff700 1 -- 172.21.15.82:0/1589576611 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0004510 con 0x7f50c00c34d0 2023-11-28T13:01:45.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.734+0000 7f50b7fff700 1 -- 172.21.15.82:0/1589576611 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b00036c0 con 0x7f50c00c34d0 2023-11-28T13:01:45.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.734+0000 7f50c4bd7700 1 -- 172.21.15.82:0/1589576611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c00cdc50 con 0x7f50c00c34d0 2023-11-28T13:01:45.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.734+0000 7f50b7fff700 1 -- 172.21.15.82:0/1589576611 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0003a70 con 0x7f50c00c34d0 2023-11-28T13:01:45.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.734+0000 7f50c4bd7700 1 -- 172.21.15.82:0/1589576611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c006ab90 con 0x7f50c00c34d0 2023-11-28T13:01:45.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.734+0000 7f50c4bd7700 1 -- 172.21.15.82:0/1589576611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c00cdde0 con 0x7f50c00c34d0 2023-11-28T13:01:45.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.734+0000 7f50b7fff700 1 -- 172.21.15.82:0/1589576611 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f50b000f050 con 0x7f50c00c34d0 2023-11-28T13:01:45.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.734+0000 7f50b7fff700 1 --2- 172.21.15.82:0/1589576611 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f50a0064ee0 0x7f50a0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:45.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.734+0000 7f50b7fff700 1 -- 172.21.15.82:0/1589576611 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f50b00832f0 con 0x7f50c00c34d0 2023-11-28T13:01:45.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.734+0000 7f50bf7fe700 1 --2- 172.21.15.82:0/1589576611 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f50a0064ee0 0x7f50a0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:45.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.738+0000 7f50bf7fe700 1 --2- 172.21.15.82:0/1589576611 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f50a0064ee0 0x7f50a0067390 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f50a8001bb0 tx=0x7f50a8001b40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:45.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.742+0000 7f50b7fff700 1 -- 172.21.15.82:0/1589576611 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f50b0051410 con 0x7f50c00c34d0 2023-11-28T13:01:45.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.910+0000 7f50c4bd7700 1 -- 172.21.15.82:0/1589576611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f50c00b2ba0 con 0x7f50c00c34d0 2023-11-28T13:01:45.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.910+0000 7f50b7fff700 1 -- 172.21.15.82:0/1589576611 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) v1 ==== 80+0+0 (secure 0 0 0) 0x7f50c00b2ba0 con 0x7f50c00c34d0 2023-11-28T13:01:45.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.914+0000 7f50c4bd7700 1 -- 172.21.15.82:0/1589576611 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f50a0064ee0 msgr2=0x7f50a0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:45.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.914+0000 7f50c4bd7700 1 --2- 172.21.15.82:0/1589576611 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f50a0064ee0 0x7f50a0067390 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f50a8001bb0 tx=0x7f50a8001b40 comp rx=0 tx=0).stop 2023-11-28T13:01:45.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.914+0000 7f50c4bd7700 1 -- 172.21.15.82:0/1589576611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50c00c34d0 msgr2=0x7f50c006c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:45.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.914+0000 7f50c4bd7700 1 --2- 172.21.15.82:0/1589576611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50c00c34d0 0x7f50c006c6e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f50c0071980 tx=0x7f50b0004770 comp rx=0 tx=0).stop 2023-11-28T13:01:45.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.914+0000 7f50c4bd7700 1 -- 172.21.15.82:0/1589576611 shutdown_connections 2023-11-28T13:01:45.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.914+0000 7f50c4bd7700 1 --2- 172.21.15.82:0/1589576611 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f50a0064ee0 0x7f50a0067390 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.914+0000 7f50c4bd7700 1 --2- 172.21.15.82:0/1589576611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50c00c34d0 0x7f50c006c6e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.914+0000 7f50c4bd7700 1 --2- 172.21.15.82:0/1589576611 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50c0159350 0x7f50c00c2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.914+0000 7f50c4bd7700 1 --2- 172.21.15.82:0/1589576611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c0070070 0x7f50c0157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:45.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.914+0000 7f50c4bd7700 1 -- 172.21.15.82:0/1589576611 >> 172.21.15.82:0/1589576611 conn(0x7f50c00ce600 msgr2=0x7f50c015fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:45.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.914+0000 7f50c4bd7700 1 -- 172.21.15.82:0/1589576611 shutdown_connections 2023-11-28T13:01:45.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:45.914+0000 7f50c4bd7700 1 -- 172.21.15.82:0/1589576611 wait complete. 2023-11-28T13:01:45.921 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2023-11-28T13:01:45.935 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:01:45.936 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:01:45.941 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:01:46.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.046+0000 7fdd8785e700 1 Processor -- start 2023-11-28T13:01:46.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.046+0000 7fdd8785e700 1 -- start start 2023-11-28T13:01:46.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.046+0000 7fdd8785e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd800703e0 0x7fdd800707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:46.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.046+0000 7fdd8785e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd80160b20 0x7fdd800ad710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:46.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.046+0000 7fdd8785e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd80070cf0 con 0x7fdd800adc50 2023-11-28T13:01:46.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.046+0000 7fdd8785e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd800ae0f0 con 0x7fdd80160b20 2023-11-28T13:01:46.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.046+0000 7fdd8785e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd800ce680 con 0x7fdd800703e0 2023-11-28T13:01:46.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.046+0000 7fdd84df9700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd80160b20 0x7fdd800ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:46.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.046+0000 7fdd84df9700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd80160b20 0x7fdd800ad710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59782/0 (socket says 172.21.15.82:59782) 2023-11-28T13:01:46.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.046+0000 7fdd84df9700 1 -- 172.21.15.82:0/4116412947 learned_addr learned my addr 172.21.15.82:0/4116412947 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:46.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.046+0000 7fdd85dfb700 1 --1- 172.21.15.82:0/4116412947 >> v1:172.21.15.82:6789/0 conn(0x7fdd800adc50 0x7fdd800ca010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48482/0 (socket says 172.21.15.82:48482) 2023-11-28T13:01:46.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.046+0000 7fdd855fa700 1 --2- 172.21.15.82:0/4116412947 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd800703e0 0x7fdd800707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:46.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.046+0000 7fdd84df9700 1 -- 172.21.15.82:0/4116412947 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd800703e0 msgr2=0x7fdd800707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:46.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.046+0000 7fdd84df9700 1 --2- 172.21.15.82:0/4116412947 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd800703e0 0x7fdd800707b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.046+0000 7fdd84df9700 1 -- 172.21.15.82:0/4116412947 >> v1:172.21.15.82:6789/0 conn(0x7fdd800adc50 legacy=0x7fdd800ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:46.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.046+0000 7fdd84df9700 1 -- 172.21.15.82:0/4116412947 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd80069c60 con 0x7fdd80160b20 2023-11-28T13:01:46.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.046+0000 7fdd77fff700 1 -- 172.21.15.82:0/4116412947 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083252484 0 0) 0x7fdd80070cf0 con 0x7fdd800adc50 2023-11-28T13:01:46.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.046+0000 7fdd84df9700 1 --2- 172.21.15.82:0/4116412947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd80160b20 0x7fdd800ad710 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009e50 tx=0x7fdd7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f2cd7ba557f86c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:46.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.046+0000 7fdd77fff700 1 -- 172.21.15.82:0/4116412947 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7800e070 con 0x7fdd80160b20 2023-11-28T13:01:46.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.046+0000 7fdd77fff700 1 -- 172.21.15.82:0/4116412947 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7800b910 con 0x7fdd80160b20 2023-11-28T13:01:46.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.046+0000 7fdd77fff700 1 -- 172.21.15.82:0/4116412947 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7800bcc0 con 0x7fdd80160b20 2023-11-28T13:01:46.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.050+0000 7fdd8785e700 1 -- 172.21.15.82:0/4116412947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd80160b20 msgr2=0x7fdd800ad710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:46.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.050+0000 7fdd8785e700 1 --2- 172.21.15.82:0/4116412947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd80160b20 0x7fdd800ad710 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009e50 tx=0x7fdd7800b330 comp rx=0 tx=0).stop 2023-11-28T13:01:46.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.050+0000 7fdd8785e700 1 -- 172.21.15.82:0/4116412947 shutdown_connections 2023-11-28T13:01:46.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.050+0000 7fdd8785e700 1 --2- 172.21.15.82:0/4116412947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd80160b20 0x7fdd800ad710 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.050+0000 7fdd8785e700 1 --2- 172.21.15.82:0/4116412947 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd800703e0 0x7fdd800707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.050+0000 7fdd8785e700 1 -- 172.21.15.82:0/4116412947 >> 172.21.15.82:0/4116412947 conn(0x7fdd800ce9b0 msgr2=0x7fdd800ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:46.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.050+0000 7fdd8785e700 1 -- 172.21.15.82:0/4116412947 shutdown_connections 2023-11-28T13:01:46.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.050+0000 7fdd8785e700 1 -- 172.21.15.82:0/4116412947 wait complete. 2023-11-28T13:01:46.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.050+0000 7fdd8785e700 1 Processor -- start 2023-11-28T13:01:46.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.050+0000 7fdd8785e700 1 -- start start 2023-11-28T13:01:46.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd8785e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd800703e0 0x7fdd8015cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:46.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd8785e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd800adc50 0x7fdd800c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:46.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd8785e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd80160b20 0x7fdd800b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:46.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd8785e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd800becc0 con 0x7fdd80160b20 2023-11-28T13:01:46.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd8785e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd800be990 con 0x7fdd800703e0 2023-11-28T13:01:46.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd8785e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd800c5030 con 0x7fdd800adc50 2023-11-28T13:01:46.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd85dfb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd80160b20 0x7fdd800b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:46.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd85dfb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd80160b20 0x7fdd800b3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59794/0 (socket says 172.21.15.82:59794) 2023-11-28T13:01:46.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd85dfb700 1 -- 172.21.15.82:0/1705279608 learned_addr learned my addr 172.21.15.82:0/1705279608 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:46.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd855fa700 1 --2- 172.21.15.82:0/1705279608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd800703e0 0x7fdd8015cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:46.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd84df9700 1 --2- 172.21.15.82:0/1705279608 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd800adc50 0x7fdd800c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:46.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd85dfb700 1 -- 172.21.15.82:0/1705279608 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd800adc50 msgr2=0x7fdd800c3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:46.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd85dfb700 1 --2- 172.21.15.82:0/1705279608 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd800adc50 0x7fdd800c3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd85dfb700 1 -- 172.21.15.82:0/1705279608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd800703e0 msgr2=0x7fdd8015cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:46.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd85dfb700 1 --2- 172.21.15.82:0/1705279608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd800703e0 0x7fdd8015cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd85dfb700 1 -- 172.21.15.82:0/1705279608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd78009b30 con 0x7fdd80160b20 2023-11-28T13:01:46.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd85dfb700 1 --2- 172.21.15.82:0/1705279608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd80160b20 0x7fdd800b3d90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c00c550 tx=0x7fdd7c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:46.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd75ffb700 1 -- 172.21.15.82:0/1705279608 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c004ca0 con 0x7fdd80160b20 2023-11-28T13:01:46.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd75ffb700 1 -- 172.21.15.82:0/1705279608 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c004e20 con 0x7fdd80160b20 2023-11-28T13:01:46.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd8785e700 1 -- 172.21.15.82:0/1705279608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8006a220 con 0x7fdd80160b20 2023-11-28T13:01:46.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd75ffb700 1 -- 172.21.15.82:0/1705279608 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c007310 con 0x7fdd80160b20 2023-11-28T13:01:46.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd8785e700 1 -- 172.21.15.82:0/1705279608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd80069f40 con 0x7fdd80160b20 2023-11-28T13:01:46.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.054+0000 7fdd8785e700 1 -- 172.21.15.82:0/1705279608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8006a500 con 0x7fdd80160b20 2023-11-28T13:01:46.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.058+0000 7fdd75ffb700 1 -- 172.21.15.82:0/1705279608 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdd7c01a020 con 0x7fdd80160b20 2023-11-28T13:01:46.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.058+0000 7fdd75ffb700 1 --2- 172.21.15.82:0/1705279608 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdd64064ee0 0x7fdd64067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:46.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.058+0000 7fdd75ffb700 1 -- 172.21.15.82:0/1705279608 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdd7c081940 con 0x7fdd80160b20 2023-11-28T13:01:46.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.058+0000 7fdd855fa700 1 --2- 172.21.15.82:0/1705279608 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdd64064ee0 0x7fdd64067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:46.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.058+0000 7fdd855fa700 1 --2- 172.21.15.82:0/1705279608 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdd64064ee0 0x7fdd64067390 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdd801f9650 tx=0x7fdd70009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:46.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.066+0000 7fdd75ffb700 1 -- 172.21.15.82:0/1705279608 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdd7c04fb90 con 0x7fdd80160b20 2023-11-28T13:01:46.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.222+0000 7fdd8785e700 1 -- 172.21.15.82:0/1705279608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd800bee00 con 0x7fdd80160b20 2023-11-28T13:01:46.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.226+0000 7fdd75ffb700 1 -- 172.21.15.82:0/1705279608 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+17883 (secure 0 0 0) 0x7fdd800bee00 con 0x7fdd80160b20 2023-11-28T13:01:46.232 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:46.232 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":38,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:01:30.589673+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:01:27.651123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T13:01:28.580057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:01:46.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.226+0000 7fdd8785e700 1 -- 172.21.15.82:0/1705279608 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdd64064ee0 msgr2=0x7fdd64067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:46.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.226+0000 7fdd8785e700 1 --2- 172.21.15.82:0/1705279608 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdd64064ee0 0x7fdd64067390 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdd801f9650 tx=0x7fdd70009240 comp rx=0 tx=0).stop 2023-11-28T13:01:46.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.226+0000 7fdd8785e700 1 -- 172.21.15.82:0/1705279608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd80160b20 msgr2=0x7fdd800b3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:46.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.226+0000 7fdd8785e700 1 --2- 172.21.15.82:0/1705279608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd80160b20 0x7fdd800b3d90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c00c550 tx=0x7fdd7c00c860 comp rx=0 tx=0).stop 2023-11-28T13:01:46.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.226+0000 7fdd8785e700 1 -- 172.21.15.82:0/1705279608 shutdown_connections 2023-11-28T13:01:46.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.226+0000 7fdd8785e700 1 --2- 172.21.15.82:0/1705279608 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdd64064ee0 0x7fdd64067390 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.226+0000 7fdd8785e700 1 --2- 172.21.15.82:0/1705279608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd80160b20 0x7fdd800b3d90 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.226+0000 7fdd8785e700 1 --2- 172.21.15.82:0/1705279608 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd800adc50 0x7fdd800c3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.226+0000 7fdd8785e700 1 --2- 172.21.15.82:0/1705279608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd800703e0 0x7fdd8015cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.226+0000 7fdd8785e700 1 -- 172.21.15.82:0/1705279608 >> 172.21.15.82:0/1705279608 conn(0x7fdd800ce9b0 msgr2=0x7fdd800ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:46.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.226+0000 7fdd8785e700 1 -- 172.21.15.82:0/1705279608 shutdown_connections 2023-11-28T13:01:46.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.226+0000 7fdd8785e700 1 -- 172.21.15.82:0/1705279608 wait complete. 2023-11-28T13:01:46.246 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T13:01:27.651123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T13:01:28.580057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:01:46.246 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:01:46.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.358+0000 7fc8bf154700 1 Processor -- start 2023-11-28T13:01:46.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.358+0000 7fc8bf154700 1 -- start start 2023-11-28T13:01:46.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8bf154700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc8b80ae090 0x7fc8b80c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:46.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8bf154700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b80ad9b0 con 0x7fc8b80b0c70 2023-11-28T13:01:46.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8bf154700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b8159280 con 0x7fc8b8158eb0 2023-11-28T13:01:46.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8bf154700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b80adee0 con 0x7fc8b80ae090 2023-11-28T13:01:46.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8be953700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc8b80b0c70 0x7fc8b815c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48494/0 (socket says 172.21.15.82:48494) 2023-11-28T13:01:46.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8be953700 1 -- 172.21.15.82:0/3043659895 learned_addr learned my addr 172.21.15.82:0/3043659895 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:46.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8bd951700 1 --2- 172.21.15.82:0/3043659895 >> v2:172.21.15.114:3300/0 conn(0x7fc8b80ae090 0x7fc8b80c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:46.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8bd150700 1 -- 172.21.15.82:0/3043659895 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110113185 0 0) 0x7fc8b80ad9b0 con 0x7fc8b80b0c70 2023-11-28T13:01:46.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8bd150700 1 -- 172.21.15.82:0/3043659895 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8a40035d0 con 0x7fc8b80b0c70 2023-11-28T13:01:46.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8bd951700 1 -- 172.21.15.82:0/3043659895 >> v1:172.21.15.114:6789/0 conn(0x7fc8b8158eb0 legacy=0x7fc8b80b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:46.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8bd150700 1 -- 172.21.15.82:0/3043659895 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3092723931 0 0) 0x7fc8a40035d0 con 0x7fc8b80b0c70 2023-11-28T13:01:46.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8bd951700 1 -- 172.21.15.82:0/3043659895 >> v1:172.21.15.82:6789/0 conn(0x7fc8b80b0c70 legacy=0x7fc8b815c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:46.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8bd951700 1 -- 172.21.15.82:0/3043659895 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b8069e60 con 0x7fc8b80ae090 2023-11-28T13:01:46.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8bd951700 1 --2- 172.21.15.82:0/3043659895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8b80ae090 0x7fc8b80c8c80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009850 tx=0x7fc8a8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=369a611ec853ab45 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:46.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8bd150700 1 -- 172.21.15.82:0/3043659895 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00019f0 con 0x7fc8b80ae090 2023-11-28T13:01:46.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8bd150700 1 -- 172.21.15.82:0/3043659895 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a8004030 con 0x7fc8b80ae090 2023-11-28T13:01:46.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8bd150700 1 -- 172.21.15.82:0/3043659895 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a80043c0 con 0x7fc8b80ae090 2023-11-28T13:01:46.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8bf154700 1 -- 172.21.15.82:0/3043659895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8b80ae090 msgr2=0x7fc8b80c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:46.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8bf154700 1 --2- 172.21.15.82:0/3043659895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8b80ae090 0x7fc8b80c8c80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009850 tx=0x7fc8a8009b60 comp rx=0 tx=0).stop 2023-11-28T13:01:46.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8bf154700 1 -- 172.21.15.82:0/3043659895 shutdown_connections 2023-11-28T13:01:46.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8bf154700 1 --2- 172.21.15.82:0/3043659895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8b80ae090 0x7fc8b80c8c80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.362+0000 7fc8bf154700 1 -- 172.21.15.82:0/3043659895 >> 172.21.15.82:0/3043659895 conn(0x7fc8b80ce630 msgr2=0x7fc8b80cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:46.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.366+0000 7fc8bf154700 1 -- 172.21.15.82:0/3043659895 shutdown_connections 2023-11-28T13:01:46.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.366+0000 7fc8bf154700 1 -- 172.21.15.82:0/3043659895 wait complete. 2023-11-28T13:01:46.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.366+0000 7fc8bf154700 1 Processor -- start 2023-11-28T13:01:46.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.366+0000 7fc8bf154700 1 -- start start 2023-11-28T13:01:46.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.366+0000 7fc8bf154700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8b80ae090 0x7fc8b81496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:46.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.366+0000 7fc8bf154700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8b80b0c70 0x7fc8b80b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:46.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.366+0000 7fc8bf154700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8b8158eb0 0x7fc8b80b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:46.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.366+0000 7fc8bf154700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80b3c70 con 0x7fc8b8158eb0 2023-11-28T13:01:46.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.366+0000 7fc8bf154700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80b1620 con 0x7fc8b80b0c70 2023-11-28T13:01:46.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.366+0000 7fc8bf154700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80b3990 con 0x7fc8b80ae090 2023-11-28T13:01:46.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.366+0000 7fc8be953700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8b8158eb0 0x7fc8b80b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:46.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.366+0000 7fc8be953700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8b8158eb0 0x7fc8b80b3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59808/0 (socket says 172.21.15.82:59808) 2023-11-28T13:01:46.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.366+0000 7fc8be953700 1 -- 172.21.15.82:0/4058431608 learned_addr learned my addr 172.21.15.82:0/4058431608 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:46.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.366+0000 7fc8bd951700 1 --2- 172.21.15.82:0/4058431608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8b80b0c70 0x7fc8b80b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:46.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.366+0000 7fc8be152700 1 --2- 172.21.15.82:0/4058431608 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8b80ae090 0x7fc8b81496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:46.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.366+0000 7fc8be953700 1 -- 172.21.15.82:0/4058431608 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8b80ae090 msgr2=0x7fc8b81496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:46.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.366+0000 7fc8be953700 1 --2- 172.21.15.82:0/4058431608 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8b80ae090 0x7fc8b81496c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.366+0000 7fc8be953700 1 -- 172.21.15.82:0/4058431608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8b80b0c70 msgr2=0x7fc8b80b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:46.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.366+0000 7fc8be953700 1 --2- 172.21.15.82:0/4058431608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8b80b0c70 0x7fc8b80b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.366+0000 7fc8be953700 1 -- 172.21.15.82:0/4058431608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a80094b0 con 0x7fc8b8158eb0 2023-11-28T13:01:46.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.366+0000 7fc8be152700 1 --2- 172.21.15.82:0/4058431608 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8b80ae090 0x7fc8b81496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:46.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.370+0000 7fc8be953700 1 --2- 172.21.15.82:0/4058431608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8b8158eb0 0x7fc8b80b3360 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0001ba0 tx=0x7fc8b000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:46.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.370+0000 7fc8b6ffd700 1 -- 172.21.15.82:0/4058431608 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b000ac20 con 0x7fc8b8158eb0 2023-11-28T13:01:46.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.370+0000 7fc8b6ffd700 1 -- 172.21.15.82:0/4058431608 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b000ad80 con 0x7fc8b8158eb0 2023-11-28T13:01:46.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.370+0000 7fc8bf154700 1 -- 172.21.15.82:0/4058431608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b8071c90 con 0x7fc8b8158eb0 2023-11-28T13:01:46.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.370+0000 7fc8b6ffd700 1 -- 172.21.15.82:0/4058431608 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0007310 con 0x7fc8b8158eb0 2023-11-28T13:01:46.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.370+0000 7fc8bf154700 1 -- 172.21.15.82:0/4058431608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b80adc00 con 0x7fc8b8158eb0 2023-11-28T13:01:46.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.370+0000 7fc8bf154700 1 -- 172.21.15.82:0/4058431608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b8071f70 con 0x7fc8b8158eb0 2023-11-28T13:01:46.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.370+0000 7fc8b6ffd700 1 -- 172.21.15.82:0/4058431608 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc8b0010070 con 0x7fc8b8158eb0 2023-11-28T13:01:46.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.370+0000 7fc8b6ffd700 1 --2- 172.21.15.82:0/4058431608 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc898064ee0 0x7fc898067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:46.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.374+0000 7fc8be152700 1 --2- 172.21.15.82:0/4058431608 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc898064ee0 0x7fc898067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:46.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.374+0000 7fc8b6ffd700 1 -- 172.21.15.82:0/4058431608 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc8b0081a80 con 0x7fc8b8158eb0 2023-11-28T13:01:46.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.374+0000 7fc8be152700 1 --2- 172.21.15.82:0/4058431608 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc898064ee0 0x7fc898067390 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80ce270 tx=0x7fc8a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:46.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.378+0000 7fc8b6ffd700 1 -- 172.21.15.82:0/4058431608 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc8b004fab0 con 0x7fc8b8158eb0 2023-11-28T13:01:46.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.538+0000 7fc8bf154700 1 -- 172.21.15.82:0/4058431608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc8b8065fc0 con 0x7fc8b8158eb0 2023-11-28T13:01:46.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.538+0000 7fc8b6ffd700 1 -- 172.21.15.82:0/4058431608 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc8b00180a0 con 0x7fc8b8158eb0 2023-11-28T13:01:46.546 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:01:46.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.542+0000 7fc8bf154700 1 -- 172.21.15.82:0/4058431608 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc898064ee0 msgr2=0x7fc898067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:46.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.542+0000 7fc8bf154700 1 --2- 172.21.15.82:0/4058431608 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc898064ee0 0x7fc898067390 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80ce270 tx=0x7fc8a0009040 comp rx=0 tx=0).stop 2023-11-28T13:01:46.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.542+0000 7fc8bf154700 1 -- 172.21.15.82:0/4058431608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8b8158eb0 msgr2=0x7fc8b80b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:46.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.542+0000 7fc8bf154700 1 --2- 172.21.15.82:0/4058431608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8b8158eb0 0x7fc8b80b3360 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0001ba0 tx=0x7fc8b000a060 comp rx=0 tx=0).stop 2023-11-28T13:01:46.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.542+0000 7fc8bf154700 1 -- 172.21.15.82:0/4058431608 shutdown_connections 2023-11-28T13:01:46.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.542+0000 7fc8bf154700 1 --2- 172.21.15.82:0/4058431608 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc898064ee0 0x7fc898067390 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.542+0000 7fc8bf154700 1 --2- 172.21.15.82:0/4058431608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8b8158eb0 0x7fc8b80b3360 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.542+0000 7fc8bf154700 1 --2- 172.21.15.82:0/4058431608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8b80b0c70 0x7fc8b80b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.542+0000 7fc8bf154700 1 --2- 172.21.15.82:0/4058431608 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8b80ae090 0x7fc8b81496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.542+0000 7fc8bf154700 1 -- 172.21.15.82:0/4058431608 >> 172.21.15.82:0/4058431608 conn(0x7fc8b80ce630 msgr2=0x7fc8b8158180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:46.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.542+0000 7fc8bf154700 1 -- 172.21.15.82:0/4058431608 shutdown_connections 2023-11-28T13:01:46.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.542+0000 7fc8bf154700 1 -- 172.21.15.82:0/4058431608 wait complete. 2023-11-28T13:01:46.561 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:01:46.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.674+0000 7fcc37fff700 1 Processor -- start 2023-11-28T13:01:46.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.674+0000 7fcc37fff700 1 -- start start 2023-11-28T13:01:46.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.674+0000 7fcc37fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc380b1d10 0x7fcc380cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:46.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.674+0000 7fcc37fff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc38069bc0 con 0x7fcc3806c140 2023-11-28T13:01:46.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.674+0000 7fcc37fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc380d1480 con 0x7fcc380d25b0 2023-11-28T13:01:46.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.674+0000 7fcc37fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc380cd280 con 0x7fcc380b1d10 2023-11-28T13:01:46.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.674+0000 7fcc377fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcc3806c140 0x7fcc3806a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60230/0 (socket says 172.21.15.82:60230) 2023-11-28T13:01:46.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.674+0000 7fcc377fe700 1 -- 172.21.15.82:0/655326084 learned_addr learned my addr 172.21.15.82:0/655326084 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:46.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.674+0000 7fcc36ffd700 1 --2- 172.21.15.82:0/655326084 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc380b1d10 0x7fcc380cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:46.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.678+0000 7fcc35ffb700 1 -- 172.21.15.82:0/655326084 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554296143 0 0) 0x7fcc38069bc0 con 0x7fcc3806c140 2023-11-28T13:01:46.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.678+0000 7fcc35ffb700 1 -- 172.21.15.82:0/655326084 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc200035d0 con 0x7fcc3806c140 2023-11-28T13:01:46.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.678+0000 7fcc35ffb700 1 -- 172.21.15.82:0/655326084 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608925965 0 0) 0x7fcc380d1480 con 0x7fcc380d25b0 2023-11-28T13:01:46.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.678+0000 7fcc35ffb700 1 -- 172.21.15.82:0/655326084 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc38069bc0 con 0x7fcc380d25b0 2023-11-28T13:01:46.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.678+0000 7fcc36ffd700 1 -- 172.21.15.82:0/655326084 >> v1:172.21.15.114:6789/0 conn(0x7fcc380d25b0 legacy=0x7fcc3806ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:46.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.678+0000 7fcc36ffd700 1 -- 172.21.15.82:0/655326084 >> v1:172.21.15.82:6789/0 conn(0x7fcc3806c140 legacy=0x7fcc3806a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:46.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.678+0000 7fcc36ffd700 1 -- 172.21.15.82:0/655326084 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc380cd560 con 0x7fcc380b1d10 2023-11-28T13:01:46.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.678+0000 7fcc36ffd700 1 --2- 172.21.15.82:0/655326084 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc380b1d10 0x7fcc380cec20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009880 tx=0x7fcc2c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f5bfa5981b3825f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:46.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.678+0000 7fcc35ffb700 1 -- 172.21.15.82:0/655326084 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c011830 con 0x7fcc380b1d10 2023-11-28T13:01:46.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.678+0000 7fcc35ffb700 1 -- 172.21.15.82:0/655326084 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2c011990 con 0x7fcc380b1d10 2023-11-28T13:01:46.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.678+0000 7fcc35ffb700 1 -- 172.21.15.82:0/655326084 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c011d20 con 0x7fcc380b1d10 2023-11-28T13:01:46.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.678+0000 7fcc37fff700 1 -- 172.21.15.82:0/655326084 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc380b1d10 msgr2=0x7fcc380cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:46.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.678+0000 7fcc37fff700 1 --2- 172.21.15.82:0/655326084 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc380b1d10 0x7fcc380cec20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009880 tx=0x7fcc2c009b90 comp rx=0 tx=0).stop 2023-11-28T13:01:46.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.678+0000 7fcc37fff700 1 -- 172.21.15.82:0/655326084 shutdown_connections 2023-11-28T13:01:46.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.678+0000 7fcc37fff700 1 --2- 172.21.15.82:0/655326084 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc380b1d10 0x7fcc380cec20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.678+0000 7fcc37fff700 1 -- 172.21.15.82:0/655326084 >> 172.21.15.82:0/655326084 conn(0x7fcc380b52a0 msgr2=0x7fcc380d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:46.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.678+0000 7fcc37fff700 1 -- 172.21.15.82:0/655326084 shutdown_connections 2023-11-28T13:01:46.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.678+0000 7fcc37fff700 1 -- 172.21.15.82:0/655326084 wait complete. 2023-11-28T13:01:46.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc37fff700 1 Processor -- start 2023-11-28T13:01:46.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc37fff700 1 -- start start 2023-11-28T13:01:46.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc37fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc3806c140 0x7fcc3815e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:46.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc37fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc380b1d10 0x7fcc3815bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:46.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc37fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc380d25b0 0x7fcc38149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:46.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc37fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3815eb60 con 0x7fcc380b1d10 2023-11-28T13:01:46.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc37fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3814a850 con 0x7fcc3806c140 2023-11-28T13:01:46.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc37fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3814ab30 con 0x7fcc380d25b0 2023-11-28T13:01:46.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc367fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc380b1d10 0x7fcc3815bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:46.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc367fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc380b1d10 0x7fcc3815bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41110/0 (socket says 172.21.15.82:41110) 2023-11-28T13:01:46.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc367fc700 1 -- 172.21.15.82:0/2192065895 learned_addr learned my addr 172.21.15.82:0/2192065895 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:46.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc36ffd700 1 --2- 172.21.15.82:0/2192065895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc3806c140 0x7fcc3815e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:46.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc377fe700 1 --2- 172.21.15.82:0/2192065895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc380d25b0 0x7fcc38149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:46.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc367fc700 1 -- 172.21.15.82:0/2192065895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc380d25b0 msgr2=0x7fcc38149d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:46.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc367fc700 1 --2- 172.21.15.82:0/2192065895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc380d25b0 0x7fcc38149d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc367fc700 1 -- 172.21.15.82:0/2192065895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc3806c140 msgr2=0x7fcc3815e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:46.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc367fc700 1 --2- 172.21.15.82:0/2192065895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc3806c140 0x7fcc3815e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc367fc700 1 -- 172.21.15.82:0/2192065895 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2c0094b0 con 0x7fcc380b1d10 2023-11-28T13:01:46.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc367fc700 1 --2- 172.21.15.82:0/2192065895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc380b1d10 0x7fcc3815bd20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800c490 tx=0x7fcc2800c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:46.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc1f7fe700 1 -- 172.21.15.82:0/2192065895 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2800cea0 con 0x7fcc380b1d10 2023-11-28T13:01:46.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc1f7fe700 1 -- 172.21.15.82:0/2192065895 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc280052f0 con 0x7fcc380b1d10 2023-11-28T13:01:46.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc37fff700 1 -- 172.21.15.82:0/2192065895 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc380d1050 con 0x7fcc380b1d10 2023-11-28T13:01:46.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc1f7fe700 1 -- 172.21.15.82:0/2192065895 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc280036a0 con 0x7fcc380b1d10 2023-11-28T13:01:46.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.682+0000 7fcc37fff700 1 -- 172.21.15.82:0/2192065895 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc380b20e0 con 0x7fcc380b1d10 2023-11-28T13:01:46.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.686+0000 7fcc37fff700 1 -- 172.21.15.82:0/2192065895 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc380d11e0 con 0x7fcc380b1d10 2023-11-28T13:01:46.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.686+0000 7fcc1f7fe700 1 -- 172.21.15.82:0/2192065895 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcc28019030 con 0x7fcc380b1d10 2023-11-28T13:01:46.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.686+0000 7fcc1f7fe700 1 --2- 172.21.15.82:0/2192065895 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcc24064ee0 0x7fcc24067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:46.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.686+0000 7fcc1f7fe700 1 -- 172.21.15.82:0/2192065895 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcc28081100 con 0x7fcc380b1d10 2023-11-28T13:01:46.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.686+0000 7fcc36ffd700 1 --2- 172.21.15.82:0/2192065895 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcc24064ee0 0x7fcc24067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:46.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.690+0000 7fcc36ffd700 1 --2- 172.21.15.82:0/2192065895 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcc24064ee0 0x7fcc24067390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0090b0 tx=0x7fcc2c01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:46.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.694+0000 7fcc1f7fe700 1 -- 172.21.15.82:0/2192065895 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcc2804f2a0 con 0x7fcc380b1d10 2023-11-28T13:01:46.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.858+0000 7fcc37fff700 1 -- 172.21.15.82:0/2192065895 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcc380d0ce0 con 0x7fcc380b1d10 2023-11-28T13:01:46.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.858+0000 7fcc1f7fe700 1 -- 172.21.15.82:0/2192065895 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcc280528c0 con 0x7fcc380b1d10 2023-11-28T13:01:46.863 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:01:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.858+0000 7fcc37fff700 1 -- 172.21.15.82:0/2192065895 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcc24064ee0 msgr2=0x7fcc24067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.858+0000 7fcc37fff700 1 --2- 172.21.15.82:0/2192065895 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcc24064ee0 0x7fcc24067390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0090b0 tx=0x7fcc2c01c040 comp rx=0 tx=0).stop 2023-11-28T13:01:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.858+0000 7fcc37fff700 1 -- 172.21.15.82:0/2192065895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc380b1d10 msgr2=0x7fcc3815bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.858+0000 7fcc37fff700 1 --2- 172.21.15.82:0/2192065895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc380b1d10 0x7fcc3815bd20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800c490 tx=0x7fcc2800c7a0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.858+0000 7fcc37fff700 1 -- 172.21.15.82:0/2192065895 shutdown_connections 2023-11-28T13:01:46.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.858+0000 7fcc37fff700 1 --2- 172.21.15.82:0/2192065895 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcc24064ee0 0x7fcc24067390 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.858+0000 7fcc37fff700 1 --2- 172.21.15.82:0/2192065895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc380d25b0 0x7fcc38149d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.858+0000 7fcc37fff700 1 --2- 172.21.15.82:0/2192065895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc380b1d10 0x7fcc3815bd20 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.858+0000 7fcc37fff700 1 --2- 172.21.15.82:0/2192065895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc3806c140 0x7fcc3815e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:46.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.858+0000 7fcc37fff700 1 -- 172.21.15.82:0/2192065895 >> 172.21.15.82:0/2192065895 conn(0x7fcc380b52a0 msgr2=0x7fcc380b3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:46.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.858+0000 7fcc37fff700 1 -- 172.21.15.82:0/2192065895 shutdown_connections 2023-11-28T13:01:46.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.858+0000 7fcc37fff700 1 -- 172.21.15.82:0/2192065895 wait complete. 2023-11-28T13:01:46.878 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T13:01:46.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.990+0000 7ff487fff700 1 Processor -- start 2023-11-28T13:01:46.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.990+0000 7ff487fff700 1 -- start start 2023-11-28T13:01:46.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff487fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff488156c50 0x7ff488159f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:47.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff487fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4880b1de0 0x7ff48806dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:47.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff487fff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4880b2330 con 0x7ff48806e100 2023-11-28T13:01:47.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff487fff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4880b3400 con 0x7ff488156c50 2023-11-28T13:01:47.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff487fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48815a480 con 0x7ff4880b1de0 2023-11-28T13:01:47.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff486ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff488156c50 0x7ff488159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:47.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff4877fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff48806e100 0x7ff48815cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60244/0 (socket says 172.21.15.82:60244) 2023-11-28T13:01:47.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff4877fe700 1 -- 172.21.15.82:0/463525390 learned_addr learned my addr 172.21.15.82:0/463525390 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:47.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff47e7fc700 1 --2- 172.21.15.82:0/463525390 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4880b1de0 0x7ff48806dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:47.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff486ffd700 1 -- 172.21.15.82:0/463525390 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4880b1de0 msgr2=0x7ff48806dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:47.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff486ffd700 1 --2- 172.21.15.82:0/463525390 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4880b1de0 0x7ff48806dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff486ffd700 1 -- 172.21.15.82:0/463525390 >> v1:172.21.15.82:6789/0 conn(0x7ff48806e100 legacy=0x7ff48815cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:47.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff486ffd700 1 -- 172.21.15.82:0/463525390 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4880b2610 con 0x7ff488156c50 2023-11-28T13:01:47.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff47e7fc700 1 --2- 172.21.15.82:0/463525390 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4880b1de0 0x7ff48806dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:47.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff4867fc700 1 -- 172.21.15.82:0/463525390 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3918376617 0 0) 0x7ff4880b2330 con 0x7ff48806e100 2023-11-28T13:01:47.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff486ffd700 1 --2- 172.21.15.82:0/463525390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff488156c50 0x7ff488159f40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff478009850 tx=0x7ff478009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c7f3a6537e0c61 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:47.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff4867fc700 1 -- 172.21.15.82:0/463525390 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff478011830 con 0x7ff488156c50 2023-11-28T13:01:47.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff4867fc700 1 -- 172.21.15.82:0/463525390 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff478011990 con 0x7ff488156c50 2023-11-28T13:01:47.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff4867fc700 1 -- 172.21.15.82:0/463525390 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff478011d20 con 0x7ff488156c50 2023-11-28T13:01:47.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff487fff700 1 -- 172.21.15.82:0/463525390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff488156c50 msgr2=0x7ff488159f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:47.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff487fff700 1 --2- 172.21.15.82:0/463525390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff488156c50 0x7ff488159f40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff478009850 tx=0x7ff478009b60 comp rx=0 tx=0).stop 2023-11-28T13:01:47.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff487fff700 1 -- 172.21.15.82:0/463525390 shutdown_connections 2023-11-28T13:01:47.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff487fff700 1 --2- 172.21.15.82:0/463525390 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4880b1de0 0x7ff48806dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff487fff700 1 --2- 172.21.15.82:0/463525390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff488156c50 0x7ff488159f40 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff487fff700 1 -- 172.21.15.82:0/463525390 >> 172.21.15.82:0/463525390 conn(0x7ff4880cee90 msgr2=0x7ff4880cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:47.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff487fff700 1 -- 172.21.15.82:0/463525390 shutdown_connections 2023-11-28T13:01:47.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.994+0000 7ff487fff700 1 -- 172.21.15.82:0/463525390 wait complete. 2023-11-28T13:01:47.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.998+0000 7ff487fff700 1 Processor -- start 2023-11-28T13:01:47.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.998+0000 7ff487fff700 1 -- start start 2023-11-28T13:01:47.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.998+0000 7ff487fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff48806e100 0x7ff4880cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:47.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.998+0000 7ff487fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4880b1de0 0x7ff488157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:47.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.998+0000 7ff487fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff488156c50 0x7ff4880cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:47.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.998+0000 7ff487fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48814c370 con 0x7ff48806e100 2023-11-28T13:01:47.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.998+0000 7ff487fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48814b9d0 con 0x7ff488156c50 2023-11-28T13:01:47.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.998+0000 7ff487fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48814bcb0 con 0x7ff4880b1de0 2023-11-28T13:01:47.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.998+0000 7ff486ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff48806e100 0x7ff4880cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:47.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.998+0000 7ff486ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff48806e100 0x7ff4880cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41118/0 (socket says 172.21.15.82:41118) 2023-11-28T13:01:47.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.998+0000 7ff486ffd700 1 -- 172.21.15.82:0/692453108 learned_addr learned my addr 172.21.15.82:0/692453108 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:47.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.998+0000 7ff4877fe700 1 --2- 172.21.15.82:0/692453108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff488156c50 0x7ff4880cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:47.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.998+0000 7ff47e7fc700 1 --2- 172.21.15.82:0/692453108 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4880b1de0 0x7ff488157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:47.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.998+0000 7ff486ffd700 1 -- 172.21.15.82:0/692453108 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4880b1de0 msgr2=0x7ff488157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:47.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.998+0000 7ff486ffd700 1 --2- 172.21.15.82:0/692453108 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4880b1de0 0x7ff488157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.998+0000 7ff486ffd700 1 -- 172.21.15.82:0/692453108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff488156c50 msgr2=0x7ff4880cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:47.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.998+0000 7ff486ffd700 1 --2- 172.21.15.82:0/692453108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff488156c50 0x7ff4880cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.998+0000 7ff486ffd700 1 -- 172.21.15.82:0/692453108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4780094b0 con 0x7ff48806e100 2023-11-28T13:01:47.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:46.998+0000 7ff486ffd700 1 --2- 172.21.15.82:0/692453108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff48806e100 0x7ff4880cd870 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff478000c00 tx=0x7ff478004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:47.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.002+0000 7ff47ffff700 1 -- 172.21.15.82:0/692453108 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff478004610 con 0x7ff48806e100 2023-11-28T13:01:47.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.002+0000 7ff47ffff700 1 -- 172.21.15.82:0/692453108 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47801e070 con 0x7ff48806e100 2023-11-28T13:01:47.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.002+0000 7ff487fff700 1 -- 172.21.15.82:0/692453108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4880b28f0 con 0x7ff48806e100 2023-11-28T13:01:47.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.002+0000 7ff47ffff700 1 -- 172.21.15.82:0/692453108 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4780038e0 con 0x7ff48806e100 2023-11-28T13:01:47.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.002+0000 7ff487fff700 1 -- 172.21.15.82:0/692453108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48806e540 con 0x7ff48806e100 2023-11-28T13:01:47.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.002+0000 7ff487fff700 1 -- 172.21.15.82:0/692453108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4880b2bd0 con 0x7ff48806e100 2023-11-28T13:01:47.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.002+0000 7ff47ffff700 1 -- 172.21.15.82:0/692453108 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff47800f050 con 0x7ff48806e100 2023-11-28T13:01:47.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.002+0000 7ff47ffff700 1 --2- 172.21.15.82:0/692453108 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff468064ee0 0x7ff468067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:47.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.002+0000 7ff47ffff700 1 -- 172.21.15.82:0/692453108 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff478020070 con 0x7ff48806e100 2023-11-28T13:01:47.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.002+0000 7ff47e7fc700 1 --2- 172.21.15.82:0/692453108 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff468064ee0 0x7ff468067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:47.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.006+0000 7ff47e7fc700 1 --2- 172.21.15.82:0/692453108 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff468064ee0 0x7ff468067390 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff48814d830 tx=0x7ff470008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:47.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.010+0000 7ff47ffff700 1 -- 172.21.15.82:0/692453108 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff4780513a0 con 0x7ff48806e100 2023-11-28T13:01:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.174+0000 7ff487fff700 1 -- 172.21.15.82:0/692453108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff488065fc0 con 0x7ff48806e100 2023-11-28T13:01:47.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.174+0000 7ff47ffff700 1 -- 172.21.15.82:0/692453108 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff47802a020 con 0x7ff48806e100 2023-11-28T13:01:47.179 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-11-28T13:01:47.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.174+0000 7ff487fff700 1 -- 172.21.15.82:0/692453108 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff468064ee0 msgr2=0x7ff468067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:47.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.174+0000 7ff487fff700 1 --2- 172.21.15.82:0/692453108 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff468064ee0 0x7ff468067390 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff48814d830 tx=0x7ff470008040 comp rx=0 tx=0).stop 2023-11-28T13:01:47.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.174+0000 7ff487fff700 1 -- 172.21.15.82:0/692453108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff48806e100 msgr2=0x7ff4880cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:47.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.174+0000 7ff487fff700 1 --2- 172.21.15.82:0/692453108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff48806e100 0x7ff4880cd870 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff478000c00 tx=0x7ff478004770 comp rx=0 tx=0).stop 2023-11-28T13:01:47.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.174+0000 7ff487fff700 1 -- 172.21.15.82:0/692453108 shutdown_connections 2023-11-28T13:01:47.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.174+0000 7ff487fff700 1 --2- 172.21.15.82:0/692453108 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff468064ee0 0x7ff468067390 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.174+0000 7ff487fff700 1 --2- 172.21.15.82:0/692453108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff488156c50 0x7ff4880cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.174+0000 7ff487fff700 1 --2- 172.21.15.82:0/692453108 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4880b1de0 0x7ff488157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.174+0000 7ff487fff700 1 --2- 172.21.15.82:0/692453108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff48806e100 0x7ff4880cd870 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.174+0000 7ff487fff700 1 -- 172.21.15.82:0/692453108 >> 172.21.15.82:0/692453108 conn(0x7ff4880cee90 msgr2=0x7ff488155ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:47.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.174+0000 7ff487fff700 1 -- 172.21.15.82:0/692453108 shutdown_connections 2023-11-28T13:01:47.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.174+0000 7ff487fff700 1 -- 172.21.15.82:0/692453108 wait complete. 2023-11-28T13:01:47.193 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T13:01:47.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.306+0000 7fe6d5e4e700 1 Processor -- start 2023-11-28T13:01:47.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.306+0000 7fe6d5e4e700 1 -- start start 2023-11-28T13:01:47.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.306+0000 7fe6d5e4e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe6d015c130 0x7fe6d00b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:47.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.306+0000 7fe6d5e4e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6d00cffd0 0x7fe6d00b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:47.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.306+0000 7fe6d5e4e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d00d0460 con 0x7fe6d015c500 2023-11-28T13:01:47.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.306+0000 7fe6d5e4e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d00cb040 con 0x7fe6d015c130 2023-11-28T13:01:47.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.306+0000 7fe6d5e4e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d00cb320 con 0x7fe6d00cffd0 2023-11-28T13:01:47.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.306+0000 7fe6d4e4c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe6d015c130 0x7fe6d00b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:47.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.306+0000 7fe6cffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe6d015c500 0x7fe6d015fdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60246/0 (socket says 172.21.15.82:60246) 2023-11-28T13:01:47.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.306+0000 7fe6cffff700 1 -- 172.21.15.82:0/1005420989 learned_addr learned my addr 172.21.15.82:0/1005420989 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:47.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.306+0000 7fe6d564d700 1 --2- 172.21.15.82:0/1005420989 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6d00cffd0 0x7fe6d00b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:47.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.306+0000 7fe6cf7fe700 1 -- 172.21.15.82:0/1005420989 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016103149 0 0) 0x7fe6d00d0460 con 0x7fe6d015c500 2023-11-28T13:01:47.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.306+0000 7fe6cf7fe700 1 -- 172.21.15.82:0/1005420989 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6bc0035d0 con 0x7fe6d015c500 2023-11-28T13:01:47.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.306+0000 7fe6d4e4c700 1 -- 172.21.15.82:0/1005420989 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6d00cffd0 msgr2=0x7fe6d00b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:47.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.306+0000 7fe6d4e4c700 1 --2- 172.21.15.82:0/1005420989 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6d00cffd0 0x7fe6d00b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.306+0000 7fe6d4e4c700 1 -- 172.21.15.82:0/1005420989 >> v1:172.21.15.82:6789/0 conn(0x7fe6d015c500 legacy=0x7fe6d015fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:47.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.310+0000 7fe6d4e4c700 1 -- 172.21.15.82:0/1005420989 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d00cb600 con 0x7fe6d015c130 2023-11-28T13:01:47.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.310+0000 7fe6d4e4c700 1 --2- 172.21.15.82:0/1005420989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6d015c130 0x7fe6d00b22d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0009850 tx=0x7fe6c0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad515194b6796d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:47.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.310+0000 7fe6cf7fe700 1 -- 172.21.15.82:0/1005420989 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0011830 con 0x7fe6d015c130 2023-11-28T13:01:47.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.310+0000 7fe6cf7fe700 1 -- 172.21.15.82:0/1005420989 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c0011990 con 0x7fe6d015c130 2023-11-28T13:01:47.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.310+0000 7fe6cf7fe700 1 -- 172.21.15.82:0/1005420989 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0011d00 con 0x7fe6d015c130 2023-11-28T13:01:47.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.310+0000 7fe6d5e4e700 1 -- 172.21.15.82:0/1005420989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6d015c130 msgr2=0x7fe6d00b22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:47.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.310+0000 7fe6d5e4e700 1 --2- 172.21.15.82:0/1005420989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6d015c130 0x7fe6d00b22d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0009850 tx=0x7fe6c0009b60 comp rx=0 tx=0).stop 2023-11-28T13:01:47.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.310+0000 7fe6d5e4e700 1 -- 172.21.15.82:0/1005420989 shutdown_connections 2023-11-28T13:01:47.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.310+0000 7fe6d5e4e700 1 --2- 172.21.15.82:0/1005420989 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6d00cffd0 0x7fe6d00b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.310+0000 7fe6d5e4e700 1 --2- 172.21.15.82:0/1005420989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6d015c130 0x7fe6d00b22d0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.310+0000 7fe6d5e4e700 1 -- 172.21.15.82:0/1005420989 >> 172.21.15.82:0/1005420989 conn(0x7fe6d00cd2d0 msgr2=0x7fe6d00cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:47.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.310+0000 7fe6d5e4e700 1 -- 172.21.15.82:0/1005420989 shutdown_connections 2023-11-28T13:01:47.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.310+0000 7fe6d5e4e700 1 -- 172.21.15.82:0/1005420989 wait complete. 2023-11-28T13:01:47.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.310+0000 7fe6d5e4e700 1 Processor -- start 2023-11-28T13:01:47.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.310+0000 7fe6d5e4e700 1 -- start start 2023-11-28T13:01:47.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6d5e4e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6d00cffd0 0x7fe6d00ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:47.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6d5e4e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6d015c130 0x7fe6d00c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:47.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6d5e4e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6d015c500 0x7fe6d00c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:47.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6d5e4e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d01f1d60 con 0x7fe6d015c130 2023-11-28T13:01:47.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6d5e4e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d00c91c0 con 0x7fe6d00cffd0 2023-11-28T13:01:47.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6d5e4e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d00c94a0 con 0x7fe6d015c500 2023-11-28T13:01:47.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6cffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6d015c130 0x7fe6d00c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:47.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6d4e4c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6d00cffd0 0x7fe6d00ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:47.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6cffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6d015c130 0x7fe6d00c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41134/0 (socket says 172.21.15.82:41134) 2023-11-28T13:01:47.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6cffff700 1 -- 172.21.15.82:0/3772096797 learned_addr learned my addr 172.21.15.82:0/3772096797 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:47.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6d564d700 1 --2- 172.21.15.82:0/3772096797 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6d015c500 0x7fe6d00c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:47.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6d4e4c700 1 -- 172.21.15.82:0/3772096797 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6d015c500 msgr2=0x7fe6d00c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:47.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6d4e4c700 1 --2- 172.21.15.82:0/3772096797 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6d015c500 0x7fe6d00c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6d4e4c700 1 -- 172.21.15.82:0/3772096797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6d015c130 msgr2=0x7fe6d00c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:47.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6d4e4c700 1 --2- 172.21.15.82:0/3772096797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6d015c130 0x7fe6d00c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6d4e4c700 1 -- 172.21.15.82:0/3772096797 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c00094b0 con 0x7fe6d00cffd0 2023-11-28T13:01:47.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6d564d700 1 --2- 172.21.15.82:0/3772096797 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6d015c500 0x7fe6d00c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:47.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6cffff700 1 --2- 172.21.15.82:0/3772096797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6d015c130 0x7fe6d00c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:01:47.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6d4e4c700 1 --2- 172.21.15.82:0/3772096797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6d00cffd0 0x7fe6d00ca260 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0016000 tx=0x7fe6c0004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:47.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6cd7fa700 1 -- 172.21.15.82:0/3772096797 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00044d0 con 0x7fe6d00cffd0 2023-11-28T13:01:47.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6cd7fa700 1 -- 172.21.15.82:0/3772096797 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c001f070 con 0x7fe6d00cffd0 2023-11-28T13:01:47.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6d5e4e700 1 -- 172.21.15.82:0/3772096797 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d00afd90 con 0x7fe6d00cffd0 2023-11-28T13:01:47.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6cd7fa700 1 -- 172.21.15.82:0/3772096797 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0003900 con 0x7fe6d00cffd0 2023-11-28T13:01:47.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.314+0000 7fe6d5e4e700 1 -- 172.21.15.82:0/3772096797 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d00afc00 con 0x7fe6d00cffd0 2023-11-28T13:01:47.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.318+0000 7fe6d5e4e700 1 -- 172.21.15.82:0/3772096797 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d00cbb20 con 0x7fe6d00cffd0 2023-11-28T13:01:47.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.318+0000 7fe6cd7fa700 1 -- 172.21.15.82:0/3772096797 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe6c000f050 con 0x7fe6d00cffd0 2023-11-28T13:01:47.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.318+0000 7fe6cd7fa700 1 --2- 172.21.15.82:0/3772096797 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe6b0064ee0 0x7fe6b0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:47.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.318+0000 7fe6cd7fa700 1 -- 172.21.15.82:0/3772096797 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe6c0021070 con 0x7fe6d00cffd0 2023-11-28T13:01:47.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.318+0000 7fe6cffff700 1 --2- 172.21.15.82:0/3772096797 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe6b0064ee0 0x7fe6b0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:47.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.318+0000 7fe6cffff700 1 --2- 172.21.15.82:0/3772096797 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe6b0064ee0 0x7fe6b0067390 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe6d01f5390 tx=0x7fe6b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:47.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.326+0000 7fe6cd7fa700 1 -- 172.21.15.82:0/3772096797 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe6c0051930 con 0x7fe6d00cffd0 2023-11-28T13:01:47.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.490+0000 7fe6d5e4e700 1 -- 172.21.15.82:0/3772096797 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6d00b41e0 con 0x7fe6d00cffd0 2023-11-28T13:01:47.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.494+0000 7fe6cd7fa700 1 -- 172.21.15.82:0/3772096797 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe6c002b020 con 0x7fe6d00cffd0 2023-11-28T13:01:47.499 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-11-28T13:01:47.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.494+0000 7fe6d5e4e700 1 -- 172.21.15.82:0/3772096797 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe6b0064ee0 msgr2=0x7fe6b0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:47.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.494+0000 7fe6d5e4e700 1 --2- 172.21.15.82:0/3772096797 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe6b0064ee0 0x7fe6b0067390 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe6d01f5390 tx=0x7fe6b8009040 comp rx=0 tx=0).stop 2023-11-28T13:01:47.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.494+0000 7fe6d5e4e700 1 -- 172.21.15.82:0/3772096797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6d00cffd0 msgr2=0x7fe6d00ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:47.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.494+0000 7fe6d5e4e700 1 --2- 172.21.15.82:0/3772096797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6d00cffd0 0x7fe6d00ca260 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0016000 tx=0x7fe6c0004770 comp rx=0 tx=0).stop 2023-11-28T13:01:47.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.494+0000 7fe6d5e4e700 1 -- 172.21.15.82:0/3772096797 shutdown_connections 2023-11-28T13:01:47.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.494+0000 7fe6d5e4e700 1 --2- 172.21.15.82:0/3772096797 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe6b0064ee0 0x7fe6b0067390 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.494+0000 7fe6d5e4e700 1 --2- 172.21.15.82:0/3772096797 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6d015c500 0x7fe6d00c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.494+0000 7fe6d5e4e700 1 --2- 172.21.15.82:0/3772096797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6d015c130 0x7fe6d00c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.494+0000 7fe6d5e4e700 1 --2- 172.21.15.82:0/3772096797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6d00cffd0 0x7fe6d00ca260 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.494+0000 7fe6d5e4e700 1 -- 172.21.15.82:0/3772096797 >> 172.21.15.82:0/3772096797 conn(0x7fe6d00cd2d0 msgr2=0x7fe6d00b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.494+0000 7fe6d5e4e700 1 -- 172.21.15.82:0/3772096797 shutdown_connections 2023-11-28T13:01:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.494+0000 7fe6d5e4e700 1 -- 172.21.15.82:0/3772096797 wait complete. 2023-11-28T13:01:47.519 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T13:01:47.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.626+0000 7fd37ffff700 1 Processor -- start 2023-11-28T13:01:47.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.626+0000 7fd37ffff700 1 -- start start 2023-11-28T13:01:47.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.626+0000 7fd37ffff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd3801591c0 0x7fd38015d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:47.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.626+0000 7fd37ffff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd38015da50 con 0x7fd380158df0 2023-11-28T13:01:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.626+0000 7fd37ffff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3800c9e20 con 0x7fd380070070 2023-11-28T13:01:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.626+0000 7fd37ffff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3800cc640 con 0x7fd3801591c0 2023-11-28T13:01:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.626+0000 7fd37effd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd380158df0 0x7fd38006c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60252/0 (socket says 172.21.15.82:60252) 2023-11-28T13:01:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.626+0000 7fd37effd700 1 -- 172.21.15.82:0/3565135127 learned_addr learned my addr 172.21.15.82:0/3565135127 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.626+0000 7fd3767fc700 1 --2- 172.21.15.82:0/3565135127 >> v2:172.21.15.114:3300/0 conn(0x7fd3801591c0 0x7fd38015d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:47.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.626+0000 7fd37e7fc700 1 -- 172.21.15.82:0/3565135127 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1267110429 0 0) 0x7fd370001110 con 0x7fd380158df0 2023-11-28T13:01:47.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.626+0000 7fd37e7fc700 1 -- 172.21.15.82:0/3565135127 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd36c0035d0 con 0x7fd380158df0 2023-11-28T13:01:47.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37e7fc700 1 -- 172.21.15.82:0/3565135127 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 712675747 0 0) 0x7fd36c0035d0 con 0x7fd380158df0 2023-11-28T13:01:47.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37e7fc700 1 -- 172.21.15.82:0/3565135127 >> v2:172.21.15.114:3300/0 conn(0x7fd3801591c0 msgr2=0x7fd38015d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:47.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37e7fc700 1 --2- 172.21.15.82:0/3565135127 >> v2:172.21.15.114:3300/0 conn(0x7fd3801591c0 0x7fd38015d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37e7fc700 1 -- 172.21.15.82:0/3565135127 >> v1:172.21.15.114:6789/0 conn(0x7fd380070070 legacy=0x7fd3800ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:47.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37e7fc700 1 -- 172.21.15.82:0/3565135127 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3800c97d0 con 0x7fd380158df0 2023-11-28T13:01:47.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37e7fc700 1 -- 172.21.15.82:0/3565135127 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7fd370001800 con 0x7fd380158df0 2023-11-28T13:01:47.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37e7fc700 1 -- 172.21.15.82:0/3565135127 >> v1:172.21.15.82:6789/0 conn(0x7fd380158df0 legacy=0x7fd38006c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:47.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37e7fc700 1 --2- 172.21.15.82:0/3565135127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd36c003a20 0x7fd36c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:47.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37e7fc700 1 --2- 172.21.15.82:0/3565135127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd36c004870 0x7fd36c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:47.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37e7fc700 1 --2- 172.21.15.82:0/3565135127 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd36c005220 0x7fd36c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:47.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37e7fc700 1 -- 172.21.15.82:0/3565135127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3800cc640 con 0x7fd36c004870 2023-11-28T13:01:47.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37e7fc700 1 -- 172.21.15.82:0/3565135127 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c00c0a0 con 0x7fd36c003a20 2023-11-28T13:01:47.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37e7fc700 1 -- 172.21.15.82:0/3565135127 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c00c260 con 0x7fd36c005220 2023-11-28T13:01:47.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd3767fc700 1 --2- 172.21.15.82:0/3565135127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd36c004870 0x7fd36c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:47.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37effd700 1 --2- 172.21.15.82:0/3565135127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd36c003a20 0x7fd36c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:47.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37f7fe700 1 --2- 172.21.15.82:0/3565135127 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd36c005220 0x7fd36c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:47.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd3767fc700 1 -- 172.21.15.82:0/3565135127 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd36c005220 msgr2=0x7fd36c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:47.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd3767fc700 1 --2- 172.21.15.82:0/3565135127 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd36c005220 0x7fd36c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd3767fc700 1 -- 172.21.15.82:0/3565135127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd36c003a20 msgr2=0x7fd36c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:47.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd3767fc700 1 --2- 172.21.15.82:0/3565135127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd36c003a20 0x7fd36c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd3767fc700 1 -- 172.21.15.82:0/3565135127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c0035d0 con 0x7fd36c004870 2023-11-28T13:01:47.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37f7fe700 1 -- 172.21.15.82:0/3565135127 reap_dead start 2023-11-28T13:01:47.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37effd700 1 --2- 172.21.15.82:0/3565135127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd36c003a20 0x7fd36c003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:47.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd3767fc700 1 --2- 172.21.15.82:0/3565135127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd36c004870 0x7fd36c004ce0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd368009b40 tx=0x7fd36c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b3d9eea484c093 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:47.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37e7fc700 1 -- 172.21.15.82:0/3565135127 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36800e6c0 con 0x7fd36c004870 2023-11-28T13:01:47.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37e7fc700 1 -- 172.21.15.82:0/3565135127 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36800e820 con 0x7fd36c004870 2023-11-28T13:01:47.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37e7fc700 1 -- 172.21.15.82:0/3565135127 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36800eb90 con 0x7fd36c004870 2023-11-28T13:01:47.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37ffff700 1 -- 172.21.15.82:0/3565135127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd36c004870 msgr2=0x7fd36c004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:47.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37ffff700 1 --2- 172.21.15.82:0/3565135127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd36c004870 0x7fd36c004ce0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd368009b40 tx=0x7fd36c0058a0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37ffff700 1 -- 172.21.15.82:0/3565135127 shutdown_connections 2023-11-28T13:01:47.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37ffff700 1 --2- 172.21.15.82:0/3565135127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd36c004870 0x7fd36c004ce0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37ffff700 1 -- 172.21.15.82:0/3565135127 >> 172.21.15.82:0/3565135127 conn(0x7fd3800ce600 msgr2=0x7fd3800ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:47.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37ffff700 1 -- 172.21.15.82:0/3565135127 shutdown_connections 2023-11-28T13:01:47.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37ffff700 1 -- 172.21.15.82:0/3565135127 wait complete. 2023-11-28T13:01:47.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37ffff700 1 Processor -- start 2023-11-28T13:01:47.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.630+0000 7fd37ffff700 1 -- start start 2023-11-28T13:01:47.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd37ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd36c004870 0x7fd3801549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:47.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd37ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd380142da0 0x7fd380157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:47.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd37ffff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd3801579b0 0x7fd380153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:47.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd37ffff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd380156710 con 0x7fd36c004870 2023-11-28T13:01:47.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd37ffff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3801552b0 con 0x7fd380142da0 2023-11-28T13:01:47.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd37ffff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd380154fd0 con 0x7fd3801579b0 2023-11-28T13:01:47.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd37effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd36c004870 0x7fd3801549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:47.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd37effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd36c004870 0x7fd3801549f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41152/0 (socket says 172.21.15.82:41152) 2023-11-28T13:01:47.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd37effd700 1 -- 172.21.15.82:0/3182150111 learned_addr learned my addr 172.21.15.82:0/3182150111 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:47.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd37f7fe700 1 --2- 172.21.15.82:0/3182150111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd3801579b0 0x7fd380153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:47.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd3767fc700 1 --2- 172.21.15.82:0/3182150111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd380142da0 0x7fd380157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:47.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd37effd700 1 -- 172.21.15.82:0/3182150111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd3801579b0 msgr2=0x7fd380153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:47.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd37effd700 1 --2- 172.21.15.82:0/3182150111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd3801579b0 0x7fd380153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd37effd700 1 -- 172.21.15.82:0/3182150111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd380142da0 msgr2=0x7fd380157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:47.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd37effd700 1 --2- 172.21.15.82:0/3182150111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd380142da0 0x7fd380157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd37effd700 1 -- 172.21.15.82:0/3182150111 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3800c9480 con 0x7fd36c004870 2023-11-28T13:01:47.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd37effd700 1 --2- 172.21.15.82:0/3182150111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd36c004870 0x7fd3801549f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd370007fc0 tx=0x7fd370007330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:47.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd377fff700 1 -- 172.21.15.82:0/3182150111 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3700114f0 con 0x7fd36c004870 2023-11-28T13:01:47.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd377fff700 1 -- 172.21.15.82:0/3182150111 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd370011650 con 0x7fd36c004870 2023-11-28T13:01:47.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd37ffff700 1 -- 172.21.15.82:0/3182150111 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3800c9ab0 con 0x7fd36c004870 2023-11-28T13:01:47.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd377fff700 1 -- 172.21.15.82:0/3182150111 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3700119c0 con 0x7fd36c004870 2023-11-28T13:01:47.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.634+0000 7fd37ffff700 1 -- 172.21.15.82:0/3182150111 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3800add00 con 0x7fd36c004870 2023-11-28T13:01:47.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.638+0000 7fd37ffff700 1 -- 172.21.15.82:0/3182150111 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd380065fc0 con 0x7fd36c004870 2023-11-28T13:01:47.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.638+0000 7fd377fff700 1 -- 172.21.15.82:0/3182150111 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd37001b030 con 0x7fd36c004870 2023-11-28T13:01:47.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.638+0000 7fd377fff700 1 --2- 172.21.15.82:0/3182150111 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd360064ee0 0x7fd360067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:47.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.638+0000 7fd3767fc700 1 --2- 172.21.15.82:0/3182150111 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd360064ee0 0x7fd360067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:47.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.638+0000 7fd377fff700 1 -- 172.21.15.82:0/3182150111 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd370081590 con 0x7fd36c004870 2023-11-28T13:01:47.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.638+0000 7fd3767fc700 1 --2- 172.21.15.82:0/3182150111 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd360064ee0 0x7fd360067390 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd3680090b0 tx=0x7fd36801e040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:47.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.646+0000 7fd377fff700 1 -- 172.21.15.82:0/3182150111 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd37004c400 con 0x7fd36c004870 2023-11-28T13:01:47.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.818+0000 7fd37ffff700 1 -- 172.21.15.82:0/3182150111 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd38015da50 con 0x7fd36c004870 2023-11-28T13:01:47.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.822+0000 7fd377fff700 1 -- 172.21.15.82:0/3182150111 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd38015da50 con 0x7fd36c004870 2023-11-28T13:01:47.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.822+0000 7fd37ffff700 1 -- 172.21.15.82:0/3182150111 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd360064ee0 msgr2=0x7fd360067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:47.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.822+0000 7fd37ffff700 1 --2- 172.21.15.82:0/3182150111 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd360064ee0 0x7fd360067390 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd3680090b0 tx=0x7fd36801e040 comp rx=0 tx=0).stop 2023-11-28T13:01:47.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.822+0000 7fd37ffff700 1 -- 172.21.15.82:0/3182150111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd36c004870 msgr2=0x7fd3801549f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:47.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.822+0000 7fd37ffff700 1 --2- 172.21.15.82:0/3182150111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd36c004870 0x7fd3801549f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd370007fc0 tx=0x7fd370007330 comp rx=0 tx=0).stop 2023-11-28T13:01:47.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.822+0000 7fd37ffff700 1 -- 172.21.15.82:0/3182150111 shutdown_connections 2023-11-28T13:01:47.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.822+0000 7fd37ffff700 1 --2- 172.21.15.82:0/3182150111 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd360064ee0 0x7fd360067390 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.822+0000 7fd37ffff700 1 --2- 172.21.15.82:0/3182150111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd3801579b0 0x7fd380153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.822+0000 7fd37ffff700 1 --2- 172.21.15.82:0/3182150111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd380142da0 0x7fd380157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.822+0000 7fd37ffff700 1 --2- 172.21.15.82:0/3182150111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd36c004870 0x7fd3801549f0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:47.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.822+0000 7fd37ffff700 1 -- 172.21.15.82:0/3182150111 >> 172.21.15.82:0/3182150111 conn(0x7fd3800ce600 msgr2=0x7fd3800cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:47.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.822+0000 7fd37ffff700 1 -- 172.21.15.82:0/3182150111 shutdown_connections 2023-11-28T13:01:47.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:47.822+0000 7fd37ffff700 1 -- 172.21.15.82:0/3182150111 wait complete. 2023-11-28T13:01:47.831 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2023-11-28T13:01:47.842 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2023-11-28T13:01:47.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:47.842 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T13:01:47.857 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[48038]: fuse finished with error 0 and tester_r 0 2023-11-28T13:01:47.858 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:01:53.960 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-11-28T13:01:53.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:01:53.960 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T13:01:53.968 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:01:54.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.122+0000 7f0a737ab700 1 Processor -- start 2023-11-28T13:01:54.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.122+0000 7f0a737ab700 1 -- start start 2023-11-28T13:01:54.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a737ab700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0a6c15a1d0 0x7f0a6c15c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:54.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a737ab700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0a6c15cf30 0x7f0a6c0703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:54.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a737ab700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6c069bc0 con 0x7f0a6c159e00 2023-11-28T13:01:54.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a737ab700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6c15d3d0 con 0x7f0a6c15cf30 2023-11-28T13:01:54.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a737ab700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6c0ce6b0 con 0x7f0a6c15a1d0 2023-11-28T13:01:54.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a71d48700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0a6c15cf30 0x7f0a6c0703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:54.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a71547700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0a6c159e00 0x7f0a6c06a680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60262/0 (socket says 172.21.15.82:60262) 2023-11-28T13:01:54.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a71d48700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0a6c15cf30 0x7f0a6c0703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41156/0 (socket says 172.21.15.82:41156) 2023-11-28T13:01:54.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a71d48700 1 -- 172.21.15.82:0/4019280774 learned_addr learned my addr 172.21.15.82:0/4019280774 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:54.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a70d46700 1 --2- 172.21.15.82:0/4019280774 >> v2:172.21.15.114:3300/0 conn(0x7f0a6c15a1d0 0x7f0a6c15c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:54.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a71d48700 1 -- 172.21.15.82:0/4019280774 >> v2:172.21.15.114:3300/0 conn(0x7f0a6c15a1d0 msgr2=0x7f0a6c15c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:54.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a71d48700 1 --2- 172.21.15.82:0/4019280774 >> v2:172.21.15.114:3300/0 conn(0x7f0a6c15a1d0 0x7f0a6c15c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:54.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a71d48700 1 -- 172.21.15.82:0/4019280774 >> v1:172.21.15.82:6789/0 conn(0x7f0a6c159e00 legacy=0x7f0a6c06a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:54.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a71d48700 1 -- 172.21.15.82:0/4019280774 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c15d5b0 con 0x7f0a6c15cf30 2023-11-28T13:01:54.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a71d48700 1 --2- 172.21.15.82:0/4019280774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a6c15cf30 0x7f0a6c0703e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0caf40 tx=0x7f0a6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38108168a733308 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:54.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a63fff700 1 -- 172.21.15.82:0/4019280774 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6400e070 con 0x7f0a6c15cf30 2023-11-28T13:01:54.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a63fff700 1 -- 172.21.15.82:0/4019280774 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6400b9c0 con 0x7f0a6c15cf30 2023-11-28T13:01:54.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a63fff700 1 -- 172.21.15.82:0/4019280774 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6400bd70 con 0x7f0a6c15cf30 2023-11-28T13:01:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a737ab700 1 -- 172.21.15.82:0/4019280774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a6c15cf30 msgr2=0x7f0a6c0703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a737ab700 1 --2- 172.21.15.82:0/4019280774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a6c15cf30 0x7f0a6c0703e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0caf40 tx=0x7f0a6400b330 comp rx=0 tx=0).stop 2023-11-28T13:01:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a737ab700 1 -- 172.21.15.82:0/4019280774 shutdown_connections 2023-11-28T13:01:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a737ab700 1 --2- 172.21.15.82:0/4019280774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a6c15cf30 0x7f0a6c0703e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a737ab700 1 --2- 172.21.15.82:0/4019280774 >> v2:172.21.15.114:3300/0 conn(0x7f0a6c15a1d0 0x7f0a6c15c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a737ab700 1 -- 172.21.15.82:0/4019280774 >> 172.21.15.82:0/4019280774 conn(0x7f0a6c0ce9b0 msgr2=0x7f0a6c0ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a737ab700 1 -- 172.21.15.82:0/4019280774 shutdown_connections 2023-11-28T13:01:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.126+0000 7f0a737ab700 1 -- 172.21.15.82:0/4019280774 wait complete. 2023-11-28T13:01:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a737ab700 1 Processor -- start 2023-11-28T13:01:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a737ab700 1 -- start start 2023-11-28T13:01:54.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a737ab700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a6c159e00 0x7f0a6c152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:54.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a737ab700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a6c15a1d0 0x7f0a6c153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a737ab700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0a6c15cf30 0x7f0a6c1541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a737ab700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c155f20 con 0x7f0a6c159e00 2023-11-28T13:01:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a737ab700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c157b50 con 0x7f0a6c15a1d0 2023-11-28T13:01:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a737ab700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c152880 con 0x7f0a6c15cf30 2023-11-28T13:01:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a71547700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a6c159e00 0x7f0a6c152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a71547700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a6c159e00 0x7f0a6c152340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41172/0 (socket says 172.21.15.82:41172) 2023-11-28T13:01:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a71547700 1 -- 172.21.15.82:0/2021502119 learned_addr learned my addr 172.21.15.82:0/2021502119 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a71d48700 1 --2- 172.21.15.82:0/2021502119 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0a6c15cf30 0x7f0a6c1541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a70d46700 1 --2- 172.21.15.82:0/2021502119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a6c15a1d0 0x7f0a6c153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a71547700 1 -- 172.21.15.82:0/2021502119 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0a6c15cf30 msgr2=0x7f0a6c1541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a71547700 1 --2- 172.21.15.82:0/2021502119 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0a6c15cf30 0x7f0a6c1541e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a71547700 1 -- 172.21.15.82:0/2021502119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a6c15a1d0 msgr2=0x7f0a6c153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:54.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a71547700 1 --2- 172.21.15.82:0/2021502119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a6c15a1d0 0x7f0a6c153ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:54.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a71547700 1 -- 172.21.15.82:0/2021502119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a64009b30 con 0x7f0a6c159e00 2023-11-28T13:01:54.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a71547700 1 --2- 172.21.15.82:0/2021502119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a6c159e00 0x7f0a6c152340 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00c730 tx=0x7f0a5c00caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:54.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a61ffb700 1 -- 172.21.15.82:0/2021502119 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c005cd0 con 0x7f0a6c159e00 2023-11-28T13:01:54.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a61ffb700 1 -- 172.21.15.82:0/2021502119 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c005e30 con 0x7f0a6c159e00 2023-11-28T13:01:54.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a737ab700 1 -- 172.21.15.82:0/2021502119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6c069e80 con 0x7f0a6c159e00 2023-11-28T13:01:54.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a61ffb700 1 -- 172.21.15.82:0/2021502119 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c0072d0 con 0x7f0a6c159e00 2023-11-28T13:01:54.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.130+0000 7f0a737ab700 1 -- 172.21.15.82:0/2021502119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6c15d890 con 0x7f0a6c159e00 2023-11-28T13:01:54.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.134+0000 7f0a737ab700 1 -- 172.21.15.82:0/2021502119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6c06a160 con 0x7f0a6c159e00 2023-11-28T13:01:54.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.134+0000 7f0a61ffb700 1 -- 172.21.15.82:0/2021502119 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0a5c019030 con 0x7f0a6c159e00 2023-11-28T13:01:54.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.134+0000 7f0a61ffb700 1 --2- 172.21.15.82:0/2021502119 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0a50064ee0 0x7f0a50067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:54.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.134+0000 7f0a70d46700 1 --2- 172.21.15.82:0/2021502119 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0a50064ee0 0x7f0a50067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:54.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.134+0000 7f0a61ffb700 1 -- 172.21.15.82:0/2021502119 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0a5c0810c0 con 0x7f0a6c159e00 2023-11-28T13:01:54.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.134+0000 7f0a70d46700 1 --2- 172.21.15.82:0/2021502119 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0a50064ee0 0x7f0a50067390 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0ad930 tx=0x7f0a68008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:54.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.142+0000 7f0a61ffb700 1 -- 172.21.15.82:0/2021502119 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0a5c04a400 con 0x7f0a6c159e00 2023-11-28T13:01:54.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.342+0000 7f0a737ab700 1 -- 172.21.15.82:0/2021502119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a6c073e50 con 0x7f0a6c159e00 2023-11-28T13:01:54.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.342+0000 7f0a61ffb700 1 -- 172.21.15.82:0/2021502119 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f0a5c017090 con 0x7f0a6c159e00 2023-11-28T13:01:54.349 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:54.349 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2975361458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2975361458},{"type":"v1","addr":"172.21.15.114:6833","nonce":2975361458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3412196002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3412196002},{"type":"v1","addr":"172.21.15.114:6835","nonce":3412196002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/167093290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":167093290},{"type":"v1","addr":"172.21.15.82:6835","nonce":167093290}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:01:29.585949+0000","modified":"2023-11-28T13:01:32.836050+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/3448846386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3448846386},{"type":"v1","addr":"172.21.15.82:6837","nonce":3448846386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T13:01:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.346+0000 7f0a737ab700 1 -- 172.21.15.82:0/2021502119 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0a50064ee0 msgr2=0x7f0a50067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.346+0000 7f0a737ab700 1 --2- 172.21.15.82:0/2021502119 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0a50064ee0 0x7f0a50067390 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0ad930 tx=0x7f0a68008040 comp rx=0 tx=0).stop 2023-11-28T13:01:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.346+0000 7f0a737ab700 1 -- 172.21.15.82:0/2021502119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a6c159e00 msgr2=0x7f0a6c152340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.346+0000 7f0a737ab700 1 --2- 172.21.15.82:0/2021502119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a6c159e00 0x7f0a6c152340 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00c730 tx=0x7f0a5c00caf0 comp rx=0 tx=0).stop 2023-11-28T13:01:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.346+0000 7f0a737ab700 1 -- 172.21.15.82:0/2021502119 shutdown_connections 2023-11-28T13:01:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.346+0000 7f0a737ab700 1 --2- 172.21.15.82:0/2021502119 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0a50064ee0 0x7f0a50067390 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.346+0000 7f0a737ab700 1 --2- 172.21.15.82:0/2021502119 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0a6c15cf30 0x7f0a6c1541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:54.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.346+0000 7f0a737ab700 1 --2- 172.21.15.82:0/2021502119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a6c15a1d0 0x7f0a6c153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:54.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.346+0000 7f0a737ab700 1 --2- 172.21.15.82:0/2021502119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a6c159e00 0x7f0a6c152340 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:54.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.346+0000 7f0a737ab700 1 -- 172.21.15.82:0/2021502119 >> 172.21.15.82:0/2021502119 conn(0x7f0a6c0ce9b0 msgr2=0x7f0a6c15f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:54.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.346+0000 7f0a737ab700 1 -- 172.21.15.82:0/2021502119 shutdown_connections 2023-11-28T13:01:54.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.346+0000 7f0a737ab700 1 -- 172.21.15.82:0/2021502119 wait complete. 2023-11-28T13:01:54.352 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2023-11-28T13:01:54.363 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-11-28T13:01:54.498 INFO:teuthology.orchestra.run.smithi082.stdout:{"message":"","return_code":0} 2023-11-28T13:01:54.501 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-28T13:01:54.501 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:01:54.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.606+0000 7fb8697a5700 1 Processor -- start 2023-11-28T13:01:54.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.606+0000 7fb8697a5700 1 -- start start 2023-11-28T13:01:54.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.606+0000 7fb8697a5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb8640b3910 0x7fb86406b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:54.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.606+0000 7fb8697a5700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb86406c910 0x7fb86406d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:54.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.606+0000 7fb8697a5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86406c480 con 0x7fb864070070 2023-11-28T13:01:54.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.606+0000 7fb8697a5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86406dbe0 con 0x7fb8640b3910 2023-11-28T13:01:54.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.606+0000 7fb8697a5700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86406dec0 con 0x7fb86406c910 2023-11-28T13:01:54.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.606+0000 7fb863fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb8640b3910 0x7fb86406b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:54.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.606+0000 7fb868fa4700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb864070070 0x7fb86415db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60264/0 (socket says 172.21.15.82:60264) 2023-11-28T13:01:54.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.606+0000 7fb868fa4700 1 -- 172.21.15.82:0/69164157 learned_addr learned my addr 172.21.15.82:0/69164157 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:01:54.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb8637fe700 1 --2- 172.21.15.82:0/69164157 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb86406c910 0x7fb86406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:54.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb863fff700 1 -- 172.21.15.82:0/69164157 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb86406c910 msgr2=0x7fb86406d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:01:54.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb863fff700 1 --2- 172.21.15.82:0/69164157 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb86406c910 0x7fb86406d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:54.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb863fff700 1 -- 172.21.15.82:0/69164157 >> v1:172.21.15.82:6789/0 conn(0x7fb864070070 legacy=0x7fb86415db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:54.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb862ffd700 1 -- 172.21.15.82:0/69164157 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723691290 0 0) 0x7fb86406c480 con 0x7fb864070070 2023-11-28T13:01:54.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb863fff700 1 -- 172.21.15.82:0/69164157 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86406c110 con 0x7fb8640b3910 2023-11-28T13:01:54.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb8637fe700 1 --2- 172.21.15.82:0/69164157 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb86406c910 0x7fb86406d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:54.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb863fff700 1 --2- 172.21.15.82:0/69164157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8640b3910 0x7fb86406b0a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb858009850 tx=0x7fb858009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa212be6273b332 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:54.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb862ffd700 1 -- 172.21.15.82:0/69164157 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858011830 con 0x7fb8640b3910 2023-11-28T13:01:54.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb862ffd700 1 -- 172.21.15.82:0/69164157 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb858011990 con 0x7fb8640b3910 2023-11-28T13:01:54.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb862ffd700 1 -- 172.21.15.82:0/69164157 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858011d20 con 0x7fb8640b3910 2023-11-28T13:01:54.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb8697a5700 1 -- 172.21.15.82:0/69164157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8640b3910 msgr2=0x7fb86406b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:54.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb8697a5700 1 --2- 172.21.15.82:0/69164157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8640b3910 0x7fb86406b0a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb858009850 tx=0x7fb858009b60 comp rx=0 tx=0).stop 2023-11-28T13:01:54.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb8697a5700 1 -- 172.21.15.82:0/69164157 shutdown_connections 2023-11-28T13:01:54.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb8697a5700 1 --2- 172.21.15.82:0/69164157 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb86406c910 0x7fb86406d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:54.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb8697a5700 1 --2- 172.21.15.82:0/69164157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8640b3910 0x7fb86406b0a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:54.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb8697a5700 1 -- 172.21.15.82:0/69164157 >> 172.21.15.82:0/69164157 conn(0x7fb8640ce600 msgr2=0x7fb8640ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:54.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb8697a5700 1 -- 172.21.15.82:0/69164157 shutdown_connections 2023-11-28T13:01:54.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb8697a5700 1 -- 172.21.15.82:0/69164157 wait complete. 2023-11-28T13:01:54.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb8697a5700 1 Processor -- start 2023-11-28T13:01:54.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb8697a5700 1 -- start start 2023-11-28T13:01:54.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb8697a5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb86406c910 0x7fb8640acc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:54.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb8697a5700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb864070070 0x7fb8640c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:54.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb8697a5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8641547d0 0x7fb8640c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:54.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb8697a5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640c7aa0 con 0x7fb86406c910 2023-11-28T13:01:54.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb8697a5700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86415e6a0 con 0x7fb8641547d0 2023-11-28T13:01:54.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb8697a5700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640c6e20 con 0x7fb864070070 2023-11-28T13:01:54.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.610+0000 7fb863fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb86406c910 0x7fb8640acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:54.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.614+0000 7fb863fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb86406c910 0x7fb8640acc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41186/0 (socket says 172.21.15.82:41186) 2023-11-28T13:01:54.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.614+0000 7fb863fff700 1 -- 172.21.15.82:0/3437479078 learned_addr learned my addr 172.21.15.82:0/3437479078 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:01:54.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.614+0000 7fb8637fe700 1 --2- 172.21.15.82:0/3437479078 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb864070070 0x7fb8640c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:54.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.614+0000 7fb868fa4700 1 --2- 172.21.15.82:0/3437479078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8641547d0 0x7fb8640c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:54.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.614+0000 7fb863fff700 1 -- 172.21.15.82:0/3437479078 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb864070070 msgr2=0x7fb8640c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:54.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.614+0000 7fb863fff700 1 --2- 172.21.15.82:0/3437479078 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb864070070 0x7fb8640c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:54.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.614+0000 7fb863fff700 1 -- 172.21.15.82:0/3437479078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8641547d0 msgr2=0x7fb8640c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:54.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.614+0000 7fb863fff700 1 --2- 172.21.15.82:0/3437479078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8641547d0 0x7fb8640c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:54.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.614+0000 7fb863fff700 1 -- 172.21.15.82:0/3437479078 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8580094b0 con 0x7fb86406c910 2023-11-28T13:01:54.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.614+0000 7fb868fa4700 1 --2- 172.21.15.82:0/3437479078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8641547d0 0x7fb8640c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:01:54.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.614+0000 7fb863fff700 1 --2- 172.21.15.82:0/3437479078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb86406c910 0x7fb8640acc90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb858000c00 tx=0x7fb858004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:54.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.614+0000 7fb860ff9700 1 -- 172.21.15.82:0/3437479078 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8580045d0 con 0x7fb86406c910 2023-11-28T13:01:54.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.614+0000 7fb860ff9700 1 -- 172.21.15.82:0/3437479078 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85801f070 con 0x7fb86406c910 2023-11-28T13:01:54.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.614+0000 7fb8697a5700 1 -- 172.21.15.82:0/3437479078 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86406d860 con 0x7fb86406c910 2023-11-28T13:01:54.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.614+0000 7fb860ff9700 1 -- 172.21.15.82:0/3437479078 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858003900 con 0x7fb86406c910 2023-11-28T13:01:54.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.614+0000 7fb8697a5700 1 -- 172.21.15.82:0/3437479078 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8640c8f80 con 0x7fb86406c910 2023-11-28T13:01:54.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.614+0000 7fb8697a5700 1 -- 172.21.15.82:0/3437479078 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8640b3ce0 con 0x7fb86406c910 2023-11-28T13:01:54.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.618+0000 7fb860ff9700 1 -- 172.21.15.82:0/3437479078 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb85800f050 con 0x7fb86406c910 2023-11-28T13:01:54.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.618+0000 7fb860ff9700 1 --2- 172.21.15.82:0/3437479078 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb850064ee0 0x7fb850067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:01:54.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.618+0000 7fb860ff9700 1 -- 172.21.15.82:0/3437479078 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb858021070 con 0x7fb86406c910 2023-11-28T13:01:54.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.618+0000 7fb8637fe700 1 --2- 172.21.15.82:0/3437479078 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb850064ee0 0x7fb850067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:01:54.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.618+0000 7fb8637fe700 1 --2- 172.21.15.82:0/3437479078 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb850064ee0 0x7fb850067390 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb8640b1650 tx=0x7fb854009910 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:01:54.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.626+0000 7fb860ff9700 1 -- 172.21.15.82:0/3437479078 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb8580514c0 con 0x7fb86406c910 2023-11-28T13:01:54.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.822+0000 7fb8697a5700 1 -- 172.21.15.82:0/3437479078 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8640c7be0 con 0x7fb86406c910 2023-11-28T13:01:54.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.822+0000 7fb860ff9700 1 -- 172.21.15.82:0/3437479078 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4651 (secure 0 0 0) 0x7fb8640c7be0 con 0x7fb86406c910 2023-11-28T13:01:54.828 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:01:54.828 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2975361458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2975361458},{"type":"v1","addr":"172.21.15.114:6833","nonce":2975361458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3412196002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3412196002},{"type":"v1","addr":"172.21.15.114:6835","nonce":3412196002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/167093290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":167093290},{"type":"v1","addr":"172.21.15.82:6835","nonce":167093290}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:01:29.585949+0000","modified":"2023-11-28T13:01:32.836050+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/3448846386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3448846386},{"type":"v1","addr":"172.21.15.82:6837","nonce":3448846386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T13:01:54.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.822+0000 7fb8697a5700 1 -- 172.21.15.82:0/3437479078 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb850064ee0 msgr2=0x7fb850067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:54.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.822+0000 7fb8697a5700 1 --2- 172.21.15.82:0/3437479078 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb850064ee0 0x7fb850067390 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb8640b1650 tx=0x7fb854009910 comp rx=0 tx=0).stop 2023-11-28T13:01:54.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.822+0000 7fb8697a5700 1 -- 172.21.15.82:0/3437479078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb86406c910 msgr2=0x7fb8640acc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:01:54.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.822+0000 7fb8697a5700 1 --2- 172.21.15.82:0/3437479078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb86406c910 0x7fb8640acc90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb858000c00 tx=0x7fb858004770 comp rx=0 tx=0).stop 2023-11-28T13:01:54.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.822+0000 7fb8697a5700 1 -- 172.21.15.82:0/3437479078 shutdown_connections 2023-11-28T13:01:54.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.822+0000 7fb8697a5700 1 --2- 172.21.15.82:0/3437479078 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb850064ee0 0x7fb850067390 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:54.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.822+0000 7fb8697a5700 1 --2- 172.21.15.82:0/3437479078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8641547d0 0x7fb8640c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:54.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.822+0000 7fb8697a5700 1 --2- 172.21.15.82:0/3437479078 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb864070070 0x7fb8640c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:54.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.822+0000 7fb8697a5700 1 --2- 172.21.15.82:0/3437479078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb86406c910 0x7fb8640acc90 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:01:54.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.822+0000 7fb8697a5700 1 -- 172.21.15.82:0/3437479078 >> 172.21.15.82:0/3437479078 conn(0x7fb8640ce600 msgr2=0x7fb8640b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:01:54.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.822+0000 7fb8697a5700 1 -- 172.21.15.82:0/3437479078 shutdown_connections 2023-11-28T13:01:54.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:01:54.822+0000 7fb8697a5700 1 -- 172.21.15.82:0/3437479078 wait complete. 2023-11-28T13:01:54.831 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2023-11-28T13:01:54.843 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json tag path /parentdir mytag 2023-11-28T13:01:54.965 INFO:teuthology.orchestra.run.smithi082.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2023-11-28T13:01:54.965 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2023-11-28T13:01:57.263 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:01:57.267 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:02:04.966 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2023-11-28T13:02:05.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde7387140 1 Processor -- start 2023-11-28T13:02:05.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde7387140 1 -- start start 2023-11-28T13:02:05.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde7387140 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5649a19cfd80 0x5649a1a9e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde7387140 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649a1aa1250 0x5649a1aa1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde7387140 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5649a1aa1620 0x5649a1aa23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde7387140 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a18f3240 con 0x5649a1aa1250 2023-11-28T13:02:05.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde7387140 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a1aa1c70 con 0x5649a1aa1620 2023-11-28T13:02:05.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde7387140 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649a1aa40e0 con 0x5649a19cfd80 2023-11-28T13:02:05.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde46bb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649a1aa1250 0x5649a1aa1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde46bb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649a1aa1250 0x5649a1aa1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53148/0 (socket says 172.21.15.82:53148) 2023-11-28T13:02:05.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde46bb700 1 -- 172.21.15.82:0/1161931428 learned_addr learned my addr 172.21.15.82:0/1161931428 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:05.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde46bb700 1 -- 172.21.15.82:0/1161931428 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5649a19cfd80 msgr2=0x5649a1a9e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:05.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde46bb700 1 --2- 172.21.15.82:0/1161931428 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5649a19cfd80 0x5649a1a9e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde46bb700 1 -- 172.21.15.82:0/1161931428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5649a1aa1620 msgr2=0x5649a1aa23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:05.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde46bb700 1 --2- 172.21.15.82:0/1161931428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5649a1aa1620 0x5649a1aa23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde46bb700 1 -- 172.21.15.82:0/1161931428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbddc00a100 con 0x5649a1aa1250 2023-11-28T13:02:05.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde46bb700 1 --2- 172.21.15.82:0/1161931428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649a1aa1250 0x5649a1aa1e80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbddc005f10 tx=0x7fbddc00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f21d83f51716271 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde36b9700 1 -- 172.21.15.82:0/1161931428 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc00f790 con 0x5649a1aa1250 2023-11-28T13:02:05.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde36b9700 1 -- 172.21.15.82:0/1161931428 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbddc00fa60 con 0x5649a1aa1250 2023-11-28T13:02:05.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde36b9700 1 -- 172.21.15.82:0/1161931428 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc00fe30 con 0x5649a1aa1250 2023-11-28T13:02:05.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde7387140 1 -- 172.21.15.82:0/1161931428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649a1aa1250 msgr2=0x5649a1aa1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde7387140 1 --2- 172.21.15.82:0/1161931428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649a1aa1250 0x5649a1aa1e80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbddc005f10 tx=0x7fbddc00f000 comp rx=0 tx=0).stop 2023-11-28T13:02:05.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde7387140 1 -- 172.21.15.82:0/1161931428 shutdown_connections 2023-11-28T13:02:05.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde7387140 1 --2- 172.21.15.82:0/1161931428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5649a1aa1620 0x5649a1aa23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde7387140 1 --2- 172.21.15.82:0/1161931428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649a1aa1250 0x5649a1aa1e80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde7387140 1 --2- 172.21.15.82:0/1161931428 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5649a19cfd80 0x5649a1a9e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde7387140 1 -- 172.21.15.82:0/1161931428 >> 172.21.15.82:0/1161931428 conn(0x5649a19fad50 msgr2=0x5649a19ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:05.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde7387140 1 -- 172.21.15.82:0/1161931428 shutdown_connections 2023-11-28T13:02:05.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.006+0000 7fbde7387140 1 -- 172.21.15.82:0/1161931428 wait complete. 2023-11-28T13:02:05.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.010+0000 7fbde7387140 1 Processor -- start 2023-11-28T13:02:05.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.010+0000 7fbde7387140 1 -- start start 2023-11-28T13:02:05.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.010+0000 7fbde7387140 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5649a19cfd80 0x5649a1a9d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.010+0000 7fbde7387140 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649a1aa1250 0x5649a1a996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.010+0000 7fbde7387140 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5649a1aa1620 0x5649a1a99be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.010+0000 7fbde7387140 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a1b34110 con 0x5649a1aa1250 2023-11-28T13:02:05.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.010+0000 7fbde7387140 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a1a9d5c0 con 0x5649a1aa1620 2023-11-28T13:02:05.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.010+0000 7fbde7387140 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649a1b2f7d0 con 0x5649a19cfd80 2023-11-28T13:02:05.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.010+0000 7fbde46bb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649a1aa1250 0x5649a1a996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.010+0000 7fbde46bb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649a1aa1250 0x5649a1a996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53162/0 (socket says 172.21.15.82:53162) 2023-11-28T13:02:05.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.010+0000 7fbde46bb700 1 -- 172.21.15.82:0/953483904 learned_addr learned my addr 172.21.15.82:0/953483904 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:05.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.010+0000 7fbde56bd700 1 --2- 172.21.15.82:0/953483904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5649a1aa1620 0x5649a1a99be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.010+0000 7fbde4ebc700 1 --2- 172.21.15.82:0/953483904 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5649a19cfd80 0x5649a1a9d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.014+0000 7fbde46bb700 1 -- 172.21.15.82:0/953483904 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5649a19cfd80 msgr2=0x5649a1a9d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.014+0000 7fbde46bb700 1 --2- 172.21.15.82:0/953483904 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5649a19cfd80 0x5649a1a9d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.014+0000 7fbde46bb700 1 -- 172.21.15.82:0/953483904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5649a1aa1620 msgr2=0x5649a1a99be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.014+0000 7fbde46bb700 1 --2- 172.21.15.82:0/953483904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5649a1aa1620 0x5649a1a99be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.014+0000 7fbde46bb700 1 -- 172.21.15.82:0/953483904 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649a1925760 con 0x5649a1aa1250 2023-11-28T13:02:05.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.014+0000 7fbde46bb700 1 --2- 172.21.15.82:0/953483904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649a1aa1250 0x5649a1a996a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00a3f0 tx=0x7fbddc003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.014+0000 7fbde26b7700 1 -- 172.21.15.82:0/953483904 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc023920 con 0x5649a1aa1250 2023-11-28T13:02:05.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.014+0000 7fbde26b7700 1 -- 172.21.15.82:0/953483904 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbddc009030 con 0x5649a1aa1250 2023-11-28T13:02:05.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.014+0000 7fbde7387140 1 -- 172.21.15.82:0/953483904 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5649a190b390 con 0x5649a1aa1250 2023-11-28T13:02:05.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.014+0000 7fbde26b7700 1 -- 172.21.15.82:0/953483904 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc023cc0 con 0x5649a1aa1250 2023-11-28T13:02:05.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.014+0000 7fbde7387140 1 -- 172.21.15.82:0/953483904 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5649a18fe8b0 con 0x5649a1aa1250 2023-11-28T13:02:05.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.014+0000 7fbde26b7700 1 -- 172.21.15.82:0/953483904 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbddc020030 con 0x5649a1aa1250 2023-11-28T13:02:05.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.018+0000 7fbde26b7700 1 --2- 172.21.15.82:0/953483904 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbdc4063840 0x7fbdc4065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.018+0000 7fbde26b7700 1 -- 172.21.15.82:0/953483904 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbddc082c00 con 0x5649a1aa1250 2023-11-28T13:02:05.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.018+0000 7fbde4ebc700 1 --2- 172.21.15.82:0/953483904 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbdc4063840 0x7fbdc4065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.018+0000 7fbde7387140 1 --2- 172.21.15.82:0/953483904 >> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] conn(0x5649a1b38bc0 0x5649a1b38fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.018+0000 7fbde7387140 1 -- 172.21.15.82:0/953483904 --> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) v8 -- 0x5649a1b39500 con 0x5649a1b38bc0 2023-11-28T13:02:05.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.018+0000 7fbde56bd700 1 --2- 172.21.15.82:0/953483904 >> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] conn(0x5649a1b38bc0 0x5649a1b38fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.018+0000 7fbde4ebc700 1 --2- 172.21.15.82:0/953483904 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbdc4063840 0x7fbdc4065cf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc001a20 tx=0x7fbdcc0019b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.018+0000 7fbde56bd700 1 --2- 172.21.15.82:0/953483904 >> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] conn(0x5649a1b38bc0 0x5649a1b38fc0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.018+0000 7fbde56bd700 1 -- 172.21.15.82:0/953483904 <== osd.7 v2:172.21.15.114:6816/36806 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7fbdd4012040 con 0x5649a1b38bc0 2023-11-28T13:02:05.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.018+0000 7fbde7387140 1 -- 172.21.15.82:0/953483904 >> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] conn(0x5649a1b38bc0 msgr2=0x5649a1b38fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.018+0000 7fbde7387140 1 --2- 172.21.15.82:0/953483904 >> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] conn(0x5649a1b38bc0 0x5649a1b38fc0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.018+0000 7fbde7387140 1 -- 172.21.15.82:0/953483904 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbdc4063840 msgr2=0x7fbdc4065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.018+0000 7fbde7387140 1 --2- 172.21.15.82:0/953483904 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbdc4063840 0x7fbdc4065cf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc001a20 tx=0x7fbdcc0019b0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.018+0000 7fbde7387140 1 -- 172.21.15.82:0/953483904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649a1aa1250 msgr2=0x5649a1a996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.018+0000 7fbde7387140 1 --2- 172.21.15.82:0/953483904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649a1aa1250 0x5649a1a996a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00a3f0 tx=0x7fbddc003330 comp rx=0 tx=0).stop 2023-11-28T13:02:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.018+0000 7fbde56bd700 1 -- 172.21.15.82:0/953483904 reap_dead start 2023-11-28T13:02:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.018+0000 7fbde7387140 1 -- 172.21.15.82:0/953483904 shutdown_connections 2023-11-28T13:02:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.018+0000 7fbde7387140 1 -- 172.21.15.82:0/953483904 >> 172.21.15.82:0/953483904 conn(0x5649a19fad50 msgr2=0x5649a19cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.018+0000 7fbde7387140 1 -- 172.21.15.82:0/953483904 shutdown_connections 2023-11-28T13:02:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.018+0000 7fbde7387140 1 -- 172.21.15.82:0/953483904 wait complete. 2023-11-28T13:02:05.026 INFO:teuthology.orchestra.run.smithi082.stdout:mytag 2023-11-28T13:02:05.027 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2023-11-28T13:02:05.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.066+0000 7f8492a9b140 1 Processor -- start 2023-11-28T13:02:05.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.066+0000 7f8492a9b140 1 -- start start 2023-11-28T13:02:05.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.066+0000 7f8492a9b140 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f821e20840 0x55f821ef5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.066+0000 7f8492a9b140 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f821e651c0 0x55f821ef11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.066+0000 7f8492a9b140 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f821ef2250 0x55f821e62740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.066+0000 7f8492a9b140 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f821ef16f0 con 0x55f821ef2250 2023-11-28T13:02:05.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.066+0000 7f8492a9b140 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f821e1da40 con 0x55f821e651c0 2023-11-28T13:02:05.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.066+0000 7f8492a9b140 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f821eefd80 con 0x55f821e20840 2023-11-28T13:02:05.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f8490dd1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f821ef2250 0x55f821e62740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f8490dd1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f821ef2250 0x55f821e62740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53180/0 (socket says 172.21.15.82:53180) 2023-11-28T13:02:05.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f84905d0700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f821e20840 0x55f821ef5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f8490dd1700 1 -- 172.21.15.82:0/4088811813 learned_addr learned my addr 172.21.15.82:0/4088811813 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:05.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f848fdcf700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f821e651c0 0x55f821ef11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f8490dd1700 1 -- 172.21.15.82:0/4088811813 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f821e20840 msgr2=0x55f821ef5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:05.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f8490dd1700 1 --2- 172.21.15.82:0/4088811813 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f821e20840 0x55f821ef5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f8490dd1700 1 -- 172.21.15.82:0/4088811813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f821e651c0 msgr2=0x55f821ef11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:05.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f8490dd1700 1 --2- 172.21.15.82:0/4088811813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f821e651c0 0x55f821ef11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f8490dd1700 1 -- 172.21.15.82:0/4088811813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8484005de0 con 0x55f821ef2250 2023-11-28T13:02:05.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f8490dd1700 1 --2- 172.21.15.82:0/4088811813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f821ef2250 0x55f821e62740 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f848800a5b0 tx=0x7f848800a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1786c45ac3a43f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f848edcd700 1 -- 172.21.15.82:0/4088811813 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848800f070 con 0x55f821ef2250 2023-11-28T13:02:05.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f848edcd700 1 -- 172.21.15.82:0/4088811813 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8488007600 con 0x55f821ef2250 2023-11-28T13:02:05.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f848edcd700 1 -- 172.21.15.82:0/4088811813 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488007990 con 0x55f821ef2250 2023-11-28T13:02:05.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f8492a9b140 1 -- 172.21.15.82:0/4088811813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f821ef2250 msgr2=0x55f821e62740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f8492a9b140 1 --2- 172.21.15.82:0/4088811813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f821ef2250 0x55f821e62740 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f848800a5b0 tx=0x7f848800a8c0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f8492a9b140 1 -- 172.21.15.82:0/4088811813 shutdown_connections 2023-11-28T13:02:05.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f8492a9b140 1 --2- 172.21.15.82:0/4088811813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f821ef2250 0x55f821e62740 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f8492a9b140 1 --2- 172.21.15.82:0/4088811813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f821e651c0 0x55f821ef11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f8492a9b140 1 --2- 172.21.15.82:0/4088811813 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f821e20840 0x55f821ef5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f8492a9b140 1 -- 172.21.15.82:0/4088811813 >> 172.21.15.82:0/4088811813 conn(0x55f821e4bd50 msgr2=0x55f821e4a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:05.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f8492a9b140 1 -- 172.21.15.82:0/4088811813 shutdown_connections 2023-11-28T13:02:05.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.070+0000 7f8492a9b140 1 -- 172.21.15.82:0/4088811813 wait complete. 2023-11-28T13:02:05.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.074+0000 7f8492a9b140 1 Processor -- start 2023-11-28T13:02:05.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.074+0000 7f8492a9b140 1 -- start start 2023-11-28T13:02:05.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.074+0000 7f8492a9b140 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f821e20840 0x55f821f894a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.074+0000 7f8492a9b140 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f821e651c0 0x55f821ef3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.074+0000 7f8492a9b140 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f821ef2250 0x55f821ef3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.074+0000 7f8492a9b140 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f821e62aa0 con 0x55f821ef2250 2023-11-28T13:02:05.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.074+0000 7f8492a9b140 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f821ef3bb0 con 0x55f821e651c0 2023-11-28T13:02:05.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.074+0000 7f8492a9b140 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f821ef3e50 con 0x55f821e20840 2023-11-28T13:02:05.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.074+0000 7f8490dd1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f821ef2250 0x55f821ef3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.074+0000 7f8490dd1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f821ef2250 0x55f821ef3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53184/0 (socket says 172.21.15.82:53184) 2023-11-28T13:02:05.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.074+0000 7f8490dd1700 1 -- 172.21.15.82:0/717907354 learned_addr learned my addr 172.21.15.82:0/717907354 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:05.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.074+0000 7f848fdcf700 1 --2- 172.21.15.82:0/717907354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f821e651c0 0x55f821ef3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.074+0000 7f84905d0700 1 --2- 172.21.15.82:0/717907354 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f821e20840 0x55f821f894a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.074+0000 7f8490dd1700 1 -- 172.21.15.82:0/717907354 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f821e20840 msgr2=0x55f821f894a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.074+0000 7f8490dd1700 1 --2- 172.21.15.82:0/717907354 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f821e20840 0x55f821f894a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.074+0000 7f8490dd1700 1 -- 172.21.15.82:0/717907354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f821e651c0 msgr2=0x55f821ef3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.074+0000 7f8490dd1700 1 --2- 172.21.15.82:0/717907354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f821e651c0 0x55f821ef3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.074+0000 7f8490dd1700 1 -- 172.21.15.82:0/717907354 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8488005e40 con 0x55f821ef2250 2023-11-28T13:02:05.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.074+0000 7f848fdcf700 1 --2- 172.21.15.82:0/717907354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f821e651c0 0x55f821ef3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:05.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.074+0000 7f84905d0700 1 --2- 172.21.15.82:0/717907354 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f821e20840 0x55f821f894a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:05.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.074+0000 7f8490dd1700 1 --2- 172.21.15.82:0/717907354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f821ef2250 0x55f821ef3570 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8488017040 tx=0x7f8488003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.078+0000 7f848ddcb700 1 -- 172.21.15.82:0/717907354 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488014680 con 0x55f821ef2250 2023-11-28T13:02:05.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.078+0000 7f848ddcb700 1 -- 172.21.15.82:0/717907354 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84880147e0 con 0x55f821ef2250 2023-11-28T13:02:05.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.078+0000 7f848ddcb700 1 -- 172.21.15.82:0/717907354 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488014b90 con 0x55f821ef2250 2023-11-28T13:02:05.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.078+0000 7f8492a9b140 1 -- 172.21.15.82:0/717907354 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f821d76760 con 0x55f821ef2250 2023-11-28T13:02:05.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.078+0000 7f8492a9b140 1 -- 172.21.15.82:0/717907354 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f821d5c390 con 0x55f821ef2250 2023-11-28T13:02:05.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.078+0000 7f848ddcb700 1 -- 172.21.15.82:0/717907354 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8488014cf0 con 0x55f821ef2250 2023-11-28T13:02:05.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.082+0000 7f848ddcb700 1 --2- 172.21.15.82:0/717907354 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f847c063810 0x7f847c065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.082+0000 7f848ddcb700 1 -- 172.21.15.82:0/717907354 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8488082350 con 0x55f821ef2250 2023-11-28T13:02:05.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.082+0000 7f84905d0700 1 --2- 172.21.15.82:0/717907354 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f847c063810 0x7f847c065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.082+0000 7f8492a9b140 1 --2- 172.21.15.82:0/717907354 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x55f821eeb290 0x55f821eeb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.082+0000 7f8492a9b140 1 -- 172.21.15.82:0/717907354 --> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) v8 -- 0x55f821eebbd0 con 0x55f821eeb290 2023-11-28T13:02:05.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.082+0000 7f848fdcf700 1 --2- 172.21.15.82:0/717907354 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x55f821eeb290 0x55f821eeb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.082+0000 7f84905d0700 1 --2- 172.21.15.82:0/717907354 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f847c063810 0x7f847c065cc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8480005fd0 tx=0x7f8480007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.082+0000 7f848fdcf700 1 --2- 172.21.15.82:0/717907354 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x55f821eeb290 0x55f821eeb690 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.082+0000 7f848fdcf700 1 -- 172.21.15.82:0/717907354 <== osd.5 v2:172.21.15.114:6808/36804 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f8484008b80 con 0x55f821eeb290 2023-11-28T13:02:05.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.082+0000 7f8492a9b140 1 -- 172.21.15.82:0/717907354 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x55f821eeb290 msgr2=0x55f821eeb690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.082+0000 7f8492a9b140 1 --2- 172.21.15.82:0/717907354 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x55f821eeb290 0x55f821eeb690 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.082+0000 7f8492a9b140 1 -- 172.21.15.82:0/717907354 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f847c063810 msgr2=0x7f847c065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.082+0000 7f8492a9b140 1 --2- 172.21.15.82:0/717907354 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f847c063810 0x7f847c065cc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8480005fd0 tx=0x7f8480007040 comp rx=0 tx=0).stop 2023-11-28T13:02:05.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.082+0000 7f8492a9b140 1 -- 172.21.15.82:0/717907354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f821ef2250 msgr2=0x55f821ef3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.082+0000 7f8492a9b140 1 --2- 172.21.15.82:0/717907354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f821ef2250 0x55f821ef3570 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8488017040 tx=0x7f8488003020 comp rx=0 tx=0).stop 2023-11-28T13:02:05.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.082+0000 7f8490dd1700 1 -- 172.21.15.82:0/717907354 reap_dead start 2023-11-28T13:02:05.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.082+0000 7f8492a9b140 1 -- 172.21.15.82:0/717907354 shutdown_connections 2023-11-28T13:02:05.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.082+0000 7f8492a9b140 1 -- 172.21.15.82:0/717907354 >> 172.21.15.82:0/717907354 conn(0x55f821e4bd50 msgr2=0x55f821eeef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:05.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.082+0000 7f8492a9b140 1 -- 172.21.15.82:0/717907354 shutdown_connections 2023-11-28T13:02:05.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.082+0000 7f8492a9b140 1 -- 172.21.15.82:0/717907354 wait complete. 2023-11-28T13:02:05.090 INFO:teuthology.orchestra.run.smithi082.stdout:mytag 2023-11-28T13:02:05.090 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2023-11-28T13:02:05.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.174+0000 7fdc23d0a140 1 Processor -- start 2023-11-28T13:02:05.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.174+0000 7fdc23d0a140 1 -- start start 2023-11-28T13:02:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.178+0000 7fdc23d0a140 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5629816d0840 0x562981714bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.178+0000 7fdc23d0a140 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5629817151c0 0x5629817a1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.178+0000 7fdc23d0a140 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629817a2250 0x562981718750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.178+0000 7fdc23d0a140 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629815f4240 con 0x5629817a2250 2023-11-28T13:02:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.178+0000 7fdc23d0a140 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629817a17d0 con 0x5629816d0840 2023-11-28T13:02:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.178+0000 7fdc23d0a140 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x56298179eee0 con 0x5629817151c0 2023-11-28T13:02:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.178+0000 7fdc2103e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5629817151c0 0x5629817a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.178+0000 7fdc22040700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629817a2250 0x562981718750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.178+0000 7fdc2183f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5629816d0840 0x562981714bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.178+0000 7fdc2103e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5629817151c0 0x5629817a1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:48318/0 (socket says 172.21.15.82:48318) 2023-11-28T13:02:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.178+0000 7fdc2103e700 1 -- 172.21.15.82:0/2576647522 learned_addr learned my addr 172.21.15.82:0/2576647522 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.178+0000 7fdc2103e700 1 -- 172.21.15.82:0/2576647522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5629816d0840 msgr2=0x562981714bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.178+0000 7fdc2103e700 1 --2- 172.21.15.82:0/2576647522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5629816d0840 0x562981714bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.178+0000 7fdc2103e700 1 -- 172.21.15.82:0/2576647522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629817a2250 msgr2=0x562981718750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.178+0000 7fdc2103e700 1 --2- 172.21.15.82:0/2576647522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629817a2250 0x562981718750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.178+0000 7fdc2103e700 1 -- 172.21.15.82:0/2576647522 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c005de0 con 0x5629817151c0 2023-11-28T13:02:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.178+0000 7fdc22040700 1 --2- 172.21.15.82:0/2576647522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629817a2250 0x562981718750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:02:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.178+0000 7fdc2103e700 1 --2- 172.21.15.82:0/2576647522 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5629817151c0 0x5629817a1290 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c000c00 tx=0x7fdc0c00d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fefe2e93c75d8e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.178+0000 7fdc1bfff700 1 -- 172.21.15.82:0/2576647522 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c008b40 con 0x5629817151c0 2023-11-28T13:02:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.178+0000 7fdc1bfff700 1 -- 172.21.15.82:0/2576647522 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0c008ca0 con 0x5629817151c0 2023-11-28T13:02:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.178+0000 7fdc1bfff700 1 -- 172.21.15.82:0/2576647522 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c012650 con 0x5629817151c0 2023-11-28T13:02:05.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc23d0a140 1 -- 172.21.15.82:0/2576647522 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5629817151c0 msgr2=0x5629817a1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc23d0a140 1 --2- 172.21.15.82:0/2576647522 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5629817151c0 0x5629817a1290 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c000c00 tx=0x7fdc0c00d000 comp rx=0 tx=0).stop 2023-11-28T13:02:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc23d0a140 1 -- 172.21.15.82:0/2576647522 shutdown_connections 2023-11-28T13:02:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc23d0a140 1 --2- 172.21.15.82:0/2576647522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629817a2250 0x562981718750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc23d0a140 1 --2- 172.21.15.82:0/2576647522 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5629817151c0 0x5629817a1290 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc23d0a140 1 --2- 172.21.15.82:0/2576647522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5629816d0840 0x562981714bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc23d0a140 1 -- 172.21.15.82:0/2576647522 >> 172.21.15.82:0/2576647522 conn(0x5629816fbd50 msgr2=0x56298179fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc23d0a140 1 -- 172.21.15.82:0/2576647522 shutdown_connections 2023-11-28T13:02:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc23d0a140 1 -- 172.21.15.82:0/2576647522 wait complete. 2023-11-28T13:02:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc23d0a140 1 Processor -- start 2023-11-28T13:02:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc23d0a140 1 -- start start 2023-11-28T13:02:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc23d0a140 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5629816d0840 0x562981713b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc23d0a140 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5629817151c0 0x56298178bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc23d0a140 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629817a2250 0x5629816cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc23d0a140 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56298178cbb0 con 0x5629817a2250 2023-11-28T13:02:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc23d0a140 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x56298178ce50 con 0x5629816d0840 2023-11-28T13:02:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc23d0a140 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x56298178d0f0 con 0x5629817151c0 2023-11-28T13:02:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc22040700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629817a2250 0x5629816cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc22040700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629817a2250 0x5629816cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53214/0 (socket says 172.21.15.82:53214) 2023-11-28T13:02:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc22040700 1 -- 172.21.15.82:0/3767989225 learned_addr learned my addr 172.21.15.82:0/3767989225 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc2183f700 1 --2- 172.21.15.82:0/3767989225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5629816d0840 0x562981713b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc2103e700 1 --2- 172.21.15.82:0/3767989225 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5629817151c0 0x56298178bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc22040700 1 -- 172.21.15.82:0/3767989225 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5629817151c0 msgr2=0x56298178bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc22040700 1 --2- 172.21.15.82:0/3767989225 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5629817151c0 0x56298178bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc22040700 1 -- 172.21.15.82:0/3767989225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5629816d0840 msgr2=0x562981713b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc22040700 1 --2- 172.21.15.82:0/3767989225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5629816d0840 0x562981713b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc22040700 1 -- 172.21.15.82:0/3767989225 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1400a040 con 0x5629817a2250 2023-11-28T13:02:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc22040700 1 --2- 172.21.15.82:0/3767989225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629817a2250 0x5629816cf6c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400ef60 tx=0x7fdc1400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc1affd700 1 -- 172.21.15.82:0/3767989225 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1400ca40 con 0x5629817a2250 2023-11-28T13:02:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc1affd700 1 -- 172.21.15.82:0/3767989225 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc14008030 con 0x5629817a2250 2023-11-28T13:02:05.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc23d0a140 1 -- 172.21.15.82:0/3767989225 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562981626760 con 0x5629817a2250 2023-11-28T13:02:05.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc1affd700 1 -- 172.21.15.82:0/3767989225 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1400cdc0 con 0x5629817a2250 2023-11-28T13:02:05.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.182+0000 7fdc23d0a140 1 -- 172.21.15.82:0/3767989225 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56298160c390 con 0x5629817a2250 2023-11-28T13:02:05.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.186+0000 7fdc1affd700 1 -- 172.21.15.82:0/3767989225 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdc14021070 con 0x5629817a2250 2023-11-28T13:02:05.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.186+0000 7fdc1affd700 1 --2- 172.21.15.82:0/3767989225 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdc04063810 0x7fdc04065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.186+0000 7fdc1affd700 1 -- 172.21.15.82:0/3767989225 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdc14080a20 con 0x5629817a2250 2023-11-28T13:02:05.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.186+0000 7fdc2183f700 1 --2- 172.21.15.82:0/3767989225 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdc04063810 0x7fdc04065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.186+0000 7fdc23d0a140 1 --2- 172.21.15.82:0/3767989225 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x56298178dad0 0x56298178dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.186+0000 7fdc23d0a140 1 -- 172.21.15.82:0/3767989225 --> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] -- osd_op(unknown.0.0:1 6.36 6:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) v8 -- 0x56298178e3e0 con 0x56298178dad0 2023-11-28T13:02:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.186+0000 7fdc2103e700 1 --2- 172.21.15.82:0/3767989225 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x56298178dad0 0x56298178dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.190+0000 7fdc2183f700 1 --2- 172.21.15.82:0/3767989225 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdc04063810 0x7fdc04065cc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00c860 tx=0x7fdc1c007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.190+0000 7fdc2103e700 1 --2- 172.21.15.82:0/3767989225 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x56298178dad0 0x56298178dea0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.190+0000 7fdc2103e700 1 -- 172.21.15.82:0/3767989225 <== osd.5 v2:172.21.15.114:6808/36804 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7fdc0c019040 con 0x56298178dad0 2023-11-28T13:02:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.190+0000 7fdc23d0a140 1 -- 172.21.15.82:0/3767989225 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x56298178dad0 msgr2=0x56298178dea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.190+0000 7fdc23d0a140 1 --2- 172.21.15.82:0/3767989225 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x56298178dad0 0x56298178dea0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.190+0000 7fdc23d0a140 1 -- 172.21.15.82:0/3767989225 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdc04063810 msgr2=0x7fdc04065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.190+0000 7fdc23d0a140 1 --2- 172.21.15.82:0/3767989225 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdc04063810 0x7fdc04065cc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00c860 tx=0x7fdc1c007040 comp rx=0 tx=0).stop 2023-11-28T13:02:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.190+0000 7fdc23d0a140 1 -- 172.21.15.82:0/3767989225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629817a2250 msgr2=0x5629816cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.190+0000 7fdc23d0a140 1 --2- 172.21.15.82:0/3767989225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629817a2250 0x5629816cf6c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400ef60 tx=0x7fdc1400ef90 comp rx=0 tx=0).stop 2023-11-28T13:02:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.190+0000 7fdc22040700 1 -- 172.21.15.82:0/3767989225 reap_dead start 2023-11-28T13:02:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.190+0000 7fdc23d0a140 1 -- 172.21.15.82:0/3767989225 shutdown_connections 2023-11-28T13:02:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.190+0000 7fdc23d0a140 1 -- 172.21.15.82:0/3767989225 >> 172.21.15.82:0/3767989225 conn(0x5629816fbd50 msgr2=0x5629817a1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.190+0000 7fdc23d0a140 1 -- 172.21.15.82:0/3767989225 shutdown_connections 2023-11-28T13:02:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.190+0000 7fdc23d0a140 1 -- 172.21.15.82:0/3767989225 wait complete. 2023-11-28T13:02:05.195 INFO:teuthology.orchestra.run.smithi082.stdout:mytag 2023-11-28T13:02:05.196 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2023-11-28T13:02:05.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.234+0000 7f5e4a28e140 1 Processor -- start 2023-11-28T13:02:05.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.234+0000 7f5e4a28e140 1 -- start start 2023-11-28T13:02:05.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.234+0000 7f5e4a28e140 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b0c71c4f50 0x55b0c72085a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.234+0000 7f5e4a28e140 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0c72091c0 0x55b0c7208ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.234+0000 7f5e4a28e140 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55b0c7296250 0x55b0c7202330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.234+0000 7f5e4a28e140 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c7155180 con 0x55b0c72091c0 2023-11-28T13:02:05.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.234+0000 7f5e4a28e140 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c70e8240 con 0x55b0c71c4f50 2023-11-28T13:02:05.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.234+0000 7f5e4a28e140 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0c7292f70 con 0x55b0c7296250 2023-11-28T13:02:05.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.234+0000 7f5e475c2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0c72091c0 0x55b0c7208ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.234+0000 7f5e475c2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0c72091c0 0x55b0c7208ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53234/0 (socket says 172.21.15.82:53234) 2023-11-28T13:02:05.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.234+0000 7f5e475c2700 1 -- 172.21.15.82:0/2144363080 learned_addr learned my addr 172.21.15.82:0/2144363080 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:05.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.234+0000 7f5e485c4700 1 --2- 172.21.15.82:0/2144363080 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55b0c7296250 0x55b0c7202330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.234+0000 7f5e47dc3700 1 --2- 172.21.15.82:0/2144363080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b0c71c4f50 0x55b0c72085a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.234+0000 7f5e475c2700 1 -- 172.21.15.82:0/2144363080 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55b0c7296250 msgr2=0x55b0c7202330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:05.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.234+0000 7f5e475c2700 1 --2- 172.21.15.82:0/2144363080 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55b0c7296250 0x55b0c7202330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.234+0000 7f5e475c2700 1 -- 172.21.15.82:0/2144363080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b0c71c4f50 msgr2=0x55b0c72085a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:05.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.234+0000 7f5e475c2700 1 --2- 172.21.15.82:0/2144363080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b0c71c4f50 0x55b0c72085a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.234+0000 7f5e475c2700 1 -- 172.21.15.82:0/2144363080 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e40005d20 con 0x55b0c72091c0 2023-11-28T13:02:05.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.234+0000 7f5e47dc3700 1 --2- 172.21.15.82:0/2144363080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b0c71c4f50 0x55b0c72085a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:02:05.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.238+0000 7f5e475c2700 1 --2- 172.21.15.82:0/2144363080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0c72091c0 0x55b0c7208ae0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5e300016e0 tx=0x7f5e300019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd90849e3faf7c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.238+0000 7f5e465c0700 1 -- 172.21.15.82:0/2144363080 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e30002690 con 0x55b0c72091c0 2023-11-28T13:02:05.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.238+0000 7f5e465c0700 1 -- 172.21.15.82:0/2144363080 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e30002810 con 0x55b0c72091c0 2023-11-28T13:02:05.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.238+0000 7f5e465c0700 1 -- 172.21.15.82:0/2144363080 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e30002bc0 con 0x55b0c72091c0 2023-11-28T13:02:05.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.238+0000 7f5e4a28e140 1 -- 172.21.15.82:0/2144363080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0c72091c0 msgr2=0x55b0c7208ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.238+0000 7f5e4a28e140 1 --2- 172.21.15.82:0/2144363080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0c72091c0 0x55b0c7208ae0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5e300016e0 tx=0x7f5e300019f0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.238+0000 7f5e4a28e140 1 -- 172.21.15.82:0/2144363080 shutdown_connections 2023-11-28T13:02:05.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.238+0000 7f5e4a28e140 1 --2- 172.21.15.82:0/2144363080 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55b0c7296250 0x55b0c7202330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.238+0000 7f5e4a28e140 1 --2- 172.21.15.82:0/2144363080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0c72091c0 0x55b0c7208ae0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.238+0000 7f5e4a28e140 1 --2- 172.21.15.82:0/2144363080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b0c71c4f50 0x55b0c72085a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.238+0000 7f5e4a28e140 1 -- 172.21.15.82:0/2144363080 >> 172.21.15.82:0/2144363080 conn(0x55b0c71efd50 msgr2=0x55b0c71ee890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:05.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.238+0000 7f5e4a28e140 1 -- 172.21.15.82:0/2144363080 shutdown_connections 2023-11-28T13:02:05.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.238+0000 7f5e4a28e140 1 -- 172.21.15.82:0/2144363080 wait complete. 2023-11-28T13:02:05.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.238+0000 7f5e4a28e140 1 Processor -- start 2023-11-28T13:02:05.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.238+0000 7f5e4a28e140 1 -- start start 2023-11-28T13:02:05.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e4a28e140 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0c71c4f50 0x55b0c72069b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e4a28e140 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55b0c72091c0 0x55b0c7291d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e4a28e140 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b0c7296250 0x55b0c71ee6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e4a28e140 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c72070c0 con 0x55b0c71c4f50 2023-11-28T13:02:05.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e4a28e140 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c7207360 con 0x55b0c7296250 2023-11-28T13:02:05.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e4a28e140 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0c7207600 con 0x55b0c72091c0 2023-11-28T13:02:05.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e47dc3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0c71c4f50 0x55b0c72069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e47dc3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0c71c4f50 0x55b0c72069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53244/0 (socket says 172.21.15.82:53244) 2023-11-28T13:02:05.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e47dc3700 1 -- 172.21.15.82:0/833351004 learned_addr learned my addr 172.21.15.82:0/833351004 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:05.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e475c2700 1 --2- 172.21.15.82:0/833351004 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55b0c72091c0 0x55b0c7291d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e485c4700 1 --2- 172.21.15.82:0/833351004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b0c7296250 0x55b0c71ee6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e47dc3700 1 -- 172.21.15.82:0/833351004 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55b0c72091c0 msgr2=0x55b0c7291d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e47dc3700 1 --2- 172.21.15.82:0/833351004 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55b0c72091c0 0x55b0c7291d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e47dc3700 1 -- 172.21.15.82:0/833351004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b0c7296250 msgr2=0x55b0c71ee6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e47dc3700 1 --2- 172.21.15.82:0/833351004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b0c7296250 0x55b0c71ee6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e47dc3700 1 -- 172.21.15.82:0/833351004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0c7100390 con 0x55b0c71c4f50 2023-11-28T13:02:05.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e485c4700 1 --2- 172.21.15.82:0/833351004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b0c7296250 0x55b0c71ee6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:05.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e47dc3700 1 --2- 172.21.15.82:0/833351004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0c71c4f50 0x55b0c72069b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x55b0c71f1710 tx=0x7f5e40002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e455be700 1 -- 172.21.15.82:0/833351004 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4001a040 con 0x55b0c71c4f50 2023-11-28T13:02:05.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e455be700 1 -- 172.21.15.82:0/833351004 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e40020640 con 0x55b0c71c4f50 2023-11-28T13:02:05.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e4a28e140 1 -- 172.21.15.82:0/833351004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e30006cb0 con 0x55b0c71c4f50 2023-11-28T13:02:05.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e455be700 1 -- 172.21.15.82:0/833351004 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e400209b0 con 0x55b0c71c4f50 2023-11-28T13:02:05.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.242+0000 7f5e4a28e140 1 -- 172.21.15.82:0/833351004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0c70f38b0 con 0x55b0c71c4f50 2023-11-28T13:02:05.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.246+0000 7f5e455be700 1 -- 172.21.15.82:0/833351004 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5e40026020 con 0x55b0c71c4f50 2023-11-28T13:02:05.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.246+0000 7f5e455be700 1 --2- 172.21.15.82:0/833351004 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5e2c063840 0x7f5e2c065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.246+0000 7f5e475c2700 1 --2- 172.21.15.82:0/833351004 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5e2c063840 0x7f5e2c065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.246+0000 7f5e455be700 1 -- 172.21.15.82:0/833351004 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5e40082e50 con 0x55b0c71c4f50 2023-11-28T13:02:05.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.246+0000 7f5e4a28e140 1 --2- 172.21.15.82:0/833351004 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x55b0c71eec20 0x55b0c728f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.246+0000 7f5e4a28e140 1 -- 172.21.15.82:0/833351004 --> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] -- osd_op(unknown.0.0:1 6.19 6:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) v8 -- 0x55b0c72084d0 con 0x55b0c71eec20 2023-11-28T13:02:05.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.246+0000 7f5e475c2700 1 --2- 172.21.15.82:0/833351004 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5e2c063840 0x7f5e2c065cf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5e30015040 tx=0x7f5e30003000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.246+0000 7f5e485c4700 1 --2- 172.21.15.82:0/833351004 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x55b0c71eec20 0x55b0c728f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.250+0000 7f5e485c4700 1 --2- 172.21.15.82:0/833351004 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x55b0c71eec20 0x55b0c728f270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.250+0000 7f5e485c4700 1 -- 172.21.15.82:0/833351004 <== osd.5 v2:172.21.15.114:6808/36804 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f5e3800e720 con 0x55b0c71eec20 2023-11-28T13:02:05.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.250+0000 7f5e4a28e140 1 -- 172.21.15.82:0/833351004 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x55b0c71eec20 msgr2=0x55b0c728f270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.250+0000 7f5e4a28e140 1 --2- 172.21.15.82:0/833351004 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x55b0c71eec20 0x55b0c728f270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.250+0000 7f5e4a28e140 1 -- 172.21.15.82:0/833351004 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5e2c063840 msgr2=0x7f5e2c065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.250+0000 7f5e4a28e140 1 --2- 172.21.15.82:0/833351004 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5e2c063840 0x7f5e2c065cf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5e30015040 tx=0x7f5e30003000 comp rx=0 tx=0).stop 2023-11-28T13:02:05.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.250+0000 7f5e4a28e140 1 -- 172.21.15.82:0/833351004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0c71c4f50 msgr2=0x55b0c72069b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.250+0000 7f5e4a28e140 1 --2- 172.21.15.82:0/833351004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0c71c4f50 0x55b0c72069b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x55b0c71f1710 tx=0x7f5e40002fb0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.250+0000 7f5e485c4700 1 -- 172.21.15.82:0/833351004 reap_dead start 2023-11-28T13:02:05.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.250+0000 7f5e4a28e140 1 -- 172.21.15.82:0/833351004 shutdown_connections 2023-11-28T13:02:05.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.250+0000 7f5e4a28e140 1 -- 172.21.15.82:0/833351004 >> 172.21.15.82:0/833351004 conn(0x55b0c71efd50 msgr2=0x55b0c71c2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:05.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.250+0000 7f5e4a28e140 1 -- 172.21.15.82:0/833351004 shutdown_connections 2023-11-28T13:02:05.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.250+0000 7f5e4a28e140 1 -- 172.21.15.82:0/833351004 wait complete. 2023-11-28T13:02:05.262 INFO:teuthology.orchestra.run.smithi082.stdout:mytag 2023-11-28T13:02:05.262 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2023-11-28T13:02:05.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.302+0000 7f9d0aaa9140 1 Processor -- start 2023-11-28T13:02:05.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.302+0000 7f9d0aaa9140 1 -- start start 2023-11-28T13:02:05.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.306+0000 7f9d0aaa9140 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55eae2173d80 0x55eae2247a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.306+0000 7f9d0aaa9140 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eae2245250 0x55eae2242c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.306+0000 7f9d0aaa9140 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55eae2245620 0x55eae22cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.306+0000 7f9d0aaa9140 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eae2104180 con 0x55eae2245250 2023-11-28T13:02:05.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.306+0000 7f9d0aaa9140 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eae2097240 con 0x55eae2173d80 2023-11-28T13:02:05.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.306+0000 7f9d0aaa9140 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eae2247080 con 0x55eae2245620 2023-11-28T13:02:05.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.306+0000 7f9d07ddd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eae2245250 0x55eae2242c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.306+0000 7f9d07ddd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eae2245250 0x55eae2242c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53250/0 (socket says 172.21.15.82:53250) 2023-11-28T13:02:05.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.306+0000 7f9d07ddd700 1 -- 172.21.15.82:0/2043910693 learned_addr learned my addr 172.21.15.82:0/2043910693 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:05.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.306+0000 7f9d085de700 1 --2- 172.21.15.82:0/2043910693 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55eae2173d80 0x55eae2247a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.306+0000 7f9d08ddf700 1 --2- 172.21.15.82:0/2043910693 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55eae2245620 0x55eae22cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.306+0000 7f9d07ddd700 1 -- 172.21.15.82:0/2043910693 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55eae2245620 msgr2=0x55eae22cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:05.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.306+0000 7f9d07ddd700 1 --2- 172.21.15.82:0/2043910693 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55eae2245620 0x55eae22cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.306+0000 7f9d07ddd700 1 -- 172.21.15.82:0/2043910693 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55eae2173d80 msgr2=0x55eae2247a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:05.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.306+0000 7f9d07ddd700 1 --2- 172.21.15.82:0/2043910693 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55eae2173d80 0x55eae2247a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.306+0000 7f9d07ddd700 1 -- 172.21.15.82:0/2043910693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0000a100 con 0x55eae2245250 2023-11-28T13:02:05.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.306+0000 7f9d07ddd700 1 --2- 172.21.15.82:0/2043910693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eae2245250 0x55eae2242c80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9d00013040 tx=0x7f9d00007030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceddda20d2c35539 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.306+0000 7f9d06ddb700 1 -- 172.21.15.82:0/2043910693 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0000f790 con 0x55eae2245250 2023-11-28T13:02:05.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.306+0000 7f9d06ddb700 1 -- 172.21.15.82:0/2043910693 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0000fa60 con 0x55eae2245250 2023-11-28T13:02:05.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.306+0000 7f9d06ddb700 1 -- 172.21.15.82:0/2043910693 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0000fe10 con 0x55eae2245250 2023-11-28T13:02:05.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d0aaa9140 1 -- 172.21.15.82:0/2043910693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eae2245250 msgr2=0x55eae2242c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d0aaa9140 1 --2- 172.21.15.82:0/2043910693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eae2245250 0x55eae2242c80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9d00013040 tx=0x7f9d00007030 comp rx=0 tx=0).stop 2023-11-28T13:02:05.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d0aaa9140 1 -- 172.21.15.82:0/2043910693 shutdown_connections 2023-11-28T13:02:05.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d0aaa9140 1 --2- 172.21.15.82:0/2043910693 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55eae2245620 0x55eae22cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d0aaa9140 1 --2- 172.21.15.82:0/2043910693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eae2245250 0x55eae2242c80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d0aaa9140 1 --2- 172.21.15.82:0/2043910693 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55eae2173d80 0x55eae2247a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d0aaa9140 1 -- 172.21.15.82:0/2043910693 >> 172.21.15.82:0/2043910693 conn(0x55eae219ed50 msgr2=0x55eae2172120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:05.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d0aaa9140 1 -- 172.21.15.82:0/2043910693 shutdown_connections 2023-11-28T13:02:05.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d0aaa9140 1 -- 172.21.15.82:0/2043910693 wait complete. 2023-11-28T13:02:05.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d0aaa9140 1 Processor -- start 2023-11-28T13:02:05.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d0aaa9140 1 -- start start 2023-11-28T13:02:05.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d0aaa9140 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55eae2173d80 0x55eae2235b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d0aaa9140 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eae2245620 0x55eae219be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d0aaa9140 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55eae219c390 0x55eae2172120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d0aaa9140 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eae2236040 con 0x55eae2245620 2023-11-28T13:02:05.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d0aaa9140 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eae219c8b0 con 0x55eae2173d80 2023-11-28T13:02:05.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d0aaa9140 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eae219cb50 con 0x55eae219c390 2023-11-28T13:02:05.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d07ddd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eae2245620 0x55eae219be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d07ddd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eae2245620 0x55eae219be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53266/0 (socket says 172.21.15.82:53266) 2023-11-28T13:02:05.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d07ddd700 1 -- 172.21.15.82:0/3125281668 learned_addr learned my addr 172.21.15.82:0/3125281668 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:05.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d08ddf700 1 --2- 172.21.15.82:0/3125281668 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55eae219c390 0x55eae2172120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d085de700 1 --2- 172.21.15.82:0/3125281668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55eae2173d80 0x55eae2235b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d07ddd700 1 -- 172.21.15.82:0/3125281668 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55eae219c390 msgr2=0x55eae2172120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d07ddd700 1 --2- 172.21.15.82:0/3125281668 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55eae219c390 0x55eae2172120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d07ddd700 1 -- 172.21.15.82:0/3125281668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55eae2173d80 msgr2=0x55eae2235b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d07ddd700 1 --2- 172.21.15.82:0/3125281668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55eae2173d80 0x55eae2235b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.310+0000 7f9d07ddd700 1 -- 172.21.15.82:0/3125281668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eae20af390 con 0x55eae2245620 2023-11-28T13:02:05.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.314+0000 7f9d07ddd700 1 --2- 172.21.15.82:0/3125281668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eae2245620 0x55eae219be50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000a4a0 tx=0x7f9d000033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.314+0000 7f9d05dd9700 1 -- 172.21.15.82:0/3125281668 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d00023860 con 0x55eae2245620 2023-11-28T13:02:05.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.314+0000 7f9d05dd9700 1 -- 172.21.15.82:0/3125281668 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d00009030 con 0x55eae2245620 2023-11-28T13:02:05.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.314+0000 7f9d0aaa9140 1 -- 172.21.15.82:0/3125281668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55eae20a28b0 con 0x55eae2245620 2023-11-28T13:02:05.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.314+0000 7f9d05dd9700 1 -- 172.21.15.82:0/3125281668 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d00023bc0 con 0x55eae2245620 2023-11-28T13:02:05.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.314+0000 7f9d0aaa9140 1 -- 172.21.15.82:0/3125281668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eae20af5d0 con 0x55eae2245620 2023-11-28T13:02:05.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.314+0000 7f9d05dd9700 1 -- 172.21.15.82:0/3125281668 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9d00029070 con 0x55eae2245620 2023-11-28T13:02:05.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.314+0000 7f9d05dd9700 1 --2- 172.21.15.82:0/3125281668 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ce8063840 0x7f9ce8065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.314+0000 7f9d085de700 1 --2- 172.21.15.82:0/3125281668 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ce8063840 0x7f9ce8065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.318+0000 7f9d05dd9700 1 -- 172.21.15.82:0/3125281668 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9d00082870 con 0x55eae2245620 2023-11-28T13:02:05.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.318+0000 7f9d0aaa9140 1 --2- 172.21.15.82:0/3125281668 >> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] conn(0x55eae21b7920 0x55eae21b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.318+0000 7f9d0aaa9140 1 -- 172.21.15.82:0/3125281668 --> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] -- osd_op(unknown.0.0:1 6.12 6:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) v8 -- 0x55eae21b8230 con 0x55eae21b7920 2023-11-28T13:02:05.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.318+0000 7f9d085de700 1 --2- 172.21.15.82:0/3125281668 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ce8063840 0x7f9ce8065cf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0000c00 tx=0x7f9cf0001810 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.318+0000 7f9d08ddf700 1 --2- 172.21.15.82:0/3125281668 >> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] conn(0x55eae21b7920 0x55eae21b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.318+0000 7f9d08ddf700 1 --2- 172.21.15.82:0/3125281668 >> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] conn(0x55eae21b7920 0x55eae21b7cf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.318+0000 7f9d08ddf700 1 -- 172.21.15.82:0/3125281668 <== osd.7 v2:172.21.15.114:6816/36806 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9cf800f760 con 0x55eae21b7920 2023-11-28T13:02:05.321 INFO:teuthology.orchestra.run.smithi082.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2023-11-28T13:02:05.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.318+0000 7f9d0aaa9140 1 -- 172.21.15.82:0/3125281668 >> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] conn(0x55eae21b7920 msgr2=0x55eae21b7cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.318+0000 7f9d0aaa9140 1 --2- 172.21.15.82:0/3125281668 >> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] conn(0x55eae21b7920 0x55eae21b7cf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.318+0000 7f9d0aaa9140 1 -- 172.21.15.82:0/3125281668 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ce8063840 msgr2=0x7f9ce8065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.318+0000 7f9d0aaa9140 1 --2- 172.21.15.82:0/3125281668 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ce8063840 0x7f9ce8065cf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0000c00 tx=0x7f9cf0001810 comp rx=0 tx=0).stop 2023-11-28T13:02:05.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.318+0000 7f9d0aaa9140 1 -- 172.21.15.82:0/3125281668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eae2245620 msgr2=0x55eae219be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.318+0000 7f9d0aaa9140 1 --2- 172.21.15.82:0/3125281668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eae2245620 0x55eae219be50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000a4a0 tx=0x7f9d000033a0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.318+0000 7f9d08ddf700 1 -- 172.21.15.82:0/3125281668 reap_dead start 2023-11-28T13:02:05.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.318+0000 7f9d0aaa9140 1 -- 172.21.15.82:0/3125281668 shutdown_connections 2023-11-28T13:02:05.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.318+0000 7f9d0aaa9140 1 -- 172.21.15.82:0/3125281668 >> 172.21.15.82:0/3125281668 conn(0x55eae219ed50 msgr2=0x55eae219d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:05.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.318+0000 7f9d0aaa9140 1 -- 172.21.15.82:0/3125281668 shutdown_connections 2023-11-28T13:02:05.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.318+0000 7f9d0aaa9140 1 -- 172.21.15.82:0/3125281668 wait complete. 2023-11-28T13:02:05.324 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T13:02:05.325 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T13:02:05.325 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T13:02:05.385 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T13:02:05.406 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T13:02:05.407 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:02:05.407 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:02:05.414 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346276k,nr_inodes=4086569,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=221 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275484k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T13:02:05.414 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-11-28T13:02:05.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:02:05.415 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T13:02:05.422 INFO:teuthology.orchestra.run.smithi082.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-28T13:02:05.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T13:02:05.423 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:02:05.423 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:02:05.432 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19664 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T13:02:05.432 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-28T13:02:05.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:02:05.432 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T13:02:05.479 INFO:teuthology.orchestra.run.smithi114.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-28T13:02:05.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T13:02:05.481 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:02:05.481 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:02:05.490 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346276k,nr_inodes=4086569,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=221 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275484k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T13:02:05.491 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-11-28T13:02:05.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:02:05.491 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T13:02:05.498 INFO:teuthology.orchestra.run.smithi082.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-28T13:02:05.499 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T13:02:05.499 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:02:05.500 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:02:05.507 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19664 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T13:02:05.507 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-28T13:02:05.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:02:05.507 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T13:02:05.555 INFO:teuthology.orchestra.run.smithi114.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-28T13:02:05.556 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T13:02:05.557 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:02:05.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.674+0000 7f7162b5e700 1 Processor -- start 2023-11-28T13:02:05.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.674+0000 7f7162b5e700 1 -- start start 2023-11-28T13:02:05.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.674+0000 7f7162b5e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f715c0ae940 0x7f715c06bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.674+0000 7f7162b5e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f715c15d5b0 con 0x7f715c06dae0 2023-11-28T13:02:05.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.674+0000 7f7162b5e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f715c15da40 con 0x7f715c158ed0 2023-11-28T13:02:05.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.674+0000 7f7162b5e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715c0aee90 con 0x7f715c0ae940 2023-11-28T13:02:05.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.674+0000 7f716135b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f715c06dae0 0x7f715c06b560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44630/0 (socket says 172.21.15.82:44630) 2023-11-28T13:02:05.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.674+0000 7f716135b700 1 -- 172.21.15.82:0/1582288921 learned_addr learned my addr 172.21.15.82:0/1582288921 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:05.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.678+0000 7f716235d700 1 --2- 172.21.15.82:0/1582288921 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f715c0ae940 0x7f715c06bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.678+0000 7f7160b5a700 1 -- 172.21.15.82:0/1582288921 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750565507 0 0) 0x7f715c15d5b0 con 0x7f715c06dae0 2023-11-28T13:02:05.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.678+0000 7f7160b5a700 1 -- 172.21.15.82:0/1582288921 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71480035d0 con 0x7f715c06dae0 2023-11-28T13:02:05.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.678+0000 7f7160b5a700 1 -- 172.21.15.82:0/1582288921 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226507625 0 0) 0x7f715c15da40 con 0x7f715c158ed0 2023-11-28T13:02:05.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.678+0000 7f7160b5a700 1 -- 172.21.15.82:0/1582288921 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f715c15d5b0 con 0x7f715c158ed0 2023-11-28T13:02:05.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.678+0000 7f716235d700 1 -- 172.21.15.82:0/1582288921 >> v1:172.21.15.114:6789/0 conn(0x7f715c158ed0 legacy=0x7f715c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.678+0000 7f716235d700 1 -- 172.21.15.82:0/1582288921 >> v1:172.21.15.82:6789/0 conn(0x7f715c06dae0 legacy=0x7f715c06b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.678+0000 7f7160b5a700 1 -- 172.21.15.82:0/1582288921 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1853152941 0 0) 0x7f71480035d0 con 0x7f715c06dae0 2023-11-28T13:02:05.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.678+0000 7f716235d700 1 -- 172.21.15.82:0/1582288921 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715c15cc80 con 0x7f715c0ae940 2023-11-28T13:02:05.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.678+0000 7f716235d700 1 --2- 172.21.15.82:0/1582288921 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f715c0ae940 0x7f715c06bc70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7154009dc0 tx=0x7f715400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6cbe639adc40a0e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.678+0000 7f7160b5a700 1 -- 172.21.15.82:0/1582288921 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715400e070 con 0x7f715c0ae940 2023-11-28T13:02:05.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.678+0000 7f7160b5a700 1 -- 172.21.15.82:0/1582288921 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7154003a40 con 0x7f715c0ae940 2023-11-28T13:02:05.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.678+0000 7f7160b5a700 1 -- 172.21.15.82:0/1582288921 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c001670 con 0x7f715c0ae940 2023-11-28T13:02:05.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.678+0000 7f7162b5e700 1 -- 172.21.15.82:0/1582288921 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f715c0ae940 msgr2=0x7f715c06bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.678+0000 7f7162b5e700 1 --2- 172.21.15.82:0/1582288921 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f715c0ae940 0x7f715c06bc70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7154009dc0 tx=0x7f715400b330 comp rx=0 tx=0).stop 2023-11-28T13:02:05.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.678+0000 7f7162b5e700 1 -- 172.21.15.82:0/1582288921 shutdown_connections 2023-11-28T13:02:05.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.678+0000 7f7162b5e700 1 --2- 172.21.15.82:0/1582288921 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f715c0ae940 0x7f715c06bc70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.678+0000 7f7162b5e700 1 -- 172.21.15.82:0/1582288921 >> 172.21.15.82:0/1582288921 conn(0x7f715c0cf710 msgr2=0x7f715c0cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:05.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.678+0000 7f7162b5e700 1 -- 172.21.15.82:0/1582288921 shutdown_connections 2023-11-28T13:02:05.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.678+0000 7f7162b5e700 1 -- 172.21.15.82:0/1582288921 wait complete. 2023-11-28T13:02:05.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f7162b5e700 1 Processor -- start 2023-11-28T13:02:05.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f7162b5e700 1 -- start start 2023-11-28T13:02:05.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f7162b5e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f715c06dae0 0x7f715c0c50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f7162b5e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f715c0ae940 0x7f715c0c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f7162b5e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f715c158ed0 0x7f715c0ab990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f7162b5e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c0ad340 con 0x7f715c0ae940 2023-11-28T13:02:05.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f7162b5e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c0b4550 con 0x7f715c06dae0 2023-11-28T13:02:05.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f7162b5e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715c0ac6c0 con 0x7f715c158ed0 2023-11-28T13:02:05.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f716135b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f715c0ae940 0x7f715c0c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f716135b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f715c0ae940 0x7f715c0c55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53272/0 (socket says 172.21.15.82:53272) 2023-11-28T13:02:05.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f716135b700 1 -- 172.21.15.82:0/2437323701 learned_addr learned my addr 172.21.15.82:0/2437323701 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:05.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f7161b5c700 1 --2- 172.21.15.82:0/2437323701 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f715c06dae0 0x7f715c0c50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f716235d700 1 --2- 172.21.15.82:0/2437323701 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f715c158ed0 0x7f715c0ab990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f716135b700 1 -- 172.21.15.82:0/2437323701 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f715c158ed0 msgr2=0x7f715c0ab990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f716135b700 1 --2- 172.21.15.82:0/2437323701 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f715c158ed0 0x7f715c0ab990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f716135b700 1 -- 172.21.15.82:0/2437323701 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f715c06dae0 msgr2=0x7f715c0c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f716135b700 1 --2- 172.21.15.82:0/2437323701 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f715c06dae0 0x7f715c0c50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f716135b700 1 -- 172.21.15.82:0/2437323701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7154009a70 con 0x7f715c0ae940 2023-11-28T13:02:05.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f716135b700 1 --2- 172.21.15.82:0/2437323701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f715c0ae940 0x7f715c0c55f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f714c00c750 tx=0x7f714c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f71527fc700 1 -- 172.21.15.82:0/2437323701 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c004ca0 con 0x7f715c0ae940 2023-11-28T13:02:05.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f71527fc700 1 -- 172.21.15.82:0/2437323701 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c004e00 con 0x7f715c0ae940 2023-11-28T13:02:05.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f7162b5e700 1 -- 172.21.15.82:0/2437323701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f715c15d240 con 0x7f715c0ae940 2023-11-28T13:02:05.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f71527fc700 1 -- 172.21.15.82:0/2437323701 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c0072f0 con 0x7f715c0ae940 2023-11-28T13:02:05.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.682+0000 7f7162b5e700 1 -- 172.21.15.82:0/2437323701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715c15cf60 con 0x7f715c0ae940 2023-11-28T13:02:05.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.686+0000 7f7162b5e700 1 -- 172.21.15.82:0/2437323701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f715c1592a0 con 0x7f715c0ae940 2023-11-28T13:02:05.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.686+0000 7f71527fc700 1 -- 172.21.15.82:0/2437323701 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f714c010070 con 0x7f715c0ae940 2023-11-28T13:02:05.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.686+0000 7f71527fc700 1 --2- 172.21.15.82:0/2437323701 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7140064ee0 0x7f7140067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:05.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.686+0000 7f71527fc700 1 -- 172.21.15.82:0/2437323701 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f714c081040 con 0x7f715c0ae940 2023-11-28T13:02:05.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.686+0000 7f7161b5c700 1 --2- 172.21.15.82:0/2437323701 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7140064ee0 0x7f7140067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:05.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.686+0000 7f7161b5c700 1 --2- 172.21.15.82:0/2437323701 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7140064ee0 0x7f7140067390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f71580011e0 tx=0x7f7158009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:05.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.694+0000 7f71527fc700 1 -- 172.21.15.82:0/2437323701 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f714c04f160 con 0x7f715c0ae940 2023-11-28T13:02:05.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.894+0000 7f7162b5e700 1 -- 172.21.15.82:0/2437323701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f715c065fc0 con 0x7f715c0ae940 2023-11-28T13:02:05.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.894+0000 7f71527fc700 1 -- 172.21.15.82:0/2437323701 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f714c018090 con 0x7f715c0ae940 2023-11-28T13:02:05.896 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:05.896 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2975361458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2975361458},{"type":"v1","addr":"172.21.15.114:6833","nonce":2975361458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3412196002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3412196002},{"type":"v1","addr":"172.21.15.114:6835","nonce":3412196002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/167093290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":167093290},{"type":"v1","addr":"172.21.15.82:6835","nonce":167093290}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:01:29.585949+0000","modified":"2023-11-28T13:01:32.836050+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/3448846386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3448846386},{"type":"v1","addr":"172.21.15.82:6837","nonce":3448846386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T13:02:05.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.894+0000 7f7162b5e700 1 -- 172.21.15.82:0/2437323701 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7140064ee0 msgr2=0x7f7140067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.894+0000 7f7162b5e700 1 --2- 172.21.15.82:0/2437323701 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7140064ee0 0x7f7140067390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f71580011e0 tx=0x7f7158009040 comp rx=0 tx=0).stop 2023-11-28T13:02:05.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.894+0000 7f7162b5e700 1 -- 172.21.15.82:0/2437323701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f715c0ae940 msgr2=0x7f715c0c55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.894+0000 7f7162b5e700 1 --2- 172.21.15.82:0/2437323701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f715c0ae940 0x7f715c0c55f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f714c00c750 tx=0x7f714c00cb10 comp rx=0 tx=0).stop 2023-11-28T13:02:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.894+0000 7f7162b5e700 1 -- 172.21.15.82:0/2437323701 shutdown_connections 2023-11-28T13:02:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.894+0000 7f7162b5e700 1 --2- 172.21.15.82:0/2437323701 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7140064ee0 0x7f7140067390 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.894+0000 7f7162b5e700 1 --2- 172.21.15.82:0/2437323701 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f715c158ed0 0x7f715c0ab990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.894+0000 7f7162b5e700 1 --2- 172.21.15.82:0/2437323701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f715c0ae940 0x7f715c0c55f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.894+0000 7f7162b5e700 1 --2- 172.21.15.82:0/2437323701 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f715c06dae0 0x7f715c0c50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.894+0000 7f7162b5e700 1 -- 172.21.15.82:0/2437323701 >> 172.21.15.82:0/2437323701 conn(0x7f715c0cf710 msgr2=0x7f715c0cb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.894+0000 7f7162b5e700 1 -- 172.21.15.82:0/2437323701 shutdown_connections 2023-11-28T13:02:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:05.898+0000 7f7162b5e700 1 -- 172.21.15.82:0/2437323701 wait complete. 2023-11-28T13:02:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2023-11-28T13:02:05.911 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:02:06.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.022+0000 7f0152280700 1 Processor -- start 2023-11-28T13:02:06.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.022+0000 7f0152280700 1 -- start start 2023-11-28T13:02:06.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.022+0000 7f0152280700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f014c06b0a0 0x7f014c06d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.022+0000 7f0152280700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c06c480 con 0x7f014c0b3910 2023-11-28T13:02:06.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.022+0000 7f0152280700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c06dbe0 con 0x7f014c070070 2023-11-28T13:02:06.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.022+0000 7f0152280700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c06dec0 con 0x7f014c06b0a0 2023-11-28T13:02:06.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.022+0000 7f015127e700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f014c0b3910 0x7f014c06c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44632/0 (socket says 172.21.15.82:44632) 2023-11-28T13:02:06.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.022+0000 7f015127e700 1 -- 172.21.15.82:0/2239578538 learned_addr learned my addr 172.21.15.82:0/2239578538 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:06.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.022+0000 7f0150a7d700 1 --2- 172.21.15.82:0/2239578538 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f014c06b0a0 0x7f014c06d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.022+0000 7f0143fff700 1 -- 172.21.15.82:0/2239578538 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504014806 0 0) 0x7f014c06c480 con 0x7f014c0b3910 2023-11-28T13:02:06.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.022+0000 7f0143fff700 1 -- 172.21.15.82:0/2239578538 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01380035d0 con 0x7f014c0b3910 2023-11-28T13:02:06.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.022+0000 7f0143fff700 1 -- 172.21.15.82:0/2239578538 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829285956 0 0) 0x7f014c06dbe0 con 0x7f014c070070 2023-11-28T13:02:06.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.022+0000 7f0143fff700 1 -- 172.21.15.82:0/2239578538 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f014c06c480 con 0x7f014c070070 2023-11-28T13:02:06.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.022+0000 7f0143fff700 1 -- 172.21.15.82:0/2239578538 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2330065360 0 0) 0x7f01380035d0 con 0x7f014c0b3910 2023-11-28T13:02:06.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.022+0000 7f0143fff700 1 -- 172.21.15.82:0/2239578538 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f014c06b0a0 msgr2=0x7f014c06d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:06.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.022+0000 7f0143fff700 1 --2- 172.21.15.82:0/2239578538 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f014c06b0a0 0x7f014c06d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.022+0000 7f0143fff700 1 -- 172.21.15.82:0/2239578538 >> v1:172.21.15.114:6789/0 conn(0x7f014c070070 legacy=0x7f014c15db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.022+0000 7f0143fff700 1 -- 172.21.15.82:0/2239578538 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c06c110 con 0x7f014c0b3910 2023-11-28T13:02:06.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.022+0000 7f0143fff700 1 -- 172.21.15.82:0/2239578538 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f013c001670 con 0x7f014c0b3910 2023-11-28T13:02:06.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.022+0000 7f0150a7d700 1 --2- 172.21.15.82:0/2239578538 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f014c06b0a0 0x7f014c06d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:02:06.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f0143fff700 1 -- 172.21.15.82:0/2239578538 >> v1:172.21.15.82:6789/0 conn(0x7f014c0b3910 legacy=0x7f014c06c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f0143fff700 1 --2- 172.21.15.82:0/2239578538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0138003be0 0x7f0138003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f0143fff700 1 --2- 172.21.15.82:0/2239578538 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f014c06b0a0 0x7f0138004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f0143fff700 1 --2- 172.21.15.82:0/2239578538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0138004db0 0x7f0138005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f0143fff700 1 -- 172.21.15.82:0/2239578538 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c06dec0 con 0x7f0138003be0 2023-11-28T13:02:06.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f0143fff700 1 -- 172.21.15.82:0/2239578538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013800bae0 con 0x7f0138004db0 2023-11-28T13:02:06.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f0143fff700 1 -- 172.21.15.82:0/2239578538 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013800bc20 con 0x7f014c06b0a0 2023-11-28T13:02:06.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f015127e700 1 --2- 172.21.15.82:0/2239578538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0138003be0 0x7f0138003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f0150a7d700 1 --2- 172.21.15.82:0/2239578538 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f014c06b0a0 0x7f0138004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f0151a7f700 1 --2- 172.21.15.82:0/2239578538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0138004db0 0x7f0138005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f015127e700 1 -- 172.21.15.82:0/2239578538 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f014c06b0a0 msgr2=0x7f0138004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:06.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f015127e700 1 --2- 172.21.15.82:0/2239578538 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f014c06b0a0 0x7f0138004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f015127e700 1 -- 172.21.15.82:0/2239578538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0138004db0 msgr2=0x7f0138005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:06.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f015127e700 1 --2- 172.21.15.82:0/2239578538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0138004db0 0x7f0138005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f015127e700 1 -- 172.21.15.82:0/2239578538 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01480094b0 con 0x7f0138003be0 2023-11-28T13:02:06.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f0151a7f700 1 --2- 172.21.15.82:0/2239578538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0138004db0 0x7f0138005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:02:06.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f015127e700 1 --2- 172.21.15.82:0/2239578538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0138003be0 0x7f0138003fd0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f013c00c240 tx=0x7f01380058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9210f08a63fec8e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:06.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f0143fff700 1 -- 172.21.15.82:0/2239578538 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c00cde0 con 0x7f0138003be0 2023-11-28T13:02:06.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f0143fff700 1 -- 172.21.15.82:0/2239578538 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c005980 con 0x7f0138003be0 2023-11-28T13:02:06.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f0143fff700 1 -- 172.21.15.82:0/2239578538 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c005d30 con 0x7f0138003be0 2023-11-28T13:02:06.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f0152280700 1 -- 172.21.15.82:0/2239578538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0138003be0 msgr2=0x7f0138003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f0152280700 1 --2- 172.21.15.82:0/2239578538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0138003be0 0x7f0138003fd0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f013c00c240 tx=0x7f01380058a0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f0151a7f700 1 -- 172.21.15.82:0/2239578538 reap_dead start 2023-11-28T13:02:06.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f0152280700 1 -- 172.21.15.82:0/2239578538 shutdown_connections 2023-11-28T13:02:06.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f0152280700 1 -- 172.21.15.82:0/2239578538 >> 172.21.15.82:0/2239578538 conn(0x7f014c0ce600 msgr2=0x7f014c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:06.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f0152280700 1 -- 172.21.15.82:0/2239578538 shutdown_connections 2023-11-28T13:02:06.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.026+0000 7f0152280700 1 -- 172.21.15.82:0/2239578538 wait complete. 2023-11-28T13:02:06.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f0152280700 1 Processor -- start 2023-11-28T13:02:06.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f0152280700 1 -- start start 2023-11-28T13:02:06.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f0152280700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0138003be0 0x7f014c15a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f0152280700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f014c15af00 0x7f014c158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f0152280700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f014c158ea0 0x7f014c1f2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f0152280700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c159310 con 0x7f0138003be0 2023-11-28T13:02:06.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f0152280700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0ae100 con 0x7f014c158ea0 2023-11-28T13:02:06.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f0152280700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0ae3a0 con 0x7f014c15af00 2023-11-28T13:02:06.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f015127e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0138003be0 0x7f014c15a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f015127e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0138003be0 0x7f014c15a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53282/0 (socket says 172.21.15.82:53282) 2023-11-28T13:02:06.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f015127e700 1 -- 172.21.15.82:0/2594368471 learned_addr learned my addr 172.21.15.82:0/2594368471 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:06.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f0151a7f700 1 --2- 172.21.15.82:0/2594368471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f014c158ea0 0x7f014c1f2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f015127e700 1 -- 172.21.15.82:0/2594368471 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f014c15af00 msgr2=0x7f014c158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f015127e700 1 --2- 172.21.15.82:0/2594368471 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f014c15af00 0x7f014c158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f015127e700 1 -- 172.21.15.82:0/2594368471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f014c158ea0 msgr2=0x7f014c1f2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f015127e700 1 --2- 172.21.15.82:0/2594368471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f014c158ea0 0x7f014c1f2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f015127e700 1 -- 172.21.15.82:0/2594368471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c0b3ce0 con 0x7f0138003be0 2023-11-28T13:02:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f015127e700 1 --2- 172.21.15.82:0/2594368471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0138003be0 0x7f014c15a7a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f013c001d20 tx=0x7f014c070d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f0141ffb700 1 -- 172.21.15.82:0/2594368471 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c004890 con 0x7f0138003be0 2023-11-28T13:02:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f0141ffb700 1 -- 172.21.15.82:0/2594368471 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c0049f0 con 0x7f0138003be0 2023-11-28T13:02:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f0152280700 1 -- 172.21.15.82:0/2594368471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014c0c8f80 con 0x7f0138003be0 2023-11-28T13:02:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f0141ffb700 1 -- 172.21.15.82:0/2594368471 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c004d60 con 0x7f0138003be0 2023-11-28T13:02:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.030+0000 7f0152280700 1 -- 172.21.15.82:0/2594368471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014c0b3e70 con 0x7f0138003be0 2023-11-28T13:02:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.034+0000 7f0152280700 1 -- 172.21.15.82:0/2594368471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f014c065fc0 con 0x7f0138003be0 2023-11-28T13:02:06.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.034+0000 7f0141ffb700 1 -- 172.21.15.82:0/2594368471 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f013c02d070 con 0x7f0138003be0 2023-11-28T13:02:06.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.034+0000 7f0141ffb700 1 --2- 172.21.15.82:0/2594368471 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0130064f10 0x7f01300673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.034+0000 7f0141ffb700 1 -- 172.21.15.82:0/2594368471 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f013c0831b0 con 0x7f0138003be0 2023-11-28T13:02:06.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.034+0000 7f0150a7d700 1 --2- 172.21.15.82:0/2594368471 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0130064f10 0x7f01300673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.034+0000 7f0150a7d700 1 --2- 172.21.15.82:0/2594368471 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0130064f10 0x7f01300673c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f014c0c4e50 tx=0x7f0148009810 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:06.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.042+0000 7f0141ffb700 1 -- 172.21.15.82:0/2594368471 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f013c0512d0 con 0x7f0138003be0 2023-11-28T13:02:06.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.206+0000 7f0152280700 1 -- 172.21.15.82:0/2594368471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f014c0c1d40 con 0x7f0138003be0 2023-11-28T13:02:06.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.206+0000 7f0141ffb700 1 -- 172.21.15.82:0/2594368471 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+17883 (secure 0 0 0) 0x7f013c0548f0 con 0x7f0138003be0 2023-11-28T13:02:06.211 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:06.211 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":38,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:01:30.589673+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:01:27.651123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T13:01:28.580057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:02:06.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.210+0000 7f0152280700 1 -- 172.21.15.82:0/2594368471 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0130064f10 msgr2=0x7f01300673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.210+0000 7f0152280700 1 --2- 172.21.15.82:0/2594368471 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0130064f10 0x7f01300673c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f014c0c4e50 tx=0x7f0148009810 comp rx=0 tx=0).stop 2023-11-28T13:02:06.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.210+0000 7f0152280700 1 -- 172.21.15.82:0/2594368471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0138003be0 msgr2=0x7f014c15a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.210+0000 7f0152280700 1 --2- 172.21.15.82:0/2594368471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0138003be0 0x7f014c15a7a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f013c001d20 tx=0x7f014c070d30 comp rx=0 tx=0).stop 2023-11-28T13:02:06.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.210+0000 7f0152280700 1 -- 172.21.15.82:0/2594368471 shutdown_connections 2023-11-28T13:02:06.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.210+0000 7f0152280700 1 --2- 172.21.15.82:0/2594368471 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0130064f10 0x7f01300673c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.210+0000 7f0152280700 1 --2- 172.21.15.82:0/2594368471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f014c158ea0 0x7f014c1f2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.210+0000 7f0152280700 1 --2- 172.21.15.82:0/2594368471 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f014c15af00 0x7f014c158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.210+0000 7f0152280700 1 --2- 172.21.15.82:0/2594368471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0138003be0 0x7f014c15a7a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.210+0000 7f0152280700 1 -- 172.21.15.82:0/2594368471 >> 172.21.15.82:0/2594368471 conn(0x7f014c0ce600 msgr2=0x7f014c0b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:06.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.210+0000 7f0152280700 1 -- 172.21.15.82:0/2594368471 shutdown_connections 2023-11-28T13:02:06.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.210+0000 7f0152280700 1 -- 172.21.15.82:0/2594368471 wait complete. 2023-11-28T13:02:06.225 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T13:01:27.651123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T13:01:28.580057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:02:06.226 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:02:06.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.346+0000 7fae7b323700 1 Processor -- start 2023-11-28T13:02:06.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.346+0000 7fae7b323700 1 -- start start 2023-11-28T13:02:06.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.346+0000 7fae7b323700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fae740b61d0 0x7fae740cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.346+0000 7fae7b323700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fae740b29e0 0x7fae7406d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.346+0000 7fae7b323700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae740d0570 con 0x7fae740d0060 2023-11-28T13:02:06.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.346+0000 7fae7b323700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7415dbf0 con 0x7fae740b29e0 2023-11-28T13:02:06.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.346+0000 7fae7b323700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7415ded0 con 0x7fae740b61d0 2023-11-28T13:02:06.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.346+0000 7fae7ab22700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fae740b29e0 0x7fae7406d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.346+0000 7fae7ab22700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fae740b29e0 0x7fae7406d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53292/0 (socket says 172.21.15.82:53292) 2023-11-28T13:02:06.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.346+0000 7fae7ab22700 1 -- 172.21.15.82:0/3176043463 learned_addr learned my addr 172.21.15.82:0/3176043463 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:06.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.346+0000 7fae7a321700 1 --2- 172.21.15.82:0/3176043463 >> v2:172.21.15.114:3300/0 conn(0x7fae740b61d0 0x7fae740cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.346+0000 7fae7ab22700 1 -- 172.21.15.82:0/3176043463 >> v2:172.21.15.114:3300/0 conn(0x7fae740b61d0 msgr2=0x7fae740cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:06.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.346+0000 7fae7ab22700 1 --2- 172.21.15.82:0/3176043463 >> v2:172.21.15.114:3300/0 conn(0x7fae740b61d0 0x7fae740cfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.346+0000 7fae7ab22700 1 -- 172.21.15.82:0/3176043463 >> v1:172.21.15.82:6789/0 conn(0x7fae740d0060 legacy=0x7fae740b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.346+0000 7fae7ab22700 1 -- 172.21.15.82:0/3176043463 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7415e1b0 con 0x7fae740b29e0 2023-11-28T13:02:06.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.346+0000 7fae7a321700 1 --2- 172.21.15.82:0/3176043463 >> v2:172.21.15.114:3300/0 conn(0x7fae740b61d0 0x7fae740cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:02:06.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.346+0000 7fae7ab22700 1 --2- 172.21.15.82:0/3176043463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae740b29e0 0x7fae7406d770 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fae7406a7a0 tx=0x7fae6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbee672551df1f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:06.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.346+0000 7fae7931f700 1 -- 172.21.15.82:0/3176043463 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c00e070 con 0x7fae740b29e0 2023-11-28T13:02:06.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.346+0000 7fae7931f700 1 -- 172.21.15.82:0/3176043463 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c00b9c0 con 0x7fae740b29e0 2023-11-28T13:02:06.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.346+0000 7fae7931f700 1 -- 172.21.15.82:0/3176043463 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c00bd70 con 0x7fae740b29e0 2023-11-28T13:02:06.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.350+0000 7fae7b323700 1 -- 172.21.15.82:0/3176043463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae740b29e0 msgr2=0x7fae7406d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.350+0000 7fae7b323700 1 --2- 172.21.15.82:0/3176043463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae740b29e0 0x7fae7406d770 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fae7406a7a0 tx=0x7fae6c00b330 comp rx=0 tx=0).stop 2023-11-28T13:02:06.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.350+0000 7fae7b323700 1 -- 172.21.15.82:0/3176043463 shutdown_connections 2023-11-28T13:02:06.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.350+0000 7fae7b323700 1 --2- 172.21.15.82:0/3176043463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae740b29e0 0x7fae7406d770 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.350+0000 7fae7b323700 1 --2- 172.21.15.82:0/3176043463 >> v2:172.21.15.114:3300/0 conn(0x7fae740b61d0 0x7fae740cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.350+0000 7fae7b323700 1 -- 172.21.15.82:0/3176043463 >> 172.21.15.82:0/3176043463 conn(0x7fae740cd2d0 msgr2=0x7fae740cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:06.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.350+0000 7fae7b323700 1 -- 172.21.15.82:0/3176043463 shutdown_connections 2023-11-28T13:02:06.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.350+0000 7fae7b323700 1 -- 172.21.15.82:0/3176043463 wait complete. 2023-11-28T13:02:06.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.350+0000 7fae7b323700 1 Processor -- start 2023-11-28T13:02:06.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.350+0000 7fae7b323700 1 -- start start 2023-11-28T13:02:06.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae7b323700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae740b29e0 0x7fae741437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae7b323700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae740b61d0 0x7fae7415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae7b323700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae740d0060 0x7fae741f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae7b323700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae741441b0 con 0x7fae740d0060 2023-11-28T13:02:06.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae7b323700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7414a5e0 con 0x7fae740b29e0 2023-11-28T13:02:06.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae7b323700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae740c8ce0 con 0x7fae740b61d0 2023-11-28T13:02:06.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae7ab22700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae740d0060 0x7fae741f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae7ab22700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae740d0060 0x7fae741f2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53296/0 (socket says 172.21.15.82:53296) 2023-11-28T13:02:06.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae7ab22700 1 -- 172.21.15.82:0/1045579009 learned_addr learned my addr 172.21.15.82:0/1045579009 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:06.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae7a321700 1 --2- 172.21.15.82:0/1045579009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae740b29e0 0x7fae741437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae79b20700 1 --2- 172.21.15.82:0/1045579009 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae740b61d0 0x7fae7415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae7ab22700 1 -- 172.21.15.82:0/1045579009 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae740b61d0 msgr2=0x7fae7415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae7ab22700 1 --2- 172.21.15.82:0/1045579009 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae740b61d0 0x7fae7415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae7ab22700 1 -- 172.21.15.82:0/1045579009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae740b29e0 msgr2=0x7fae741437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae7ab22700 1 --2- 172.21.15.82:0/1045579009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae740b29e0 0x7fae741437d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae7ab22700 1 -- 172.21.15.82:0/1045579009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c009b30 con 0x7fae740d0060 2023-11-28T13:02:06.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae7a321700 1 --2- 172.21.15.82:0/1045579009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae740b29e0 0x7fae741437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:06.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae7ab22700 1 --2- 172.21.15.82:0/1045579009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae740d0060 0x7fae741f2d30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fae6c00b730 tx=0x7fae6c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:06.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae6affd700 1 -- 172.21.15.82:0/1045579009 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c0048e0 con 0x7fae740d0060 2023-11-28T13:02:06.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae6affd700 1 -- 172.21.15.82:0/1045579009 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c0099b0 con 0x7fae740d0060 2023-11-28T13:02:06.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae7b323700 1 -- 172.21.15.82:0/1045579009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae740afdc0 con 0x7fae740d0060 2023-11-28T13:02:06.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae6affd700 1 -- 172.21.15.82:0/1045579009 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c01c680 con 0x7fae740d0060 2023-11-28T13:02:06.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae7b323700 1 -- 172.21.15.82:0/1045579009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7415e490 con 0x7fae740d0060 2023-11-28T13:02:06.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae7b323700 1 -- 172.21.15.82:0/1045579009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae740aff50 con 0x7fae740d0060 2023-11-28T13:02:06.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.354+0000 7fae6affd700 1 -- 172.21.15.82:0/1045579009 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fae6c022030 con 0x7fae740d0060 2023-11-28T13:02:06.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.358+0000 7fae6affd700 1 --2- 172.21.15.82:0/1045579009 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fae58064ee0 0x7fae58067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.358+0000 7fae6affd700 1 -- 172.21.15.82:0/1045579009 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fae6c083750 con 0x7fae740d0060 2023-11-28T13:02:06.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.358+0000 7fae7a321700 1 --2- 172.21.15.82:0/1045579009 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fae58064ee0 0x7fae58067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.358+0000 7fae7a321700 1 --2- 172.21.15.82:0/1045579009 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fae58064ee0 0x7fae58067390 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fae64006fd0 tx=0x7fae64008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:06.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.362+0000 7fae6affd700 1 -- 172.21.15.82:0/1045579009 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fae6c0518f0 con 0x7fae740d0060 2023-11-28T13:02:06.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.526+0000 7fae7b323700 1 -- 172.21.15.82:0/1045579009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fae74065fc0 con 0x7fae740d0060 2023-11-28T13:02:06.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.526+0000 7fae6affd700 1 -- 172.21.15.82:0/1045579009 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7fae6c054f10 con 0x7fae740d0060 2023-11-28T13:02:06.528 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:02:06.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.526+0000 7fae7b323700 1 -- 172.21.15.82:0/1045579009 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fae58064ee0 msgr2=0x7fae58067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.526+0000 7fae7b323700 1 --2- 172.21.15.82:0/1045579009 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fae58064ee0 0x7fae58067390 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fae64006fd0 tx=0x7fae64008040 comp rx=0 tx=0).stop 2023-11-28T13:02:06.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.526+0000 7fae7b323700 1 -- 172.21.15.82:0/1045579009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae740d0060 msgr2=0x7fae741f2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.526+0000 7fae7b323700 1 --2- 172.21.15.82:0/1045579009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae740d0060 0x7fae741f2d30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fae6c00b730 tx=0x7fae6c004af0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.526+0000 7fae7b323700 1 -- 172.21.15.82:0/1045579009 shutdown_connections 2023-11-28T13:02:06.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.526+0000 7fae7b323700 1 --2- 172.21.15.82:0/1045579009 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fae58064ee0 0x7fae58067390 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.526+0000 7fae7b323700 1 --2- 172.21.15.82:0/1045579009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae740d0060 0x7fae741f2d30 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.530+0000 7fae7b323700 1 --2- 172.21.15.82:0/1045579009 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae740b61d0 0x7fae7415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.530+0000 7fae7b323700 1 --2- 172.21.15.82:0/1045579009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae740b29e0 0x7fae741437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.530+0000 7fae7b323700 1 -- 172.21.15.82:0/1045579009 >> 172.21.15.82:0/1045579009 conn(0x7fae740cd2d0 msgr2=0x7fae740b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:06.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.530+0000 7fae7b323700 1 -- 172.21.15.82:0/1045579009 shutdown_connections 2023-11-28T13:02:06.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.530+0000 7fae7b323700 1 -- 172.21.15.82:0/1045579009 wait complete. 2023-11-28T13:02:06.543 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:02:06.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.658+0000 7f51ab493700 1 Processor -- start 2023-11-28T13:02:06.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.658+0000 7f51ab493700 1 -- start start 2023-11-28T13:02:06.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.658+0000 7f51ab493700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f51a40b1d10 0x7f51a40cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.658+0000 7f51ab493700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f51a406c140 0x7f51a406a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.658+0000 7f51ab493700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a4069bc0 con 0x7f51a40d25b0 2023-11-28T13:02:06.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.658+0000 7f51ab493700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a40d1480 con 0x7f51a40b1d10 2023-11-28T13:02:06.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.658+0000 7f51ab493700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a40cd280 con 0x7f51a406c140 2023-11-28T13:02:06.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.658+0000 7f51aa491700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f51a40b1d10 0x7f51a40cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.658+0000 7f51aa491700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f51a40b1d10 0x7f51a40cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49192/0 (socket says 172.21.15.82:49192) 2023-11-28T13:02:06.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.658+0000 7f51aa491700 1 -- 172.21.15.82:0/774416638 learned_addr learned my addr 172.21.15.82:0/774416638 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:06.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.658+0000 7f51aac92700 1 --2- 172.21.15.82:0/774416638 >> v2:172.21.15.114:3300/0 conn(0x7f51a406c140 0x7f51a406a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.658+0000 7f51aa491700 1 -- 172.21.15.82:0/774416638 >> v2:172.21.15.114:3300/0 conn(0x7f51a406c140 msgr2=0x7f51a406a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:06.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.658+0000 7f51aa491700 1 --2- 172.21.15.82:0/774416638 >> v2:172.21.15.114:3300/0 conn(0x7f51a406c140 0x7f51a406a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.658+0000 7f51aa491700 1 -- 172.21.15.82:0/774416638 >> v1:172.21.15.114:6789/0 conn(0x7f51a40d25b0 legacy=0x7f51a406ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:06.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.658+0000 7f51aa491700 1 -- 172.21.15.82:0/774416638 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a40cd560 con 0x7f51a40b1d10 2023-11-28T13:02:06.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.658+0000 7f51aa491700 1 --2- 172.21.15.82:0/774416638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a40b1d10 0x7f51a40cec20 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f51a40c9af0 tx=0x7f51a0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ee9713064a2eca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:06.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.658+0000 7f51a948f700 1 -- 172.21.15.82:0/774416638 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a0004230 con 0x7f51a40b1d10 2023-11-28T13:02:06.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.658+0000 7f51a948f700 1 -- 172.21.15.82:0/774416638 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a0004390 con 0x7f51a40b1d10 2023-11-28T13:02:06.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.658+0000 7f51a948f700 1 -- 172.21.15.82:0/774416638 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a00036c0 con 0x7f51a40b1d10 2023-11-28T13:02:06.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.662+0000 7f51ab493700 1 -- 172.21.15.82:0/774416638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a40b1d10 msgr2=0x7f51a40cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.662+0000 7f51ab493700 1 --2- 172.21.15.82:0/774416638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a40b1d10 0x7f51a40cec20 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f51a40c9af0 tx=0x7f51a0009bf0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.662+0000 7f51ab493700 1 -- 172.21.15.82:0/774416638 shutdown_connections 2023-11-28T13:02:06.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.662+0000 7f51ab493700 1 --2- 172.21.15.82:0/774416638 >> v2:172.21.15.114:3300/0 conn(0x7f51a406c140 0x7f51a406a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.662+0000 7f51ab493700 1 --2- 172.21.15.82:0/774416638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a40b1d10 0x7f51a40cec20 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.662+0000 7f51ab493700 1 -- 172.21.15.82:0/774416638 >> 172.21.15.82:0/774416638 conn(0x7f51a40b52a0 msgr2=0x7f51a40d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:06.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.662+0000 7f51ab493700 1 -- 172.21.15.82:0/774416638 shutdown_connections 2023-11-28T13:02:06.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.662+0000 7f51ab493700 1 -- 172.21.15.82:0/774416638 wait complete. 2023-11-28T13:02:06.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.662+0000 7f51ab493700 1 Processor -- start 2023-11-28T13:02:06.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.662+0000 7f51ab493700 1 -- start start 2023-11-28T13:02:06.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f51ab493700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a406c140 0x7f51a4150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f51ab493700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51a40b1d10 0x7f51a40b7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f51ab493700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a40d25b0 0x7f51a415ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f51ab493700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a40cc160 con 0x7f51a40d25b0 2023-11-28T13:02:06.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f51ab493700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a40cb550 con 0x7f51a40b1d10 2023-11-28T13:02:06.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f51ab493700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a40cb830 con 0x7f51a406c140 2023-11-28T13:02:06.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f51aac92700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a40d25b0 0x7f51a415ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f51aac92700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a40d25b0 0x7f51a415ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49206/0 (socket says 172.21.15.82:49206) 2023-11-28T13:02:06.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f51aac92700 1 -- 172.21.15.82:0/1579586921 learned_addr learned my addr 172.21.15.82:0/1579586921 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:06.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f51a9c90700 1 --2- 172.21.15.82:0/1579586921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51a40b1d10 0x7f51a40b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f51aa491700 1 --2- 172.21.15.82:0/1579586921 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a406c140 0x7f51a4150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f51aac92700 1 -- 172.21.15.82:0/1579586921 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a406c140 msgr2=0x7f51a4150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f51aac92700 1 --2- 172.21.15.82:0/1579586921 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a406c140 0x7f51a4150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f51aac92700 1 -- 172.21.15.82:0/1579586921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51a40b1d10 msgr2=0x7f51a40b7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f51aac92700 1 --2- 172.21.15.82:0/1579586921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51a40b1d10 0x7f51a40b7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f51aac92700 1 -- 172.21.15.82:0/1579586921 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a0009570 con 0x7f51a40d25b0 2023-11-28T13:02:06.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f51aac92700 1 --2- 172.21.15.82:0/1579586921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a40d25b0 0x7f51a415ca10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f519c007e30 tx=0x7f519c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:06.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f5196ffd700 1 -- 172.21.15.82:0/1579586921 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c00ed30 con 0x7f51a40d25b0 2023-11-28T13:02:06.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f5196ffd700 1 -- 172.21.15.82:0/1579586921 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c00ee90 con 0x7f51a40d25b0 2023-11-28T13:02:06.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f5196ffd700 1 -- 172.21.15.82:0/1579586921 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c014660 con 0x7f51a40d25b0 2023-11-28T13:02:06.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f51ab493700 1 -- 172.21.15.82:0/1579586921 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a40d1050 con 0x7f51a40d25b0 2023-11-28T13:02:06.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.666+0000 7f51ab493700 1 -- 172.21.15.82:0/1579586921 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a40b20e0 con 0x7f51a40d25b0 2023-11-28T13:02:06.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.670+0000 7f51ab493700 1 -- 172.21.15.82:0/1579586921 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a40d11e0 con 0x7f51a40d25b0 2023-11-28T13:02:06.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.670+0000 7f5196ffd700 1 -- 172.21.15.82:0/1579586921 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f519c012050 con 0x7f51a40d25b0 2023-11-28T13:02:06.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.670+0000 7f5196ffd700 1 --2- 172.21.15.82:0/1579586921 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5188064ee0 0x7f5188067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.670+0000 7f5196ffd700 1 -- 172.21.15.82:0/1579586921 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f519c082320 con 0x7f51a40d25b0 2023-11-28T13:02:06.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.670+0000 7f51aa491700 1 --2- 172.21.15.82:0/1579586921 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5188064ee0 0x7f5188067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.670+0000 7f51aa491700 1 --2- 172.21.15.82:0/1579586921 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5188064ee0 0x7f5188067390 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f51a40c9af0 tx=0x7f51a0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:06.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.678+0000 7f5196ffd700 1 -- 172.21.15.82:0/1579586921 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f519c0504c0 con 0x7f51a40d25b0 2023-11-28T13:02:06.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.838+0000 7f51ab493700 1 -- 172.21.15.82:0/1579586921 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f51a4065fc0 con 0x7f51a40d25b0 2023-11-28T13:02:06.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.838+0000 7f5196ffd700 1 -- 172.21.15.82:0/1579586921 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7f519c053ae0 con 0x7f51a40d25b0 2023-11-28T13:02:06.842 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:02:06.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.842+0000 7f51ab493700 1 -- 172.21.15.82:0/1579586921 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5188064ee0 msgr2=0x7f5188067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.842+0000 7f51ab493700 1 --2- 172.21.15.82:0/1579586921 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5188064ee0 0x7f5188067390 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f51a40c9af0 tx=0x7f51a0008030 comp rx=0 tx=0).stop 2023-11-28T13:02:06.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.842+0000 7f51ab493700 1 -- 172.21.15.82:0/1579586921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a40d25b0 msgr2=0x7f51a415ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.842+0000 7f51ab493700 1 --2- 172.21.15.82:0/1579586921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a40d25b0 0x7f51a415ca10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f519c007e30 tx=0x7f519c00e3c0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.842+0000 7f51ab493700 1 -- 172.21.15.82:0/1579586921 shutdown_connections 2023-11-28T13:02:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.842+0000 7f51ab493700 1 --2- 172.21.15.82:0/1579586921 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5188064ee0 0x7f5188067390 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.842+0000 7f51ab493700 1 --2- 172.21.15.82:0/1579586921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a40d25b0 0x7f51a415ca10 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.842+0000 7f51ab493700 1 --2- 172.21.15.82:0/1579586921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51a40b1d10 0x7f51a40b7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.842+0000 7f51ab493700 1 --2- 172.21.15.82:0/1579586921 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a406c140 0x7f51a4150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.842+0000 7f51ab493700 1 -- 172.21.15.82:0/1579586921 >> 172.21.15.82:0/1579586921 conn(0x7f51a40b52a0 msgr2=0x7f51a40d29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.842+0000 7f51ab493700 1 -- 172.21.15.82:0/1579586921 shutdown_connections 2023-11-28T13:02:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.842+0000 7f51ab493700 1 -- 172.21.15.82:0/1579586921 wait complete. 2023-11-28T13:02:06.857 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T13:02:06.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.966+0000 7f9e0a43a700 1 Processor -- start 2023-11-28T13:02:06.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.966+0000 7f9e0a43a700 1 -- start start 2023-11-28T13:02:06.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e0a43a700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9e040b1d10 0x7f9e040cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e0a43a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9e040d25b0 0x7f9e0406ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e0a43a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e04069bc0 con 0x7f9e040b5940 2023-11-28T13:02:06.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e0a43a700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e040d1480 con 0x7f9e040b1d10 2023-11-28T13:02:06.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e0a43a700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040cd280 con 0x7f9e040d25b0 2023-11-28T13:02:06.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e09c39700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9e040b5940 0x7f9e0406a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48428/0 (socket says 172.21.15.82:48428) 2023-11-28T13:02:06.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e09c39700 1 -- 172.21.15.82:0/1095753733 learned_addr learned my addr 172.21.15.82:0/1095753733 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:06.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e08c37700 1 --2- 172.21.15.82:0/1095753733 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9e040d25b0 0x7f9e0406ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e09438700 1 --2- 172.21.15.82:0/1095753733 >> v2:172.21.15.114:3300/0 conn(0x7f9e040b1d10 0x7f9e040cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9dfbfff700 1 -- 172.21.15.82:0/1095753733 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970790487 0 0) 0x7f9e04069bc0 con 0x7f9e040b5940 2023-11-28T13:02:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9dfbfff700 1 -- 172.21.15.82:0/1095753733 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9df00035d0 con 0x7f9e040b5940 2023-11-28T13:02:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9dfbfff700 1 -- 172.21.15.82:0/1095753733 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2195988286 0 0) 0x7f9df00035d0 con 0x7f9e040b5940 2023-11-28T13:02:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9dfbfff700 1 -- 172.21.15.82:0/1095753733 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9e040d25b0 msgr2=0x7f9e0406ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9dfbfff700 1 --2- 172.21.15.82:0/1095753733 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9e040d25b0 0x7f9e0406ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9dfbfff700 1 -- 172.21.15.82:0/1095753733 >> v2:172.21.15.114:3300/0 conn(0x7f9e040b1d10 msgr2=0x7f9e040cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9dfbfff700 1 --2- 172.21.15.82:0/1095753733 >> v2:172.21.15.114:3300/0 conn(0x7f9e040b1d10 0x7f9e040cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9dfbfff700 1 -- 172.21.15.82:0/1095753733 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e040cd560 con 0x7f9e040b5940 2023-11-28T13:02:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9dfbfff700 1 -- 172.21.15.82:0/1095753733 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f9dfc0019f0 con 0x7f9e040b5940 2023-11-28T13:02:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9dfbfff700 1 -- 172.21.15.82:0/1095753733 >> v1:172.21.15.82:6789/0 conn(0x7f9e040b5940 legacy=0x7f9e0406a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9dfbfff700 1 --2- 172.21.15.82:0/1095753733 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9e040d25b0 0x7f9df0003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9dfbfff700 1 --2- 172.21.15.82:0/1095753733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9df0003fa0 0x7f9df0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9dfbfff700 1 --2- 172.21.15.82:0/1095753733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df0004db0 0x7f9df0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9dfbfff700 1 -- 172.21.15.82:0/1095753733 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040d1480 con 0x7f9df0004db0 2023-11-28T13:02:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9dfbfff700 1 -- 172.21.15.82:0/1095753733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040cd280 con 0x7f9df0003fa0 2023-11-28T13:02:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9dfbfff700 1 -- 172.21.15.82:0/1095753733 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df000ba30 con 0x7f9e040d25b0 2023-11-28T13:02:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e09c39700 1 --2- 172.21.15.82:0/1095753733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df0004db0 0x7f9df0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e08c37700 1 --2- 172.21.15.82:0/1095753733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9df0003fa0 0x7f9df0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e09438700 1 --2- 172.21.15.82:0/1095753733 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9e040d25b0 0x7f9df0003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e09c39700 1 -- 172.21.15.82:0/1095753733 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9e040d25b0 msgr2=0x7f9df0003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e09c39700 1 --2- 172.21.15.82:0/1095753733 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9e040d25b0 0x7f9df0003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e09c39700 1 -- 172.21.15.82:0/1095753733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9df0003fa0 msgr2=0x7f9df0004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e09c39700 1 --2- 172.21.15.82:0/1095753733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9df0003fa0 0x7f9df0004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e09c39700 1 -- 172.21.15.82:0/1095753733 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df00035d0 con 0x7f9df0004db0 2023-11-28T13:02:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e09c39700 1 --2- 172.21.15.82:0/1095753733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df0004db0 0x7f9df0005220 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00a830 tx=0x7f9df00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483dc403fd2a05db server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:06.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9dfbfff700 1 -- 172.21.15.82:0/1095753733 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc00a2f0 con 0x7f9df0004db0 2023-11-28T13:02:06.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9dfbfff700 1 -- 172.21.15.82:0/1095753733 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dfc0072f0 con 0x7f9df0004db0 2023-11-28T13:02:06.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9dfbfff700 1 -- 172.21.15.82:0/1095753733 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc0076a0 con 0x7f9df0004db0 2023-11-28T13:02:06.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e0a43a700 1 -- 172.21.15.82:0/1095753733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df0004db0 msgr2=0x7f9df0005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e0a43a700 1 --2- 172.21.15.82:0/1095753733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df0004db0 0x7f9df0005220 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00a830 tx=0x7f9df00058a0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e09c39700 1 -- 172.21.15.82:0/1095753733 reap_dead start 2023-11-28T13:02:06.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e0a43a700 1 -- 172.21.15.82:0/1095753733 shutdown_connections 2023-11-28T13:02:06.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e0a43a700 1 -- 172.21.15.82:0/1095753733 >> 172.21.15.82:0/1095753733 conn(0x7f9e040b52a0 msgr2=0x7f9e040d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:06.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e0a43a700 1 -- 172.21.15.82:0/1095753733 shutdown_connections 2023-11-28T13:02:06.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.970+0000 7f9e0a43a700 1 -- 172.21.15.82:0/1095753733 wait complete. 2023-11-28T13:02:06.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.974+0000 7f9e0a43a700 1 Processor -- start 2023-11-28T13:02:06.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.974+0000 7f9e0a43a700 1 -- start start 2023-11-28T13:02:06.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.974+0000 7f9e0a43a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9df0004db0 0x7f9e0414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.974+0000 7f9e0a43a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e040b32c0 0x7f9e040b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.974+0000 7f9e0a43a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e0415d710 0x7f9e0415db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.974+0000 7f9e0a43a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040b3c70 con 0x7f9e040b32c0 2023-11-28T13:02:06.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.974+0000 7f9e0a43a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0415e480 con 0x7f9e0415d710 2023-11-28T13:02:06.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.974+0000 7f9e0a43a700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0415e760 con 0x7f9df0004db0 2023-11-28T13:02:06.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.974+0000 7f9e08c37700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e040b32c0 0x7f9e040b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.974+0000 7f9e08c37700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e040b32c0 0x7f9e040b3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49222/0 (socket says 172.21.15.82:49222) 2023-11-28T13:02:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.974+0000 7f9e08c37700 1 -- 172.21.15.82:0/2535401139 learned_addr learned my addr 172.21.15.82:0/2535401139 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.974+0000 7f9e09438700 1 --2- 172.21.15.82:0/2535401139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9df0004db0 0x7f9e0414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.974+0000 7f9e09c39700 1 --2- 172.21.15.82:0/2535401139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e0415d710 0x7f9e0415db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.974+0000 7f9e08c37700 1 -- 172.21.15.82:0/2535401139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9df0004db0 msgr2=0x7f9e0414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.974+0000 7f9e08c37700 1 --2- 172.21.15.82:0/2535401139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9df0004db0 0x7f9e0414ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.974+0000 7f9e08c37700 1 -- 172.21.15.82:0/2535401139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e0415d710 msgr2=0x7f9e0415db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.974+0000 7f9e08c37700 1 --2- 172.21.15.82:0/2535401139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e0415d710 0x7f9e0415db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.978+0000 7f9e08c37700 1 -- 172.21.15.82:0/2535401139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e040d1050 con 0x7f9e040b32c0 2023-11-28T13:02:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.978+0000 7f9e08c37700 1 --2- 172.21.15.82:0/2535401139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e040b32c0 0x7f9e040b3730 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9df40119b0 tx=0x7f9df4011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:06.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.978+0000 7f9df9ffb700 1 -- 172.21.15.82:0/2535401139 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4011e40 con 0x7f9e040b32c0 2023-11-28T13:02:06.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.978+0000 7f9df9ffb700 1 -- 172.21.15.82:0/2535401139 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df400f940 con 0x7f9e040b32c0 2023-11-28T13:02:06.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.978+0000 7f9df9ffb700 1 -- 172.21.15.82:0/2535401139 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df400fcd0 con 0x7f9e040b32c0 2023-11-28T13:02:06.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.978+0000 7f9e0a43a700 1 -- 172.21.15.82:0/2535401139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e040b20e0 con 0x7f9e040b32c0 2023-11-28T13:02:06.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.978+0000 7f9e0a43a700 1 -- 172.21.15.82:0/2535401139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e040d11e0 con 0x7f9e040b32c0 2023-11-28T13:02:06.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.978+0000 7f9e0a43a700 1 -- 172.21.15.82:0/2535401139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e04065fc0 con 0x7f9e040b32c0 2023-11-28T13:02:06.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.978+0000 7f9df9ffb700 1 -- 172.21.15.82:0/2535401139 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9df4014440 con 0x7f9e040b32c0 2023-11-28T13:02:06.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.978+0000 7f9df9ffb700 1 --2- 172.21.15.82:0/2535401139 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9de8064ee0 0x7f9de8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:06.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.978+0000 7f9df9ffb700 1 -- 172.21.15.82:0/2535401139 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9df4082570 con 0x7f9e040b32c0 2023-11-28T13:02:06.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.978+0000 7f9e09438700 1 --2- 172.21.15.82:0/2535401139 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9de8064ee0 0x7f9de8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:06.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.982+0000 7f9e09438700 1 --2- 172.21.15.82:0/2535401139 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9de8064ee0 0x7f9de8067390 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9e0415d6a0 tx=0x7f9e00009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:06.986+0000 7f9df9ffb700 1 -- 172.21.15.82:0/2535401139 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9df40506b0 con 0x7f9e040b32c0 2023-11-28T13:02:07.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.150+0000 7f9e0a43a700 1 -- 172.21.15.82:0/2535401139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9e040b8330 con 0x7f9e040b32c0 2023-11-28T13:02:07.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.150+0000 7f9df9ffb700 1 -- 172.21.15.82:0/2535401139 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9df4053cd0 con 0x7f9e040b32c0 2023-11-28T13:02:07.151 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-11-28T13:02:07.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.150+0000 7f9e0a43a700 1 -- 172.21.15.82:0/2535401139 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9de8064ee0 msgr2=0x7f9de8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:07.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.150+0000 7f9e0a43a700 1 --2- 172.21.15.82:0/2535401139 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9de8064ee0 0x7f9de8067390 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9e0415d6a0 tx=0x7f9e00009240 comp rx=0 tx=0).stop 2023-11-28T13:02:07.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.150+0000 7f9e0a43a700 1 -- 172.21.15.82:0/2535401139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e040b32c0 msgr2=0x7f9e040b3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:07.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.150+0000 7f9e0a43a700 1 --2- 172.21.15.82:0/2535401139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e040b32c0 0x7f9e040b3730 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9df40119b0 tx=0x7f9df4011cc0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.150+0000 7f9e0a43a700 1 -- 172.21.15.82:0/2535401139 shutdown_connections 2023-11-28T13:02:07.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.150+0000 7f9e0a43a700 1 --2- 172.21.15.82:0/2535401139 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9de8064ee0 0x7f9de8067390 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.150+0000 7f9e0a43a700 1 --2- 172.21.15.82:0/2535401139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e0415d710 0x7f9e0415db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.150+0000 7f9e0a43a700 1 --2- 172.21.15.82:0/2535401139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e040b32c0 0x7f9e040b3730 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.150+0000 7f9e0a43a700 1 --2- 172.21.15.82:0/2535401139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9df0004db0 0x7f9e0414ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.150+0000 7f9e0a43a700 1 -- 172.21.15.82:0/2535401139 >> 172.21.15.82:0/2535401139 conn(0x7f9e040b52a0 msgr2=0x7f9e040d16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:07.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.150+0000 7f9e0a43a700 1 -- 172.21.15.82:0/2535401139 shutdown_connections 2023-11-28T13:02:07.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.150+0000 7f9e0a43a700 1 -- 172.21.15.82:0/2535401139 wait complete. 2023-11-28T13:02:07.166 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T13:02:07.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.286+0000 7f47d427a700 1 Processor -- start 2023-11-28T13:02:07.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.286+0000 7f47d427a700 1 -- start start 2023-11-28T13:02:07.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d427a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f47cc15fcb0 0x7f47cc0ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:07.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d427a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f47cc06bf10 0x7f47cc0d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:07.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d427a700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47cc06af10 con 0x7f47cc0cd200 2023-11-28T13:02:07.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d427a700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47cc0d0820 con 0x7f47cc06bf10 2023-11-28T13:02:07.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d427a700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc06a670 con 0x7f47cc15fcb0 2023-11-28T13:02:07.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d2817700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f47cc06bf10 0x7f47cc0d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:07.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d2817700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f47cc06bf10 0x7f47cc0d0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49228/0 (socket says 172.21.15.82:49228) 2023-11-28T13:02:07.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d2817700 1 -- 172.21.15.82:0/1124904409 learned_addr learned my addr 172.21.15.82:0/1124904409 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:07.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d2016700 1 --2- 172.21.15.82:0/1124904409 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f47cc15fcb0 0x7f47cc0ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:07.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d2817700 1 -- 172.21.15.82:0/1124904409 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f47cc15fcb0 msgr2=0x7f47cc0ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:07.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d2817700 1 --2- 172.21.15.82:0/1124904409 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f47cc15fcb0 0x7f47cc0ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d2817700 1 -- 172.21.15.82:0/1124904409 >> v1:172.21.15.114:6789/0 conn(0x7f47cc0cd200 legacy=0x7f47cc06b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:07.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d2817700 1 -- 172.21.15.82:0/1124904409 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc06a950 con 0x7f47cc06bf10 2023-11-28T13:02:07.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d2817700 1 --2- 172.21.15.82:0/1124904409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47cc06bf10 0x7f47cc0d0d20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009e50 tx=0x7f47c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e002e95c3e5a061 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:07.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d1014700 1 -- 172.21.15.82:0/1124904409 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c400e070 con 0x7f47cc06bf10 2023-11-28T13:02:07.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d1014700 1 -- 172.21.15.82:0/1124904409 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c400b910 con 0x7f47cc06bf10 2023-11-28T13:02:07.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d1014700 1 -- 172.21.15.82:0/1124904409 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c400bcc0 con 0x7f47cc06bf10 2023-11-28T13:02:07.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d427a700 1 -- 172.21.15.82:0/1124904409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47cc06bf10 msgr2=0x7f47cc0d0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:07.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d427a700 1 --2- 172.21.15.82:0/1124904409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47cc06bf10 0x7f47cc0d0d20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009e50 tx=0x7f47c400b330 comp rx=0 tx=0).stop 2023-11-28T13:02:07.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d427a700 1 -- 172.21.15.82:0/1124904409 shutdown_connections 2023-11-28T13:02:07.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d427a700 1 --2- 172.21.15.82:0/1124904409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47cc06bf10 0x7f47cc0d0d20 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d427a700 1 --2- 172.21.15.82:0/1124904409 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f47cc15fcb0 0x7f47cc0ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d427a700 1 -- 172.21.15.82:0/1124904409 >> 172.21.15.82:0/1124904409 conn(0x7f47cc0d02c0 msgr2=0x7f47cc0d2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:07.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d427a700 1 -- 172.21.15.82:0/1124904409 shutdown_connections 2023-11-28T13:02:07.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.290+0000 7f47d427a700 1 -- 172.21.15.82:0/1124904409 wait complete. 2023-11-28T13:02:07.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47d427a700 1 Processor -- start 2023-11-28T13:02:07.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47d427a700 1 -- start start 2023-11-28T13:02:07.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47d427a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f47cc06bf10 0x7f47cc0ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:07.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47d427a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47cc0cd200 0x7f47cc0cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:07.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47d427a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47cc15fcb0 0x7f47cc1f5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:07.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47d427a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0ca880 con 0x7f47cc0cd200 2023-11-28T13:02:07.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47d427a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0cc670 con 0x7f47cc15fcb0 2023-11-28T13:02:07.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47d427a700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0cc950 con 0x7f47cc06bf10 2023-11-28T13:02:07.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47d1815700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47cc0cd200 0x7f47cc0cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:07.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47d1815700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47cc0cd200 0x7f47cc0cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49234/0 (socket says 172.21.15.82:49234) 2023-11-28T13:02:07.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47d1815700 1 -- 172.21.15.82:0/2435767163 learned_addr learned my addr 172.21.15.82:0/2435767163 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:07.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47d2817700 1 --2- 172.21.15.82:0/2435767163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47cc15fcb0 0x7f47cc1f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:07.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47d2016700 1 --2- 172.21.15.82:0/2435767163 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f47cc06bf10 0x7f47cc0ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:07.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47d1815700 1 -- 172.21.15.82:0/2435767163 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f47cc06bf10 msgr2=0x7f47cc0ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:07.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47d1815700 1 --2- 172.21.15.82:0/2435767163 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f47cc06bf10 0x7f47cc0ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47d1815700 1 -- 172.21.15.82:0/2435767163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47cc15fcb0 msgr2=0x7f47cc1f5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:07.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47d1815700 1 --2- 172.21.15.82:0/2435767163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47cc15fcb0 0x7f47cc1f5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47d1815700 1 -- 172.21.15.82:0/2435767163 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c4009b30 con 0x7f47cc0cd200 2023-11-28T13:02:07.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47d1815700 1 --2- 172.21.15.82:0/2435767163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47cc0cd200 0x7f47cc0cbe00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f47c000c410 tx=0x7f47c000c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:07.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47beffd700 1 -- 172.21.15.82:0/2435767163 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c00052d0 con 0x7f47cc0cd200 2023-11-28T13:02:07.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47beffd700 1 -- 172.21.15.82:0/2435767163 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c0005430 con 0x7f47cc0cd200 2023-11-28T13:02:07.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47d427a700 1 -- 172.21.15.82:0/2435767163 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47cc0cd650 con 0x7f47cc0cd200 2023-11-28T13:02:07.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47beffd700 1 -- 172.21.15.82:0/2435767163 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c00055a0 con 0x7f47cc0cd200 2023-11-28T13:02:07.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.294+0000 7f47d427a700 1 -- 172.21.15.82:0/2435767163 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47cc06ac30 con 0x7f47cc0cd200 2023-11-28T13:02:07.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.298+0000 7f47d427a700 1 -- 172.21.15.82:0/2435767163 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47cc0cd7e0 con 0x7f47cc0cd200 2023-11-28T13:02:07.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.298+0000 7f47beffd700 1 -- 172.21.15.82:0/2435767163 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f47c0010050 con 0x7f47cc0cd200 2023-11-28T13:02:07.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.298+0000 7f47beffd700 1 --2- 172.21.15.82:0/2435767163 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f47b0064ee0 0x7f47b0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:07.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.298+0000 7f47beffd700 1 -- 172.21.15.82:0/2435767163 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f47c0080e80 con 0x7f47cc0cd200 2023-11-28T13:02:07.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.298+0000 7f47d2016700 1 --2- 172.21.15.82:0/2435767163 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f47b0064ee0 0x7f47b0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:07.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.298+0000 7f47d2016700 1 --2- 172.21.15.82:0/2435767163 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f47b0064ee0 0x7f47b0067390 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009bf0 tx=0x7f47c8009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:07.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.306+0000 7f47beffd700 1 -- 172.21.15.82:0/2435767163 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f47c0049400 con 0x7f47cc0cd200 2023-11-28T13:02:07.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.466+0000 7f47d427a700 1 -- 172.21.15.82:0/2435767163 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f47cc073e20 con 0x7f47cc0cd200 2023-11-28T13:02:07.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.466+0000 7f47beffd700 1 -- 172.21.15.82:0/2435767163 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f47c004efc0 con 0x7f47cc0cd200 2023-11-28T13:02:07.467 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-11-28T13:02:07.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.470+0000 7f47d427a700 1 -- 172.21.15.82:0/2435767163 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f47b0064ee0 msgr2=0x7f47b0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:07.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.470+0000 7f47d427a700 1 --2- 172.21.15.82:0/2435767163 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f47b0064ee0 0x7f47b0067390 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009bf0 tx=0x7f47c8009240 comp rx=0 tx=0).stop 2023-11-28T13:02:07.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.470+0000 7f47d427a700 1 -- 172.21.15.82:0/2435767163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47cc0cd200 msgr2=0x7f47cc0cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:07.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.470+0000 7f47d427a700 1 --2- 172.21.15.82:0/2435767163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47cc0cd200 0x7f47cc0cbe00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f47c000c410 tx=0x7f47c000c720 comp rx=0 tx=0).stop 2023-11-28T13:02:07.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.470+0000 7f47d427a700 1 -- 172.21.15.82:0/2435767163 shutdown_connections 2023-11-28T13:02:07.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.470+0000 7f47d427a700 1 --2- 172.21.15.82:0/2435767163 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f47b0064ee0 0x7f47b0067390 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.470+0000 7f47d427a700 1 --2- 172.21.15.82:0/2435767163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47cc15fcb0 0x7f47cc1f5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.470+0000 7f47d427a700 1 --2- 172.21.15.82:0/2435767163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47cc0cd200 0x7f47cc0cbe00 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.470+0000 7f47d427a700 1 --2- 172.21.15.82:0/2435767163 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f47cc06bf10 0x7f47cc0ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.470+0000 7f47d427a700 1 -- 172.21.15.82:0/2435767163 >> 172.21.15.82:0/2435767163 conn(0x7f47cc0d02c0 msgr2=0x7f47cc0d2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:07.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.470+0000 7f47d427a700 1 -- 172.21.15.82:0/2435767163 shutdown_connections 2023-11-28T13:02:07.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.470+0000 7f47d427a700 1 -- 172.21.15.82:0/2435767163 wait complete. 2023-11-28T13:02:07.489 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:02:07.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.598+0000 7f5529755700 1 Processor -- start 2023-11-28T13:02:07.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.598+0000 7f5529755700 1 -- start start 2023-11-28T13:02:07.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5529755700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f552406b0a0 0x7f552406d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:07.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5529755700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5524070070 0x7f55240704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:07.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5529755700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5524070a10 con 0x7f55240b3910 2023-11-28T13:02:07.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5529755700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552406c480 con 0x7f5524070070 2023-11-28T13:02:07.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5529755700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552406dbe0 con 0x7f552406b0a0 2023-11-28T13:02:07.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5528f54700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5524070070 0x7f55240704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:07.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5523fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f55240b3910 0x7f552406c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48438/0 (socket says 172.21.15.82:48438) 2023-11-28T13:02:07.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5523fff700 1 -- 172.21.15.82:0/3742565655 learned_addr learned my addr 172.21.15.82:0/3742565655 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:07.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f55237fe700 1 --2- 172.21.15.82:0/3742565655 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f552406b0a0 0x7f552406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:07.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5528f54700 1 -- 172.21.15.82:0/3742565655 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f552406b0a0 msgr2=0x7f552406d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:07.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5528f54700 1 --2- 172.21.15.82:0/3742565655 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f552406b0a0 0x7f552406d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5528f54700 1 -- 172.21.15.82:0/3742565655 >> v1:172.21.15.82:6789/0 conn(0x7f55240b3910 legacy=0x7f552406c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:07.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5528f54700 1 -- 172.21.15.82:0/3742565655 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552406dec0 con 0x7f5524070070 2023-11-28T13:02:07.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f55237fe700 1 --2- 172.21.15.82:0/3742565655 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f552406b0a0 0x7f552406d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:02:07.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5528f54700 1 --2- 172.21.15.82:0/3742565655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5524070070 0x7f55240704d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f551c009d90 tx=0x7f551c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf68b6b889ebc1f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:07.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5522ffd700 1 -- 172.21.15.82:0/3742565655 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c00e070 con 0x7f5524070070 2023-11-28T13:02:07.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5522ffd700 1 -- 172.21.15.82:0/3742565655 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551c00bbd0 con 0x7f5524070070 2023-11-28T13:02:07.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5522ffd700 1 -- 172.21.15.82:0/3742565655 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c012430 con 0x7f5524070070 2023-11-28T13:02:07.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5529755700 1 -- 172.21.15.82:0/3742565655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5524070070 msgr2=0x7f55240704d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:07.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5529755700 1 --2- 172.21.15.82:0/3742565655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5524070070 0x7f55240704d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f551c009d90 tx=0x7f551c00b330 comp rx=0 tx=0).stop 2023-11-28T13:02:07.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5529755700 1 -- 172.21.15.82:0/3742565655 shutdown_connections 2023-11-28T13:02:07.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5529755700 1 --2- 172.21.15.82:0/3742565655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5524070070 0x7f55240704d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5529755700 1 --2- 172.21.15.82:0/3742565655 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f552406b0a0 0x7f552406d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5529755700 1 -- 172.21.15.82:0/3742565655 >> 172.21.15.82:0/3742565655 conn(0x7f55240ce600 msgr2=0x7f55240ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:07.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5529755700 1 -- 172.21.15.82:0/3742565655 shutdown_connections 2023-11-28T13:02:07.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.602+0000 7f5529755700 1 -- 172.21.15.82:0/3742565655 wait complete. 2023-11-28T13:02:07.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5529755700 1 Processor -- start 2023-11-28T13:02:07.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5529755700 1 -- start start 2023-11-28T13:02:07.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5529755700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f552406b0a0 0x7f55241f3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:07.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5529755700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5524070070 0x7f55240c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:07.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5529755700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55240b3910 0x7f5524149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5529755700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552414d1d0 con 0x7f552406b0a0 2023-11-28T13:02:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5529755700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55241f4130 con 0x7f55240b3910 2023-11-28T13:02:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5529755700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552415bda0 con 0x7f5524070070 2023-11-28T13:02:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5523fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f552406b0a0 0x7f55241f3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5523fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f552406b0a0 0x7f55241f3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49240/0 (socket says 172.21.15.82:49240) 2023-11-28T13:02:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5523fff700 1 -- 172.21.15.82:0/2842709587 learned_addr learned my addr 172.21.15.82:0/2842709587 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5523fff700 1 -- 172.21.15.82:0/2842709587 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5524070070 msgr2=0x7f55240c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5523fff700 1 --2- 172.21.15.82:0/2842709587 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5524070070 0x7f55240c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5523fff700 1 -- 172.21.15.82:0/2842709587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55240b3910 msgr2=0x7f5524149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5528f54700 1 --2- 172.21.15.82:0/2842709587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55240b3910 0x7f5524149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5523fff700 1 --2- 172.21.15.82:0/2842709587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55240b3910 0x7f5524149620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5523fff700 1 -- 172.21.15.82:0/2842709587 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c009a70 con 0x7f552406b0a0 2023-11-28T13:02:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5523fff700 1 --2- 172.21.15.82:0/2842709587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f552406b0a0 0x7f55241f3bf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5518001eb0 tx=0x7f551800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:07.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5520ff9700 1 -- 172.21.15.82:0/2842709587 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518005d90 con 0x7f552406b0a0 2023-11-28T13:02:07.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5520ff9700 1 -- 172.21.15.82:0/2842709587 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55180070d0 con 0x7f552406b0a0 2023-11-28T13:02:07.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5529755700 1 -- 172.21.15.82:0/2842709587 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55240c8f80 con 0x7f552406b0a0 2023-11-28T13:02:07.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5520ff9700 1 -- 172.21.15.82:0/2842709587 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518007440 con 0x7f552406b0a0 2023-11-28T13:02:07.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5529755700 1 -- 172.21.15.82:0/2842709587 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552406c110 con 0x7f552406b0a0 2023-11-28T13:02:07.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.606+0000 7f5529755700 1 -- 172.21.15.82:0/2842709587 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552406d860 con 0x7f552406b0a0 2023-11-28T13:02:07.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.610+0000 7f5520ff9700 1 -- 172.21.15.82:0/2842709587 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5518019030 con 0x7f552406b0a0 2023-11-28T13:02:07.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.610+0000 7f5520ff9700 1 --2- 172.21.15.82:0/2842709587 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5510064ee0 0x7f5510067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:07.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.610+0000 7f55237fe700 1 --2- 172.21.15.82:0/2842709587 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5510064ee0 0x7f5510067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:07.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.610+0000 7f5520ff9700 1 -- 172.21.15.82:0/2842709587 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5518081040 con 0x7f552406b0a0 2023-11-28T13:02:07.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.610+0000 7f55237fe700 1 --2- 172.21.15.82:0/2842709587 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5510064ee0 0x7f5510067390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f55240a8cf0 tx=0x7f5514008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:07.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.614+0000 7f5520ff9700 1 -- 172.21.15.82:0/2842709587 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f551804a400 con 0x7f552406b0a0 2023-11-28T13:02:07.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.810+0000 7f5529755700 1 -- 172.21.15.82:0/2842709587 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5524065fc0 con 0x7f552406b0a0 2023-11-28T13:02:07.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.814+0000 7f5520ff9700 1 -- 172.21.15.82:0/2842709587 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f551804f290 con 0x7f552406b0a0 2023-11-28T13:02:07.815 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:07.816 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2975361458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2975361458},{"type":"v1","addr":"172.21.15.114:6833","nonce":2975361458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3412196002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3412196002},{"type":"v1","addr":"172.21.15.114:6835","nonce":3412196002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/167093290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":167093290},{"type":"v1","addr":"172.21.15.82:6835","nonce":167093290}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:01:29.585949+0000","modified":"2023-11-28T13:01:32.836050+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/3448846386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3448846386},{"type":"v1","addr":"172.21.15.82:6837","nonce":3448846386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T13:02:07.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.814+0000 7f5529755700 1 -- 172.21.15.82:0/2842709587 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5510064ee0 msgr2=0x7f5510067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:07.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.814+0000 7f5529755700 1 --2- 172.21.15.82:0/2842709587 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5510064ee0 0x7f5510067390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f55240a8cf0 tx=0x7f5514008040 comp rx=0 tx=0).stop 2023-11-28T13:02:07.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.814+0000 7f5529755700 1 -- 172.21.15.82:0/2842709587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f552406b0a0 msgr2=0x7f55241f3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:07.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.814+0000 7f5529755700 1 --2- 172.21.15.82:0/2842709587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f552406b0a0 0x7f55241f3bf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5518001eb0 tx=0x7f551800c860 comp rx=0 tx=0).stop 2023-11-28T13:02:07.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.814+0000 7f5529755700 1 -- 172.21.15.82:0/2842709587 shutdown_connections 2023-11-28T13:02:07.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.814+0000 7f5529755700 1 --2- 172.21.15.82:0/2842709587 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5510064ee0 0x7f5510067390 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.814+0000 7f5529755700 1 --2- 172.21.15.82:0/2842709587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55240b3910 0x7f5524149620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.814+0000 7f5529755700 1 --2- 172.21.15.82:0/2842709587 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5524070070 0x7f55240c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.814+0000 7f5529755700 1 --2- 172.21.15.82:0/2842709587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f552406b0a0 0x7f55241f3bf0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.814+0000 7f5529755700 1 -- 172.21.15.82:0/2842709587 >> 172.21.15.82:0/2842709587 conn(0x7f55240ce600 msgr2=0x7f55240b2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:07.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.814+0000 7f5529755700 1 -- 172.21.15.82:0/2842709587 shutdown_connections 2023-11-28T13:02:07.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.814+0000 7f5529755700 1 -- 172.21.15.82:0/2842709587 wait complete. 2023-11-28T13:02:07.821 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2023-11-28T13:02:07.830 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:02:07.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.942+0000 7f7a30b20700 1 Processor -- start 2023-11-28T13:02:07.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.942+0000 7f7a30b20700 1 -- start start 2023-11-28T13:02:07.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.942+0000 7f7a30b20700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7a2c158f00 0x7f7a2c06b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:07.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.942+0000 7f7a30b20700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2c0c9c30 con 0x7f7a2c0cac20 2023-11-28T13:02:07.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.942+0000 7f7a30b20700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2c06ae20 con 0x7f7a2c06c830 2023-11-28T13:02:07.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.942+0000 7f7a30b20700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a2c0ca790 con 0x7f7a2c158f00 2023-11-28T13:02:07.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.942+0000 7f7a2affd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7a2c0cac20 0x7f7a2c06a560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48450/0 (socket says 172.21.15.82:48450) 2023-11-28T13:02:07.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.942+0000 7f7a2b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7a2c158f00 0x7f7a2c06b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:07.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.942+0000 7f7a2affd700 1 -- 172.21.15.82:0/1580752037 learned_addr learned my addr 172.21.15.82:0/1580752037 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:07.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.942+0000 7f7a2b7fe700 1 -- 172.21.15.82:0/1580752037 >> v1:172.21.15.114:6789/0 conn(0x7f7a2c06c830 legacy=0x7f7a2c0ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:07.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.942+0000 7f7a2b7fe700 1 -- 172.21.15.82:0/1580752037 >> v1:172.21.15.82:6789/0 conn(0x7f7a2c0cac20 legacy=0x7f7a2c06a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:07.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.942+0000 7f7a2b7fe700 1 -- 172.21.15.82:0/1580752037 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c0cb070 con 0x7f7a2c158f00 2023-11-28T13:02:07.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.942+0000 7f7a2b7fe700 1 --2- 172.21.15.82:0/1580752037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2c158f00 0x7f7a2c06b1f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c009850 tx=0x7f7a1c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d26f302db9d276c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:07.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.942+0000 7f7a2a7fc700 1 -- 172.21.15.82:0/1580752037 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c00f8a0 con 0x7f7a2c158f00 2023-11-28T13:02:07.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.942+0000 7f7a2a7fc700 1 -- 172.21.15.82:0/1580752037 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c00fa00 con 0x7f7a2c158f00 2023-11-28T13:02:07.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.942+0000 7f7a2a7fc700 1 -- 172.21.15.82:0/1580752037 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c00fd90 con 0x7f7a2c158f00 2023-11-28T13:02:07.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.946+0000 7f7a30b20700 1 -- 172.21.15.82:0/1580752037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2c158f00 msgr2=0x7f7a2c06b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:07.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.946+0000 7f7a30b20700 1 --2- 172.21.15.82:0/1580752037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2c158f00 0x7f7a2c06b1f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c009850 tx=0x7f7a1c009b60 comp rx=0 tx=0).stop 2023-11-28T13:02:07.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.946+0000 7f7a30b20700 1 -- 172.21.15.82:0/1580752037 shutdown_connections 2023-11-28T13:02:07.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.946+0000 7f7a30b20700 1 --2- 172.21.15.82:0/1580752037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2c158f00 0x7f7a2c06b1f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.946+0000 7f7a30b20700 1 -- 172.21.15.82:0/1580752037 >> 172.21.15.82:0/1580752037 conn(0x7f7a2c0cb890 msgr2=0x7f7a2c0cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:07.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.946+0000 7f7a30b20700 1 -- 172.21.15.82:0/1580752037 shutdown_connections 2023-11-28T13:02:07.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.946+0000 7f7a30b20700 1 -- 172.21.15.82:0/1580752037 wait complete. 2023-11-28T13:02:07.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.946+0000 7f7a30b20700 1 Processor -- start 2023-11-28T13:02:07.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.946+0000 7f7a30b20700 1 -- start start 2023-11-28T13:02:07.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.946+0000 7f7a30b20700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2c06c830 0x7f7a2c1ecc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:07.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a30b20700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a2c0cac20 0x7f7a2c14de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:07.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a30b20700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a2c158f00 0x7f7a2c14e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:07.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a30b20700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c0b3f10 con 0x7f7a2c06c830 2023-11-28T13:02:07.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a30b20700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c0b3290 con 0x7f7a2c0cac20 2023-11-28T13:02:07.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a30b20700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c0b3570 con 0x7f7a2c158f00 2023-11-28T13:02:07.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a2b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2c06c830 0x7f7a2c1ecc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:07.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a2b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2c06c830 0x7f7a2c1ecc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49252/0 (socket says 172.21.15.82:49252) 2023-11-28T13:02:07.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a2b7fe700 1 -- 172.21.15.82:0/1442651318 learned_addr learned my addr 172.21.15.82:0/1442651318 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:07.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a2affd700 1 --2- 172.21.15.82:0/1442651318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a2c0cac20 0x7f7a2c14de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:07.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a2bfff700 1 --2- 172.21.15.82:0/1442651318 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a2c158f00 0x7f7a2c14e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:07.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a2b7fe700 1 -- 172.21.15.82:0/1442651318 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a2c158f00 msgr2=0x7f7a2c14e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:07.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a2b7fe700 1 --2- 172.21.15.82:0/1442651318 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a2c158f00 0x7f7a2c14e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a2b7fe700 1 -- 172.21.15.82:0/1442651318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a2c0cac20 msgr2=0x7f7a2c14de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:07.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a2b7fe700 1 --2- 172.21.15.82:0/1442651318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a2c0cac20 0x7f7a2c14de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:07.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a2b7fe700 1 -- 172.21.15.82:0/1442651318 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c0094b0 con 0x7f7a2c06c830 2023-11-28T13:02:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a2bfff700 1 --2- 172.21.15.82:0/1442651318 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a2c158f00 0x7f7a2c14e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:02:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a2b7fe700 1 --2- 172.21.15.82:0/1442651318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2c06c830 0x7f7a2c1ecc60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c06ff60 tx=0x7f7a1c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a13fff700 1 -- 172.21.15.82:0/1442651318 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c01e070 con 0x7f7a2c06c830 2023-11-28T13:02:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a13fff700 1 -- 172.21.15.82:0/1442651318 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c0036c0 con 0x7f7a2c06c830 2023-11-28T13:02:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a30b20700 1 -- 172.21.15.82:0/1442651318 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a2c0ca140 con 0x7f7a2c06c830 2023-11-28T13:02:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a13fff700 1 -- 172.21.15.82:0/1442651318 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c003a70 con 0x7f7a2c06c830 2023-11-28T13:02:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a30b20700 1 -- 172.21.15.82:0/1442651318 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2c0c9e60 con 0x7f7a2c06c830 2023-11-28T13:02:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a13fff700 1 -- 172.21.15.82:0/1442651318 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7a1c003bd0 con 0x7f7a2c06c830 2023-11-28T13:02:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a30b20700 1 -- 172.21.15.82:0/1442651318 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a2c0ca420 con 0x7f7a2c06c830 2023-11-28T13:02:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a13fff700 1 --2- 172.21.15.82:0/1442651318 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a18064ee0 0x7f7a18067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a2affd700 1 --2- 172.21.15.82:0/1442651318 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a18064ee0 0x7f7a18067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.950+0000 7f7a13fff700 1 -- 172.21.15.82:0/1442651318 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a1c085580 con 0x7f7a2c06c830 2023-11-28T13:02:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.954+0000 7f7a2affd700 1 --2- 172.21.15.82:0/1442651318 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a18064ee0 0x7f7a18067390 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c1f0940 tx=0x7f7a20009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:07.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:07.958+0000 7f7a13fff700 1 -- 172.21.15.82:0/1442651318 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7a1c053720 con 0x7f7a2c06c830 2023-11-28T13:02:08.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.122+0000 7f7a30b20700 1 -- 172.21.15.82:0/1442651318 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a2c065fc0 con 0x7f7a2c06c830 2023-11-28T13:02:08.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.122+0000 7f7a13fff700 1 -- 172.21.15.82:0/1442651318 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+17883 (secure 0 0 0) 0x7f7a1c003e60 con 0x7f7a2c06c830 2023-11-28T13:02:08.126 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:08.127 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":38,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:01:30.589673+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:01:27.651123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T13:01:28.580057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:02:08.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.126+0000 7f7a30b20700 1 -- 172.21.15.82:0/1442651318 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a18064ee0 msgr2=0x7f7a18067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:08.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.126+0000 7f7a30b20700 1 --2- 172.21.15.82:0/1442651318 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a18064ee0 0x7f7a18067390 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c1f0940 tx=0x7f7a20009040 comp rx=0 tx=0).stop 2023-11-28T13:02:08.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.126+0000 7f7a30b20700 1 -- 172.21.15.82:0/1442651318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2c06c830 msgr2=0x7f7a2c1ecc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:08.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.126+0000 7f7a30b20700 1 --2- 172.21.15.82:0/1442651318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2c06c830 0x7f7a2c1ecc60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c06ff60 tx=0x7f7a1c004770 comp rx=0 tx=0).stop 2023-11-28T13:02:08.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.126+0000 7f7a30b20700 1 -- 172.21.15.82:0/1442651318 shutdown_connections 2023-11-28T13:02:08.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.126+0000 7f7a30b20700 1 --2- 172.21.15.82:0/1442651318 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a18064ee0 0x7f7a18067390 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.126+0000 7f7a30b20700 1 --2- 172.21.15.82:0/1442651318 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a2c158f00 0x7f7a2c14e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.126+0000 7f7a30b20700 1 --2- 172.21.15.82:0/1442651318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a2c0cac20 0x7f7a2c14de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.126+0000 7f7a30b20700 1 --2- 172.21.15.82:0/1442651318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a2c06c830 0x7f7a2c1ecc60 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.126+0000 7f7a30b20700 1 -- 172.21.15.82:0/1442651318 >> 172.21.15.82:0/1442651318 conn(0x7f7a2c0cb890 msgr2=0x7f7a2c1584d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:08.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.126+0000 7f7a30b20700 1 -- 172.21.15.82:0/1442651318 shutdown_connections 2023-11-28T13:02:08.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.126+0000 7f7a30b20700 1 -- 172.21.15.82:0/1442651318 wait complete. 2023-11-28T13:02:08.140 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T13:02:08.141 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:02:08.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf6411700 1 Processor -- start 2023-11-28T13:02:08.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf6411700 1 -- start start 2023-11-28T13:02:08.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf6411700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdaf006d980 0x7fdaf00cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:08.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf6411700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdaf006cfa0 0x7fdaf0069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:08.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf6411700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf006d780 con 0x7fdaf0070070 2023-11-28T13:02:08.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf6411700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf006cb10 con 0x7fdaf006cfa0 2023-11-28T13:02:08.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf6411700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf006ddf0 con 0x7fdaf006d980 2023-11-28T13:02:08.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf5c10700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdaf006cfa0 0x7fdaf0069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf5c10700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdaf006cfa0 0x7fdaf0069bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49266/0 (socket says 172.21.15.82:49266) 2023-11-28T13:02:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf5c10700 1 -- 172.21.15.82:0/2761792979 learned_addr learned my addr 172.21.15.82:0/2761792979 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf4c0e700 1 --2- 172.21.15.82:0/2761792979 >> v2:172.21.15.114:3300/0 conn(0x7fdaf006d980 0x7fdaf00cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf5c10700 1 -- 172.21.15.82:0/2761792979 >> v2:172.21.15.114:3300/0 conn(0x7fdaf006d980 msgr2=0x7fdaf00cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf5c10700 1 --2- 172.21.15.82:0/2761792979 >> v2:172.21.15.114:3300/0 conn(0x7fdaf006d980 0x7fdaf00cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf5c10700 1 -- 172.21.15.82:0/2761792979 >> v1:172.21.15.114:6789/0 conn(0x7fdaf0070070 legacy=0x7fdaf0070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf5c10700 1 -- 172.21.15.82:0/2761792979 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf00ce030 con 0x7fdaf006cfa0 2023-11-28T13:02:08.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf5c10700 1 --2- 172.21.15.82:0/2761792979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf006cfa0 0x7fdaf0069bc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdaf00cb050 tx=0x7fdae800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5a89f9f2c72cf3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:08.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdae7fff700 1 -- 172.21.15.82:0/2761792979 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae800e070 con 0x7fdaf006cfa0 2023-11-28T13:02:08.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdae7fff700 1 -- 172.21.15.82:0/2761792979 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae800b910 con 0x7fdaf006cfa0 2023-11-28T13:02:08.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdae7fff700 1 -- 172.21.15.82:0/2761792979 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae800bcc0 con 0x7fdaf006cfa0 2023-11-28T13:02:08.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf6411700 1 -- 172.21.15.82:0/2761792979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf006cfa0 msgr2=0x7fdaf0069bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:08.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf6411700 1 --2- 172.21.15.82:0/2761792979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf006cfa0 0x7fdaf0069bc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdaf00cb050 tx=0x7fdae800b330 comp rx=0 tx=0).stop 2023-11-28T13:02:08.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf6411700 1 -- 172.21.15.82:0/2761792979 shutdown_connections 2023-11-28T13:02:08.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf6411700 1 --2- 172.21.15.82:0/2761792979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf006cfa0 0x7fdaf0069bc0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf6411700 1 --2- 172.21.15.82:0/2761792979 >> v2:172.21.15.114:3300/0 conn(0x7fdaf006d980 0x7fdaf00cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf6411700 1 -- 172.21.15.82:0/2761792979 >> 172.21.15.82:0/2761792979 conn(0x7fdaf00ce600 msgr2=0x7fdaf00ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:08.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf6411700 1 -- 172.21.15.82:0/2761792979 shutdown_connections 2023-11-28T13:02:08.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.250+0000 7fdaf6411700 1 -- 172.21.15.82:0/2761792979 wait complete. 2023-11-28T13:02:08.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.254+0000 7fdaf6411700 1 Processor -- start 2023-11-28T13:02:08.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.254+0000 7fdaf6411700 1 -- start start 2023-11-28T13:02:08.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdaf6411700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf006cfa0 0x7fdaf015d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:08.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdaf6411700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdaf006d980 0x7fdaf014a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:08.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdaf6411700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdaf0070070 0x7fdaf015e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:08.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdaf6411700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf015d220 con 0x7fdaf006cfa0 2023-11-28T13:02:08.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdaf6411700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf015c610 con 0x7fdaf006d980 2023-11-28T13:02:08.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdaf6411700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf015c8f0 con 0x7fdaf0070070 2023-11-28T13:02:08.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdaf540f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf006cfa0 0x7fdaf015d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:08.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdaf540f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf006cfa0 0x7fdaf015d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49282/0 (socket says 172.21.15.82:49282) 2023-11-28T13:02:08.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdaf540f700 1 -- 172.21.15.82:0/476880946 learned_addr learned my addr 172.21.15.82:0/476880946 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:08.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdaf4c0e700 1 --2- 172.21.15.82:0/476880946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdaf006d980 0x7fdaf014a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:08.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdaf5c10700 1 --2- 172.21.15.82:0/476880946 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdaf0070070 0x7fdaf015e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:08.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdaf540f700 1 -- 172.21.15.82:0/476880946 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdaf0070070 msgr2=0x7fdaf015e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:08.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdaf540f700 1 --2- 172.21.15.82:0/476880946 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdaf0070070 0x7fdaf015e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdaf540f700 1 -- 172.21.15.82:0/476880946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdaf006d980 msgr2=0x7fdaf014a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:08.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdaf540f700 1 --2- 172.21.15.82:0/476880946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdaf006d980 0x7fdaf014a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdaf540f700 1 -- 172.21.15.82:0/476880946 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae8009b30 con 0x7fdaf006cfa0 2023-11-28T13:02:08.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdaf4c0e700 1 --2- 172.21.15.82:0/476880946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdaf006d980 0x7fdaf014a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:08.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdaf540f700 1 --2- 172.21.15.82:0/476880946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf006cfa0 0x7fdaf015d6b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fdaec00c410 tx=0x7fdaec00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:08.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdae5ffb700 1 -- 172.21.15.82:0/476880946 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec0052d0 con 0x7fdaf006cfa0 2023-11-28T13:02:08.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdae5ffb700 1 -- 172.21.15.82:0/476880946 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec005430 con 0x7fdaf006cfa0 2023-11-28T13:02:08.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdaf6411700 1 -- 172.21.15.82:0/476880946 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf00cc710 con 0x7fdaf006cfa0 2023-11-28T13:02:08.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdae5ffb700 1 -- 172.21.15.82:0/476880946 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec0055a0 con 0x7fdaf006cfa0 2023-11-28T13:02:08.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.258+0000 7fdaf6411700 1 -- 172.21.15.82:0/476880946 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf00ce310 con 0x7fdaf006cfa0 2023-11-28T13:02:08.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.262+0000 7fdaf6411700 1 -- 172.21.15.82:0/476880946 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf00cdc50 con 0x7fdaf006cfa0 2023-11-28T13:02:08.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.262+0000 7fdae5ffb700 1 -- 172.21.15.82:0/476880946 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdaec010050 con 0x7fdaf006cfa0 2023-11-28T13:02:08.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.262+0000 7fdae5ffb700 1 --2- 172.21.15.82:0/476880946 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdad4064ee0 0x7fdad4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:08.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.262+0000 7fdae5ffb700 1 -- 172.21.15.82:0/476880946 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdaec081000 con 0x7fdaf006cfa0 2023-11-28T13:02:08.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.262+0000 7fdaf4c0e700 1 --2- 172.21.15.82:0/476880946 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdad4064ee0 0x7fdad4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:08.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.262+0000 7fdaf4c0e700 1 --2- 172.21.15.82:0/476880946 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdad4064ee0 0x7fdad4067390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdaf00c42f0 tx=0x7fdae0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:08.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.270+0000 7fdae5ffb700 1 -- 172.21.15.82:0/476880946 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdaec049400 con 0x7fdaf006cfa0 2023-11-28T13:02:08.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.466+0000 7fdaf6411700 1 -- 172.21.15.82:0/476880946 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdaf0065fc0 con 0x7fdaf006cfa0 2023-11-28T13:02:08.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.466+0000 7fdae5ffb700 1 -- 172.21.15.82:0/476880946 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4651 (secure 0 0 0) 0x7fdaec04f140 con 0x7fdaf006cfa0 2023-11-28T13:02:08.471 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:08.471 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2975361458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2975361458},{"type":"v1","addr":"172.21.15.114:6833","nonce":2975361458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3412196002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3412196002},{"type":"v1","addr":"172.21.15.114:6835","nonce":3412196002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/167093290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":167093290},{"type":"v1","addr":"172.21.15.82:6835","nonce":167093290}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:01:29.585949+0000","modified":"2023-11-28T13:01:32.836050+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/3448846386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3448846386},{"type":"v1","addr":"172.21.15.82:6837","nonce":3448846386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T13:02:08.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.470+0000 7fdaf6411700 1 -- 172.21.15.82:0/476880946 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdad4064ee0 msgr2=0x7fdad4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:08.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.470+0000 7fdaf6411700 1 --2- 172.21.15.82:0/476880946 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdad4064ee0 0x7fdad4067390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdaf00c42f0 tx=0x7fdae0008040 comp rx=0 tx=0).stop 2023-11-28T13:02:08.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.470+0000 7fdaf6411700 1 -- 172.21.15.82:0/476880946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf006cfa0 msgr2=0x7fdaf015d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:08.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.470+0000 7fdaf6411700 1 --2- 172.21.15.82:0/476880946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf006cfa0 0x7fdaf015d6b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fdaec00c410 tx=0x7fdaec00c7d0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.470+0000 7fdaf6411700 1 -- 172.21.15.82:0/476880946 shutdown_connections 2023-11-28T13:02:08.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.470+0000 7fdaf6411700 1 --2- 172.21.15.82:0/476880946 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdad4064ee0 0x7fdad4067390 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.470+0000 7fdaf6411700 1 --2- 172.21.15.82:0/476880946 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdaf0070070 0x7fdaf015e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.470+0000 7fdaf6411700 1 --2- 172.21.15.82:0/476880946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdaf006d980 0x7fdaf014a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.470+0000 7fdaf6411700 1 --2- 172.21.15.82:0/476880946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf006cfa0 0x7fdaf015d6b0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.470+0000 7fdaf6411700 1 -- 172.21.15.82:0/476880946 >> 172.21.15.82:0/476880946 conn(0x7fdaf00ce600 msgr2=0x7fdaf0070440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:08.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.470+0000 7fdaf6411700 1 -- 172.21.15.82:0/476880946 shutdown_connections 2023-11-28T13:02:08.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.470+0000 7fdaf6411700 1 -- 172.21.15.82:0/476880946 wait complete. 2023-11-28T13:02:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2023-11-28T13:02:08.485 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:02:08.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.590+0000 7f06c6ab3700 1 Processor -- start 2023-11-28T13:02:08.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.590+0000 7f06c6ab3700 1 -- start start 2023-11-28T13:02:08.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.590+0000 7f06c6ab3700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06c00cca60 0x7f06c00cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:08.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.590+0000 7f06c6ab3700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f06c00b1490 0x7f06c0159650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:08.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.590+0000 7f06c6ab3700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c0156630 con 0x7f06c006cdd0 2023-11-28T13:02:08.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.590+0000 7f06c6ab3700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c015cfc0 con 0x7f06c00b1490 2023-11-28T13:02:08.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.590+0000 7f06c6ab3700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00cd370 con 0x7f06c00cca60 2023-11-28T13:02:08.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.594+0000 7f06c52b0700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f06c00b1490 0x7f06c0159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:08.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.594+0000 7f06c52b0700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f06c00b1490 0x7f06c0159650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:55094/0 (socket says 172.21.15.82:55094) 2023-11-28T13:02:08.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.594+0000 7f06c52b0700 1 -- 172.21.15.82:0/2827179196 learned_addr learned my addr 172.21.15.82:0/2827179196 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:08.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.594+0000 7f06c5ab1700 1 --2- 172.21.15.82:0/2827179196 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06c00cca60 0x7f06c00cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:08.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.594+0000 7f06c52b0700 1 -- 172.21.15.82:0/2827179196 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06c00cca60 msgr2=0x7f06c00cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:08.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.594+0000 7f06c52b0700 1 --2- 172.21.15.82:0/2827179196 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06c00cca60 0x7f06c00cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.594+0000 7f06c52b0700 1 -- 172.21.15.82:0/2827179196 >> v1:172.21.15.114:6789/0 conn(0x7f06c006cdd0 legacy=0x7f06c006d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:08.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.594+0000 7f06c52b0700 1 -- 172.21.15.82:0/2827179196 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c0159b90 con 0x7f06c00b1490 2023-11-28T13:02:08.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.594+0000 7f06c52b0700 1 --2- 172.21.15.82:0/2827179196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06c00b1490 0x7f06c0159650 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f06bc009910 tx=0x7f06bc009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a05fe2f1ecdbe000 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:08.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.594+0000 7f06c4aaf700 1 -- 172.21.15.82:0/2827179196 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc011830 con 0x7f06c00b1490 2023-11-28T13:02:08.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.594+0000 7f06c4aaf700 1 -- 172.21.15.82:0/2827179196 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06bc011990 con 0x7f06c00b1490 2023-11-28T13:02:08.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.594+0000 7f06c4aaf700 1 -- 172.21.15.82:0/2827179196 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc011d40 con 0x7f06c00b1490 2023-11-28T13:02:08.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.594+0000 7f06c6ab3700 1 -- 172.21.15.82:0/2827179196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06c00b1490 msgr2=0x7f06c0159650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:08.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.594+0000 7f06c6ab3700 1 --2- 172.21.15.82:0/2827179196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06c00b1490 0x7f06c0159650 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f06bc009910 tx=0x7f06bc009c20 comp rx=0 tx=0).stop 2023-11-28T13:02:08.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.594+0000 7f06c6ab3700 1 -- 172.21.15.82:0/2827179196 shutdown_connections 2023-11-28T13:02:08.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.594+0000 7f06c6ab3700 1 --2- 172.21.15.82:0/2827179196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06c00b1490 0x7f06c0159650 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.594+0000 7f06c6ab3700 1 --2- 172.21.15.82:0/2827179196 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06c00cca60 0x7f06c00cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.594+0000 7f06c6ab3700 1 -- 172.21.15.82:0/2827179196 >> 172.21.15.82:0/2827179196 conn(0x7f06c00cfb20 msgr2=0x7f06c00b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:08.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.594+0000 7f06c6ab3700 1 -- 172.21.15.82:0/2827179196 shutdown_connections 2023-11-28T13:02:08.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.594+0000 7f06c6ab3700 1 -- 172.21.15.82:0/2827179196 wait complete. 2023-11-28T13:02:08.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.598+0000 7f06c6ab3700 1 Processor -- start 2023-11-28T13:02:08.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.598+0000 7f06c6ab3700 1 -- start start 2023-11-28T13:02:08.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06c6ab3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06c006cdd0 0x7f06c0158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:08.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06c6ab3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06c00b1490 0x7f06c014a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:08.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06c6ab3700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06c00cca60 0x7f06c00c50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:08.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06c6ab3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c0158740 con 0x7f06c006cdd0 2023-11-28T13:02:08.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06c6ab3700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c0157b30 con 0x7f06c00b1490 2023-11-28T13:02:08.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06c6ab3700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c0157e10 con 0x7f06c00cca60 2023-11-28T13:02:08.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06c5ab1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06c006cdd0 0x7f06c0158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:08.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06c5ab1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06c006cdd0 0x7f06c0158bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49296/0 (socket says 172.21.15.82:49296) 2023-11-28T13:02:08.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06c5ab1700 1 -- 172.21.15.82:0/588955361 learned_addr learned my addr 172.21.15.82:0/588955361 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:08.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06c52b0700 1 --2- 172.21.15.82:0/588955361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06c00b1490 0x7f06c014a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:08.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06c62b2700 1 --2- 172.21.15.82:0/588955361 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06c00cca60 0x7f06c00c50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:08.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06c5ab1700 1 -- 172.21.15.82:0/588955361 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06c00cca60 msgr2=0x7f06c00c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:08.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06c5ab1700 1 --2- 172.21.15.82:0/588955361 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06c00cca60 0x7f06c00c50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06c5ab1700 1 -- 172.21.15.82:0/588955361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06c00b1490 msgr2=0x7f06c014a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:08.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06c5ab1700 1 --2- 172.21.15.82:0/588955361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06c00b1490 0x7f06c014a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06c5ab1700 1 -- 172.21.15.82:0/588955361 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06bc009570 con 0x7f06c006cdd0 2023-11-28T13:02:08.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06c62b2700 1 --2- 172.21.15.82:0/588955361 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06c00cca60 0x7f06c00c50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:08.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06c5ab1700 1 --2- 172.21.15.82:0/588955361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06c006cdd0 0x7f06c0158bd0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f06b000e9d0 tx=0x7f06b000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:08.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06b67fc700 1 -- 172.21.15.82:0/588955361 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0009720 con 0x7f06c006cdd0 2023-11-28T13:02:08.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06b67fc700 1 -- 172.21.15.82:0/588955361 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b000c850 con 0x7f06c006cdd0 2023-11-28T13:02:08.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06c6ab3700 1 -- 172.21.15.82:0/588955361 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c015c620 con 0x7f06c006cdd0 2023-11-28T13:02:08.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06b67fc700 1 -- 172.21.15.82:0/588955361 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b000cbc0 con 0x7f06c006cdd0 2023-11-28T13:02:08.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06c6ab3700 1 -- 172.21.15.82:0/588955361 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c015c340 con 0x7f06c006cdd0 2023-11-28T13:02:08.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.602+0000 7f06c6ab3700 1 -- 172.21.15.82:0/588955361 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c015c900 con 0x7f06c006cdd0 2023-11-28T13:02:08.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.606+0000 7f06b67fc700 1 -- 172.21.15.82:0/588955361 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f06b0019030 con 0x7f06c006cdd0 2023-11-28T13:02:08.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.606+0000 7f06b67fc700 1 --2- 172.21.15.82:0/588955361 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f06a4064ee0 0x7f06a4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:08.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.606+0000 7f06b67fc700 1 -- 172.21.15.82:0/588955361 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f06b0081f40 con 0x7f06c006cdd0 2023-11-28T13:02:08.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.606+0000 7f06c52b0700 1 --2- 172.21.15.82:0/588955361 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f06a4064ee0 0x7f06a4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:08.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.606+0000 7f06c52b0700 1 --2- 172.21.15.82:0/588955361 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f06a4064ee0 0x7f06a4067390 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f06bc000c00 tx=0x7f06bc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:08.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.614+0000 7f06b67fc700 1 -- 172.21.15.82:0/588955361 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f06b004fff0 con 0x7f06c006cdd0 2023-11-28T13:02:08.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.810+0000 7f06c6ab3700 1 -- 172.21.15.82:0/588955361 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06c0065fc0 con 0x7f06c006cdd0 2023-11-28T13:02:08.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.810+0000 7f06b67fc700 1 -- 172.21.15.82:0/588955361 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f06b0053610 con 0x7f06c006cdd0 2023-11-28T13:02:08.814 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:08.814 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2975361458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2975361458},{"type":"v1","addr":"172.21.15.114:6833","nonce":2975361458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3412196002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3412196002},{"type":"v1","addr":"172.21.15.114:6835","nonce":3412196002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/167093290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":167093290},{"type":"v1","addr":"172.21.15.82:6835","nonce":167093290}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:01:29.585949+0000","modified":"2023-11-28T13:01:32.836050+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/3448846386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3448846386},{"type":"v1","addr":"172.21.15.82:6837","nonce":3448846386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T13:02:08.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.814+0000 7f06c6ab3700 1 -- 172.21.15.82:0/588955361 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f06a4064ee0 msgr2=0x7f06a4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:08.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.814+0000 7f06c6ab3700 1 --2- 172.21.15.82:0/588955361 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f06a4064ee0 0x7f06a4067390 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f06bc000c00 tx=0x7f06bc008030 comp rx=0 tx=0).stop 2023-11-28T13:02:08.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.814+0000 7f06c6ab3700 1 -- 172.21.15.82:0/588955361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06c006cdd0 msgr2=0x7f06c0158bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:08.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.814+0000 7f06c6ab3700 1 --2- 172.21.15.82:0/588955361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06c006cdd0 0x7f06c0158bd0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f06b000e9d0 tx=0x7f06b000ece0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.814+0000 7f06c6ab3700 1 -- 172.21.15.82:0/588955361 shutdown_connections 2023-11-28T13:02:08.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.814+0000 7f06c6ab3700 1 --2- 172.21.15.82:0/588955361 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f06a4064ee0 0x7f06a4067390 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.814+0000 7f06c6ab3700 1 --2- 172.21.15.82:0/588955361 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06c00cca60 0x7f06c00c50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.814+0000 7f06c6ab3700 1 --2- 172.21.15.82:0/588955361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06c00b1490 0x7f06c014a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.814+0000 7f06c6ab3700 1 --2- 172.21.15.82:0/588955361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06c006cdd0 0x7f06c0158bd0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.814+0000 7f06c6ab3700 1 -- 172.21.15.82:0/588955361 >> 172.21.15.82:0/588955361 conn(0x7f06c00cfb20 msgr2=0x7f06c015b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:08.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.814+0000 7f06c6ab3700 1 -- 172.21.15.82:0/588955361 shutdown_connections 2023-11-28T13:02:08.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.814+0000 7f06c6ab3700 1 -- 172.21.15.82:0/588955361 wait complete. 2023-11-28T13:02:08.818 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2023-11-28T13:02:08.833 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:02:08.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.934+0000 7fb77bfff700 1 Processor -- start 2023-11-28T13:02:08.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.934+0000 7fb77bfff700 1 -- start start 2023-11-28T13:02:08.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.934+0000 7fb77bfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb77c0c93d0 0x7fb77c070730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:08.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.934+0000 7fb77bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb77c070c70 0x7fb77c06ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:08.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.934+0000 7fb77bfff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77c06a9d0 con 0x7fb77c158760 2023-11-28T13:02:08.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.934+0000 7fb77bfff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77c071110 con 0x7fb77c070c70 2023-11-28T13:02:08.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.934+0000 7fb77bfff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c06a450 con 0x7fb77c0c93d0 2023-11-28T13:02:08.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.934+0000 7fb77affd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb77c158760 0x7fb77c15c1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48454/0 (socket says 172.21.15.82:48454) 2023-11-28T13:02:08.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.934+0000 7fb77affd700 1 -- 172.21.15.82:0/348875655 learned_addr learned my addr 172.21.15.82:0/348875655 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:08.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.934+0000 7fb77b7fe700 1 --2- 172.21.15.82:0/348875655 >> v2:172.21.15.82:3300/0 conn(0x7fb77c070c70 0x7fb77c06ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:08.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.934+0000 7fb77a7fc700 1 --2- 172.21.15.82:0/348875655 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb77c0c93d0 0x7fb77c070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:08.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb779ffb700 1 -- 172.21.15.82:0/348875655 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2986303015 0 0) 0x7fb77c06a9d0 con 0x7fb77c158760 2023-11-28T13:02:08.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb779ffb700 1 -- 172.21.15.82:0/348875655 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7640035d0 con 0x7fb77c158760 2023-11-28T13:02:08.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb77b7fe700 1 -- 172.21.15.82:0/348875655 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb77c0c93d0 msgr2=0x7fb77c070730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:08.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb77b7fe700 1 --2- 172.21.15.82:0/348875655 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb77c0c93d0 0x7fb77c070730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb77b7fe700 1 -- 172.21.15.82:0/348875655 >> v1:172.21.15.82:6789/0 conn(0x7fb77c158760 legacy=0x7fb77c15c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:08.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb77b7fe700 1 -- 172.21.15.82:0/348875655 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c15cc50 con 0x7fb77c070c70 2023-11-28T13:02:08.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb77b7fe700 1 --2- 172.21.15.82:0/348875655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb77c070c70 0x7fb77c06ae60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb774009d90 tx=0x7fb77400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777df487fe8c0a20 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:08.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb779ffb700 1 -- 172.21.15.82:0/348875655 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77400e070 con 0x7fb77c070c70 2023-11-28T13:02:08.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb779ffb700 1 -- 172.21.15.82:0/348875655 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77400bd20 con 0x7fb77c070c70 2023-11-28T13:02:08.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb779ffb700 1 -- 172.21.15.82:0/348875655 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7740128e0 con 0x7fb77c070c70 2023-11-28T13:02:08.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb77bfff700 1 -- 172.21.15.82:0/348875655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb77c070c70 msgr2=0x7fb77c06ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:08.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb77bfff700 1 --2- 172.21.15.82:0/348875655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb77c070c70 0x7fb77c06ae60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb774009d90 tx=0x7fb77400b330 comp rx=0 tx=0).stop 2023-11-28T13:02:08.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb77bfff700 1 -- 172.21.15.82:0/348875655 shutdown_connections 2023-11-28T13:02:08.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb77bfff700 1 --2- 172.21.15.82:0/348875655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb77c070c70 0x7fb77c06ae60 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb77bfff700 1 --2- 172.21.15.82:0/348875655 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb77c0c93d0 0x7fb77c070730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb77bfff700 1 -- 172.21.15.82:0/348875655 >> 172.21.15.82:0/348875655 conn(0x7fb77c0cb890 msgr2=0x7fb77c0cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:08.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb77bfff700 1 -- 172.21.15.82:0/348875655 shutdown_connections 2023-11-28T13:02:08.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb77bfff700 1 -- 172.21.15.82:0/348875655 wait complete. 2023-11-28T13:02:08.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb77bfff700 1 Processor -- start 2023-11-28T13:02:08.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb77bfff700 1 -- start start 2023-11-28T13:02:08.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb77bfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb77c070c70 0x7fb77c14e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:08.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb77bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb77c0c93d0 0x7fb77c159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:08.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb77bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb77c158760 0x7fb77c1f0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:08.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb77bfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c0c2870 con 0x7fb77c158760 2023-11-28T13:02:08.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb77bfff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c14eb90 con 0x7fb77c0c93d0 2023-11-28T13:02:08.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.938+0000 7fb77bfff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c1527a0 con 0x7fb77c070c70 2023-11-28T13:02:08.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb77b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb77c158760 0x7fb77c1f0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:08.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb77b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb77c158760 0x7fb77c1f0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49318/0 (socket says 172.21.15.82:49318) 2023-11-28T13:02:08.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb77b7fe700 1 -- 172.21.15.82:0/314015873 learned_addr learned my addr 172.21.15.82:0/314015873 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:08.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb77affd700 1 --2- 172.21.15.82:0/314015873 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb77c070c70 0x7fb77c14e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:08.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb77a7fc700 1 --2- 172.21.15.82:0/314015873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb77c0c93d0 0x7fb77c159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:08.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb77b7fe700 1 -- 172.21.15.82:0/314015873 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb77c070c70 msgr2=0x7fb77c14e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:08.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb77b7fe700 1 --2- 172.21.15.82:0/314015873 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb77c070c70 0x7fb77c14e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb77b7fe700 1 -- 172.21.15.82:0/314015873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb77c0c93d0 msgr2=0x7fb77c159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:08.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb77b7fe700 1 --2- 172.21.15.82:0/314015873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb77c0c93d0 0x7fb77c159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:08.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb77b7fe700 1 -- 172.21.15.82:0/314015873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb774009a70 con 0x7fb77c158760 2023-11-28T13:02:08.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb77a7fc700 1 --2- 172.21.15.82:0/314015873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb77c0c93d0 0x7fb77c159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:08.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb77b7fe700 1 --2- 172.21.15.82:0/314015873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb77c158760 0x7fb77c1f0660 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb77c06ff60 tx=0x7fb774004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:08.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb7637fe700 1 -- 172.21.15.82:0/314015873 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77401f030 con 0x7fb77c158760 2023-11-28T13:02:08.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb7637fe700 1 -- 172.21.15.82:0/314015873 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77400be90 con 0x7fb77c158760 2023-11-28T13:02:08.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb77bfff700 1 -- 172.21.15.82:0/314015873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77c06a660 con 0x7fb77c158760 2023-11-28T13:02:08.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb7637fe700 1 -- 172.21.15.82:0/314015873 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77400e070 con 0x7fb77c158760 2023-11-28T13:02:08.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb77bfff700 1 -- 172.21.15.82:0/314015873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77c15cf30 con 0x7fb77c158760 2023-11-28T13:02:08.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb77bfff700 1 -- 172.21.15.82:0/314015873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77c0cb510 con 0x7fb77c158760 2023-11-28T13:02:08.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb7637fe700 1 -- 172.21.15.82:0/314015873 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb7740044b0 con 0x7fb77c158760 2023-11-28T13:02:08.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb7637fe700 1 --2- 172.21.15.82:0/314015873 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb768064f10 0x7fb7680673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:08.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb7637fe700 1 -- 172.21.15.82:0/314015873 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fb7740879f0 con 0x7fb77c158760 2023-11-28T13:02:08.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.942+0000 7fb77affd700 1 --2- 172.21.15.82:0/314015873 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb768064f10 0x7fb7680673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:08.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.946+0000 7fb77affd700 1 --2- 172.21.15.82:0/314015873 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb768064f10 0x7fb7680673c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb76c005930 tx=0x7fb76c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:08.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:08.950+0000 7fb7637fe700 1 -- 172.21.15.82:0/314015873 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb774089e60 con 0x7fb77c158760 2023-11-28T13:02:09.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.114+0000 7fb77bfff700 1 -- 172.21.15.82:0/314015873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb77c065fc0 con 0x7fb77c158760 2023-11-28T13:02:09.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.114+0000 7fb7637fe700 1 -- 172.21.15.82:0/314015873 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+17876 (secure 0 0 0) 0x7fb774055b70 con 0x7fb77c158760 2023-11-28T13:02:09.118 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:09.118 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":39,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:02:08.904162+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:01:27.651123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T13:01:28.580057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.39","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:02:09.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.118+0000 7fb77bfff700 1 -- 172.21.15.82:0/314015873 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb768064f10 msgr2=0x7fb7680673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:09.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.118+0000 7fb77bfff700 1 --2- 172.21.15.82:0/314015873 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb768064f10 0x7fb7680673c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb76c005930 tx=0x7fb76c009040 comp rx=0 tx=0).stop 2023-11-28T13:02:09.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.118+0000 7fb77bfff700 1 -- 172.21.15.82:0/314015873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb77c158760 msgr2=0x7fb77c1f0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:09.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.118+0000 7fb77bfff700 1 --2- 172.21.15.82:0/314015873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb77c158760 0x7fb77c1f0660 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb77c06ff60 tx=0x7fb774004af0 comp rx=0 tx=0).stop 2023-11-28T13:02:09.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.118+0000 7fb77bfff700 1 -- 172.21.15.82:0/314015873 shutdown_connections 2023-11-28T13:02:09.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.118+0000 7fb77bfff700 1 --2- 172.21.15.82:0/314015873 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb768064f10 0x7fb7680673c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:09.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.118+0000 7fb77bfff700 1 --2- 172.21.15.82:0/314015873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb77c158760 0x7fb77c1f0660 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:09.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.118+0000 7fb77bfff700 1 --2- 172.21.15.82:0/314015873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb77c0c93d0 0x7fb77c159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:09.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.118+0000 7fb77bfff700 1 --2- 172.21.15.82:0/314015873 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb77c070c70 0x7fb77c14e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:09.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.118+0000 7fb77bfff700 1 -- 172.21.15.82:0/314015873 >> 172.21.15.82:0/314015873 conn(0x7fb77c0cb890 msgr2=0x7fb77c0c9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:09.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.118+0000 7fb77bfff700 1 -- 172.21.15.82:0/314015873 shutdown_connections 2023-11-28T13:02:09.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.118+0000 7fb77bfff700 1 -- 172.21.15.82:0/314015873 wait complete. 2023-11-28T13:02:09.133 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T13:02:09.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.246+0000 7f7eeb59e700 1 Processor -- start 2023-11-28T13:02:09.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.246+0000 7f7eeb59e700 1 -- start start 2023-11-28T13:02:09.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.246+0000 7f7eeb59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7eec070780 0x7f7eec15d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:09.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.246+0000 7f7eeb59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eec15da50 con 0x7f7eec1591c0 2023-11-28T13:02:09.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.246+0000 7f7eeb59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eec0c9e20 con 0x7f7eec158df0 2023-11-28T13:02:09.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.246+0000 7f7eeb59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eec0cc640 con 0x7f7eec070780 2023-11-28T13:02:09.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.250+0000 7f7ee9d9b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7eec1591c0 0x7f7eec070070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48462/0 (socket says 172.21.15.82:48462) 2023-11-28T13:02:09.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.250+0000 7f7ee9d9b700 1 -- 172.21.15.82:0/184025957 learned_addr learned my addr 172.21.15.82:0/184025957 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:09.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.250+0000 7f7eead9d700 1 --2- 172.21.15.82:0/184025957 >> v2:172.21.15.82:3300/0 conn(0x7f7eec070780 0x7f7eec15d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:09.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.250+0000 7f7ee959a700 1 -- 172.21.15.82:0/184025957 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146685586 0 0) 0x7f7edc001110 con 0x7f7eec1591c0 2023-11-28T13:02:09.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.250+0000 7f7ee959a700 1 -- 172.21.15.82:0/184025957 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ed40035d0 con 0x7f7eec1591c0 2023-11-28T13:02:09.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.250+0000 7f7eead9d700 1 -- 172.21.15.82:0/184025957 >> v1:172.21.15.114:6789/0 conn(0x7f7eec158df0 legacy=0x7f7eec06c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:09.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.250+0000 7f7eead9d700 1 -- 172.21.15.82:0/184025957 >> v1:172.21.15.82:6789/0 conn(0x7f7eec1591c0 legacy=0x7f7eec070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:09.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.250+0000 7f7eead9d700 1 -- 172.21.15.82:0/184025957 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec0c97d0 con 0x7f7eec070780 2023-11-28T13:02:09.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.250+0000 7f7eead9d700 1 --2- 172.21.15.82:0/184025957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec070780 0x7f7eec15d510 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009d90 tx=0x7f7ee400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2331cd8b28943294 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:09.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.250+0000 7f7ee959a700 1 -- 172.21.15.82:0/184025957 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee400e070 con 0x7f7eec070780 2023-11-28T13:02:09.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.250+0000 7f7ee959a700 1 -- 172.21.15.82:0/184025957 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee400bb20 con 0x7f7eec070780 2023-11-28T13:02:09.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.250+0000 7f7ee959a700 1 -- 172.21.15.82:0/184025957 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4012430 con 0x7f7eec070780 2023-11-28T13:02:09.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.250+0000 7f7eeb59e700 1 -- 172.21.15.82:0/184025957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec070780 msgr2=0x7f7eec15d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:09.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.250+0000 7f7eeb59e700 1 --2- 172.21.15.82:0/184025957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec070780 0x7f7eec15d510 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009d90 tx=0x7f7ee400b330 comp rx=0 tx=0).stop 2023-11-28T13:02:09.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.250+0000 7f7eeb59e700 1 -- 172.21.15.82:0/184025957 shutdown_connections 2023-11-28T13:02:09.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.250+0000 7f7eeb59e700 1 --2- 172.21.15.82:0/184025957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec070780 0x7f7eec15d510 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:09.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.250+0000 7f7eeb59e700 1 -- 172.21.15.82:0/184025957 >> 172.21.15.82:0/184025957 conn(0x7f7eec0ce600 msgr2=0x7f7eec0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:09.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.250+0000 7f7eeb59e700 1 -- 172.21.15.82:0/184025957 shutdown_connections 2023-11-28T13:02:09.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.250+0000 7f7eeb59e700 1 -- 172.21.15.82:0/184025957 wait complete. 2023-11-28T13:02:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.250+0000 7f7eeb59e700 1 Processor -- start 2023-11-28T13:02:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.250+0000 7f7eeb59e700 1 -- start start 2023-11-28T13:02:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7eeb59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7eec070780 0x7f7eec14c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7eeb59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec158df0 0x7f7eec14d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7eeb59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eec1591c0 0x7f7eec069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7eeb59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec15bac0 con 0x7f7eec158df0 2023-11-28T13:02:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7eeb59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec15bf50 con 0x7f7eec1591c0 2023-11-28T13:02:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7eeb59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec15aeb0 con 0x7f7eec070780 2023-11-28T13:02:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7ee9d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec158df0 0x7f7eec14d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7eea59c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7eec070780 0x7f7eec14c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7ee9d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec158df0 0x7f7eec14d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49346/0 (socket says 172.21.15.82:49346) 2023-11-28T13:02:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7eead9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eec1591c0 0x7f7eec069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:09.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7ee9d9b700 1 -- 172.21.15.82:0/1521202561 learned_addr learned my addr 172.21.15.82:0/1521202561 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:09.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7ee9d9b700 1 -- 172.21.15.82:0/1521202561 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7eec070780 msgr2=0x7f7eec14c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:09.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7ee9d9b700 1 --2- 172.21.15.82:0/1521202561 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7eec070780 0x7f7eec14c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:09.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7ee9d9b700 1 -- 172.21.15.82:0/1521202561 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eec1591c0 msgr2=0x7f7eec069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:09.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7ee9d9b700 1 --2- 172.21.15.82:0/1521202561 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eec1591c0 0x7f7eec069bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:09.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7ee9d9b700 1 -- 172.21.15.82:0/1521202561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee4009a70 con 0x7f7eec158df0 2023-11-28T13:02:09.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7ee9d9b700 1 --2- 172.21.15.82:0/1521202561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec158df0 0x7f7eec14d8c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00c4e0 tx=0x7f7edc00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:09.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7edaffd700 1 -- 172.21.15.82:0/1521202561 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc005d90 con 0x7f7eec158df0 2023-11-28T13:02:09.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7edaffd700 1 -- 172.21.15.82:0/1521202561 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc00ce90 con 0x7f7eec158df0 2023-11-28T13:02:09.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7eeb59e700 1 -- 172.21.15.82:0/1521202561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eec0c9480 con 0x7f7eec158df0 2023-11-28T13:02:09.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7edaffd700 1 -- 172.21.15.82:0/1521202561 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0072f0 con 0x7f7eec158df0 2023-11-28T13:02:09.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.254+0000 7f7eeb59e700 1 -- 172.21.15.82:0/1521202561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eec0c9ab0 con 0x7f7eec158df0 2023-11-28T13:02:09.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.258+0000 7f7eeb59e700 1 -- 172.21.15.82:0/1521202561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eec15bc30 con 0x7f7eec158df0 2023-11-28T13:02:09.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.258+0000 7f7edaffd700 1 -- 172.21.15.82:0/1521202561 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7edc019030 con 0x7f7eec158df0 2023-11-28T13:02:09.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.258+0000 7f7edaffd700 1 --2- 172.21.15.82:0/1521202561 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7ecc064ee0 0x7f7ecc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:09.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.258+0000 7f7edaffd700 1 -- 172.21.15.82:0/1521202561 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f7edc0810d0 con 0x7f7eec158df0 2023-11-28T13:02:09.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.258+0000 7f7eea59c700 1 --2- 172.21.15.82:0/1521202561 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7ecc064ee0 0x7f7ecc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:09.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.258+0000 7f7eea59c700 1 --2- 172.21.15.82:0/1521202561 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7ecc064ee0 0x7f7ecc067390 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7eec1f5300 tx=0x7f7ee0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:09.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.266+0000 7f7edaffd700 1 -- 172.21.15.82:0/1521202561 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7edc04f0e0 con 0x7f7eec158df0 2023-11-28T13:02:09.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.466+0000 7f7eeb59e700 1 -- 172.21.15.82:0/1521202561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7eec15da50 con 0x7f7eec158df0 2023-11-28T13:02:09.919 INFO:tasks.ceph.mon.a.smithi082.stderr:2023-11-28T13:02:09.918+0000 7f1907e90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T13:02:09.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.930+0000 7f7edaffd700 1 -- 172.21.15.82:0/1521202561 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7eec15da50 con 0x7f7eec158df0 2023-11-28T13:02:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.934+0000 7f7eeb59e700 1 -- 172.21.15.82:0/1521202561 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7ecc064ee0 msgr2=0x7f7ecc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.934+0000 7f7eeb59e700 1 --2- 172.21.15.82:0/1521202561 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7ecc064ee0 0x7f7ecc067390 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7eec1f5300 tx=0x7f7ee0009040 comp rx=0 tx=0).stop 2023-11-28T13:02:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.934+0000 7f7eeb59e700 1 -- 172.21.15.82:0/1521202561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec158df0 msgr2=0x7f7eec14d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.934+0000 7f7eeb59e700 1 --2- 172.21.15.82:0/1521202561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec158df0 0x7f7eec14d8c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00c4e0 tx=0x7f7edc00c7f0 comp rx=0 tx=0).stop 2023-11-28T13:02:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.934+0000 7f7eeb59e700 1 -- 172.21.15.82:0/1521202561 shutdown_connections 2023-11-28T13:02:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.934+0000 7f7eeb59e700 1 --2- 172.21.15.82:0/1521202561 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7ecc064ee0 0x7f7ecc067390 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.934+0000 7f7eeb59e700 1 --2- 172.21.15.82:0/1521202561 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eec1591c0 0x7f7eec069bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.934+0000 7f7eeb59e700 1 --2- 172.21.15.82:0/1521202561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec158df0 0x7f7eec14d8c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.934+0000 7f7eeb59e700 1 --2- 172.21.15.82:0/1521202561 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7eec070780 0x7f7eec14c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.934+0000 7f7eeb59e700 1 -- 172.21.15.82:0/1521202561 >> 172.21.15.82:0/1521202561 conn(0x7f7eec0ce600 msgr2=0x7f7eec0abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:09.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.934+0000 7f7eeb59e700 1 -- 172.21.15.82:0/1521202561 shutdown_connections 2023-11-28T13:02:09.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:09.934+0000 7f7eeb59e700 1 -- 172.21.15.82:0/1521202561 wait complete. 2023-11-28T13:02:09.940 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T13:02:09.941 INFO:tasks.ceph.mds.a.smithi082.stderr: -5968> 2023-11-28T13:01:33.183+0000 7f1e7d7eb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T13:02:09.955 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T13:02:09.977 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-11-28T13:02:10.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.070+0000 7fb190e55700 1 Processor -- start 2023-11-28T13:02:10.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.070+0000 7fb190e55700 1 -- start start 2023-11-28T13:02:10.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.070+0000 7fb190e55700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb18c0cd090 0x7fb18c06a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:10.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.070+0000 7fb190e55700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb18c0b44c0 0x7fb18c0b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:10.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.070+0000 7fb190e55700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18c0cd4e0 con 0x7fb18c0b1e20 2023-11-28T13:02:10.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.070+0000 7fb190e55700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18c0b21f0 con 0x7fb18c0b44c0 2023-11-28T13:02:10.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.070+0000 7fb190e55700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c0b4e80 con 0x7fb18c0cd090 2023-11-28T13:02:10.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.070+0000 7fb18bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb18c0b44c0 0x7fb18c0b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:10.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.070+0000 7fb18bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb18c0b44c0 0x7fb18c0b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49388/0 (socket says 172.21.15.82:49388) 2023-11-28T13:02:10.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.070+0000 7fb18b7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb18c0b1e20 0x7fb18c0d13d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48484/0 (socket says 172.21.15.82:48484) 2023-11-28T13:02:10.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.070+0000 7fb18bfff700 1 -- 172.21.15.82:0/899007278 learned_addr learned my addr 172.21.15.82:0/899007278 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:10.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.070+0000 7fb18affd700 1 --2- 172.21.15.82:0/899007278 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb18c0cd090 0x7fb18c06a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:10.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.070+0000 7fb18bfff700 1 -- 172.21.15.82:0/899007278 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb18c0cd090 msgr2=0x7fb18c06a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:10.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.070+0000 7fb18bfff700 1 --2- 172.21.15.82:0/899007278 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb18c0cd090 0x7fb18c06a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:10.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.070+0000 7fb18bfff700 1 -- 172.21.15.82:0/899007278 >> v1:172.21.15.82:6789/0 conn(0x7fb18c0b1e20 legacy=0x7fb18c0d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:10.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.070+0000 7fb18bfff700 1 -- 172.21.15.82:0/899007278 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18c06ab80 con 0x7fb18c0b44c0 2023-11-28T13:02:10.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.074+0000 7fb18bfff700 1 --2- 172.21.15.82:0/899007278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18c0b44c0 0x7fb18c0b4940 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb184009910 tx=0x7fb184009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1887e400a2bd7e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:10.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.074+0000 7fb18a7fc700 1 -- 172.21.15.82:0/899007278 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18400ba60 con 0x7fb18c0b44c0 2023-11-28T13:02:10.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.074+0000 7fb18a7fc700 1 -- 172.21.15.82:0/899007278 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18400bbc0 con 0x7fb18c0b44c0 2023-11-28T13:02:10.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.074+0000 7fb18a7fc700 1 -- 172.21.15.82:0/899007278 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184009e60 con 0x7fb18c0b44c0 2023-11-28T13:02:10.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.074+0000 7fb190e55700 1 -- 172.21.15.82:0/899007278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18c0b44c0 msgr2=0x7fb18c0b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:10.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.074+0000 7fb190e55700 1 --2- 172.21.15.82:0/899007278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18c0b44c0 0x7fb18c0b4940 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb184009910 tx=0x7fb184009c20 comp rx=0 tx=0).stop 2023-11-28T13:02:10.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.074+0000 7fb190e55700 1 -- 172.21.15.82:0/899007278 shutdown_connections 2023-11-28T13:02:10.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.074+0000 7fb190e55700 1 --2- 172.21.15.82:0/899007278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18c0b44c0 0x7fb18c0b4940 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:10.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.074+0000 7fb190e55700 1 --2- 172.21.15.82:0/899007278 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb18c0cd090 0x7fb18c06a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:10.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.074+0000 7fb190e55700 1 -- 172.21.15.82:0/899007278 >> 172.21.15.82:0/899007278 conn(0x7fb18c0cf4c0 msgr2=0x7fb18c0cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:10.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.074+0000 7fb190e55700 1 -- 172.21.15.82:0/899007278 shutdown_connections 2023-11-28T13:02:10.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.074+0000 7fb190e55700 1 -- 172.21.15.82:0/899007278 wait complete. 2023-11-28T13:02:10.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.074+0000 7fb190e55700 1 Processor -- start 2023-11-28T13:02:10.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.074+0000 7fb190e55700 1 -- start start 2023-11-28T13:02:10.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb190e55700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb18c0b1e20 0x7fb18c0ab2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:10.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb190e55700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb18c0b44c0 0x7fb18c0b8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:10.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb190e55700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18c0cd090 0x7fb18c0cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:10.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb190e55700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c0b8690 con 0x7fb18c0cd090 2023-11-28T13:02:10.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb190e55700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c0aa250 con 0x7fb18c0b1e20 2023-11-28T13:02:10.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb190e55700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c0aa530 con 0x7fb18c0b44c0 2023-11-28T13:02:10.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb18bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18c0cd090 0x7fb18c0cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:10.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb18bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18c0cd090 0x7fb18c0cbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49400/0 (socket says 172.21.15.82:49400) 2023-11-28T13:02:10.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb18bfff700 1 -- 172.21.15.82:0/1464699478 learned_addr learned my addr 172.21.15.82:0/1464699478 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:10.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb18affd700 1 --2- 172.21.15.82:0/1464699478 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb18c0b44c0 0x7fb18c0b8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:10.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb18b7fe700 1 --2- 172.21.15.82:0/1464699478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb18c0b1e20 0x7fb18c0ab2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:10.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb18bfff700 1 -- 172.21.15.82:0/1464699478 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb18c0b44c0 msgr2=0x7fb18c0b8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:10.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb18bfff700 1 --2- 172.21.15.82:0/1464699478 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb18c0b44c0 0x7fb18c0b8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:10.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb18bfff700 1 -- 172.21.15.82:0/1464699478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb18c0b1e20 msgr2=0x7fb18c0ab2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:10.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb18bfff700 1 --2- 172.21.15.82:0/1464699478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb18c0b1e20 0x7fb18c0ab2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:10.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb18bfff700 1 -- 172.21.15.82:0/1464699478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb184009570 con 0x7fb18c0cd090 2023-11-28T13:02:10.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb18bfff700 1 --2- 172.21.15.82:0/1464699478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18c0cd090 0x7fb18c0cbfc0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb18c06c940 tx=0x7fb184004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:10.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb183fff700 1 -- 172.21.15.82:0/1464699478 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184004450 con 0x7fb18c0cd090 2023-11-28T13:02:10.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb183fff700 1 -- 172.21.15.82:0/1464699478 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18401f070 con 0x7fb18c0cd090 2023-11-28T13:02:10.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb190e55700 1 -- 172.21.15.82:0/1464699478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18c0d0610 con 0x7fb18c0cd090 2023-11-28T13:02:10.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb183fff700 1 -- 172.21.15.82:0/1464699478 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184003900 con 0x7fb18c0cd090 2023-11-28T13:02:10.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb190e55700 1 -- 172.21.15.82:0/1464699478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18c0cd720 con 0x7fb18c0cd090 2023-11-28T13:02:10.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.078+0000 7fb190e55700 1 -- 172.21.15.82:0/1464699478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18c0d08f0 con 0x7fb18c0cd090 2023-11-28T13:02:10.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.082+0000 7fb183fff700 1 -- 172.21.15.82:0/1464699478 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb18400f050 con 0x7fb18c0cd090 2023-11-28T13:02:10.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.082+0000 7fb183fff700 1 --2- 172.21.15.82:0/1464699478 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb16c064ee0 0x7fb16c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:10.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.082+0000 7fb183fff700 1 -- 172.21.15.82:0/1464699478 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fb184021070 con 0x7fb18c0cd090 2023-11-28T13:02:10.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.082+0000 7fb18b7fe700 1 --2- 172.21.15.82:0/1464699478 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb16c064ee0 0x7fb16c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:10.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.082+0000 7fb18b7fe700 1 --2- 172.21.15.82:0/1464699478 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb16c064ee0 0x7fb16c067390 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0012e0 tx=0x7fb17c001b20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:10.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.090+0000 7fb183fff700 1 -- 172.21.15.82:0/1464699478 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb184051600 con 0x7fb18c0cd090 2023-11-28T13:02:10.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.290+0000 7fb190e55700 1 -- 172.21.15.82:0/1464699478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb18c06ab80 con 0x7fb18c0cd090 2023-11-28T13:02:10.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.938+0000 7fb183fff700 1 -- 172.21.15.82:0/1464699478 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb18c06ab80 con 0x7fb18c0cd090 2023-11-28T13:02:10.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.942+0000 7fb190e55700 1 -- 172.21.15.82:0/1464699478 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb16c064ee0 msgr2=0x7fb16c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:10.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.942+0000 7fb190e55700 1 --2- 172.21.15.82:0/1464699478 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb16c064ee0 0x7fb16c067390 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0012e0 tx=0x7fb17c001b20 comp rx=0 tx=0).stop 2023-11-28T13:02:10.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.942+0000 7fb190e55700 1 -- 172.21.15.82:0/1464699478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18c0cd090 msgr2=0x7fb18c0cbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:10.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.942+0000 7fb190e55700 1 --2- 172.21.15.82:0/1464699478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18c0cd090 0x7fb18c0cbfc0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb18c06c940 tx=0x7fb184004770 comp rx=0 tx=0).stop 2023-11-28T13:02:10.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.942+0000 7fb190e55700 1 -- 172.21.15.82:0/1464699478 shutdown_connections 2023-11-28T13:02:10.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.942+0000 7fb190e55700 1 --2- 172.21.15.82:0/1464699478 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb16c064ee0 0x7fb16c067390 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:10.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.942+0000 7fb190e55700 1 --2- 172.21.15.82:0/1464699478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18c0cd090 0x7fb18c0cbfc0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:10.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.942+0000 7fb190e55700 1 --2- 172.21.15.82:0/1464699478 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb18c0b44c0 0x7fb18c0b8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:10.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.942+0000 7fb190e55700 1 --2- 172.21.15.82:0/1464699478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb18c0b1e20 0x7fb18c0ab2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:10.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.942+0000 7fb190e55700 1 -- 172.21.15.82:0/1464699478 >> 172.21.15.82:0/1464699478 conn(0x7fb18c0cf4c0 msgr2=0x7fb18c0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:10.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.942+0000 7fb190e55700 1 -- 172.21.15.82:0/1464699478 shutdown_connections 2023-11-28T13:02:10.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:10.942+0000 7fb190e55700 1 -- 172.21.15.82:0/1464699478 wait complete. 2023-11-28T13:02:10.966 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T13:02:11.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcb0ba9700 1 Processor -- start 2023-11-28T13:02:11.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcb0ba9700 1 -- start start 2023-11-28T13:02:11.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcb0ba9700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbcac0cb690 0x7fbcac0700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:11.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcb0ba9700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcac15a370 con 0x7fbcac0c9ab0 2023-11-28T13:02:11.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcb0ba9700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcac0cad50 con 0x7fbcac0b4000 2023-11-28T13:02:11.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcb0ba9700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcac0c8cf0 con 0x7fbcac0cb690 2023-11-28T13:02:11.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcabfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbcac0cb690 0x7fbcac0700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:11.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcaaffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbcac0c9ab0 0x7fbcac0caf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48492/0 (socket says 172.21.15.82:48492) 2023-11-28T13:02:11.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcabfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbcac0cb690 0x7fbcac0700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49412/0 (socket says 172.21.15.82:49412) 2023-11-28T13:02:11.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcaaffd700 1 -- 172.21.15.82:0/3285531884 learned_addr learned my addr 172.21.15.82:0/3285531884 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:11.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcabfff700 1 -- 172.21.15.82:0/3285531884 >> v1:172.21.15.114:6789/0 conn(0x7fbcac0b4000 legacy=0x7fbcac0ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:11.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcabfff700 1 -- 172.21.15.82:0/3285531884 >> v1:172.21.15.82:6789/0 conn(0x7fbcac0c9ab0 legacy=0x7fbcac0caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:11.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcabfff700 1 -- 172.21.15.82:0/3285531884 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac0c8fd0 con 0x7fbcac0cb690 2023-11-28T13:02:11.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcaa7fc700 1 -- 172.21.15.82:0/3285531884 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3643293036 0 0) 0x7fbca0001110 con 0x7fbcac0c9ab0 2023-11-28T13:02:11.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcabfff700 1 --2- 172.21.15.82:0/3285531884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcac0cb690 0x7fbcac0700b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009d90 tx=0x7fbca400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9ae2bbf0cc706c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:11.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcaa7fc700 1 -- 172.21.15.82:0/3285531884 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca400e070 con 0x7fbcac0cb690 2023-11-28T13:02:11.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcaa7fc700 1 -- 172.21.15.82:0/3285531884 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca400bbd0 con 0x7fbcac0cb690 2023-11-28T13:02:11.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcaa7fc700 1 -- 172.21.15.82:0/3285531884 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca4012430 con 0x7fbcac0cb690 2023-11-28T13:02:11.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcb0ba9700 1 -- 172.21.15.82:0/3285531884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcac0cb690 msgr2=0x7fbcac0700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:11.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcb0ba9700 1 --2- 172.21.15.82:0/3285531884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcac0cb690 0x7fbcac0700b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009d90 tx=0x7fbca400b330 comp rx=0 tx=0).stop 2023-11-28T13:02:11.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcb0ba9700 1 -- 172.21.15.82:0/3285531884 shutdown_connections 2023-11-28T13:02:11.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcb0ba9700 1 --2- 172.21.15.82:0/3285531884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcac0cb690 0x7fbcac0700b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:11.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcb0ba9700 1 -- 172.21.15.82:0/3285531884 >> 172.21.15.82:0/3285531884 conn(0x7fbcac06cc60 msgr2=0x7fbcac0b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:11.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcb0ba9700 1 -- 172.21.15.82:0/3285531884 shutdown_connections 2023-11-28T13:02:11.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.134+0000 7fbcb0ba9700 1 -- 172.21.15.82:0/3285531884 wait complete. 2023-11-28T13:02:11.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbcb0ba9700 1 Processor -- start 2023-11-28T13:02:11.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbcb0ba9700 1 -- start start 2023-11-28T13:02:11.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbcb0ba9700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbcac0c9ab0 0x7fbcac14e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:11.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbcb0ba9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcac0cb690 0x7fbcac0cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:11.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbcb0ba9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcac0ac150 0x7fbcac0acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:11.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbcb0ba9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac0abd30 con 0x7fbcac0ac150 2023-11-28T13:02:11.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbcb0ba9700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac0cd8a0 con 0x7fbcac0cb690 2023-11-28T13:02:11.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbcb0ba9700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac0cdb40 con 0x7fbcac0c9ab0 2023-11-28T13:02:11.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbcabfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcac0ac150 0x7fbcac0acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:11.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbcabfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcac0ac150 0x7fbcac0acb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49424/0 (socket says 172.21.15.82:49424) 2023-11-28T13:02:11.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbcabfff700 1 -- 172.21.15.82:0/3655423867 learned_addr learned my addr 172.21.15.82:0/3655423867 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:11.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbcaaffd700 1 --2- 172.21.15.82:0/3655423867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcac0cb690 0x7fbcac0cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:11.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbcab7fe700 1 --2- 172.21.15.82:0/3655423867 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbcac0c9ab0 0x7fbcac14e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:11.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbcabfff700 1 -- 172.21.15.82:0/3655423867 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbcac0c9ab0 msgr2=0x7fbcac14e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:11.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbcabfff700 1 --2- 172.21.15.82:0/3655423867 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbcac0c9ab0 0x7fbcac14e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:11.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbcabfff700 1 -- 172.21.15.82:0/3655423867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcac0cb690 msgr2=0x7fbcac0cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:11.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbcabfff700 1 --2- 172.21.15.82:0/3655423867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcac0cb690 0x7fbcac0cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:11.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbcabfff700 1 -- 172.21.15.82:0/3655423867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca4009a70 con 0x7fbcac0ac150 2023-11-28T13:02:11.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbcabfff700 1 --2- 172.21.15.82:0/3655423867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcac0ac150 0x7fbcac0acb70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbca4014040 tx=0x7fbca4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:11.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbc93fff700 1 -- 172.21.15.82:0/3655423867 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca401b810 con 0x7fbcac0ac150 2023-11-28T13:02:11.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbc93fff700 1 -- 172.21.15.82:0/3655423867 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca4020070 con 0x7fbcac0ac150 2023-11-28T13:02:11.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbcb0ba9700 1 -- 172.21.15.82:0/3655423867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcac0c9590 con 0x7fbcac0ac150 2023-11-28T13:02:11.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbc93fff700 1 -- 172.21.15.82:0/3655423867 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca401bbb0 con 0x7fbcac0ac150 2023-11-28T13:02:11.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.138+0000 7fbcb0ba9700 1 -- 172.21.15.82:0/3655423867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcac0c92b0 con 0x7fbcac0ac150 2023-11-28T13:02:11.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.142+0000 7fbcb0ba9700 1 -- 172.21.15.82:0/3655423867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcac069bc0 con 0x7fbcac0ac150 2023-11-28T13:02:11.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.142+0000 7fbc93fff700 1 -- 172.21.15.82:0/3655423867 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbca401bd10 con 0x7fbcac0ac150 2023-11-28T13:02:11.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.142+0000 7fbc93fff700 1 --2- 172.21.15.82:0/3655423867 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbc98064ee0 0x7fbc98067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:11.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.142+0000 7fbc93fff700 1 -- 172.21.15.82:0/3655423867 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fbca4022070 con 0x7fbcac0ac150 2023-11-28T13:02:11.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.142+0000 7fbcab7fe700 1 --2- 172.21.15.82:0/3655423867 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbc98064ee0 0x7fbc98067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:11.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.142+0000 7fbcab7fe700 1 --2- 172.21.15.82:0/3655423867 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbc98064ee0 0x7fbc98067390 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c000f60 tx=0x7fbc9c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:11.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.146+0000 7fbc93fff700 1 -- 172.21.15.82:0/3655423867 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbca4052910 con 0x7fbcac0ac150 2023-11-28T13:02:11.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.310+0000 7fbcb0ba9700 1 -- 172.21.15.82:0/3655423867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbcac065fc0 con 0x7fbcac0ac150 2023-11-28T13:02:11.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.950+0000 7fbc93fff700 1 -- 172.21.15.82:0/3655423867 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v41) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbca4055f30 con 0x7fbcac0ac150 2023-11-28T13:02:11.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.954+0000 7fbcb0ba9700 1 -- 172.21.15.82:0/3655423867 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbc98064ee0 msgr2=0x7fbc98067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:11.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.954+0000 7fbcb0ba9700 1 --2- 172.21.15.82:0/3655423867 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbc98064ee0 0x7fbc98067390 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c000f60 tx=0x7fbc9c009040 comp rx=0 tx=0).stop 2023-11-28T13:02:11.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.954+0000 7fbcb0ba9700 1 -- 172.21.15.82:0/3655423867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcac0ac150 msgr2=0x7fbcac0acb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:11.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.954+0000 7fbcb0ba9700 1 --2- 172.21.15.82:0/3655423867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcac0ac150 0x7fbcac0acb70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbca4014040 tx=0x7fbca4004af0 comp rx=0 tx=0).stop 2023-11-28T13:02:11.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.954+0000 7fbcb0ba9700 1 -- 172.21.15.82:0/3655423867 shutdown_connections 2023-11-28T13:02:11.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.954+0000 7fbcb0ba9700 1 --2- 172.21.15.82:0/3655423867 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbc98064ee0 0x7fbc98067390 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:11.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.954+0000 7fbcb0ba9700 1 --2- 172.21.15.82:0/3655423867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcac0ac150 0x7fbcac0acb70 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:11.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.954+0000 7fbcb0ba9700 1 --2- 172.21.15.82:0/3655423867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcac0cb690 0x7fbcac0cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:11.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.954+0000 7fbcb0ba9700 1 --2- 172.21.15.82:0/3655423867 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbcac0c9ab0 0x7fbcac14e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:11.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.954+0000 7fbcb0ba9700 1 -- 172.21.15.82:0/3655423867 >> 172.21.15.82:0/3655423867 conn(0x7fbcac06cc60 msgr2=0x7fbcac0c9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:11.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.954+0000 7fbcb0ba9700 1 -- 172.21.15.82:0/3655423867 shutdown_connections 2023-11-28T13:02:11.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:11.954+0000 7fbcb0ba9700 1 -- 172.21.15.82:0/3655423867 wait complete. 2023-11-28T13:02:11.959 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2023-11-28T13:02:11.971 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T13:02:12.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.090+0000 7fa591b92700 1 Processor -- start 2023-11-28T13:02:12.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.090+0000 7fa591b92700 1 -- start start 2023-11-28T13:02:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa591b92700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa58c0b1830 0x7fa58c163dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa591b92700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa58c0cda50 con 0x7fa58c158e60 2023-11-28T13:02:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa591b92700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa58c0cdd30 con 0x7fa58c15ca50 2023-11-28T13:02:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa591b92700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa58c0ce010 con 0x7fa58c0b1830 2023-11-28T13:02:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa590b90700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa58c158e60 0x7fa58c0cd270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48496/0 (socket says 172.21.15.82:48496) 2023-11-28T13:02:12.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa590b90700 1 -- 172.21.15.82:0/195690719 learned_addr learned my addr 172.21.15.82:0/195690719 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:12.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa591391700 1 --2- 172.21.15.82:0/195690719 >> v2:172.21.15.82:3300/0 conn(0x7fa58c0b1830 0x7fa58c163dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:12.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa5837fe700 1 -- 172.21.15.82:0/195690719 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363124966 0 0) 0x7fa58c0cda50 con 0x7fa58c158e60 2023-11-28T13:02:12.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa5837fe700 1 -- 172.21.15.82:0/195690719 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5740035d0 con 0x7fa58c158e60 2023-11-28T13:02:12.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa591391700 1 -- 172.21.15.82:0/195690719 >> v1:172.21.15.114:6789/0 conn(0x7fa58c15ca50 legacy=0x7fa58c0b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:12.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa591391700 1 -- 172.21.15.82:0/195690719 >> v1:172.21.15.82:6789/0 conn(0x7fa58c158e60 legacy=0x7fa58c0cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:12.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa591391700 1 -- 172.21.15.82:0/195690719 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c0ce2f0 con 0x7fa58c0b1830 2023-11-28T13:02:12.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa591391700 1 --2- 172.21.15.82:0/195690719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa58c0b1830 0x7fa58c163dc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa584009dc0 tx=0x7fa58400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1235ee62dccd98e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:12.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa5837fe700 1 -- 172.21.15.82:0/195690719 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58400e070 con 0x7fa58c0b1830 2023-11-28T13:02:12.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa5837fe700 1 -- 172.21.15.82:0/195690719 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58400bae0 con 0x7fa58c0b1830 2023-11-28T13:02:12.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa5837fe700 1 -- 172.21.15.82:0/195690719 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58400be50 con 0x7fa58c0b1830 2023-11-28T13:02:12.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa591b92700 1 -- 172.21.15.82:0/195690719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa58c0b1830 msgr2=0x7fa58c163dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:12.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa591b92700 1 --2- 172.21.15.82:0/195690719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa58c0b1830 0x7fa58c163dc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa584009dc0 tx=0x7fa58400b330 comp rx=0 tx=0).stop 2023-11-28T13:02:12.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa591b92700 1 -- 172.21.15.82:0/195690719 shutdown_connections 2023-11-28T13:02:12.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa591b92700 1 --2- 172.21.15.82:0/195690719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa58c0b1830 0x7fa58c163dc0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:12.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa591b92700 1 -- 172.21.15.82:0/195690719 >> 172.21.15.82:0/195690719 conn(0x7fa58c0cc120 msgr2=0x7fa58c0cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:12.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa591b92700 1 -- 172.21.15.82:0/195690719 shutdown_connections 2023-11-28T13:02:12.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.094+0000 7fa591b92700 1 -- 172.21.15.82:0/195690719 wait complete. 2023-11-28T13:02:12.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.098+0000 7fa591b92700 1 Processor -- start 2023-11-28T13:02:12.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.098+0000 7fa591b92700 1 -- start start 2023-11-28T13:02:12.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.098+0000 7fa591b92700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa58c0b1830 0x7fa58c0c2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:12.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.098+0000 7fa591b92700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa58c158e60 0x7fa58c0b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:12.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.098+0000 7fa591b92700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa58c15ca50 0x7fa58c0b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:12.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.098+0000 7fa591b92700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c1f3840 con 0x7fa58c15ca50 2023-11-28T13:02:12.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.098+0000 7fa591b92700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c1f2bc0 con 0x7fa58c158e60 2023-11-28T13:02:12.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.098+0000 7fa591b92700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c1f2ea0 con 0x7fa58c0b1830 2023-11-28T13:02:12.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.098+0000 7fa591391700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa58c15ca50 0x7fa58c0b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:12.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.098+0000 7fa591391700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa58c15ca50 0x7fa58c0b4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49438/0 (socket says 172.21.15.82:49438) 2023-11-28T13:02:12.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.098+0000 7fa591391700 1 -- 172.21.15.82:0/482151936 learned_addr learned my addr 172.21.15.82:0/482151936 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:12.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.098+0000 7fa590b90700 1 --2- 172.21.15.82:0/482151936 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa58c0b1830 0x7fa58c0c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:12.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.098+0000 7fa583fff700 1 --2- 172.21.15.82:0/482151936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa58c158e60 0x7fa58c0b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:12.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.098+0000 7fa591391700 1 -- 172.21.15.82:0/482151936 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa58c0b1830 msgr2=0x7fa58c0c2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:12.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.098+0000 7fa591391700 1 --2- 172.21.15.82:0/482151936 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa58c0b1830 0x7fa58c0c2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:12.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.098+0000 7fa591391700 1 -- 172.21.15.82:0/482151936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa58c158e60 msgr2=0x7fa58c0b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:12.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.098+0000 7fa591391700 1 --2- 172.21.15.82:0/482151936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa58c158e60 0x7fa58c0b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:12.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.098+0000 7fa591391700 1 -- 172.21.15.82:0/482151936 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa584009a70 con 0x7fa58c15ca50 2023-11-28T13:02:12.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.098+0000 7fa591391700 1 --2- 172.21.15.82:0/482151936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa58c15ca50 0x7fa58c0b4c20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa584014040 tx=0x7fa584004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:12.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.102+0000 7fa5817fa700 1 -- 172.21.15.82:0/482151936 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5840098f0 con 0x7fa58c15ca50 2023-11-28T13:02:12.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.102+0000 7fa5817fa700 1 -- 172.21.15.82:0/482151936 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58401f070 con 0x7fa58c15ca50 2023-11-28T13:02:12.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.102+0000 7fa591b92700 1 -- 172.21.15.82:0/482151936 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58c159230 con 0x7fa58c15ca50 2023-11-28T13:02:12.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.102+0000 7fa5817fa700 1 -- 172.21.15.82:0/482151936 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa584025600 con 0x7fa58c15ca50 2023-11-28T13:02:12.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.102+0000 7fa591b92700 1 -- 172.21.15.82:0/482151936 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58c0ce5d0 con 0x7fa58c15ca50 2023-11-28T13:02:12.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.102+0000 7fa591b92700 1 -- 172.21.15.82:0/482151936 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa58c06c600 con 0x7fa58c15ca50 2023-11-28T13:02:12.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.102+0000 7fa5817fa700 1 -- 172.21.15.82:0/482151936 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa58402b060 con 0x7fa58c15ca50 2023-11-28T13:02:12.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.102+0000 7fa5817fa700 1 --2- 172.21.15.82:0/482151936 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa578064ee0 0x7fa578067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:12.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.102+0000 7fa5817fa700 1 -- 172.21.15.82:0/482151936 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5739+0+0 (secure 0 0 0) 0x7fa5840830a0 con 0x7fa58c15ca50 2023-11-28T13:02:12.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.102+0000 7fa590b90700 1 --2- 172.21.15.82:0/482151936 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa578064ee0 0x7fa578067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:12.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.106+0000 7fa590b90700 1 --2- 172.21.15.82:0/482151936 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa578064ee0 0x7fa578067390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa588007fd0 tx=0x7fa588007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:12.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.110+0000 7fa5817fa700 1 -- 172.21.15.82:0/482151936 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa584051430 con 0x7fa58c15ca50 2023-11-28T13:02:12.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.282+0000 7fa591b92700 1 -- 172.21.15.82:0/482151936 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa58c1f3980 con 0x7fa58c15ca50 2023-11-28T13:02:12.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.950+0000 7fa5817fa700 1 -- 172.21.15.82:0/482151936 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v42) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa58c1f3980 con 0x7fa58c15ca50 2023-11-28T13:02:12.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.958+0000 7fa591b92700 1 -- 172.21.15.82:0/482151936 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa578064ee0 msgr2=0x7fa578067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:12.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.958+0000 7fa591b92700 1 --2- 172.21.15.82:0/482151936 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa578064ee0 0x7fa578067390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa588007fd0 tx=0x7fa588007de0 comp rx=0 tx=0).stop 2023-11-28T13:02:12.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.958+0000 7fa591b92700 1 -- 172.21.15.82:0/482151936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa58c15ca50 msgr2=0x7fa58c0b4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:12.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.958+0000 7fa591b92700 1 --2- 172.21.15.82:0/482151936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa58c15ca50 0x7fa58c0b4c20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa584014040 tx=0x7fa584004af0 comp rx=0 tx=0).stop 2023-11-28T13:02:12.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.958+0000 7fa591b92700 1 -- 172.21.15.82:0/482151936 shutdown_connections 2023-11-28T13:02:12.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.958+0000 7fa591b92700 1 --2- 172.21.15.82:0/482151936 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa578064ee0 0x7fa578067390 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:12.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.958+0000 7fa591b92700 1 --2- 172.21.15.82:0/482151936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa58c15ca50 0x7fa58c0b4c20 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:12.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.958+0000 7fa591b92700 1 --2- 172.21.15.82:0/482151936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa58c158e60 0x7fa58c0b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:12.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.958+0000 7fa591b92700 1 --2- 172.21.15.82:0/482151936 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa58c0b1830 0x7fa58c0c2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:12.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.958+0000 7fa591b92700 1 -- 172.21.15.82:0/482151936 >> 172.21.15.82:0/482151936 conn(0x7fa58c0cc120 msgr2=0x7fa58c1577b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:12.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.958+0000 7fa591b92700 1 -- 172.21.15.82:0/482151936 shutdown_connections 2023-11-28T13:02:12.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:12.958+0000 7fa591b92700 1 -- 172.21.15.82:0/482151936 wait complete. 2023-11-28T13:02:12.963 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2023-11-28T13:02:12.975 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T13:02:13.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.086+0000 7fdf9d8fd700 1 Processor -- start 2023-11-28T13:02:13.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.086+0000 7fdf9d8fd700 1 -- start start 2023-11-28T13:02:13.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf9d8fd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdf98070730 0x7fdf98070b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:13.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf9d8fd700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf98158800 0x7fdf980c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:13.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf9d8fd700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf9806ad40 con 0x7fdf9815c220 2023-11-28T13:02:13.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf9d8fd700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf9806a450 con 0x7fdf98070730 2023-11-28T13:02:13.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf9d8fd700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf98071040 con 0x7fdf98158800 2023-11-28T13:02:13.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf9d0fc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdf9815c220 0x7fdf9815c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48508/0 (socket says 172.21.15.82:48508) 2023-11-28T13:02:13.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf9d0fc700 1 -- 172.21.15.82:0/3192546180 learned_addr learned my addr 172.21.15.82:0/3192546180 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:13.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf8ffff700 1 --2- 172.21.15.82:0/3192546180 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf98158800 0x7fdf980c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:13.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf9c8fb700 1 --2- 172.21.15.82:0/3192546180 >> v2:172.21.15.114:3300/0 conn(0x7fdf98070730 0x7fdf98070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:13.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf8f7fe700 1 -- 172.21.15.82:0/3192546180 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676037891 0 0) 0x7fdf9806ad40 con 0x7fdf9815c220 2023-11-28T13:02:13.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf8f7fe700 1 -- 172.21.15.82:0/3192546180 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf800035d0 con 0x7fdf9815c220 2023-11-28T13:02:13.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf8ffff700 1 -- 172.21.15.82:0/3192546180 >> v2:172.21.15.114:3300/0 conn(0x7fdf98070730 msgr2=0x7fdf98070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:13.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf8ffff700 1 --2- 172.21.15.82:0/3192546180 >> v2:172.21.15.114:3300/0 conn(0x7fdf98070730 0x7fdf98070b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:13.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf8ffff700 1 -- 172.21.15.82:0/3192546180 >> v1:172.21.15.82:6789/0 conn(0x7fdf9815c220 legacy=0x7fdf9815c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:13.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf8f7fe700 1 -- 172.21.15.82:0/3192546180 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2672106416 0 0) 0x7fdf800035d0 con 0x7fdf9815c220 2023-11-28T13:02:13.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf8ffff700 1 -- 172.21.15.82:0/3192546180 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9815cfa0 con 0x7fdf98158800 2023-11-28T13:02:13.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf9c8fb700 1 --2- 172.21.15.82:0/3192546180 >> v2:172.21.15.114:3300/0 conn(0x7fdf98070730 0x7fdf98070b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:02:13.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf8ffff700 1 --2- 172.21.15.82:0/3192546180 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf98158800 0x7fdf980c93d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009850 tx=0x7fdf88009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5243fa2e90d951d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:13.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf8f7fe700 1 -- 172.21.15.82:0/3192546180 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf900019f0 con 0x7fdf98158800 2023-11-28T13:02:13.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf8f7fe700 1 -- 172.21.15.82:0/3192546180 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf88004030 con 0x7fdf98158800 2023-11-28T13:02:13.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf8f7fe700 1 -- 172.21.15.82:0/3192546180 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf880043a0 con 0x7fdf98158800 2023-11-28T13:02:13.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf9d8fd700 1 -- 172.21.15.82:0/3192546180 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf98158800 msgr2=0x7fdf980c93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:13.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf9d8fd700 1 --2- 172.21.15.82:0/3192546180 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf98158800 0x7fdf980c93d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009850 tx=0x7fdf88009b60 comp rx=0 tx=0).stop 2023-11-28T13:02:13.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf9d8fd700 1 -- 172.21.15.82:0/3192546180 shutdown_connections 2023-11-28T13:02:13.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf9d8fd700 1 --2- 172.21.15.82:0/3192546180 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf98158800 0x7fdf980c93d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:13.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf9d8fd700 1 --2- 172.21.15.82:0/3192546180 >> v2:172.21.15.114:3300/0 conn(0x7fdf98070730 0x7fdf98070b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:13.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf9d8fd700 1 -- 172.21.15.82:0/3192546180 >> 172.21.15.82:0/3192546180 conn(0x7fdf980cb890 msgr2=0x7fdf980cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:13.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf9d8fd700 1 -- 172.21.15.82:0/3192546180 shutdown_connections 2023-11-28T13:02:13.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.090+0000 7fdf9d8fd700 1 -- 172.21.15.82:0/3192546180 wait complete. 2023-11-28T13:02:13.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf9d8fd700 1 Processor -- start 2023-11-28T13:02:13.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf9d8fd700 1 -- start start 2023-11-28T13:02:13.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf9d8fd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf98070730 0x7fdf98147310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:13.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf9d8fd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf98158800 0x7fdf980c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:13.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf9d8fd700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf9815c220 0x7fdf980c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:13.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf9d8fd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf98148460 con 0x7fdf98158800 2023-11-28T13:02:13.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf9d8fd700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980b2100 con 0x7fdf98070730 2023-11-28T13:02:13.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf9d8fd700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980b23e0 con 0x7fdf9815c220 2023-11-28T13:02:13.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf8ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf98158800 0x7fdf980c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:13.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf8ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf98158800 0x7fdf980c7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49448/0 (socket says 172.21.15.82:49448) 2023-11-28T13:02:13.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf8ffff700 1 -- 172.21.15.82:0/1920191142 learned_addr learned my addr 172.21.15.82:0/1920191142 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:13.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf9c8fb700 1 --2- 172.21.15.82:0/1920191142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf98070730 0x7fdf98147310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:13.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf9d0fc700 1 --2- 172.21.15.82:0/1920191142 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf9815c220 0x7fdf980c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:13.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf8ffff700 1 -- 172.21.15.82:0/1920191142 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf9815c220 msgr2=0x7fdf980c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:13.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf8ffff700 1 --2- 172.21.15.82:0/1920191142 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf9815c220 0x7fdf980c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:13.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf8ffff700 1 -- 172.21.15.82:0/1920191142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf98070730 msgr2=0x7fdf98147310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:13.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf8ffff700 1 --2- 172.21.15.82:0/1920191142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf98070730 0x7fdf98147310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:13.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf8ffff700 1 -- 172.21.15.82:0/1920191142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf940094b0 con 0x7fdf98158800 2023-11-28T13:02:13.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf9c8fb700 1 --2- 172.21.15.82:0/1920191142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf98070730 0x7fdf98147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:13.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf8ffff700 1 --2- 172.21.15.82:0/1920191142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf98158800 0x7fdf980c7960 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fdf880090b0 tx=0x7fdf88004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:13.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf8d7fa700 1 -- 172.21.15.82:0/1920191142 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88004590 con 0x7fdf98158800 2023-11-28T13:02:13.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf8d7fa700 1 -- 172.21.15.82:0/1920191142 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8801f070 con 0x7fdf98158800 2023-11-28T13:02:13.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf9d8fd700 1 -- 172.21.15.82:0/1920191142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf880094b0 con 0x7fdf98158800 2023-11-28T13:02:13.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf8d7fa700 1 -- 172.21.15.82:0/1920191142 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88011870 con 0x7fdf98158800 2023-11-28T13:02:13.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.094+0000 7fdf9d8fd700 1 -- 172.21.15.82:0/1920191142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9806a9d0 con 0x7fdf98158800 2023-11-28T13:02:13.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.098+0000 7fdf9d8fd700 1 -- 172.21.15.82:0/1920191142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf9806a6f0 con 0x7fdf98158800 2023-11-28T13:02:13.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.098+0000 7fdf8d7fa700 1 -- 172.21.15.82:0/1920191142 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdf88017020 con 0x7fdf98158800 2023-11-28T13:02:13.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.098+0000 7fdf8d7fa700 1 --2- 172.21.15.82:0/1920191142 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdf84064ee0 0x7fdf84067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:13.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.098+0000 7fdf8d7fa700 1 -- 172.21.15.82:0/1920191142 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fdf88021070 con 0x7fdf98158800 2023-11-28T13:02:13.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.098+0000 7fdf9c8fb700 1 --2- 172.21.15.82:0/1920191142 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdf84064ee0 0x7fdf84067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:13.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.098+0000 7fdf9c8fb700 1 --2- 172.21.15.82:0/1920191142 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdf84064ee0 0x7fdf84067390 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009dd0 tx=0x7fdf94008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:13.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.106+0000 7fdf8d7fa700 1 -- 172.21.15.82:0/1920191142 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdf88051990 con 0x7fdf98158800 2023-11-28T13:02:13.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.266+0000 7fdf9d8fd700 1 -- 172.21.15.82:0/1920191142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fdf980c9910 con 0x7fdf98158800 2023-11-28T13:02:13.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.274+0000 7fdf8d7fa700 1 -- 172.21.15.82:0/1920191142 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdf88054fb0 con 0x7fdf98158800 2023-11-28T13:02:13.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.278+0000 7fdf9d8fd700 1 -- 172.21.15.82:0/1920191142 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdf84064ee0 msgr2=0x7fdf84067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:13.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.278+0000 7fdf9d8fd700 1 --2- 172.21.15.82:0/1920191142 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdf84064ee0 0x7fdf84067390 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009dd0 tx=0x7fdf94008040 comp rx=0 tx=0).stop 2023-11-28T13:02:13.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.278+0000 7fdf9d8fd700 1 -- 172.21.15.82:0/1920191142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf98158800 msgr2=0x7fdf980c7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:13.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.278+0000 7fdf9d8fd700 1 --2- 172.21.15.82:0/1920191142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf98158800 0x7fdf980c7960 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fdf880090b0 tx=0x7fdf88004770 comp rx=0 tx=0).stop 2023-11-28T13:02:13.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.278+0000 7fdf9d8fd700 1 -- 172.21.15.82:0/1920191142 shutdown_connections 2023-11-28T13:02:13.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.278+0000 7fdf9d8fd700 1 --2- 172.21.15.82:0/1920191142 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdf84064ee0 0x7fdf84067390 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:13.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.278+0000 7fdf9d8fd700 1 --2- 172.21.15.82:0/1920191142 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf9815c220 0x7fdf980c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:13.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.278+0000 7fdf9d8fd700 1 --2- 172.21.15.82:0/1920191142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf98158800 0x7fdf980c7960 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:13.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.278+0000 7fdf9d8fd700 1 --2- 172.21.15.82:0/1920191142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf98070730 0x7fdf98147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:13.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.278+0000 7fdf9d8fd700 1 -- 172.21.15.82:0/1920191142 >> 172.21.15.82:0/1920191142 conn(0x7fdf980cb890 msgr2=0x7fdf980c7100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:13.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.278+0000 7fdf9d8fd700 1 -- 172.21.15.82:0/1920191142 shutdown_connections 2023-11-28T13:02:13.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.278+0000 7fdf9d8fd700 1 -- 172.21.15.82:0/1920191142 wait complete. 2023-11-28T13:02:13.295 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2023-11-28T13:02:13.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.406+0000 7f5ccb31b700 1 Processor -- start 2023-11-28T13:02:13.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.406+0000 7f5ccb31b700 1 -- start start 2023-11-28T13:02:13.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.406+0000 7f5ccb31b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5cc41591c0 0x7f5cc415d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:13.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.406+0000 7f5ccb31b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5cc4070070 0x7f5cc40704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:13.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.406+0000 7f5ccb31b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc415da50 con 0x7f5cc4158df0 2023-11-28T13:02:13.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.406+0000 7f5ccb31b700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc4070a30 con 0x7f5cc41591c0 2023-11-28T13:02:13.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.406+0000 7f5ccb31b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc40c9e20 con 0x7f5cc4070070 2023-11-28T13:02:13.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.406+0000 7f5cca319700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5cc4158df0 0x7f5cc406c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48518/0 (socket says 172.21.15.82:48518) 2023-11-28T13:02:13.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.406+0000 7f5cca319700 1 -- 172.21.15.82:0/4037766634 learned_addr learned my addr 172.21.15.82:0/4037766634 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:13.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.406+0000 7f5cc9b18700 1 --2- 172.21.15.82:0/4037766634 >> v2:172.21.15.114:3300/0 conn(0x7f5cc41591c0 0x7f5cc415d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:13.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.406+0000 7f5ccab1a700 1 --2- 172.21.15.82:0/4037766634 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5cc4070070 0x7f5cc40704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:13.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.406+0000 7f5cc9317700 1 -- 172.21.15.82:0/4037766634 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413824498 0 0) 0x7f5cb4001110 con 0x7f5cc4158df0 2023-11-28T13:02:13.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.406+0000 7f5cc9317700 1 -- 172.21.15.82:0/4037766634 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cb00035d0 con 0x7f5cc4158df0 2023-11-28T13:02:13.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.406+0000 7f5cc9b18700 1 -- 172.21.15.82:0/4037766634 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5cc4070070 msgr2=0x7f5cc40704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:13.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.406+0000 7f5cc9b18700 1 --2- 172.21.15.82:0/4037766634 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5cc4070070 0x7f5cc40704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:13.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.406+0000 7f5cc9b18700 1 -- 172.21.15.82:0/4037766634 >> v1:172.21.15.82:6789/0 conn(0x7f5cc4158df0 legacy=0x7f5cc406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:13.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.406+0000 7f5cc9b18700 1 -- 172.21.15.82:0/4037766634 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc40cc640 con 0x7f5cc41591c0 2023-11-28T13:02:13.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.406+0000 7f5cc9b18700 1 --2- 172.21.15.82:0/4037766634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cc41591c0 0x7f5cc415d510 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0009850 tx=0x7f5cc0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3db8d3df6bd95fb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:13.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.410+0000 7f5cc9317700 1 -- 172.21.15.82:0/4037766634 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0011830 con 0x7f5cc41591c0 2023-11-28T13:02:13.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.410+0000 7f5cc9317700 1 -- 172.21.15.82:0/4037766634 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc0011990 con 0x7f5cc41591c0 2023-11-28T13:02:13.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.410+0000 7f5cc9317700 1 -- 172.21.15.82:0/4037766634 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0011d40 con 0x7f5cc41591c0 2023-11-28T13:02:13.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.410+0000 7f5ccb31b700 1 -- 172.21.15.82:0/4037766634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cc41591c0 msgr2=0x7f5cc415d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:13.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.410+0000 7f5ccb31b700 1 --2- 172.21.15.82:0/4037766634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cc41591c0 0x7f5cc415d510 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0009850 tx=0x7f5cc0009b60 comp rx=0 tx=0).stop 2023-11-28T13:02:13.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.410+0000 7f5ccb31b700 1 -- 172.21.15.82:0/4037766634 shutdown_connections 2023-11-28T13:02:13.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.410+0000 7f5ccb31b700 1 --2- 172.21.15.82:0/4037766634 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5cc4070070 0x7f5cc40704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:13.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.410+0000 7f5ccb31b700 1 --2- 172.21.15.82:0/4037766634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cc41591c0 0x7f5cc415d510 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:13.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.410+0000 7f5ccb31b700 1 -- 172.21.15.82:0/4037766634 >> 172.21.15.82:0/4037766634 conn(0x7f5cc40ce600 msgr2=0x7f5cc40ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:13.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.410+0000 7f5ccb31b700 1 -- 172.21.15.82:0/4037766634 shutdown_connections 2023-11-28T13:02:13.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.410+0000 7f5ccb31b700 1 -- 172.21.15.82:0/4037766634 wait complete. 2023-11-28T13:02:13.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5ccb31b700 1 Processor -- start 2023-11-28T13:02:13.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5ccb31b700 1 -- start start 2023-11-28T13:02:13.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5ccb31b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5cc4070070 0x7f5cc415b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:13.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5ccb31b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cc4158df0 0x7f5cc4159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:13.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5ccb31b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cc41591c0 0x7f5cc414cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:13.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5ccb31b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc40c5bc0 con 0x7f5cc41591c0 2023-11-28T13:02:13.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5ccb31b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc415be90 con 0x7f5cc4158df0 2023-11-28T13:02:13.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5ccb31b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc415c130 con 0x7f5cc4070070 2023-11-28T13:02:13.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5ccab1a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cc41591c0 0x7f5cc414cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:13.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5ccab1a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cc41591c0 0x7f5cc414cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49450/0 (socket says 172.21.15.82:49450) 2023-11-28T13:02:13.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5ccab1a700 1 -- 172.21.15.82:0/2405753482 learned_addr learned my addr 172.21.15.82:0/2405753482 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:13.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5cc9b18700 1 --2- 172.21.15.82:0/2405753482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cc4158df0 0x7f5cc4159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:13.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5cca319700 1 --2- 172.21.15.82:0/2405753482 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5cc4070070 0x7f5cc415b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:13.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5ccab1a700 1 -- 172.21.15.82:0/2405753482 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5cc4070070 msgr2=0x7f5cc415b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:13.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5ccab1a700 1 --2- 172.21.15.82:0/2405753482 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5cc4070070 0x7f5cc415b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:13.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5ccab1a700 1 -- 172.21.15.82:0/2405753482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cc4158df0 msgr2=0x7f5cc4159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:13.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5ccab1a700 1 --2- 172.21.15.82:0/2405753482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cc4158df0 0x7f5cc4159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:13.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5ccab1a700 1 -- 172.21.15.82:0/2405753482 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc00094b0 con 0x7f5cc41591c0 2023-11-28T13:02:13.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5cca319700 1 --2- 172.21.15.82:0/2405753482 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5cc4070070 0x7f5cc415b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:13.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5ccab1a700 1 --2- 172.21.15.82:0/2405753482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cc41591c0 0x7f5cc414cbc0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00efc0 tx=0x7f5cbc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:13.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5cbaffd700 1 -- 172.21.15.82:0/2405753482 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc009ea0 con 0x7f5cc41591c0 2023-11-28T13:02:13.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5cbaffd700 1 -- 172.21.15.82:0/2405753482 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cbc00f040 con 0x7f5cc41591c0 2023-11-28T13:02:13.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5ccb31b700 1 -- 172.21.15.82:0/2405753482 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc40c9ab0 con 0x7f5cc41591c0 2023-11-28T13:02:13.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5cbaffd700 1 -- 172.21.15.82:0/2405753482 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc014480 con 0x7f5cc41591c0 2023-11-28T13:02:13.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.414+0000 7f5ccb31b700 1 -- 172.21.15.82:0/2405753482 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc40c97d0 con 0x7f5cc41591c0 2023-11-28T13:02:13.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.418+0000 7f5ccb31b700 1 -- 172.21.15.82:0/2405753482 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc40c9480 con 0x7f5cc41591c0 2023-11-28T13:02:13.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.418+0000 7f5cbaffd700 1 -- 172.21.15.82:0/2405753482 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5cbc0145e0 con 0x7f5cc41591c0 2023-11-28T13:02:13.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.418+0000 7f5cbaffd700 1 --2- 172.21.15.82:0/2405753482 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5ca8064ee0 0x7f5ca8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:13.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.418+0000 7f5cbaffd700 1 -- 172.21.15.82:0/2405753482 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5cbc082650 con 0x7f5cc41591c0 2023-11-28T13:02:13.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.418+0000 7f5cca319700 1 --2- 172.21.15.82:0/2405753482 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5ca8064ee0 0x7f5ca8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:13.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.418+0000 7f5cca319700 1 --2- 172.21.15.82:0/2405753482 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5ca8064ee0 0x7f5ca8067390 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4001270 tx=0x7f5cb4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:13.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.430+0000 7f5cbaffd700 1 -- 172.21.15.82:0/2405753482 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5cbc050a70 con 0x7f5cc41591c0 2023-11-28T13:02:13.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.666+0000 7f5ccb31b700 1 -- 172.21.15.82:0/2405753482 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7f5cc4065fc0 con 0x7f5cc41591c0 2023-11-28T13:02:13.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.958+0000 7f5cbaffd700 1 -- 172.21.15.82:0/2405753482 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v113) v1 ==== 142+0+0 (secure 0 0 0) 0x7f5cbc054090 con 0x7f5cc41591c0 2023-11-28T13:02:13.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.962+0000 7f5ccb31b700 1 -- 172.21.15.82:0/2405753482 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5ca8064ee0 msgr2=0x7f5ca8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:13.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.962+0000 7f5ccb31b700 1 --2- 172.21.15.82:0/2405753482 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5ca8064ee0 0x7f5ca8067390 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4001270 tx=0x7f5cb4009040 comp rx=0 tx=0).stop 2023-11-28T13:02:13.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.962+0000 7f5ccb31b700 1 -- 172.21.15.82:0/2405753482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cc41591c0 msgr2=0x7f5cc414cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:13.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.962+0000 7f5ccb31b700 1 --2- 172.21.15.82:0/2405753482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cc41591c0 0x7f5cc414cbc0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00efc0 tx=0x7f5cbc00c3a0 comp rx=0 tx=0).stop 2023-11-28T13:02:13.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.966+0000 7f5ccb31b700 1 -- 172.21.15.82:0/2405753482 shutdown_connections 2023-11-28T13:02:13.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.966+0000 7f5ccb31b700 1 --2- 172.21.15.82:0/2405753482 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5ca8064ee0 0x7f5ca8067390 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:13.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.966+0000 7f5ccb31b700 1 --2- 172.21.15.82:0/2405753482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cc41591c0 0x7f5cc414cbc0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:13.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.966+0000 7f5ccb31b700 1 --2- 172.21.15.82:0/2405753482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cc4158df0 0x7f5cc4159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:13.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.966+0000 7f5ccb31b700 1 --2- 172.21.15.82:0/2405753482 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5cc4070070 0x7f5cc415b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:13.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.966+0000 7f5ccb31b700 1 -- 172.21.15.82:0/2405753482 >> 172.21.15.82:0/2405753482 conn(0x7f5cc40ce600 msgr2=0x7f5cc406dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:13.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.966+0000 7f5ccb31b700 1 -- 172.21.15.82:0/2405753482 shutdown_connections 2023-11-28T13:02:13.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:13.966+0000 7f5ccb31b700 1 -- 172.21.15.82:0/2405753482 wait complete. 2023-11-28T13:02:13.984 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2023-11-28T13:02:13.984 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2023-11-28T13:02:13.984 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T13:02:13.985 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2023-11-28T13:02:14.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d97fff700 1 Processor -- start 2023-11-28T13:02:14.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d97fff700 1 -- start start 2023-11-28T13:02:14.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d97fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d980c1910 0x7f6d9816b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:14.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d97fff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d980ce030 con 0x7f6d98160900 2023-11-28T13:02:14.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d97fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d980ce310 con 0x7f6d98070070 2023-11-28T13:02:14.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d97fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9806a5d0 con 0x7f6d980c1910 2023-11-28T13:02:14.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d967fc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6d98160900 0x7f6d980cc1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48532/0 (socket says 172.21.15.82:48532) 2023-11-28T13:02:14.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d967fc700 1 -- 172.21.15.82:0/2164577456 learned_addr learned my addr 172.21.15.82:0/2164577456 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:14.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d977fe700 1 --2- 172.21.15.82:0/2164577456 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d980c1910 0x7f6d9816b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:14.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d95ffb700 1 -- 172.21.15.82:0/2164577456 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2433486357 0 0) 0x7f6d980ce030 con 0x7f6d98160900 2023-11-28T13:02:14.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d95ffb700 1 -- 172.21.15.82:0/2164577456 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d840035d0 con 0x7f6d98160900 2023-11-28T13:02:14.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d95ffb700 1 -- 172.21.15.82:0/2164577456 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880232787 0 0) 0x7f6d980ce310 con 0x7f6d98070070 2023-11-28T13:02:14.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d977fe700 1 -- 172.21.15.82:0/2164577456 >> v1:172.21.15.114:6789/0 conn(0x7f6d98070070 legacy=0x7f6d98070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:14.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d977fe700 1 -- 172.21.15.82:0/2164577456 >> v1:172.21.15.82:6789/0 conn(0x7f6d98160900 legacy=0x7f6d980cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:14.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d977fe700 1 -- 172.21.15.82:0/2164577456 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9806a8b0 con 0x7f6d980c1910 2023-11-28T13:02:14.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d977fe700 1 --2- 172.21.15.82:0/2164577456 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d980c1910 0x7f6d9816b570 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6d90009880 tx=0x7f6d90009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91d35e95d0827a7c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:14.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d95ffb700 1 -- 172.21.15.82:0/2164577456 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d880019f0 con 0x7f6d980c1910 2023-11-28T13:02:14.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d95ffb700 1 -- 172.21.15.82:0/2164577456 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d90010590 con 0x7f6d980c1910 2023-11-28T13:02:14.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d95ffb700 1 -- 172.21.15.82:0/2164577456 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d90010940 con 0x7f6d980c1910 2023-11-28T13:02:14.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d97fff700 1 -- 172.21.15.82:0/2164577456 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d980c1910 msgr2=0x7f6d9816b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:14.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d97fff700 1 --2- 172.21.15.82:0/2164577456 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d980c1910 0x7f6d9816b570 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6d90009880 tx=0x7f6d90009b90 comp rx=0 tx=0).stop 2023-11-28T13:02:14.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d97fff700 1 -- 172.21.15.82:0/2164577456 shutdown_connections 2023-11-28T13:02:14.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d97fff700 1 --2- 172.21.15.82:0/2164577456 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d980c1910 0x7f6d9816b570 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:14.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.106+0000 7f6d97fff700 1 -- 172.21.15.82:0/2164577456 >> 172.21.15.82:0/2164577456 conn(0x7f6d980ce600 msgr2=0x7f6d980ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:14.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.110+0000 7f6d97fff700 1 -- 172.21.15.82:0/2164577456 shutdown_connections 2023-11-28T13:02:14.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.110+0000 7f6d97fff700 1 -- 172.21.15.82:0/2164577456 wait complete. 2023-11-28T13:02:14.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.110+0000 7f6d97fff700 1 Processor -- start 2023-11-28T13:02:14.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.110+0000 7f6d97fff700 1 -- start start 2023-11-28T13:02:14.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.110+0000 7f6d97fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d98070070 0x7f6d981f6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:14.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.110+0000 7f6d97fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d980c83a0 0x7f6d98163660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:14.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.110+0000 7f6d97fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d9815c670 0x7f6d9815cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:14.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.110+0000 7f6d97fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9815d050 con 0x7f6d980c83a0 2023-11-28T13:02:14.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.110+0000 7f6d97fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d98161790 con 0x7f6d98070070 2023-11-28T13:02:14.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.110+0000 7f6d97fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d98161a00 con 0x7f6d9815c670 2023-11-28T13:02:14.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.110+0000 7f6d967fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d980c83a0 0x7f6d98163660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:14.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.110+0000 7f6d967fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d980c83a0 0x7f6d98163660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49452/0 (socket says 172.21.15.82:49452) 2023-11-28T13:02:14.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.110+0000 7f6d967fc700 1 -- 172.21.15.82:0/3582884512 learned_addr learned my addr 172.21.15.82:0/3582884512 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:14.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.110+0000 7f6d977fe700 1 --2- 172.21.15.82:0/3582884512 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d9815c670 0x7f6d9815cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:14.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.110+0000 7f6d96ffd700 1 --2- 172.21.15.82:0/3582884512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d98070070 0x7f6d981f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:14.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.110+0000 7f6d967fc700 1 -- 172.21.15.82:0/3582884512 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d9815c670 msgr2=0x7f6d9815cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:14.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.110+0000 7f6d967fc700 1 --2- 172.21.15.82:0/3582884512 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d9815c670 0x7f6d9815cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:14.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.114+0000 7f6d967fc700 1 -- 172.21.15.82:0/3582884512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d98070070 msgr2=0x7f6d981f6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:14.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.114+0000 7f6d967fc700 1 --2- 172.21.15.82:0/3582884512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d98070070 0x7f6d981f6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:14.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.114+0000 7f6d967fc700 1 -- 172.21.15.82:0/3582884512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d900094b0 con 0x7f6d980c83a0 2023-11-28T13:02:14.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.114+0000 7f6d96ffd700 1 --2- 172.21.15.82:0/3582884512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d98070070 0x7f6d981f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:02:14.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.114+0000 7f6d967fc700 1 --2- 172.21.15.82:0/3582884512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d980c83a0 0x7f6d98163660 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6d880020e0 tx=0x7f6d8800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:14.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.114+0000 7f6d8ffff700 1 -- 172.21.15.82:0/3582884512 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8800acb0 con 0x7f6d980c83a0 2023-11-28T13:02:14.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.114+0000 7f6d8ffff700 1 -- 172.21.15.82:0/3582884512 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8800ae30 con 0x7f6d980c83a0 2023-11-28T13:02:14.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.114+0000 7f6d97fff700 1 -- 172.21.15.82:0/3582884512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d980cdc50 con 0x7f6d980c83a0 2023-11-28T13:02:14.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.114+0000 7f6d8ffff700 1 -- 172.21.15.82:0/3582884512 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d88007310 con 0x7f6d980c83a0 2023-11-28T13:02:14.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.114+0000 7f6d97fff700 1 -- 172.21.15.82:0/3582884512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9806ab90 con 0x7f6d980c83a0 2023-11-28T13:02:14.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.114+0000 7f6d97fff700 1 -- 172.21.15.82:0/3582884512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d980cdde0 con 0x7f6d980c83a0 2023-11-28T13:02:14.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.114+0000 7f6d8ffff700 1 -- 172.21.15.82:0/3582884512 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6d8801a030 con 0x7f6d980c83a0 2023-11-28T13:02:14.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.118+0000 7f6d8ffff700 1 --2- 172.21.15.82:0/3582884512 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6d78064ee0 0x7f6d78067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:14.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.118+0000 7f6d8ffff700 1 -- 172.21.15.82:0/3582884512 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f6d880819d0 con 0x7f6d980c83a0 2023-11-28T13:02:14.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.118+0000 7f6d96ffd700 1 --2- 172.21.15.82:0/3582884512 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6d78064ee0 0x7f6d78067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:14.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.118+0000 7f6d96ffd700 1 --2- 172.21.15.82:0/3582884512 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6d78064ee0 0x7f6d78067390 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6d80000f60 tx=0x7f6d80009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:14.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.122+0000 7f6d8ffff700 1 -- 172.21.15.82:0/3582884512 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6d8804fe70 con 0x7f6d980c83a0 2023-11-28T13:02:14.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.346+0000 7f6d97fff700 1 -- 172.21.15.82:0/3582884512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7f6d98065fc0 con 0x7f6d980c83a0 2023-11-28T13:02:14.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.962+0000 7f6d8ffff700 1 -- 172.21.15.82:0/3582884512 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v114) v1 ==== 152+0+0 (secure 0 0 0) 0x7f6d88053490 con 0x7f6d980c83a0 2023-11-28T13:02:14.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.966+0000 7f6d97fff700 1 -- 172.21.15.82:0/3582884512 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6d78064ee0 msgr2=0x7f6d78067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:14.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.966+0000 7f6d97fff700 1 --2- 172.21.15.82:0/3582884512 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6d78064ee0 0x7f6d78067390 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6d80000f60 tx=0x7f6d80009040 comp rx=0 tx=0).stop 2023-11-28T13:02:14.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.966+0000 7f6d97fff700 1 -- 172.21.15.82:0/3582884512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d980c83a0 msgr2=0x7f6d98163660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:14.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.966+0000 7f6d97fff700 1 --2- 172.21.15.82:0/3582884512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d980c83a0 0x7f6d98163660 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6d880020e0 tx=0x7f6d8800a340 comp rx=0 tx=0).stop 2023-11-28T13:02:14.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.966+0000 7f6d97fff700 1 -- 172.21.15.82:0/3582884512 shutdown_connections 2023-11-28T13:02:14.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.966+0000 7f6d97fff700 1 --2- 172.21.15.82:0/3582884512 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6d78064ee0 0x7f6d78067390 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:14.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.966+0000 7f6d97fff700 1 --2- 172.21.15.82:0/3582884512 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d9815c670 0x7f6d9815cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:14.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.966+0000 7f6d97fff700 1 --2- 172.21.15.82:0/3582884512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d980c83a0 0x7f6d98163660 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:14.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.966+0000 7f6d97fff700 1 --2- 172.21.15.82:0/3582884512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d98070070 0x7f6d981f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:14.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.966+0000 7f6d97fff700 1 -- 172.21.15.82:0/3582884512 >> 172.21.15.82:0/3582884512 conn(0x7f6d980ce600 msgr2=0x7f6d98070440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:14.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.966+0000 7f6d97fff700 1 -- 172.21.15.82:0/3582884512 shutdown_connections 2023-11-28T13:02:14.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:14.970+0000 7f6d97fff700 1 -- 172.21.15.82:0/3582884512 wait complete. 2023-11-28T13:02:14.989 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T13:02:15.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.114+0000 7ff4b952b700 1 Processor -- start 2023-11-28T13:02:15.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.114+0000 7ff4b952b700 1 -- start start 2023-11-28T13:02:15.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b952b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4b41578a0 0x7ff4b40afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:15.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b952b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b415abf0 con 0x7ff4b406de30 2023-11-28T13:02:15.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b952b700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b415aed0 con 0x7ff4b415a480 2023-11-28T13:02:15.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b952b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b40b00b0 con 0x7ff4b41578a0 2023-11-28T13:02:15.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b8d2a700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff4b406de30 0x7ff4b406fce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48544/0 (socket says 172.21.15.82:48544) 2023-11-28T13:02:15.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b8d2a700 1 -- 172.21.15.82:0/188941951 learned_addr learned my addr 172.21.15.82:0/188941951 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b3fff700 1 --2- 172.21.15.82:0/188941951 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4b41578a0 0x7ff4b40afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b2ffd700 1 -- 172.21.15.82:0/188941951 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85905521 0 0) 0x7ff4b415abf0 con 0x7ff4b406de30 2023-11-28T13:02:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b2ffd700 1 -- 172.21.15.82:0/188941951 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff49c0035d0 con 0x7ff4b406de30 2023-11-28T13:02:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b2ffd700 1 -- 172.21.15.82:0/188941951 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1935995856 0 0) 0x7ff4b415aed0 con 0x7ff4b415a480 2023-11-28T13:02:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b2ffd700 1 -- 172.21.15.82:0/188941951 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4b415abf0 con 0x7ff4b415a480 2023-11-28T13:02:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b3fff700 1 -- 172.21.15.82:0/188941951 >> v1:172.21.15.114:6789/0 conn(0x7ff4b415a480 legacy=0x7ff4b40ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b3fff700 1 -- 172.21.15.82:0/188941951 >> v1:172.21.15.82:6789/0 conn(0x7ff4b406de30 legacy=0x7ff4b406fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b2ffd700 1 -- 172.21.15.82:0/188941951 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1608366165 0 0) 0x7ff49c0035d0 con 0x7ff4b406de30 2023-11-28T13:02:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b3fff700 1 -- 172.21.15.82:0/188941951 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b415b1b0 con 0x7ff4b41578a0 2023-11-28T13:02:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b3fff700 1 --2- 172.21.15.82:0/188941951 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4b41578a0 0x7ff4b40afb70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009880 tx=0x7ff4a4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9827531f1ae94b93 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:15.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b2ffd700 1 -- 172.21.15.82:0/188941951 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4011830 con 0x7ff4b41578a0 2023-11-28T13:02:15.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b2ffd700 1 -- 172.21.15.82:0/188941951 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a4011990 con 0x7ff4b41578a0 2023-11-28T13:02:15.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b2ffd700 1 -- 172.21.15.82:0/188941951 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4011d20 con 0x7ff4b41578a0 2023-11-28T13:02:15.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b952b700 1 -- 172.21.15.82:0/188941951 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4b41578a0 msgr2=0x7ff4b40afb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:15.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b952b700 1 --2- 172.21.15.82:0/188941951 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4b41578a0 0x7ff4b40afb70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009880 tx=0x7ff4a4009b90 comp rx=0 tx=0).stop 2023-11-28T13:02:15.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b952b700 1 -- 172.21.15.82:0/188941951 shutdown_connections 2023-11-28T13:02:15.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b952b700 1 --2- 172.21.15.82:0/188941951 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4b41578a0 0x7ff4b40afb70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:15.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b952b700 1 -- 172.21.15.82:0/188941951 >> 172.21.15.82:0/188941951 conn(0x7ff4b40d07e0 msgr2=0x7ff4b40d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:15.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b952b700 1 -- 172.21.15.82:0/188941951 shutdown_connections 2023-11-28T13:02:15.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.118+0000 7ff4b952b700 1 -- 172.21.15.82:0/188941951 wait complete. 2023-11-28T13:02:15.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.122+0000 7ff4b952b700 1 Processor -- start 2023-11-28T13:02:15.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.122+0000 7ff4b952b700 1 -- start start 2023-11-28T13:02:15.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.122+0000 7ff4b952b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4b406de30 0x7ff4b41f02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:15.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.122+0000 7ff4b952b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4b41578a0 0x7ff4b40b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:15.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.122+0000 7ff4b952b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4b415a480 0x7ff4b40b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:15.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.122+0000 7ff4b952b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b41f0820 con 0x7ff4b41578a0 2023-11-28T13:02:15.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.122+0000 7ff4b952b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b41f3400 con 0x7ff4b406de30 2023-11-28T13:02:15.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.122+0000 7ff4b952b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b41f36e0 con 0x7ff4b415a480 2023-11-28T13:02:15.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.122+0000 7ff4b37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4b41578a0 0x7ff4b40b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:15.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.122+0000 7ff4b3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4b406de30 0x7ff4b41f02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:15.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.122+0000 7ff4b8d2a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4b415a480 0x7ff4b40b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:15.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.122+0000 7ff4b37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4b41578a0 0x7ff4b40b3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49462/0 (socket says 172.21.15.82:49462) 2023-11-28T13:02:15.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.122+0000 7ff4b37fe700 1 -- 172.21.15.82:0/4163206277 learned_addr learned my addr 172.21.15.82:0/4163206277 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:15.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.126+0000 7ff4b3fff700 1 -- 172.21.15.82:0/4163206277 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4b415a480 msgr2=0x7ff4b40b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:15.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.126+0000 7ff4b3fff700 1 --2- 172.21.15.82:0/4163206277 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4b415a480 0x7ff4b40b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:15.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.126+0000 7ff4b3fff700 1 -- 172.21.15.82:0/4163206277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4b41578a0 msgr2=0x7ff4b40b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:15.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.126+0000 7ff4b3fff700 1 --2- 172.21.15.82:0/4163206277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4b41578a0 0x7ff4b40b3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:15.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.126+0000 7ff4b3fff700 1 -- 172.21.15.82:0/4163206277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a40094b0 con 0x7ff4b406de30 2023-11-28T13:02:15.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.126+0000 7ff4b37fe700 1 --2- 172.21.15.82:0/4163206277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4b41578a0 0x7ff4b40b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:02:15.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.126+0000 7ff4b8d2a700 1 --2- 172.21.15.82:0/4163206277 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4b415a480 0x7ff4b40b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:02:15.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.126+0000 7ff4b3fff700 1 --2- 172.21.15.82:0/4163206277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4b406de30 0x7ff4b41f02e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4015000 tx=0x7ff4a4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:15.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.126+0000 7ff4b0ff9700 1 -- 172.21.15.82:0/4163206277 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a401a8c0 con 0x7ff4b406de30 2023-11-28T13:02:15.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.126+0000 7ff4b0ff9700 1 -- 172.21.15.82:0/4163206277 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a401e070 con 0x7ff4b406de30 2023-11-28T13:02:15.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.126+0000 7ff4b952b700 1 -- 172.21.15.82:0/4163206277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b415a8d0 con 0x7ff4b406de30 2023-11-28T13:02:15.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.126+0000 7ff4b0ff9700 1 -- 172.21.15.82:0/4163206277 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a401aca0 con 0x7ff4b406de30 2023-11-28T13:02:15.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.126+0000 7ff4b952b700 1 -- 172.21.15.82:0/4163206277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b406d910 con 0x7ff4b406de30 2023-11-28T13:02:15.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.126+0000 7ff4b952b700 1 -- 172.21.15.82:0/4163206277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b40ceac0 con 0x7ff4b406de30 2023-11-28T13:02:15.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.130+0000 7ff4b0ff9700 1 -- 172.21.15.82:0/4163206277 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff4a400f050 con 0x7ff4b406de30 2023-11-28T13:02:15.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.130+0000 7ff4b0ff9700 1 --2- 172.21.15.82:0/4163206277 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff4a0064ee0 0x7ff4a0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:15.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.130+0000 7ff4b0ff9700 1 -- 172.21.15.82:0/4163206277 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff4a4082970 con 0x7ff4b406de30 2023-11-28T13:02:15.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.130+0000 7ff4b37fe700 1 --2- 172.21.15.82:0/4163206277 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff4a0064ee0 0x7ff4a0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:15.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.130+0000 7ff4b37fe700 1 --2- 172.21.15.82:0/4163206277 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff4a0064ee0 0x7ff4a0067390 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff4b40c6d40 tx=0x7ff4a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:15.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.138+0000 7ff4b0ff9700 1 -- 172.21.15.82:0/4163206277 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff4a4050e10 con 0x7ff4b406de30 2023-11-28T13:02:15.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.306+0000 7ff4b952b700 1 -- 172.21.15.82:0/4163206277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff4b41f3820 con 0x7ff4b406de30 2023-11-28T13:02:15.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.318+0000 7ff4b0ff9700 1 -- 172.21.15.82:0/4163206277 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff4b41f3820 con 0x7ff4b406de30 2023-11-28T13:02:15.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.318+0000 7ff4b952b700 1 -- 172.21.15.82:0/4163206277 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff4a0064ee0 msgr2=0x7ff4a0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:15.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.318+0000 7ff4b952b700 1 --2- 172.21.15.82:0/4163206277 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff4a0064ee0 0x7ff4a0067390 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff4b40c6d40 tx=0x7ff4a8009040 comp rx=0 tx=0).stop 2023-11-28T13:02:15.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.318+0000 7ff4b952b700 1 -- 172.21.15.82:0/4163206277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4b406de30 msgr2=0x7ff4b41f02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:15.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.318+0000 7ff4b952b700 1 --2- 172.21.15.82:0/4163206277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4b406de30 0x7ff4b41f02e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4015000 tx=0x7ff4a4004770 comp rx=0 tx=0).stop 2023-11-28T13:02:15.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.318+0000 7ff4b952b700 1 -- 172.21.15.82:0/4163206277 shutdown_connections 2023-11-28T13:02:15.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.318+0000 7ff4b952b700 1 --2- 172.21.15.82:0/4163206277 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff4a0064ee0 0x7ff4a0067390 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:15.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.318+0000 7ff4b952b700 1 --2- 172.21.15.82:0/4163206277 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4b415a480 0x7ff4b40b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:15.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.318+0000 7ff4b952b700 1 --2- 172.21.15.82:0/4163206277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4b41578a0 0x7ff4b40b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:15.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.318+0000 7ff4b952b700 1 --2- 172.21.15.82:0/4163206277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4b406de30 0x7ff4b41f02e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:15.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.318+0000 7ff4b952b700 1 -- 172.21.15.82:0/4163206277 >> 172.21.15.82:0/4163206277 conn(0x7ff4b40d07e0 msgr2=0x7ff4b4159c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:15.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.318+0000 7ff4b952b700 1 -- 172.21.15.82:0/4163206277 shutdown_connections 2023-11-28T13:02:15.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.318+0000 7ff4b952b700 1 -- 172.21.15.82:0/4163206277 wait complete. 2023-11-28T13:02:15.338 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T13:02:15.338 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T13:02:15.357 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T13:02:15.379 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T13:02:15.380 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:02:15.380 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:02:15.387 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346276k,nr_inodes=4086569,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=221 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275484k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T13:02:15.387 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:02:15.387 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:02:15.395 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19664 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T13:02:15.395 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:02:15.395 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:02:15.437 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346276k,nr_inodes=4086569,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=221 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275484k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T13:02:15.438 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:02:15.438 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:02:15.445 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19664 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T13:02:15.445 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T13:02:15.445 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:02:15.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.562+0000 7f49226f5700 1 Processor -- start 2023-11-28T13:02:15.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.562+0000 7f49226f5700 1 -- start start 2023-11-28T13:02:15.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f49226f5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f491c070070 0x7f491c070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:15.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f49226f5700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f491c0c1910 0x7f491c06c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:15.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f49226f5700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491c070980 con 0x7f491c160900 2023-11-28T13:02:15.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f49226f5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491c0ce030 con 0x7f491c070070 2023-11-28T13:02:15.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f49226f5700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491c0ce310 con 0x7f491c0c1910 2023-11-28T13:02:15.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f49216f3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f491c070070 0x7f491c070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:15.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f49216f3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f491c070070 0x7f491c070440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49470/0 (socket says 172.21.15.82:49470) 2023-11-28T13:02:15.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f49216f3700 1 -- 172.21.15.82:0/3586057251 learned_addr learned my addr 172.21.15.82:0/3586057251 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:15.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f4921ef4700 1 --2- 172.21.15.82:0/3586057251 >> v2:172.21.15.114:3300/0 conn(0x7f491c0c1910 0x7f491c06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:15.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f49216f3700 1 -- 172.21.15.82:0/3586057251 >> v2:172.21.15.114:3300/0 conn(0x7f491c0c1910 msgr2=0x7f491c06c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:15.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f49216f3700 1 --2- 172.21.15.82:0/3586057251 >> v2:172.21.15.114:3300/0 conn(0x7f491c0c1910 0x7f491c06c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:15.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f49216f3700 1 -- 172.21.15.82:0/3586057251 >> v1:172.21.15.114:6789/0 conn(0x7f491c160900 legacy=0x7f491c0cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:15.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f49216f3700 1 -- 172.21.15.82:0/3586057251 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c06a5d0 con 0x7f491c070070 2023-11-28T13:02:15.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f49216f3700 1 --2- 172.21.15.82:0/3586057251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f491c070070 0x7f491c070440 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f491c0b4530 tx=0x7f491400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54eb2bd6636acd35 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:15.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f4913fff700 1 -- 172.21.15.82:0/3586057251 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491400e070 con 0x7f491c070070 2023-11-28T13:02:15.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f4913fff700 1 -- 172.21.15.82:0/3586057251 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4914003a40 con 0x7f491c070070 2023-11-28T13:02:15.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f4913fff700 1 -- 172.21.15.82:0/3586057251 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4914003df0 con 0x7f491c070070 2023-11-28T13:02:15.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f49226f5700 1 -- 172.21.15.82:0/3586057251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f491c070070 msgr2=0x7f491c070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:15.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f49226f5700 1 --2- 172.21.15.82:0/3586057251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f491c070070 0x7f491c070440 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f491c0b4530 tx=0x7f491400b330 comp rx=0 tx=0).stop 2023-11-28T13:02:15.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f49226f5700 1 -- 172.21.15.82:0/3586057251 shutdown_connections 2023-11-28T13:02:15.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f49226f5700 1 --2- 172.21.15.82:0/3586057251 >> v2:172.21.15.114:3300/0 conn(0x7f491c0c1910 0x7f491c06c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:15.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f49226f5700 1 --2- 172.21.15.82:0/3586057251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f491c070070 0x7f491c070440 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:15.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f49226f5700 1 -- 172.21.15.82:0/3586057251 >> 172.21.15.82:0/3586057251 conn(0x7f491c0ce600 msgr2=0x7f491c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:15.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f49226f5700 1 -- 172.21.15.82:0/3586057251 shutdown_connections 2023-11-28T13:02:15.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.566+0000 7f49226f5700 1 -- 172.21.15.82:0/3586057251 wait complete. 2023-11-28T13:02:15.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f49226f5700 1 Processor -- start 2023-11-28T13:02:15.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f49226f5700 1 -- start start 2023-11-28T13:02:15.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f49226f5700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f491c070070 0x7f491c1fa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:15.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f49226f5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f491c1637b0 0x7f491c15a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:15.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f49226f5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f491c0b2e10 0x7f491c0b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:15.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f49226f5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c0c5030 con 0x7f491c1637b0 2023-11-28T13:02:15.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f49226f5700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c0b37c0 con 0x7f491c0b2e10 2023-11-28T13:02:15.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f49226f5700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c1fadb0 con 0x7f491c070070 2023-11-28T13:02:15.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f4920ef2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f491c1637b0 0x7f491c15a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:15.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f4920ef2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f491c1637b0 0x7f491c15a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49476/0 (socket says 172.21.15.82:49476) 2023-11-28T13:02:15.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f4920ef2700 1 -- 172.21.15.82:0/1088446854 learned_addr learned my addr 172.21.15.82:0/1088446854 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:15.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f4921ef4700 1 --2- 172.21.15.82:0/1088446854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f491c0b2e10 0x7f491c0b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:15.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f49216f3700 1 --2- 172.21.15.82:0/1088446854 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f491c070070 0x7f491c1fa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:15.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f4920ef2700 1 -- 172.21.15.82:0/1088446854 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f491c070070 msgr2=0x7f491c1fa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:15.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f4920ef2700 1 --2- 172.21.15.82:0/1088446854 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f491c070070 0x7f491c1fa870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:15.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f4920ef2700 1 -- 172.21.15.82:0/1088446854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f491c0b2e10 msgr2=0x7f491c0b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:15.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f4920ef2700 1 --2- 172.21.15.82:0/1088446854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f491c0b2e10 0x7f491c0b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:15.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f4920ef2700 1 -- 172.21.15.82:0/1088446854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4914009b30 con 0x7f491c1637b0 2023-11-28T13:02:15.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f49216f3700 1 --2- 172.21.15.82:0/1088446854 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f491c070070 0x7f491c1fa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:15.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f4920ef2700 1 --2- 172.21.15.82:0/1088446854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f491c1637b0 0x7f491c15a270 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f490c00c510 tx=0x7f490c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:15.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f4911ffb700 1 -- 172.21.15.82:0/1088446854 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c011790 con 0x7f491c1637b0 2023-11-28T13:02:15.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f4911ffb700 1 -- 172.21.15.82:0/1088446854 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490c011910 con 0x7f491c1637b0 2023-11-28T13:02:15.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f49226f5700 1 -- 172.21.15.82:0/1088446854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491c06ab90 con 0x7f491c1637b0 2023-11-28T13:02:15.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f4911ffb700 1 -- 172.21.15.82:0/1088446854 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c011cc0 con 0x7f491c1637b0 2023-11-28T13:02:15.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.570+0000 7f49226f5700 1 -- 172.21.15.82:0/1088446854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491c06a8b0 con 0x7f491c1637b0 2023-11-28T13:02:15.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.574+0000 7f49226f5700 1 -- 172.21.15.82:0/1088446854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491c0cdc50 con 0x7f491c1637b0 2023-11-28T13:02:15.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.574+0000 7f4911ffb700 1 -- 172.21.15.82:0/1088446854 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f490c010050 con 0x7f491c1637b0 2023-11-28T13:02:15.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.574+0000 7f4911ffb700 1 --2- 172.21.15.82:0/1088446854 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4900064ee0 0x7f4900067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:15.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.574+0000 7f4911ffb700 1 -- 172.21.15.82:0/1088446854 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f490c0817c0 con 0x7f491c1637b0 2023-11-28T13:02:15.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.574+0000 7f49216f3700 1 --2- 172.21.15.82:0/1088446854 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4900064ee0 0x7f4900067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:15.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.578+0000 7f49216f3700 1 --2- 172.21.15.82:0/1088446854 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4900064ee0 0x7f4900067390 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4914000f80 tx=0x7f4914009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:15.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.582+0000 7f4911ffb700 1 -- 172.21.15.82:0/1088446854 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f490c04fc60 con 0x7f491c1637b0 2023-11-28T13:02:15.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.782+0000 7f49226f5700 1 -- 172.21.15.82:0/1088446854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f491c06e8c0 con 0x7f491c1637b0 2023-11-28T13:02:15.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.782+0000 7f4911ffb700 1 -- 172.21.15.82:0/1088446854 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f490c053280 con 0x7f491c1637b0 2023-11-28T13:02:15.784 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:15.784 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":16,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2975361458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2975361458},{"type":"v1","addr":"172.21.15.114:6833","nonce":2975361458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3412196002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3412196002},{"type":"v1","addr":"172.21.15.114:6835","nonce":3412196002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/167093290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":167093290},{"type":"v1","addr":"172.21.15.82:6835","nonce":167093290}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4150520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4150520914},{"type":"v1","addr":"172.21.15.82:6837","nonce":4150520914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[]} 2023-11-28T13:02:15.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.782+0000 7f49226f5700 1 -- 172.21.15.82:0/1088446854 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4900064ee0 msgr2=0x7f4900067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:15.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.782+0000 7f49226f5700 1 --2- 172.21.15.82:0/1088446854 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4900064ee0 0x7f4900067390 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4914000f80 tx=0x7f4914009000 comp rx=0 tx=0).stop 2023-11-28T13:02:15.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.782+0000 7f49226f5700 1 -- 172.21.15.82:0/1088446854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f491c1637b0 msgr2=0x7f491c15a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:15.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.782+0000 7f49226f5700 1 --2- 172.21.15.82:0/1088446854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f491c1637b0 0x7f491c15a270 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f490c00c510 tx=0x7f490c00c820 comp rx=0 tx=0).stop 2023-11-28T13:02:15.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.782+0000 7f49226f5700 1 -- 172.21.15.82:0/1088446854 shutdown_connections 2023-11-28T13:02:15.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.782+0000 7f49226f5700 1 --2- 172.21.15.82:0/1088446854 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4900064ee0 0x7f4900067390 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:15.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.782+0000 7f49226f5700 1 --2- 172.21.15.82:0/1088446854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f491c0b2e10 0x7f491c0b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:15.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.782+0000 7f49226f5700 1 --2- 172.21.15.82:0/1088446854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f491c1637b0 0x7f491c15a270 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:15.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.782+0000 7f49226f5700 1 --2- 172.21.15.82:0/1088446854 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f491c070070 0x7f491c1fa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:15.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.786+0000 7f49226f5700 1 -- 172.21.15.82:0/1088446854 >> 172.21.15.82:0/1088446854 conn(0x7f491c0ce600 msgr2=0x7f491c0aef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:15.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.786+0000 7f49226f5700 1 -- 172.21.15.82:0/1088446854 shutdown_connections 2023-11-28T13:02:15.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.786+0000 7f49226f5700 1 -- 172.21.15.82:0/1088446854 wait complete. 2023-11-28T13:02:15.788 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 16 2023-11-28T13:02:15.798 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T13:02:15.798 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T13:02:15.799 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T13:02:15.799 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:02:15.799 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T13:02:15.799 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T13:02:15.799 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T13:02:15.800 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:02:15.800 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T13:02:15.800 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T13:02:15.800 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T13:02:15.800 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:02:15.801 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T13:02:15.801 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T13:02:15.801 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T13:02:15.801 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:02:15.809 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T13:02:15.809 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T13:02:15.813 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T13:02:15.813 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T13:02:15.816 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T13:02:15.817 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T13:02:15.818 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T13:02:15.818 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T13:02:15.855 INFO:tasks.ceph.mds.a:Started 2023-11-28T13:02:15.856 DEBUG:teuthology.parallel:result is None 2023-11-28T13:02:15.857 INFO:tasks.ceph.mds.c:Started 2023-11-28T13:02:15.857 DEBUG:teuthology.parallel:result is None 2023-11-28T13:02:15.859 INFO:tasks.ceph.mds.b:Started 2023-11-28T13:02:15.859 DEBUG:teuthology.parallel:result is None 2023-11-28T13:02:15.860 INFO:tasks.ceph.mds.d:Started 2023-11-28T13:02:15.860 DEBUG:teuthology.parallel:result is None 2023-11-28T13:02:15.860 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T13:02:15.944 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-11-28T13:02:15.944 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-11-28T13:02:15.945 INFO:tasks.ceph.mds.b.smithi114.stdout:starting mds.b at 2023-11-28T13:02:15.945 INFO:tasks.ceph.mds.d.smithi114.stdout:starting mds.d at 2023-11-28T13:02:15.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.966+0000 7f4de910a700 1 Processor -- start 2023-11-28T13:02:15.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.966+0000 7f4de910a700 1 -- start start 2023-11-28T13:02:15.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.966+0000 7f4de910a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4de4158df0 0x7f4de415d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:15.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.966+0000 7f4de910a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de415da50 con 0x7f4de4070070 2023-11-28T13:02:15.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.966+0000 7f4de910a700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de40c9e20 con 0x7f4de41591c0 2023-11-28T13:02:15.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.966+0000 7f4de910a700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de40cc640 con 0x7f4de4158df0 2023-11-28T13:02:15.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.966+0000 7f4de3fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4de4158df0 0x7f4de415d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:15.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.966+0000 7f4de3fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4de4158df0 0x7f4de415d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49490/0 (socket says 172.21.15.82:49490) 2023-11-28T13:02:15.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.966+0000 7f4de3fff700 1 -- 172.21.15.82:0/547439312 learned_addr learned my addr 172.21.15.82:0/547439312 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:15.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.966+0000 7f4de8909700 1 --1- 172.21.15.82:0/547439312 >> v1:172.21.15.82:6789/0 conn(0x7f4de4070070 0x7f4de40ca2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48564/0 (socket says 172.21.15.82:48564) 2023-11-28T13:02:15.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.966+0000 7f4de3fff700 1 -- 172.21.15.82:0/547439312 >> v1:172.21.15.114:6789/0 conn(0x7f4de41591c0 legacy=0x7f4de406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:15.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.966+0000 7f4de3fff700 1 -- 172.21.15.82:0/547439312 >> v1:172.21.15.82:6789/0 conn(0x7f4de4070070 legacy=0x7f4de40ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:15.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.966+0000 7f4de3fff700 1 -- 172.21.15.82:0/547439312 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de40c97d0 con 0x7f4de4158df0 2023-11-28T13:02:15.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.966+0000 7f4de3fff700 1 --2- 172.21.15.82:0/547439312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4de4158df0 0x7f4de415d510 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc009e50 tx=0x7f4ddc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8bb6788cc2ad9e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:15.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.966+0000 7f4de2ffd700 1 -- 172.21.15.82:0/547439312 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc00e070 con 0x7f4de4158df0 2023-11-28T13:02:15.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.966+0000 7f4de2ffd700 1 -- 172.21.15.82:0/547439312 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ddc003a40 con 0x7f4de4158df0 2023-11-28T13:02:15.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.970+0000 7f4de2ffd700 1 -- 172.21.15.82:0/547439312 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc003df0 con 0x7f4de4158df0 2023-11-28T13:02:15.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.970+0000 7f4de910a700 1 -- 172.21.15.82:0/547439312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4de4158df0 msgr2=0x7f4de415d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:15.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.970+0000 7f4de910a700 1 --2- 172.21.15.82:0/547439312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4de4158df0 0x7f4de415d510 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc009e50 tx=0x7f4ddc00b330 comp rx=0 tx=0).stop 2023-11-28T13:02:15.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.970+0000 7f4de910a700 1 -- 172.21.15.82:0/547439312 shutdown_connections 2023-11-28T13:02:15.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.970+0000 7f4de910a700 1 --2- 172.21.15.82:0/547439312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4de4158df0 0x7f4de415d510 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:15.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.970+0000 7f4de910a700 1 -- 172.21.15.82:0/547439312 >> 172.21.15.82:0/547439312 conn(0x7f4de40ce600 msgr2=0x7f4de40ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:15.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.970+0000 7f4de910a700 1 -- 172.21.15.82:0/547439312 shutdown_connections 2023-11-28T13:02:15.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.970+0000 7f4de910a700 1 -- 172.21.15.82:0/547439312 wait complete. 2023-11-28T13:02:15.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.970+0000 7f4de910a700 1 Processor -- start 2023-11-28T13:02:15.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.970+0000 7f4de910a700 1 -- start start 2023-11-28T13:02:15.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.970+0000 7f4de910a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de4070070 0x7f4de40c3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:15.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.970+0000 7f4de910a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4de4158df0 0x7f4de41f1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:15.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.970+0000 7f4de910a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4de41591c0 0x7f4de40c2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:15.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.970+0000 7f4de910a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de40c1f40 con 0x7f4de4158df0 2023-11-28T13:02:15.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.970+0000 7f4de910a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de41f2860 con 0x7f4de4070070 2023-11-28T13:02:15.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.970+0000 7f4de910a700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de41f2b40 con 0x7f4de41591c0 2023-11-28T13:02:15.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.970+0000 7f4de37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4de4158df0 0x7f4de41f1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:15.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.970+0000 7f4de37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4de4158df0 0x7f4de41f1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49506/0 (socket says 172.21.15.82:49506) 2023-11-28T13:02:15.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.970+0000 7f4de37fe700 1 -- 172.21.15.82:0/799489569 learned_addr learned my addr 172.21.15.82:0/799489569 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:15.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.970+0000 7f4de3fff700 1 --2- 172.21.15.82:0/799489569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de4070070 0x7f4de40c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:15.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.970+0000 7f4de8909700 1 --2- 172.21.15.82:0/799489569 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4de41591c0 0x7f4de40c2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:15.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.974+0000 7f4de37fe700 1 -- 172.21.15.82:0/799489569 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4de41591c0 msgr2=0x7f4de40c2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:15.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.974+0000 7f4de37fe700 1 --2- 172.21.15.82:0/799489569 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4de41591c0 0x7f4de40c2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:15.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.974+0000 7f4de37fe700 1 -- 172.21.15.82:0/799489569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de4070070 msgr2=0x7f4de40c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:15.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.974+0000 7f4de37fe700 1 --2- 172.21.15.82:0/799489569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de4070070 0x7f4de40c3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:15.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.974+0000 7f4de37fe700 1 -- 172.21.15.82:0/799489569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc009b30 con 0x7f4de4158df0 2023-11-28T13:02:15.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.974+0000 7f4de37fe700 1 --2- 172.21.15.82:0/799489569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4de4158df0 0x7f4de41f1f60 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800b450 tx=0x7f4dd800b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:15.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.974+0000 7f4de0ff9700 1 -- 172.21.15.82:0/799489569 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd800be60 con 0x7f4de4158df0 2023-11-28T13:02:15.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.974+0000 7f4de910a700 1 -- 172.21.15.82:0/799489569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de40c9480 con 0x7f4de4158df0 2023-11-28T13:02:15.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.974+0000 7f4de910a700 1 -- 172.21.15.82:0/799489569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de40c9ab0 con 0x7f4de4158df0 2023-11-28T13:02:15.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.974+0000 7f4de0ff9700 1 -- 172.21.15.82:0/799489569 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd80092a0 con 0x7f4de4158df0 2023-11-28T13:02:15.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.974+0000 7f4de0ff9700 1 -- 172.21.15.82:0/799489569 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8004220 con 0x7f4de4158df0 2023-11-28T13:02:15.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.974+0000 7f4de910a700 1 -- 172.21.15.82:0/799489569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc4005310 con 0x7f4de4158df0 2023-11-28T13:02:15.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.978+0000 7f4de0ff9700 1 -- 172.21.15.82:0/799489569 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4dd800f050 con 0x7f4de4158df0 2023-11-28T13:02:15.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.978+0000 7f4de0ff9700 1 --2- 172.21.15.82:0/799489569 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4dd0064f10 0x7f4dd00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:15.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.978+0000 7f4de0ff9700 1 -- 172.21.15.82:0/799489569 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4dd8081180 con 0x7f4de4158df0 2023-11-28T13:02:15.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.978+0000 7f4de3fff700 1 --2- 172.21.15.82:0/799489569 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4dd0064f10 0x7f4dd00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:15.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.978+0000 7f4de3fff700 1 --2- 172.21.15.82:0/799489569 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4dd0064f10 0x7f4dd00673c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc015040 tx=0x7f4ddc009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:15.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:15.986+0000 7f4de0ff9700 1 -- 172.21.15.82:0/799489569 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4dd804f530 con 0x7f4de4158df0 2023-11-28T13:02:16.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:16.154+0000 7f4de910a700 1 -- 172.21.15.82:0/799489569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4dc4005b40 con 0x7f4de4158df0 2023-11-28T13:02:17.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.005+0000 7f4de0ff9700 1 -- 172.21.15.82:0/799489569 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v47) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4dd8015080 con 0x7f4de4158df0 2023-11-28T13:02:17.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.009+0000 7f4de910a700 1 -- 172.21.15.82:0/799489569 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4dd0064f10 msgr2=0x7f4dd00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:17.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.009+0000 7f4de910a700 1 --2- 172.21.15.82:0/799489569 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4dd0064f10 0x7f4dd00673c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc015040 tx=0x7f4ddc009000 comp rx=0 tx=0).stop 2023-11-28T13:02:17.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.009+0000 7f4de910a700 1 -- 172.21.15.82:0/799489569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4de4158df0 msgr2=0x7f4de41f1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:17.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.009+0000 7f4de910a700 1 --2- 172.21.15.82:0/799489569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4de4158df0 0x7f4de41f1f60 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800b450 tx=0x7f4dd800b760 comp rx=0 tx=0).stop 2023-11-28T13:02:17.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.009+0000 7f4de910a700 1 -- 172.21.15.82:0/799489569 shutdown_connections 2023-11-28T13:02:17.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.009+0000 7f4de910a700 1 --2- 172.21.15.82:0/799489569 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4dd0064f10 0x7f4dd00673c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.009+0000 7f4de910a700 1 --2- 172.21.15.82:0/799489569 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4de41591c0 0x7f4de40c2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.009+0000 7f4de910a700 1 --2- 172.21.15.82:0/799489569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4de4158df0 0x7f4de41f1f60 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.009+0000 7f4de910a700 1 --2- 172.21.15.82:0/799489569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de4070070 0x7f4de40c3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.009+0000 7f4de910a700 1 -- 172.21.15.82:0/799489569 >> 172.21.15.82:0/799489569 conn(0x7f4de40ce600 msgr2=0x7f4de4152510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:17.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.009+0000 7f4de910a700 1 -- 172.21.15.82:0/799489569 shutdown_connections 2023-11-28T13:02:17.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.009+0000 7f4de910a700 1 -- 172.21.15.82:0/799489569 wait complete. 2023-11-28T13:02:17.014 INFO:teuthology.orchestra.run.smithi082.stderr: removed all blocklist entries 2023-11-28T13:02:17.027 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T13:02:17.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.141+0000 7f5ded31f700 1 Processor -- start 2023-11-28T13:02:17.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.141+0000 7f5ded31f700 1 -- start start 2023-11-28T13:02:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5ded31f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5de8158760 0x7f5de815c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5ded31f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5de8070e40 0x7f5de806ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5ded31f700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de806a9d0 con 0x7f5de80c93d0 2023-11-28T13:02:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5de77fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5de80c93d0 0x7f5de8070730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58716/0 (socket says 172.21.15.82:58716) 2023-11-28T13:02:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5de77fe700 1 -- 172.21.15.82:0/15956917 learned_addr learned my addr 172.21.15.82:0/15956917 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5ded31f700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de806a450 con 0x7f5de8070e40 2023-11-28T13:02:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5ded31f700 1 -- 172.21.15.82:0/15956917 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de8158b30 con 0x7f5de8158760 2023-11-28T13:02:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5decb1e700 1 --2- 172.21.15.82:0/15956917 >> v2:172.21.15.82:3300/0 conn(0x7f5de8070e40 0x7f5de806ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5de7fff700 1 --2- 172.21.15.82:0/15956917 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5de8158760 0x7f5de815c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5de6ffd700 1 -- 172.21.15.82:0/15956917 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3654326321 0 0) 0x7f5de806a9d0 con 0x7f5de80c93d0 2023-11-28T13:02:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5de6ffd700 1 -- 172.21.15.82:0/15956917 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dd00035d0 con 0x7f5de80c93d0 2023-11-28T13:02:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5decb1e700 1 -- 172.21.15.82:0/15956917 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5de8158760 msgr2=0x7f5de815c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5decb1e700 1 --2- 172.21.15.82:0/15956917 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5de8158760 0x7f5de815c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5decb1e700 1 -- 172.21.15.82:0/15956917 >> v1:172.21.15.82:6789/0 conn(0x7f5de80c93d0 legacy=0x7f5de8070730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:17.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5decb1e700 1 -- 172.21.15.82:0/15956917 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de815cc50 con 0x7f5de8070e40 2023-11-28T13:02:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5decb1e700 1 --2- 172.21.15.82:0/15956917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5de8070e40 0x7f5de806ae60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009d90 tx=0x7f5de000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2150498f36da15ce server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5de6ffd700 1 -- 172.21.15.82:0/15956917 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de000e070 con 0x7f5de8070e40 2023-11-28T13:02:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5de6ffd700 1 -- 172.21.15.82:0/15956917 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de000bb20 con 0x7f5de8070e40 2023-11-28T13:02:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5de6ffd700 1 -- 172.21.15.82:0/15956917 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de0012430 con 0x7f5de8070e40 2023-11-28T13:02:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5ded31f700 1 -- 172.21.15.82:0/15956917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5de8070e40 msgr2=0x7f5de806ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5ded31f700 1 --2- 172.21.15.82:0/15956917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5de8070e40 0x7f5de806ae60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009d90 tx=0x7f5de000b330 comp rx=0 tx=0).stop 2023-11-28T13:02:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5ded31f700 1 -- 172.21.15.82:0/15956917 shutdown_connections 2023-11-28T13:02:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5ded31f700 1 --2- 172.21.15.82:0/15956917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5de8070e40 0x7f5de806ae60 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5ded31f700 1 --2- 172.21.15.82:0/15956917 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5de8158760 0x7f5de815c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5ded31f700 1 -- 172.21.15.82:0/15956917 >> 172.21.15.82:0/15956917 conn(0x7f5de80cb890 msgr2=0x7f5de80cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5ded31f700 1 -- 172.21.15.82:0/15956917 shutdown_connections 2023-11-28T13:02:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.145+0000 7f5ded31f700 1 -- 172.21.15.82:0/15956917 wait complete. 2023-11-28T13:02:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5ded31f700 1 Processor -- start 2023-11-28T13:02:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5ded31f700 1 -- start start 2023-11-28T13:02:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5ded31f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5de8070e40 0x7f5de8142970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5ded31f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5de80c93d0 0x7f5de8157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5ded31f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5de8158760 0x7f5de80c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5ded31f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de8157aa0 con 0x7f5de80c93d0 2023-11-28T13:02:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5ded31f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de8143b80 con 0x7f5de8070e40 2023-11-28T13:02:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5ded31f700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de8143000 con 0x7f5de8158760 2023-11-28T13:02:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5de77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5de80c93d0 0x7f5de8157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5de77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5de80c93d0 0x7f5de8157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37150/0 (socket says 172.21.15.82:37150) 2023-11-28T13:02:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5de77fe700 1 -- 172.21.15.82:0/1884185987 learned_addr learned my addr 172.21.15.82:0/1884185987 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5de7fff700 1 --2- 172.21.15.82:0/1884185987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5de8070e40 0x7f5de8142970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5decb1e700 1 --2- 172.21.15.82:0/1884185987 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5de8158760 0x7f5de80c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5de77fe700 1 -- 172.21.15.82:0/1884185987 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5de8158760 msgr2=0x7f5de80c1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5de77fe700 1 --2- 172.21.15.82:0/1884185987 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5de8158760 0x7f5de80c1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5de77fe700 1 -- 172.21.15.82:0/1884185987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5de8070e40 msgr2=0x7f5de8142970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5de77fe700 1 --2- 172.21.15.82:0/1884185987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5de8070e40 0x7f5de8142970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5de77fe700 1 -- 172.21.15.82:0/1884185987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de0009a70 con 0x7f5de80c93d0 2023-11-28T13:02:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5de7fff700 1 --2- 172.21.15.82:0/1884185987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5de8070e40 0x7f5de8142970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5de77fe700 1 --2- 172.21.15.82:0/1884185987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5de80c93d0 0x7f5de8157560 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00c700 tx=0x7f5ddc00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:17.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5de4ff9700 1 -- 172.21.15.82:0/1884185987 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc005d90 con 0x7f5de80c93d0 2023-11-28T13:02:17.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5de4ff9700 1 -- 172.21.15.82:0/1884185987 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc0070d0 con 0x7f5de80c93d0 2023-11-28T13:02:17.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5ded31f700 1 -- 172.21.15.82:0/1884185987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de806a660 con 0x7f5de80c93d0 2023-11-28T13:02:17.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5de4ff9700 1 -- 172.21.15.82:0/1884185987 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc007480 con 0x7f5de80c93d0 2023-11-28T13:02:17.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.149+0000 7f5ded31f700 1 -- 172.21.15.82:0/1884185987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de815cf30 con 0x7f5de80c93d0 2023-11-28T13:02:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.153+0000 7f5ded31f700 1 -- 172.21.15.82:0/1884185987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de80cb510 con 0x7f5de80c93d0 2023-11-28T13:02:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.153+0000 7f5de4ff9700 1 -- 172.21.15.82:0/1884185987 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5ddc019030 con 0x7f5de80c93d0 2023-11-28T13:02:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.153+0000 7f5de4ff9700 1 --2- 172.21.15.82:0/1884185987 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5dd4064ee0 0x7f5dd4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.153+0000 7f5de4ff9700 1 -- 172.21.15.82:0/1884185987 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5ddc081150 con 0x7f5de80c93d0 2023-11-28T13:02:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.153+0000 7f5de7fff700 1 --2- 172.21.15.82:0/1884185987 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5dd4064ee0 0x7f5dd4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.153+0000 7f5de7fff700 1 --2- 172.21.15.82:0/1884185987 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5dd4064ee0 0x7f5dd4067390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8007a70 tx=0x7f5dd8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:17.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.161+0000 7f5de4ff9700 1 -- 172.21.15.82:0/1884185987 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5ddc04f5c0 con 0x7f5de80c93d0 2023-11-28T13:02:17.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.381+0000 7f5ded31f700 1 -- 172.21.15.82:0/1884185987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5de80ca020 con 0x7f5de80c93d0 2023-11-28T13:02:17.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.381+0000 7f5de4ff9700 1 -- 172.21.15.82:0/1884185987 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) v1 ==== 80+0+5298 (secure 0 0 0) 0x7f5ddc052be0 con 0x7f5de80c93d0 2023-11-28T13:02:17.385 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:17.385 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:02:17.385 INFO:teuthology.orchestra.run.smithi082.stdout: "auth_dump": [ 2023-11-28T13:02:17.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:17.386 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.a", 2023-11-28T13:02:17.386 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlCdS5DxAA6mejkVFcUsLxQRj3VIVjiA==", 2023-11-28T13:02:17.386 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:02:17.386 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:02:17.386 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-11-28T13:02:17.386 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-11-28T13:02:17.387 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:02:17.387 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:17.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:17.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:17.387 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.b", 2023-11-28T13:02:17.387 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVls/voFhAAwSFuDQwvvCr9AWGJTcYVYA==", 2023-11-28T13:02:17.387 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:02:17.387 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:02:17.388 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-11-28T13:02:17.388 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-11-28T13:02:17.388 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:02:17.388 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:17.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:17.388 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:17.388 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.c", 2023-11-28T13:02:17.389 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVltTgvExAA5x6bGq3lWvWbwnvFAHNIHQ==", 2023-11-28T13:02:17.389 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:02:17.389 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:02:17.389 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-11-28T13:02:17.389 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-11-28T13:02:17.389 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:02:17.389 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:17.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:17.390 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:17.390 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.d", 2023-11-28T13:02:17.390 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlT4ecGhAA/S/lIx6fXgbKUmDq6TXAag==", 2023-11-28T13:02:17.390 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:02:17.390 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:02:17.390 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-11-28T13:02:17.390 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-11-28T13:02:17.390 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:02:17.391 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:17.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:17.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:17.391 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.0", 2023-11-28T13:02:17.391 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAz5GVlMpQBERAAim3Dp31FdCvBHZRLRmpUEA==", 2023-11-28T13:02:17.391 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:02:17.391 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:02:17.391 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:02:17.392 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:02:17.392 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:17.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:17.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:17.392 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.1", 2023-11-28T13:02:17.392 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA25GVlbynJJhAAVPGWlzi2gCbAx8A2CtTDew==", 2023-11-28T13:02:17.392 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:02:17.392 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:02:17.393 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:02:17.393 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:02:17.393 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:17.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:17.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:17.393 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.2", 2023-11-28T13:02:17.393 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA55GVl8le5OBAA6KTsYliyG4l1fqTHluWUgA==", 2023-11-28T13:02:17.393 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:02:17.394 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:02:17.394 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:02:17.394 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:02:17.394 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:17.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:17.394 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:17.394 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.3", 2023-11-28T13:02:17.395 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA95GVlupEwAxAAb2UOrNbiicmvMKlJkWrwVA==", 2023-11-28T13:02:17.395 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:02:17.395 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:02:17.395 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:02:17.395 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:02:17.395 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:17.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:17.395 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:17.396 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.4", 2023-11-28T13:02:17.396 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBC5GVlXgk5KhAAUhkPiT909nUDc/DQ2uITYQ==", 2023-11-28T13:02:17.396 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:02:17.396 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:02:17.396 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:02:17.396 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:02:17.396 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:17.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:17.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:17.397 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.5", 2023-11-28T13:02:17.397 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBG5GVloYsaBBAAn1PYxCBVxsjA6Mmq/cnUrQ==", 2023-11-28T13:02:17.397 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:02:17.397 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:02:17.397 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:02:17.397 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:02:17.397 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:17.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:17.398 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:17.398 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.6", 2023-11-28T13:02:17.398 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBJ5GVljJcAFhAAVy/GB5HhhbKfmXji0e+7sw==", 2023-11-28T13:02:17.398 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:02:17.398 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:02:17.398 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:02:17.399 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:02:17.399 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:17.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:17.399 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:17.399 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.7", 2023-11-28T13:02:17.399 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBM5GVlNcBbHhAAvMcutUUBiQEgLHGFK4Nb7Q==", 2023-11-28T13:02:17.399 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:02:17.399 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:02:17.400 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:02:17.400 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:02:17.400 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:17.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:17.400 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:17.400 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.0", 2023-11-28T13:02:17.400 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlK0wtHhAAALaA+R3pU9RtJq4wvijo3Q==", 2023-11-28T13:02:17.400 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:02:17.401 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:02:17.401 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow r", 2023-11-28T13:02:17.401 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rw pool=cephfs_data" 2023-11-28T13:02:17.401 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:17.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:17.401 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:17.401 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.1", 2023-11-28T13:02:17.401 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlb19GJxAApBeChk0RMz7CTiIBPNn+kQ==", 2023-11-28T13:02:17.402 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:02:17.402 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:02:17.402 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-11-28T13:02:17.402 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-11-28T13:02:17.402 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-11-28T13:02:17.402 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:17.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:17.402 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:17.403 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.2", 2023-11-28T13:02:17.403 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlOosGJBAAO019e3SgRbOsmZWZdVihpA==", 2023-11-28T13:02:17.403 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:02:17.403 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:02:17.403 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-11-28T13:02:17.403 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-11-28T13:02:17.403 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-11-28T13:02:17.403 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:17.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:17.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:17.404 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.3", 2023-11-28T13:02:17.404 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlf59HKhAAvROZEH3qiOM8RLS2pgNGxw==", 2023-11-28T13:02:17.404 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:02:17.404 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:02:17.404 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-11-28T13:02:17.404 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-11-28T13:02:17.405 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-11-28T13:02:17.405 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:17.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:17.405 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:17.405 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.admin", 2023-11-28T13:02:17.405 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAv5GVlThU6NxAAKEg/veQS9Wg1PeZl3scbbQ==", 2023-11-28T13:02:17.405 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:02:17.406 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-11-28T13:02:17.406 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-11-28T13:02:17.406 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-11-28T13:02:17.406 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:02:17.406 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:17.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:17.406 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:17.406 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.x", 2023-11-28T13:02:17.407 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlas3pCxAAHp82YHi3DweifxetdtSMQg==", 2023-11-28T13:02:17.407 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:02:17.407 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-11-28T13:02:17.407 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-11-28T13:02:17.407 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:02:17.407 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:17.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:17.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:17.407 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.y", 2023-11-28T13:02:17.408 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlpOu6CBAAlqY+m5+MrGgcRTUOT2+seQ==", 2023-11-28T13:02:17.408 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:02:17.408 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-11-28T13:02:17.408 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-11-28T13:02:17.408 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:02:17.408 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:17.408 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:17.408 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-11-28T13:02:17.409 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:02:17.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.385+0000 7f5ded31f700 1 -- 172.21.15.82:0/1884185987 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5dd4064ee0 msgr2=0x7f5dd4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:17.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.385+0000 7f5ded31f700 1 --2- 172.21.15.82:0/1884185987 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5dd4064ee0 0x7f5dd4067390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8007a70 tx=0x7f5dd8008040 comp rx=0 tx=0).stop 2023-11-28T13:02:17.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.385+0000 7f5ded31f700 1 -- 172.21.15.82:0/1884185987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5de80c93d0 msgr2=0x7f5de8157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:17.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.385+0000 7f5ded31f700 1 --2- 172.21.15.82:0/1884185987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5de80c93d0 0x7f5de8157560 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00c700 tx=0x7f5ddc00cac0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.385+0000 7f5ded31f700 1 -- 172.21.15.82:0/1884185987 shutdown_connections 2023-11-28T13:02:17.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.385+0000 7f5ded31f700 1 --2- 172.21.15.82:0/1884185987 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5dd4064ee0 0x7f5dd4067390 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.385+0000 7f5ded31f700 1 --2- 172.21.15.82:0/1884185987 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5de8158760 0x7f5de80c1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.385+0000 7f5ded31f700 1 --2- 172.21.15.82:0/1884185987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5de80c93d0 0x7f5de8157560 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.385+0000 7f5ded31f700 1 --2- 172.21.15.82:0/1884185987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5de8070e40 0x7f5de8142970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.385+0000 7f5ded31f700 1 -- 172.21.15.82:0/1884185987 >> 172.21.15.82:0/1884185987 conn(0x7f5de80cb890 msgr2=0x7f5de80cc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:17.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.385+0000 7f5ded31f700 1 -- 172.21.15.82:0/1884185987 shutdown_connections 2023-11-28T13:02:17.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.385+0000 7f5ded31f700 1 -- 172.21.15.82:0/1884185987 wait complete. 2023-11-28T13:02:17.412 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:02:17.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.525+0000 7f718c911700 1 Processor -- start 2023-11-28T13:02:17.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.525+0000 7f718c911700 1 -- start start 2023-11-28T13:02:17.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f718c911700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f718815c1c0 0x7f71880c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:17.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f718c911700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f71880ca4b0 0x7f718806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:17.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f718c911700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f718806d910 0x7f71880710b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:17.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f718c911700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f718806dd90 con 0x7f71880ca4b0 2023-11-28T13:02:17.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f718c911700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71880cd2e0 con 0x7f718815c1c0 2023-11-28T13:02:17.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f718c911700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71880ca9c0 con 0x7f718806d910 2023-11-28T13:02:17.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f717effd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f71880ca4b0 0x7f718806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:17.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f717effd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f71880ca4b0 0x7f718806d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37156/0 (socket says 172.21.15.82:37156) 2023-11-28T13:02:17.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f717effd700 1 -- 172.21.15.82:0/1036674783 learned_addr learned my addr 172.21.15.82:0/1036674783 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:17.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f71877fe700 1 --2- 172.21.15.82:0/1036674783 >> v2:172.21.15.114:3300/0 conn(0x7f718815c1c0 0x7f71880c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:17.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f7187fff700 1 --2- 172.21.15.82:0/1036674783 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f718806d910 0x7f71880710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:17.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f717effd700 1 -- 172.21.15.82:0/1036674783 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f718806d910 msgr2=0x7f71880710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:17.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f717effd700 1 --2- 172.21.15.82:0/1036674783 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f718806d910 0x7f71880710b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f717effd700 1 -- 172.21.15.82:0/1036674783 >> v2:172.21.15.114:3300/0 conn(0x7f718815c1c0 msgr2=0x7f71880c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:17.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f717effd700 1 --2- 172.21.15.82:0/1036674783 >> v2:172.21.15.114:3300/0 conn(0x7f718815c1c0 0x7f71880c9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f717effd700 1 -- 172.21.15.82:0/1036674783 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71880cd530 con 0x7f71880ca4b0 2023-11-28T13:02:17.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f717effd700 1 --2- 172.21.15.82:0/1036674783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71880ca4b0 0x7f718806d3d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f718806e100 tx=0x7f7170009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c52d981cd407e87b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:17.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f7186ffd700 1 -- 172.21.15.82:0/1036674783 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7170011830 con 0x7f71880ca4b0 2023-11-28T13:02:17.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f7186ffd700 1 -- 172.21.15.82:0/1036674783 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7170011990 con 0x7f71880ca4b0 2023-11-28T13:02:17.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f7186ffd700 1 -- 172.21.15.82:0/1036674783 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7170011d20 con 0x7f71880ca4b0 2023-11-28T13:02:17.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f718c911700 1 -- 172.21.15.82:0/1036674783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71880ca4b0 msgr2=0x7f718806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:17.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f718c911700 1 --2- 172.21.15.82:0/1036674783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71880ca4b0 0x7f718806d3d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f718806e100 tx=0x7f7170009bf0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f718c911700 1 -- 172.21.15.82:0/1036674783 shutdown_connections 2023-11-28T13:02:17.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.529+0000 7f718c911700 1 --2- 172.21.15.82:0/1036674783 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f718806d910 0x7f71880710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.533+0000 7f718c911700 1 --2- 172.21.15.82:0/1036674783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71880ca4b0 0x7f718806d3d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.533+0000 7f718c911700 1 --2- 172.21.15.82:0/1036674783 >> v2:172.21.15.114:3300/0 conn(0x7f718815c1c0 0x7f71880c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.533+0000 7f718c911700 1 -- 172.21.15.82:0/1036674783 >> 172.21.15.82:0/1036674783 conn(0x7f71880cf710 msgr2=0x7f71880cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:17.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.533+0000 7f718c911700 1 -- 172.21.15.82:0/1036674783 shutdown_connections 2023-11-28T13:02:17.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.533+0000 7f718c911700 1 -- 172.21.15.82:0/1036674783 wait complete. 2023-11-28T13:02:17.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.533+0000 7f718c911700 1 Processor -- start 2023-11-28T13:02:17.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.533+0000 7f718c911700 1 -- start start 2023-11-28T13:02:17.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.533+0000 7f718c911700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f718806d910 0x7f7188149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:17.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.533+0000 7f718c911700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71880ca4b0 0x7f718815d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:17.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.533+0000 7f718c911700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f718815c1c0 0x7f71881f5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:17.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.533+0000 7f718c911700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718815d5a0 con 0x7f71880ca4b0 2023-11-28T13:02:17.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.533+0000 7f718c911700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71881f6010 con 0x7f718815c1c0 2023-11-28T13:02:17.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.533+0000 7f718c911700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71880b0320 con 0x7f718806d910 2023-11-28T13:02:17.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.533+0000 7f717effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71880ca4b0 0x7f718815d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:17.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.533+0000 7f717effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71880ca4b0 0x7f718815d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37158/0 (socket says 172.21.15.82:37158) 2023-11-28T13:02:17.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.533+0000 7f717effd700 1 -- 172.21.15.82:0/2508766718 learned_addr learned my addr 172.21.15.82:0/2508766718 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:17.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.533+0000 7f71877fe700 1 --2- 172.21.15.82:0/2508766718 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f718806d910 0x7f7188149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:17.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.533+0000 7f7187fff700 1 --2- 172.21.15.82:0/2508766718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f718815c1c0 0x7f71881f5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:17.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.537+0000 7f717effd700 1 -- 172.21.15.82:0/2508766718 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f718806d910 msgr2=0x7f7188149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:17.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.537+0000 7f717effd700 1 --2- 172.21.15.82:0/2508766718 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f718806d910 0x7f7188149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.537+0000 7f717effd700 1 -- 172.21.15.82:0/2508766718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f718815c1c0 msgr2=0x7f71881f5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:17.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.537+0000 7f717effd700 1 --2- 172.21.15.82:0/2508766718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f718815c1c0 0x7f71881f5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.537+0000 7f717effd700 1 -- 172.21.15.82:0/2508766718 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7170009570 con 0x7f71880ca4b0 2023-11-28T13:02:17.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.537+0000 7f71877fe700 1 --2- 172.21.15.82:0/2508766718 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f718806d910 0x7f7188149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:17.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.537+0000 7f7187fff700 1 --2- 172.21.15.82:0/2508766718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f718815c1c0 0x7f71881f5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:17.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.537+0000 7f717effd700 1 --2- 172.21.15.82:0/2508766718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71880ca4b0 0x7f718815d060 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7170014040 tx=0x7f7170004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:17.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.537+0000 7f7184ff9700 1 -- 172.21.15.82:0/2508766718 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7170004510 con 0x7f71880ca4b0 2023-11-28T13:02:17.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.537+0000 7f7184ff9700 1 -- 172.21.15.82:0/2508766718 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717001e070 con 0x7f71880ca4b0 2023-11-28T13:02:17.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.537+0000 7f718c911700 1 -- 172.21.15.82:0/2508766718 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71880cdaf0 con 0x7f71880ca4b0 2023-11-28T13:02:17.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.537+0000 7f7184ff9700 1 -- 172.21.15.82:0/2508766718 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7170003900 con 0x7f71880ca4b0 2023-11-28T13:02:17.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.537+0000 7f718c911700 1 -- 172.21.15.82:0/2508766718 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71880cd810 con 0x7f71880ca4b0 2023-11-28T13:02:17.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.537+0000 7f718c911700 1 -- 172.21.15.82:0/2508766718 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718815c590 con 0x7f71880ca4b0 2023-11-28T13:02:17.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.537+0000 7f7184ff9700 1 -- 172.21.15.82:0/2508766718 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f717000f050 con 0x7f71880ca4b0 2023-11-28T13:02:17.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.537+0000 7f7184ff9700 1 --2- 172.21.15.82:0/2508766718 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7168064ee0 0x7f7168067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:17.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.537+0000 7f7184ff9700 1 -- 172.21.15.82:0/2508766718 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7170082700 con 0x7f71880ca4b0 2023-11-28T13:02:17.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.537+0000 7f71877fe700 1 --2- 172.21.15.82:0/2508766718 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7168064ee0 0x7f7168067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:17.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.541+0000 7f71877fe700 1 --2- 172.21.15.82:0/2508766718 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7168064ee0 0x7f7168067390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7178009b20 tx=0x7f7178008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:17.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.545+0000 7f7184ff9700 1 -- 172.21.15.82:0/2508766718 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7170050b00 con 0x7f71880ca4b0 2023-11-28T13:02:17.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.709+0000 7f718c911700 1 -- 172.21.15.82:0/2508766718 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7188066010 con 0x7f71880ca4b0 2023-11-28T13:02:17.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.709+0000 7f7184ff9700 1 -- 172.21.15.82:0/2508766718 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+14171 (secure 0 0 0) 0x7f7170054120 con 0x7f71880ca4b0 2023-11-28T13:02:17.713 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:17.714 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":47,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:02:16.996130+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:02:17.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.713+0000 7f718c911700 1 -- 172.21.15.82:0/2508766718 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7168064ee0 msgr2=0x7f7168067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:17.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.713+0000 7f718c911700 1 --2- 172.21.15.82:0/2508766718 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7168064ee0 0x7f7168067390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7178009b20 tx=0x7f7178008040 comp rx=0 tx=0).stop 2023-11-28T13:02:17.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.713+0000 7f718c911700 1 -- 172.21.15.82:0/2508766718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71880ca4b0 msgr2=0x7f718815d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:17.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.713+0000 7f718c911700 1 --2- 172.21.15.82:0/2508766718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71880ca4b0 0x7f718815d060 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7170014040 tx=0x7f7170004770 comp rx=0 tx=0).stop 2023-11-28T13:02:17.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.713+0000 7f718c911700 1 -- 172.21.15.82:0/2508766718 shutdown_connections 2023-11-28T13:02:17.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.713+0000 7f718c911700 1 --2- 172.21.15.82:0/2508766718 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7168064ee0 0x7f7168067390 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.713+0000 7f718c911700 1 --2- 172.21.15.82:0/2508766718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f718815c1c0 0x7f71881f5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.713+0000 7f718c911700 1 --2- 172.21.15.82:0/2508766718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71880ca4b0 0x7f718815d060 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.713+0000 7f718c911700 1 --2- 172.21.15.82:0/2508766718 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f718806d910 0x7f7188149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.713+0000 7f718c911700 1 -- 172.21.15.82:0/2508766718 >> 172.21.15.82:0/2508766718 conn(0x7f71880cf710 msgr2=0x7f7188157100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:17.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.713+0000 7f718c911700 1 -- 172.21.15.82:0/2508766718 shutdown_connections 2023-11-28T13:02:17.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.713+0000 7f718c911700 1 -- 172.21.15.82:0/2508766718 wait complete. 2023-11-28T13:02:17.728 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:02:17.728 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:02:17.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.837+0000 7f62ea9c2700 1 Processor -- start 2023-11-28T13:02:17.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.837+0000 7f62ea9c2700 1 -- start start 2023-11-28T13:02:17.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62ea9c2700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62e406b180 0x7f62e41608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:17.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62ea9c2700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e4071f30 con 0x7f62e40c79a0 2023-11-28T13:02:17.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62ea9c2700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e4072210 con 0x7f62e41568b0 2023-11-28T13:02:17.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62ea9c2700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e4156c80 con 0x7f62e406b180 2023-11-28T13:02:17.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62ea1c1700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f62e40c79a0 0x7f62e415c730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58728/0 (socket says 172.21.15.82:58728) 2023-11-28T13:02:17.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62ea1c1700 1 -- 172.21.15.82:0/3982930712 learned_addr learned my addr 172.21.15.82:0/3982930712 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:17.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62e91bf700 1 --2- 172.21.15.82:0/3982930712 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62e406b180 0x7f62e41608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:17.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62e89be700 1 -- 172.21.15.82:0/3982930712 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174803044 0 0) 0x7f62e4071f30 con 0x7f62e40c79a0 2023-11-28T13:02:17.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62e89be700 1 -- 172.21.15.82:0/3982930712 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62d00035d0 con 0x7f62e40c79a0 2023-11-28T13:02:17.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62e89be700 1 -- 172.21.15.82:0/3982930712 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173809839 0 0) 0x7f62e4072210 con 0x7f62e41568b0 2023-11-28T13:02:17.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62e91bf700 1 -- 172.21.15.82:0/3982930712 >> v1:172.21.15.114:6789/0 conn(0x7f62e41568b0 legacy=0x7f62e4071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:17.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62e91bf700 1 -- 172.21.15.82:0/3982930712 >> v1:172.21.15.82:6789/0 conn(0x7f62e40c79a0 legacy=0x7f62e415c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:17.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62e91bf700 1 -- 172.21.15.82:0/3982930712 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e415fdc0 con 0x7f62e406b180 2023-11-28T13:02:17.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62e91bf700 1 --2- 172.21.15.82:0/3982930712 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62e406b180 0x7f62e41608a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f62d4009880 tx=0x7f62d4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4ed4cb03ada49e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:17.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62e89be700 1 -- 172.21.15.82:0/3982930712 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d4011830 con 0x7f62e406b180 2023-11-28T13:02:17.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62e89be700 1 -- 172.21.15.82:0/3982930712 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d4011990 con 0x7f62e406b180 2023-11-28T13:02:17.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62e89be700 1 -- 172.21.15.82:0/3982930712 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d4011d20 con 0x7f62e406b180 2023-11-28T13:02:17.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62ea9c2700 1 -- 172.21.15.82:0/3982930712 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62e406b180 msgr2=0x7f62e41608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:17.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62ea9c2700 1 --2- 172.21.15.82:0/3982930712 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62e406b180 0x7f62e41608a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f62d4009880 tx=0x7f62d4009b90 comp rx=0 tx=0).stop 2023-11-28T13:02:17.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62ea9c2700 1 -- 172.21.15.82:0/3982930712 shutdown_connections 2023-11-28T13:02:17.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62ea9c2700 1 --2- 172.21.15.82:0/3982930712 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62e406b180 0x7f62e41608a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62ea9c2700 1 -- 172.21.15.82:0/3982930712 >> 172.21.15.82:0/3982930712 conn(0x7f62e40ce630 msgr2=0x7f62e40cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:17.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62ea9c2700 1 -- 172.21.15.82:0/3982930712 shutdown_connections 2023-11-28T13:02:17.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.841+0000 7f62ea9c2700 1 -- 172.21.15.82:0/3982930712 wait complete. 2023-11-28T13:02:17.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.845+0000 7f62ea9c2700 1 Processor -- start 2023-11-28T13:02:17.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.845+0000 7f62ea9c2700 1 -- start start 2023-11-28T13:02:17.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.845+0000 7f62ea9c2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62e406b180 0x7f62e4155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:17.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.845+0000 7f62ea9c2700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62e40c79a0 0x7f62e413f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:17.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.845+0000 7f62ea9c2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62e41568b0 0x7f62e4155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:17.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.845+0000 7f62ea9c2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e4155970 con 0x7f62e406b180 2023-11-28T13:02:17.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.845+0000 7f62ea9c2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e40b1a00 con 0x7f62e41568b0 2023-11-28T13:02:17.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.845+0000 7f62ea9c2700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e4154950 con 0x7f62e40c79a0 2023-11-28T13:02:17.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.845+0000 7f62e99c0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62e406b180 0x7f62e4155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:17.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.845+0000 7f62e99c0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62e406b180 0x7f62e4155d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37174/0 (socket says 172.21.15.82:37174) 2023-11-28T13:02:17.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.845+0000 7f62e99c0700 1 -- 172.21.15.82:0/366768137 learned_addr learned my addr 172.21.15.82:0/366768137 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:17.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.845+0000 7f62ea1c1700 1 --2- 172.21.15.82:0/366768137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62e41568b0 0x7f62e4155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:17.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.845+0000 7f62e91bf700 1 --2- 172.21.15.82:0/366768137 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62e40c79a0 0x7f62e413f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:17.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.845+0000 7f62e99c0700 1 -- 172.21.15.82:0/366768137 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62e40c79a0 msgr2=0x7f62e413f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:17.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.845+0000 7f62e99c0700 1 --2- 172.21.15.82:0/366768137 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62e40c79a0 0x7f62e413f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.845+0000 7f62e99c0700 1 -- 172.21.15.82:0/366768137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62e41568b0 msgr2=0x7f62e4155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:17.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.845+0000 7f62e99c0700 1 --2- 172.21.15.82:0/366768137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62e41568b0 0x7f62e4155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:17.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.845+0000 7f62e99c0700 1 -- 172.21.15.82:0/366768137 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d40094b0 con 0x7f62e406b180 2023-11-28T13:02:17.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.845+0000 7f62e99c0700 1 --2- 172.21.15.82:0/366768137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62e406b180 0x7f62e4155d10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f62e000c520 tx=0x7f62e000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:17.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.849+0000 7f62da7fc700 1 -- 172.21.15.82:0/366768137 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e00054e0 con 0x7f62e406b180 2023-11-28T13:02:17.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.849+0000 7f62da7fc700 1 -- 172.21.15.82:0/366768137 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e00036a0 con 0x7f62e406b180 2023-11-28T13:02:17.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.849+0000 7f62ea9c2700 1 -- 172.21.15.82:0/366768137 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e4160380 con 0x7f62e406b180 2023-11-28T13:02:17.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.849+0000 7f62da7fc700 1 -- 172.21.15.82:0/366768137 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e0003a50 con 0x7f62e406b180 2023-11-28T13:02:17.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.849+0000 7f62ea9c2700 1 -- 172.21.15.82:0/366768137 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e41600a0 con 0x7f62e406b180 2023-11-28T13:02:17.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.849+0000 7f62ea9c2700 1 -- 172.21.15.82:0/366768137 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e40c7e00 con 0x7f62e406b180 2023-11-28T13:02:17.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.849+0000 7f62da7fc700 1 -- 172.21.15.82:0/366768137 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f62e0019030 con 0x7f62e406b180 2023-11-28T13:02:17.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.849+0000 7f62da7fc700 1 --2- 172.21.15.82:0/366768137 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f62c8064ee0 0x7f62c8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:17.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.849+0000 7f62da7fc700 1 -- 172.21.15.82:0/366768137 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f62e0080dd0 con 0x7f62e406b180 2023-11-28T13:02:17.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.849+0000 7f62e91bf700 1 --2- 172.21.15.82:0/366768137 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f62c8064ee0 0x7f62c8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:17.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.853+0000 7f62e91bf700 1 --2- 172.21.15.82:0/366768137 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f62c8064ee0 0x7f62c8067390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f62d40090b0 tx=0x7f62d4010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:17.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:17.857+0000 7f62da7fc700 1 -- 172.21.15.82:0/366768137 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f62e004f2c0 con 0x7f62e406b180 2023-11-28T13:02:18.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.021+0000 7f62ea9c2700 1 -- 172.21.15.82:0/366768137 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f62e4065fc0 con 0x7f62e406b180 2023-11-28T13:02:18.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.021+0000 7f62da7fc700 1 -- 172.21.15.82:0/366768137 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f62e00170a0 con 0x7f62e406b180 2023-11-28T13:02:18.025 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:02:18.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.025+0000 7f62ea9c2700 1 -- 172.21.15.82:0/366768137 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f62c8064ee0 msgr2=0x7f62c8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:18.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.025+0000 7f62ea9c2700 1 --2- 172.21.15.82:0/366768137 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f62c8064ee0 0x7f62c8067390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f62d40090b0 tx=0x7f62d4010000 comp rx=0 tx=0).stop 2023-11-28T13:02:18.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.025+0000 7f62ea9c2700 1 -- 172.21.15.82:0/366768137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62e406b180 msgr2=0x7f62e4155d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:18.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.025+0000 7f62ea9c2700 1 --2- 172.21.15.82:0/366768137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62e406b180 0x7f62e4155d10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f62e000c520 tx=0x7f62e000c830 comp rx=0 tx=0).stop 2023-11-28T13:02:18.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.025+0000 7f62ea9c2700 1 -- 172.21.15.82:0/366768137 shutdown_connections 2023-11-28T13:02:18.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.025+0000 7f62ea9c2700 1 --2- 172.21.15.82:0/366768137 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f62c8064ee0 0x7f62c8067390 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.025+0000 7f62ea9c2700 1 --2- 172.21.15.82:0/366768137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62e41568b0 0x7f62e4155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.025+0000 7f62ea9c2700 1 --2- 172.21.15.82:0/366768137 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62e40c79a0 0x7f62e413f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.025+0000 7f62ea9c2700 1 --2- 172.21.15.82:0/366768137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62e406b180 0x7f62e4155d10 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.025+0000 7f62ea9c2700 1 -- 172.21.15.82:0/366768137 >> 172.21.15.82:0/366768137 conn(0x7f62e40ce630 msgr2=0x7f62e4070200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:18.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.025+0000 7f62ea9c2700 1 -- 172.21.15.82:0/366768137 shutdown_connections 2023-11-28T13:02:18.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.025+0000 7f62ea9c2700 1 -- 172.21.15.82:0/366768137 wait complete. 2023-11-28T13:02:18.039 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:02:18.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.153+0000 7fba011fb700 1 Processor -- start 2023-11-28T13:02:18.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.153+0000 7fba011fb700 1 -- start start 2023-11-28T13:02:18.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.153+0000 7fba011fb700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb9fc0d25b0 0x7fb9fc0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:18.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.153+0000 7fba011fb700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9fc069bc0 con 0x7fb9fc06c140 2023-11-28T13:02:18.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.153+0000 7fba011fb700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9fc0d1480 con 0x7fb9fc0b1d10 2023-11-28T13:02:18.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.153+0000 7fba011fb700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc0cd280 con 0x7fb9fc0d25b0 2023-11-28T13:02:18.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.153+0000 7fb9fb7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb9fc06c140 0x7fb9fc06a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58732/0 (socket says 172.21.15.82:58732) 2023-11-28T13:02:18.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.153+0000 7fb9fb7fe700 1 -- 172.21.15.82:0/2716744202 learned_addr learned my addr 172.21.15.82:0/2716744202 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:18.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fba009fa700 1 --2- 172.21.15.82:0/2716744202 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb9fc0d25b0 0x7fb9fc0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:18.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9faffd700 1 -- 172.21.15.82:0/2716744202 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853278894 0 0) 0x7fb9fc069bc0 con 0x7fb9fc06c140 2023-11-28T13:02:18.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9faffd700 1 -- 172.21.15.82:0/2716744202 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9e40035d0 con 0x7fb9fc06c140 2023-11-28T13:02:18.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9faffd700 1 -- 172.21.15.82:0/2716744202 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 584140937 0 0) 0x7fb9e40035d0 con 0x7fb9fc06c140 2023-11-28T13:02:18.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9faffd700 1 -- 172.21.15.82:0/2716744202 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb9fc0d25b0 msgr2=0x7fb9fc0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:18.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9faffd700 1 --2- 172.21.15.82:0/2716744202 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb9fc0d25b0 0x7fb9fc0cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9faffd700 1 -- 172.21.15.82:0/2716744202 >> v1:172.21.15.114:6789/0 conn(0x7fb9fc0b1d10 legacy=0x7fb9fc06ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:18.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9faffd700 1 -- 172.21.15.82:0/2716744202 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc0cd560 con 0x7fb9fc06c140 2023-11-28T13:02:18.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9faffd700 1 -- 172.21.15.82:0/2716744202 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7fb9ec001670 con 0x7fb9fc06c140 2023-11-28T13:02:18.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9faffd700 1 -- 172.21.15.82:0/2716744202 >> v1:172.21.15.82:6789/0 conn(0x7fb9fc06c140 legacy=0x7fb9fc06a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:18.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9faffd700 1 --2- 172.21.15.82:0/2716744202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e4003a50 0x7fb9e4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:18.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9faffd700 1 --2- 172.21.15.82:0/2716744202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9e4004870 0x7fb9e4004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:18.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9faffd700 1 --2- 172.21.15.82:0/2716744202 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb9fc0d25b0 0x7fb9e4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:18.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9faffd700 1 -- 172.21.15.82:0/2716744202 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc0cd280 con 0x7fb9e4004870 2023-11-28T13:02:18.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9faffd700 1 -- 172.21.15.82:0/2716744202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e400bae0 con 0x7fb9e4003a50 2023-11-28T13:02:18.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9faffd700 1 -- 172.21.15.82:0/2716744202 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e400bc70 con 0x7fb9fc0d25b0 2023-11-28T13:02:18.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9fb7fe700 1 --2- 172.21.15.82:0/2716744202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9e4004870 0x7fb9e4004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:18.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fba009fa700 1 --2- 172.21.15.82:0/2716744202 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb9fc0d25b0 0x7fb9e4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:18.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9fbfff700 1 --2- 172.21.15.82:0/2716744202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e4003a50 0x7fb9e4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:18.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9fb7fe700 1 -- 172.21.15.82:0/2716744202 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb9fc0d25b0 msgr2=0x7fb9e4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:18.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9fb7fe700 1 --2- 172.21.15.82:0/2716744202 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb9fc0d25b0 0x7fb9e4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9fb7fe700 1 -- 172.21.15.82:0/2716744202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e4003a50 msgr2=0x7fb9e4003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:18.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9fb7fe700 1 --2- 172.21.15.82:0/2716744202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e4003a50 0x7fb9e4003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9fb7fe700 1 -- 172.21.15.82:0/2716744202 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e40035d0 con 0x7fb9e4004870 2023-11-28T13:02:18.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9fbfff700 1 --2- 172.21.15.82:0/2716744202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e4003a50 0x7fb9e4003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:02:18.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9fb7fe700 1 --2- 172.21.15.82:0/2716744202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9e4004870 0x7fb9e4004ce0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00c2f0 tx=0x7fb9e40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94900d76a8c56a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:18.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9faffd700 1 -- 172.21.15.82:0/2716744202 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec007c30 con 0x7fb9e4004870 2023-11-28T13:02:18.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9faffd700 1 -- 172.21.15.82:0/2716744202 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec00ce50 con 0x7fb9e4004870 2023-11-28T13:02:18.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fb9faffd700 1 -- 172.21.15.82:0/2716744202 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec005bc0 con 0x7fb9e4004870 2023-11-28T13:02:18.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fba011fb700 1 -- 172.21.15.82:0/2716744202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9e4004870 msgr2=0x7fb9e4004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:18.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fba011fb700 1 --2- 172.21.15.82:0/2716744202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9e4004870 0x7fb9e4004ce0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00c2f0 tx=0x7fb9e40058a0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fba009fa700 1 -- 172.21.15.82:0/2716744202 reap_dead start 2023-11-28T13:02:18.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fba011fb700 1 -- 172.21.15.82:0/2716744202 shutdown_connections 2023-11-28T13:02:18.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fba011fb700 1 -- 172.21.15.82:0/2716744202 >> 172.21.15.82:0/2716744202 conn(0x7fb9fc0b52a0 msgr2=0x7fb9fc0d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:18.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fba011fb700 1 -- 172.21.15.82:0/2716744202 shutdown_connections 2023-11-28T13:02:18.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.157+0000 7fba011fb700 1 -- 172.21.15.82:0/2716744202 wait complete. 2023-11-28T13:02:18.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fba011fb700 1 Processor -- start 2023-11-28T13:02:18.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fba011fb700 1 -- start start 2023-11-28T13:02:18.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fba011fb700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb9e4004870 0x7fb9fc15f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:18.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fba011fb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9fc1f59e0 0x7fb9fc0d1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:18.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fba011fb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9fc0d1ca0 0x7fb9fc14ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:18.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fba011fb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc1f55c0 con 0x7fb9fc1f59e0 2023-11-28T13:02:18.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fba011fb700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc0d2110 con 0x7fb9fc0d1ca0 2023-11-28T13:02:18.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fba011fb700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc0a9a20 con 0x7fb9e4004870 2023-11-28T13:02:18.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fb9fb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9fc1f59e0 0x7fb9fc0d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:18.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fb9fb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9fc1f59e0 0x7fb9fc0d1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37192/0 (socket says 172.21.15.82:37192) 2023-11-28T13:02:18.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fb9fb7fe700 1 -- 172.21.15.82:0/1207933339 learned_addr learned my addr 172.21.15.82:0/1207933339 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:18.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fba009fa700 1 --2- 172.21.15.82:0/1207933339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9fc0d1ca0 0x7fb9fc14ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:18.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fb9fbfff700 1 --2- 172.21.15.82:0/1207933339 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb9e4004870 0x7fb9fc15f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:18.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fb9fb7fe700 1 -- 172.21.15.82:0/1207933339 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb9e4004870 msgr2=0x7fb9fc15f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:18.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fb9fb7fe700 1 --2- 172.21.15.82:0/1207933339 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb9e4004870 0x7fb9fc15f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fb9fb7fe700 1 -- 172.21.15.82:0/1207933339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9fc0d1ca0 msgr2=0x7fb9fc14ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:18.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fb9fb7fe700 1 --2- 172.21.15.82:0/1207933339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9fc0d1ca0 0x7fb9fc14ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fb9fb7fe700 1 -- 172.21.15.82:0/1207933339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc0d1050 con 0x7fb9fc1f59e0 2023-11-28T13:02:18.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fba009fa700 1 --2- 172.21.15.82:0/1207933339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9fc0d1ca0 0x7fb9fc14ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:02:18.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fb9fb7fe700 1 --2- 172.21.15.82:0/1207933339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9fc1f59e0 0x7fb9fc0d1760 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec000f00 tx=0x7fb9ec001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:18.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fb9f8ff9700 1 -- 172.21.15.82:0/1207933339 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec001630 con 0x7fb9fc1f59e0 2023-11-28T13:02:18.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fb9f8ff9700 1 -- 172.21.15.82:0/1207933339 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec0070d0 con 0x7fb9fc1f59e0 2023-11-28T13:02:18.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fb9f8ff9700 1 -- 172.21.15.82:0/1207933339 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0074a0 con 0x7fb9fc1f59e0 2023-11-28T13:02:18.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fba011fb700 1 -- 172.21.15.82:0/1207933339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9fc0b20e0 con 0x7fb9fc1f59e0 2023-11-28T13:02:18.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.161+0000 7fba011fb700 1 -- 172.21.15.82:0/1207933339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9fc0d11e0 con 0x7fb9fc1f59e0 2023-11-28T13:02:18.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.165+0000 7fba011fb700 1 -- 172.21.15.82:0/1207933339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9fc0a94d0 con 0x7fb9fc1f59e0 2023-11-28T13:02:18.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.165+0000 7fb9f8ff9700 1 -- 172.21.15.82:0/1207933339 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb9ec010070 con 0x7fb9fc1f59e0 2023-11-28T13:02:18.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.165+0000 7fb9f8ff9700 1 --2- 172.21.15.82:0/1207933339 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb9e8064ee0 0x7fb9e8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:18.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.165+0000 7fb9f8ff9700 1 -- 172.21.15.82:0/1207933339 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb9ec082a00 con 0x7fb9fc1f59e0 2023-11-28T13:02:18.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.165+0000 7fb9fbfff700 1 --2- 172.21.15.82:0/1207933339 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb9e8064ee0 0x7fb9e8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:18.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.165+0000 7fb9fbfff700 1 --2- 172.21.15.82:0/1207933339 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb9e8064ee0 0x7fb9e8067390 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0000f60 tx=0x7fb9f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:18.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.177+0000 7fb9f8ff9700 1 -- 172.21.15.82:0/1207933339 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb9ec050e70 con 0x7fb9fc1f59e0 2023-11-28T13:02:18.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.337+0000 7fba011fb700 1 -- 172.21.15.82:0/1207933339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb9fc065fc0 con 0x7fb9fc1f59e0 2023-11-28T13:02:18.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.337+0000 7fb9f8ff9700 1 -- 172.21.15.82:0/1207933339 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb9ec054490 con 0x7fb9fc1f59e0 2023-11-28T13:02:18.342 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:02:18.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.341+0000 7fba011fb700 1 -- 172.21.15.82:0/1207933339 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb9e8064ee0 msgr2=0x7fb9e8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:18.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.341+0000 7fba011fb700 1 --2- 172.21.15.82:0/1207933339 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb9e8064ee0 0x7fb9e8067390 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0000f60 tx=0x7fb9f0009040 comp rx=0 tx=0).stop 2023-11-28T13:02:18.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.341+0000 7fba011fb700 1 -- 172.21.15.82:0/1207933339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9fc1f59e0 msgr2=0x7fb9fc0d1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:18.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.341+0000 7fba011fb700 1 --2- 172.21.15.82:0/1207933339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9fc1f59e0 0x7fb9fc0d1760 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec000f00 tx=0x7fb9ec001a00 comp rx=0 tx=0).stop 2023-11-28T13:02:18.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.341+0000 7fba011fb700 1 -- 172.21.15.82:0/1207933339 shutdown_connections 2023-11-28T13:02:18.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.341+0000 7fba011fb700 1 --2- 172.21.15.82:0/1207933339 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb9e8064ee0 0x7fb9e8067390 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.341+0000 7fba011fb700 1 --2- 172.21.15.82:0/1207933339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9fc0d1ca0 0x7fb9fc14ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.341+0000 7fba011fb700 1 --2- 172.21.15.82:0/1207933339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9fc1f59e0 0x7fb9fc0d1760 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.341+0000 7fba011fb700 1 --2- 172.21.15.82:0/1207933339 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb9e4004870 0x7fb9fc15f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.341+0000 7fba011fb700 1 -- 172.21.15.82:0/1207933339 >> 172.21.15.82:0/1207933339 conn(0x7fb9fc0b52a0 msgr2=0x7fb9fc0b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:18.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.341+0000 7fba011fb700 1 -- 172.21.15.82:0/1207933339 shutdown_connections 2023-11-28T13:02:18.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.341+0000 7fba011fb700 1 -- 172.21.15.82:0/1207933339 wait complete. 2023-11-28T13:02:18.357 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T13:02:18.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.465+0000 7f348a363700 1 Processor -- start 2023-11-28T13:02:18.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.465+0000 7f348a363700 1 -- start start 2023-11-28T13:02:18.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.465+0000 7f348a363700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f34840b3910 0x7f348406b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:18.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.465+0000 7f348a363700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348406c480 con 0x7f348406c910 2023-11-28T13:02:18.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.465+0000 7f348a363700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348406dbe0 con 0x7f3484070070 2023-11-28T13:02:18.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.465+0000 7f348a363700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348406dec0 con 0x7f34840b3910 2023-11-28T13:02:18.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.465+0000 7f3488b60700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f348406c910 0x7f348406d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58742/0 (socket says 172.21.15.82:58742) 2023-11-28T13:02:18.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.465+0000 7f3489361700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f34840b3910 0x7f348406b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:18.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.465+0000 7f3488b60700 1 -- 172.21.15.82:0/901744753 learned_addr learned my addr 172.21.15.82:0/901744753 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:18.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.465+0000 7f347bfff700 1 -- 172.21.15.82:0/901744753 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511224179 0 0) 0x7f348406c480 con 0x7f348406c910 2023-11-28T13:02:18.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.465+0000 7f347bfff700 1 -- 172.21.15.82:0/901744753 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34700035d0 con 0x7f348406c910 2023-11-28T13:02:18.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.465+0000 7f3489361700 1 -- 172.21.15.82:0/901744753 >> v1:172.21.15.114:6789/0 conn(0x7f3484070070 legacy=0x7f3484070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:18.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.465+0000 7f3489361700 1 -- 172.21.15.82:0/901744753 >> v1:172.21.15.82:6789/0 conn(0x7f348406c910 legacy=0x7f348406d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:18.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.465+0000 7f347bfff700 1 -- 172.21.15.82:0/901744753 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1812655136 0 0) 0x7f34700035d0 con 0x7f348406c910 2023-11-28T13:02:18.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.465+0000 7f3489361700 1 -- 172.21.15.82:0/901744753 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348406c110 con 0x7f34840b3910 2023-11-28T13:02:18.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.465+0000 7f3489361700 1 --2- 172.21.15.82:0/901744753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34840b3910 0x7f348406b0a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3474009850 tx=0x7f3474009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948e2ce93216dbec server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:18.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.465+0000 7f347bfff700 1 -- 172.21.15.82:0/901744753 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34800019f0 con 0x7f34840b3910 2023-11-28T13:02:18.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.465+0000 7f347bfff700 1 -- 172.21.15.82:0/901744753 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3474004030 con 0x7f34840b3910 2023-11-28T13:02:18.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.469+0000 7f347bfff700 1 -- 172.21.15.82:0/901744753 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34740043c0 con 0x7f34840b3910 2023-11-28T13:02:18.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.469+0000 7f348a363700 1 -- 172.21.15.82:0/901744753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34840b3910 msgr2=0x7f348406b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:18.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.469+0000 7f348a363700 1 --2- 172.21.15.82:0/901744753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34840b3910 0x7f348406b0a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3474009850 tx=0x7f3474009b60 comp rx=0 tx=0).stop 2023-11-28T13:02:18.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.469+0000 7f348a363700 1 -- 172.21.15.82:0/901744753 shutdown_connections 2023-11-28T13:02:18.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.469+0000 7f348a363700 1 --2- 172.21.15.82:0/901744753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34840b3910 0x7f348406b0a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.469+0000 7f348a363700 1 -- 172.21.15.82:0/901744753 >> 172.21.15.82:0/901744753 conn(0x7f34840ce600 msgr2=0x7f34840ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:18.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.469+0000 7f348a363700 1 -- 172.21.15.82:0/901744753 shutdown_connections 2023-11-28T13:02:18.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.469+0000 7f348a363700 1 -- 172.21.15.82:0/901744753 wait complete. 2023-11-28T13:02:18.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f348a363700 1 Processor -- start 2023-11-28T13:02:18.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f348a363700 1 -- start start 2023-11-28T13:02:18.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f348a363700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f348406c910 0x7f348414dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:18.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f348a363700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3484070070 0x7f348415c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:18.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f348a363700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34840b3910 0x7f348415caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:18.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f348a363700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34840c7230 con 0x7f34840b3910 2023-11-28T13:02:18.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f348a363700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348414b390 con 0x7f3484070070 2023-11-28T13:02:18.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f348a363700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348414e1d0 con 0x7f348406c910 2023-11-28T13:02:18.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f3489b62700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34840b3910 0x7f348415caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:18.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f3489b62700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34840b3910 0x7f348415caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37208/0 (socket says 172.21.15.82:37208) 2023-11-28T13:02:18.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f3489b62700 1 -- 172.21.15.82:0/106882720 learned_addr learned my addr 172.21.15.82:0/106882720 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:18.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f3488b60700 1 --2- 172.21.15.82:0/106882720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3484070070 0x7f348415c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:18.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f3489361700 1 --2- 172.21.15.82:0/106882720 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f348406c910 0x7f348414dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:18.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f3489b62700 1 -- 172.21.15.82:0/106882720 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f348406c910 msgr2=0x7f348414dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:18.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f3489b62700 1 --2- 172.21.15.82:0/106882720 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f348406c910 0x7f348414dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f3489b62700 1 -- 172.21.15.82:0/106882720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3484070070 msgr2=0x7f348415c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:18.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f3489b62700 1 --2- 172.21.15.82:0/106882720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3484070070 0x7f348415c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f3489b62700 1 -- 172.21.15.82:0/106882720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34740094b0 con 0x7f34840b3910 2023-11-28T13:02:18.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f3489b62700 1 --2- 172.21.15.82:0/106882720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34840b3910 0x7f348415caf0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f347c00c480 tx=0x7f347c00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:18.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f3479ffb700 1 -- 172.21.15.82:0/106882720 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c0052d0 con 0x7f34840b3910 2023-11-28T13:02:18.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f3479ffb700 1 -- 172.21.15.82:0/106882720 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347c00ce90 con 0x7f34840b3910 2023-11-28T13:02:18.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f348a363700 1 -- 172.21.15.82:0/106882720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34840b3ce0 con 0x7f34840b3910 2023-11-28T13:02:18.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f3479ffb700 1 -- 172.21.15.82:0/106882720 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c0036a0 con 0x7f34840b3910 2023-11-28T13:02:18.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.473+0000 7f348a363700 1 -- 172.21.15.82:0/106882720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34840c8f80 con 0x7f34840b3910 2023-11-28T13:02:18.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.477+0000 7f348a363700 1 -- 172.21.15.82:0/106882720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34840b3e70 con 0x7f34840b3910 2023-11-28T13:02:18.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.477+0000 7f3479ffb700 1 -- 172.21.15.82:0/106882720 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f347c019030 con 0x7f34840b3910 2023-11-28T13:02:18.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.477+0000 7f3479ffb700 1 --2- 172.21.15.82:0/106882720 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3468064ee0 0x7f3468067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:18.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.477+0000 7f3479ffb700 1 -- 172.21.15.82:0/106882720 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f347c080dd0 con 0x7f34840b3910 2023-11-28T13:02:18.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.477+0000 7f3489361700 1 --2- 172.21.15.82:0/106882720 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3468064ee0 0x7f3468067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:18.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.477+0000 7f3489361700 1 --2- 172.21.15.82:0/106882720 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3468064ee0 0x7f3468067390 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f34740090b0 tx=0x7f3474008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:18.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.485+0000 7f3479ffb700 1 -- 172.21.15.82:0/106882720 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f347c04f240 con 0x7f34840b3910 2023-11-28T13:02:18.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.649+0000 7f348a363700 1 -- 172.21.15.82:0/106882720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3484065fc0 con 0x7f34840b3910 2023-11-28T13:02:18.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.649+0000 7f3479ffb700 1 -- 172.21.15.82:0/106882720 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v47) v1 ==== 84+0+126 (secure 0 0 0) 0x7f347c056e60 con 0x7f34840b3910 2023-11-28T13:02:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:18.653 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-11-28T13:02:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2023-11-28T13:02:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2023-11-28T13:02:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 2, 2023-11-28T13:02:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "rbd" 2023-11-28T13:02:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:18.654 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-11-28T13:02:18.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.653+0000 7f348a363700 1 -- 172.21.15.82:0/106882720 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3468064ee0 msgr2=0x7f3468067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:18.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.653+0000 7f348a363700 1 --2- 172.21.15.82:0/106882720 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3468064ee0 0x7f3468067390 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f34740090b0 tx=0x7f3474008030 comp rx=0 tx=0).stop 2023-11-28T13:02:18.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.653+0000 7f348a363700 1 -- 172.21.15.82:0/106882720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34840b3910 msgr2=0x7f348415caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:18.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.653+0000 7f348a363700 1 --2- 172.21.15.82:0/106882720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34840b3910 0x7f348415caf0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f347c00c480 tx=0x7f347c00c790 comp rx=0 tx=0).stop 2023-11-28T13:02:18.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.653+0000 7f348a363700 1 -- 172.21.15.82:0/106882720 shutdown_connections 2023-11-28T13:02:18.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.653+0000 7f348a363700 1 --2- 172.21.15.82:0/106882720 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3468064ee0 0x7f3468067390 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.653+0000 7f348a363700 1 --2- 172.21.15.82:0/106882720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34840b3910 0x7f348415caf0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.653+0000 7f348a363700 1 --2- 172.21.15.82:0/106882720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3484070070 0x7f348415c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.653+0000 7f348a363700 1 --2- 172.21.15.82:0/106882720 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f348406c910 0x7f348414dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.653+0000 7f348a363700 1 -- 172.21.15.82:0/106882720 >> 172.21.15.82:0/106882720 conn(0x7f34840ce600 msgr2=0x7f348406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:18.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.653+0000 7f348a363700 1 -- 172.21.15.82:0/106882720 shutdown_connections 2023-11-28T13:02:18.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.653+0000 7f348a363700 1 -- 172.21.15.82:0/106882720 wait complete. 2023-11-28T13:02:18.667 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T13:02:18.668 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T13:02:18.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.785+0000 7fa8c280a700 1 Processor -- start 2023-11-28T13:02:18.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.785+0000 7fa8c280a700 1 -- start start 2023-11-28T13:02:18.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.785+0000 7fa8c280a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa8bc15c250 0x7fa8bc1606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:18.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.785+0000 7fa8c280a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8bc06ce80 con 0x7fa8bc0cd2b0 2023-11-28T13:02:18.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.785+0000 7fa8c280a700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8bc0c9e90 con 0x7fa8bc0b1830 2023-11-28T13:02:18.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.785+0000 7fa8c280a700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8bc160cb0 con 0x7fa8bc15c250 2023-11-28T13:02:18.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.789+0000 7fa8c1808700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa8bc15c250 0x7fa8bc1606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:18.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.789+0000 7fa8c1007700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa8bc0cd2b0 0x7fa8bc0b1120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58748/0 (socket says 172.21.15.82:58748) 2023-11-28T13:02:18.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.789+0000 7fa8c1007700 1 -- 172.21.15.82:0/1702653750 learned_addr learned my addr 172.21.15.82:0/1702653750 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:18.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.789+0000 7fa8c1808700 1 -- 172.21.15.82:0/1702653750 >> v1:172.21.15.114:6789/0 conn(0x7fa8bc0b1830 legacy=0x7fa8bc0cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:18.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.789+0000 7fa8c1808700 1 -- 172.21.15.82:0/1702653750 >> v1:172.21.15.82:6789/0 conn(0x7fa8bc0cd2b0 legacy=0x7fa8bc0b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:18.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.789+0000 7fa8c1808700 1 -- 172.21.15.82:0/1702653750 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc0ca170 con 0x7fa8bc15c250 2023-11-28T13:02:18.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.789+0000 7fa8c0806700 1 -- 172.21.15.82:0/1702653750 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165734757 0 0) 0x7fa8bc06ce80 con 0x7fa8bc0cd2b0 2023-11-28T13:02:18.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.789+0000 7fa8c1808700 1 --2- 172.21.15.82:0/1702653750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8bc15c250 0x7fa8bc1606d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009850 tx=0x7fa8ac009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69131f17a871b751 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:18.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.789+0000 7fa8c0806700 1 -- 172.21.15.82:0/1702653750 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac011830 con 0x7fa8bc15c250 2023-11-28T13:02:18.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.789+0000 7fa8c0806700 1 -- 172.21.15.82:0/1702653750 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac011990 con 0x7fa8bc15c250 2023-11-28T13:02:18.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.789+0000 7fa8c0806700 1 -- 172.21.15.82:0/1702653750 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac011d20 con 0x7fa8bc15c250 2023-11-28T13:02:18.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.789+0000 7fa8c280a700 1 -- 172.21.15.82:0/1702653750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8bc15c250 msgr2=0x7fa8bc1606d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:18.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.789+0000 7fa8c280a700 1 --2- 172.21.15.82:0/1702653750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8bc15c250 0x7fa8bc1606d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009850 tx=0x7fa8ac009b60 comp rx=0 tx=0).stop 2023-11-28T13:02:18.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.789+0000 7fa8c280a700 1 -- 172.21.15.82:0/1702653750 shutdown_connections 2023-11-28T13:02:18.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.789+0000 7fa8c280a700 1 --2- 172.21.15.82:0/1702653750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8bc15c250 0x7fa8bc1606d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.789+0000 7fa8c280a700 1 -- 172.21.15.82:0/1702653750 >> 172.21.15.82:0/1702653750 conn(0x7fa8bc0cc120 msgr2=0x7fa8bc0cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:18.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.789+0000 7fa8c280a700 1 -- 172.21.15.82:0/1702653750 shutdown_connections 2023-11-28T13:02:18.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.789+0000 7fa8c280a700 1 -- 172.21.15.82:0/1702653750 wait complete. 2023-11-28T13:02:18.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c280a700 1 Processor -- start 2023-11-28T13:02:18.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c280a700 1 -- start start 2023-11-28T13:02:18.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c280a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa8bc0b1830 0x7fa8bc153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:18.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c280a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8bc0cd2b0 0x7fa8bc0c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:18.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c280a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8bc15c250 0x7fa8bc0c5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:18.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c280a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc0c47c0 con 0x7fa8bc0cd2b0 2023-11-28T13:02:18.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c280a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc0c3bb0 con 0x7fa8bc15c250 2023-11-28T13:02:18.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c280a700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc0c3e90 con 0x7fa8bc0b1830 2023-11-28T13:02:18.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c1007700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8bc0cd2b0 0x7fa8bc0c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:18.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c1007700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8bc0cd2b0 0x7fa8bc0c31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37222/0 (socket says 172.21.15.82:37222) 2023-11-28T13:02:18.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c1007700 1 -- 172.21.15.82:0/1716437162 learned_addr learned my addr 172.21.15.82:0/1716437162 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:18.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c2009700 1 --2- 172.21.15.82:0/1716437162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8bc15c250 0x7fa8bc0c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:18.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c1808700 1 --2- 172.21.15.82:0/1716437162 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa8bc0b1830 0x7fa8bc153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:18.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c1007700 1 -- 172.21.15.82:0/1716437162 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa8bc0b1830 msgr2=0x7fa8bc153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:18.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c1007700 1 --2- 172.21.15.82:0/1716437162 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa8bc0b1830 0x7fa8bc153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c1007700 1 -- 172.21.15.82:0/1716437162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8bc15c250 msgr2=0x7fa8bc0c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:18.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c1007700 1 --2- 172.21.15.82:0/1716437162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8bc15c250 0x7fa8bc0c5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:18.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c1007700 1 -- 172.21.15.82:0/1716437162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac0094b0 con 0x7fa8bc0cd2b0 2023-11-28T13:02:18.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c1808700 1 --2- 172.21.15.82:0/1716437162 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa8bc0b1830 0x7fa8bc153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:18.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c2009700 1 --2- 172.21.15.82:0/1716437162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8bc15c250 0x7fa8bc0c5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:18.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c1007700 1 --2- 172.21.15.82:0/1716437162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8bc0cd2b0 0x7fa8bc0c31d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800c550 tx=0x7fa8b800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:18.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8b27fc700 1 -- 172.21.15.82:0/1716437162 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8004ca0 con 0x7fa8bc0cd2b0 2023-11-28T13:02:18.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8b27fc700 1 -- 172.21.15.82:0/1716437162 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b8004e00 con 0x7fa8bc0cd2b0 2023-11-28T13:02:18.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8b27fc700 1 -- 172.21.15.82:0/1716437162 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8007310 con 0x7fa8bc0cd2b0 2023-11-28T13:02:18.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c280a700 1 -- 172.21.15.82:0/1716437162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8bc0ca730 con 0x7fa8bc0cd2b0 2023-11-28T13:02:18.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.793+0000 7fa8c280a700 1 -- 172.21.15.82:0/1716437162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8bc0ca450 con 0x7fa8bc0cd2b0 2023-11-28T13:02:18.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.797+0000 7fa8c280a700 1 -- 172.21.15.82:0/1716437162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8bc0cac50 con 0x7fa8bc0cd2b0 2023-11-28T13:02:18.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.797+0000 7fa8b27fc700 1 -- 172.21.15.82:0/1716437162 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa8b801a020 con 0x7fa8bc0cd2b0 2023-11-28T13:02:18.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.797+0000 7fa8b27fc700 1 --2- 172.21.15.82:0/1716437162 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa8a0064ee0 0x7fa8a0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:18.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.797+0000 7fa8b27fc700 1 -- 172.21.15.82:0/1716437162 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa8b8081770 con 0x7fa8bc0cd2b0 2023-11-28T13:02:18.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.797+0000 7fa8c1808700 1 --2- 172.21.15.82:0/1716437162 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa8a0064ee0 0x7fa8a0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:18.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.801+0000 7fa8c1808700 1 --2- 172.21.15.82:0/1716437162 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa8a0064ee0 0x7fa8a0067390 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0090b0 tx=0x7fa8ac01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:18.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.805+0000 7fa8b27fc700 1 -- 172.21.15.82:0/1716437162 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa8b804fc60 con 0x7fa8bc0cd2b0 2023-11-28T13:02:18.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:18.969+0000 7fa8c280a700 1 -- 172.21.15.82:0/1716437162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa8bc065fc0 con 0x7fa8bc0cd2b0 2023-11-28T13:02:19.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.069+0000 7fa8b27fc700 1 -- 172.21.15.82:0/1716437162 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v48) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa8b8053280 con 0x7fa8bc0cd2b0 2023-11-28T13:02:19.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.077+0000 7fa8c280a700 1 -- 172.21.15.82:0/1716437162 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa8a0064ee0 msgr2=0x7fa8a0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:19.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.077+0000 7fa8c280a700 1 --2- 172.21.15.82:0/1716437162 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa8a0064ee0 0x7fa8a0067390 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0090b0 tx=0x7fa8ac01c040 comp rx=0 tx=0).stop 2023-11-28T13:02:19.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.077+0000 7fa8c280a700 1 -- 172.21.15.82:0/1716437162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8bc0cd2b0 msgr2=0x7fa8bc0c31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:19.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.077+0000 7fa8c280a700 1 --2- 172.21.15.82:0/1716437162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8bc0cd2b0 0x7fa8bc0c31d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800c550 tx=0x7fa8b800c910 comp rx=0 tx=0).stop 2023-11-28T13:02:19.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.077+0000 7fa8c280a700 1 -- 172.21.15.82:0/1716437162 shutdown_connections 2023-11-28T13:02:19.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.077+0000 7fa8c280a700 1 --2- 172.21.15.82:0/1716437162 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa8a0064ee0 0x7fa8a0067390 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:19.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.077+0000 7fa8c280a700 1 --2- 172.21.15.82:0/1716437162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8bc15c250 0x7fa8bc0c5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:19.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.077+0000 7fa8c280a700 1 --2- 172.21.15.82:0/1716437162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8bc0cd2b0 0x7fa8bc0c31d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:19.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.077+0000 7fa8c280a700 1 --2- 172.21.15.82:0/1716437162 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa8bc0b1830 0x7fa8bc153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:19.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.077+0000 7fa8c280a700 1 -- 172.21.15.82:0/1716437162 >> 172.21.15.82:0/1716437162 conn(0x7fa8bc0cc120 msgr2=0x7fa8bc0cf630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:19.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.077+0000 7fa8c280a700 1 -- 172.21.15.82:0/1716437162 shutdown_connections 2023-11-28T13:02:19.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.077+0000 7fa8c280a700 1 -- 172.21.15.82:0/1716437162 wait complete. 2023-11-28T13:02:19.084 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2023-11-28T13:02:19.095 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T13:02:19.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63f00a700 1 Processor -- start 2023-11-28T13:02:19.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63f00a700 1 -- start start 2023-11-28T13:02:19.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63f00a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb6380b61d0 0x7fb6380cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:19.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63f00a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6380d0570 con 0x7fb6380d0060 2023-11-28T13:02:19.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63f00a700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63815dbf0 con 0x7fb6380b29e0 2023-11-28T13:02:19.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63f00a700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63815ded0 con 0x7fb6380b61d0 2023-11-28T13:02:19.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63e008700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb6380b61d0 0x7fb6380cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:19.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63d807700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb6380d0060 0x7fb6380b22d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58754/0 (socket says 172.21.15.82:58754) 2023-11-28T13:02:19.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63d807700 1 -- 172.21.15.82:0/2284153216 learned_addr learned my addr 172.21.15.82:0/2284153216 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:19.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63d006700 1 -- 172.21.15.82:0/2284153216 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613109309 0 0) 0x7fb6380d0570 con 0x7fb6380d0060 2023-11-28T13:02:19.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63d006700 1 -- 172.21.15.82:0/2284153216 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6240035d0 con 0x7fb6380d0060 2023-11-28T13:02:19.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63e008700 1 -- 172.21.15.82:0/2284153216 >> v1:172.21.15.114:6789/0 conn(0x7fb6380b29e0 legacy=0x7fb63806d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:19.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63e008700 1 -- 172.21.15.82:0/2284153216 >> v1:172.21.15.82:6789/0 conn(0x7fb6380d0060 legacy=0x7fb6380b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:19.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63e008700 1 -- 172.21.15.82:0/2284153216 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63815e1b0 con 0x7fb6380b61d0 2023-11-28T13:02:19.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63e008700 1 --2- 172.21.15.82:0/2284153216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6380b61d0 0x7fb6380cfb20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb628009850 tx=0x7fb628009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8d9d20d659199f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:19.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63d006700 1 -- 172.21.15.82:0/2284153216 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb628011830 con 0x7fb6380b61d0 2023-11-28T13:02:19.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63d006700 1 -- 172.21.15.82:0/2284153216 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb628011990 con 0x7fb6380b61d0 2023-11-28T13:02:19.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63d006700 1 -- 172.21.15.82:0/2284153216 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb628011d00 con 0x7fb6380b61d0 2023-11-28T13:02:19.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63f00a700 1 -- 172.21.15.82:0/2284153216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6380b61d0 msgr2=0x7fb6380cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:19.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63f00a700 1 --2- 172.21.15.82:0/2284153216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6380b61d0 0x7fb6380cfb20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb628009850 tx=0x7fb628009b60 comp rx=0 tx=0).stop 2023-11-28T13:02:19.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63f00a700 1 -- 172.21.15.82:0/2284153216 shutdown_connections 2023-11-28T13:02:19.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63f00a700 1 --2- 172.21.15.82:0/2284153216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6380b61d0 0x7fb6380cfb20 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:19.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.209+0000 7fb63f00a700 1 -- 172.21.15.82:0/2284153216 >> 172.21.15.82:0/2284153216 conn(0x7fb6380cd2d0 msgr2=0x7fb6380cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:19.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.213+0000 7fb63f00a700 1 -- 172.21.15.82:0/2284153216 shutdown_connections 2023-11-28T13:02:19.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.213+0000 7fb63f00a700 1 -- 172.21.15.82:0/2284153216 wait complete. 2023-11-28T13:02:19.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.213+0000 7fb63f00a700 1 Processor -- start 2023-11-28T13:02:19.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.213+0000 7fb63f00a700 1 -- start start 2023-11-28T13:02:19.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.213+0000 7fb63f00a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6380b29e0 0x7fb6381521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:19.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.213+0000 7fb63f00a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6380b61d0 0x7fb6380c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:19.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.213+0000 7fb63f00a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6380d0060 0x7fb638156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:19.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.213+0000 7fb63f00a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb638153210 con 0x7fb6380d0060 2023-11-28T13:02:19.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.213+0000 7fb63f00a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380c7e60 con 0x7fb6380b29e0 2023-11-28T13:02:19.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.213+0000 7fb63f00a700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb638153460 con 0x7fb6380b61d0 2023-11-28T13:02:19.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.217+0000 7fb63e809700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6380d0060 0x7fb638156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:19.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.217+0000 7fb63e809700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6380d0060 0x7fb638156dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37250/0 (socket says 172.21.15.82:37250) 2023-11-28T13:02:19.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.217+0000 7fb63e809700 1 -- 172.21.15.82:0/348854647 learned_addr learned my addr 172.21.15.82:0/348854647 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:19.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.217+0000 7fb63e008700 1 --2- 172.21.15.82:0/348854647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6380b29e0 0x7fb6381521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:19.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.217+0000 7fb63d807700 1 --2- 172.21.15.82:0/348854647 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6380b61d0 0x7fb6380c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:19.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.217+0000 7fb63e809700 1 -- 172.21.15.82:0/348854647 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6380b61d0 msgr2=0x7fb6380c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:19.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.217+0000 7fb63e809700 1 --2- 172.21.15.82:0/348854647 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6380b61d0 0x7fb6380c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:19.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.217+0000 7fb63e809700 1 -- 172.21.15.82:0/348854647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6380b29e0 msgr2=0x7fb6381521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:19.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.217+0000 7fb63e809700 1 --2- 172.21.15.82:0/348854647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6380b29e0 0x7fb6381521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:19.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.217+0000 7fb63e809700 1 -- 172.21.15.82:0/348854647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6280094b0 con 0x7fb6380d0060 2023-11-28T13:02:19.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.217+0000 7fb63d807700 1 --2- 172.21.15.82:0/348854647 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6380b61d0 0x7fb6380c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:02:19.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.217+0000 7fb63e809700 1 --2- 172.21.15.82:0/348854647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6380d0060 0x7fb638156dd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb63000cbc0 tx=0x7fb63000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.217+0000 7fb62effd700 1 -- 172.21.15.82:0/348854647 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb630003c20 con 0x7fb6380d0060 2023-11-28T13:02:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.217+0000 7fb62effd700 1 -- 172.21.15.82:0/348854647 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb630003d80 con 0x7fb6380d0060 2023-11-28T13:02:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.217+0000 7fb63f00a700 1 -- 172.21.15.82:0/348854647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6380afdc0 con 0x7fb6380d0060 2023-11-28T13:02:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.217+0000 7fb62effd700 1 -- 172.21.15.82:0/348854647 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63000abb0 con 0x7fb6380d0060 2023-11-28T13:02:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.217+0000 7fb63f00a700 1 -- 172.21.15.82:0/348854647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63815e490 con 0x7fb6380d0060 2023-11-28T13:02:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.217+0000 7fb63f00a700 1 -- 172.21.15.82:0/348854647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6380aff50 con 0x7fb6380d0060 2023-11-28T13:02:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.217+0000 7fb62effd700 1 -- 172.21.15.82:0/348854647 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb630010050 con 0x7fb6380d0060 2023-11-28T13:02:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.221+0000 7fb62effd700 1 --2- 172.21.15.82:0/348854647 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb61c064ee0 0x7fb61c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.221+0000 7fb62effd700 1 -- 172.21.15.82:0/348854647 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fb630082650 con 0x7fb6380d0060 2023-11-28T13:02:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.221+0000 7fb63e008700 1 --2- 172.21.15.82:0/348854647 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb61c064ee0 0x7fb61c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.221+0000 7fb63e008700 1 --2- 172.21.15.82:0/348854647 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb61c064ee0 0x7fb61c067390 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb628009ba0 tx=0x7fb628008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:19.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.225+0000 7fb62effd700 1 -- 172.21.15.82:0/348854647 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb630050a70 con 0x7fb6380d0060 2023-11-28T13:02:19.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:19.385+0000 7fb63f00a700 1 -- 172.21.15.82:0/348854647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb638065fc0 con 0x7fb6380d0060 2023-11-28T13:02:20.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.081+0000 7fb62effd700 1 -- 172.21.15.82:0/348854647 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v49) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb630054090 con 0x7fb6380d0060 2023-11-28T13:02:20.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.097+0000 7fb63f00a700 1 -- 172.21.15.82:0/348854647 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb61c064ee0 msgr2=0x7fb61c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:20.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.097+0000 7fb63f00a700 1 --2- 172.21.15.82:0/348854647 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb61c064ee0 0x7fb61c067390 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb628009ba0 tx=0x7fb628008030 comp rx=0 tx=0).stop 2023-11-28T13:02:20.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.097+0000 7fb63f00a700 1 -- 172.21.15.82:0/348854647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6380d0060 msgr2=0x7fb638156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:20.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.097+0000 7fb63f00a700 1 --2- 172.21.15.82:0/348854647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6380d0060 0x7fb638156dd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb63000cbc0 tx=0x7fb63000cf80 comp rx=0 tx=0).stop 2023-11-28T13:02:20.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.097+0000 7fb63f00a700 1 -- 172.21.15.82:0/348854647 shutdown_connections 2023-11-28T13:02:20.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.097+0000 7fb63f00a700 1 --2- 172.21.15.82:0/348854647 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb61c064ee0 0x7fb61c067390 secure :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb628009ba0 tx=0x7fb628008030 comp rx=0 tx=0).stop 2023-11-28T13:02:20.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.097+0000 7fb63f00a700 1 --2- 172.21.15.82:0/348854647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6380d0060 0x7fb638156dd0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.097+0000 7fb63f00a700 1 --2- 172.21.15.82:0/348854647 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb6380b61d0 0x7fb6380c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.097+0000 7fb63f00a700 1 --2- 172.21.15.82:0/348854647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6380b29e0 0x7fb6381521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.097+0000 7fb63f00a700 1 -- 172.21.15.82:0/348854647 >> 172.21.15.82:0/348854647 conn(0x7fb6380cd2d0 msgr2=0x7fb6380b3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:20.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.097+0000 7fb63f00a700 1 -- 172.21.15.82:0/348854647 shutdown_connections 2023-11-28T13:02:20.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.097+0000 7fb63f00a700 1 -- 172.21.15.82:0/348854647 wait complete. 2023-11-28T13:02:20.110 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2023-11-28T13:02:20.121 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T13:02:20.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.233+0000 7f4c78460700 1 Processor -- start 2023-11-28T13:02:20.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.233+0000 7f4c78460700 1 -- start start 2023-11-28T13:02:20.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c78460700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4c700ccbf0 0x7f4c700c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:20.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c78460700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4c700cd120 0x7f4c700ca180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:20.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c78460700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c7015d560 con 0x7f4c7006dd50 2023-11-28T13:02:20.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c78460700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c700c4fb0 con 0x7f4c700cd120 2023-11-28T13:02:20.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c78460700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c700c45e0 con 0x7f4c700ccbf0 2023-11-28T13:02:20.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c761fc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4c7006dd50 0x7f4c7006e120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58760/0 (socket says 172.21.15.82:58760) 2023-11-28T13:02:20.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c761fc700 1 -- 172.21.15.82:0/4117440866 learned_addr learned my addr 172.21.15.82:0/4117440866 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:20.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c769fd700 1 --2- 172.21.15.82:0/4117440866 >> v2:172.21.15.82:3300/0 conn(0x7f4c700cd120 0x7f4c700ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:20.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c759fb700 1 --2- 172.21.15.82:0/4117440866 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4c700ccbf0 0x7f4c700c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:20.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c751fa700 1 -- 172.21.15.82:0/4117440866 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 308589212 0 0) 0x7f4c7015d560 con 0x7f4c7006dd50 2023-11-28T13:02:20.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c751fa700 1 -- 172.21.15.82:0/4117440866 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c5c0035d0 con 0x7f4c7006dd50 2023-11-28T13:02:20.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c751fa700 1 -- 172.21.15.82:0/4117440866 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1640466951 0 0) 0x7f4c5c0035d0 con 0x7f4c7006dd50 2023-11-28T13:02:20.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c751fa700 1 -- 172.21.15.82:0/4117440866 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4c700ccbf0 msgr2=0x7f4c700c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:20.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c751fa700 1 --2- 172.21.15.82:0/4117440866 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4c700ccbf0 0x7f4c700c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c751fa700 1 -- 172.21.15.82:0/4117440866 >> v2:172.21.15.82:3300/0 conn(0x7f4c700cd120 msgr2=0x7f4c700ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:20.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c751fa700 1 --2- 172.21.15.82:0/4117440866 >> v2:172.21.15.82:3300/0 conn(0x7f4c700cd120 0x7f4c700ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c751fa700 1 -- 172.21.15.82:0/4117440866 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7006f440 con 0x7f4c7006dd50 2023-11-28T13:02:20.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c751fa700 1 -- 172.21.15.82:0/4117440866 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f4c6c001670 con 0x7f4c7006dd50 2023-11-28T13:02:20.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c769fd700 1 --2- 172.21.15.82:0/4117440866 >> v2:172.21.15.82:3300/0 conn(0x7f4c700cd120 0x7f4c700ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:02:20.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c751fa700 1 -- 172.21.15.82:0/4117440866 >> v1:172.21.15.82:6789/0 conn(0x7f4c7006dd50 legacy=0x7f4c7006e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:20.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c751fa700 1 --2- 172.21.15.82:0/4117440866 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4c700ccbf0 0x7f4c5c003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:20.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c751fa700 1 --2- 172.21.15.82:0/4117440866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c5c003fa0 0x7f4c5c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:20.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c751fa700 1 --2- 172.21.15.82:0/4117440866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c5c004db0 0x7f4c5c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:20.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c751fa700 1 -- 172.21.15.82:0/4117440866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c700c4fb0 con 0x7f4c5c004db0 2023-11-28T13:02:20.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c751fa700 1 -- 172.21.15.82:0/4117440866 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c700c45e0 con 0x7f4c5c003fa0 2023-11-28T13:02:20.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c751fa700 1 -- 172.21.15.82:0/4117440866 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c00dd20 con 0x7f4c700ccbf0 2023-11-28T13:02:20.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c769fd700 1 --2- 172.21.15.82:0/4117440866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c5c004db0 0x7f4c5c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:20.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c761fc700 1 --2- 172.21.15.82:0/4117440866 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4c700ccbf0 0x7f4c5c003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:20.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c759fb700 1 --2- 172.21.15.82:0/4117440866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c5c003fa0 0x7f4c5c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:20.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c769fd700 1 -- 172.21.15.82:0/4117440866 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4c700ccbf0 msgr2=0x7f4c5c003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:20.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c769fd700 1 --2- 172.21.15.82:0/4117440866 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4c700ccbf0 0x7f4c5c003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c769fd700 1 -- 172.21.15.82:0/4117440866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c5c003fa0 msgr2=0x7f4c5c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:20.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c769fd700 1 --2- 172.21.15.82:0/4117440866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c5c003fa0 0x7f4c5c004870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c769fd700 1 -- 172.21.15.82:0/4117440866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5c0035d0 con 0x7f4c5c004db0 2023-11-28T13:02:20.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c769fd700 1 --2- 172.21.15.82:0/4117440866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c5c004db0 0x7f4c5c005220 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800e320 tx=0x7f4c5c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af7e35e05032d43 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:20.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c751fa700 1 -- 172.21.15.82:0/4117440866 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6800edc0 con 0x7f4c5c004db0 2023-11-28T13:02:20.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c751fa700 1 -- 172.21.15.82:0/4117440866 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6800f040 con 0x7f4c5c004db0 2023-11-28T13:02:20.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c751fa700 1 -- 172.21.15.82:0/4117440866 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c680146a0 con 0x7f4c5c004db0 2023-11-28T13:02:20.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c78460700 1 -- 172.21.15.82:0/4117440866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c5c004db0 msgr2=0x7f4c5c005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:20.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c78460700 1 --2- 172.21.15.82:0/4117440866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c5c004db0 0x7f4c5c005220 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800e320 tx=0x7f4c5c0058a0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c769fd700 1 -- 172.21.15.82:0/4117440866 reap_dead start 2023-11-28T13:02:20.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c78460700 1 -- 172.21.15.82:0/4117440866 shutdown_connections 2023-11-28T13:02:20.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c78460700 1 -- 172.21.15.82:0/4117440866 >> 172.21.15.82:0/4117440866 conn(0x7f4c700b18c0 msgr2=0x7f4c700cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:20.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c78460700 1 -- 172.21.15.82:0/4117440866 shutdown_connections 2023-11-28T13:02:20.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c78460700 1 -- 172.21.15.82:0/4117440866 wait complete. 2023-11-28T13:02:20.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c78460700 1 Processor -- start 2023-11-28T13:02:20.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.237+0000 7f4c78460700 1 -- start start 2023-11-28T13:02:20.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c78460700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4c70149f10 0x7f4c70159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:20.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c78460700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c7015a2a0 0x7f4c700b2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:20.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c78460700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c700b2b70 0x7f4c7015a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:20.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c78460700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c701e2dd0 con 0x7f4c7015a2a0 2023-11-28T13:02:20.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c78460700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c701e3020 con 0x7f4c700b2b70 2023-11-28T13:02:20.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c78460700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c701e3300 con 0x7f4c70149f10 2023-11-28T13:02:20.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c759fb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c7015a2a0 0x7f4c700b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:20.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c759fb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c7015a2a0 0x7f4c700b2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37268/0 (socket says 172.21.15.82:37268) 2023-11-28T13:02:20.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c759fb700 1 -- 172.21.15.82:0/3840748576 learned_addr learned my addr 172.21.15.82:0/3840748576 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:20.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c761fc700 1 --2- 172.21.15.82:0/3840748576 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4c70149f10 0x7f4c70159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:20.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c769fd700 1 --2- 172.21.15.82:0/3840748576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c700b2b70 0x7f4c7015a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:20.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c759fb700 1 -- 172.21.15.82:0/3840748576 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4c70149f10 msgr2=0x7f4c70159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:20.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c759fb700 1 --2- 172.21.15.82:0/3840748576 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4c70149f10 0x7f4c70159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c759fb700 1 -- 172.21.15.82:0/3840748576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c700b2b70 msgr2=0x7f4c7015a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:20.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c759fb700 1 --2- 172.21.15.82:0/3840748576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c700b2b70 0x7f4c7015a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c759fb700 1 -- 172.21.15.82:0/3840748576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c700c3fd0 con 0x7f4c7015a2a0 2023-11-28T13:02:20.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c769fd700 1 --2- 172.21.15.82:0/3840748576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c700b2b70 0x7f4c7015a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:02:20.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c759fb700 1 --2- 172.21.15.82:0/3840748576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c7015a2a0 0x7f4c700b2630 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4c60010920 tx=0x7f4c60010c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:20.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c66ffd700 1 -- 172.21.15.82:0/3840748576 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c600096c0 con 0x7f4c7015a2a0 2023-11-28T13:02:20.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c66ffd700 1 -- 172.21.15.82:0/3840748576 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6000ea70 con 0x7f4c7015a2a0 2023-11-28T13:02:20.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c78460700 1 -- 172.21.15.82:0/3840748576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7015da90 con 0x7f4c7015a2a0 2023-11-28T13:02:20.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c66ffd700 1 -- 172.21.15.82:0/3840748576 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000ee20 con 0x7f4c7015a2a0 2023-11-28T13:02:20.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c78460700 1 -- 172.21.15.82:0/3840748576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7015d7b0 con 0x7f4c7015a2a0 2023-11-28T13:02:20.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.241+0000 7f4c78460700 1 -- 172.21.15.82:0/3840748576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c700cebd0 con 0x7f4c7015a2a0 2023-11-28T13:02:20.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.245+0000 7f4c66ffd700 1 -- 172.21.15.82:0/3840748576 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4c60012040 con 0x7f4c7015a2a0 2023-11-28T13:02:20.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.245+0000 7f4c66ffd700 1 --2- 172.21.15.82:0/3840748576 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4c54064f10 0x7f4c540673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:20.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.245+0000 7f4c761fc700 1 --2- 172.21.15.82:0/3840748576 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4c54064f10 0x7f4c540673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:20.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.245+0000 7f4c66ffd700 1 -- 172.21.15.82:0/3840748576 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f4c600820b0 con 0x7f4c7015a2a0 2023-11-28T13:02:20.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.245+0000 7f4c761fc700 1 --2- 172.21.15.82:0/3840748576 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4c54064f10 0x7f4c540673c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0048f0 tx=0x7f4c6c007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:20.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.249+0000 7f4c66ffd700 1 -- 172.21.15.82:0/3840748576 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4c60050360 con 0x7f4c7015a2a0 2023-11-28T13:02:20.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.449+0000 7f4c78460700 1 -- 172.21.15.82:0/3840748576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4c70073e20 con 0x7f4c7015a2a0 2023-11-28T13:02:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.465+0000 7f4c66ffd700 1 -- 172.21.15.82:0/3840748576 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v18) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4c60053980 con 0x7f4c7015a2a0 2023-11-28T13:02:20.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.469+0000 7f4c78460700 1 -- 172.21.15.82:0/3840748576 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4c54064f10 msgr2=0x7f4c540673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:20.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.469+0000 7f4c78460700 1 --2- 172.21.15.82:0/3840748576 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4c54064f10 0x7f4c540673c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0048f0 tx=0x7f4c6c007040 comp rx=0 tx=0).stop 2023-11-28T13:02:20.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.469+0000 7f4c78460700 1 -- 172.21.15.82:0/3840748576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c7015a2a0 msgr2=0x7f4c700b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:20.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.469+0000 7f4c78460700 1 --2- 172.21.15.82:0/3840748576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c7015a2a0 0x7f4c700b2630 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4c60010920 tx=0x7f4c60010c30 comp rx=0 tx=0).stop 2023-11-28T13:02:20.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.473+0000 7f4c78460700 1 -- 172.21.15.82:0/3840748576 shutdown_connections 2023-11-28T13:02:20.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.473+0000 7f4c78460700 1 --2- 172.21.15.82:0/3840748576 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4c54064f10 0x7f4c540673c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.473+0000 7f4c78460700 1 --2- 172.21.15.82:0/3840748576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c700b2b70 0x7f4c7015a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.473+0000 7f4c78460700 1 --2- 172.21.15.82:0/3840748576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c7015a2a0 0x7f4c700b2630 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.473+0000 7f4c78460700 1 --2- 172.21.15.82:0/3840748576 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4c70149f10 0x7f4c70159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.473+0000 7f4c78460700 1 -- 172.21.15.82:0/3840748576 >> 172.21.15.82:0/3840748576 conn(0x7f4c700b18c0 msgr2=0x7f4c700af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:20.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.481+0000 7f4c78460700 1 -- 172.21.15.82:0/3840748576 shutdown_connections 2023-11-28T13:02:20.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.481+0000 7f4c78460700 1 -- 172.21.15.82:0/3840748576 wait complete. 2023-11-28T13:02:20.490 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 7 and data pool 8 2023-11-28T13:02:20.503 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:02:20.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.597+0000 7f78aa844700 1 Processor -- start 2023-11-28T13:02:20.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.597+0000 7f78aa844700 1 -- start start 2023-11-28T13:02:20.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.597+0000 7f78aa844700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f78a40ced70 0x7f78a406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:20.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.597+0000 7f78aa844700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f78a40d06f0 0x7f78a40d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:20.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.597+0000 7f78aa844700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a40d28e0 con 0x7f78a406b910 2023-11-28T13:02:20.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.597+0000 7f78aa844700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a40cdfe0 con 0x7f78a40ced70 2023-11-28T13:02:20.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.597+0000 7f78aa844700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a406c220 con 0x7f78a40d06f0 2023-11-28T13:02:20.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.597+0000 7f78a9041700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f78a40ced70 0x7f78a406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:20.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.601+0000 7f78a9041700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f78a40ced70 0x7f78a406bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37284/0 (socket says 172.21.15.82:37284) 2023-11-28T13:02:20.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.601+0000 7f78a9041700 1 -- 172.21.15.82:0/2203723740 learned_addr learned my addr 172.21.15.82:0/2203723740 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:20.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.601+0000 7f78aa043700 1 --2- 172.21.15.82:0/2203723740 >> v2:172.21.15.114:3300/0 conn(0x7f78a40d06f0 0x7f78a40d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:20.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.601+0000 7f78a9041700 1 -- 172.21.15.82:0/2203723740 >> v2:172.21.15.114:3300/0 conn(0x7f78a40d06f0 msgr2=0x7f78a40d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:20.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.601+0000 7f78a9041700 1 --2- 172.21.15.82:0/2203723740 >> v2:172.21.15.114:3300/0 conn(0x7f78a40d06f0 0x7f78a40d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.601+0000 7f78a9041700 1 -- 172.21.15.82:0/2203723740 >> v1:172.21.15.114:6789/0 conn(0x7f78a406b910 legacy=0x7f78a4160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:20.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.601+0000 7f78a9041700 1 -- 172.21.15.82:0/2203723740 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a40b2040 con 0x7f78a40ced70 2023-11-28T13:02:20.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.601+0000 7f78aa043700 1 --2- 172.21.15.82:0/2203723740 >> v2:172.21.15.114:3300/0 conn(0x7f78a40d06f0 0x7f78a40d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:20.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.601+0000 7f78a9041700 1 --2- 172.21.15.82:0/2203723740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78a40ced70 0x7f78a406bce0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f78a40b23b0 tx=0x7f78a0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa590a39ee2cee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:20.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.601+0000 7f78a8840700 1 -- 172.21.15.82:0/2203723740 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a000b8a0 con 0x7f78a40ced70 2023-11-28T13:02:20.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.601+0000 7f78a8840700 1 -- 172.21.15.82:0/2203723740 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a000ba00 con 0x7f78a40ced70 2023-11-28T13:02:20.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.601+0000 7f78a8840700 1 -- 172.21.15.82:0/2203723740 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a000bd90 con 0x7f78a40ced70 2023-11-28T13:02:20.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.601+0000 7f78aa844700 1 -- 172.21.15.82:0/2203723740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78a40ced70 msgr2=0x7f78a406bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:20.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.601+0000 7f78aa844700 1 --2- 172.21.15.82:0/2203723740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78a40ced70 0x7f78a406bce0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f78a40b23b0 tx=0x7f78a0009bf0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.601+0000 7f78aa844700 1 -- 172.21.15.82:0/2203723740 shutdown_connections 2023-11-28T13:02:20.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.601+0000 7f78aa844700 1 --2- 172.21.15.82:0/2203723740 >> v2:172.21.15.114:3300/0 conn(0x7f78a40d06f0 0x7f78a40d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.601+0000 7f78aa844700 1 --2- 172.21.15.82:0/2203723740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78a40ced70 0x7f78a406bce0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.601+0000 7f78aa844700 1 -- 172.21.15.82:0/2203723740 >> 172.21.15.82:0/2203723740 conn(0x7f78a40d2b20 msgr2=0x7f78a40d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:20.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.601+0000 7f78aa844700 1 -- 172.21.15.82:0/2203723740 shutdown_connections 2023-11-28T13:02:20.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.601+0000 7f78aa844700 1 -- 172.21.15.82:0/2203723740 wait complete. 2023-11-28T13:02:20.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.605+0000 7f78aa844700 1 Processor -- start 2023-11-28T13:02:20.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.605+0000 7f78aa844700 1 -- start start 2023-11-28T13:02:20.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.605+0000 7f78aa844700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f78a406b910 0x7f78a41e5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:20.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.605+0000 7f78aa844700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78a40ced70 0x7f78a40cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:20.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.605+0000 7f78aa844700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78a40d06f0 0x7f78a40b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:20.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.605+0000 7f78aa844700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a41e5640 con 0x7f78a40d06f0 2023-11-28T13:02:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.605+0000 7f78aa844700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a41e5920 con 0x7f78a40ced70 2023-11-28T13:02:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.605+0000 7f78aa844700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a41e5c00 con 0x7f78a406b910 2023-11-28T13:02:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.605+0000 7f78aa043700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78a40d06f0 0x7f78a40b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.605+0000 7f78aa043700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78a40d06f0 0x7f78a40b61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37288/0 (socket says 172.21.15.82:37288) 2023-11-28T13:02:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.605+0000 7f78aa043700 1 -- 172.21.15.82:0/649198007 learned_addr learned my addr 172.21.15.82:0/649198007 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.609+0000 7f78a9041700 1 --2- 172.21.15.82:0/649198007 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78a40ced70 0x7f78a40cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.609+0000 7f78a9842700 1 --2- 172.21.15.82:0/649198007 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f78a406b910 0x7f78a41e5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.609+0000 7f78aa043700 1 -- 172.21.15.82:0/649198007 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f78a406b910 msgr2=0x7f78a41e5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.609+0000 7f78aa043700 1 --2- 172.21.15.82:0/649198007 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f78a406b910 0x7f78a41e5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.609+0000 7f78aa043700 1 -- 172.21.15.82:0/649198007 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78a40ced70 msgr2=0x7f78a40cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:20.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.609+0000 7f78aa043700 1 --2- 172.21.15.82:0/649198007 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78a40ced70 0x7f78a40cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.609+0000 7f78aa043700 1 -- 172.21.15.82:0/649198007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a0009570 con 0x7f78a40d06f0 2023-11-28T13:02:20.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.609+0000 7f78aa043700 1 --2- 172.21.15.82:0/649198007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78a40d06f0 0x7f78a40b61e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f789c007df0 tx=0x7f789c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:20.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.609+0000 7f789a7fc700 1 -- 172.21.15.82:0/649198007 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c00ddd0 con 0x7f78a40d06f0 2023-11-28T13:02:20.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.609+0000 7f789a7fc700 1 -- 172.21.15.82:0/649198007 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c00f040 con 0x7f78a40d06f0 2023-11-28T13:02:20.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.609+0000 7f78aa844700 1 -- 172.21.15.82:0/649198007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a40d2320 con 0x7f78a40d06f0 2023-11-28T13:02:20.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.609+0000 7f789a7fc700 1 -- 172.21.15.82:0/649198007 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c003c80 con 0x7f78a40d06f0 2023-11-28T13:02:20.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.609+0000 7f78aa844700 1 -- 172.21.15.82:0/649198007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a40cf2c0 con 0x7f78a40d06f0 2023-11-28T13:02:20.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.609+0000 7f78aa844700 1 -- 172.21.15.82:0/649198007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a40d2600 con 0x7f78a40d06f0 2023-11-28T13:02:20.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.609+0000 7f789a7fc700 1 -- 172.21.15.82:0/649198007 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f789c01c030 con 0x7f78a40d06f0 2023-11-28T13:02:20.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.609+0000 7f789a7fc700 1 --2- 172.21.15.82:0/649198007 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7888064ee0 0x7f7888067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:20.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.609+0000 7f789a7fc700 1 -- 172.21.15.82:0/649198007 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f789c081ff0 con 0x7f78a40d06f0 2023-11-28T13:02:20.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.609+0000 7f78a9842700 1 --2- 172.21.15.82:0/649198007 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7888064ee0 0x7f7888067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:20.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.613+0000 7f78a9842700 1 --2- 172.21.15.82:0/649198007 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7888064ee0 0x7f7888067390 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f78940016e0 tx=0x7f7894009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:20.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.621+0000 7f789a7fc700 1 -- 172.21.15.82:0/649198007 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f789c050110 con 0x7f78a40d06f0 2023-11-28T13:02:20.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.785+0000 7f78aa844700 1 -- 172.21.15.82:0/649198007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78a4065fc0 con 0x7f78a40d06f0 2023-11-28T13:02:20.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.789+0000 7f789a7fc700 1 -- 172.21.15.82:0/649198007 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+17896 (secure 0 0 0) 0x7f789c053730 con 0x7f78a40d06f0 2023-11-28T13:02:20.792 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:20.792 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":50,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:02:20.453561+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:02:19.012136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T13:02:19.431685+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:02:20.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.789+0000 7f78aa844700 1 -- 172.21.15.82:0/649198007 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7888064ee0 msgr2=0x7f7888067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:20.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.789+0000 7f78aa844700 1 --2- 172.21.15.82:0/649198007 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7888064ee0 0x7f7888067390 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f78940016e0 tx=0x7f7894009040 comp rx=0 tx=0).stop 2023-11-28T13:02:20.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.789+0000 7f78aa844700 1 -- 172.21.15.82:0/649198007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78a40d06f0 msgr2=0x7f78a40b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:20.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.789+0000 7f78aa844700 1 --2- 172.21.15.82:0/649198007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78a40d06f0 0x7f78a40b61e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f789c007df0 tx=0x7f789c00d3b0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.789+0000 7f78aa844700 1 -- 172.21.15.82:0/649198007 shutdown_connections 2023-11-28T13:02:20.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.789+0000 7f78aa844700 1 --2- 172.21.15.82:0/649198007 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7888064ee0 0x7f7888067390 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.789+0000 7f78aa844700 1 --2- 172.21.15.82:0/649198007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78a40d06f0 0x7f78a40b61e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.789+0000 7f78aa844700 1 --2- 172.21.15.82:0/649198007 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78a40ced70 0x7f78a40cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.789+0000 7f78aa844700 1 --2- 172.21.15.82:0/649198007 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f78a406b910 0x7f78a41e5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:20.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.789+0000 7f78aa844700 1 -- 172.21.15.82:0/649198007 >> 172.21.15.82:0/649198007 conn(0x7f78a40d2b20 msgr2=0x7f78a4158030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:20.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.789+0000 7f78aa844700 1 -- 172.21.15.82:0/649198007 shutdown_connections 2023-11-28T13:02:20.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.789+0000 7f78aa844700 1 -- 172.21.15.82:0/649198007 wait complete. 2023-11-28T13:02:20.807 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:02:20.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.921+0000 7f187ffff700 1 Processor -- start 2023-11-28T13:02:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.921+0000 7f187ffff700 1 -- start start 2023-11-28T13:02:21.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.921+0000 7f187ffff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f18800b3910 0x7f188006b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:21.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.921+0000 7f187ffff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1880070070 0x7f18800704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:21.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.921+0000 7f187ffff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188006c480 con 0x7f188006c910 2023-11-28T13:02:21.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.921+0000 7f187ffff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18800709f0 con 0x7f18800b3910 2023-11-28T13:02:21.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.921+0000 7f187ffff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188006dbe0 con 0x7f1880070070 2023-11-28T13:02:21.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.921+0000 7f187f7fe700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1880070070 0x7f18800704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:21.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.921+0000 7f187effd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f18800b3910 0x7f188006b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:21.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.921+0000 7f18767fc700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f188006c910 0x7f188006d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:45578/0 (socket says 172.21.15.82:45578) 2023-11-28T13:02:21.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.921+0000 7f187effd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f18800b3910 0x7f188006b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:43762/0 (socket says 172.21.15.82:43762) 2023-11-28T13:02:21.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.921+0000 7f187f7fe700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1880070070 0x7f18800704b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:35182/0 (socket says 172.21.15.82:35182) 2023-11-28T13:02:21.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.921+0000 7f18767fc700 1 -- 172.21.15.82:0/1331386152 learned_addr learned my addr 172.21.15.82:0/1331386152 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:21.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.925+0000 7f187effd700 1 -- 172.21.15.82:0/1331386152 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1880070070 msgr2=0x7f18800704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:21.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.925+0000 7f187effd700 1 --2- 172.21.15.82:0/1331386152 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1880070070 0x7f18800704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:21.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.925+0000 7f187effd700 1 -- 172.21.15.82:0/1331386152 >> v1:172.21.15.114:6789/0 conn(0x7f188006c910 legacy=0x7f188006d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:21.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.925+0000 7f187effd700 1 -- 172.21.15.82:0/1331386152 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188006dec0 con 0x7f18800b3910 2023-11-28T13:02:21.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.925+0000 7f187effd700 1 --2- 172.21.15.82:0/1331386152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18800b3910 0x7f188006b0a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1870009850 tx=0x7f1870009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64e9eabb5ebd3acf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:21.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.925+0000 7f187e7fc700 1 -- 172.21.15.82:0/1331386152 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870011830 con 0x7f18800b3910 2023-11-28T13:02:21.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.925+0000 7f187e7fc700 1 -- 172.21.15.82:0/1331386152 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1870011990 con 0x7f18800b3910 2023-11-28T13:02:21.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.925+0000 7f187e7fc700 1 -- 172.21.15.82:0/1331386152 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870011d40 con 0x7f18800b3910 2023-11-28T13:02:21.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.925+0000 7f187ffff700 1 -- 172.21.15.82:0/1331386152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18800b3910 msgr2=0x7f188006b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:21.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.925+0000 7f187ffff700 1 --2- 172.21.15.82:0/1331386152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18800b3910 0x7f188006b0a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1870009850 tx=0x7f1870009b60 comp rx=0 tx=0).stop 2023-11-28T13:02:21.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.925+0000 7f187ffff700 1 -- 172.21.15.82:0/1331386152 shutdown_connections 2023-11-28T13:02:21.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.925+0000 7f187ffff700 1 --2- 172.21.15.82:0/1331386152 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1880070070 0x7f18800704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:21.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.925+0000 7f187ffff700 1 --2- 172.21.15.82:0/1331386152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18800b3910 0x7f188006b0a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.925+0000 7f187ffff700 1 -- 172.21.15.82:0/1331386152 >> 172.21.15.82:0/1331386152 conn(0x7f18800ce600 msgr2=0x7f18800ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.925+0000 7f187ffff700 1 -- 172.21.15.82:0/1331386152 shutdown_connections 2023-11-28T13:02:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.925+0000 7f187ffff700 1 -- 172.21.15.82:0/1331386152 wait complete. 2023-11-28T13:02:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.925+0000 7f187ffff700 1 Processor -- start 2023-11-28T13:02:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f187ffff700 1 -- start start 2023-11-28T13:02:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f187ffff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f188006c910 0x7f18800c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f187ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1880070070 0x7f1880157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f187ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18800b3910 0x7f188015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f187ffff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188015a3e0 con 0x7f18800b3910 2023-11-28T13:02:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f187ffff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18801ef4c0 con 0x7f1880070070 2023-11-28T13:02:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f187ffff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188015e090 con 0x7f188006c910 2023-11-28T13:02:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f187f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18800b3910 0x7f188015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f187f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18800b3910 0x7f188015d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37294/0 (socket says 172.21.15.82:37294) 2023-11-28T13:02:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f187f7fe700 1 -- 172.21.15.82:0/4151633496 learned_addr learned my addr 172.21.15.82:0/4151633496 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f187effd700 1 --2- 172.21.15.82:0/4151633496 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f188006c910 0x7f18800c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f18767fc700 1 --2- 172.21.15.82:0/4151633496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1880070070 0x7f1880157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f187f7fe700 1 -- 172.21.15.82:0/4151633496 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f188006c910 msgr2=0x7f18800c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f187f7fe700 1 --2- 172.21.15.82:0/4151633496 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f188006c910 0x7f18800c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f187f7fe700 1 -- 172.21.15.82:0/4151633496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1880070070 msgr2=0x7f1880157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f187f7fe700 1 --2- 172.21.15.82:0/4151633496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1880070070 0x7f1880157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f187f7fe700 1 -- 172.21.15.82:0/4151633496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18700094b0 con 0x7f18800b3910 2023-11-28T13:02:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f187f7fe700 1 --2- 172.21.15.82:0/4151633496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18800b3910 0x7f188015d7d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f187800efc0 tx=0x7f187800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f1877fff700 1 -- 172.21.15.82:0/4151633496 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1878009ea0 con 0x7f18800b3910 2023-11-28T13:02:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f1877fff700 1 -- 172.21.15.82:0/4151633496 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187800f040 con 0x7f18800b3910 2023-11-28T13:02:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f187ffff700 1 -- 172.21.15.82:0/4151633496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18800c8f80 con 0x7f18800b3910 2023-11-28T13:02:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f1877fff700 1 -- 172.21.15.82:0/4151633496 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187800ced0 con 0x7f18800b3910 2023-11-28T13:02:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.929+0000 7f187ffff700 1 -- 172.21.15.82:0/4151633496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188006c110 con 0x7f18800b3910 2023-11-28T13:02:21.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.933+0000 7f187ffff700 1 -- 172.21.15.82:0/4151633496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18800b3ce0 con 0x7f18800b3910 2023-11-28T13:02:21.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.933+0000 7f1877fff700 1 -- 172.21.15.82:0/4151633496 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1878014480 con 0x7f18800b3910 2023-11-28T13:02:21.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.933+0000 7f1877fff700 1 --2- 172.21.15.82:0/4151633496 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1864064ee0 0x7f1864067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:21.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.933+0000 7f1877fff700 1 -- 172.21.15.82:0/4151633496 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1878082920 con 0x7f18800b3910 2023-11-28T13:02:21.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.933+0000 7f187effd700 1 --2- 172.21.15.82:0/4151633496 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1864064ee0 0x7f1864067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:21.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.933+0000 7f187effd700 1 --2- 172.21.15.82:0/4151633496 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1864064ee0 0x7f1864067390 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f18700090b0 tx=0x7f187001c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:21.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:20.941+0000 7f1877fff700 1 -- 172.21.15.82:0/4151633496 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1878050970 con 0x7f18800b3910 2023-11-28T13:02:21.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.105+0000 7f187ffff700 1 -- 172.21.15.82:0/4151633496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1880065fc0 con 0x7f18800b3910 2023-11-28T13:02:21.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.105+0000 7f1877fff700 1 -- 172.21.15.82:0/4151633496 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+17896 (secure 0 0 0) 0x7f1878053f90 con 0x7f18800b3910 2023-11-28T13:02:21.238 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:21.238 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":50,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:02:20.453561+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:02:19.012136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T13:02:19.431685+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:02:21.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.109+0000 7f187ffff700 1 -- 172.21.15.82:0/4151633496 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1864064ee0 msgr2=0x7f1864067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.109+0000 7f187ffff700 1 --2- 172.21.15.82:0/4151633496 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1864064ee0 0x7f1864067390 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f18700090b0 tx=0x7f187001c040 comp rx=0 tx=0).stop 2023-11-28T13:02:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.109+0000 7f187ffff700 1 -- 172.21.15.82:0/4151633496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18800b3910 msgr2=0x7f188015d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.109+0000 7f187ffff700 1 --2- 172.21.15.82:0/4151633496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18800b3910 0x7f188015d7d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f187800efc0 tx=0x7f187800c3a0 comp rx=0 tx=0).stop 2023-11-28T13:02:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.109+0000 7f187ffff700 1 -- 172.21.15.82:0/4151633496 shutdown_connections 2023-11-28T13:02:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.109+0000 7f187ffff700 1 --2- 172.21.15.82:0/4151633496 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1864064ee0 0x7f1864067390 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.109+0000 7f187ffff700 1 --2- 172.21.15.82:0/4151633496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18800b3910 0x7f188015d7d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.109+0000 7f187ffff700 1 --2- 172.21.15.82:0/4151633496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1880070070 0x7f1880157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.109+0000 7f187ffff700 1 --2- 172.21.15.82:0/4151633496 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f188006c910 0x7f18800c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.109+0000 7f187ffff700 1 -- 172.21.15.82:0/4151633496 >> 172.21.15.82:0/4151633496 conn(0x7f18800ce600 msgr2=0x7f18800b2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.109+0000 7f187ffff700 1 -- 172.21.15.82:0/4151633496 shutdown_connections 2023-11-28T13:02:21.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.109+0000 7f187ffff700 1 -- 172.21.15.82:0/4151633496 wait complete. 2023-11-28T13:02:21.243 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T13:02:21.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.365+0000 7f8283fff700 1 Processor -- start 2023-11-28T13:02:21.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.365+0000 7f8283fff700 1 -- start start 2023-11-28T13:02:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8283fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8284070910 0x7f8284070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8283fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82840ad820 0x7f828406a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8283fff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82840c93a0 con 0x7f82841640a0 2023-11-28T13:02:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8283fff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82840c96f0 con 0x7f8284070910 2023-11-28T13:02:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8283fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8284071580 con 0x7f82840ad820 2023-11-28T13:02:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f82837fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f82841640a0 0x7f8284164510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58774/0 (socket says 172.21.15.82:58774) 2023-11-28T13:02:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f82837fe700 1 -- 172.21.15.82:0/2986339271 learned_addr learned my addr 172.21.15.82:0/2986339271 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8282ffd700 1 --2- 172.21.15.82:0/2986339271 >> v2:172.21.15.82:3300/0 conn(0x7f8284070910 0x7f8284070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f82827fc700 1 --2- 172.21.15.82:0/2986339271 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82840ad820 0x7f828406a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8281ffb700 1 -- 172.21.15.82:0/2986339271 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451283569 0 0) 0x7f82840c93a0 con 0x7f82841640a0 2023-11-28T13:02:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8281ffb700 1 -- 172.21.15.82:0/2986339271 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82700035d0 con 0x7f82841640a0 2023-11-28T13:02:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8282ffd700 1 -- 172.21.15.82:0/2986339271 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82840ad820 msgr2=0x7f828406a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8282ffd700 1 --2- 172.21.15.82:0/2986339271 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82840ad820 0x7f828406a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8282ffd700 1 -- 172.21.15.82:0/2986339271 >> v1:172.21.15.82:6789/0 conn(0x7f82841640a0 legacy=0x7f8284164510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8282ffd700 1 -- 172.21.15.82:0/2986339271 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8284071220 con 0x7f8284070910 2023-11-28T13:02:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8282ffd700 1 --2- 172.21.15.82:0/2986339271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8284070910 0x7f8284070ce0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8274009880 tx=0x7f8274009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa1c0d30a6e6a26 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8281ffb700 1 -- 172.21.15.82:0/2986339271 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8274011830 con 0x7f8284070910 2023-11-28T13:02:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8281ffb700 1 -- 172.21.15.82:0/2986339271 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8274011990 con 0x7f8284070910 2023-11-28T13:02:21.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8281ffb700 1 -- 172.21.15.82:0/2986339271 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8274011d00 con 0x7f8284070910 2023-11-28T13:02:21.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8283fff700 1 -- 172.21.15.82:0/2986339271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8284070910 msgr2=0x7f8284070ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:21.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8283fff700 1 --2- 172.21.15.82:0/2986339271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8284070910 0x7f8284070ce0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8274009880 tx=0x7f8274009b90 comp rx=0 tx=0).stop 2023-11-28T13:02:21.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8283fff700 1 -- 172.21.15.82:0/2986339271 shutdown_connections 2023-11-28T13:02:21.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8283fff700 1 --2- 172.21.15.82:0/2986339271 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82840ad820 0x7f828406a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:21.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8283fff700 1 --2- 172.21.15.82:0/2986339271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8284070910 0x7f8284070ce0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:21.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8283fff700 1 -- 172.21.15.82:0/2986339271 >> 172.21.15.82:0/2986339271 conn(0x7f82840ce630 msgr2=0x7f82840cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:21.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8283fff700 1 -- 172.21.15.82:0/2986339271 shutdown_connections 2023-11-28T13:02:21.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.369+0000 7f8283fff700 1 -- 172.21.15.82:0/2986339271 wait complete. 2023-11-28T13:02:21.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f8283fff700 1 Processor -- start 2023-11-28T13:02:21.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f8283fff700 1 -- start start 2023-11-28T13:02:21.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f8283fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8284070910 0x7f82841441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:21.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f8283fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82840ad820 0x7f8284159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:21.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f8283fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82841640a0 0x7f82841608b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:21.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f8283fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8284144a10 con 0x7f82841640a0 2023-11-28T13:02:21.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f8283fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8284163e10 con 0x7f82840ad820 2023-11-28T13:02:21.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f8283fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8284157190 con 0x7f8284070910 2023-11-28T13:02:21.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f82837fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82841640a0 0x7f82841608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:21.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f8282ffd700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8284070910 0x7f82841441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:21.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f82837fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82841640a0 0x7f82841608b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37304/0 (socket says 172.21.15.82:37304) 2023-11-28T13:02:21.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f82837fe700 1 -- 172.21.15.82:0/3776131798 learned_addr learned my addr 172.21.15.82:0/3776131798 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:21.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f82827fc700 1 --2- 172.21.15.82:0/3776131798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82840ad820 0x7f8284159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:21.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f82837fe700 1 -- 172.21.15.82:0/3776131798 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8284070910 msgr2=0x7f82841441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:21.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f82837fe700 1 --2- 172.21.15.82:0/3776131798 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8284070910 0x7f82841441c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:21.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f82837fe700 1 -- 172.21.15.82:0/3776131798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82840ad820 msgr2=0x7f8284159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:21.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f82837fe700 1 --2- 172.21.15.82:0/3776131798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82840ad820 0x7f8284159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:21.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f82837fe700 1 -- 172.21.15.82:0/3776131798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82740094b0 con 0x7f82841640a0 2023-11-28T13:02:21.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f82827fc700 1 --2- 172.21.15.82:0/3776131798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82840ad820 0x7f8284159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:21.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f82837fe700 1 --2- 172.21.15.82:0/3776131798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82841640a0 0x7f82841608b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f827c005930 tx=0x7f827c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:21.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f827bfff700 1 -- 172.21.15.82:0/3776131798 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c005d90 con 0x7f82841640a0 2023-11-28T13:02:21.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f8283fff700 1 -- 172.21.15.82:0/3776131798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828406ade0 con 0x7f82841640a0 2023-11-28T13:02:21.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f827bfff700 1 -- 172.21.15.82:0/3776131798 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c0070d0 con 0x7f82841640a0 2023-11-28T13:02:21.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f827bfff700 1 -- 172.21.15.82:0/3776131798 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c007440 con 0x7f82841640a0 2023-11-28T13:02:21.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.373+0000 7f8283fff700 1 -- 172.21.15.82:0/3776131798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828406ab10 con 0x7f82841640a0 2023-11-28T13:02:21.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.377+0000 7f8283fff700 1 -- 172.21.15.82:0/3776131798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828406b0c0 con 0x7f82841640a0 2023-11-28T13:02:21.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.377+0000 7f827bfff700 1 -- 172.21.15.82:0/3776131798 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f827c019030 con 0x7f82841640a0 2023-11-28T13:02:21.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.377+0000 7f827bfff700 1 --2- 172.21.15.82:0/3776131798 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8264064ee0 0x7f8264067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:21.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.377+0000 7f827bfff700 1 -- 172.21.15.82:0/3776131798 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f827c081180 con 0x7f82841640a0 2023-11-28T13:02:21.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.377+0000 7f8282ffd700 1 --2- 172.21.15.82:0/3776131798 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8264064ee0 0x7f8264067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:21.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.377+0000 7f8282ffd700 1 --2- 172.21.15.82:0/3776131798 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8264064ee0 0x7f8264067390 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8274000c00 tx=0x7f827401c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:21.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.385+0000 7f827bfff700 1 -- 172.21.15.82:0/3776131798 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f827c04a400 con 0x7f82841640a0 2023-11-28T13:02:21.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:21.593+0000 7f8283fff700 1 -- 172.21.15.82:0/3776131798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8284065fc0 con 0x7f82841640a0 2023-11-28T13:02:22.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.477+0000 7f827bfff700 1 -- 172.21.15.82:0/3776131798 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 118+0+0 (secure 0 0 0) 0x7f827c04f260 con 0x7f82841640a0 2023-11-28T13:02:22.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.481+0000 7f8283fff700 1 -- 172.21.15.82:0/3776131798 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8264064ee0 msgr2=0x7f8264067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:22.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.481+0000 7f8283fff700 1 --2- 172.21.15.82:0/3776131798 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8264064ee0 0x7f8264067390 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8274000c00 tx=0x7f827401c040 comp rx=0 tx=0).stop 2023-11-28T13:02:22.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.481+0000 7f8283fff700 1 -- 172.21.15.82:0/3776131798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82841640a0 msgr2=0x7f82841608b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:22.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.481+0000 7f8283fff700 1 --2- 172.21.15.82:0/3776131798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82841640a0 0x7f82841608b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f827c005930 tx=0x7f827c00c7b0 comp rx=0 tx=0).stop 2023-11-28T13:02:22.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.481+0000 7f8283fff700 1 -- 172.21.15.82:0/3776131798 shutdown_connections 2023-11-28T13:02:22.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.481+0000 7f8283fff700 1 --2- 172.21.15.82:0/3776131798 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8264064ee0 0x7f8264067390 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:22.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.481+0000 7f8283fff700 1 --2- 172.21.15.82:0/3776131798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82841640a0 0x7f82841608b0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:22.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.481+0000 7f8283fff700 1 --2- 172.21.15.82:0/3776131798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82840ad820 0x7f8284159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:22.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.481+0000 7f8283fff700 1 --2- 172.21.15.82:0/3776131798 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8284070910 0x7f82841441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:22.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.481+0000 7f8283fff700 1 -- 172.21.15.82:0/3776131798 >> 172.21.15.82:0/3776131798 conn(0x7f82840ce630 msgr2=0x7f8284164510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:22.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.481+0000 7f8283fff700 1 -- 172.21.15.82:0/3776131798 shutdown_connections 2023-11-28T13:02:22.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.481+0000 7f8283fff700 1 -- 172.21.15.82:0/3776131798 wait complete. 2023-11-28T13:02:22.503 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T13:02:22.503 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T13:02:22.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.625+0000 7fddd6949700 1 Processor -- start 2023-11-28T13:02:22.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.625+0000 7fddd6949700 1 -- start start 2023-11-28T13:02:22.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd6949700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddd00b1d10 0x7fddd00cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:22.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd6949700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd0069bc0 con 0x7fddd006c140 2023-11-28T13:02:22.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd6949700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd00d1480 con 0x7fddd00d25b0 2023-11-28T13:02:22.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd6949700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00cd280 con 0x7fddd00b1d10 2023-11-28T13:02:22.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd6148700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fddd006c140 0x7fddd006a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58776/0 (socket says 172.21.15.82:58776) 2023-11-28T13:02:22.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd6148700 1 -- 172.21.15.82:0/482413974 learned_addr learned my addr 172.21.15.82:0/482413974 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:22.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd5947700 1 --2- 172.21.15.82:0/482413974 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddd00b1d10 0x7fddd00cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:22.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd4945700 1 -- 172.21.15.82:0/482413974 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2094380049 0 0) 0x7fddd0069bc0 con 0x7fddd006c140 2023-11-28T13:02:22.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd4945700 1 -- 172.21.15.82:0/482413974 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddbc0035d0 con 0x7fddd006c140 2023-11-28T13:02:22.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd5947700 1 -- 172.21.15.82:0/482413974 >> v1:172.21.15.114:6789/0 conn(0x7fddd00d25b0 legacy=0x7fddd006ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:22.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd5947700 1 -- 172.21.15.82:0/482413974 >> v1:172.21.15.82:6789/0 conn(0x7fddd006c140 legacy=0x7fddd006a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:22.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd5947700 1 -- 172.21.15.82:0/482413974 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd00cd560 con 0x7fddd00b1d10 2023-11-28T13:02:22.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd5947700 1 --2- 172.21.15.82:0/482413974 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddd00b1d10 0x7fddd00cec20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fddc0009880 tx=0x7fddc0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4c5c4e3b4ef00a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:22.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd4945700 1 -- 172.21.15.82:0/482413974 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc0011830 con 0x7fddd00b1d10 2023-11-28T13:02:22.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd4945700 1 -- 172.21.15.82:0/482413974 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc0011990 con 0x7fddd00b1d10 2023-11-28T13:02:22.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd4945700 1 -- 172.21.15.82:0/482413974 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc0011d00 con 0x7fddd00b1d10 2023-11-28T13:02:22.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd6949700 1 -- 172.21.15.82:0/482413974 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddd00b1d10 msgr2=0x7fddd00cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:22.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd6949700 1 --2- 172.21.15.82:0/482413974 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddd00b1d10 0x7fddd00cec20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fddc0009880 tx=0x7fddc0009b90 comp rx=0 tx=0).stop 2023-11-28T13:02:22.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd6949700 1 -- 172.21.15.82:0/482413974 shutdown_connections 2023-11-28T13:02:22.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd6949700 1 --2- 172.21.15.82:0/482413974 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddd00b1d10 0x7fddd00cec20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:22.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd6949700 1 -- 172.21.15.82:0/482413974 >> 172.21.15.82:0/482413974 conn(0x7fddd00b52a0 msgr2=0x7fddd00d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:22.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd6949700 1 -- 172.21.15.82:0/482413974 shutdown_connections 2023-11-28T13:02:22.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.629+0000 7fddd6949700 1 -- 172.21.15.82:0/482413974 wait complete. 2023-11-28T13:02:22.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.633+0000 7fddd6949700 1 Processor -- start 2023-11-28T13:02:22.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.633+0000 7fddd6949700 1 -- start start 2023-11-28T13:02:22.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.633+0000 7fddd6949700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddd006c140 0x7fddd0157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:22.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.633+0000 7fddd6949700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddd00b1d10 0x7fddd00b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:22.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.633+0000 7fddd6949700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddd00d25b0 0x7fddd00b7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:22.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.633+0000 7fddd6949700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00c9be0 con 0x7fddd00b1d10 2023-11-28T13:02:22.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.633+0000 7fddd6949700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00c9e50 con 0x7fddd006c140 2023-11-28T13:02:22.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.633+0000 7fddd6949700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00ca130 con 0x7fddd00d25b0 2023-11-28T13:02:22.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.633+0000 7fddd5146700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddd00b1d10 0x7fddd00b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:22.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.633+0000 7fddd5146700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddd00b1d10 0x7fddd00b6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37310/0 (socket says 172.21.15.82:37310) 2023-11-28T13:02:22.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.633+0000 7fddd5146700 1 -- 172.21.15.82:0/3746168702 learned_addr learned my addr 172.21.15.82:0/3746168702 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:22.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.633+0000 7fddd5947700 1 --2- 172.21.15.82:0/3746168702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddd006c140 0x7fddd0157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:22.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.633+0000 7fddd6148700 1 --2- 172.21.15.82:0/3746168702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddd00d25b0 0x7fddd00b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:22.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.633+0000 7fddd6148700 1 -- 172.21.15.82:0/3746168702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddd006c140 msgr2=0x7fddd0157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:22.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.633+0000 7fddd6148700 1 --2- 172.21.15.82:0/3746168702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddd006c140 0x7fddd0157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:22.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.633+0000 7fddd6148700 1 -- 172.21.15.82:0/3746168702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddd00b1d10 msgr2=0x7fddd00b6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:22.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.633+0000 7fddd6148700 1 --2- 172.21.15.82:0/3746168702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddd00b1d10 0x7fddd00b6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:22.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.633+0000 7fddd6148700 1 -- 172.21.15.82:0/3746168702 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc00094b0 con 0x7fddd00d25b0 2023-11-28T13:02:22.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.633+0000 7fddd5146700 1 --2- 172.21.15.82:0/3746168702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddd00b1d10 0x7fddd00b6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:02:22.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.633+0000 7fddd6148700 1 --2- 172.21.15.82:0/3746168702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddd00d25b0 0x7fddd00b7470 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fddc800ca80 tx=0x7fddc800cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:22.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.637+0000 7fddc67fc700 1 -- 172.21.15.82:0/3746168702 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc8007480 con 0x7fddd00d25b0 2023-11-28T13:02:22.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.637+0000 7fddc67fc700 1 -- 172.21.15.82:0/3746168702 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc80075e0 con 0x7fddd00d25b0 2023-11-28T13:02:22.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.637+0000 7fddd6949700 1 -- 172.21.15.82:0/3746168702 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd00d1050 con 0x7fddd00d25b0 2023-11-28T13:02:22.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.637+0000 7fddc67fc700 1 -- 172.21.15.82:0/3746168702 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc8007950 con 0x7fddd00d25b0 2023-11-28T13:02:22.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.637+0000 7fddd6949700 1 -- 172.21.15.82:0/3746168702 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd00b20e0 con 0x7fddd00d25b0 2023-11-28T13:02:22.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.637+0000 7fddd6949700 1 -- 172.21.15.82:0/3746168702 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd00d11e0 con 0x7fddd00d25b0 2023-11-28T13:02:22.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.637+0000 7fddc67fc700 1 -- 172.21.15.82:0/3746168702 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fddc8019030 con 0x7fddd00d25b0 2023-11-28T13:02:22.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.637+0000 7fddc67fc700 1 --2- 172.21.15.82:0/3746168702 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fddb4064ee0 0x7fddb4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:22.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.637+0000 7fddc67fc700 1 -- 172.21.15.82:0/3746168702 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fddc8081550 con 0x7fddd00d25b0 2023-11-28T13:02:22.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.637+0000 7fddd5947700 1 --2- 172.21.15.82:0/3746168702 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fddb4064ee0 0x7fddb4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:22.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.637+0000 7fddd5947700 1 --2- 172.21.15.82:0/3746168702 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fddb4064ee0 0x7fddb4067390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fddc00090b0 tx=0x7fddc0010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:22.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.649+0000 7fddc67fc700 1 -- 172.21.15.82:0/3746168702 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fddc804a400 con 0x7fddd00d25b0 2023-11-28T13:02:22.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:22.849+0000 7fddd6949700 1 -- 172.21.15.82:0/3746168702 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fddd00ca650 con 0x7fddd00d25b0 2023-11-28T13:02:23.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.489+0000 7fddc67fc700 1 -- 172.21.15.82:0/3746168702 <== mon.2 v2:172.21.15.114:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fddd00ca650 con 0x7fddd00d25b0 2023-11-28T13:02:23.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.493+0000 7fddd6949700 1 -- 172.21.15.82:0/3746168702 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fddb4064ee0 msgr2=0x7fddb4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:23.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.493+0000 7fddd6949700 1 --2- 172.21.15.82:0/3746168702 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fddb4064ee0 0x7fddb4067390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fddc00090b0 tx=0x7fddc0010000 comp rx=0 tx=0).stop 2023-11-28T13:02:23.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.493+0000 7fddd6949700 1 -- 172.21.15.82:0/3746168702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddd00d25b0 msgr2=0x7fddd00b7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:23.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.493+0000 7fddd6949700 1 --2- 172.21.15.82:0/3746168702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddd00d25b0 0x7fddd00b7470 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fddc800ca80 tx=0x7fddc800cab0 comp rx=0 tx=0).stop 2023-11-28T13:02:23.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.497+0000 7fddd6949700 1 -- 172.21.15.82:0/3746168702 shutdown_connections 2023-11-28T13:02:23.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.497+0000 7fddd6949700 1 --2- 172.21.15.82:0/3746168702 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fddb4064ee0 0x7fddb4067390 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:23.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.497+0000 7fddd6949700 1 --2- 172.21.15.82:0/3746168702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddd00d25b0 0x7fddd00b7470 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:23.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.497+0000 7fddd6949700 1 --2- 172.21.15.82:0/3746168702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddd00b1d10 0x7fddd00b6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:23.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.497+0000 7fddd6949700 1 --2- 172.21.15.82:0/3746168702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddd006c140 0x7fddd0157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:23.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.497+0000 7fddd6949700 1 -- 172.21.15.82:0/3746168702 >> 172.21.15.82:0/3746168702 conn(0x7fddd00b52a0 msgr2=0x7fddd00d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:23.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.497+0000 7fddd6949700 1 -- 172.21.15.82:0/3746168702 shutdown_connections 2023-11-28T13:02:23.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.497+0000 7fddd6949700 1 -- 172.21.15.82:0/3746168702 wait complete. 2023-11-28T13:02:23.515 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T13:02:23.515 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:02:23.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.629+0000 7f718de81700 1 Processor -- start 2023-11-28T13:02:23.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.629+0000 7f718de81700 1 -- start start 2023-11-28T13:02:23.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.629+0000 7f718de81700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7188070780 0x7f718815d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:23.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.629+0000 7f718de81700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f718815da50 con 0x7f71881591c0 2023-11-28T13:02:23.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.629+0000 7f718de81700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71880c9e20 con 0x7f7188158df0 2023-11-28T13:02:23.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.629+0000 7f718de81700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71880cc640 con 0x7f7188070780 2023-11-28T13:02:23.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.629+0000 7f7187fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f71881591c0 0x7f7188070070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58790/0 (socket says 172.21.15.82:58790) 2023-11-28T13:02:23.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.629+0000 7f7187fff700 1 -- 172.21.15.82:0/1359334669 learned_addr learned my addr 172.21.15.82:0/1359334669 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:23.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.629+0000 7f718d680700 1 --2- 172.21.15.82:0/1359334669 >> v2:172.21.15.114:3300/0 conn(0x7f7188070780 0x7f718815d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:23.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.629+0000 7f71877fe700 1 -- 172.21.15.82:0/1359334669 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290265812 0 0) 0x7f7178001110 con 0x7f71881591c0 2023-11-28T13:02:23.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.629+0000 7f71877fe700 1 -- 172.21.15.82:0/1359334669 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71700057e0 con 0x7f71881591c0 2023-11-28T13:02:23.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.629+0000 7f71877fe700 1 -- 172.21.15.82:0/1359334669 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817452027 0 0) 0x7f71880c9e20 con 0x7f7188158df0 2023-11-28T13:02:23.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.629+0000 7f71877fe700 1 -- 172.21.15.82:0/1359334669 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7178001110 con 0x7f7188158df0 2023-11-28T13:02:23.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.629+0000 7f718d680700 1 -- 172.21.15.82:0/1359334669 >> v1:172.21.15.114:6789/0 conn(0x7f7188158df0 legacy=0x7f718806c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:23.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.629+0000 7f718d680700 1 -- 172.21.15.82:0/1359334669 >> v1:172.21.15.82:6789/0 conn(0x7f71881591c0 legacy=0x7f7188070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:23.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.629+0000 7f718d680700 1 -- 172.21.15.82:0/1359334669 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71880c97d0 con 0x7f7188070780 2023-11-28T13:02:23.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.629+0000 7f718d680700 1 --2- 172.21.15.82:0/1359334669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7188070780 0x7f718815d510 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7180009d90 tx=0x7f718000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6f47a893d63353a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:23.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.629+0000 7f71877fe700 1 -- 172.21.15.82:0/1359334669 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718000e070 con 0x7f7188070780 2023-11-28T13:02:23.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.629+0000 7f71877fe700 1 -- 172.21.15.82:0/1359334669 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718000bb20 con 0x7f7188070780 2023-11-28T13:02:23.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.629+0000 7f71877fe700 1 -- 172.21.15.82:0/1359334669 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7180012430 con 0x7f7188070780 2023-11-28T13:02:23.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.633+0000 7f718de81700 1 -- 172.21.15.82:0/1359334669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7188070780 msgr2=0x7f718815d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:23.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.633+0000 7f718de81700 1 --2- 172.21.15.82:0/1359334669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7188070780 0x7f718815d510 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7180009d90 tx=0x7f718000b330 comp rx=0 tx=0).stop 2023-11-28T13:02:23.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.633+0000 7f718de81700 1 -- 172.21.15.82:0/1359334669 shutdown_connections 2023-11-28T13:02:23.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.633+0000 7f718de81700 1 --2- 172.21.15.82:0/1359334669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7188070780 0x7f718815d510 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:23.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.633+0000 7f718de81700 1 -- 172.21.15.82:0/1359334669 >> 172.21.15.82:0/1359334669 conn(0x7f71880ce600 msgr2=0x7f71880ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:23.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.633+0000 7f718de81700 1 -- 172.21.15.82:0/1359334669 shutdown_connections 2023-11-28T13:02:23.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.633+0000 7f718de81700 1 -- 172.21.15.82:0/1359334669 wait complete. 2023-11-28T13:02:23.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.633+0000 7f718de81700 1 Processor -- start 2023-11-28T13:02:23.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.633+0000 7f718de81700 1 -- start start 2023-11-28T13:02:23.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.633+0000 7f718de81700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7188070780 0x7f718814f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:23.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.633+0000 7f718de81700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7188158df0 0x7f71880b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:23.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.633+0000 7f718de81700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71881591c0 0x7f71881565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:23.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.633+0000 7f718de81700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7188153b80 con 0x7f7188070780 2023-11-28T13:02:23.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.633+0000 7f718de81700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7188152f70 con 0x7f71881591c0 2023-11-28T13:02:23.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.633+0000 7f718de81700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7188153250 con 0x7f7188158df0 2023-11-28T13:02:23.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.633+0000 7f718ce7f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7188070780 0x7f718814f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:23.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.633+0000 7f718ce7f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7188070780 0x7f718814f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37324/0 (socket says 172.21.15.82:37324) 2023-11-28T13:02:23.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.633+0000 7f718ce7f700 1 -- 172.21.15.82:0/2687332252 learned_addr learned my addr 172.21.15.82:0/2687332252 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:23.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.633+0000 7f718d680700 1 --2- 172.21.15.82:0/2687332252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71881591c0 0x7f71881565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:23.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.633+0000 7f7187fff700 1 --2- 172.21.15.82:0/2687332252 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7188158df0 0x7f71880b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:23.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.637+0000 7f718ce7f700 1 -- 172.21.15.82:0/2687332252 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7188158df0 msgr2=0x7f71880b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:23.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.637+0000 7f718ce7f700 1 --2- 172.21.15.82:0/2687332252 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7188158df0 0x7f71880b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:23.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.637+0000 7f718ce7f700 1 -- 172.21.15.82:0/2687332252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71881591c0 msgr2=0x7f71881565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:23.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.637+0000 7f718ce7f700 1 --2- 172.21.15.82:0/2687332252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71881591c0 0x7f71881565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:23.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.637+0000 7f718ce7f700 1 -- 172.21.15.82:0/2687332252 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7180009a70 con 0x7f7188070780 2023-11-28T13:02:23.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.637+0000 7f718ce7f700 1 --2- 172.21.15.82:0/2687332252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7188070780 0x7f718814f060 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f717c00c730 tx=0x7f717c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:23.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.637+0000 7f71857fa700 1 -- 172.21.15.82:0/2687332252 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c0052d0 con 0x7f7188070780 2023-11-28T13:02:23.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.637+0000 7f71857fa700 1 -- 172.21.15.82:0/2687332252 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717c005450 con 0x7f7188070780 2023-11-28T13:02:23.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.637+0000 7f718de81700 1 -- 172.21.15.82:0/2687332252 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71880c9480 con 0x7f7188070780 2023-11-28T13:02:23.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.637+0000 7f71857fa700 1 -- 172.21.15.82:0/2687332252 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c0038e0 con 0x7f7188070780 2023-11-28T13:02:23.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.637+0000 7f718de81700 1 -- 172.21.15.82:0/2687332252 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71880c9ab0 con 0x7f7188070780 2023-11-28T13:02:23.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.637+0000 7f718de81700 1 -- 172.21.15.82:0/2687332252 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71880add00 con 0x7f7188070780 2023-11-28T13:02:23.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.637+0000 7f71857fa700 1 -- 172.21.15.82:0/2687332252 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f717c019030 con 0x7f7188070780 2023-11-28T13:02:23.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.641+0000 7f71857fa700 1 --2- 172.21.15.82:0/2687332252 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7174064ee0 0x7f7174067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:23.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.641+0000 7f71857fa700 1 -- 172.21.15.82:0/2687332252 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f717c0811c0 con 0x7f7188070780 2023-11-28T13:02:23.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.641+0000 7f7187fff700 1 --2- 172.21.15.82:0/2687332252 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7174064ee0 0x7f7174067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:23.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.641+0000 7f7187fff700 1 --2- 172.21.15.82:0/2687332252 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7174064ee0 0x7f7174067390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7188157a40 tx=0x7f7178007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:23.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.649+0000 7f71857fa700 1 -- 172.21.15.82:0/2687332252 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f717c04f360 con 0x7f7188070780 2023-11-28T13:02:23.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.845+0000 7f718de81700 1 -- 172.21.15.82:0/2687332252 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7188065fc0 con 0x7f7188070780 2023-11-28T13:02:23.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.849+0000 7f71857fa700 1 -- 172.21.15.82:0/2687332252 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f717c052980 con 0x7f7188070780 2023-11-28T13:02:23.851 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:23.851 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/704061431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":704061431},{"type":"v1","addr":"172.21.15.114:6834","nonce":704061431}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3972503523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3972503523},{"type":"v1","addr":"172.21.15.82:6836","nonce":3972503523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5811,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2000262220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2000262220},{"type":"v1","addr":"172.21.15.82:6837","nonce":2000262220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:02:20.454524+0000","modified":"2023-11-28T13:02:23.476763+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5814":{"gid":5814,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/4092152651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":4092152651},{"type":"v1","addr":"172.21.15.114:6835","nonce":4092152651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T13:02:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.849+0000 7f718de81700 1 -- 172.21.15.82:0/2687332252 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7174064ee0 msgr2=0x7f7174067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.849+0000 7f718de81700 1 --2- 172.21.15.82:0/2687332252 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7174064ee0 0x7f7174067390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7188157a40 tx=0x7f7178007de0 comp rx=0 tx=0).stop 2023-11-28T13:02:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.849+0000 7f718de81700 1 -- 172.21.15.82:0/2687332252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7188070780 msgr2=0x7f718814f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.849+0000 7f718de81700 1 --2- 172.21.15.82:0/2687332252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7188070780 0x7f718814f060 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f717c00c730 tx=0x7f717c00ca40 comp rx=0 tx=0).stop 2023-11-28T13:02:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.849+0000 7f718de81700 1 -- 172.21.15.82:0/2687332252 shutdown_connections 2023-11-28T13:02:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.849+0000 7f718de81700 1 --2- 172.21.15.82:0/2687332252 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7174064ee0 0x7f7174067390 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:23.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.849+0000 7f718de81700 1 --2- 172.21.15.82:0/2687332252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71881591c0 0x7f71881565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:23.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.849+0000 7f718de81700 1 --2- 172.21.15.82:0/2687332252 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7188158df0 0x7f71880b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:23.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.849+0000 7f718de81700 1 --2- 172.21.15.82:0/2687332252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7188070780 0x7f718814f060 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:23.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.849+0000 7f718de81700 1 -- 172.21.15.82:0/2687332252 >> 172.21.15.82:0/2687332252 conn(0x7f71880ce600 msgr2=0x7f718806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:23.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.849+0000 7f718de81700 1 -- 172.21.15.82:0/2687332252 shutdown_connections 2023-11-28T13:02:23.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.849+0000 7f718de81700 1 -- 172.21.15.82:0/2687332252 wait complete. 2023-11-28T13:02:23.855 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 22 2023-11-28T13:02:23.866 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:02:23.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.973+0000 7f0aa6657700 1 Processor -- start 2023-11-28T13:02:23.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.973+0000 7f0aa6657700 1 -- start start 2023-11-28T13:02:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.973+0000 7f0aa6657700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0aa015cda0 0x7f0aa00cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.973+0000 7f0aa6657700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0aa00d0620 0x7f0aa00ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.973+0000 7f0aa6657700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa00cdc90 con 0x7f0aa015c9d0 2023-11-28T13:02:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.973+0000 7f0aa6657700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa00cdf70 con 0x7f0aa015cda0 2023-11-28T13:02:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0aa6657700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa00ce250 con 0x7f0aa00d0620 2023-11-28T13:02:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0a9ffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0aa015c9d0 0x7f0aa00ced30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58806/0 (socket says 172.21.15.82:58806) 2023-11-28T13:02:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0a9ffff700 1 -- 172.21.15.82:0/3589488512 learned_addr learned my addr 172.21.15.82:0/3589488512 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0a9f7fe700 1 --2- 172.21.15.82:0/3589488512 >> v2:172.21.15.82:3300/0 conn(0x7f0aa015cda0 0x7f0aa00cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0aa4bf4700 1 --2- 172.21.15.82:0/3589488512 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0aa00d0620 0x7f0aa00ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:23.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0a9effd700 1 -- 172.21.15.82:0/3589488512 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1750222434 0 0) 0x7f0aa00cdc90 con 0x7f0aa015c9d0 2023-11-28T13:02:23.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0a9f7fe700 1 -- 172.21.15.82:0/3589488512 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0aa00d0620 msgr2=0x7f0aa00ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:23.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0a9f7fe700 1 --2- 172.21.15.82:0/3589488512 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0aa00d0620 0x7f0aa00ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:23.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0a9f7fe700 1 -- 172.21.15.82:0/3589488512 >> v1:172.21.15.82:6789/0 conn(0x7f0aa015c9d0 legacy=0x7f0aa00ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:23.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0a9f7fe700 1 -- 172.21.15.82:0/3589488512 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa00ce530 con 0x7f0aa015cda0 2023-11-28T13:02:23.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0a9f7fe700 1 --2- 172.21.15.82:0/3589488512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa015cda0 0x7f0aa00cd6b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009850 tx=0x7f0a94009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c679e185bff579 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:23.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0a9effd700 1 -- 172.21.15.82:0/3589488512 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a94010a90 con 0x7f0aa015cda0 2023-11-28T13:02:23.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0a9effd700 1 -- 172.21.15.82:0/3589488512 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a94010bf0 con 0x7f0aa015cda0 2023-11-28T13:02:23.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0a9effd700 1 -- 172.21.15.82:0/3589488512 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a94018440 con 0x7f0aa015cda0 2023-11-28T13:02:23.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0aa6657700 1 -- 172.21.15.82:0/3589488512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa015cda0 msgr2=0x7f0aa00cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:23.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0aa6657700 1 --2- 172.21.15.82:0/3589488512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa015cda0 0x7f0aa00cd6b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009850 tx=0x7f0a94009b60 comp rx=0 tx=0).stop 2023-11-28T13:02:23.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0aa6657700 1 -- 172.21.15.82:0/3589488512 shutdown_connections 2023-11-28T13:02:23.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0aa6657700 1 --2- 172.21.15.82:0/3589488512 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0aa00d0620 0x7f0aa00ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:23.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0aa6657700 1 --2- 172.21.15.82:0/3589488512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa015cda0 0x7f0aa00cd6b0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:23.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0aa6657700 1 -- 172.21.15.82:0/3589488512 >> 172.21.15.82:0/3589488512 conn(0x7f0aa00b2a30 msgr2=0x7f0aa00b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:23.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0aa6657700 1 -- 172.21.15.82:0/3589488512 shutdown_connections 2023-11-28T13:02:23.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0aa6657700 1 -- 172.21.15.82:0/3589488512 wait complete. 2023-11-28T13:02:23.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0aa6657700 1 Processor -- start 2023-11-28T13:02:23.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.977+0000 7f0aa6657700 1 -- start start 2023-11-28T13:02:23.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0aa6657700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0aa00d0620 0x7f0aa0153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:23.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0aa6657700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0aa015c9d0 0x7f0aa00acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:23.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0aa6657700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa015cda0 0x7f0aa01f0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:23.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0aa6657700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa01f1ca0 con 0x7f0aa015cda0 2023-11-28T13:02:23.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0aa6657700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa01e2090 con 0x7f0aa015c9d0 2023-11-28T13:02:23.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0aa6657700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa01535d0 con 0x7f0aa00d0620 2023-11-28T13:02:23.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0aa4bf4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa015cda0 0x7f0aa01f0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:23.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0aa4bf4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa015cda0 0x7f0aa01f0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37342/0 (socket says 172.21.15.82:37342) 2023-11-28T13:02:23.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0aa4bf4700 1 -- 172.21.15.82:0/3393642251 learned_addr learned my addr 172.21.15.82:0/3393642251 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:23.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0a9f7fe700 1 --2- 172.21.15.82:0/3393642251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0aa015c9d0 0x7f0aa00acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:23.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0a9ffff700 1 --2- 172.21.15.82:0/3393642251 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0aa00d0620 0x7f0aa0153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:23.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0aa4bf4700 1 -- 172.21.15.82:0/3393642251 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0aa00d0620 msgr2=0x7f0aa0153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:23.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0aa4bf4700 1 --2- 172.21.15.82:0/3393642251 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0aa00d0620 0x7f0aa0153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:23.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0aa4bf4700 1 -- 172.21.15.82:0/3393642251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0aa015c9d0 msgr2=0x7f0aa00acd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:23.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0aa4bf4700 1 --2- 172.21.15.82:0/3393642251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0aa015c9d0 0x7f0aa00acd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:23.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0aa4bf4700 1 -- 172.21.15.82:0/3393642251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a940094b0 con 0x7f0aa015cda0 2023-11-28T13:02:23.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0aa4bf4700 1 --2- 172.21.15.82:0/3393642251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa015cda0 0x7f0aa01f0e30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800efc0 tx=0x7f0a9800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:23.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0a9cff9700 1 -- 172.21.15.82:0/3393642251 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a98009ea0 con 0x7f0aa015cda0 2023-11-28T13:02:23.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0a9cff9700 1 -- 172.21.15.82:0/3393642251 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9800f040 con 0x7f0aa015cda0 2023-11-28T13:02:23.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0aa6657700 1 -- 172.21.15.82:0/3393642251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa00cf8f0 con 0x7f0aa015cda0 2023-11-28T13:02:23.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0a9cff9700 1 -- 172.21.15.82:0/3393642251 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9800ced0 con 0x7f0aa015cda0 2023-11-28T13:02:23.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0aa6657700 1 -- 172.21.15.82:0/3393642251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa00ce810 con 0x7f0aa015cda0 2023-11-28T13:02:23.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.981+0000 7f0aa6657700 1 -- 172.21.15.82:0/3393642251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa00cf440 con 0x7f0aa015cda0 2023-11-28T13:02:23.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.985+0000 7f0a9cff9700 1 -- 172.21.15.82:0/3393642251 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0a98014480 con 0x7f0aa015cda0 2023-11-28T13:02:23.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.985+0000 7f0a9cff9700 1 --2- 172.21.15.82:0/3393642251 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0a8c064ee0 0x7f0a8c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:23.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.985+0000 7f0a9cff9700 1 -- 172.21.15.82:0/3393642251 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0a980827f0 con 0x7f0aa015cda0 2023-11-28T13:02:23.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.985+0000 7f0a9ffff700 1 --2- 172.21.15.82:0/3393642251 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0a8c064ee0 0x7f0a8c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:23.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.985+0000 7f0a9ffff700 1 --2- 172.21.15.82:0/3393642251 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0a8c064ee0 0x7f0a8c067390 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0a900010e0 tx=0x7f0a90009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:23.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:23.989+0000 7f0a9cff9700 1 -- 172.21.15.82:0/3393642251 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0a98050930 con 0x7f0aa015cda0 2023-11-28T13:02:24.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.149+0000 7f0aa6657700 1 -- 172.21.15.82:0/3393642251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0aa00cfb60 con 0x7f0aa015cda0 2023-11-28T13:02:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.149+0000 7f0a9cff9700 1 -- 172.21.15.82:0/3393642251 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+17883 (secure 0 0 0) 0x7f0a98053f50 con 0x7f0aa015cda0 2023-11-28T13:02:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:24.154 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":51,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:02:21.459082+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:02:19.012136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T13:02:19.431685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:02:24.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.153+0000 7f0aa6657700 1 -- 172.21.15.82:0/3393642251 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0a8c064ee0 msgr2=0x7f0a8c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:24.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.153+0000 7f0aa6657700 1 --2- 172.21.15.82:0/3393642251 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0a8c064ee0 0x7f0a8c067390 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0a900010e0 tx=0x7f0a90009040 comp rx=0 tx=0).stop 2023-11-28T13:02:24.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.153+0000 7f0aa6657700 1 -- 172.21.15.82:0/3393642251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa015cda0 msgr2=0x7f0aa01f0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:24.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.153+0000 7f0aa6657700 1 --2- 172.21.15.82:0/3393642251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa015cda0 0x7f0aa01f0e30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800efc0 tx=0x7f0a9800c3a0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.153+0000 7f0aa6657700 1 -- 172.21.15.82:0/3393642251 shutdown_connections 2023-11-28T13:02:24.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.153+0000 7f0aa6657700 1 --2- 172.21.15.82:0/3393642251 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0a8c064ee0 0x7f0a8c067390 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.153+0000 7f0aa6657700 1 --2- 172.21.15.82:0/3393642251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa015cda0 0x7f0aa01f0e30 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.153+0000 7f0aa6657700 1 --2- 172.21.15.82:0/3393642251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0aa015c9d0 0x7f0aa00acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.153+0000 7f0aa6657700 1 --2- 172.21.15.82:0/3393642251 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0aa00d0620 0x7f0aa0153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.153+0000 7f0aa6657700 1 -- 172.21.15.82:0/3393642251 >> 172.21.15.82:0/3393642251 conn(0x7f0aa00b2a30 msgr2=0x7f0aa00b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:24.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.153+0000 7f0aa6657700 1 -- 172.21.15.82:0/3393642251 shutdown_connections 2023-11-28T13:02:24.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.153+0000 7f0aa6657700 1 -- 172.21.15.82:0/3393642251 wait complete. 2023-11-28T13:02:24.168 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T13:02:24.169 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:02:24.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60ab4e9700 1 Processor -- start 2023-11-28T13:02:24.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60ab4e9700 1 -- start start 2023-11-28T13:02:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60ab4e9700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f60a406dae0 0x7f60a406b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60ab4e9700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a415d5b0 con 0x7f60a40ae940 2023-11-28T13:02:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60ab4e9700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a415da40 con 0x7f60a4158ed0 2023-11-28T13:02:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60ab4e9700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40aee90 con 0x7f60a406dae0 2023-11-28T13:02:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60aace8700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f60a40ae940 0x7f60a406baa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58820/0 (socket says 172.21.15.82:58820) 2023-11-28T13:02:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60aace8700 1 -- 172.21.15.82:0/2027074750 learned_addr learned my addr 172.21.15.82:0/2027074750 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60a9ce6700 1 --2- 172.21.15.82:0/2027074750 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f60a406dae0 0x7f60a406b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:24.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60a94e5700 1 -- 172.21.15.82:0/2027074750 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 15685990 0 0) 0x7f60a415d5b0 con 0x7f60a40ae940 2023-11-28T13:02:24.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60a94e5700 1 -- 172.21.15.82:0/2027074750 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f608c0035d0 con 0x7f60a40ae940 2023-11-28T13:02:24.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60a94e5700 1 -- 172.21.15.82:0/2027074750 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3786943193 0 0) 0x7f60a415da40 con 0x7f60a4158ed0 2023-11-28T13:02:24.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60a94e5700 1 -- 172.21.15.82:0/2027074750 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60a415d5b0 con 0x7f60a4158ed0 2023-11-28T13:02:24.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60a94e5700 1 -- 172.21.15.82:0/2027074750 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3575930658 0 0) 0x7f608c0035d0 con 0x7f60a40ae940 2023-11-28T13:02:24.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60a94e5700 1 -- 172.21.15.82:0/2027074750 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f60a406dae0 msgr2=0x7f60a406b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:24.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60a94e5700 1 --2- 172.21.15.82:0/2027074750 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f60a406dae0 0x7f60a406b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60a94e5700 1 -- 172.21.15.82:0/2027074750 >> v1:172.21.15.114:6789/0 conn(0x7f60a4158ed0 legacy=0x7f60a406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:24.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60a94e5700 1 -- 172.21.15.82:0/2027074750 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a415cc80 con 0x7f60a40ae940 2023-11-28T13:02:24.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60a94e5700 1 -- 172.21.15.82:0/2027074750 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f609c001670 con 0x7f60a40ae940 2023-11-28T13:02:24.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60a94e5700 1 -- 172.21.15.82:0/2027074750 >> v1:172.21.15.82:6789/0 conn(0x7f60a40ae940 legacy=0x7f60a406baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:24.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60a94e5700 1 --2- 172.21.15.82:0/2027074750 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f60a406dae0 0x7f608c003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:24.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60a94e5700 1 --2- 172.21.15.82:0/2027074750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f608c004120 0x7f608c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:24.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60a94e5700 1 --2- 172.21.15.82:0/2027074750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f608c004db0 0x7f608c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:24.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60a94e5700 1 -- 172.21.15.82:0/2027074750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40aee90 con 0x7f608c004db0 2023-11-28T13:02:24.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60a94e5700 1 -- 172.21.15.82:0/2027074750 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c010040 con 0x7f608c004120 2023-11-28T13:02:24.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60a94e5700 1 -- 172.21.15.82:0/2027074750 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608c010180 con 0x7f60a406dae0 2023-11-28T13:02:24.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.277+0000 7f60aace8700 1 --2- 172.21.15.82:0/2027074750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f608c004db0 0x7f608c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:24.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.281+0000 7f60a9ce6700 1 --2- 172.21.15.82:0/2027074750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f608c004120 0x7f608c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:24.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.281+0000 7f60aa4e7700 1 --2- 172.21.15.82:0/2027074750 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f60a406dae0 0x7f608c003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:24.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.281+0000 7f60aace8700 1 -- 172.21.15.82:0/2027074750 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f60a406dae0 msgr2=0x7f608c003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:24.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.281+0000 7f60aace8700 1 --2- 172.21.15.82:0/2027074750 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f60a406dae0 0x7f608c003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.281+0000 7f60aace8700 1 -- 172.21.15.82:0/2027074750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f608c004120 msgr2=0x7f608c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:24.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.281+0000 7f60aace8700 1 --2- 172.21.15.82:0/2027074750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f608c004120 0x7f608c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.281+0000 7f60aace8700 1 -- 172.21.15.82:0/2027074750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c0035d0 con 0x7f608c004db0 2023-11-28T13:02:24.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.281+0000 7f60aace8700 1 --2- 172.21.15.82:0/2027074750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f608c004db0 0x7f608c005220 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f60a40aedc0 tx=0x7f608c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa886c063aeeb0d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:24.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.281+0000 7f60a94e5700 1 -- 172.21.15.82:0/2027074750 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c00ccf0 con 0x7f608c004db0 2023-11-28T13:02:24.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.281+0000 7f60a94e5700 1 -- 172.21.15.82:0/2027074750 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c001af0 con 0x7f608c004db0 2023-11-28T13:02:24.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.281+0000 7f60a94e5700 1 -- 172.21.15.82:0/2027074750 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c005bc0 con 0x7f608c004db0 2023-11-28T13:02:24.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.281+0000 7f60ab4e9700 1 -- 172.21.15.82:0/2027074750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f608c004db0 msgr2=0x7f608c005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:24.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.281+0000 7f60ab4e9700 1 --2- 172.21.15.82:0/2027074750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f608c004db0 0x7f608c005220 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f60a40aedc0 tx=0x7f608c0058a0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.281+0000 7f60aace8700 1 -- 172.21.15.82:0/2027074750 reap_dead start 2023-11-28T13:02:24.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.281+0000 7f60ab4e9700 1 -- 172.21.15.82:0/2027074750 shutdown_connections 2023-11-28T13:02:24.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.281+0000 7f60ab4e9700 1 -- 172.21.15.82:0/2027074750 >> 172.21.15.82:0/2027074750 conn(0x7f60a40cf710 msgr2=0x7f60a40cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:24.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.281+0000 7f60ab4e9700 1 -- 172.21.15.82:0/2027074750 shutdown_connections 2023-11-28T13:02:24.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.281+0000 7f60ab4e9700 1 -- 172.21.15.82:0/2027074750 wait complete. 2023-11-28T13:02:24.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.281+0000 7f60ab4e9700 1 Processor -- start 2023-11-28T13:02:24.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.281+0000 7f60ab4e9700 1 -- start start 2023-11-28T13:02:24.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f60ab4e9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60a4148ad0 0x7f60a40af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:24.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f60ab4e9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60a4148ea0 0x7f60a40b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:24.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f60ab4e9700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f60a40b0bf0 0x7f60a40b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:24.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f60ab4e9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40af8e0 con 0x7f60a4148ea0 2023-11-28T13:02:24.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f60ab4e9700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40afbc0 con 0x7f60a4148ad0 2023-11-28T13:02:24.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f60ab4e9700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40afea0 con 0x7f60a40b0bf0 2023-11-28T13:02:24.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f60a9ce6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60a4148ea0 0x7f60a40b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:24.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f60a9ce6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60a4148ea0 0x7f60a40b4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37366/0 (socket says 172.21.15.82:37366) 2023-11-28T13:02:24.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f60a9ce6700 1 -- 172.21.15.82:0/163113823 learned_addr learned my addr 172.21.15.82:0/163113823 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:24.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f60aa4e7700 1 --2- 172.21.15.82:0/163113823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60a4148ad0 0x7f60a40af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:24.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f60aace8700 1 --2- 172.21.15.82:0/163113823 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f60a40b0bf0 0x7f60a40b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:24.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f60a9ce6700 1 -- 172.21.15.82:0/163113823 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f60a40b0bf0 msgr2=0x7f60a40b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:24.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f60a9ce6700 1 --2- 172.21.15.82:0/163113823 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f60a40b0bf0 0x7f60a40b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f60a9ce6700 1 -- 172.21.15.82:0/163113823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60a4148ad0 msgr2=0x7f60a40af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:24.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f60a9ce6700 1 --2- 172.21.15.82:0/163113823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60a4148ad0 0x7f60a40af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f60a9ce6700 1 -- 172.21.15.82:0/163113823 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a415d240 con 0x7f60a4148ea0 2023-11-28T13:02:24.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f60a9ce6700 1 --2- 172.21.15.82:0/163113823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60a4148ea0 0x7f60a40b4490 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f60a0011620 tx=0x7f60a0011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:24.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f609affd700 1 -- 172.21.15.82:0/163113823 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a0004220 con 0x7f60a4148ea0 2023-11-28T13:02:24.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f609affd700 1 -- 172.21.15.82:0/163113823 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a0004380 con 0x7f60a4148ea0 2023-11-28T13:02:24.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f60ab4e9700 1 -- 172.21.15.82:0/163113823 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a415cf60 con 0x7f60a4148ea0 2023-11-28T13:02:24.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f609affd700 1 -- 172.21.15.82:0/163113823 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a00036c0 con 0x7f60a4148ea0 2023-11-28T13:02:24.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f60ab4e9700 1 -- 172.21.15.82:0/163113823 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a41592a0 con 0x7f60a4148ea0 2023-11-28T13:02:24.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.285+0000 7f60ab4e9700 1 -- 172.21.15.82:0/163113823 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a40afa20 con 0x7f60a4148ea0 2023-11-28T13:02:24.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.289+0000 7f609affd700 1 -- 172.21.15.82:0/163113823 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f60a0012040 con 0x7f60a4148ea0 2023-11-28T13:02:24.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.289+0000 7f609affd700 1 --2- 172.21.15.82:0/163113823 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6090064ee0 0x7f6090067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:24.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.289+0000 7f60aa4e7700 1 --2- 172.21.15.82:0/163113823 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6090064ee0 0x7f6090067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:24.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.289+0000 7f609affd700 1 -- 172.21.15.82:0/163113823 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f60a0081d90 con 0x7f60a4148ea0 2023-11-28T13:02:24.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.289+0000 7f60aa4e7700 1 --2- 172.21.15.82:0/163113823 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6090064ee0 0x7f6090067390 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6094001a50 tx=0x7f6094009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.293+0000 7f609affd700 1 -- 172.21.15.82:0/163113823 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f60a40afa20 con 0x7f60a4148ea0 2023-11-28T13:02:24.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.453+0000 7f60ab4e9700 1 -- 172.21.15.82:0/163113823 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60a40b0010 con 0x7f6090064ee0 2023-11-28T13:02:24.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.469+0000 7f609affd700 1 -- 172.21.15.82:0/163113823 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299237 (secure 0 0 0) 0x7f60a40b0010 con 0x7f6090064ee0 2023-11-28T13:02:24.475 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:24.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.473+0000 7f60ab4e9700 1 -- 172.21.15.82:0/163113823 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6090064ee0 msgr2=0x7f6090067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:24.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.473+0000 7f60ab4e9700 1 --2- 172.21.15.82:0/163113823 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6090064ee0 0x7f6090067390 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6094001a50 tx=0x7f6094009040 comp rx=0 tx=0).stop 2023-11-28T13:02:24.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.473+0000 7f60ab4e9700 1 -- 172.21.15.82:0/163113823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60a4148ea0 msgr2=0x7f60a40b4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:24.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.473+0000 7f60ab4e9700 1 --2- 172.21.15.82:0/163113823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60a4148ea0 0x7f60a40b4490 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f60a0011620 tx=0x7f60a0011930 comp rx=0 tx=0).stop 2023-11-28T13:02:24.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.473+0000 7f60ab4e9700 1 -- 172.21.15.82:0/163113823 shutdown_connections 2023-11-28T13:02:24.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.473+0000 7f60ab4e9700 1 --2- 172.21.15.82:0/163113823 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6090064ee0 0x7f6090067390 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.473+0000 7f60ab4e9700 1 --2- 172.21.15.82:0/163113823 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f60a40b0bf0 0x7f60a40b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.473+0000 7f60ab4e9700 1 --2- 172.21.15.82:0/163113823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60a4148ea0 0x7f60a40b4490 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.473+0000 7f60ab4e9700 1 --2- 172.21.15.82:0/163113823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60a4148ad0 0x7f60a40af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.473+0000 7f60ab4e9700 1 -- 172.21.15.82:0/163113823 >> 172.21.15.82:0/163113823 conn(0x7f60a40cf710 msgr2=0x7f60a406adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:24.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.473+0000 7f60ab4e9700 1 -- 172.21.15.82:0/163113823 shutdown_connections 2023-11-28T13:02:24.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.473+0000 7f60ab4e9700 1 -- 172.21.15.82:0/163113823 wait complete. 2023-11-28T13:02:24.478 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:02:24.487 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2023-11-28T13:02:23.194632+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":72960,"kb_used_data":5504,"kb_used_omap":0,"kb_used_meta":67392,"kb_avail":754901760,"statfs":{"total":773094113280,"available":773019402240,"internally_reserved":0,"allocated":5636096,"data_stored":3054612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":69009408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.125286"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.077902+0000","last_change":"2023-11-28T13:02:19.077902+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.077902+0000","last_undegraded":"2023-11-28T13:02:19.077902+0000","last_fullsized":"2023-11-28T13:02:19.077902+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:12.209141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.075162+0000","last_change":"2023-11-28T13:02:19.075162+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.075162+0000","last_undegraded":"2023-11-28T13:02:19.075162+0000","last_fullsized":"2023-11-28T13:02:19.075162+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:19.032803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.075037+0000","last_change":"2023-11-28T13:02:19.075037+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.075037+0000","last_undegraded":"2023-11-28T13:02:19.075037+0000","last_fullsized":"2023-11-28T13:02:19.075037+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:24.782403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.077873+0000","last_change":"2023-11-28T13:02:19.077873+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.077873+0000","last_undegraded":"2023-11-28T13:02:19.077873+0000","last_fullsized":"2023-11-28T13:02:19.077873+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:14.909436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.081928+0000","last_change":"2023-11-28T13:02:19.081928+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.081928+0000","last_undegraded":"2023-11-28T13:02:19.081928+0000","last_fullsized":"2023-11-28T13:02:19.081928+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:47.914711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.072503+0000","last_change":"2023-11-28T13:02:19.072503+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.072503+0000","last_undegraded":"2023-11-28T13:02:19.072503+0000","last_fullsized":"2023-11-28T13:02:19.072503+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:19.257824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.076664+0000","last_change":"2023-11-28T13:02:19.076664+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.076664+0000","last_undegraded":"2023-11-28T13:02:19.076664+0000","last_fullsized":"2023-11-28T13:02:19.076664+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:55:18.096845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.081120+0000","last_change":"2023-11-28T13:02:19.081120+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.081120+0000","last_undegraded":"2023-11-28T13:02:19.081120+0000","last_fullsized":"2023-11-28T13:02:19.081120+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:07:00.966797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.073601+0000","last_change":"2023-11-28T13:02:19.073601+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.073601+0000","last_undegraded":"2023-11-28T13:02:19.073601+0000","last_fullsized":"2023-11-28T13:02:19.073601+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:47.491241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.073526+0000","last_change":"2023-11-28T13:02:19.073526+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.073526+0000","last_undegraded":"2023-11-28T13:02:19.073526+0000","last_fullsized":"2023-11-28T13:02:19.073526+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:33:36.451705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.074958+0000","last_change":"2023-11-28T13:02:19.074958+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.074958+0000","last_undegraded":"2023-11-28T13:02:19.074958+0000","last_fullsized":"2023-11-28T13:02:19.074958+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:54.789622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.078405+0000","last_change":"2023-11-28T13:02:19.078405+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.078405+0000","last_undegraded":"2023-11-28T13:02:19.078405+0000","last_fullsized":"2023-11-28T13:02:19.078405+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:47.914711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.081429+0000","last_change":"2023-11-28T13:02:19.081429+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.081429+0000","last_undegraded":"2023-11-28T13:02:19.081429+0000","last_fullsized":"2023-11-28T13:02:19.081429+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:14.909436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.076785+0000","last_change":"2023-11-28T13:02:19.076785+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.076785+0000","last_undegraded":"2023-11-28T13:02:19.076785+0000","last_fullsized":"2023-11-28T13:02:19.076785+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:31.937666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.073266+0000","last_change":"2023-11-28T13:02:19.073266+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.073266+0000","last_undegraded":"2023-11-28T13:02:19.073266+0000","last_fullsized":"2023-11-28T13:02:19.073266+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:37.011377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.078057+0000","last_change":"2023-11-28T13:02:19.078057+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.078057+0000","last_undegraded":"2023-11-28T13:02:19.078057+0000","last_fullsized":"2023-11-28T13:02:19.078057+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:55.285175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.081612+0000","last_change":"2023-11-28T13:02:19.081612+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.081612+0000","last_undegraded":"2023-11-28T13:02:19.081612+0000","last_fullsized":"2023-11-28T13:02:19.081612+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:15:56.250681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.082465+0000","last_change":"2023-11-28T13:02:19.082465+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.082465+0000","last_undegraded":"2023-11-28T13:02:19.082465+0000","last_fullsized":"2023-11-28T13:02:19.082465+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:56:09.688582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.077604+0000","last_change":"2023-11-28T13:02:19.077604+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.077604+0000","last_undegraded":"2023-11-28T13:02:19.077604+0000","last_fullsized":"2023-11-28T13:02:19.077604+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:24:50.411915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.076809+0000","last_change":"2023-11-28T13:02:19.076809+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.076809+0000","last_undegraded":"2023-11-28T13:02:19.076809+0000","last_fullsized":"2023-11-28T13:02:19.076809+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:45.041829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.074997+0000","last_change":"2023-11-28T13:02:19.074997+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.074997+0000","last_undegraded":"2023-11-28T13:02:19.074997+0000","last_fullsized":"2023-11-28T13:02:19.074997+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:14:46.191864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.080967+0000","last_change":"2023-11-28T13:02:19.080967+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.080967+0000","last_undegraded":"2023-11-28T13:02:19.080967+0000","last_fullsized":"2023-11-28T13:02:19.080967+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:28:45.191699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.081505+0000","last_change":"2023-11-28T13:02:19.081505+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.081505+0000","last_undegraded":"2023-11-28T13:02:19.081505+0000","last_fullsized":"2023-11-28T13:02:19.081505+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:30:54.767899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.082430+0000","last_change":"2023-11-28T13:02:19.082430+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.082430+0000","last_undegraded":"2023-11-28T13:02:19.082430+0000","last_fullsized":"2023-11-28T13:02:19.082430+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:43.577442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.081283+0000","last_change":"2023-11-28T13:02:19.081283+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.081283+0000","last_undegraded":"2023-11-28T13:02:19.081283+0000","last_fullsized":"2023-11-28T13:02:19.081283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:09.884077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":192,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T13:02:19.075816+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:02:19.075816+0000","last_peered":"2023-11-28T13:02:19.075816+0000","last_clean":"2023-11-28T13:02:19.075816+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:02:19.075816+0000","last_undegraded":"2023-11-28T13:02:19.075816+0000","last_fullsized":"2023-11-28T13:02:19.075816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.172848+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:02:17.172848+0000","last_peered":"2023-11-28T13:02:17.172848+0000","last_clean":"2023-11-28T13:02:17.172848+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:02:17.172848+0000","last_undegraded":"2023-11-28T13:02:17.172848+0000","last_fullsized":"2023-11-28T13:02:17.172848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.073553+0000","last_change":"2023-11-28T13:02:19.073553+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.073553+0000","last_undegraded":"2023-11-28T13:02:19.073553+0000","last_fullsized":"2023-11-28T13:02:19.073553+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:11.227538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.005762+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:02:17.005762+0000","last_peered":"2023-11-28T13:02:17.005762+0000","last_clean":"2023-11-28T13:02:17.005762+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:02:17.005762+0000","last_undegraded":"2023-11-28T13:02:17.005762+0000","last_fullsized":"2023-11-28T13:02:17.005762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.081506+0000","last_change":"2023-11-28T13:02:19.081506+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.081506+0000","last_undegraded":"2023-11-28T13:02:19.081506+0000","last_fullsized":"2023-11-28T13:02:19.081506+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:32.316383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.172333+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:02:17.172333+0000","last_peered":"2023-11-28T13:02:17.172333+0000","last_clean":"2023-11-28T13:02:17.172333+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:02:17.172333+0000","last_undegraded":"2023-11-28T13:02:17.172333+0000","last_fullsized":"2023-11-28T13:02:17.172333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.077003+0000","last_change":"2023-11-28T13:02:19.077003+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.077003+0000","last_undegraded":"2023-11-28T13:02:19.077003+0000","last_fullsized":"2023-11-28T13:02:19.077003+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:52.544723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.172841+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:02:17.172841+0000","last_peered":"2023-11-28T13:02:17.172841+0000","last_clean":"2023-11-28T13:02:17.172841+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:02:17.172841+0000","last_undegraded":"2023-11-28T13:02:17.172841+0000","last_fullsized":"2023-11-28T13:02:17.172841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.072521+0000","last_change":"2023-11-28T13:02:19.072521+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.072521+0000","last_undegraded":"2023-11-28T13:02:19.072521+0000","last_fullsized":"2023-11-28T13:02:19.072521+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:14.909436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.173011+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:02:17.173011+0000","last_peered":"2023-11-28T13:02:17.173011+0000","last_clean":"2023-11-28T13:02:17.173011+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:02:17.173011+0000","last_undegraded":"2023-11-28T13:02:17.173011+0000","last_fullsized":"2023-11-28T13:02:17.173011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.078580+0000","last_change":"2023-11-28T13:02:19.078580+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.078580+0000","last_undegraded":"2023-11-28T13:02:19.078580+0000","last_fullsized":"2023-11-28T13:02:19.078580+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:33:36.451705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.005743+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:02:17.005743+0000","last_peered":"2023-11-28T13:02:17.005743+0000","last_clean":"2023-11-28T13:02:17.005743+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:02:17.005743+0000","last_undegraded":"2023-11-28T13:02:17.005743+0000","last_fullsized":"2023-11-28T13:02:17.005743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.080960+0000","last_change":"2023-11-28T13:02:19.080960+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.080960+0000","last_undegraded":"2023-11-28T13:02:19.080960+0000","last_fullsized":"2023-11-28T13:02:19.080960+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:13.894190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.172990+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:02:17.172990+0000","last_peered":"2023-11-28T13:02:17.172990+0000","last_clean":"2023-11-28T13:02:17.172990+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:02:17.172990+0000","last_undegraded":"2023-11-28T13:02:17.172990+0000","last_fullsized":"2023-11-28T13:02:17.172990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.078260+0000","last_change":"2023-11-28T13:02:19.078260+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.078260+0000","last_undegraded":"2023-11-28T13:02:19.078260+0000","last_fullsized":"2023-11-28T13:02:19.078260+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:32.316383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.172317+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:02:17.172317+0000","last_peered":"2023-11-28T13:02:17.172317+0000","last_clean":"2023-11-28T13:02:17.172317+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:02:17.172317+0000","last_undegraded":"2023-11-28T13:02:17.172317+0000","last_fullsized":"2023-11-28T13:02:17.172317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10100,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94361740,"statfs":{"total":96636764160,"available":96626421760,"internally_reserved":0,"allocated":1159168,"data_stored":829230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.82699999999999996,"15min":0.81499999999999995},"min":{"1min":0.625,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.871},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.90200000000000002,"15min":0.91100000000000003},"min":{"1min":0.50900000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.222,"5min":1.377,"15min":1.377},"last":0.50900000000000001}]},{"osd":1,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.91400000000000003,"15min":0.92000000000000004},"min":{"1min":0.58399999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.242,"5min":1.599,"15min":1.599},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.871,"5min":0.93600000000000005,"15min":0.94699999999999995},"min":{"1min":0.63400000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.161,"5min":1.375,"15min":1.375},"last":0.80000000000000004}]},{"osd":2,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.92700000000000005,"15min":0.94099999999999995},"min":{"1min":0.58799999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2949999999999999,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.60999999999999999,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.329,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.95999999999999996}]},{"osd":3,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.93999999999999995,"15min":0.95199999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.1839999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.92800000000000005,"15min":0.92200000000000004},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.71999999999999997}]},{"osd":4,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0029999999999999,"15min":1.0089999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.504,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.96399999999999997,"15min":0.96599999999999997},"min":{"1min":0.72899999999999998,"5min":0.621,"15min":0.621},"max":{"1min":1.296,"5min":1.409,"15min":1.409},"last":0.77000000000000002}]},{"osd":5,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.0449999999999999,"15min":1.0309999999999999},"min":{"1min":0.872,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.1020000000000001,"15min":1.107},"min":{"1min":0.76800000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4530000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.93899999999999995}]},{"osd":6,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.179,"15min":1.1870000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3500000000000001,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1699999999999999,"15min":1.175},"min":{"1min":0.879,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.4299999999999999,"5min":1.794,"15min":1.794},"last":0.91500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8676,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363164,"statfs":{"total":96636764160,"available":96627879936,"internally_reserved":0,"allocated":552960,"data_stored":232692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.83399999999999996,"15min":0.83599999999999997},"min":{"1min":0.64500000000000002,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0960000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.85399999999999998,"15min":0.84199999999999997},"min":{"1min":0.65200000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1539999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.97599999999999998}]},{"osd":1,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.87,"15min":0.86199999999999999},"min":{"1min":0.65800000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2370000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.871,"15min":0.86499999999999999},"min":{"1min":0.68600000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.218,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.79200000000000004}]},{"osd":2,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.875,"15min":0.88400000000000001},"min":{"1min":0.57899999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1339999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.02},{"interface":"front","average":{"1min":0.87,"5min":0.88800000000000001,"15min":0.89100000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1819999999999999,"5min":1.639,"15min":1.639},"last":0.83099999999999996}]},{"osd":3,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.88400000000000001,"15min":0.88},"min":{"1min":0.67800000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1399999999999999,"5min":1.141,"15min":1.141},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.97499999999999998,"15min":0.97699999999999998},"min":{"1min":0.74099999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.1259999999999999,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.0780000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.95199999999999996,"15min":0.94899999999999995},"min":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2390000000000001,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.113},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.4390000000000001,"15min":1.506},"min":{"1min":0.66100000000000003,"5min":0.629,"15min":0.629},"max":{"1min":1.266,"5min":10.566000000000001,"15min":10.566000000000001},"last":1.0009999999999999}]},{"osd":5,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.0780000000000001,"15min":1.0860000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.21,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.0940000000000001,"15min":1.0840000000000001},"min":{"1min":0.91500000000000004,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.3160000000000001,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.3160000000000001}]},{"osd":7,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.234,"15min":1.25},"min":{"1min":0.877,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.3819999999999999,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.306,"15min":1.331},"min":{"1min":0.97399999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":1.351,"5min":3.593,"15min":3.593},"last":1.351}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8868,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362972,"statfs":{"total":96636764160,"available":96627683328,"internally_reserved":0,"allocated":552960,"data_stored":232692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.81699999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82599999999999996,"15min":0.81999999999999995},"min":{"1min":0.628,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0680000000000001,"5min":1.248,"15min":1.248},"last":1.0229999999999999}]},{"osd":1,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82299999999999995,"15min":0.82199999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1100000000000001,"5min":1.274,"15min":1.274},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.56299999999999994,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.109,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.86499999999999999}]},{"osd":2,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81499999999999995,"15min":0.81100000000000005},"min":{"1min":0.505,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.92900000000000005,"15min":0.93999999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2010000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.89500000000000002}]},{"osd":3,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.88500000000000001,"15min":0.871},"min":{"1min":0.69999999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.998,"5min":1.0229999999999999,"15min":1.0269999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.391,"5min":1.403,"15min":1.403},"last":0.98399999999999999}]},{"osd":4,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.88300000000000001,"15min":0.89000000000000001},"min":{"1min":0.63,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1719999999999999,"5min":1.216,"15min":1.216},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.153,"5min":0.98299999999999998,"15min":0.95499999999999996},"min":{"1min":0.72499999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":4.3300000000000001,"5min":4.3300000000000001,"15min":4.3300000000000001},"last":0.94599999999999995}]},{"osd":6,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.02,"15min":1.0289999999999999},"min":{"1min":0.76800000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0269999999999999,"15min":1.0289999999999999},"min":{"1min":0.74299999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.448,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.92400000000000004}]},{"osd":7,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.0620000000000001,"15min":1.038},"min":{"1min":0.71699999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":4.234,"5min":4.234,"15min":4.234},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.133,"15min":1.1399999999999999},"min":{"1min":0.82199999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.377,"5min":1.466,"15min":1.466},"last":1.056}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8932,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362908,"statfs":{"total":96636764160,"available":96627617792,"internally_reserved":0,"allocated":552960,"data_stored":232692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.59799999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.78500000000000003}]},{"osd":1,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81399999999999995,"15min":0.81599999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0880000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.153,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.03}]},{"osd":2,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.83899999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.133,"5min":1.357,"15min":1.357},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.88400000000000001}]},{"osd":3,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.88300000000000001,"15min":0.872},"min":{"1min":0.64600000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.004,"5min":0.99299999999999999,"15min":0.99099999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.84099999999999997}]},{"osd":5,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.63700000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4039999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.98699999999999999,"15min":0.997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.73299999999999998}]},{"osd":6,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0269999999999999,"15min":1.034},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.296,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0840000000000001,"15min":1.0800000000000001},"min":{"1min":0.86299999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.97999999999999998}]},{"osd":7,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0880000000000001,"15min":1.093},"min":{"1min":0.81999999999999995,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.151,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.98899999999999999,"5min":0.871,"15min":0.871},"max":{"1min":1.571,"5min":1.655,"15min":1.655},"last":0.91500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8932,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362908,"statfs":{"total":96636764160,"available":96627617792,"internally_reserved":0,"allocated":552960,"data_stored":232692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.46300000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98099999999999998,"5min":0.998,"15min":0.998},"last":0.60699999999999998}]},{"osd":1,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68100000000000005,"15min":0.69199999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86499999999999999,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.93100000000000005}]},{"osd":2,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.5,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0289999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82699999999999996,"15min":0.82899999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0740000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.0740000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.97799999999999998,"15min":1},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.194,"5min":1.405,"15min":1.405},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.038,"15min":1.05},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.409,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.879}]},{"osd":5,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.0529999999999999,"15min":1.0669999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2430000000000001,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.081,"15min":1.093},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.321,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.018}]},{"osd":6,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.073,"15min":1.101},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.196,"5min":1.446,"15min":1.446},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.038,"5min":1.1040000000000001,"15min":1.115},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.3500000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.97899999999999998}]},{"osd":7,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.145,"15min":1.1579999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3640000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.153,"15min":1.1819999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.2290000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.95699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8740,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363100,"statfs":{"total":96636764160,"available":96627814400,"internally_reserved":0,"allocated":552960,"data_stored":232692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.52200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81999999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.57199999999999995}]},{"osd":1,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.629,"15min":0.61599999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.94399999999999995,"5min":1.123,"15min":1.123},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97899999999999998,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.501}]},{"osd":3,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.73799999999999999,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.317,"15min":0.317},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.74199999999999999,"15min":0.74099999999999999},"min":{"1min":0.46400000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.018,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91200000000000003,"15min":0.91600000000000004},"min":{"1min":0.64300000000000002,"5min":0.498,"15min":0.498},"max":{"1min":1.1519999999999999,"5min":1.327,"15min":1.327},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.002,"15min":1.0049999999999999},"min":{"1min":0.69999999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3129999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.69999999999999996}]},{"osd":5,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.76800000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.202,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.137,"5min":1.006,"15min":0.98399999999999999},"min":{"1min":0.73899999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.78600000000000003}]},{"osd":6,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.0569999999999999,"15min":1.0309999999999999},"min":{"1min":0.66900000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1,"15min":1.0009999999999999},"min":{"1min":0.72499999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.2450000000000001,"5min":1.359,"15min":1.359},"last":0.72499999999999998}]},{"osd":7,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.74399999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.431,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.1160000000000001,"15min":1.0960000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.73899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8804,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363036,"statfs":{"total":96636764160,"available":96627748864,"internally_reserved":0,"allocated":552960,"data_stored":232692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.96599999999999997,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.66800000000000004,"15min":0.68200000000000005},"min":{"1min":0.39100000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.749,"5min":1.181,"15min":1.181},"last":0.41399999999999998}]},{"osd":2,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78500000000000003,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.752,"15min":0.755},"min":{"1min":0.53700000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97599999999999998,"5min":1.409,"15min":1.409},"last":0.55300000000000005}]},{"osd":3,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.81599999999999995,"15min":0.82799999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.069,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.073,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.72799999999999998}]},{"osd":4,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.98299999999999998,"15min":0.99299999999999999},"min":{"1min":0.65000000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.93400000000000005,"15min":0.94199999999999995},"min":{"1min":0.68100000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1850000000000001,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":0.69899999999999995}]},{"osd":5,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.96899999999999997,"15min":0.97699999999999998},"min":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.3580000000000001,"5min":1.425,"15min":1.425},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0369999999999999,"15min":1.0509999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.234,"5min":2.004,"15min":2.004},"last":0.85299999999999998}]},{"osd":6,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.99299999999999999,"15min":1.0089999999999999},"min":{"1min":0.64100000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.101,"5min":1.889,"15min":1.889},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.097,"15min":1.1100000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4119999999999999,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.80800000000000005}]},{"osd":7,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.085,"15min":1.0940000000000001},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.3029999999999999,"5min":1.766,"15min":1.766},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.107,"15min":1.123},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.3109999999999999,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.82999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9908,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94361932,"statfs":{"total":96636764160,"available":96626618368,"internally_reserved":0,"allocated":1159168,"data_stored":829230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.501}]},{"osd":2,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.746},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.57499999999999996}]},{"osd":3,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.86699999999999999}]},{"osd":4,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.93700000000000006}]},{"osd":5,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.048},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.96599999999999997}]},{"osd":6,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.997}]},{"osd":7,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":1.121},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.83299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:02:24.493 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:02:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50ffff700 1 Processor -- start 2023-11-28T13:02:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50ffff700 1 -- start start 2023-11-28T13:02:24.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50ffff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb510160900 0x7fb5100cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:24.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5100c1910 0x7fb51006c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:24.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50ffff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5100ce030 con 0x7fb510070070 2023-11-28T13:02:24.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50ffff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5100ce310 con 0x7fb5100c1910 2023-11-28T13:02:24.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50ffff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb51006a5d0 con 0x7fb510160900 2023-11-28T13:02:24.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5100c1910 0x7fb51006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:24.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5100c1910 0x7fb51006c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37380/0 (socket says 172.21.15.82:37380) 2023-11-28T13:02:24.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50f7fe700 1 -- 172.21.15.82:0/1526562471 learned_addr learned my addr 172.21.15.82:0/1526562471 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:24.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50e7fc700 1 --2- 172.21.15.82:0/1526562471 >> v2:172.21.15.114:3300/0 conn(0x7fb510160900 0x7fb5100cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:24.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50f7fe700 1 -- 172.21.15.82:0/1526562471 >> v2:172.21.15.114:3300/0 conn(0x7fb510160900 msgr2=0x7fb5100cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:24.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50f7fe700 1 --2- 172.21.15.82:0/1526562471 >> v2:172.21.15.114:3300/0 conn(0x7fb510160900 0x7fb5100cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50f7fe700 1 -- 172.21.15.82:0/1526562471 >> v1:172.21.15.114:6789/0 conn(0x7fb510070070 legacy=0x7fb510070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:24.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50f7fe700 1 -- 172.21.15.82:0/1526562471 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51006a8b0 con 0x7fb5100c1910 2023-11-28T13:02:24.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50e7fc700 1 --2- 172.21.15.82:0/1526562471 >> v2:172.21.15.114:3300/0 conn(0x7fb510160900 0x7fb5100cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:02:24.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50f7fe700 1 --2- 172.21.15.82:0/1526562471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5100c1910 0x7fb51006c070 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb51006b6b0 tx=0x7fb500009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0a9e86de34bebe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:24.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50dffb700 1 -- 172.21.15.82:0/1526562471 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50000b8a0 con 0x7fb5100c1910 2023-11-28T13:02:24.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50dffb700 1 -- 172.21.15.82:0/1526562471 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50000ba00 con 0x7fb5100c1910 2023-11-28T13:02:24.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50dffb700 1 -- 172.21.15.82:0/1526562471 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50000bd90 con 0x7fb5100c1910 2023-11-28T13:02:24.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50ffff700 1 -- 172.21.15.82:0/1526562471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5100c1910 msgr2=0x7fb51006c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:24.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50ffff700 1 --2- 172.21.15.82:0/1526562471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5100c1910 0x7fb51006c070 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb51006b6b0 tx=0x7fb500009bf0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50ffff700 1 -- 172.21.15.82:0/1526562471 shutdown_connections 2023-11-28T13:02:24.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50ffff700 1 --2- 172.21.15.82:0/1526562471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5100c1910 0x7fb51006c070 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50ffff700 1 --2- 172.21.15.82:0/1526562471 >> v2:172.21.15.114:3300/0 conn(0x7fb510160900 0x7fb5100cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50ffff700 1 -- 172.21.15.82:0/1526562471 >> 172.21.15.82:0/1526562471 conn(0x7fb5100ce600 msgr2=0x7fb5100ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:24.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50ffff700 1 -- 172.21.15.82:0/1526562471 shutdown_connections 2023-11-28T13:02:24.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.605+0000 7fb50ffff700 1 -- 172.21.15.82:0/1526562471 wait complete. 2023-11-28T13:02:24.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50ffff700 1 Processor -- start 2023-11-28T13:02:24.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50ffff700 1 -- start start 2023-11-28T13:02:24.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb510070070 0x7fb510157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:24.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50ffff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5100c3270 0x7fb5100c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:24.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5100c73f0 0x7fb5100c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:24.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50ffff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5100c21d0 con 0x7fb510070070 2023-11-28T13:02:24.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50ffff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5100c24b0 con 0x7fb5100c73f0 2023-11-28T13:02:24.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50ffff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5100c2790 con 0x7fb5100c3270 2023-11-28T13:02:24.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb510070070 0x7fb510157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:24.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb510070070 0x7fb510157bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37388/0 (socket says 172.21.15.82:37388) 2023-11-28T13:02:24.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50effd700 1 -- 172.21.15.82:0/3049976828 learned_addr learned my addr 172.21.15.82:0/3049976828 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:24.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50f7fe700 1 --2- 172.21.15.82:0/3049976828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5100c73f0 0x7fb5100c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:24.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50e7fc700 1 --2- 172.21.15.82:0/3049976828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5100c3270 0x7fb5100c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:24.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50effd700 1 -- 172.21.15.82:0/3049976828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5100c3270 msgr2=0x7fb5100c36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:24.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50effd700 1 --2- 172.21.15.82:0/3049976828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5100c3270 0x7fb5100c36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50effd700 1 -- 172.21.15.82:0/3049976828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5100c73f0 msgr2=0x7fb5100c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:24.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50effd700 1 --2- 172.21.15.82:0/3049976828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5100c73f0 0x7fb5100c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50effd700 1 -- 172.21.15.82:0/3049976828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb500009570 con 0x7fb510070070 2023-11-28T13:02:24.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50e7fc700 1 --2- 172.21.15.82:0/3049976828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5100c3270 0x7fb5100c36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:24.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50effd700 1 --2- 172.21.15.82:0/3049976828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb510070070 0x7fb510157bc0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800c410 tx=0x7fb4f800c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:24.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb5077fe700 1 -- 172.21.15.82:0/3049976828 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80052d0 con 0x7fb510070070 2023-11-28T13:02:24.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb5077fe700 1 -- 172.21.15.82:0/3049976828 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f8005430 con 0x7fb510070070 2023-11-28T13:02:24.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50ffff700 1 -- 172.21.15.82:0/3049976828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5100cc710 con 0x7fb510070070 2023-11-28T13:02:24.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb5077fe700 1 -- 172.21.15.82:0/3049976828 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80055a0 con 0x7fb510070070 2023-11-28T13:02:24.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.609+0000 7fb50ffff700 1 -- 172.21.15.82:0/3049976828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51006ab90 con 0x7fb510070070 2023-11-28T13:02:24.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.613+0000 7fb50ffff700 1 -- 172.21.15.82:0/3049976828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5100cdc50 con 0x7fb510070070 2023-11-28T13:02:24.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.613+0000 7fb5077fe700 1 -- 172.21.15.82:0/3049976828 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb4f8010050 con 0x7fb510070070 2023-11-28T13:02:24.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.613+0000 7fb5077fe700 1 --2- 172.21.15.82:0/3049976828 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb4f0064ee0 0x7fb4f0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:24.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.613+0000 7fb5077fe700 1 -- 172.21.15.82:0/3049976828 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb4f80810e0 con 0x7fb510070070 2023-11-28T13:02:24.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.613+0000 7fb50e7fc700 1 --2- 172.21.15.82:0/3049976828 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb4f0064ee0 0x7fb4f0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:24.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.613+0000 7fb50e7fc700 1 --2- 172.21.15.82:0/3049976828 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb4f0064ee0 0x7fb4f0067390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb50800e550 tx=0x7fb508007ab0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:24.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.621+0000 7fb5077fe700 1 -- 172.21.15.82:0/3049976828 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb4f8049400 con 0x7fb510070070 2023-11-28T13:02:24.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.781+0000 7fb50ffff700 1 -- 172.21.15.82:0/3049976828 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5100c5490 con 0x7fb4f0064ee0 2023-11-28T13:02:24.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.797+0000 7fb5077fe700 1 -- 172.21.15.82:0/3049976828 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299237 (secure 0 0 0) 0x7fb5100c5490 con 0x7fb4f0064ee0 2023-11-28T13:02:24.806 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:24.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.801+0000 7fb50ffff700 1 -- 172.21.15.82:0/3049976828 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb4f0064ee0 msgr2=0x7fb4f0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:24.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.801+0000 7fb50ffff700 1 --2- 172.21.15.82:0/3049976828 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb4f0064ee0 0x7fb4f0067390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb50800e550 tx=0x7fb508007ab0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.801+0000 7fb50ffff700 1 -- 172.21.15.82:0/3049976828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb510070070 msgr2=0x7fb510157bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:24.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.801+0000 7fb50ffff700 1 --2- 172.21.15.82:0/3049976828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb510070070 0x7fb510157bc0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800c410 tx=0x7fb4f800c720 comp rx=0 tx=0).stop 2023-11-28T13:02:24.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.801+0000 7fb50ffff700 1 -- 172.21.15.82:0/3049976828 shutdown_connections 2023-11-28T13:02:24.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.801+0000 7fb50ffff700 1 --2- 172.21.15.82:0/3049976828 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb4f0064ee0 0x7fb4f0067390 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.801+0000 7fb50ffff700 1 --2- 172.21.15.82:0/3049976828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5100c73f0 0x7fb5100c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.801+0000 7fb50ffff700 1 --2- 172.21.15.82:0/3049976828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb5100c3270 0x7fb5100c36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.801+0000 7fb50ffff700 1 --2- 172.21.15.82:0/3049976828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb510070070 0x7fb510157bc0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.801+0000 7fb50ffff700 1 -- 172.21.15.82:0/3049976828 >> 172.21.15.82:0/3049976828 conn(0x7fb5100ce600 msgr2=0x7fb5100af0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:24.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.801+0000 7fb50ffff700 1 -- 172.21.15.82:0/3049976828 shutdown_connections 2023-11-28T13:02:24.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.801+0000 7fb50ffff700 1 -- 172.21.15.82:0/3049976828 wait complete. 2023-11-28T13:02:24.811 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:02:24.819 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2023-11-28T13:02:23.194632+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":72960,"kb_used_data":5504,"kb_used_omap":0,"kb_used_meta":67392,"kb_avail":754901760,"statfs":{"total":773094113280,"available":773019402240,"internally_reserved":0,"allocated":5636096,"data_stored":3054612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":69009408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.125286"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.077902+0000","last_change":"2023-11-28T13:02:19.077902+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.077902+0000","last_undegraded":"2023-11-28T13:02:19.077902+0000","last_fullsized":"2023-11-28T13:02:19.077902+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:12.209141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.075162+0000","last_change":"2023-11-28T13:02:19.075162+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.075162+0000","last_undegraded":"2023-11-28T13:02:19.075162+0000","last_fullsized":"2023-11-28T13:02:19.075162+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:19.032803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.075037+0000","last_change":"2023-11-28T13:02:19.075037+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.075037+0000","last_undegraded":"2023-11-28T13:02:19.075037+0000","last_fullsized":"2023-11-28T13:02:19.075037+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:24.782403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.077873+0000","last_change":"2023-11-28T13:02:19.077873+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.077873+0000","last_undegraded":"2023-11-28T13:02:19.077873+0000","last_fullsized":"2023-11-28T13:02:19.077873+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:14.909436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.081928+0000","last_change":"2023-11-28T13:02:19.081928+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.081928+0000","last_undegraded":"2023-11-28T13:02:19.081928+0000","last_fullsized":"2023-11-28T13:02:19.081928+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:47.914711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.072503+0000","last_change":"2023-11-28T13:02:19.072503+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.072503+0000","last_undegraded":"2023-11-28T13:02:19.072503+0000","last_fullsized":"2023-11-28T13:02:19.072503+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:19.257824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.076664+0000","last_change":"2023-11-28T13:02:19.076664+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.076664+0000","last_undegraded":"2023-11-28T13:02:19.076664+0000","last_fullsized":"2023-11-28T13:02:19.076664+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:55:18.096845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.081120+0000","last_change":"2023-11-28T13:02:19.081120+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.081120+0000","last_undegraded":"2023-11-28T13:02:19.081120+0000","last_fullsized":"2023-11-28T13:02:19.081120+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:07:00.966797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.073601+0000","last_change":"2023-11-28T13:02:19.073601+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.073601+0000","last_undegraded":"2023-11-28T13:02:19.073601+0000","last_fullsized":"2023-11-28T13:02:19.073601+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:47.491241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.073526+0000","last_change":"2023-11-28T13:02:19.073526+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.073526+0000","last_undegraded":"2023-11-28T13:02:19.073526+0000","last_fullsized":"2023-11-28T13:02:19.073526+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:33:36.451705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.074958+0000","last_change":"2023-11-28T13:02:19.074958+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.074958+0000","last_undegraded":"2023-11-28T13:02:19.074958+0000","last_fullsized":"2023-11-28T13:02:19.074958+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:54.789622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.078405+0000","last_change":"2023-11-28T13:02:19.078405+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.078405+0000","last_undegraded":"2023-11-28T13:02:19.078405+0000","last_fullsized":"2023-11-28T13:02:19.078405+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:47.914711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.081429+0000","last_change":"2023-11-28T13:02:19.081429+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.081429+0000","last_undegraded":"2023-11-28T13:02:19.081429+0000","last_fullsized":"2023-11-28T13:02:19.081429+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:14.909436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.076785+0000","last_change":"2023-11-28T13:02:19.076785+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.076785+0000","last_undegraded":"2023-11-28T13:02:19.076785+0000","last_fullsized":"2023-11-28T13:02:19.076785+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:31.937666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.073266+0000","last_change":"2023-11-28T13:02:19.073266+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.073266+0000","last_undegraded":"2023-11-28T13:02:19.073266+0000","last_fullsized":"2023-11-28T13:02:19.073266+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:37.011377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.078057+0000","last_change":"2023-11-28T13:02:19.078057+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.078057+0000","last_undegraded":"2023-11-28T13:02:19.078057+0000","last_fullsized":"2023-11-28T13:02:19.078057+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:55.285175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.081612+0000","last_change":"2023-11-28T13:02:19.081612+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.081612+0000","last_undegraded":"2023-11-28T13:02:19.081612+0000","last_fullsized":"2023-11-28T13:02:19.081612+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:15:56.250681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.082465+0000","last_change":"2023-11-28T13:02:19.082465+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.082465+0000","last_undegraded":"2023-11-28T13:02:19.082465+0000","last_fullsized":"2023-11-28T13:02:19.082465+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:56:09.688582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.077604+0000","last_change":"2023-11-28T13:02:19.077604+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.077604+0000","last_undegraded":"2023-11-28T13:02:19.077604+0000","last_fullsized":"2023-11-28T13:02:19.077604+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:24:50.411915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.076809+0000","last_change":"2023-11-28T13:02:19.076809+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.076809+0000","last_undegraded":"2023-11-28T13:02:19.076809+0000","last_fullsized":"2023-11-28T13:02:19.076809+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:45.041829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.074997+0000","last_change":"2023-11-28T13:02:19.074997+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.074997+0000","last_undegraded":"2023-11-28T13:02:19.074997+0000","last_fullsized":"2023-11-28T13:02:19.074997+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:14:46.191864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.080967+0000","last_change":"2023-11-28T13:02:19.080967+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.080967+0000","last_undegraded":"2023-11-28T13:02:19.080967+0000","last_fullsized":"2023-11-28T13:02:19.080967+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:28:45.191699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.081505+0000","last_change":"2023-11-28T13:02:19.081505+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.081505+0000","last_undegraded":"2023-11-28T13:02:19.081505+0000","last_fullsized":"2023-11-28T13:02:19.081505+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:30:54.767899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.082430+0000","last_change":"2023-11-28T13:02:19.082430+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.082430+0000","last_undegraded":"2023-11-28T13:02:19.082430+0000","last_fullsized":"2023-11-28T13:02:19.082430+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:43.577442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.081283+0000","last_change":"2023-11-28T13:02:19.081283+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.081283+0000","last_undegraded":"2023-11-28T13:02:19.081283+0000","last_fullsized":"2023-11-28T13:02:19.081283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:09.884077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":192,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T13:02:19.075816+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:02:19.075816+0000","last_peered":"2023-11-28T13:02:19.075816+0000","last_clean":"2023-11-28T13:02:19.075816+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:02:19.075816+0000","last_undegraded":"2023-11-28T13:02:19.075816+0000","last_fullsized":"2023-11-28T13:02:19.075816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.172848+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:02:17.172848+0000","last_peered":"2023-11-28T13:02:17.172848+0000","last_clean":"2023-11-28T13:02:17.172848+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:02:17.172848+0000","last_undegraded":"2023-11-28T13:02:17.172848+0000","last_fullsized":"2023-11-28T13:02:17.172848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.073553+0000","last_change":"2023-11-28T13:02:19.073553+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.073553+0000","last_undegraded":"2023-11-28T13:02:19.073553+0000","last_fullsized":"2023-11-28T13:02:19.073553+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:11.227538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.005762+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:02:17.005762+0000","last_peered":"2023-11-28T13:02:17.005762+0000","last_clean":"2023-11-28T13:02:17.005762+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:02:17.005762+0000","last_undegraded":"2023-11-28T13:02:17.005762+0000","last_fullsized":"2023-11-28T13:02:17.005762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.081506+0000","last_change":"2023-11-28T13:02:19.081506+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.081506+0000","last_undegraded":"2023-11-28T13:02:19.081506+0000","last_fullsized":"2023-11-28T13:02:19.081506+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:32.316383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.172333+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:02:17.172333+0000","last_peered":"2023-11-28T13:02:17.172333+0000","last_clean":"2023-11-28T13:02:17.172333+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:02:17.172333+0000","last_undegraded":"2023-11-28T13:02:17.172333+0000","last_fullsized":"2023-11-28T13:02:17.172333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.077003+0000","last_change":"2023-11-28T13:02:19.077003+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.077003+0000","last_undegraded":"2023-11-28T13:02:19.077003+0000","last_fullsized":"2023-11-28T13:02:19.077003+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:52.544723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.172841+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:02:17.172841+0000","last_peered":"2023-11-28T13:02:17.172841+0000","last_clean":"2023-11-28T13:02:17.172841+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:02:17.172841+0000","last_undegraded":"2023-11-28T13:02:17.172841+0000","last_fullsized":"2023-11-28T13:02:17.172841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.072521+0000","last_change":"2023-11-28T13:02:19.072521+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.072521+0000","last_undegraded":"2023-11-28T13:02:19.072521+0000","last_fullsized":"2023-11-28T13:02:19.072521+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:14.909436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.173011+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:02:17.173011+0000","last_peered":"2023-11-28T13:02:17.173011+0000","last_clean":"2023-11-28T13:02:17.173011+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:02:17.173011+0000","last_undegraded":"2023-11-28T13:02:17.173011+0000","last_fullsized":"2023-11-28T13:02:17.173011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.078580+0000","last_change":"2023-11-28T13:02:19.078580+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.078580+0000","last_undegraded":"2023-11-28T13:02:19.078580+0000","last_fullsized":"2023-11-28T13:02:19.078580+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:33:36.451705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.005743+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:02:17.005743+0000","last_peered":"2023-11-28T13:02:17.005743+0000","last_clean":"2023-11-28T13:02:17.005743+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:02:17.005743+0000","last_undegraded":"2023-11-28T13:02:17.005743+0000","last_fullsized":"2023-11-28T13:02:17.005743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.080960+0000","last_change":"2023-11-28T13:02:19.080960+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.080960+0000","last_undegraded":"2023-11-28T13:02:19.080960+0000","last_fullsized":"2023-11-28T13:02:19.080960+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:13.894190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.172990+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:02:17.172990+0000","last_peered":"2023-11-28T13:02:17.172990+0000","last_clean":"2023-11-28T13:02:17.172990+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:02:17.172990+0000","last_undegraded":"2023-11-28T13:02:17.172990+0000","last_fullsized":"2023-11-28T13:02:17.172990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.078260+0000","last_change":"2023-11-28T13:02:19.078260+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.078260+0000","last_undegraded":"2023-11-28T13:02:19.078260+0000","last_fullsized":"2023-11-28T13:02:19.078260+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:32.316383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.172317+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:02:17.172317+0000","last_peered":"2023-11-28T13:02:17.172317+0000","last_clean":"2023-11-28T13:02:17.172317+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:02:17.172317+0000","last_undegraded":"2023-11-28T13:02:17.172317+0000","last_fullsized":"2023-11-28T13:02:17.172317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10100,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94361740,"statfs":{"total":96636764160,"available":96626421760,"internally_reserved":0,"allocated":1159168,"data_stored":829230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.82699999999999996,"15min":0.81499999999999995},"min":{"1min":0.625,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.871},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.90200000000000002,"15min":0.91100000000000003},"min":{"1min":0.50900000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.222,"5min":1.377,"15min":1.377},"last":0.50900000000000001}]},{"osd":1,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.91400000000000003,"15min":0.92000000000000004},"min":{"1min":0.58399999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.242,"5min":1.599,"15min":1.599},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.871,"5min":0.93600000000000005,"15min":0.94699999999999995},"min":{"1min":0.63400000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.161,"5min":1.375,"15min":1.375},"last":0.80000000000000004}]},{"osd":2,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.92700000000000005,"15min":0.94099999999999995},"min":{"1min":0.58799999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2949999999999999,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.60999999999999999,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.329,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.95999999999999996}]},{"osd":3,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.93999999999999995,"15min":0.95199999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.1839999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.92800000000000005,"15min":0.92200000000000004},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.71999999999999997}]},{"osd":4,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0029999999999999,"15min":1.0089999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.504,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.96399999999999997,"15min":0.96599999999999997},"min":{"1min":0.72899999999999998,"5min":0.621,"15min":0.621},"max":{"1min":1.296,"5min":1.409,"15min":1.409},"last":0.77000000000000002}]},{"osd":5,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.0449999999999999,"15min":1.0309999999999999},"min":{"1min":0.872,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.1020000000000001,"15min":1.107},"min":{"1min":0.76800000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4530000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.93899999999999995}]},{"osd":6,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.179,"15min":1.1870000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3500000000000001,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1699999999999999,"15min":1.175},"min":{"1min":0.879,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.4299999999999999,"5min":1.794,"15min":1.794},"last":0.91500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8676,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363164,"statfs":{"total":96636764160,"available":96627879936,"internally_reserved":0,"allocated":552960,"data_stored":232692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.83399999999999996,"15min":0.83599999999999997},"min":{"1min":0.64500000000000002,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0960000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.85399999999999998,"15min":0.84199999999999997},"min":{"1min":0.65200000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1539999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.97599999999999998}]},{"osd":1,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.87,"15min":0.86199999999999999},"min":{"1min":0.65800000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2370000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.871,"15min":0.86499999999999999},"min":{"1min":0.68600000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.218,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.79200000000000004}]},{"osd":2,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.875,"15min":0.88400000000000001},"min":{"1min":0.57899999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1339999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.02},{"interface":"front","average":{"1min":0.87,"5min":0.88800000000000001,"15min":0.89100000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1819999999999999,"5min":1.639,"15min":1.639},"last":0.83099999999999996}]},{"osd":3,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.88400000000000001,"15min":0.88},"min":{"1min":0.67800000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1399999999999999,"5min":1.141,"15min":1.141},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.97499999999999998,"15min":0.97699999999999998},"min":{"1min":0.74099999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.1259999999999999,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.0780000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.95199999999999996,"15min":0.94899999999999995},"min":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2390000000000001,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.113},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.4390000000000001,"15min":1.506},"min":{"1min":0.66100000000000003,"5min":0.629,"15min":0.629},"max":{"1min":1.266,"5min":10.566000000000001,"15min":10.566000000000001},"last":1.0009999999999999}]},{"osd":5,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.0780000000000001,"15min":1.0860000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.21,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.0940000000000001,"15min":1.0840000000000001},"min":{"1min":0.91500000000000004,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.3160000000000001,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.3160000000000001}]},{"osd":7,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.234,"15min":1.25},"min":{"1min":0.877,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.3819999999999999,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.306,"15min":1.331},"min":{"1min":0.97399999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":1.351,"5min":3.593,"15min":3.593},"last":1.351}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8868,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362972,"statfs":{"total":96636764160,"available":96627683328,"internally_reserved":0,"allocated":552960,"data_stored":232692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.81699999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82599999999999996,"15min":0.81999999999999995},"min":{"1min":0.628,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0680000000000001,"5min":1.248,"15min":1.248},"last":1.0229999999999999}]},{"osd":1,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82299999999999995,"15min":0.82199999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1100000000000001,"5min":1.274,"15min":1.274},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.56299999999999994,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.109,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.86499999999999999}]},{"osd":2,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81499999999999995,"15min":0.81100000000000005},"min":{"1min":0.505,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.92900000000000005,"15min":0.93999999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2010000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.89500000000000002}]},{"osd":3,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.88500000000000001,"15min":0.871},"min":{"1min":0.69999999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.998,"5min":1.0229999999999999,"15min":1.0269999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.391,"5min":1.403,"15min":1.403},"last":0.98399999999999999}]},{"osd":4,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.88300000000000001,"15min":0.89000000000000001},"min":{"1min":0.63,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1719999999999999,"5min":1.216,"15min":1.216},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.153,"5min":0.98299999999999998,"15min":0.95499999999999996},"min":{"1min":0.72499999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":4.3300000000000001,"5min":4.3300000000000001,"15min":4.3300000000000001},"last":0.94599999999999995}]},{"osd":6,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.02,"15min":1.0289999999999999},"min":{"1min":0.76800000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0269999999999999,"15min":1.0289999999999999},"min":{"1min":0.74299999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.448,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.92400000000000004}]},{"osd":7,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.0620000000000001,"15min":1.038},"min":{"1min":0.71699999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":4.234,"5min":4.234,"15min":4.234},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.133,"15min":1.1399999999999999},"min":{"1min":0.82199999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.377,"5min":1.466,"15min":1.466},"last":1.056}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8932,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362908,"statfs":{"total":96636764160,"available":96627617792,"internally_reserved":0,"allocated":552960,"data_stored":232692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.59799999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.78500000000000003}]},{"osd":1,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81399999999999995,"15min":0.81599999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0880000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.153,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.03}]},{"osd":2,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.83899999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.133,"5min":1.357,"15min":1.357},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.88400000000000001}]},{"osd":3,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.88300000000000001,"15min":0.872},"min":{"1min":0.64600000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.004,"5min":0.99299999999999999,"15min":0.99099999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.84099999999999997}]},{"osd":5,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.63700000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4039999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.98699999999999999,"15min":0.997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.73299999999999998}]},{"osd":6,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0269999999999999,"15min":1.034},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.296,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0840000000000001,"15min":1.0800000000000001},"min":{"1min":0.86299999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.97999999999999998}]},{"osd":7,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0880000000000001,"15min":1.093},"min":{"1min":0.81999999999999995,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.151,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.98899999999999999,"5min":0.871,"15min":0.871},"max":{"1min":1.571,"5min":1.655,"15min":1.655},"last":0.91500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8932,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362908,"statfs":{"total":96636764160,"available":96627617792,"internally_reserved":0,"allocated":552960,"data_stored":232692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.46300000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98099999999999998,"5min":0.998,"15min":0.998},"last":0.60699999999999998}]},{"osd":1,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68100000000000005,"15min":0.69199999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86499999999999999,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.93100000000000005}]},{"osd":2,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.5,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0289999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82699999999999996,"15min":0.82899999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0740000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.0740000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.97799999999999998,"15min":1},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.194,"5min":1.405,"15min":1.405},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.038,"15min":1.05},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.409,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.879}]},{"osd":5,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.0529999999999999,"15min":1.0669999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2430000000000001,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.081,"15min":1.093},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.321,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.018}]},{"osd":6,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.073,"15min":1.101},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.196,"5min":1.446,"15min":1.446},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.038,"5min":1.1040000000000001,"15min":1.115},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.3500000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.97899999999999998}]},{"osd":7,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.145,"15min":1.1579999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3640000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.153,"15min":1.1819999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.2290000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.95699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8740,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363100,"statfs":{"total":96636764160,"available":96627814400,"internally_reserved":0,"allocated":552960,"data_stored":232692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.52200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81999999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.57199999999999995}]},{"osd":1,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.629,"15min":0.61599999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.94399999999999995,"5min":1.123,"15min":1.123},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97899999999999998,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.501}]},{"osd":3,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.73799999999999999,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.317,"15min":0.317},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.74199999999999999,"15min":0.74099999999999999},"min":{"1min":0.46400000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.018,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91200000000000003,"15min":0.91600000000000004},"min":{"1min":0.64300000000000002,"5min":0.498,"15min":0.498},"max":{"1min":1.1519999999999999,"5min":1.327,"15min":1.327},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.002,"15min":1.0049999999999999},"min":{"1min":0.69999999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3129999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.69999999999999996}]},{"osd":5,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.76800000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.202,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.137,"5min":1.006,"15min":0.98399999999999999},"min":{"1min":0.73899999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.78600000000000003}]},{"osd":6,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.0569999999999999,"15min":1.0309999999999999},"min":{"1min":0.66900000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1,"15min":1.0009999999999999},"min":{"1min":0.72499999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.2450000000000001,"5min":1.359,"15min":1.359},"last":0.72499999999999998}]},{"osd":7,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.74399999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.431,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.1160000000000001,"15min":1.0960000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.73899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8804,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363036,"statfs":{"total":96636764160,"available":96627748864,"internally_reserved":0,"allocated":552960,"data_stored":232692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.96599999999999997,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.66800000000000004,"15min":0.68200000000000005},"min":{"1min":0.39100000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.749,"5min":1.181,"15min":1.181},"last":0.41399999999999998}]},{"osd":2,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78500000000000003,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.752,"15min":0.755},"min":{"1min":0.53700000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97599999999999998,"5min":1.409,"15min":1.409},"last":0.55300000000000005}]},{"osd":3,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.81599999999999995,"15min":0.82799999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.069,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.073,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.72799999999999998}]},{"osd":4,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.98299999999999998,"15min":0.99299999999999999},"min":{"1min":0.65000000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.93400000000000005,"15min":0.94199999999999995},"min":{"1min":0.68100000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1850000000000001,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":0.69899999999999995}]},{"osd":5,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.96899999999999997,"15min":0.97699999999999998},"min":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.3580000000000001,"5min":1.425,"15min":1.425},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0369999999999999,"15min":1.0509999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.234,"5min":2.004,"15min":2.004},"last":0.85299999999999998}]},{"osd":6,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.99299999999999999,"15min":1.0089999999999999},"min":{"1min":0.64100000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.101,"5min":1.889,"15min":1.889},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.097,"15min":1.1100000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4119999999999999,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.80800000000000005}]},{"osd":7,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.085,"15min":1.0940000000000001},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.3029999999999999,"5min":1.766,"15min":1.766},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.107,"15min":1.123},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.3109999999999999,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.82999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9908,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94361932,"statfs":{"total":96636764160,"available":96626618368,"internally_reserved":0,"allocated":1159168,"data_stored":829230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.501}]},{"osd":2,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.746},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.57499999999999996}]},{"osd":3,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.86699999999999999}]},{"osd":4,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.93700000000000006}]},{"osd":5,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.048},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.96599999999999997}]},{"osd":6,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.997}]},{"osd":7,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":1.121},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.83299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:02:24.825 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:02:24.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.933+0000 7f39b3fff700 1 Processor -- start 2023-11-28T13:02:24.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.933+0000 7f39b3fff700 1 -- start start 2023-11-28T13:02:24.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.937+0000 7f39b3fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f39b40ca7b0 0x7f39b40b0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:24.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.937+0000 7f39b3fff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b40c92b0 con 0x7f39b40b0550 2023-11-28T13:02:24.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.937+0000 7f39b3fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b40b0950 con 0x7f39b4160660 2023-11-28T13:02:24.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.937+0000 7f39b3fff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b4160a30 con 0x7f39b40ca7b0 2023-11-28T13:02:24.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.937+0000 7f39b27fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f39b40ca7b0 0x7f39b40b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:24.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.937+0000 7f39b37fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f39b40b0550 0x7f39b40cc1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58834/0 (socket says 172.21.15.82:58834) 2023-11-28T13:02:24.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.937+0000 7f39b37fe700 1 -- 172.21.15.82:0/2118298405 learned_addr learned my addr 172.21.15.82:0/2118298405 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:24.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.937+0000 7f39b27fc700 1 -- 172.21.15.82:0/2118298405 >> v1:172.21.15.114:6789/0 conn(0x7f39b4160660 legacy=0x7f39b40c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:24.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.937+0000 7f39b27fc700 1 -- 172.21.15.82:0/2118298405 >> v1:172.21.15.82:6789/0 conn(0x7f39b40b0550 legacy=0x7f39b40cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:24.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.937+0000 7f39b27fc700 1 -- 172.21.15.82:0/2118298405 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b4069cf0 con 0x7f39b40ca7b0 2023-11-28T13:02:24.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.937+0000 7f39b27fc700 1 --2- 172.21.15.82:0/2118298405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39b40ca7b0 0x7f39b40b0010 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009d90 tx=0x7f39ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6f46eb49767866 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:24.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.937+0000 7f39b1ffb700 1 -- 172.21.15.82:0/2118298405 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac00e070 con 0x7f39b40ca7b0 2023-11-28T13:02:24.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.937+0000 7f39b1ffb700 1 -- 172.21.15.82:0/2118298405 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac00bbd0 con 0x7f39b40ca7b0 2023-11-28T13:02:24.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.937+0000 7f39b1ffb700 1 -- 172.21.15.82:0/2118298405 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac012430 con 0x7f39b40ca7b0 2023-11-28T13:02:24.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.937+0000 7f39b3fff700 1 -- 172.21.15.82:0/2118298405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39b40ca7b0 msgr2=0x7f39b40b0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:24.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.937+0000 7f39b3fff700 1 --2- 172.21.15.82:0/2118298405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39b40ca7b0 0x7f39b40b0010 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009d90 tx=0x7f39ac00b330 comp rx=0 tx=0).stop 2023-11-28T13:02:24.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.937+0000 7f39b3fff700 1 -- 172.21.15.82:0/2118298405 shutdown_connections 2023-11-28T13:02:24.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.937+0000 7f39b3fff700 1 --2- 172.21.15.82:0/2118298405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39b40ca7b0 0x7f39b40b0010 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.937+0000 7f39b3fff700 1 -- 172.21.15.82:0/2118298405 >> 172.21.15.82:0/2118298405 conn(0x7f39b40cf1a0 msgr2=0x7f39b40caf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:24.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.937+0000 7f39b3fff700 1 -- 172.21.15.82:0/2118298405 shutdown_connections 2023-11-28T13:02:24.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.937+0000 7f39b3fff700 1 -- 172.21.15.82:0/2118298405 wait complete. 2023-11-28T13:02:24.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b3fff700 1 Processor -- start 2023-11-28T13:02:24.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b3fff700 1 -- start start 2023-11-28T13:02:24.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39b40b0550 0x7f39b415f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:24.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b40ca7b0 0x7f39b41e9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:24.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b3fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39b4160660 0x7f39b40711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:24.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b3fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40b3200 con 0x7f39b40b0550 2023-11-28T13:02:24.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b3fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b41f65d0 con 0x7f39b40ca7b0 2023-11-28T13:02:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b3fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40b1aa0 con 0x7f39b4160660 2023-11-28T13:02:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39b40b0550 0x7f39b415f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39b40b0550 0x7f39b415f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37410/0 (socket says 172.21.15.82:37410) 2023-11-28T13:02:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b2ffd700 1 -- 172.21.15.82:0/457337145 learned_addr learned my addr 172.21.15.82:0/457337145 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b27fc700 1 --2- 172.21.15.82:0/457337145 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b40ca7b0 0x7f39b41e9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b37fe700 1 --2- 172.21.15.82:0/457337145 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39b4160660 0x7f39b40711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b2ffd700 1 -- 172.21.15.82:0/457337145 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39b4160660 msgr2=0x7f39b40711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b2ffd700 1 --2- 172.21.15.82:0/457337145 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39b4160660 0x7f39b40711a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b2ffd700 1 -- 172.21.15.82:0/457337145 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b40ca7b0 msgr2=0x7f39b41e9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b2ffd700 1 --2- 172.21.15.82:0/457337145 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b40ca7b0 0x7f39b41e9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b2ffd700 1 -- 172.21.15.82:0/457337145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac009a70 con 0x7f39b40b0550 2023-11-28T13:02:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b37fe700 1 --2- 172.21.15.82:0/457337145 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39b4160660 0x7f39b40711a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:02:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b2ffd700 1 --2- 172.21.15.82:0/457337145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39b40b0550 0x7f39b415f670 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f39a800c410 tx=0x7f39a800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f399b7fe700 1 -- 172.21.15.82:0/457337145 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a80052d0 con 0x7f39b40b0550 2023-11-28T13:02:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f399b7fe700 1 -- 172.21.15.82:0/457337145 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a8005430 con 0x7f39b40b0550 2023-11-28T13:02:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b3fff700 1 -- 172.21.15.82:0/457337145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b406a2b0 con 0x7f39b40b0550 2023-11-28T13:02:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f399b7fe700 1 -- 172.21.15.82:0/457337145 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a80055a0 con 0x7f39b40b0550 2023-11-28T13:02:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.941+0000 7f39b3fff700 1 -- 172.21.15.82:0/457337145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b4069fd0 con 0x7f39b40b0550 2023-11-28T13:02:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.945+0000 7f39b3fff700 1 -- 172.21.15.82:0/457337145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b406a590 con 0x7f39b40b0550 2023-11-28T13:02:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.945+0000 7f399b7fe700 1 -- 172.21.15.82:0/457337145 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f39a8010050 con 0x7f39b40b0550 2023-11-28T13:02:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.945+0000 7f399b7fe700 1 --2- 172.21.15.82:0/457337145 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f39a0064f10 0x7f39a00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.945+0000 7f399b7fe700 1 -- 172.21.15.82:0/457337145 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f39a8080f60 con 0x7f39b40b0550 2023-11-28T13:02:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.945+0000 7f39b27fc700 1 --2- 172.21.15.82:0/457337145 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f39a0064f10 0x7f39a00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.945+0000 7f39b27fc700 1 --2- 172.21.15.82:0/457337145 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f39a0064f10 0x7f39a00673c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f39ac014040 tx=0x7f39ac011000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:24.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:24.949+0000 7f399b7fe700 1 -- 172.21.15.82:0/457337145 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f39a8049400 con 0x7f39b40b0550 2023-11-28T13:02:25.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.105+0000 7f39b3fff700 1 -- 172.21.15.82:0/457337145 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39b4065fc0 con 0x7f39a0064f10 2023-11-28T13:02:25.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.121+0000 7f399b7fe700 1 -- 172.21.15.82:0/457337145 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299237 (secure 0 0 0) 0x7f39b4065fc0 con 0x7f39a0064f10 2023-11-28T13:02:25.129 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:25.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.129+0000 7f39b3fff700 1 -- 172.21.15.82:0/457337145 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f39a0064f10 msgr2=0x7f39a00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:25.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.129+0000 7f39b3fff700 1 --2- 172.21.15.82:0/457337145 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f39a0064f10 0x7f39a00673c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f39ac014040 tx=0x7f39ac011000 comp rx=0 tx=0).stop 2023-11-28T13:02:25.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.129+0000 7f39b3fff700 1 -- 172.21.15.82:0/457337145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39b40b0550 msgr2=0x7f39b415f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:25.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.129+0000 7f39b3fff700 1 --2- 172.21.15.82:0/457337145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39b40b0550 0x7f39b415f670 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f39a800c410 tx=0x7f39a800c7d0 comp rx=0 tx=0).stop 2023-11-28T13:02:25.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.129+0000 7f39b3fff700 1 -- 172.21.15.82:0/457337145 shutdown_connections 2023-11-28T13:02:25.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.129+0000 7f39b3fff700 1 --2- 172.21.15.82:0/457337145 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f39a0064f10 0x7f39a00673c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:25.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.129+0000 7f39b3fff700 1 --2- 172.21.15.82:0/457337145 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39b4160660 0x7f39b40711a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:25.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.129+0000 7f39b3fff700 1 --2- 172.21.15.82:0/457337145 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b40ca7b0 0x7f39b41e9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:25.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.129+0000 7f39b3fff700 1 --2- 172.21.15.82:0/457337145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39b40b0550 0x7f39b415f670 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:25.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.129+0000 7f39b3fff700 1 -- 172.21.15.82:0/457337145 >> 172.21.15.82:0/457337145 conn(0x7f39b40cf1a0 msgr2=0x7f39b40cc050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:25.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.129+0000 7f39b3fff700 1 -- 172.21.15.82:0/457337145 shutdown_connections 2023-11-28T13:02:25.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.129+0000 7f39b3fff700 1 -- 172.21.15.82:0/457337145 wait complete. 2023-11-28T13:02:25.134 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:02:25.148 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2023-11-28T13:02:23.194632+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":72960,"kb_used_data":5504,"kb_used_omap":0,"kb_used_meta":67392,"kb_avail":754901760,"statfs":{"total":773094113280,"available":773019402240,"internally_reserved":0,"allocated":5636096,"data_stored":3054612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":69009408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.125286"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.077902+0000","last_change":"2023-11-28T13:02:19.077902+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.077902+0000","last_undegraded":"2023-11-28T13:02:19.077902+0000","last_fullsized":"2023-11-28T13:02:19.077902+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:12.209141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.075162+0000","last_change":"2023-11-28T13:02:19.075162+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.075162+0000","last_undegraded":"2023-11-28T13:02:19.075162+0000","last_fullsized":"2023-11-28T13:02:19.075162+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:19.032803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.075037+0000","last_change":"2023-11-28T13:02:19.075037+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.075037+0000","last_undegraded":"2023-11-28T13:02:19.075037+0000","last_fullsized":"2023-11-28T13:02:19.075037+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:24.782403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.077873+0000","last_change":"2023-11-28T13:02:19.077873+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.077873+0000","last_undegraded":"2023-11-28T13:02:19.077873+0000","last_fullsized":"2023-11-28T13:02:19.077873+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:14.909436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.081928+0000","last_change":"2023-11-28T13:02:19.081928+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.081928+0000","last_undegraded":"2023-11-28T13:02:19.081928+0000","last_fullsized":"2023-11-28T13:02:19.081928+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:47.914711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.072503+0000","last_change":"2023-11-28T13:02:19.072503+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.072503+0000","last_undegraded":"2023-11-28T13:02:19.072503+0000","last_fullsized":"2023-11-28T13:02:19.072503+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:19.257824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.076664+0000","last_change":"2023-11-28T13:02:19.076664+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.076664+0000","last_undegraded":"2023-11-28T13:02:19.076664+0000","last_fullsized":"2023-11-28T13:02:19.076664+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:55:18.096845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.081120+0000","last_change":"2023-11-28T13:02:19.081120+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.081120+0000","last_undegraded":"2023-11-28T13:02:19.081120+0000","last_fullsized":"2023-11-28T13:02:19.081120+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:07:00.966797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.073601+0000","last_change":"2023-11-28T13:02:19.073601+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.073601+0000","last_undegraded":"2023-11-28T13:02:19.073601+0000","last_fullsized":"2023-11-28T13:02:19.073601+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:47.491241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.073526+0000","last_change":"2023-11-28T13:02:19.073526+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.073526+0000","last_undegraded":"2023-11-28T13:02:19.073526+0000","last_fullsized":"2023-11-28T13:02:19.073526+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:33:36.451705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.074958+0000","last_change":"2023-11-28T13:02:19.074958+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.074958+0000","last_undegraded":"2023-11-28T13:02:19.074958+0000","last_fullsized":"2023-11-28T13:02:19.074958+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:54.789622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.078405+0000","last_change":"2023-11-28T13:02:19.078405+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.078405+0000","last_undegraded":"2023-11-28T13:02:19.078405+0000","last_fullsized":"2023-11-28T13:02:19.078405+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:47.914711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.081429+0000","last_change":"2023-11-28T13:02:19.081429+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.081429+0000","last_undegraded":"2023-11-28T13:02:19.081429+0000","last_fullsized":"2023-11-28T13:02:19.081429+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:14.909436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.076785+0000","last_change":"2023-11-28T13:02:19.076785+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.076785+0000","last_undegraded":"2023-11-28T13:02:19.076785+0000","last_fullsized":"2023-11-28T13:02:19.076785+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:31.937666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.073266+0000","last_change":"2023-11-28T13:02:19.073266+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.073266+0000","last_undegraded":"2023-11-28T13:02:19.073266+0000","last_fullsized":"2023-11-28T13:02:19.073266+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:37.011377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.078057+0000","last_change":"2023-11-28T13:02:19.078057+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.078057+0000","last_undegraded":"2023-11-28T13:02:19.078057+0000","last_fullsized":"2023-11-28T13:02:19.078057+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:55.285175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.081612+0000","last_change":"2023-11-28T13:02:19.081612+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.081612+0000","last_undegraded":"2023-11-28T13:02:19.081612+0000","last_fullsized":"2023-11-28T13:02:19.081612+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:15:56.250681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.082465+0000","last_change":"2023-11-28T13:02:19.082465+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.082465+0000","last_undegraded":"2023-11-28T13:02:19.082465+0000","last_fullsized":"2023-11-28T13:02:19.082465+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:56:09.688582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.077604+0000","last_change":"2023-11-28T13:02:19.077604+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.077604+0000","last_undegraded":"2023-11-28T13:02:19.077604+0000","last_fullsized":"2023-11-28T13:02:19.077604+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:24:50.411915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.076809+0000","last_change":"2023-11-28T13:02:19.076809+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.076809+0000","last_undegraded":"2023-11-28T13:02:19.076809+0000","last_fullsized":"2023-11-28T13:02:19.076809+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:45.041829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.074997+0000","last_change":"2023-11-28T13:02:19.074997+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.074997+0000","last_undegraded":"2023-11-28T13:02:19.074997+0000","last_fullsized":"2023-11-28T13:02:19.074997+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:14:46.191864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.080967+0000","last_change":"2023-11-28T13:02:19.080967+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.080967+0000","last_undegraded":"2023-11-28T13:02:19.080967+0000","last_fullsized":"2023-11-28T13:02:19.080967+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:28:45.191699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.081505+0000","last_change":"2023-11-28T13:02:19.081505+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.081505+0000","last_undegraded":"2023-11-28T13:02:19.081505+0000","last_fullsized":"2023-11-28T13:02:19.081505+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:30:54.767899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.082430+0000","last_change":"2023-11-28T13:02:19.082430+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.082430+0000","last_undegraded":"2023-11-28T13:02:19.082430+0000","last_fullsized":"2023-11-28T13:02:19.082430+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:43.577442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.081283+0000","last_change":"2023-11-28T13:02:19.081283+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.081283+0000","last_undegraded":"2023-11-28T13:02:19.081283+0000","last_fullsized":"2023-11-28T13:02:19.081283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:09.884077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":192,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-28T13:02:19.075816+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:02:19.075816+0000","last_peered":"2023-11-28T13:02:19.075816+0000","last_clean":"2023-11-28T13:02:19.075816+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:02:19.075816+0000","last_undegraded":"2023-11-28T13:02:19.075816+0000","last_fullsized":"2023-11-28T13:02:19.075816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.172848+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:02:17.172848+0000","last_peered":"2023-11-28T13:02:17.172848+0000","last_clean":"2023-11-28T13:02:17.172848+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:02:17.172848+0000","last_undegraded":"2023-11-28T13:02:17.172848+0000","last_fullsized":"2023-11-28T13:02:17.172848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.073553+0000","last_change":"2023-11-28T13:02:19.073553+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.073553+0000","last_undegraded":"2023-11-28T13:02:19.073553+0000","last_fullsized":"2023-11-28T13:02:19.073553+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:11.227538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.005762+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:02:17.005762+0000","last_peered":"2023-11-28T13:02:17.005762+0000","last_clean":"2023-11-28T13:02:17.005762+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:02:17.005762+0000","last_undegraded":"2023-11-28T13:02:17.005762+0000","last_fullsized":"2023-11-28T13:02:17.005762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.081506+0000","last_change":"2023-11-28T13:02:19.081506+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.081506+0000","last_undegraded":"2023-11-28T13:02:19.081506+0000","last_fullsized":"2023-11-28T13:02:19.081506+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:32.316383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.172333+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:02:17.172333+0000","last_peered":"2023-11-28T13:02:17.172333+0000","last_clean":"2023-11-28T13:02:17.172333+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:02:17.172333+0000","last_undegraded":"2023-11-28T13:02:17.172333+0000","last_fullsized":"2023-11-28T13:02:17.172333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.077003+0000","last_change":"2023-11-28T13:02:19.077003+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.077003+0000","last_undegraded":"2023-11-28T13:02:19.077003+0000","last_fullsized":"2023-11-28T13:02:19.077003+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:52.544723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.172841+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:02:17.172841+0000","last_peered":"2023-11-28T13:02:17.172841+0000","last_clean":"2023-11-28T13:02:17.172841+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:02:17.172841+0000","last_undegraded":"2023-11-28T13:02:17.172841+0000","last_fullsized":"2023-11-28T13:02:17.172841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.072521+0000","last_change":"2023-11-28T13:02:19.072521+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.072521+0000","last_undegraded":"2023-11-28T13:02:19.072521+0000","last_fullsized":"2023-11-28T13:02:19.072521+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:14.909436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.173011+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:02:17.173011+0000","last_peered":"2023-11-28T13:02:17.173011+0000","last_clean":"2023-11-28T13:02:17.173011+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:02:17.173011+0000","last_undegraded":"2023-11-28T13:02:17.173011+0000","last_fullsized":"2023-11-28T13:02:17.173011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.078580+0000","last_change":"2023-11-28T13:02:19.078580+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.078580+0000","last_undegraded":"2023-11-28T13:02:19.078580+0000","last_fullsized":"2023-11-28T13:02:19.078580+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:33:36.451705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.005743+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:02:17.005743+0000","last_peered":"2023-11-28T13:02:17.005743+0000","last_clean":"2023-11-28T13:02:17.005743+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:02:17.005743+0000","last_undegraded":"2023-11-28T13:02:17.005743+0000","last_fullsized":"2023-11-28T13:02:17.005743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.080960+0000","last_change":"2023-11-28T13:02:19.080960+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.080960+0000","last_undegraded":"2023-11-28T13:02:19.080960+0000","last_fullsized":"2023-11-28T13:02:19.080960+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:13.894190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.172990+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:02:17.172990+0000","last_peered":"2023-11-28T13:02:17.172990+0000","last_clean":"2023-11-28T13:02:17.172990+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:02:17.172990+0000","last_undegraded":"2023-11-28T13:02:17.172990+0000","last_fullsized":"2023-11-28T13:02:17.172990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T13:02:20.067476+0000","last_change":"2023-11-28T13:02:20.067476+0000","last_active":"2023-11-28T13:02:20.067476+0000","last_peered":"2023-11-28T13:02:20.067476+0000","last_clean":"2023-11-28T13:02:20.067476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:20.067476+0000","last_undegraded":"2023-11-28T13:02:20.067476+0000","last_fullsized":"2023-11-28T13:02:20.067476+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-11-28T13:02:19.078260+0000","last_change":"2023-11-28T13:02:19.078260+0000","last_active":"2023-11-28T13:02:19.062350+0000","last_peered":"2023-11-28T13:02:19.062350+0000","last_clean":"2023-11-28T13:02:19.062350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T13:02:19.078260+0000","last_undegraded":"2023-11-28T13:02:19.078260+0000","last_fullsized":"2023-11-28T13:02:19.078260+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:32.316383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-28T13:02:17.172317+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:02:17.172317+0000","last_peered":"2023-11-28T13:02:17.172317+0000","last_clean":"2023-11-28T13:02:17.172317+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:02:17.172317+0000","last_undegraded":"2023-11-28T13:02:17.172317+0000","last_fullsized":"2023-11-28T13:02:17.172317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10100,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94361740,"statfs":{"total":96636764160,"available":96626421760,"internally_reserved":0,"allocated":1159168,"data_stored":829230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.82699999999999996,"15min":0.81499999999999995},"min":{"1min":0.625,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.871},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.90200000000000002,"15min":0.91100000000000003},"min":{"1min":0.50900000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.222,"5min":1.377,"15min":1.377},"last":0.50900000000000001}]},{"osd":1,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.91400000000000003,"15min":0.92000000000000004},"min":{"1min":0.58399999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.242,"5min":1.599,"15min":1.599},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.871,"5min":0.93600000000000005,"15min":0.94699999999999995},"min":{"1min":0.63400000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.161,"5min":1.375,"15min":1.375},"last":0.80000000000000004}]},{"osd":2,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.92700000000000005,"15min":0.94099999999999995},"min":{"1min":0.58799999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2949999999999999,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.60999999999999999,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.329,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.95999999999999996}]},{"osd":3,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.93999999999999995,"15min":0.95199999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.1839999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.92800000000000005,"15min":0.92200000000000004},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.71999999999999997}]},{"osd":4,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0029999999999999,"15min":1.0089999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.504,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.96399999999999997,"15min":0.96599999999999997},"min":{"1min":0.72899999999999998,"5min":0.621,"15min":0.621},"max":{"1min":1.296,"5min":1.409,"15min":1.409},"last":0.77000000000000002}]},{"osd":5,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.0449999999999999,"15min":1.0309999999999999},"min":{"1min":0.872,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.1020000000000001,"15min":1.107},"min":{"1min":0.76800000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4530000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.93899999999999995}]},{"osd":6,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.179,"15min":1.1870000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3500000000000001,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1699999999999999,"15min":1.175},"min":{"1min":0.879,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.4299999999999999,"5min":1.794,"15min":1.794},"last":0.91500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8676,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363164,"statfs":{"total":96636764160,"available":96627879936,"internally_reserved":0,"allocated":552960,"data_stored":232692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.83399999999999996,"15min":0.83599999999999997},"min":{"1min":0.64500000000000002,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0960000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.85399999999999998,"15min":0.84199999999999997},"min":{"1min":0.65200000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1539999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.97599999999999998}]},{"osd":1,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.87,"15min":0.86199999999999999},"min":{"1min":0.65800000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2370000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.871,"15min":0.86499999999999999},"min":{"1min":0.68600000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.218,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.79200000000000004}]},{"osd":2,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.875,"15min":0.88400000000000001},"min":{"1min":0.57899999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1339999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.02},{"interface":"front","average":{"1min":0.87,"5min":0.88800000000000001,"15min":0.89100000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1819999999999999,"5min":1.639,"15min":1.639},"last":0.83099999999999996}]},{"osd":3,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.88400000000000001,"15min":0.88},"min":{"1min":0.67800000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1399999999999999,"5min":1.141,"15min":1.141},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.97499999999999998,"15min":0.97699999999999998},"min":{"1min":0.74099999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.1259999999999999,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.0780000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.95199999999999996,"15min":0.94899999999999995},"min":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2390000000000001,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.113},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.4390000000000001,"15min":1.506},"min":{"1min":0.66100000000000003,"5min":0.629,"15min":0.629},"max":{"1min":1.266,"5min":10.566000000000001,"15min":10.566000000000001},"last":1.0009999999999999}]},{"osd":5,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.0780000000000001,"15min":1.0860000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.21,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.0940000000000001,"15min":1.0840000000000001},"min":{"1min":0.91500000000000004,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.3160000000000001,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.3160000000000001}]},{"osd":7,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.234,"15min":1.25},"min":{"1min":0.877,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.3819999999999999,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.306,"15min":1.331},"min":{"1min":0.97399999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":1.351,"5min":3.593,"15min":3.593},"last":1.351}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8868,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362972,"statfs":{"total":96636764160,"available":96627683328,"internally_reserved":0,"allocated":552960,"data_stored":232692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.81699999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82599999999999996,"15min":0.81999999999999995},"min":{"1min":0.628,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0680000000000001,"5min":1.248,"15min":1.248},"last":1.0229999999999999}]},{"osd":1,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82299999999999995,"15min":0.82199999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1100000000000001,"5min":1.274,"15min":1.274},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.56299999999999994,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.109,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.86499999999999999}]},{"osd":2,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81499999999999995,"15min":0.81100000000000005},"min":{"1min":0.505,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.92900000000000005,"15min":0.93999999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2010000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.89500000000000002}]},{"osd":3,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.88500000000000001,"15min":0.871},"min":{"1min":0.69999999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.998,"5min":1.0229999999999999,"15min":1.0269999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.391,"5min":1.403,"15min":1.403},"last":0.98399999999999999}]},{"osd":4,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.88300000000000001,"15min":0.89000000000000001},"min":{"1min":0.63,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1719999999999999,"5min":1.216,"15min":1.216},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.153,"5min":0.98299999999999998,"15min":0.95499999999999996},"min":{"1min":0.72499999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":4.3300000000000001,"5min":4.3300000000000001,"15min":4.3300000000000001},"last":0.94599999999999995}]},{"osd":6,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.02,"15min":1.0289999999999999},"min":{"1min":0.76800000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0269999999999999,"15min":1.0289999999999999},"min":{"1min":0.74299999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.448,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.92400000000000004}]},{"osd":7,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.0620000000000001,"15min":1.038},"min":{"1min":0.71699999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":4.234,"5min":4.234,"15min":4.234},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.133,"15min":1.1399999999999999},"min":{"1min":0.82199999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.377,"5min":1.466,"15min":1.466},"last":1.056}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8932,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362908,"statfs":{"total":96636764160,"available":96627617792,"internally_reserved":0,"allocated":552960,"data_stored":232692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.59799999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.78500000000000003}]},{"osd":1,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81399999999999995,"15min":0.81599999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0880000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.153,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.03}]},{"osd":2,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.83899999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.133,"5min":1.357,"15min":1.357},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.88400000000000001}]},{"osd":3,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.88300000000000001,"15min":0.872},"min":{"1min":0.64600000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.004,"5min":0.99299999999999999,"15min":0.99099999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.84099999999999997}]},{"osd":5,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.63700000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4039999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.98699999999999999,"15min":0.997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.73299999999999998}]},{"osd":6,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0269999999999999,"15min":1.034},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.296,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0840000000000001,"15min":1.0800000000000001},"min":{"1min":0.86299999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.97999999999999998}]},{"osd":7,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0880000000000001,"15min":1.093},"min":{"1min":0.81999999999999995,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.151,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.98899999999999999,"5min":0.871,"15min":0.871},"max":{"1min":1.571,"5min":1.655,"15min":1.655},"last":0.91500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8932,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362908,"statfs":{"total":96636764160,"available":96627617792,"internally_reserved":0,"allocated":552960,"data_stored":232692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.46300000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98099999999999998,"5min":0.998,"15min":0.998},"last":0.60699999999999998}]},{"osd":1,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68100000000000005,"15min":0.69199999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86499999999999999,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.93100000000000005}]},{"osd":2,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.5,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0289999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82699999999999996,"15min":0.82899999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0740000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.0740000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.97799999999999998,"15min":1},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.194,"5min":1.405,"15min":1.405},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.038,"15min":1.05},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.409,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.879}]},{"osd":5,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.0529999999999999,"15min":1.0669999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2430000000000001,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.081,"15min":1.093},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.321,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.018}]},{"osd":6,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.073,"15min":1.101},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.196,"5min":1.446,"15min":1.446},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.038,"5min":1.1040000000000001,"15min":1.115},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.3500000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.97899999999999998}]},{"osd":7,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.145,"15min":1.1579999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3640000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.153,"15min":1.1819999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.2290000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.95699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8740,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363100,"statfs":{"total":96636764160,"available":96627814400,"internally_reserved":0,"allocated":552960,"data_stored":232692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.52200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81999999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.57199999999999995}]},{"osd":1,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.629,"15min":0.61599999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.94399999999999995,"5min":1.123,"15min":1.123},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97899999999999998,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.501}]},{"osd":3,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.73799999999999999,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.317,"15min":0.317},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.74199999999999999,"15min":0.74099999999999999},"min":{"1min":0.46400000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.018,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91200000000000003,"15min":0.91600000000000004},"min":{"1min":0.64300000000000002,"5min":0.498,"15min":0.498},"max":{"1min":1.1519999999999999,"5min":1.327,"15min":1.327},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.002,"15min":1.0049999999999999},"min":{"1min":0.69999999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3129999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.69999999999999996}]},{"osd":5,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.76800000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.202,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.137,"5min":1.006,"15min":0.98399999999999999},"min":{"1min":0.73899999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.78600000000000003}]},{"osd":6,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.0569999999999999,"15min":1.0309999999999999},"min":{"1min":0.66900000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1,"15min":1.0009999999999999},"min":{"1min":0.72499999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.2450000000000001,"5min":1.359,"15min":1.359},"last":0.72499999999999998}]},{"osd":7,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.74399999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.431,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.1160000000000001,"15min":1.0960000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.73899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8804,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363036,"statfs":{"total":96636764160,"available":96627748864,"internally_reserved":0,"allocated":552960,"data_stored":232692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.96599999999999997,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.66800000000000004,"15min":0.68200000000000005},"min":{"1min":0.39100000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.749,"5min":1.181,"15min":1.181},"last":0.41399999999999998}]},{"osd":2,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78500000000000003,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.752,"15min":0.755},"min":{"1min":0.53700000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97599999999999998,"5min":1.409,"15min":1.409},"last":0.55300000000000005}]},{"osd":3,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.81599999999999995,"15min":0.82799999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.069,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.073,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.72799999999999998}]},{"osd":4,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.98299999999999998,"15min":0.99299999999999999},"min":{"1min":0.65000000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.93400000000000005,"15min":0.94199999999999995},"min":{"1min":0.68100000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1850000000000001,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":0.69899999999999995}]},{"osd":5,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.96899999999999997,"15min":0.97699999999999998},"min":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.3580000000000001,"5min":1.425,"15min":1.425},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0369999999999999,"15min":1.0509999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.234,"5min":2.004,"15min":2.004},"last":0.85299999999999998}]},{"osd":6,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.99299999999999999,"15min":1.0089999999999999},"min":{"1min":0.64100000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.101,"5min":1.889,"15min":1.889},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.097,"15min":1.1100000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4119999999999999,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.80800000000000005}]},{"osd":7,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.085,"15min":1.0940000000000001},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.3029999999999999,"5min":1.766,"15min":1.766},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.107,"15min":1.123},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.3109999999999999,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.82999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9908,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94361932,"statfs":{"total":96636764160,"available":96626618368,"internally_reserved":0,"allocated":1159168,"data_stored":829230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.501}]},{"osd":2,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.746},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.57499999999999996}]},{"osd":3,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.86699999999999999}]},{"osd":4,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.93700000000000006}]},{"osd":5,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.048},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.96599999999999997}]},{"osd":6,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.997}]},{"osd":7,"last update":"Tue Nov 28 13:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":1.121},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.83299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:02:25.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3f is not active+clean 2023-11-28T13:02:25.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2023-11-28T13:02:25.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2023-11-28T13:02:25.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3c is not active+clean 2023-11-28T13:02:25.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2023-11-28T13:02:25.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3a is not active+clean 2023-11-28T13:02:25.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2023-11-28T13:02:25.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2023-11-28T13:02:25.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.37 is not active+clean 2023-11-28T13:02:25.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.36 is not active+clean 2023-11-28T13:02:25.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.35 is not active+clean 2023-11-28T13:02:25.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2023-11-28T13:02:25.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.33 is not active+clean 2023-11-28T13:02:25.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2023-11-28T13:02:25.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.31 is not active+clean 2023-11-28T13:02:25.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.30 is not active+clean 2023-11-28T13:02:25.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2023-11-28T13:02:25.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2e is not active+clean 2023-11-28T13:02:25.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2023-11-28T13:02:25.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2023-11-28T13:02:25.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2023-11-28T13:02:25.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2a is not active+clean 2023-11-28T13:02:25.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.29 is not active+clean 2023-11-28T13:02:25.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2023-11-28T13:02:25.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.27 is not active+clean 2023-11-28T13:02:25.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.26 is not active+clean 2023-11-28T13:02:25.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.25 is not active+clean 2023-11-28T13:02:25.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2023-11-28T13:02:25.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2023-11-28T13:02:25.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2023-11-28T13:02:25.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2023-11-28T13:02:25.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.20 is not active+clean 2023-11-28T13:02:25.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-11-28T13:02:25.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-11-28T13:02:25.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.077902+0000', 'last_change': '2023-11-28T13:02:19.077902+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.077902+0000', 'last_undegraded': '2023-11-28T13:02:19.077902+0000', 'last_fullsized': '2023-11-28T13:02:19.077902+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T22:45:12.209141+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T13:02:25.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-11-28T13:02:25.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-11-28T13:02:25.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.075162+0000', 'last_change': '2023-11-28T13:02:19.075162+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.075162+0000', 'last_undegraded': '2023-11-28T13:02:19.075162+0000', 'last_fullsized': '2023-11-28T13:02:19.075162+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T22:05:19.032803+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T13:02:25.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-11-28T13:02:25.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-11-28T13:02:25.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.075037+0000', 'last_change': '2023-11-28T13:02:19.075037+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.075037+0000', 'last_undegraded': '2023-11-28T13:02:19.075037+0000', 'last_fullsized': '2023-11-28T13:02:19.075037+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T20:39:24.782403+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T13:02:25.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-11-28T13:02:25.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-11-28T13:02:25.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.077873+0000', 'last_change': '2023-11-28T13:02:19.077873+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.077873+0000', 'last_undegraded': '2023-11-28T13:02:19.077873+0000', 'last_fullsized': '2023-11-28T13:02:19.077873+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T18:22:14.909436+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T13:02:25.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-11-28T13:02:25.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-11-28T13:02:25.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.081928+0000', 'last_change': '2023-11-28T13:02:19.081928+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.081928+0000', 'last_undegraded': '2023-11-28T13:02:19.081928+0000', 'last_fullsized': '2023-11-28T13:02:19.081928+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T00:13:47.914711+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T13:02:25.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-11-28T13:02:25.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-11-28T13:02:25.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.072503+0000', 'last_change': '2023-11-28T13:02:19.072503+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.072503+0000', 'last_undegraded': '2023-11-28T13:02:19.072503+0000', 'last_fullsized': '2023-11-28T13:02:19.072503+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T22:51:19.257824+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T13:02:25.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-11-28T13:02:25.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-11-28T13:02:25.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.076664+0000', 'last_change': '2023-11-28T13:02:19.076664+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.076664+0000', 'last_undegraded': '2023-11-28T13:02:19.076664+0000', 'last_fullsized': '2023-11-28T13:02:19.076664+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T15:55:18.096845+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T13:02:25.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-11-28T13:02:25.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-11-28T13:02:25.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.081120+0000', 'last_change': '2023-11-28T13:02:19.081120+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.081120+0000', 'last_undegraded': '2023-11-28T13:02:19.081120+0000', 'last_fullsized': '2023-11-28T13:02:19.081120+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T18:07:00.966797+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T13:02:25.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-11-28T13:02:25.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-11-28T13:02:25.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.073601+0000', 'last_change': '2023-11-28T13:02:19.073601+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.073601+0000', 'last_undegraded': '2023-11-28T13:02:19.073601+0000', 'last_fullsized': '2023-11-28T13:02:19.073601+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:15:47.491241+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T13:02:25.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-11-28T13:02:25.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-11-28T13:02:25.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.073526+0000', 'last_change': '2023-11-28T13:02:19.073526+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.073526+0000', 'last_undegraded': '2023-11-28T13:02:19.073526+0000', 'last_fullsized': '2023-11-28T13:02:19.073526+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T13:33:36.451705+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T13:02:25.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-11-28T13:02:25.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-11-28T13:02:25.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.074958+0000', 'last_change': '2023-11-28T13:02:19.074958+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.074958+0000', 'last_undegraded': '2023-11-28T13:02:19.074958+0000', 'last_fullsized': '2023-11-28T13:02:19.074958+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T00:09:54.789622+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T13:02:25.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-11-28T13:02:25.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-11-28T13:02:25.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.078405+0000', 'last_change': '2023-11-28T13:02:19.078405+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.078405+0000', 'last_undegraded': '2023-11-28T13:02:19.078405+0000', 'last_fullsized': '2023-11-28T13:02:19.078405+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T00:13:47.914711+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T13:02:25.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-11-28T13:02:25.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-11-28T13:02:25.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.081429+0000', 'last_change': '2023-11-28T13:02:19.081429+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.081429+0000', 'last_undegraded': '2023-11-28T13:02:19.081429+0000', 'last_fullsized': '2023-11-28T13:02:19.081429+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T18:22:14.909436+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T13:02:25.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-11-28T13:02:25.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-11-28T13:02:25.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.076785+0000', 'last_change': '2023-11-28T13:02:19.076785+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.076785+0000', 'last_undegraded': '2023-11-28T13:02:19.076785+0000', 'last_fullsized': '2023-11-28T13:02:19.076785+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T16:01:31.937666+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T13:02:25.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-11-28T13:02:25.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-11-28T13:02:25.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.073266+0000', 'last_change': '2023-11-28T13:02:19.073266+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.073266+0000', 'last_undegraded': '2023-11-28T13:02:19.073266+0000', 'last_fullsized': '2023-11-28T13:02:19.073266+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:20:37.011377+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T13:02:25.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-11-28T13:02:25.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-11-28T13:02:25.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.078057+0000', 'last_change': '2023-11-28T13:02:19.078057+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.078057+0000', 'last_undegraded': '2023-11-28T13:02:19.078057+0000', 'last_fullsized': '2023-11-28T13:02:19.078057+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T19:08:55.285175+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T13:02:25.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-11-28T13:02:25.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-11-28T13:02:25.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.081612+0000', 'last_change': '2023-11-28T13:02:19.081612+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.081612+0000', 'last_undegraded': '2023-11-28T13:02:19.081612+0000', 'last_fullsized': '2023-11-28T13:02:19.081612+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T16:15:56.250681+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T13:02:25.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-11-28T13:02:25.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-11-28T13:02:25.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.082465+0000', 'last_change': '2023-11-28T13:02:19.082465+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.082465+0000', 'last_undegraded': '2023-11-28T13:02:19.082465+0000', 'last_fullsized': '2023-11-28T13:02:19.082465+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T13:56:09.688582+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T13:02:25.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-11-28T13:02:25.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-11-28T13:02:25.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.077604+0000', 'last_change': '2023-11-28T13:02:19.077604+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.077604+0000', 'last_undegraded': '2023-11-28T13:02:19.077604+0000', 'last_fullsized': '2023-11-28T13:02:19.077604+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T16:24:50.411915+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T13:02:25.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-11-28T13:02:25.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-11-28T13:02:25.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.076809+0000', 'last_change': '2023-11-28T13:02:19.076809+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.076809+0000', 'last_undegraded': '2023-11-28T13:02:19.076809+0000', 'last_fullsized': '2023-11-28T13:02:19.076809+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T13:08:45.041829+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T13:02:25.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-11-28T13:02:25.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-11-28T13:02:25.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.074997+0000', 'last_change': '2023-11-28T13:02:19.074997+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.074997+0000', 'last_undegraded': '2023-11-28T13:02:19.074997+0000', 'last_fullsized': '2023-11-28T13:02:19.074997+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T00:14:46.191864+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T13:02:25.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-11-28T13:02:25.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-11-28T13:02:25.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.080967+0000', 'last_change': '2023-11-28T13:02:19.080967+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.080967+0000', 'last_undegraded': '2023-11-28T13:02:19.080967+0000', 'last_fullsized': '2023-11-28T13:02:19.080967+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T00:28:45.191699+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T13:02:25.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-11-28T13:02:25.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-11-28T13:02:25.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.081505+0000', 'last_change': '2023-11-28T13:02:19.081505+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.081505+0000', 'last_undegraded': '2023-11-28T13:02:19.081505+0000', 'last_fullsized': '2023-11-28T13:02:19.081505+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T14:30:54.767899+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T13:02:25.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-11-28T13:02:25.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-11-28T13:02:25.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.082430+0000', 'last_change': '2023-11-28T13:02:19.082430+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.082430+0000', 'last_undegraded': '2023-11-28T13:02:19.082430+0000', 'last_fullsized': '2023-11-28T13:02:19.082430+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:35:43.577442+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T13:02:25.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-11-28T13:02:25.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-11-28T13:02:25.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.081283+0000', 'last_change': '2023-11-28T13:02:19.081283+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.081283+0000', 'last_undegraded': '2023-11-28T13:02:19.081283+0000', 'last_fullsized': '2023-11-28T13:02:19.081283+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:45:09.884077+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T13:02:25.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-11-28T13:02:25.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-11-28T13:02:25.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.073553+0000', 'last_change': '2023-11-28T13:02:19.073553+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.073553+0000', 'last_undegraded': '2023-11-28T13:02:19.073553+0000', 'last_fullsized': '2023-11-28T13:02:19.073553+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T20:22:11.227538+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T13:02:25.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-11-28T13:02:25.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-11-28T13:02:25.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.081506+0000', 'last_change': '2023-11-28T13:02:19.081506+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.081506+0000', 'last_undegraded': '2023-11-28T13:02:19.081506+0000', 'last_fullsized': '2023-11-28T13:02:19.081506+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T21:29:32.316383+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T13:02:25.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-11-28T13:02:25.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-11-28T13:02:25.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.077003+0000', 'last_change': '2023-11-28T13:02:19.077003+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.077003+0000', 'last_undegraded': '2023-11-28T13:02:19.077003+0000', 'last_fullsized': '2023-11-28T13:02:19.077003+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T22:30:52.544723+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T13:02:25.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-11-28T13:02:25.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-11-28T13:02:25.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.072521+0000', 'last_change': '2023-11-28T13:02:19.072521+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.072521+0000', 'last_undegraded': '2023-11-28T13:02:19.072521+0000', 'last_fullsized': '2023-11-28T13:02:19.072521+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T18:22:14.909436+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T13:02:25.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-11-28T13:02:25.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-11-28T13:02:25.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.078580+0000', 'last_change': '2023-11-28T13:02:19.078580+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.078580+0000', 'last_undegraded': '2023-11-28T13:02:19.078580+0000', 'last_fullsized': '2023-11-28T13:02:19.078580+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T13:33:36.451705+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T13:02:25.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-11-28T13:02:25.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-11-28T13:02:25.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.080960+0000', 'last_change': '2023-11-28T13:02:19.080960+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.080960+0000', 'last_undegraded': '2023-11-28T13:02:19.080960+0000', 'last_fullsized': '2023-11-28T13:02:19.080960+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T00:20:13.894190+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T13:02:25.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-11-28T13:02:25.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T13:02:20.067476+0000', 'last_change': '2023-11-28T13:02:20.067476+0000', 'last_active': '2023-11-28T13:02:20.067476+0000', 'last_peered': '2023-11-28T13:02:20.067476+0000', 'last_clean': '2023-11-28T13:02:20.067476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:20.067476+0000', 'last_undegraded': '2023-11-28T13:02:20.067476+0000', 'last_fullsized': '2023-11-28T13:02:20.067476+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:20.067476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T13:02:25.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-11-28T13:02:25.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-11-28T13:02:19.078260+0000', 'last_change': '2023-11-28T13:02:19.078260+0000', 'last_active': '2023-11-28T13:02:19.062350+0000', 'last_peered': '2023-11-28T13:02:19.062350+0000', 'last_clean': '2023-11-28T13:02:19.062350+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T13:02:19.078260+0000', 'last_undegraded': '2023-11-28T13:02:19.078260+0000', 'last_fullsized': '2023-11-28T13:02:19.078260+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'last_clean_scrub_stamp': '2023-11-28T13:02:19.062350+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T21:29:32.316383+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T13:02:25.174 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T13:02:25.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.285+0000 7f762ca36700 1 Processor -- start 2023-11-28T13:02:25.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.285+0000 7f762ca36700 1 -- start start 2023-11-28T13:02:25.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.285+0000 7f762ca36700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7628158760 0x7f762815c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:25.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.285+0000 7f762ca36700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f76280c93d0 0x7f7628070730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:25.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f762ca36700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f762806a9d0 con 0x7f762815c6f0 2023-11-28T13:02:25.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f762ca36700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762806a450 con 0x7f76280c93d0 2023-11-28T13:02:25.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f762ca36700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7628158b30 con 0x7f7628158760 2023-11-28T13:02:25.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f761ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f76280c93d0 0x7f7628070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:25.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f761ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f76280c93d0 0x7f7628070730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37420/0 (socket says 172.21.15.82:37420) 2023-11-28T13:02:25.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f761ffff700 1 -- 172.21.15.82:0/1066136849 learned_addr learned my addr 172.21.15.82:0/1066136849 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:25.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f7626d9d700 1 --2- 172.21.15.82:0/1066136849 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7628158760 0x7f762815c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:25.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f762659c700 1 -- 172.21.15.82:0/1066136849 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3628263298 0 0) 0x7f762806a9d0 con 0x7f762815c6f0 2023-11-28T13:02:25.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f762659c700 1 -- 172.21.15.82:0/1066136849 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76140035d0 con 0x7f762815c6f0 2023-11-28T13:02:25.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f761ffff700 1 -- 172.21.15.82:0/1066136849 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7628158760 msgr2=0x7f762815c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:25.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f761ffff700 1 --2- 172.21.15.82:0/1066136849 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7628158760 0x7f762815c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:25.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f761ffff700 1 -- 172.21.15.82:0/1066136849 >> v1:172.21.15.114:6789/0 conn(0x7f762815c6f0 legacy=0x7f762806c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:25.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f761ffff700 1 -- 172.21.15.82:0/1066136849 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762815cc50 con 0x7f76280c93d0 2023-11-28T13:02:25.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f7626d9d700 1 --2- 172.21.15.82:0/1066136849 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7628158760 0x7f762815c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:02:25.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f761ffff700 1 --2- 172.21.15.82:0/1066136849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76280c93d0 0x7f7628070730 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7610009910 tx=0x7f7610009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a708e00e533aa692 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:25.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f762659c700 1 -- 172.21.15.82:0/1066136849 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7610011830 con 0x7f76280c93d0 2023-11-28T13:02:25.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f762659c700 1 -- 172.21.15.82:0/1066136849 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7610011990 con 0x7f76280c93d0 2023-11-28T13:02:25.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f762659c700 1 -- 172.21.15.82:0/1066136849 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7610011d00 con 0x7f76280c93d0 2023-11-28T13:02:25.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f762ca36700 1 -- 172.21.15.82:0/1066136849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76280c93d0 msgr2=0x7f7628070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:25.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f762ca36700 1 --2- 172.21.15.82:0/1066136849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76280c93d0 0x7f7628070730 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7610009910 tx=0x7f7610009c20 comp rx=0 tx=0).stop 2023-11-28T13:02:25.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f762ca36700 1 -- 172.21.15.82:0/1066136849 shutdown_connections 2023-11-28T13:02:25.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f762ca36700 1 --2- 172.21.15.82:0/1066136849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76280c93d0 0x7f7628070730 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:25.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f762ca36700 1 --2- 172.21.15.82:0/1066136849 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7628158760 0x7f762815c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:25.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f762ca36700 1 -- 172.21.15.82:0/1066136849 >> 172.21.15.82:0/1066136849 conn(0x7f76280cb890 msgr2=0x7f76280cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:25.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f762ca36700 1 -- 172.21.15.82:0/1066136849 shutdown_connections 2023-11-28T13:02:25.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.289+0000 7f762ca36700 1 -- 172.21.15.82:0/1066136849 wait complete. 2023-11-28T13:02:25.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.293+0000 7f762ca36700 1 Processor -- start 2023-11-28T13:02:25.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.293+0000 7f762ca36700 1 -- start start 2023-11-28T13:02:25.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.293+0000 7f762ca36700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76280c93d0 0x7f76280c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:25.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.293+0000 7f762ca36700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7628158760 0x7f76280b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:25.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.293+0000 7f762ca36700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762815c6f0 0x7f76280c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:25.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.293+0000 7f762ca36700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76280c5750 con 0x7f762815c6f0 2023-11-28T13:02:25.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.293+0000 7f762ca36700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7628150780 con 0x7f7628158760 2023-11-28T13:02:25.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.293+0000 7f762ca36700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76280b0b20 con 0x7f76280c93d0 2023-11-28T13:02:25.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.293+0000 7f762759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762815c6f0 0x7f76280c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:25.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.293+0000 7f762759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762815c6f0 0x7f76280c5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37432/0 (socket says 172.21.15.82:37432) 2023-11-28T13:02:25.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.293+0000 7f762759e700 1 -- 172.21.15.82:0/3204463479 learned_addr learned my addr 172.21.15.82:0/3204463479 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:25.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.293+0000 7f761ffff700 1 --2- 172.21.15.82:0/3204463479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7628158760 0x7f76280b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:25.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.293+0000 7f7626d9d700 1 --2- 172.21.15.82:0/3204463479 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76280c93d0 0x7f76280c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:25.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.293+0000 7f762759e700 1 -- 172.21.15.82:0/3204463479 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76280c93d0 msgr2=0x7f76280c3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:25.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.293+0000 7f762759e700 1 --2- 172.21.15.82:0/3204463479 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76280c93d0 0x7f76280c3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:25.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.293+0000 7f762759e700 1 -- 172.21.15.82:0/3204463479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7628158760 msgr2=0x7f76280b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:25.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.293+0000 7f762759e700 1 --2- 172.21.15.82:0/3204463479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7628158760 0x7f76280b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:25.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.293+0000 7f762759e700 1 -- 172.21.15.82:0/3204463479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f761800a650 con 0x7f762815c6f0 2023-11-28T13:02:25.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.293+0000 7f7626d9d700 1 --2- 172.21.15.82:0/3204463479 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76280c93d0 0x7f76280c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:25.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.297+0000 7f762759e700 1 --2- 172.21.15.82:0/3204463479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762815c6f0 0x7f76280c5e50 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f762000cc50 tx=0x7f762000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:25.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.297+0000 7f761f7fe700 1 -- 172.21.15.82:0/3204463479 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762000ada0 con 0x7f762815c6f0 2023-11-28T13:02:25.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.297+0000 7f761f7fe700 1 -- 172.21.15.82:0/3204463479 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762000ce50 con 0x7f762815c6f0 2023-11-28T13:02:25.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.297+0000 7f762ca36700 1 -- 172.21.15.82:0/3204463479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7610009570 con 0x7f762815c6f0 2023-11-28T13:02:25.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.297+0000 7f761f7fe700 1 -- 172.21.15.82:0/3204463479 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7620003c60 con 0x7f762815c6f0 2023-11-28T13:02:25.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.297+0000 7f762ca36700 1 -- 172.21.15.82:0/3204463479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762806a660 con 0x7f762815c6f0 2023-11-28T13:02:25.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.297+0000 7f762ca36700 1 -- 172.21.15.82:0/3204463479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762815cf30 con 0x7f762815c6f0 2023-11-28T13:02:25.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.297+0000 7f761f7fe700 1 -- 172.21.15.82:0/3204463479 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7620010050 con 0x7f762815c6f0 2023-11-28T13:02:25.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.297+0000 7f761f7fe700 1 --2- 172.21.15.82:0/3204463479 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7608064f10 0x7f76080673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:25.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.297+0000 7f761f7fe700 1 -- 172.21.15.82:0/3204463479 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7620081f80 con 0x7f762815c6f0 2023-11-28T13:02:25.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.297+0000 7f7626d9d700 1 --2- 172.21.15.82:0/3204463479 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7608064f10 0x7f76080673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:25.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.301+0000 7f7626d9d700 1 --2- 172.21.15.82:0/3204463479 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7608064f10 0x7f76080673c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f761800ae30 tx=0x7f7618008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:25.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.305+0000 7f761f7fe700 1 -- 172.21.15.82:0/3204463479 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f76200500a0 con 0x7f762815c6f0 2023-11-28T13:02:25.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.529+0000 7f762ca36700 1 -- 172.21.15.82:0/3204463479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f76280cb510 con 0x7f762815c6f0 2023-11-28T13:02:25.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.529+0000 7f761f7fe700 1 -- 172.21.15.82:0/3204463479 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1174 (secure 0 0 0) 0x7f76200536c0 con 0x7f762815c6f0 2023-11-28T13:02:25.534 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:25.534 INFO:teuthology.orchestra.run.smithi082.stdout:{"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":143,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":51,"num_osds":8,"num_up_osds":8,"osd_up_since":1701176413,"num_in_osds":8,"osd_in_since":1701176404,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592698,"bytes_used":76390400,"bytes_avail":773017722880,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":22,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"d","status":"up:active","gid":5814}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-11-28T13:01:23.176112+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-28T13:02:25.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.533+0000 7f762ca36700 1 -- 172.21.15.82:0/3204463479 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7608064f10 msgr2=0x7f76080673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:25.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.533+0000 7f762ca36700 1 --2- 172.21.15.82:0/3204463479 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7608064f10 0x7f76080673c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f761800ae30 tx=0x7f7618008040 comp rx=0 tx=0).stop 2023-11-28T13:02:25.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.533+0000 7f762ca36700 1 -- 172.21.15.82:0/3204463479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762815c6f0 msgr2=0x7f76280c5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:25.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.533+0000 7f762ca36700 1 --2- 172.21.15.82:0/3204463479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762815c6f0 0x7f76280c5e50 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f762000cc50 tx=0x7f762000a340 comp rx=0 tx=0).stop 2023-11-28T13:02:25.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.533+0000 7f762ca36700 1 -- 172.21.15.82:0/3204463479 shutdown_connections 2023-11-28T13:02:25.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.533+0000 7f762ca36700 1 --2- 172.21.15.82:0/3204463479 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7608064f10 0x7f76080673c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:25.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.533+0000 7f762ca36700 1 --2- 172.21.15.82:0/3204463479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762815c6f0 0x7f76280c5e50 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:25.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.533+0000 7f762ca36700 1 --2- 172.21.15.82:0/3204463479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7628158760 0x7f76280b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:25.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.533+0000 7f762ca36700 1 --2- 172.21.15.82:0/3204463479 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76280c93d0 0x7f76280c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:25.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.533+0000 7f762ca36700 1 -- 172.21.15.82:0/3204463479 >> 172.21.15.82:0/3204463479 conn(0x7f76280cb890 msgr2=0x7f762815bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:25.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.533+0000 7f762ca36700 1 -- 172.21.15.82:0/3204463479 shutdown_connections 2023-11-28T13:02:25.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.533+0000 7f762ca36700 1 -- 172.21.15.82:0/3204463479 wait complete. 2023-11-28T13:02:25.549 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T13:02:25.549 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:02:25.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.657+0000 7fe0a8c88700 1 Processor -- start 2023-11-28T13:02:25.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.657+0000 7fe0a8c88700 1 -- start start 2023-11-28T13:02:25.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.657+0000 7fe0a8c88700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a4070070 0x7fe0a4070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:25.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.657+0000 7fe0a8c88700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a4070980 con 0x7fe0a4160900 2023-11-28T13:02:25.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.657+0000 7fe0a8c88700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a40ce030 con 0x7fe0a40c1910 2023-11-28T13:02:25.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.657+0000 7fe0a8c88700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a40ce310 con 0x7fe0a4070070 2023-11-28T13:02:25.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.657+0000 7fe0a2ffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe0a4160900 0x7fe0a40cc1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58848/0 (socket says 172.21.15.82:58848) 2023-11-28T13:02:25.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.657+0000 7fe0a2ffd700 1 -- 172.21.15.82:0/2861671770 learned_addr learned my addr 172.21.15.82:0/2861671770 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:25.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.657+0000 7fe0a37fe700 1 --2- 172.21.15.82:0/2861671770 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a4070070 0x7fe0a4070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:25.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.657+0000 7fe0a27fc700 1 -- 172.21.15.82:0/2861671770 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489350135 0 0) 0x7fe0a4070980 con 0x7fe0a4160900 2023-11-28T13:02:25.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.657+0000 7fe0a27fc700 1 -- 172.21.15.82:0/2861671770 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe08c0035d0 con 0x7fe0a4160900 2023-11-28T13:02:25.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.657+0000 7fe0a37fe700 1 -- 172.21.15.82:0/2861671770 >> v1:172.21.15.114:6789/0 conn(0x7fe0a40c1910 legacy=0x7fe0a406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:25.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.657+0000 7fe0a37fe700 1 -- 172.21.15.82:0/2861671770 >> v1:172.21.15.82:6789/0 conn(0x7fe0a4160900 legacy=0x7fe0a40cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:25.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.657+0000 7fe0a27fc700 1 -- 172.21.15.82:0/2861671770 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3362275219 0 0) 0x7fe08c0035d0 con 0x7fe0a4160900 2023-11-28T13:02:25.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.657+0000 7fe0a37fe700 1 -- 172.21.15.82:0/2861671770 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a406a5d0 con 0x7fe0a4070070 2023-11-28T13:02:25.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.657+0000 7fe0a37fe700 1 --2- 172.21.15.82:0/2861671770 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a4070070 0x7fe0a4070440 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe098009880 tx=0x7fe098009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aede67585b528ed server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:25.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.661+0000 7fe0a27fc700 1 -- 172.21.15.82:0/2861671770 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c0019f0 con 0x7fe0a4070070 2023-11-28T13:02:25.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.661+0000 7fe0a27fc700 1 -- 172.21.15.82:0/2861671770 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe098004030 con 0x7fe0a4070070 2023-11-28T13:02:25.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.661+0000 7fe0a27fc700 1 -- 172.21.15.82:0/2861671770 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980043a0 con 0x7fe0a4070070 2023-11-28T13:02:25.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.661+0000 7fe0a8c88700 1 -- 172.21.15.82:0/2861671770 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a4070070 msgr2=0x7fe0a4070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:25.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.661+0000 7fe0a8c88700 1 --2- 172.21.15.82:0/2861671770 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a4070070 0x7fe0a4070440 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe098009880 tx=0x7fe098009b90 comp rx=0 tx=0).stop 2023-11-28T13:02:25.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.661+0000 7fe0a8c88700 1 -- 172.21.15.82:0/2861671770 shutdown_connections 2023-11-28T13:02:25.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.661+0000 7fe0a8c88700 1 --2- 172.21.15.82:0/2861671770 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a4070070 0x7fe0a4070440 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:25.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.661+0000 7fe0a8c88700 1 -- 172.21.15.82:0/2861671770 >> 172.21.15.82:0/2861671770 conn(0x7fe0a40ce600 msgr2=0x7fe0a40ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:25.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.661+0000 7fe0a8c88700 1 -- 172.21.15.82:0/2861671770 shutdown_connections 2023-11-28T13:02:25.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.661+0000 7fe0a8c88700 1 -- 172.21.15.82:0/2861671770 wait complete. 2023-11-28T13:02:25.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.661+0000 7fe0a8c88700 1 Processor -- start 2023-11-28T13:02:25.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.661+0000 7fe0a8c88700 1 -- start start 2023-11-28T13:02:25.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe0a8c88700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a4070070 0x7fe0a40c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:25.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe0a8c88700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a415c8f0 0x7fe0a41538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:25.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe0a8c88700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0a4160ce0 0x7fe0a40b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:25.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe0a8c88700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a40c87d0 con 0x7fe0a4070070 2023-11-28T13:02:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe0a8c88700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a40c3510 con 0x7fe0a4160ce0 2023-11-28T13:02:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe0a8c88700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a40c37f0 con 0x7fe0a415c8f0 2023-11-28T13:02:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe0a37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a4070070 0x7fe0a40c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe0a37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a4070070 0x7fe0a40c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37434/0 (socket says 172.21.15.82:37434) 2023-11-28T13:02:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe0a37fe700 1 -- 172.21.15.82:0/544707273 learned_addr learned my addr 172.21.15.82:0/544707273 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe0a2ffd700 1 --2- 172.21.15.82:0/544707273 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a415c8f0 0x7fe0a41538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe0a3fff700 1 --2- 172.21.15.82:0/544707273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0a4160ce0 0x7fe0a40b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe0a37fe700 1 -- 172.21.15.82:0/544707273 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a415c8f0 msgr2=0x7fe0a41538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe0a37fe700 1 --2- 172.21.15.82:0/544707273 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a415c8f0 0x7fe0a41538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe0a37fe700 1 -- 172.21.15.82:0/544707273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0a4160ce0 msgr2=0x7fe0a40b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe0a37fe700 1 --2- 172.21.15.82:0/544707273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0a4160ce0 0x7fe0a40b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:25.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe0a37fe700 1 -- 172.21.15.82:0/544707273 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0980094b0 con 0x7fe0a4070070 2023-11-28T13:02:25.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe0a3fff700 1 --2- 172.21.15.82:0/544707273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0a4160ce0 0x7fe0a40b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:02:25.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe0a37fe700 1 --2- 172.21.15.82:0/544707273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a4070070 0x7fe0a40c8290 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe0980090b0 tx=0x7fe098004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:25.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe08bfff700 1 -- 172.21.15.82:0/544707273 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098011830 con 0x7fe0a4070070 2023-11-28T13:02:25.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe08bfff700 1 -- 172.21.15.82:0/544707273 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0980119b0 con 0x7fe0a4070070 2023-11-28T13:02:25.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe0a8c88700 1 -- 172.21.15.82:0/544707273 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a406ab90 con 0x7fe0a4070070 2023-11-28T13:02:25.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe08bfff700 1 -- 172.21.15.82:0/544707273 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098011d60 con 0x7fe0a4070070 2023-11-28T13:02:25.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.665+0000 7fe0a8c88700 1 -- 172.21.15.82:0/544707273 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a406a8b0 con 0x7fe0a4070070 2023-11-28T13:02:25.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.669+0000 7fe08bfff700 1 -- 172.21.15.82:0/544707273 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe09800f050 con 0x7fe0a4070070 2023-11-28T13:02:25.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.669+0000 7fe0a8c88700 1 -- 172.21.15.82:0/544707273 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a40cdc50 con 0x7fe0a4070070 2023-11-28T13:02:25.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.669+0000 7fe08bfff700 1 --2- 172.21.15.82:0/544707273 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe090064ee0 0x7fe090067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:25.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.669+0000 7fe08bfff700 1 -- 172.21.15.82:0/544707273 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe098083390 con 0x7fe0a4070070 2023-11-28T13:02:25.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.669+0000 7fe0a2ffd700 1 --2- 172.21.15.82:0/544707273 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe090064ee0 0x7fe090067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:25.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.669+0000 7fe0a2ffd700 1 --2- 172.21.15.82:0/544707273 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe090064ee0 0x7fe090067390 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe0a415cdf0 tx=0x7fe09c001f80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:25.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.677+0000 7fe08bfff700 1 -- 172.21.15.82:0/544707273 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe098051530 con 0x7fe0a4070070 2023-11-28T13:02:25.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.837+0000 7fe0a8c88700 1 -- 172.21.15.82:0/544707273 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0a4065fc0 con 0x7fe090064ee0 2023-11-28T13:02:25.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.845+0000 7fe08bfff700 1 -- 172.21.15.82:0/544707273 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310067 (secure 0 0 0) 0x7fe0a4065fc0 con 0x7fe090064ee0 2023-11-28T13:02:25.855 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:25.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.853+0000 7fe0a8c88700 1 -- 172.21.15.82:0/544707273 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe090064ee0 msgr2=0x7fe090067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:25.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.853+0000 7fe0a8c88700 1 --2- 172.21.15.82:0/544707273 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe090064ee0 0x7fe090067390 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe0a415cdf0 tx=0x7fe09c001f80 comp rx=0 tx=0).stop 2023-11-28T13:02:25.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.853+0000 7fe0a8c88700 1 -- 172.21.15.82:0/544707273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a4070070 msgr2=0x7fe0a40c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:25.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.853+0000 7fe0a8c88700 1 --2- 172.21.15.82:0/544707273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a4070070 0x7fe0a40c8290 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe0980090b0 tx=0x7fe098004770 comp rx=0 tx=0).stop 2023-11-28T13:02:25.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.853+0000 7fe0a8c88700 1 -- 172.21.15.82:0/544707273 shutdown_connections 2023-11-28T13:02:25.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.853+0000 7fe0a8c88700 1 --2- 172.21.15.82:0/544707273 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe090064ee0 0x7fe090067390 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:25.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.853+0000 7fe0a8c88700 1 --2- 172.21.15.82:0/544707273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0a4160ce0 0x7fe0a40b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:25.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.853+0000 7fe0a8c88700 1 --2- 172.21.15.82:0/544707273 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0a415c8f0 0x7fe0a41538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:25.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.853+0000 7fe0a8c88700 1 --2- 172.21.15.82:0/544707273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a4070070 0x7fe0a40c8290 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:25.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.853+0000 7fe0a8c88700 1 -- 172.21.15.82:0/544707273 >> 172.21.15.82:0/544707273 conn(0x7fe0a40ce600 msgr2=0x7fe0a40ae0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:25.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.853+0000 7fe0a8c88700 1 -- 172.21.15.82:0/544707273 shutdown_connections 2023-11-28T13:02:25.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:25.853+0000 7fe0a8c88700 1 -- 172.21.15.82:0/544707273 wait complete. 2023-11-28T13:02:25.858 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:02:25.868 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-11-28T13:02:25.195214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":74600,"kb_used_data":5928,"kb_used_omap":0,"kb_used_meta":68608,"kb_avail":754900120,"statfs":{"total":773094113280,"available":773017722880,"internally_reserved":0,"allocated":6070272,"data_stored":3259564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":70254592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001797"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.542654+0000","last_change":"2023-11-28T13:02:20.486104+0000","last_active":"2023-11-28T13:02:21.542654+0000","last_peered":"2023-11-28T13:02:21.542654+0000","last_clean":"2023-11-28T13:02:21.542654+0000","last_became_active":"2023-11-28T13:02:20.485856+0000","last_became_peered":"2023-11-28T13:02:20.485856+0000","last_unstale":"2023-11-28T13:02:21.542654+0000","last_undegraded":"2023-11-28T13:02:21.542654+0000","last_fullsized":"2023-11-28T13:02:21.542654+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:15.914562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.479866+0000","last_change":"2023-11-28T13:02:20.482510+0000","last_active":"2023-11-28T13:02:21.479866+0000","last_peered":"2023-11-28T13:02:21.479866+0000","last_clean":"2023-11-28T13:02:21.479866+0000","last_became_active":"2023-11-28T13:02:20.482089+0000","last_became_peered":"2023-11-28T13:02:20.482089+0000","last_unstale":"2023-11-28T13:02:21.479866+0000","last_undegraded":"2023-11-28T13:02:21.479866+0000","last_fullsized":"2023-11-28T13:02:21.479866+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:43:39.177433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930553+0000","last_change":"2023-11-28T13:02:20.491476+0000","last_active":"2023-11-28T13:02:21.930553+0000","last_peered":"2023-11-28T13:02:21.930553+0000","last_clean":"2023-11-28T13:02:21.930553+0000","last_became_active":"2023-11-28T13:02:20.490861+0000","last_became_peered":"2023-11-28T13:02:20.490861+0000","last_unstale":"2023-11-28T13:02:21.930553+0000","last_undegraded":"2023-11-28T13:02:21.930553+0000","last_fullsized":"2023-11-28T13:02:21.930553+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:04.846165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.479047+0000","last_change":"2023-11-28T13:02:20.495760+0000","last_active":"2023-11-28T13:02:21.479047+0000","last_peered":"2023-11-28T13:02:21.479047+0000","last_clean":"2023-11-28T13:02:21.479047+0000","last_became_active":"2023-11-28T13:02:20.495452+0000","last_became_peered":"2023-11-28T13:02:20.495452+0000","last_unstale":"2023-11-28T13:02:21.479047+0000","last_undegraded":"2023-11-28T13:02:21.479047+0000","last_fullsized":"2023-11-28T13:02:21.479047+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:14.899317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.480281+0000","last_change":"2023-11-28T13:02:20.484634+0000","last_active":"2023-11-28T13:02:21.480281+0000","last_peered":"2023-11-28T13:02:21.480281+0000","last_clean":"2023-11-28T13:02:21.480281+0000","last_became_active":"2023-11-28T13:02:20.484335+0000","last_became_peered":"2023-11-28T13:02:20.484335+0000","last_unstale":"2023-11-28T13:02:21.480281+0000","last_undegraded":"2023-11-28T13:02:21.480281+0000","last_fullsized":"2023-11-28T13:02:21.480281+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:56.290302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.542145+0000","last_change":"2023-11-28T13:02:20.487057+0000","last_active":"2023-11-28T13:02:21.542145+0000","last_peered":"2023-11-28T13:02:21.542145+0000","last_clean":"2023-11-28T13:02:21.542145+0000","last_became_active":"2023-11-28T13:02:20.486774+0000","last_became_peered":"2023-11-28T13:02:20.486774+0000","last_unstale":"2023-11-28T13:02:21.542145+0000","last_undegraded":"2023-11-28T13:02:21.542145+0000","last_fullsized":"2023-11-28T13:02:21.542145+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:07:01.971923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.929733+0000","last_change":"2023-11-28T13:02:20.490526+0000","last_active":"2023-11-28T13:02:21.929733+0000","last_peered":"2023-11-28T13:02:21.929733+0000","last_clean":"2023-11-28T13:02:21.929733+0000","last_became_active":"2023-11-28T13:02:20.490260+0000","last_became_peered":"2023-11-28T13:02:20.490260+0000","last_unstale":"2023-11-28T13:02:21.929733+0000","last_undegraded":"2023-11-28T13:02:21.929733+0000","last_fullsized":"2023-11-28T13:02:21.929733+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:07.208164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.627884+0000","last_change":"2023-11-28T13:02:20.479851+0000","last_active":"2023-11-28T13:02:21.627884+0000","last_peered":"2023-11-28T13:02:21.627884+0000","last_clean":"2023-11-28T13:02:21.627884+0000","last_became_active":"2023-11-28T13:02:20.479611+0000","last_became_peered":"2023-11-28T13:02:20.479611+0000","last_unstale":"2023-11-28T13:02:21.627884+0000","last_undegraded":"2023-11-28T13:02:21.627884+0000","last_fullsized":"2023-11-28T13:02:21.627884+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:57:45.588310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.628540+0000","last_change":"2023-11-28T13:02:20.488781+0000","last_active":"2023-11-28T13:02:21.628540+0000","last_peered":"2023-11-28T13:02:21.628540+0000","last_clean":"2023-11-28T13:02:21.628540+0000","last_became_active":"2023-11-28T13:02:20.488527+0000","last_became_peered":"2023-11-28T13:02:20.488527+0000","last_unstale":"2023-11-28T13:02:21.628540+0000","last_undegraded":"2023-11-28T13:02:21.628540+0000","last_fullsized":"2023-11-28T13:02:21.628540+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:26:04.441168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.542581+0000","last_change":"2023-11-28T13:02:20.486433+0000","last_active":"2023-11-28T13:02:21.542581+0000","last_peered":"2023-11-28T13:02:21.542581+0000","last_clean":"2023-11-28T13:02:21.542581+0000","last_became_active":"2023-11-28T13:02:20.486144+0000","last_became_peered":"2023-11-28T13:02:20.486144+0000","last_unstale":"2023-11-28T13:02:21.542581+0000","last_undegraded":"2023-11-28T13:02:21.542581+0000","last_fullsized":"2023-11-28T13:02:21.542581+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:30:55.773025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.478514+0000","last_change":"2023-11-28T13:02:20.493936+0000","last_active":"2023-11-28T13:02:21.478514+0000","last_peered":"2023-11-28T13:02:21.478514+0000","last_clean":"2023-11-28T13:02:21.478514+0000","last_became_active":"2023-11-28T13:02:20.493632+0000","last_became_peered":"2023-11-28T13:02:20.493632+0000","last_unstale":"2023-11-28T13:02:21.478514+0000","last_undegraded":"2023-11-28T13:02:21.478514+0000","last_fullsized":"2023-11-28T13:02:21.478514+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:46.046956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.628435+0000","last_change":"2023-11-28T13:02:20.478090+0000","last_active":"2023-11-28T13:02:21.628435+0000","last_peered":"2023-11-28T13:02:21.628435+0000","last_clean":"2023-11-28T13:02:21.628435+0000","last_became_active":"2023-11-28T13:02:20.477827+0000","last_became_peered":"2023-11-28T13:02:20.477827+0000","last_unstale":"2023-11-28T13:02:21.628435+0000","last_undegraded":"2023-11-28T13:02:21.628435+0000","last_fullsized":"2023-11-28T13:02:21.628435+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:12.276000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.542574+0000","last_change":"2023-11-28T13:02:20.485991+0000","last_active":"2023-11-28T13:02:21.542574+0000","last_peered":"2023-11-28T13:02:21.542574+0000","last_clean":"2023-11-28T13:02:21.542574+0000","last_became_active":"2023-11-28T13:02:20.485735+0000","last_became_peered":"2023-11-28T13:02:20.485735+0000","last_unstale":"2023-11-28T13:02:21.542574+0000","last_undegraded":"2023-11-28T13:02:21.542574+0000","last_fullsized":"2023-11-28T13:02:21.542574+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:10.889203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930040+0000","last_change":"2023-11-28T13:02:20.486467+0000","last_active":"2023-11-28T13:02:21.930040+0000","last_peered":"2023-11-28T13:02:21.930040+0000","last_clean":"2023-11-28T13:02:21.930040+0000","last_became_active":"2023-11-28T13:02:20.486130+0000","last_became_peered":"2023-11-28T13:02:20.486130+0000","last_unstale":"2023-11-28T13:02:21.930040+0000","last_undegraded":"2023-11-28T13:02:21.930040+0000","last_fullsized":"2023-11-28T13:02:21.930040+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:35.993824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.478908+0000","last_change":"2023-11-28T13:02:20.482083+0000","last_active":"2023-11-28T13:02:21.478908+0000","last_peered":"2023-11-28T13:02:21.478908+0000","last_clean":"2023-11-28T13:02:21.478908+0000","last_became_active":"2023-11-28T13:02:20.481794+0000","last_became_peered":"2023-11-28T13:02:20.481794+0000","last_unstale":"2023-11-28T13:02:21.478908+0000","last_undegraded":"2023-11-28T13:02:21.478908+0000","last_fullsized":"2023-11-28T13:02:21.478908+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:58.879685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.542000+0000","last_change":"2023-11-28T13:02:20.486293+0000","last_active":"2023-11-28T13:02:21.542000+0000","last_peered":"2023-11-28T13:02:21.542000+0000","last_clean":"2023-11-28T13:02:21.542000+0000","last_became_active":"2023-11-28T13:02:20.485544+0000","last_became_peered":"2023-11-28T13:02:20.485544+0000","last_unstale":"2023-11-28T13:02:21.542000+0000","last_undegraded":"2023-11-28T13:02:21.542000+0000","last_fullsized":"2023-11-28T13:02:21.542000+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:15:57.255807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930805+0000","last_change":"2023-11-28T13:02:20.487538+0000","last_active":"2023-11-28T13:02:21.930805+0000","last_peered":"2023-11-28T13:02:21.930805+0000","last_clean":"2023-11-28T13:02:21.930805+0000","last_became_active":"2023-11-28T13:02:20.487292+0000","last_became_peered":"2023-11-28T13:02:20.487292+0000","last_unstale":"2023-11-28T13:02:21.930805+0000","last_undegraded":"2023-11-28T13:02:21.930805+0000","last_fullsized":"2023-11-28T13:02:21.930805+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:46:45.783765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.479908+0000","last_change":"2023-11-28T13:02:20.487859+0000","last_active":"2023-11-28T13:02:21.479908+0000","last_peered":"2023-11-28T13:02:21.479908+0000","last_clean":"2023-11-28T13:02:21.479908+0000","last_became_active":"2023-11-28T13:02:20.486314+0000","last_became_peered":"2023-11-28T13:02:20.486314+0000","last_unstale":"2023-11-28T13:02:21.479908+0000","last_undegraded":"2023-11-28T13:02:21.479908+0000","last_fullsized":"2023-11-28T13:02:21.479908+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:37:29.772655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930579+0000","last_change":"2023-11-28T13:02:20.491129+0000","last_active":"2023-11-28T13:02:21.930579+0000","last_peered":"2023-11-28T13:02:21.930579+0000","last_clean":"2023-11-28T13:02:21.930579+0000","last_became_active":"2023-11-28T13:02:20.488097+0000","last_became_peered":"2023-11-28T13:02:20.488097+0000","last_unstale":"2023-11-28T13:02:21.930579+0000","last_undegraded":"2023-11-28T13:02:21.930579+0000","last_fullsized":"2023-11-28T13:02:21.930579+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:46:00.288275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930963+0000","last_change":"2023-11-28T13:02:20.486860+0000","last_active":"2023-11-28T13:02:21.930963+0000","last_peered":"2023-11-28T13:02:21.930963+0000","last_clean":"2023-11-28T13:02:21.930963+0000","last_became_active":"2023-11-28T13:02:20.486511+0000","last_became_peered":"2023-11-28T13:02:20.486511+0000","last_unstale":"2023-11-28T13:02:21.930963+0000","last_undegraded":"2023-11-28T13:02:21.930963+0000","last_fullsized":"2023-11-28T13:02:21.930963+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:19:37.170900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930406+0000","last_change":"2023-11-28T13:02:20.483448+0000","last_active":"2023-11-28T13:02:21.930406+0000","last_peered":"2023-11-28T13:02:21.930406+0000","last_clean":"2023-11-28T13:02:21.930406+0000","last_became_active":"2023-11-28T13:02:20.482833+0000","last_became_peered":"2023-11-28T13:02:20.482833+0000","last_unstale":"2023-11-28T13:02:21.930406+0000","last_undegraded":"2023-11-28T13:02:21.930406+0000","last_fullsized":"2023-11-28T13:02:21.930406+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:18.202627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.627987+0000","last_change":"2023-11-28T13:02:20.482191+0000","last_active":"2023-11-28T13:02:21.627987+0000","last_peered":"2023-11-28T13:02:21.627987+0000","last_clean":"2023-11-28T13:02:21.627987+0000","last_became_active":"2023-11-28T13:02:20.481872+0000","last_became_peered":"2023-11-28T13:02:20.481872+0000","last_unstale":"2023-11-28T13:02:21.627987+0000","last_undegraded":"2023-11-28T13:02:21.627987+0000","last_fullsized":"2023-11-28T13:02:21.627987+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:54.660349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.477943+0000","last_change":"2023-11-28T13:02:20.493950+0000","last_active":"2023-11-28T13:02:21.477943+0000","last_peered":"2023-11-28T13:02:21.477943+0000","last_clean":"2023-11-28T13:02:21.477943+0000","last_became_active":"2023-11-28T13:02:20.493627+0000","last_became_peered":"2023-11-28T13:02:20.493627+0000","last_unstale":"2023-11-28T13:02:21.477943+0000","last_undegraded":"2023-11-28T13:02:21.477943+0000","last_fullsized":"2023-11-28T13:02:21.477943+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:32.942792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.929505+0000","last_change":"2023-11-28T13:02:20.486502+0000","last_active":"2023-11-28T13:02:21.929505+0000","last_peered":"2023-11-28T13:02:21.929505+0000","last_clean":"2023-11-28T13:02:21.929505+0000","last_became_active":"2023-11-28T13:02:20.486220+0000","last_became_peered":"2023-11-28T13:02:20.486220+0000","last_unstale":"2023-11-28T13:02:21.929505+0000","last_undegraded":"2023-11-28T13:02:21.929505+0000","last_fullsized":"2023-11-28T13:02:21.929505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:50.016629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.931291+0000","last_change":"2023-11-28T13:02:20.497629+0000","last_active":"2023-11-28T13:02:21.931291+0000","last_peered":"2023-11-28T13:02:21.931291+0000","last_clean":"2023-11-28T13:02:21.931291+0000","last_became_active":"2023-11-28T13:02:20.497358+0000","last_became_peered":"2023-11-28T13:02:20.497358+0000","last_unstale":"2023-11-28T13:02:21.931291+0000","last_undegraded":"2023-11-28T13:02:21.931291+0000","last_fullsized":"2023-11-28T13:02:21.931291+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:12.049704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.628327+0000","last_change":"2023-11-28T13:02:20.490716+0000","last_active":"2023-11-28T13:02:21.628327+0000","last_peered":"2023-11-28T13:02:21.628327+0000","last_clean":"2023-11-28T13:02:21.628327+0000","last_became_active":"2023-11-28T13:02:20.490210+0000","last_became_peered":"2023-11-28T13:02:20.490210+0000","last_unstale":"2023-11-28T13:02:21.628327+0000","last_undegraded":"2023-11-28T13:02:21.628327+0000","last_fullsized":"2023-11-28T13:02:21.628327+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:29:36.605472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.542913+0000","last_change":"2023-11-28T13:02:20.487186+0000","last_active":"2023-11-28T13:02:21.542913+0000","last_peered":"2023-11-28T13:02:21.542913+0000","last_clean":"2023-11-28T13:02:21.542913+0000","last_became_active":"2023-11-28T13:02:20.486733+0000","last_became_peered":"2023-11-28T13:02:20.486733+0000","last_unstale":"2023-11-28T13:02:21.542913+0000","last_undegraded":"2023-11-28T13:02:21.542913+0000","last_fullsized":"2023-11-28T13:02:21.542913+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:33.321509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.931199+0000","last_change":"2023-11-28T13:02:20.479504+0000","last_active":"2023-11-28T13:02:21.931199+0000","last_peered":"2023-11-28T13:02:21.931199+0000","last_clean":"2023-11-28T13:02:21.931199+0000","last_became_active":"2023-11-28T13:02:20.479202+0000","last_became_peered":"2023-11-28T13:02:20.479202+0000","last_unstale":"2023-11-28T13:02:21.931199+0000","last_undegraded":"2023-11-28T13:02:21.931199+0000","last_fullsized":"2023-11-28T13:02:21.931199+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:13:52.276112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930068+0000","last_change":"2023-11-28T13:02:20.487430+0000","last_active":"2023-11-28T13:02:21.930068+0000","last_peered":"2023-11-28T13:02:21.930068+0000","last_clean":"2023-11-28T13:02:21.930068+0000","last_became_active":"2023-11-28T13:02:20.487161+0000","last_became_peered":"2023-11-28T13:02:20.487161+0000","last_unstale":"2023-11-28T13:02:21.930068+0000","last_undegraded":"2023-11-28T13:02:21.930068+0000","last_fullsized":"2023-11-28T13:02:21.930068+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:26:04.441168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.479168+0000","last_change":"2023-11-28T13:02:20.488234+0000","last_active":"2023-11-28T13:02:21.479168+0000","last_peered":"2023-11-28T13:02:21.479168+0000","last_clean":"2023-11-28T13:02:21.479168+0000","last_became_active":"2023-11-28T13:02:20.487819+0000","last_became_peered":"2023-11-28T13:02:20.487819+0000","last_unstale":"2023-11-28T13:02:21.479168+0000","last_undegraded":"2023-11-28T13:02:21.479168+0000","last_fullsized":"2023-11-28T13:02:21.479168+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:03:57.222909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.929833+0000","last_change":"2023-11-28T13:02:20.482478+0000","last_active":"2023-11-28T13:02:21.929833+0000","last_peered":"2023-11-28T13:02:21.929833+0000","last_clean":"2023-11-28T13:02:21.929833+0000","last_became_active":"2023-11-28T13:02:20.482209+0000","last_became_peered":"2023-11-28T13:02:20.482209+0000","last_unstale":"2023-11-28T13:02:21.929833+0000","last_undegraded":"2023-11-28T13:02:21.929833+0000","last_fullsized":"2023-11-28T13:02:21.929833+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:43:13.793803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.929653+0000","last_change":"2023-11-28T13:02:20.496749+0000","last_active":"2023-11-28T13:02:21.929653+0000","last_peered":"2023-11-28T13:02:21.929653+0000","last_clean":"2023-11-28T13:02:21.929653+0000","last_became_active":"2023-11-28T13:02:20.496498+0000","last_became_peered":"2023-11-28T13:02:20.496498+0000","last_unstale":"2023-11-28T13:02:21.929653+0000","last_undegraded":"2023-11-28T13:02:21.929653+0000","last_fullsized":"2023-11-28T13:02:21.929653+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:26.009180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.478612+0000","last_change":"2023-11-28T13:02:20.487736+0000","last_active":"2023-11-28T13:02:21.478612+0000","last_peered":"2023-11-28T13:02:21.478612+0000","last_clean":"2023-11-28T13:02:21.478612+0000","last_became_active":"2023-11-28T13:02:20.485509+0000","last_became_peered":"2023-11-28T13:02:20.485509+0000","last_unstale":"2023-11-28T13:02:21.478612+0000","last_undegraded":"2023-11-28T13:02:21.478612+0000","last_fullsized":"2023-11-28T13:02:21.478612+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:44:43.901562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.483882+0000","last_change":"2023-11-28T13:02:20.097519+0000","last_active":"2023-11-28T13:02:20.483882+0000","last_peered":"2023-11-28T13:02:20.483882+0000","last_clean":"2023-11-28T13:02:20.483882+0000","last_became_active":"2023-11-28T13:02:20.097217+0000","last_became_peered":"2023-11-28T13:02:20.097217+0000","last_unstale":"2023-11-28T13:02:20.483882+0000","last_undegraded":"2023-11-28T13:02:20.483882+0000","last_fullsized":"2023-11-28T13:02:20.483882+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:12.209141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.929578+0000","last_change":"2023-11-28T13:02:20.492125+0000","last_active":"2023-11-28T13:02:21.929578+0000","last_peered":"2023-11-28T13:02:21.929578+0000","last_clean":"2023-11-28T13:02:21.929578+0000","last_became_active":"2023-11-28T13:02:20.491809+0000","last_became_peered":"2023-11-28T13:02:20.491809+0000","last_unstale":"2023-11-28T13:02:21.929578+0000","last_undegraded":"2023-11-28T13:02:21.929578+0000","last_fullsized":"2023-11-28T13:02:21.929578+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:58.879685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.497807+0000","last_change":"2023-11-28T13:02:20.106059+0000","last_active":"2023-11-28T13:02:20.497807+0000","last_peered":"2023-11-28T13:02:20.497807+0000","last_clean":"2023-11-28T13:02:20.497807+0000","last_became_active":"2023-11-28T13:02:20.105774+0000","last_became_peered":"2023-11-28T13:02:20.105774+0000","last_unstale":"2023-11-28T13:02:20.497807+0000","last_undegraded":"2023-11-28T13:02:20.497807+0000","last_fullsized":"2023-11-28T13:02:20.497807+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:19.032803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.929640+0000","last_change":"2023-11-28T13:02:20.483418+0000","last_active":"2023-11-28T13:02:21.929640+0000","last_peered":"2023-11-28T13:02:21.929640+0000","last_clean":"2023-11-28T13:02:21.929640+0000","last_became_active":"2023-11-28T13:02:20.482896+0000","last_became_peered":"2023-11-28T13:02:20.482896+0000","last_unstale":"2023-11-28T13:02:21.929640+0000","last_undegraded":"2023-11-28T13:02:21.929640+0000","last_fullsized":"2023-11-28T13:02:21.929640+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:34:42.393542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.487496+0000","last_change":"2023-11-28T13:02:20.102685+0000","last_active":"2023-11-28T13:02:20.487496+0000","last_peered":"2023-11-28T13:02:20.487496+0000","last_clean":"2023-11-28T13:02:20.487496+0000","last_became_active":"2023-11-28T13:02:20.102498+0000","last_became_peered":"2023-11-28T13:02:20.102498+0000","last_unstale":"2023-11-28T13:02:20.487496+0000","last_undegraded":"2023-11-28T13:02:20.487496+0000","last_fullsized":"2023-11-28T13:02:20.487496+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:24.782403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.628053+0000","last_change":"2023-11-28T13:02:20.482127+0000","last_active":"2023-11-28T13:02:21.628053+0000","last_peered":"2023-11-28T13:02:21.628053+0000","last_clean":"2023-11-28T13:02:21.628053+0000","last_became_active":"2023-11-28T13:02:20.481817+0000","last_became_peered":"2023-11-28T13:02:20.481817+0000","last_unstale":"2023-11-28T13:02:21.628053+0000","last_undegraded":"2023-11-28T13:02:21.628053+0000","last_fullsized":"2023-11-28T13:02:21.628053+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:46:45.783765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.496742+0000","last_change":"2023-11-28T13:02:20.104723+0000","last_active":"2023-11-28T13:02:20.496742+0000","last_peered":"2023-11-28T13:02:20.496742+0000","last_clean":"2023-11-28T13:02:20.496742+0000","last_became_active":"2023-11-28T13:02:20.104416+0000","last_became_peered":"2023-11-28T13:02:20.104416+0000","last_unstale":"2023-11-28T13:02:20.496742+0000","last_undegraded":"2023-11-28T13:02:20.496742+0000","last_fullsized":"2023-11-28T13:02:20.496742+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:14.909436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.480203+0000","last_change":"2023-11-28T13:02:20.485128+0000","last_active":"2023-11-28T13:02:21.480203+0000","last_peered":"2023-11-28T13:02:21.480203+0000","last_clean":"2023-11-28T13:02:21.480203+0000","last_became_active":"2023-11-28T13:02:20.484810+0000","last_became_peered":"2023-11-28T13:02:20.484810+0000","last_unstale":"2023-11-28T13:02:21.480203+0000","last_undegraded":"2023-11-28T13:02:21.480203+0000","last_fullsized":"2023-11-28T13:02:21.480203+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:14.899317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.487985+0000","last_change":"2023-11-28T13:02:20.103735+0000","last_active":"2023-11-28T13:02:20.487985+0000","last_peered":"2023-11-28T13:02:20.487985+0000","last_clean":"2023-11-28T13:02:20.487985+0000","last_became_active":"2023-11-28T13:02:20.103445+0000","last_became_peered":"2023-11-28T13:02:20.103445+0000","last_unstale":"2023-11-28T13:02:20.487985+0000","last_undegraded":"2023-11-28T13:02:20.487985+0000","last_fullsized":"2023-11-28T13:02:20.487985+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:47.914711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.479325+0000","last_change":"2023-11-28T13:02:20.488147+0000","last_active":"2023-11-28T13:02:21.479325+0000","last_peered":"2023-11-28T13:02:21.479325+0000","last_clean":"2023-11-28T13:02:21.479325+0000","last_became_active":"2023-11-28T13:02:20.487310+0000","last_became_peered":"2023-11-28T13:02:20.487310+0000","last_unstale":"2023-11-28T13:02:21.479325+0000","last_undegraded":"2023-11-28T13:02:21.479325+0000","last_fullsized":"2023-11-28T13:02:21.479325+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:42.036693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.479420+0000","last_change":"2023-11-28T13:02:20.100899+0000","last_active":"2023-11-28T13:02:20.479420+0000","last_peered":"2023-11-28T13:02:20.479420+0000","last_clean":"2023-11-28T13:02:20.479420+0000","last_became_active":"2023-11-28T13:02:20.100613+0000","last_became_peered":"2023-11-28T13:02:20.100613+0000","last_unstale":"2023-11-28T13:02:20.479420+0000","last_undegraded":"2023-11-28T13:02:20.479420+0000","last_fullsized":"2023-11-28T13:02:20.479420+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:19.257824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.628742+0000","last_change":"2023-11-28T13:02:20.490879+0000","last_active":"2023-11-28T13:02:21.628742+0000","last_peered":"2023-11-28T13:02:21.628742+0000","last_clean":"2023-11-28T13:02:21.628742+0000","last_became_active":"2023-11-28T13:02:20.490524+0000","last_became_peered":"2023-11-28T13:02:20.490524+0000","last_unstale":"2023-11-28T13:02:21.628742+0000","last_undegraded":"2023-11-28T13:02:21.628742+0000","last_fullsized":"2023-11-28T13:02:21.628742+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:46:00.288275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.471438+0000","last_change":"2023-11-28T13:02:20.097706+0000","last_active":"2023-11-28T13:02:20.471438+0000","last_peered":"2023-11-28T13:02:20.471438+0000","last_clean":"2023-11-28T13:02:20.471438+0000","last_became_active":"2023-11-28T13:02:20.097439+0000","last_became_peered":"2023-11-28T13:02:20.097439+0000","last_unstale":"2023-11-28T13:02:20.471438+0000","last_undegraded":"2023-11-28T13:02:20.471438+0000","last_fullsized":"2023-11-28T13:02:20.471438+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:55:18.096845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.479758+0000","last_change":"2023-11-28T13:02:20.482634+0000","last_active":"2023-11-28T13:02:21.479758+0000","last_peered":"2023-11-28T13:02:21.479758+0000","last_clean":"2023-11-28T13:02:21.479758+0000","last_became_active":"2023-11-28T13:02:20.482245+0000","last_became_peered":"2023-11-28T13:02:20.482245+0000","last_unstale":"2023-11-28T13:02:21.479758+0000","last_undegraded":"2023-11-28T13:02:21.479758+0000","last_fullsized":"2023-11-28T13:02:21.479758+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:28:46.196825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.478803+0000","last_change":"2023-11-28T13:02:20.098506+0000","last_active":"2023-11-28T13:02:20.478803+0000","last_peered":"2023-11-28T13:02:20.478803+0000","last_clean":"2023-11-28T13:02:20.478803+0000","last_became_active":"2023-11-28T13:02:20.098104+0000","last_became_peered":"2023-11-28T13:02:20.098104+0000","last_unstale":"2023-11-28T13:02:20.478803+0000","last_undegraded":"2023-11-28T13:02:20.478803+0000","last_fullsized":"2023-11-28T13:02:20.478803+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:07:00.966797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.479463+0000","last_change":"2023-11-28T13:02:20.490770+0000","last_active":"2023-11-28T13:02:21.479463+0000","last_peered":"2023-11-28T13:02:21.479463+0000","last_clean":"2023-11-28T13:02:21.479463+0000","last_became_active":"2023-11-28T13:02:20.490418+0000","last_became_peered":"2023-11-28T13:02:20.490418+0000","last_unstale":"2023-11-28T13:02:21.479463+0000","last_undegraded":"2023-11-28T13:02:21.479463+0000","last_fullsized":"2023-11-28T13:02:21.479463+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:28:46.196825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.472947+0000","last_change":"2023-11-28T13:02:20.097662+0000","last_active":"2023-11-28T13:02:20.472947+0000","last_peered":"2023-11-28T13:02:20.472947+0000","last_clean":"2023-11-28T13:02:20.472947+0000","last_became_active":"2023-11-28T13:02:20.097360+0000","last_became_peered":"2023-11-28T13:02:20.097360+0000","last_unstale":"2023-11-28T13:02:20.472947+0000","last_undegraded":"2023-11-28T13:02:20.472947+0000","last_fullsized":"2023-11-28T13:02:20.472947+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:47.491241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.929745+0000","last_change":"2023-11-28T13:02:20.481622+0000","last_active":"2023-11-28T13:02:21.929745+0000","last_peered":"2023-11-28T13:02:21.929745+0000","last_clean":"2023-11-28T13:02:21.929745+0000","last_became_active":"2023-11-28T13:02:20.481372+0000","last_became_peered":"2023-11-28T13:02:20.481372+0000","last_unstale":"2023-11-28T13:02:21.929745+0000","last_undegraded":"2023-11-28T13:02:21.929745+0000","last_fullsized":"2023-11-28T13:02:21.929745+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:44:43.901562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.469727+0000","last_change":"2023-11-28T13:02:20.094157+0000","last_active":"2023-11-28T13:02:20.469727+0000","last_peered":"2023-11-28T13:02:20.469727+0000","last_clean":"2023-11-28T13:02:20.469727+0000","last_became_active":"2023-11-28T13:02:20.093826+0000","last_became_peered":"2023-11-28T13:02:20.093826+0000","last_unstale":"2023-11-28T13:02:20.469727+0000","last_undegraded":"2023-11-28T13:02:20.469727+0000","last_fullsized":"2023-11-28T13:02:20.469727+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:33:36.451705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930127+0000","last_change":"2023-11-28T13:02:20.482901+0000","last_active":"2023-11-28T13:02:21.930127+0000","last_peered":"2023-11-28T13:02:21.930127+0000","last_clean":"2023-11-28T13:02:21.930127+0000","last_became_active":"2023-11-28T13:02:20.482661+0000","last_became_peered":"2023-11-28T13:02:20.482661+0000","last_unstale":"2023-11-28T13:02:21.930127+0000","last_undegraded":"2023-11-28T13:02:21.930127+0000","last_fullsized":"2023-11-28T13:02:21.930127+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:12.276000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.487443+0000","last_change":"2023-11-28T13:02:20.103164+0000","last_active":"2023-11-28T13:02:20.487443+0000","last_peered":"2023-11-28T13:02:20.487443+0000","last_clean":"2023-11-28T13:02:20.487443+0000","last_became_active":"2023-11-28T13:02:20.102765+0000","last_became_peered":"2023-11-28T13:02:20.102765+0000","last_unstale":"2023-11-28T13:02:20.487443+0000","last_undegraded":"2023-11-28T13:02:20.487443+0000","last_fullsized":"2023-11-28T13:02:20.487443+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:54.789622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.480113+0000","last_change":"2023-11-28T13:02:20.481286+0000","last_active":"2023-11-28T13:02:21.480113+0000","last_peered":"2023-11-28T13:02:21.480113+0000","last_clean":"2023-11-28T13:02:21.480113+0000","last_became_active":"2023-11-28T13:02:20.480771+0000","last_became_peered":"2023-11-28T13:02:20.480771+0000","last_unstale":"2023-11-28T13:02:21.480113+0000","last_undegraded":"2023-11-28T13:02:21.480113+0000","last_fullsized":"2023-11-28T13:02:21.480113+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:43:39.177433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.499168+0000","last_change":"2023-11-28T13:02:20.103851+0000","last_active":"2023-11-28T13:02:20.499168+0000","last_peered":"2023-11-28T13:02:20.499168+0000","last_clean":"2023-11-28T13:02:20.499168+0000","last_became_active":"2023-11-28T13:02:20.103578+0000","last_became_peered":"2023-11-28T13:02:20.103578+0000","last_unstale":"2023-11-28T13:02:20.499168+0000","last_undegraded":"2023-11-28T13:02:20.499168+0000","last_fullsized":"2023-11-28T13:02:20.499168+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:47.914711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930291+0000","last_change":"2023-11-28T13:02:20.492538+0000","last_active":"2023-11-28T13:02:21.930291+0000","last_peered":"2023-11-28T13:02:21.930291+0000","last_clean":"2023-11-28T13:02:21.930291+0000","last_became_active":"2023-11-28T13:02:20.491849+0000","last_became_peered":"2023-11-28T13:02:20.491849+0000","last_unstale":"2023-11-28T13:02:21.930291+0000","last_undegraded":"2023-11-28T13:02:21.930291+0000","last_fullsized":"2023-11-28T13:02:21.930291+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:37:29.772655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.492620+0000","last_change":"2023-11-28T13:02:20.094131+0000","last_active":"2023-11-28T13:02:20.492620+0000","last_peered":"2023-11-28T13:02:20.492620+0000","last_clean":"2023-11-28T13:02:20.492620+0000","last_became_active":"2023-11-28T13:02:20.093677+0000","last_became_peered":"2023-11-28T13:02:20.093677+0000","last_unstale":"2023-11-28T13:02:20.492620+0000","last_undegraded":"2023-11-28T13:02:20.492620+0000","last_fullsized":"2023-11-28T13:02:20.492620+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:14.909436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930834+0000","last_change":"2023-11-28T13:02:20.491326+0000","last_active":"2023-11-28T13:02:21.930834+0000","last_peered":"2023-11-28T13:02:21.930834+0000","last_clean":"2023-11-28T13:02:21.930834+0000","last_became_active":"2023-11-28T13:02:20.488372+0000","last_became_peered":"2023-11-28T13:02:20.488372+0000","last_unstale":"2023-11-28T13:02:21.930834+0000","last_undegraded":"2023-11-28T13:02:21.930834+0000","last_fullsized":"2023-11-28T13:02:21.930834+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:29:36.605472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.471902+0000","last_change":"2023-11-28T13:02:20.108552+0000","last_active":"2023-11-28T13:02:20.471902+0000","last_peered":"2023-11-28T13:02:20.471902+0000","last_clean":"2023-11-28T13:02:20.471902+0000","last_became_active":"2023-11-28T13:02:20.108180+0000","last_became_peered":"2023-11-28T13:02:20.108180+0000","last_unstale":"2023-11-28T13:02:20.471902+0000","last_undegraded":"2023-11-28T13:02:20.471902+0000","last_fullsized":"2023-11-28T13:02:20.471902+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:31.937666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.628557+0000","last_change":"2023-11-28T13:02:20.491060+0000","last_active":"2023-11-28T13:02:21.628557+0000","last_peered":"2023-11-28T13:02:21.628557+0000","last_clean":"2023-11-28T13:02:21.628557+0000","last_became_active":"2023-11-28T13:02:20.490815+0000","last_became_peered":"2023-11-28T13:02:20.490815+0000","last_unstale":"2023-11-28T13:02:21.628557+0000","last_undegraded":"2023-11-28T13:02:21.628557+0000","last_fullsized":"2023-11-28T13:02:21.628557+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:04:19.965382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.470062+0000","last_change":"2023-11-28T13:02:20.100521+0000","last_active":"2023-11-28T13:02:20.470062+0000","last_peered":"2023-11-28T13:02:20.470062+0000","last_clean":"2023-11-28T13:02:20.470062+0000","last_became_active":"2023-11-28T13:02:20.100173+0000","last_became_peered":"2023-11-28T13:02:20.100173+0000","last_unstale":"2023-11-28T13:02:20.470062+0000","last_undegraded":"2023-11-28T13:02:20.470062+0000","last_fullsized":"2023-11-28T13:02:20.470062+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:37.011377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.931119+0000","last_change":"2023-11-28T13:02:20.486512+0000","last_active":"2023-11-28T13:02:21.931119+0000","last_peered":"2023-11-28T13:02:21.931119+0000","last_clean":"2023-11-28T13:02:21.931119+0000","last_became_active":"2023-11-28T13:02:20.486161+0000","last_became_peered":"2023-11-28T13:02:20.486161+0000","last_unstale":"2023-11-28T13:02:21.931119+0000","last_undegraded":"2023-11-28T13:02:21.931119+0000","last_fullsized":"2023-11-28T13:02:21.931119+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:54.660349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.496415+0000","last_change":"2023-11-28T13:02:20.103804+0000","last_active":"2023-11-28T13:02:20.496415+0000","last_peered":"2023-11-28T13:02:20.496415+0000","last_clean":"2023-11-28T13:02:20.496415+0000","last_became_active":"2023-11-28T13:02:20.103068+0000","last_became_peered":"2023-11-28T13:02:20.103068+0000","last_unstale":"2023-11-28T13:02:20.496415+0000","last_undegraded":"2023-11-28T13:02:20.496415+0000","last_fullsized":"2023-11-28T13:02:20.496415+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:55.285175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.628357+0000","last_change":"2023-11-28T13:02:20.490605+0000","last_active":"2023-11-28T13:02:21.628357+0000","last_peered":"2023-11-28T13:02:21.628357+0000","last_clean":"2023-11-28T13:02:21.628357+0000","last_became_active":"2023-11-28T13:02:20.490245+0000","last_became_peered":"2023-11-28T13:02:20.490245+0000","last_unstale":"2023-11-28T13:02:21.628357+0000","last_undegraded":"2023-11-28T13:02:21.628357+0000","last_fullsized":"2023-11-28T13:02:21.628357+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:39:27.639303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.497369+0000","last_change":"2023-11-28T13:02:20.105396+0000","last_active":"2023-11-28T13:02:20.497369+0000","last_peered":"2023-11-28T13:02:20.497369+0000","last_clean":"2023-11-28T13:02:20.497369+0000","last_became_active":"2023-11-28T13:02:20.105115+0000","last_became_peered":"2023-11-28T13:02:20.105115+0000","last_unstale":"2023-11-28T13:02:20.497369+0000","last_undegraded":"2023-11-28T13:02:20.497369+0000","last_fullsized":"2023-11-28T13:02:20.497369+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:15:56.250681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.542045+0000","last_change":"2023-11-28T13:02:20.482763+0000","last_active":"2023-11-28T13:02:21.542045+0000","last_peered":"2023-11-28T13:02:21.542045+0000","last_clean":"2023-11-28T13:02:21.542045+0000","last_became_active":"2023-11-28T13:02:20.482549+0000","last_became_peered":"2023-11-28T13:02:20.482549+0000","last_unstale":"2023-11-28T13:02:21.542045+0000","last_undegraded":"2023-11-28T13:02:21.542045+0000","last_fullsized":"2023-11-28T13:02:21.542045+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:56.290302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.491539+0000","last_change":"2023-11-28T13:02:20.102513+0000","last_active":"2023-11-28T13:02:20.491539+0000","last_peered":"2023-11-28T13:02:20.491539+0000","last_clean":"2023-11-28T13:02:20.491539+0000","last_became_active":"2023-11-28T13:02:20.102256+0000","last_became_peered":"2023-11-28T13:02:20.102256+0000","last_unstale":"2023-11-28T13:02:20.491539+0000","last_undegraded":"2023-11-28T13:02:20.491539+0000","last_fullsized":"2023-11-28T13:02:20.491539+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:56:09.688582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.479557+0000","last_change":"2023-11-28T13:02:20.485072+0000","last_active":"2023-11-28T13:02:21.479557+0000","last_peered":"2023-11-28T13:02:21.479557+0000","last_clean":"2023-11-28T13:02:21.479557+0000","last_became_active":"2023-11-28T13:02:20.483997+0000","last_became_peered":"2023-11-28T13:02:20.483997+0000","last_unstale":"2023-11-28T13:02:21.479557+0000","last_undegraded":"2023-11-28T13:02:21.479557+0000","last_fullsized":"2023-11-28T13:02:21.479557+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:37:29.772655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.487275+0000","last_change":"2023-11-28T13:02:20.107738+0000","last_active":"2023-11-28T13:02:20.487275+0000","last_peered":"2023-11-28T13:02:20.487275+0000","last_clean":"2023-11-28T13:02:20.487275+0000","last_became_active":"2023-11-28T13:02:20.107480+0000","last_became_peered":"2023-11-28T13:02:20.107480+0000","last_unstale":"2023-11-28T13:02:20.487275+0000","last_undegraded":"2023-11-28T13:02:20.487275+0000","last_fullsized":"2023-11-28T13:02:20.487275+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:24:50.411915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.542330+0000","last_change":"2023-11-28T13:02:20.486597+0000","last_active":"2023-11-28T13:02:21.542330+0000","last_peered":"2023-11-28T13:02:21.542330+0000","last_clean":"2023-11-28T13:02:21.542330+0000","last_became_active":"2023-11-28T13:02:20.485110+0000","last_became_peered":"2023-11-28T13:02:20.485110+0000","last_unstale":"2023-11-28T13:02:21.542330+0000","last_undegraded":"2023-11-28T13:02:21.542330+0000","last_fullsized":"2023-11-28T13:02:21.542330+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:33:37.456831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.472779+0000","last_change":"2023-11-28T13:02:20.100922+0000","last_active":"2023-11-28T13:02:20.472779+0000","last_peered":"2023-11-28T13:02:20.472779+0000","last_clean":"2023-11-28T13:02:20.472779+0000","last_became_active":"2023-11-28T13:02:20.100519+0000","last_became_peered":"2023-11-28T13:02:20.100519+0000","last_unstale":"2023-11-28T13:02:20.472779+0000","last_undegraded":"2023-11-28T13:02:20.472779+0000","last_fullsized":"2023-11-28T13:02:20.472779+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:45.041829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930512+0000","last_change":"2023-11-28T13:02:20.487025+0000","last_active":"2023-11-28T13:02:21.930512+0000","last_peered":"2023-11-28T13:02:21.930512+0000","last_clean":"2023-11-28T13:02:21.930512+0000","last_became_active":"2023-11-28T13:02:20.486686+0000","last_became_peered":"2023-11-28T13:02:20.486686+0000","last_unstale":"2023-11-28T13:02:21.930512+0000","last_undegraded":"2023-11-28T13:02:21.930512+0000","last_fullsized":"2023-11-28T13:02:21.930512+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:14.899317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.486958+0000","last_change":"2023-11-28T13:02:20.099308+0000","last_active":"2023-11-28T13:02:20.486958+0000","last_peered":"2023-11-28T13:02:20.486958+0000","last_clean":"2023-11-28T13:02:20.486958+0000","last_became_active":"2023-11-28T13:02:20.099051+0000","last_became_peered":"2023-11-28T13:02:20.099051+0000","last_unstale":"2023-11-28T13:02:20.486958+0000","last_undegraded":"2023-11-28T13:02:20.486958+0000","last_fullsized":"2023-11-28T13:02:20.486958+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:14:46.191864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930661+0000","last_change":"2023-11-28T13:02:20.483545+0000","last_active":"2023-11-28T13:02:21.930661+0000","last_peered":"2023-11-28T13:02:21.930661+0000","last_clean":"2023-11-28T13:02:21.930661+0000","last_became_active":"2023-11-28T13:02:20.483189+0000","last_became_peered":"2023-11-28T13:02:20.483189+0000","last_unstale":"2023-11-28T13:02:21.930661+0000","last_undegraded":"2023-11-28T13:02:21.930661+0000","last_fullsized":"2023-11-28T13:02:21.930661+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:08.280978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.463866+0000","last_change":"2023-11-28T13:02:20.106651+0000","last_active":"2023-11-28T13:02:20.463866+0000","last_peered":"2023-11-28T13:02:20.463866+0000","last_clean":"2023-11-28T13:02:20.463866+0000","last_became_active":"2023-11-28T13:02:20.106340+0000","last_became_peered":"2023-11-28T13:02:20.106340+0000","last_unstale":"2023-11-28T13:02:20.463866+0000","last_undegraded":"2023-11-28T13:02:20.463866+0000","last_fullsized":"2023-11-28T13:02:20.463866+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:28:45.191699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930857+0000","last_change":"2023-11-28T13:02:20.484587+0000","last_active":"2023-11-28T13:02:21.930857+0000","last_peered":"2023-11-28T13:02:21.930857+0000","last_clean":"2023-11-28T13:02:21.930857+0000","last_became_active":"2023-11-28T13:02:20.484352+0000","last_became_peered":"2023-11-28T13:02:20.484352+0000","last_unstale":"2023-11-28T13:02:21.930857+0000","last_undegraded":"2023-11-28T13:02:21.930857+0000","last_fullsized":"2023-11-28T13:02:21.930857+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:26.231477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.479762+0000","last_change":"2023-11-28T13:02:20.103739+0000","last_active":"2023-11-28T13:02:20.479762+0000","last_peered":"2023-11-28T13:02:20.479762+0000","last_clean":"2023-11-28T13:02:20.479762+0000","last_became_active":"2023-11-28T13:02:20.103467+0000","last_became_peered":"2023-11-28T13:02:20.103467+0000","last_unstale":"2023-11-28T13:02:20.479762+0000","last_undegraded":"2023-11-28T13:02:20.479762+0000","last_fullsized":"2023-11-28T13:02:20.479762+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:30:54.767899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.542546+0000","last_change":"2023-11-28T13:02:20.496378+0000","last_active":"2023-11-28T13:02:21.542546+0000","last_peered":"2023-11-28T13:02:21.542546+0000","last_clean":"2023-11-28T13:02:21.542546+0000","last_became_active":"2023-11-28T13:02:20.496105+0000","last_became_peered":"2023-11-28T13:02:20.496105+0000","last_unstale":"2023-11-28T13:02:21.542546+0000","last_undegraded":"2023-11-28T13:02:21.542546+0000","last_fullsized":"2023-11-28T13:02:21.542546+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:48.919837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.472735+0000","last_change":"2023-11-28T13:02:20.105836+0000","last_active":"2023-11-28T13:02:20.472735+0000","last_peered":"2023-11-28T13:02:20.472735+0000","last_clean":"2023-11-28T13:02:20.472735+0000","last_became_active":"2023-11-28T13:02:20.105637+0000","last_became_peered":"2023-11-28T13:02:20.105637+0000","last_unstale":"2023-11-28T13:02:20.472735+0000","last_undegraded":"2023-11-28T13:02:20.472735+0000","last_fullsized":"2023-11-28T13:02:20.472735+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:43.577442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.929637+0000","last_change":"2023-11-28T13:02:20.484753+0000","last_active":"2023-11-28T13:02:21.929637+0000","last_peered":"2023-11-28T13:02:21.929637+0000","last_clean":"2023-11-28T13:02:21.929637+0000","last_became_active":"2023-11-28T13:02:20.484467+0000","last_became_peered":"2023-11-28T13:02:20.484467+0000","last_unstale":"2023-11-28T13:02:21.929637+0000","last_undegraded":"2023-11-28T13:02:21.929637+0000","last_fullsized":"2023-11-28T13:02:21.929637+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:17:33.409993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.480413+0000","last_change":"2023-11-28T13:02:20.099034+0000","last_active":"2023-11-28T13:02:20.480413+0000","last_peered":"2023-11-28T13:02:20.480413+0000","last_clean":"2023-11-28T13:02:20.480413+0000","last_became_active":"2023-11-28T13:02:20.098726+0000","last_became_peered":"2023-11-28T13:02:20.098726+0000","last_unstale":"2023-11-28T13:02:20.480413+0000","last_undegraded":"2023-11-28T13:02:20.480413+0000","last_fullsized":"2023-11-28T13:02:20.480413+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:09.884077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":195,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.468266+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:02:20.468266+0000","last_peered":"2023-11-28T13:02:20.468266+0000","last_clean":"2023-11-28T13:02:20.468266+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:02:20.468266+0000","last_undegraded":"2023-11-28T13:02:20.468266+0000","last_fullsized":"2023-11-28T13:02:20.468266+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.477522+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:02:20.477522+0000","last_peered":"2023-11-28T13:02:20.477522+0000","last_clean":"2023-11-28T13:02:20.477522+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:02:20.477522+0000","last_undegraded":"2023-11-28T13:02:20.477522+0000","last_fullsized":"2023-11-28T13:02:20.477522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.542354+0000","last_change":"2023-11-28T13:02:20.483039+0000","last_active":"2023-11-28T13:02:21.542354+0000","last_peered":"2023-11-28T13:02:21.542354+0000","last_clean":"2023-11-28T13:02:21.542354+0000","last_became_active":"2023-11-28T13:02:20.482722+0000","last_became_peered":"2023-11-28T13:02:20.482722+0000","last_unstale":"2023-11-28T13:02:21.542354+0000","last_undegraded":"2023-11-28T13:02:21.542354+0000","last_fullsized":"2023-11-28T13:02:21.542354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:28:46.196825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.469283+0000","last_change":"2023-11-28T13:02:20.102926+0000","last_active":"2023-11-28T13:02:20.469283+0000","last_peered":"2023-11-28T13:02:20.469283+0000","last_clean":"2023-11-28T13:02:20.469283+0000","last_became_active":"2023-11-28T13:02:20.102318+0000","last_became_peered":"2023-11-28T13:02:20.102318+0000","last_unstale":"2023-11-28T13:02:20.469283+0000","last_undegraded":"2023-11-28T13:02:20.469283+0000","last_fullsized":"2023-11-28T13:02:20.469283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:11.227538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.478634+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:02:21.478634+0000","last_peered":"2023-11-28T13:02:21.478634+0000","last_clean":"2023-11-28T13:02:21.478634+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:02:21.478634+0000","last_undegraded":"2023-11-28T13:02:21.478634+0000","last_fullsized":"2023-11-28T13:02:21.478634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.628143+0000","last_change":"2023-11-28T13:02:20.478008+0000","last_active":"2023-11-28T13:02:21.628143+0000","last_peered":"2023-11-28T13:02:21.628143+0000","last_clean":"2023-11-28T13:02:21.628143+0000","last_became_active":"2023-11-28T13:02:20.477737+0000","last_became_peered":"2023-11-28T13:02:20.477737+0000","last_unstale":"2023-11-28T13:02:21.628143+0000","last_undegraded":"2023-11-28T13:02:21.628143+0000","last_fullsized":"2023-11-28T13:02:21.628143+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:23:48.335246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.479881+0000","last_change":"2023-11-28T13:02:20.096598+0000","last_active":"2023-11-28T13:02:20.479881+0000","last_peered":"2023-11-28T13:02:20.479881+0000","last_clean":"2023-11-28T13:02:20.479881+0000","last_became_active":"2023-11-28T13:02:20.096267+0000","last_became_peered":"2023-11-28T13:02:20.096267+0000","last_unstale":"2023-11-28T13:02:20.479881+0000","last_undegraded":"2023-11-28T13:02:20.479881+0000","last_fullsized":"2023-11-28T13:02:20.479881+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:32.316383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.472651+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:02:20.472651+0000","last_peered":"2023-11-28T13:02:20.472651+0000","last_clean":"2023-11-28T13:02:20.472651+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:02:20.472651+0000","last_undegraded":"2023-11-28T13:02:20.472651+0000","last_fullsized":"2023-11-28T13:02:20.472651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.929513+0000","last_change":"2023-11-28T13:02:20.496730+0000","last_active":"2023-11-28T13:02:21.929513+0000","last_peered":"2023-11-28T13:02:21.929513+0000","last_clean":"2023-11-28T13:02:21.929513+0000","last_became_active":"2023-11-28T13:02:20.496434+0000","last_became_peered":"2023-11-28T13:02:20.496434+0000","last_unstale":"2023-11-28T13:02:21.929513+0000","last_undegraded":"2023-11-28T13:02:21.929513+0000","last_fullsized":"2023-11-28T13:02:21.929513+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:42.036693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.478359+0000","last_change":"2023-11-28T13:02:20.108336+0000","last_active":"2023-11-28T13:02:20.478359+0000","last_peered":"2023-11-28T13:02:20.478359+0000","last_clean":"2023-11-28T13:02:20.478359+0000","last_became_active":"2023-11-28T13:02:20.108081+0000","last_became_peered":"2023-11-28T13:02:20.108081+0000","last_unstale":"2023-11-28T13:02:20.478359+0000","last_undegraded":"2023-11-28T13:02:20.478359+0000","last_fullsized":"2023-11-28T13:02:20.478359+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:52.544723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.477396+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:02:20.477396+0000","last_peered":"2023-11-28T13:02:20.477396+0000","last_clean":"2023-11-28T13:02:20.477396+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:02:20.477396+0000","last_undegraded":"2023-11-28T13:02:20.477396+0000","last_fullsized":"2023-11-28T13:02:20.477396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930534+0000","last_change":"2023-11-28T13:02:20.490440+0000","last_active":"2023-11-28T13:02:21.930534+0000","last_peered":"2023-11-28T13:02:21.930534+0000","last_clean":"2023-11-28T13:02:21.930534+0000","last_became_active":"2023-11-28T13:02:20.488328+0000","last_became_peered":"2023-11-28T13:02:20.488328+0000","last_unstale":"2023-11-28T13:02:21.930534+0000","last_undegraded":"2023-11-28T13:02:21.930534+0000","last_fullsized":"2023-11-28T13:02:21.930534+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:43:53.954131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.468281+0000","last_change":"2023-11-28T13:02:20.104985+0000","last_active":"2023-11-28T13:02:20.468281+0000","last_peered":"2023-11-28T13:02:20.468281+0000","last_clean":"2023-11-28T13:02:20.468281+0000","last_became_active":"2023-11-28T13:02:20.104691+0000","last_became_peered":"2023-11-28T13:02:20.104691+0000","last_unstale":"2023-11-28T13:02:20.468281+0000","last_undegraded":"2023-11-28T13:02:20.468281+0000","last_fullsized":"2023-11-28T13:02:20.468281+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:14.909436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.469096+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:02:20.469096+0000","last_peered":"2023-11-28T13:02:20.469096+0000","last_clean":"2023-11-28T13:02:20.469096+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:02:20.469096+0000","last_undegraded":"2023-11-28T13:02:20.469096+0000","last_fullsized":"2023-11-28T13:02:20.469096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.628695+0000","last_change":"2023-11-28T13:02:20.491302+0000","last_active":"2023-11-28T13:02:21.628695+0000","last_peered":"2023-11-28T13:02:21.628695+0000","last_clean":"2023-11-28T13:02:21.628695+0000","last_became_active":"2023-11-28T13:02:20.491074+0000","last_became_peered":"2023-11-28T13:02:20.491074+0000","last_unstale":"2023-11-28T13:02:21.628695+0000","last_undegraded":"2023-11-28T13:02:21.628695+0000","last_fullsized":"2023-11-28T13:02:21.628695+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:12.049704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.478081+0000","last_change":"2023-11-28T13:02:20.102946+0000","last_active":"2023-11-28T13:02:20.478081+0000","last_peered":"2023-11-28T13:02:20.478081+0000","last_clean":"2023-11-28T13:02:20.478081+0000","last_became_active":"2023-11-28T13:02:20.102672+0000","last_became_peered":"2023-11-28T13:02:20.102672+0000","last_unstale":"2023-11-28T13:02:20.478081+0000","last_undegraded":"2023-11-28T13:02:20.478081+0000","last_fullsized":"2023-11-28T13:02:20.478081+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:33:36.451705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.469361+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:02:20.469361+0000","last_peered":"2023-11-28T13:02:20.469361+0000","last_clean":"2023-11-28T13:02:20.469361+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:02:20.469361+0000","last_undegraded":"2023-11-28T13:02:20.469361+0000","last_fullsized":"2023-11-28T13:02:20.469361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930158+0000","last_change":"2023-11-28T13:02:20.497892+0000","last_active":"2023-11-28T13:02:21.930158+0000","last_peered":"2023-11-28T13:02:21.930158+0000","last_clean":"2023-11-28T13:02:21.930158+0000","last_became_active":"2023-11-28T13:02:20.497604+0000","last_became_peered":"2023-11-28T13:02:20.497604+0000","last_unstale":"2023-11-28T13:02:21.930158+0000","last_undegraded":"2023-11-28T13:02:21.930158+0000","last_fullsized":"2023-11-28T13:02:21.930158+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:57:45.588310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.465156+0000","last_change":"2023-11-28T13:02:20.104067+0000","last_active":"2023-11-28T13:02:20.465156+0000","last_peered":"2023-11-28T13:02:20.465156+0000","last_clean":"2023-11-28T13:02:20.465156+0000","last_became_active":"2023-11-28T13:02:20.103087+0000","last_became_peered":"2023-11-28T13:02:20.103087+0000","last_unstale":"2023-11-28T13:02:20.465156+0000","last_undegraded":"2023-11-28T13:02:20.465156+0000","last_fullsized":"2023-11-28T13:02:20.465156+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:13.894190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.471360+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:02:20.471360+0000","last_peered":"2023-11-28T13:02:20.471360+0000","last_clean":"2023-11-28T13:02:20.471360+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:02:20.471360+0000","last_undegraded":"2023-11-28T13:02:20.471360+0000","last_fullsized":"2023-11-28T13:02:20.471360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.929852+0000","last_change":"2023-11-28T13:02:20.492227+0000","last_active":"2023-11-28T13:02:21.929852+0000","last_peered":"2023-11-28T13:02:21.929852+0000","last_clean":"2023-11-28T13:02:21.929852+0000","last_became_active":"2023-11-28T13:02:20.491872+0000","last_became_peered":"2023-11-28T13:02:20.491872+0000","last_unstale":"2023-11-28T13:02:21.929852+0000","last_undegraded":"2023-11-28T13:02:21.929852+0000","last_fullsized":"2023-11-28T13:02:21.929852+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:03:57.222909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.463967+0000","last_change":"2023-11-28T13:02:20.109497+0000","last_active":"2023-11-28T13:02:20.463967+0000","last_peered":"2023-11-28T13:02:20.463967+0000","last_clean":"2023-11-28T13:02:20.463967+0000","last_became_active":"2023-11-28T13:02:20.109212+0000","last_became_peered":"2023-11-28T13:02:20.109212+0000","last_unstale":"2023-11-28T13:02:20.463967+0000","last_undegraded":"2023-11-28T13:02:20.463967+0000","last_fullsized":"2023-11-28T13:02:20.463967+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:32.316383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.471138+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:02:20.471138+0000","last_peered":"2023-11-28T13:02:20.471138+0000","last_clean":"2023-11-28T13:02:20.471138+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:02:20.471138+0000","last_undegraded":"2023-11-28T13:02:20.471138+0000","last_fullsized":"2023-11-28T13:02:20.471138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10272,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361568,"statfs":{"total":96636764160,"available":96626245632,"internally_reserved":0,"allocated":1204224,"data_stored":849763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.82699999999999996,"15min":0.81499999999999995},"min":{"1min":0.625,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.90200000000000002,"15min":0.91100000000000003},"min":{"1min":0.50900000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.222,"5min":1.377,"15min":1.377},"last":0.52500000000000002}]},{"osd":1,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.91400000000000003,"15min":0.92000000000000004},"min":{"1min":0.58399999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.242,"5min":1.599,"15min":1.599},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.871,"5min":0.93600000000000005,"15min":0.94699999999999995},"min":{"1min":0.63400000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.161,"5min":1.375,"15min":1.375},"last":0.71199999999999997}]},{"osd":2,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.92700000000000005,"15min":0.94099999999999995},"min":{"1min":0.58799999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2949999999999999,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.60999999999999999,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.329,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.88600000000000001}]},{"osd":3,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.93999999999999995,"15min":0.95199999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.1839999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.92800000000000005,"15min":0.92200000000000004},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.752}]},{"osd":4,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0029999999999999,"15min":1.0089999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.504,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.96399999999999997,"15min":0.96599999999999997},"min":{"1min":0.72899999999999998,"5min":0.621,"15min":0.621},"max":{"1min":1.296,"5min":1.409,"15min":1.409},"last":0.84899999999999998}]},{"osd":5,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.0449999999999999,"15min":1.0309999999999999},"min":{"1min":0.872,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.1020000000000001,"15min":1.107},"min":{"1min":0.76800000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4530000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.93400000000000005}]},{"osd":6,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.179,"15min":1.1870000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3500000000000001,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.052},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1699999999999999,"15min":1.175},"min":{"1min":0.879,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.4299999999999999,"5min":1.794,"15min":1.794},"last":1.0329999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8860,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362980,"statfs":{"total":96636764160,"available":96627691520,"internally_reserved":0,"allocated":610304,"data_stored":259907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.83399999999999996,"15min":0.83599999999999997},"min":{"1min":0.64500000000000002,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0960000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.85399999999999998,"15min":0.84199999999999997},"min":{"1min":0.65200000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1539999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.196}]},{"osd":1,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.87,"15min":0.86199999999999999},"min":{"1min":0.65800000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2370000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.871,"15min":0.86499999999999999},"min":{"1min":0.68600000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.218,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.008}]},{"osd":2,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.875,"15min":0.88400000000000001},"min":{"1min":0.57899999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1339999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.87,"5min":0.88800000000000001,"15min":0.89100000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1819999999999999,"5min":1.639,"15min":1.639},"last":0.93100000000000005}]},{"osd":3,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.88400000000000001,"15min":0.88},"min":{"1min":0.67800000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1399999999999999,"5min":1.141,"15min":1.141},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.97499999999999998,"15min":0.97699999999999998},"min":{"1min":0.74099999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.1259999999999999,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.0509999999999999}]},{"osd":4,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.95199999999999996,"15min":0.94899999999999995},"min":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2390000000000001,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.4390000000000001,"15min":1.506},"min":{"1min":0.66100000000000003,"5min":0.629,"15min":0.629},"max":{"1min":1.266,"5min":10.566000000000001,"15min":10.566000000000001},"last":0.80800000000000005}]},{"osd":5,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.0780000000000001,"15min":1.0860000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.21,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.151,"5min":1.0940000000000001,"15min":1.0840000000000001},"min":{"1min":0.91500000000000004,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.3160000000000001,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.125}]},{"osd":7,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.234,"15min":1.25},"min":{"1min":0.877,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.3819999999999999,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.155,"5min":1.306,"15min":1.331},"min":{"1min":0.97399999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":1.351,"5min":3.593,"15min":3.593},"last":1.1579999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9044,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362796,"statfs":{"total":96636764160,"available":96627503104,"internally_reserved":0,"allocated":602112,"data_stored":259271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.81699999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82599999999999996,"15min":0.81999999999999995},"min":{"1min":0.628,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0680000000000001,"5min":1.248,"15min":1.248},"last":0.749}]},{"osd":1,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82299999999999995,"15min":0.82199999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1100000000000001,"5min":1.274,"15min":1.274},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.56299999999999994,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.109,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.57699999999999996}]},{"osd":2,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81499999999999995,"15min":0.81100000000000005},"min":{"1min":0.505,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.92900000000000005,"15min":0.93999999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2010000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.72199999999999998}]},{"osd":3,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.88500000000000001,"15min":0.871},"min":{"1min":0.69999999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.998,"5min":1.0229999999999999,"15min":1.0269999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.391,"5min":1.403,"15min":1.403},"last":0.86699999999999999}]},{"osd":4,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.88300000000000001,"15min":0.89000000000000001},"min":{"1min":0.63,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1719999999999999,"5min":1.216,"15min":1.216},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.153,"5min":0.98299999999999998,"15min":0.95499999999999996},"min":{"1min":0.72499999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":4.3300000000000001,"5min":4.3300000000000001,"15min":4.3300000000000001},"last":1.0589999999999999}]},{"osd":6,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.02,"15min":1.0289999999999999},"min":{"1min":0.76800000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0269999999999999,"15min":1.0289999999999999},"min":{"1min":0.74299999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.448,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.92000000000000004}]},{"osd":7,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.0620000000000001,"15min":1.038},"min":{"1min":0.71699999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":4.234,"5min":4.234,"15min":4.234},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.133,"15min":1.1399999999999999},"min":{"1min":0.82199999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.377,"5min":1.466,"15min":1.466},"last":0.79800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9112,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362728,"statfs":{"total":96636764160,"available":96627433472,"internally_reserved":0,"allocated":606208,"data_stored":259837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.59799999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.73199999999999998}]},{"osd":1,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81399999999999995,"15min":0.81599999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0880000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.153,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.58299999999999996}]},{"osd":2,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.83899999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.133,"5min":1.357,"15min":1.357},"last":0.62},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.54600000000000004}]},{"osd":3,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.88300000000000001,"15min":0.872},"min":{"1min":0.64600000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.004,"5min":0.99299999999999999,"15min":0.99099999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.89600000000000002}]},{"osd":5,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.63700000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4039999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.98699999999999999,"15min":0.997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.871}]},{"osd":6,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0269999999999999,"15min":1.034},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.296,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0840000000000001,"15min":1.0800000000000001},"min":{"1min":0.86299999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.0169999999999999}]},{"osd":7,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0880000000000001,"15min":1.093},"min":{"1min":0.81999999999999995,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.151,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.98899999999999999,"5min":0.871,"15min":0.871},"max":{"1min":1.571,"5min":1.655,"15min":1.655},"last":1.03}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9188,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362652,"statfs":{"total":96636764160,"available":96627355648,"internally_reserved":0,"allocated":618496,"data_stored":260841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.46300000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98099999999999998,"5min":0.998,"15min":0.998},"last":0.53500000000000003}]},{"osd":1,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68100000000000005,"15min":0.69199999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86499999999999999,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.65200000000000002}]},{"osd":2,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.5,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0289999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82699999999999996,"15min":0.82899999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0740000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.751}]},{"osd":4,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.97799999999999998,"15min":1},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.194,"5min":1.405,"15min":1.405},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.038,"15min":1.05},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.409,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.0529999999999999,"15min":1.0669999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2430000000000001,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.012,"5min":1.081,"15min":1.093},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.321,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.874}]},{"osd":6,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.073,"15min":1.101},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.196,"5min":1.446,"15min":1.446},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.038,"5min":1.1040000000000001,"15min":1.115},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.3500000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.84699999999999998}]},{"osd":7,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.145,"15min":1.1579999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3640000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.105},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.153,"15min":1.1819999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.2290000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.071}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8992,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362848,"statfs":{"total":96636764160,"available":96627556352,"internally_reserved":0,"allocated":614400,"data_stored":260819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.52200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81999999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.68700000000000006}]},{"osd":1,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.629,"15min":0.61599999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.94399999999999995,"5min":1.123,"15min":1.123},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97899999999999998,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.85199999999999998}]},{"osd":3,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.73799999999999999,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.317,"15min":0.317},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.74199999999999999,"15min":0.74099999999999999},"min":{"1min":0.46400000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.018,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.77100000000000002}]},{"osd":4,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91200000000000003,"15min":0.91600000000000004},"min":{"1min":0.64300000000000002,"5min":0.498,"15min":0.498},"max":{"1min":1.1519999999999999,"5min":1.327,"15min":1.327},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.002,"15min":1.0049999999999999},"min":{"1min":0.69999999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3129999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.96999999999999997}]},{"osd":5,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.76800000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.202,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.006,"15min":0.98399999999999999},"min":{"1min":0.73899999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.95099999999999996}]},{"osd":6,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.0569999999999999,"15min":1.0309999999999999},"min":{"1min":0.66900000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1,"15min":1.0009999999999999},"min":{"1min":0.72499999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.2450000000000001,"5min":1.359,"15min":1.359},"last":1.143}]},{"osd":7,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.74399999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.431,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.1160000000000001,"15min":1.0960000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.107}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8988,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362852,"statfs":{"total":96636764160,"available":96627560448,"internally_reserved":0,"allocated":610304,"data_stored":259431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.96599999999999997,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.66800000000000004,"15min":0.68200000000000005},"min":{"1min":0.39100000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.749,"5min":1.181,"15min":1.181},"last":0.69899999999999995}]},{"osd":2,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78500000000000003,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.752,"15min":0.755},"min":{"1min":0.53700000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97599999999999998,"5min":1.409,"15min":1.409},"last":0.48799999999999999}]},{"osd":3,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.81599999999999995,"15min":0.82799999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.069,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.073,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.64100000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.98299999999999998,"15min":0.99299999999999999},"min":{"1min":0.65000000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1.284},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.93400000000000005,"15min":0.94199999999999995},"min":{"1min":0.68100000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1850000000000001,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.1060000000000001}]},{"osd":5,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.96899999999999997,"15min":0.97699999999999998},"min":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.3580000000000001,"5min":1.425,"15min":1.425},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0369999999999999,"15min":1.0509999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.234,"5min":2.004,"15min":2.004},"last":1.0580000000000001}]},{"osd":6,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.99299999999999999,"15min":1.0089999999999999},"min":{"1min":0.64100000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.101,"5min":1.889,"15min":1.889},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.097,"15min":1.1100000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4119999999999999,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.127}]},{"osd":7,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.085,"15min":1.0940000000000001},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.3029999999999999,"5min":1.766,"15min":1.766},"last":1.236},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.107,"15min":1.123},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.3109999999999999,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.2030000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10144,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94361696,"statfs":{"total":96636764160,"available":96626376704,"internally_reserved":0,"allocated":1204224,"data_stored":849695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63500000000000001,"15min":0.63100000000000001},"min":{"1min":0.499,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92800000000000005,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.49199999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88300000000000001,"5min":1.198,"15min":1.198},"last":0.65000000000000002}]},{"osd":2,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70799999999999996,"15min":0.70699999999999996},"min":{"1min":0.53100000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.878,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.47699999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.101,"5min":1.143,"15min":1.143},"last":0.72899999999999998}]},{"osd":3,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.50900000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82399999999999995,"5min":1.298,"15min":1.298},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.84199999999999997,"15min":0.84699999999999998},"min":{"1min":0.53900000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0249999999999999,"5min":1.629,"15min":1.629},"last":0.754}]},{"osd":4,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.88900000000000001,"15min":0.89300000000000002},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.95899999999999996,"15min":0.95599999999999996},"min":{"1min":0.76400000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.155,"5min":1.242,"15min":1.242},"last":1.1399999999999999}]},{"osd":5,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.98699999999999999,"15min":0.98899999999999999},"min":{"1min":0.71999999999999997,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.2769999999999999,"5min":1.895,"15min":1.895},"last":1.2430000000000001},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.93799999999999994,"15min":0.93999999999999995},"min":{"1min":0.71799999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.196,"5min":1.319,"15min":1.319},"last":1.155}]},{"osd":6,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0449999999999999,"15min":1.0489999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.252,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0800000000000001,"15min":1.083},"min":{"1min":0.88300000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.363,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.288}]},{"osd":7,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1060000000000001,"15min":1.113},"min":{"1min":0.77100000000000002,"5min":0.746,"15min":0.746},"max":{"1min":1.3129999999999999,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.014,"15min":1.0149999999999999},"min":{"1min":0.83299999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.0489999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:02:26.331 INFO:tasks.ceph.mds.d.smithi114.stderr:2023-11-28T13:02:26.327+0000 7f088ce06700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T13:02:27.337 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:02:27.339 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:02:28.876 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:02:28.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.993+0000 7fc46359e700 1 Processor -- start 2023-11-28T13:02:28.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.993+0000 7fc46359e700 1 -- start start 2023-11-28T13:02:28.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.993+0000 7fc46359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc464070780 0x7fc46415d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:28.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.993+0000 7fc46359e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc46415da50 con 0x7fc4641591c0 2023-11-28T13:02:28.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.993+0000 7fc46359e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4640c9e20 con 0x7fc464158df0 2023-11-28T13:02:28.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.993+0000 7fc46359e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4640cc640 con 0x7fc464070780 2023-11-28T13:02:28.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.993+0000 7fc461d9b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc4641591c0 0x7fc464070070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43470/0 (socket says 172.21.15.82:43470) 2023-11-28T13:02:28.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.993+0000 7fc462d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc464070780 0x7fc46415d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:28.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.993+0000 7fc461d9b700 1 -- 172.21.15.82:0/323510072 learned_addr learned my addr 172.21.15.82:0/323510072 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:28.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.997+0000 7fc46159a700 1 -- 172.21.15.82:0/323510072 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730571203 0 0) 0x7fc454001490 con 0x7fc4641591c0 2023-11-28T13:02:28.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.997+0000 7fc46159a700 1 -- 172.21.15.82:0/323510072 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc44c0057e0 con 0x7fc4641591c0 2023-11-28T13:02:29.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.997+0000 7fc462d9d700 1 -- 172.21.15.82:0/323510072 >> v1:172.21.15.114:6789/0 conn(0x7fc464158df0 legacy=0x7fc46406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:29.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.997+0000 7fc462d9d700 1 -- 172.21.15.82:0/323510072 >> v1:172.21.15.82:6789/0 conn(0x7fc4641591c0 legacy=0x7fc464070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:29.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.997+0000 7fc462d9d700 1 -- 172.21.15.82:0/323510072 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4640c97d0 con 0x7fc464070780 2023-11-28T13:02:29.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.997+0000 7fc462d9d700 1 --2- 172.21.15.82:0/323510072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc464070780 0x7fc46415d510 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc45c009850 tx=0x7fc45c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09c11872a188c7e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:29.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.997+0000 7fc46159a700 1 -- 172.21.15.82:0/323510072 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c011830 con 0x7fc464070780 2023-11-28T13:02:29.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.997+0000 7fc46159a700 1 -- 172.21.15.82:0/323510072 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45c011990 con 0x7fc464070780 2023-11-28T13:02:29.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.997+0000 7fc46159a700 1 -- 172.21.15.82:0/323510072 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c011d40 con 0x7fc464070780 2023-11-28T13:02:29.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.997+0000 7fc46359e700 1 -- 172.21.15.82:0/323510072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc464070780 msgr2=0x7fc46415d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:29.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.997+0000 7fc46359e700 1 --2- 172.21.15.82:0/323510072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc464070780 0x7fc46415d510 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc45c009850 tx=0x7fc45c009b60 comp rx=0 tx=0).stop 2023-11-28T13:02:29.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.997+0000 7fc46359e700 1 -- 172.21.15.82:0/323510072 shutdown_connections 2023-11-28T13:02:29.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.997+0000 7fc46359e700 1 --2- 172.21.15.82:0/323510072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc464070780 0x7fc46415d510 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.997+0000 7fc46359e700 1 -- 172.21.15.82:0/323510072 >> 172.21.15.82:0/323510072 conn(0x7fc4640ce600 msgr2=0x7fc4640ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:29.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.997+0000 7fc46359e700 1 -- 172.21.15.82:0/323510072 shutdown_connections 2023-11-28T13:02:29.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.997+0000 7fc46359e700 1 -- 172.21.15.82:0/323510072 wait complete. 2023-11-28T13:02:29.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.997+0000 7fc46359e700 1 Processor -- start 2023-11-28T13:02:29.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:28.997+0000 7fc46359e700 1 -- start start 2023-11-28T13:02:29.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc46359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc464070780 0x7fc464159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:29.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc46359e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc464158df0 0x7fc46415a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:29.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc46359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4641591c0 0x7fc4640ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:29.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc46359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4641ee410 con 0x7fc4641591c0 2023-11-28T13:02:29.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc46359e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640b25a0 con 0x7fc464070780 2023-11-28T13:02:29.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc46359e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640b2880 con 0x7fc464158df0 2023-11-28T13:02:29.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc462d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4641591c0 0x7fc4640ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:29.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc462d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4641591c0 0x7fc4640ae060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46618/0 (socket says 172.21.15.82:46618) 2023-11-28T13:02:29.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc462d9d700 1 -- 172.21.15.82:0/3598512054 learned_addr learned my addr 172.21.15.82:0/3598512054 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:29.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc461d9b700 1 --2- 172.21.15.82:0/3598512054 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc464158df0 0x7fc46415a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:29.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc46259c700 1 --2- 172.21.15.82:0/3598512054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc464070780 0x7fc464159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:29.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc462d9d700 1 -- 172.21.15.82:0/3598512054 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc464158df0 msgr2=0x7fc46415a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:29.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc462d9d700 1 --2- 172.21.15.82:0/3598512054 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc464158df0 0x7fc46415a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc462d9d700 1 -- 172.21.15.82:0/3598512054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc464070780 msgr2=0x7fc464159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:29.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc462d9d700 1 --2- 172.21.15.82:0/3598512054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc464070780 0x7fc464159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc462d9d700 1 -- 172.21.15.82:0/3598512054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c0094b0 con 0x7fc4641591c0 2023-11-28T13:02:29.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc46259c700 1 --2- 172.21.15.82:0/3598512054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc464070780 0x7fc464159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:29.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc462d9d700 1 --2- 172.21.15.82:0/3598512054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4641591c0 0x7fc4640ae060 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc45c009ba0 tx=0x7fc45c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:29.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc452ffd700 1 -- 172.21.15.82:0/3598512054 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c0045d0 con 0x7fc4641591c0 2023-11-28T13:02:29.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc452ffd700 1 -- 172.21.15.82:0/3598512054 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45c01f070 con 0x7fc4641591c0 2023-11-28T13:02:29.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc46359e700 1 -- 172.21.15.82:0/3598512054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4640c9480 con 0x7fc4641591c0 2023-11-28T13:02:29.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc452ffd700 1 -- 172.21.15.82:0/3598512054 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c003900 con 0x7fc4641591c0 2023-11-28T13:02:29.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc46359e700 1 -- 172.21.15.82:0/3598512054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4640c9ab0 con 0x7fc4641591c0 2023-11-28T13:02:29.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.001+0000 7fc46359e700 1 -- 172.21.15.82:0/3598512054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4640add00 con 0x7fc4641591c0 2023-11-28T13:02:29.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.005+0000 7fc452ffd700 1 -- 172.21.15.82:0/3598512054 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc45c00f050 con 0x7fc4641591c0 2023-11-28T13:02:29.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.005+0000 7fc452ffd700 1 --2- 172.21.15.82:0/3598512054 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc444064ee0 0x7fc444067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:29.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.005+0000 7fc452ffd700 1 -- 172.21.15.82:0/3598512054 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc45c021070 con 0x7fc4641591c0 2023-11-28T13:02:29.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.005+0000 7fc46259c700 1 --2- 172.21.15.82:0/3598512054 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc444064ee0 0x7fc444067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:29.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.005+0000 7fc46259c700 1 --2- 172.21.15.82:0/3598512054 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc444064ee0 0x7fc444067390 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc4580017a0 tx=0x7fc458009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:29.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.013+0000 7fc452ffd700 1 -- 172.21.15.82:0/3598512054 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc45c051870 con 0x7fc4641591c0 2023-11-28T13:02:29.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.173+0000 7fc46359e700 1 -- 172.21.15.82:0/3598512054 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4640b23e0 con 0x7fc444064ee0 2023-11-28T13:02:29.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.181+0000 7fc452ffd700 1 -- 172.21.15.82:0/3598512054 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310067 (secure 0 0 0) 0x7fc4640b23e0 con 0x7fc444064ee0 2023-11-28T13:02:29.187 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:29.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.185+0000 7fc46359e700 1 -- 172.21.15.82:0/3598512054 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc444064ee0 msgr2=0x7fc444067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:29.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.185+0000 7fc46359e700 1 --2- 172.21.15.82:0/3598512054 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc444064ee0 0x7fc444067390 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc4580017a0 tx=0x7fc458009040 comp rx=0 tx=0).stop 2023-11-28T13:02:29.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.185+0000 7fc46359e700 1 -- 172.21.15.82:0/3598512054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4641591c0 msgr2=0x7fc4640ae060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:29.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.185+0000 7fc46359e700 1 --2- 172.21.15.82:0/3598512054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4641591c0 0x7fc4640ae060 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc45c009ba0 tx=0x7fc45c004770 comp rx=0 tx=0).stop 2023-11-28T13:02:29.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.185+0000 7fc46359e700 1 -- 172.21.15.82:0/3598512054 shutdown_connections 2023-11-28T13:02:29.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.185+0000 7fc46359e700 1 --2- 172.21.15.82:0/3598512054 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc444064ee0 0x7fc444067390 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.185+0000 7fc46359e700 1 --2- 172.21.15.82:0/3598512054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4641591c0 0x7fc4640ae060 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.185+0000 7fc46359e700 1 --2- 172.21.15.82:0/3598512054 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc464158df0 0x7fc46415a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.185+0000 7fc46359e700 1 --2- 172.21.15.82:0/3598512054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc464070780 0x7fc464159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.185+0000 7fc46359e700 1 -- 172.21.15.82:0/3598512054 >> 172.21.15.82:0/3598512054 conn(0x7fc4640ce600 msgr2=0x7fc4641533b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:29.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.185+0000 7fc46359e700 1 -- 172.21.15.82:0/3598512054 shutdown_connections 2023-11-28T13:02:29.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.185+0000 7fc46359e700 1 -- 172.21.15.82:0/3598512054 wait complete. 2023-11-28T13:02:29.191 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:02:29.202 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2023-11-28T13:02:27.196210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":74600,"kb_used_data":5928,"kb_used_omap":0,"kb_used_meta":68608,"kb_avail":754900120,"statfs":{"total":773094113280,"available":773017722880,"internally_reserved":0,"allocated":6070272,"data_stored":3259564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":70254592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.116436"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.542654+0000","last_change":"2023-11-28T13:02:20.486104+0000","last_active":"2023-11-28T13:02:21.542654+0000","last_peered":"2023-11-28T13:02:21.542654+0000","last_clean":"2023-11-28T13:02:21.542654+0000","last_became_active":"2023-11-28T13:02:20.485856+0000","last_became_peered":"2023-11-28T13:02:20.485856+0000","last_unstale":"2023-11-28T13:02:21.542654+0000","last_undegraded":"2023-11-28T13:02:21.542654+0000","last_fullsized":"2023-11-28T13:02:21.542654+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:15.914562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.479866+0000","last_change":"2023-11-28T13:02:20.482510+0000","last_active":"2023-11-28T13:02:21.479866+0000","last_peered":"2023-11-28T13:02:21.479866+0000","last_clean":"2023-11-28T13:02:21.479866+0000","last_became_active":"2023-11-28T13:02:20.482089+0000","last_became_peered":"2023-11-28T13:02:20.482089+0000","last_unstale":"2023-11-28T13:02:21.479866+0000","last_undegraded":"2023-11-28T13:02:21.479866+0000","last_fullsized":"2023-11-28T13:02:21.479866+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:43:39.177433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930553+0000","last_change":"2023-11-28T13:02:20.491476+0000","last_active":"2023-11-28T13:02:21.930553+0000","last_peered":"2023-11-28T13:02:21.930553+0000","last_clean":"2023-11-28T13:02:21.930553+0000","last_became_active":"2023-11-28T13:02:20.490861+0000","last_became_peered":"2023-11-28T13:02:20.490861+0000","last_unstale":"2023-11-28T13:02:21.930553+0000","last_undegraded":"2023-11-28T13:02:21.930553+0000","last_fullsized":"2023-11-28T13:02:21.930553+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:04.846165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.479047+0000","last_change":"2023-11-28T13:02:20.495760+0000","last_active":"2023-11-28T13:02:21.479047+0000","last_peered":"2023-11-28T13:02:21.479047+0000","last_clean":"2023-11-28T13:02:21.479047+0000","last_became_active":"2023-11-28T13:02:20.495452+0000","last_became_peered":"2023-11-28T13:02:20.495452+0000","last_unstale":"2023-11-28T13:02:21.479047+0000","last_undegraded":"2023-11-28T13:02:21.479047+0000","last_fullsized":"2023-11-28T13:02:21.479047+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:14.899317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.480281+0000","last_change":"2023-11-28T13:02:20.484634+0000","last_active":"2023-11-28T13:02:21.480281+0000","last_peered":"2023-11-28T13:02:21.480281+0000","last_clean":"2023-11-28T13:02:21.480281+0000","last_became_active":"2023-11-28T13:02:20.484335+0000","last_became_peered":"2023-11-28T13:02:20.484335+0000","last_unstale":"2023-11-28T13:02:21.480281+0000","last_undegraded":"2023-11-28T13:02:21.480281+0000","last_fullsized":"2023-11-28T13:02:21.480281+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:56.290302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.542145+0000","last_change":"2023-11-28T13:02:20.487057+0000","last_active":"2023-11-28T13:02:21.542145+0000","last_peered":"2023-11-28T13:02:21.542145+0000","last_clean":"2023-11-28T13:02:21.542145+0000","last_became_active":"2023-11-28T13:02:20.486774+0000","last_became_peered":"2023-11-28T13:02:20.486774+0000","last_unstale":"2023-11-28T13:02:21.542145+0000","last_undegraded":"2023-11-28T13:02:21.542145+0000","last_fullsized":"2023-11-28T13:02:21.542145+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:07:01.971923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.929733+0000","last_change":"2023-11-28T13:02:20.490526+0000","last_active":"2023-11-28T13:02:21.929733+0000","last_peered":"2023-11-28T13:02:21.929733+0000","last_clean":"2023-11-28T13:02:21.929733+0000","last_became_active":"2023-11-28T13:02:20.490260+0000","last_became_peered":"2023-11-28T13:02:20.490260+0000","last_unstale":"2023-11-28T13:02:21.929733+0000","last_undegraded":"2023-11-28T13:02:21.929733+0000","last_fullsized":"2023-11-28T13:02:21.929733+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:07.208164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.627884+0000","last_change":"2023-11-28T13:02:20.479851+0000","last_active":"2023-11-28T13:02:21.627884+0000","last_peered":"2023-11-28T13:02:21.627884+0000","last_clean":"2023-11-28T13:02:21.627884+0000","last_became_active":"2023-11-28T13:02:20.479611+0000","last_became_peered":"2023-11-28T13:02:20.479611+0000","last_unstale":"2023-11-28T13:02:21.627884+0000","last_undegraded":"2023-11-28T13:02:21.627884+0000","last_fullsized":"2023-11-28T13:02:21.627884+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:57:45.588310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.628540+0000","last_change":"2023-11-28T13:02:20.488781+0000","last_active":"2023-11-28T13:02:21.628540+0000","last_peered":"2023-11-28T13:02:21.628540+0000","last_clean":"2023-11-28T13:02:21.628540+0000","last_became_active":"2023-11-28T13:02:20.488527+0000","last_became_peered":"2023-11-28T13:02:20.488527+0000","last_unstale":"2023-11-28T13:02:21.628540+0000","last_undegraded":"2023-11-28T13:02:21.628540+0000","last_fullsized":"2023-11-28T13:02:21.628540+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:26:04.441168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.542581+0000","last_change":"2023-11-28T13:02:20.486433+0000","last_active":"2023-11-28T13:02:21.542581+0000","last_peered":"2023-11-28T13:02:21.542581+0000","last_clean":"2023-11-28T13:02:21.542581+0000","last_became_active":"2023-11-28T13:02:20.486144+0000","last_became_peered":"2023-11-28T13:02:20.486144+0000","last_unstale":"2023-11-28T13:02:21.542581+0000","last_undegraded":"2023-11-28T13:02:21.542581+0000","last_fullsized":"2023-11-28T13:02:21.542581+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:30:55.773025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.478514+0000","last_change":"2023-11-28T13:02:20.493936+0000","last_active":"2023-11-28T13:02:21.478514+0000","last_peered":"2023-11-28T13:02:21.478514+0000","last_clean":"2023-11-28T13:02:21.478514+0000","last_became_active":"2023-11-28T13:02:20.493632+0000","last_became_peered":"2023-11-28T13:02:20.493632+0000","last_unstale":"2023-11-28T13:02:21.478514+0000","last_undegraded":"2023-11-28T13:02:21.478514+0000","last_fullsized":"2023-11-28T13:02:21.478514+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:46.046956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.628435+0000","last_change":"2023-11-28T13:02:20.478090+0000","last_active":"2023-11-28T13:02:21.628435+0000","last_peered":"2023-11-28T13:02:21.628435+0000","last_clean":"2023-11-28T13:02:21.628435+0000","last_became_active":"2023-11-28T13:02:20.477827+0000","last_became_peered":"2023-11-28T13:02:20.477827+0000","last_unstale":"2023-11-28T13:02:21.628435+0000","last_undegraded":"2023-11-28T13:02:21.628435+0000","last_fullsized":"2023-11-28T13:02:21.628435+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:12.276000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.542574+0000","last_change":"2023-11-28T13:02:20.485991+0000","last_active":"2023-11-28T13:02:21.542574+0000","last_peered":"2023-11-28T13:02:21.542574+0000","last_clean":"2023-11-28T13:02:21.542574+0000","last_became_active":"2023-11-28T13:02:20.485735+0000","last_became_peered":"2023-11-28T13:02:20.485735+0000","last_unstale":"2023-11-28T13:02:21.542574+0000","last_undegraded":"2023-11-28T13:02:21.542574+0000","last_fullsized":"2023-11-28T13:02:21.542574+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:10.889203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930040+0000","last_change":"2023-11-28T13:02:20.486467+0000","last_active":"2023-11-28T13:02:21.930040+0000","last_peered":"2023-11-28T13:02:21.930040+0000","last_clean":"2023-11-28T13:02:21.930040+0000","last_became_active":"2023-11-28T13:02:20.486130+0000","last_became_peered":"2023-11-28T13:02:20.486130+0000","last_unstale":"2023-11-28T13:02:21.930040+0000","last_undegraded":"2023-11-28T13:02:21.930040+0000","last_fullsized":"2023-11-28T13:02:21.930040+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:35.993824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.478908+0000","last_change":"2023-11-28T13:02:20.482083+0000","last_active":"2023-11-28T13:02:21.478908+0000","last_peered":"2023-11-28T13:02:21.478908+0000","last_clean":"2023-11-28T13:02:21.478908+0000","last_became_active":"2023-11-28T13:02:20.481794+0000","last_became_peered":"2023-11-28T13:02:20.481794+0000","last_unstale":"2023-11-28T13:02:21.478908+0000","last_undegraded":"2023-11-28T13:02:21.478908+0000","last_fullsized":"2023-11-28T13:02:21.478908+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:58.879685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.542000+0000","last_change":"2023-11-28T13:02:20.486293+0000","last_active":"2023-11-28T13:02:21.542000+0000","last_peered":"2023-11-28T13:02:21.542000+0000","last_clean":"2023-11-28T13:02:21.542000+0000","last_became_active":"2023-11-28T13:02:20.485544+0000","last_became_peered":"2023-11-28T13:02:20.485544+0000","last_unstale":"2023-11-28T13:02:21.542000+0000","last_undegraded":"2023-11-28T13:02:21.542000+0000","last_fullsized":"2023-11-28T13:02:21.542000+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:15:57.255807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930805+0000","last_change":"2023-11-28T13:02:20.487538+0000","last_active":"2023-11-28T13:02:21.930805+0000","last_peered":"2023-11-28T13:02:21.930805+0000","last_clean":"2023-11-28T13:02:21.930805+0000","last_became_active":"2023-11-28T13:02:20.487292+0000","last_became_peered":"2023-11-28T13:02:20.487292+0000","last_unstale":"2023-11-28T13:02:21.930805+0000","last_undegraded":"2023-11-28T13:02:21.930805+0000","last_fullsized":"2023-11-28T13:02:21.930805+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:46:45.783765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.479908+0000","last_change":"2023-11-28T13:02:20.487859+0000","last_active":"2023-11-28T13:02:21.479908+0000","last_peered":"2023-11-28T13:02:21.479908+0000","last_clean":"2023-11-28T13:02:21.479908+0000","last_became_active":"2023-11-28T13:02:20.486314+0000","last_became_peered":"2023-11-28T13:02:20.486314+0000","last_unstale":"2023-11-28T13:02:21.479908+0000","last_undegraded":"2023-11-28T13:02:21.479908+0000","last_fullsized":"2023-11-28T13:02:21.479908+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:37:29.772655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930579+0000","last_change":"2023-11-28T13:02:20.491129+0000","last_active":"2023-11-28T13:02:21.930579+0000","last_peered":"2023-11-28T13:02:21.930579+0000","last_clean":"2023-11-28T13:02:21.930579+0000","last_became_active":"2023-11-28T13:02:20.488097+0000","last_became_peered":"2023-11-28T13:02:20.488097+0000","last_unstale":"2023-11-28T13:02:21.930579+0000","last_undegraded":"2023-11-28T13:02:21.930579+0000","last_fullsized":"2023-11-28T13:02:21.930579+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:46:00.288275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930963+0000","last_change":"2023-11-28T13:02:20.486860+0000","last_active":"2023-11-28T13:02:21.930963+0000","last_peered":"2023-11-28T13:02:21.930963+0000","last_clean":"2023-11-28T13:02:21.930963+0000","last_became_active":"2023-11-28T13:02:20.486511+0000","last_became_peered":"2023-11-28T13:02:20.486511+0000","last_unstale":"2023-11-28T13:02:21.930963+0000","last_undegraded":"2023-11-28T13:02:21.930963+0000","last_fullsized":"2023-11-28T13:02:21.930963+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:19:37.170900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930406+0000","last_change":"2023-11-28T13:02:20.483448+0000","last_active":"2023-11-28T13:02:21.930406+0000","last_peered":"2023-11-28T13:02:21.930406+0000","last_clean":"2023-11-28T13:02:21.930406+0000","last_became_active":"2023-11-28T13:02:20.482833+0000","last_became_peered":"2023-11-28T13:02:20.482833+0000","last_unstale":"2023-11-28T13:02:21.930406+0000","last_undegraded":"2023-11-28T13:02:21.930406+0000","last_fullsized":"2023-11-28T13:02:21.930406+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:18.202627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.627987+0000","last_change":"2023-11-28T13:02:20.482191+0000","last_active":"2023-11-28T13:02:21.627987+0000","last_peered":"2023-11-28T13:02:21.627987+0000","last_clean":"2023-11-28T13:02:21.627987+0000","last_became_active":"2023-11-28T13:02:20.481872+0000","last_became_peered":"2023-11-28T13:02:20.481872+0000","last_unstale":"2023-11-28T13:02:21.627987+0000","last_undegraded":"2023-11-28T13:02:21.627987+0000","last_fullsized":"2023-11-28T13:02:21.627987+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:54.660349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.477943+0000","last_change":"2023-11-28T13:02:20.493950+0000","last_active":"2023-11-28T13:02:21.477943+0000","last_peered":"2023-11-28T13:02:21.477943+0000","last_clean":"2023-11-28T13:02:21.477943+0000","last_became_active":"2023-11-28T13:02:20.493627+0000","last_became_peered":"2023-11-28T13:02:20.493627+0000","last_unstale":"2023-11-28T13:02:21.477943+0000","last_undegraded":"2023-11-28T13:02:21.477943+0000","last_fullsized":"2023-11-28T13:02:21.477943+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:32.942792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.929505+0000","last_change":"2023-11-28T13:02:20.486502+0000","last_active":"2023-11-28T13:02:21.929505+0000","last_peered":"2023-11-28T13:02:21.929505+0000","last_clean":"2023-11-28T13:02:21.929505+0000","last_became_active":"2023-11-28T13:02:20.486220+0000","last_became_peered":"2023-11-28T13:02:20.486220+0000","last_unstale":"2023-11-28T13:02:21.929505+0000","last_undegraded":"2023-11-28T13:02:21.929505+0000","last_fullsized":"2023-11-28T13:02:21.929505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:50.016629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.931291+0000","last_change":"2023-11-28T13:02:20.497629+0000","last_active":"2023-11-28T13:02:21.931291+0000","last_peered":"2023-11-28T13:02:21.931291+0000","last_clean":"2023-11-28T13:02:21.931291+0000","last_became_active":"2023-11-28T13:02:20.497358+0000","last_became_peered":"2023-11-28T13:02:20.497358+0000","last_unstale":"2023-11-28T13:02:21.931291+0000","last_undegraded":"2023-11-28T13:02:21.931291+0000","last_fullsized":"2023-11-28T13:02:21.931291+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:12.049704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.628327+0000","last_change":"2023-11-28T13:02:20.490716+0000","last_active":"2023-11-28T13:02:21.628327+0000","last_peered":"2023-11-28T13:02:21.628327+0000","last_clean":"2023-11-28T13:02:21.628327+0000","last_became_active":"2023-11-28T13:02:20.490210+0000","last_became_peered":"2023-11-28T13:02:20.490210+0000","last_unstale":"2023-11-28T13:02:21.628327+0000","last_undegraded":"2023-11-28T13:02:21.628327+0000","last_fullsized":"2023-11-28T13:02:21.628327+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:29:36.605472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.542913+0000","last_change":"2023-11-28T13:02:20.487186+0000","last_active":"2023-11-28T13:02:21.542913+0000","last_peered":"2023-11-28T13:02:21.542913+0000","last_clean":"2023-11-28T13:02:21.542913+0000","last_became_active":"2023-11-28T13:02:20.486733+0000","last_became_peered":"2023-11-28T13:02:20.486733+0000","last_unstale":"2023-11-28T13:02:21.542913+0000","last_undegraded":"2023-11-28T13:02:21.542913+0000","last_fullsized":"2023-11-28T13:02:21.542913+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:33.321509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.931199+0000","last_change":"2023-11-28T13:02:20.479504+0000","last_active":"2023-11-28T13:02:21.931199+0000","last_peered":"2023-11-28T13:02:21.931199+0000","last_clean":"2023-11-28T13:02:21.931199+0000","last_became_active":"2023-11-28T13:02:20.479202+0000","last_became_peered":"2023-11-28T13:02:20.479202+0000","last_unstale":"2023-11-28T13:02:21.931199+0000","last_undegraded":"2023-11-28T13:02:21.931199+0000","last_fullsized":"2023-11-28T13:02:21.931199+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:13:52.276112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930068+0000","last_change":"2023-11-28T13:02:20.487430+0000","last_active":"2023-11-28T13:02:21.930068+0000","last_peered":"2023-11-28T13:02:21.930068+0000","last_clean":"2023-11-28T13:02:21.930068+0000","last_became_active":"2023-11-28T13:02:20.487161+0000","last_became_peered":"2023-11-28T13:02:20.487161+0000","last_unstale":"2023-11-28T13:02:21.930068+0000","last_undegraded":"2023-11-28T13:02:21.930068+0000","last_fullsized":"2023-11-28T13:02:21.930068+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:26:04.441168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.479168+0000","last_change":"2023-11-28T13:02:20.488234+0000","last_active":"2023-11-28T13:02:21.479168+0000","last_peered":"2023-11-28T13:02:21.479168+0000","last_clean":"2023-11-28T13:02:21.479168+0000","last_became_active":"2023-11-28T13:02:20.487819+0000","last_became_peered":"2023-11-28T13:02:20.487819+0000","last_unstale":"2023-11-28T13:02:21.479168+0000","last_undegraded":"2023-11-28T13:02:21.479168+0000","last_fullsized":"2023-11-28T13:02:21.479168+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:03:57.222909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.929833+0000","last_change":"2023-11-28T13:02:20.482478+0000","last_active":"2023-11-28T13:02:21.929833+0000","last_peered":"2023-11-28T13:02:21.929833+0000","last_clean":"2023-11-28T13:02:21.929833+0000","last_became_active":"2023-11-28T13:02:20.482209+0000","last_became_peered":"2023-11-28T13:02:20.482209+0000","last_unstale":"2023-11-28T13:02:21.929833+0000","last_undegraded":"2023-11-28T13:02:21.929833+0000","last_fullsized":"2023-11-28T13:02:21.929833+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:43:13.793803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.929653+0000","last_change":"2023-11-28T13:02:20.496749+0000","last_active":"2023-11-28T13:02:21.929653+0000","last_peered":"2023-11-28T13:02:21.929653+0000","last_clean":"2023-11-28T13:02:21.929653+0000","last_became_active":"2023-11-28T13:02:20.496498+0000","last_became_peered":"2023-11-28T13:02:20.496498+0000","last_unstale":"2023-11-28T13:02:21.929653+0000","last_undegraded":"2023-11-28T13:02:21.929653+0000","last_fullsized":"2023-11-28T13:02:21.929653+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:26.009180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.478612+0000","last_change":"2023-11-28T13:02:20.487736+0000","last_active":"2023-11-28T13:02:21.478612+0000","last_peered":"2023-11-28T13:02:21.478612+0000","last_clean":"2023-11-28T13:02:21.478612+0000","last_became_active":"2023-11-28T13:02:20.485509+0000","last_became_peered":"2023-11-28T13:02:20.485509+0000","last_unstale":"2023-11-28T13:02:21.478612+0000","last_undegraded":"2023-11-28T13:02:21.478612+0000","last_fullsized":"2023-11-28T13:02:21.478612+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:44:43.901562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.483882+0000","last_change":"2023-11-28T13:02:20.097519+0000","last_active":"2023-11-28T13:02:20.483882+0000","last_peered":"2023-11-28T13:02:20.483882+0000","last_clean":"2023-11-28T13:02:20.483882+0000","last_became_active":"2023-11-28T13:02:20.097217+0000","last_became_peered":"2023-11-28T13:02:20.097217+0000","last_unstale":"2023-11-28T13:02:20.483882+0000","last_undegraded":"2023-11-28T13:02:20.483882+0000","last_fullsized":"2023-11-28T13:02:20.483882+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:12.209141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.929578+0000","last_change":"2023-11-28T13:02:20.492125+0000","last_active":"2023-11-28T13:02:21.929578+0000","last_peered":"2023-11-28T13:02:21.929578+0000","last_clean":"2023-11-28T13:02:21.929578+0000","last_became_active":"2023-11-28T13:02:20.491809+0000","last_became_peered":"2023-11-28T13:02:20.491809+0000","last_unstale":"2023-11-28T13:02:21.929578+0000","last_undegraded":"2023-11-28T13:02:21.929578+0000","last_fullsized":"2023-11-28T13:02:21.929578+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:58.879685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.497807+0000","last_change":"2023-11-28T13:02:20.106059+0000","last_active":"2023-11-28T13:02:20.497807+0000","last_peered":"2023-11-28T13:02:20.497807+0000","last_clean":"2023-11-28T13:02:20.497807+0000","last_became_active":"2023-11-28T13:02:20.105774+0000","last_became_peered":"2023-11-28T13:02:20.105774+0000","last_unstale":"2023-11-28T13:02:20.497807+0000","last_undegraded":"2023-11-28T13:02:20.497807+0000","last_fullsized":"2023-11-28T13:02:20.497807+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:19.032803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.929640+0000","last_change":"2023-11-28T13:02:20.483418+0000","last_active":"2023-11-28T13:02:21.929640+0000","last_peered":"2023-11-28T13:02:21.929640+0000","last_clean":"2023-11-28T13:02:21.929640+0000","last_became_active":"2023-11-28T13:02:20.482896+0000","last_became_peered":"2023-11-28T13:02:20.482896+0000","last_unstale":"2023-11-28T13:02:21.929640+0000","last_undegraded":"2023-11-28T13:02:21.929640+0000","last_fullsized":"2023-11-28T13:02:21.929640+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:34:42.393542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.487496+0000","last_change":"2023-11-28T13:02:20.102685+0000","last_active":"2023-11-28T13:02:20.487496+0000","last_peered":"2023-11-28T13:02:20.487496+0000","last_clean":"2023-11-28T13:02:20.487496+0000","last_became_active":"2023-11-28T13:02:20.102498+0000","last_became_peered":"2023-11-28T13:02:20.102498+0000","last_unstale":"2023-11-28T13:02:20.487496+0000","last_undegraded":"2023-11-28T13:02:20.487496+0000","last_fullsized":"2023-11-28T13:02:20.487496+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:24.782403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.628053+0000","last_change":"2023-11-28T13:02:20.482127+0000","last_active":"2023-11-28T13:02:21.628053+0000","last_peered":"2023-11-28T13:02:21.628053+0000","last_clean":"2023-11-28T13:02:21.628053+0000","last_became_active":"2023-11-28T13:02:20.481817+0000","last_became_peered":"2023-11-28T13:02:20.481817+0000","last_unstale":"2023-11-28T13:02:21.628053+0000","last_undegraded":"2023-11-28T13:02:21.628053+0000","last_fullsized":"2023-11-28T13:02:21.628053+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:46:45.783765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.496742+0000","last_change":"2023-11-28T13:02:20.104723+0000","last_active":"2023-11-28T13:02:20.496742+0000","last_peered":"2023-11-28T13:02:20.496742+0000","last_clean":"2023-11-28T13:02:20.496742+0000","last_became_active":"2023-11-28T13:02:20.104416+0000","last_became_peered":"2023-11-28T13:02:20.104416+0000","last_unstale":"2023-11-28T13:02:20.496742+0000","last_undegraded":"2023-11-28T13:02:20.496742+0000","last_fullsized":"2023-11-28T13:02:20.496742+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:14.909436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.480203+0000","last_change":"2023-11-28T13:02:20.485128+0000","last_active":"2023-11-28T13:02:21.480203+0000","last_peered":"2023-11-28T13:02:21.480203+0000","last_clean":"2023-11-28T13:02:21.480203+0000","last_became_active":"2023-11-28T13:02:20.484810+0000","last_became_peered":"2023-11-28T13:02:20.484810+0000","last_unstale":"2023-11-28T13:02:21.480203+0000","last_undegraded":"2023-11-28T13:02:21.480203+0000","last_fullsized":"2023-11-28T13:02:21.480203+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:14.899317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.487985+0000","last_change":"2023-11-28T13:02:20.103735+0000","last_active":"2023-11-28T13:02:20.487985+0000","last_peered":"2023-11-28T13:02:20.487985+0000","last_clean":"2023-11-28T13:02:20.487985+0000","last_became_active":"2023-11-28T13:02:20.103445+0000","last_became_peered":"2023-11-28T13:02:20.103445+0000","last_unstale":"2023-11-28T13:02:20.487985+0000","last_undegraded":"2023-11-28T13:02:20.487985+0000","last_fullsized":"2023-11-28T13:02:20.487985+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:47.914711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.479325+0000","last_change":"2023-11-28T13:02:20.488147+0000","last_active":"2023-11-28T13:02:21.479325+0000","last_peered":"2023-11-28T13:02:21.479325+0000","last_clean":"2023-11-28T13:02:21.479325+0000","last_became_active":"2023-11-28T13:02:20.487310+0000","last_became_peered":"2023-11-28T13:02:20.487310+0000","last_unstale":"2023-11-28T13:02:21.479325+0000","last_undegraded":"2023-11-28T13:02:21.479325+0000","last_fullsized":"2023-11-28T13:02:21.479325+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:42.036693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.479420+0000","last_change":"2023-11-28T13:02:20.100899+0000","last_active":"2023-11-28T13:02:20.479420+0000","last_peered":"2023-11-28T13:02:20.479420+0000","last_clean":"2023-11-28T13:02:20.479420+0000","last_became_active":"2023-11-28T13:02:20.100613+0000","last_became_peered":"2023-11-28T13:02:20.100613+0000","last_unstale":"2023-11-28T13:02:20.479420+0000","last_undegraded":"2023-11-28T13:02:20.479420+0000","last_fullsized":"2023-11-28T13:02:20.479420+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:19.257824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.628742+0000","last_change":"2023-11-28T13:02:20.490879+0000","last_active":"2023-11-28T13:02:21.628742+0000","last_peered":"2023-11-28T13:02:21.628742+0000","last_clean":"2023-11-28T13:02:21.628742+0000","last_became_active":"2023-11-28T13:02:20.490524+0000","last_became_peered":"2023-11-28T13:02:20.490524+0000","last_unstale":"2023-11-28T13:02:21.628742+0000","last_undegraded":"2023-11-28T13:02:21.628742+0000","last_fullsized":"2023-11-28T13:02:21.628742+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:46:00.288275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.471438+0000","last_change":"2023-11-28T13:02:20.097706+0000","last_active":"2023-11-28T13:02:20.471438+0000","last_peered":"2023-11-28T13:02:20.471438+0000","last_clean":"2023-11-28T13:02:20.471438+0000","last_became_active":"2023-11-28T13:02:20.097439+0000","last_became_peered":"2023-11-28T13:02:20.097439+0000","last_unstale":"2023-11-28T13:02:20.471438+0000","last_undegraded":"2023-11-28T13:02:20.471438+0000","last_fullsized":"2023-11-28T13:02:20.471438+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:55:18.096845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.479758+0000","last_change":"2023-11-28T13:02:20.482634+0000","last_active":"2023-11-28T13:02:21.479758+0000","last_peered":"2023-11-28T13:02:21.479758+0000","last_clean":"2023-11-28T13:02:21.479758+0000","last_became_active":"2023-11-28T13:02:20.482245+0000","last_became_peered":"2023-11-28T13:02:20.482245+0000","last_unstale":"2023-11-28T13:02:21.479758+0000","last_undegraded":"2023-11-28T13:02:21.479758+0000","last_fullsized":"2023-11-28T13:02:21.479758+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:28:46.196825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.478803+0000","last_change":"2023-11-28T13:02:20.098506+0000","last_active":"2023-11-28T13:02:20.478803+0000","last_peered":"2023-11-28T13:02:20.478803+0000","last_clean":"2023-11-28T13:02:20.478803+0000","last_became_active":"2023-11-28T13:02:20.098104+0000","last_became_peered":"2023-11-28T13:02:20.098104+0000","last_unstale":"2023-11-28T13:02:20.478803+0000","last_undegraded":"2023-11-28T13:02:20.478803+0000","last_fullsized":"2023-11-28T13:02:20.478803+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:07:00.966797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.479463+0000","last_change":"2023-11-28T13:02:20.490770+0000","last_active":"2023-11-28T13:02:21.479463+0000","last_peered":"2023-11-28T13:02:21.479463+0000","last_clean":"2023-11-28T13:02:21.479463+0000","last_became_active":"2023-11-28T13:02:20.490418+0000","last_became_peered":"2023-11-28T13:02:20.490418+0000","last_unstale":"2023-11-28T13:02:21.479463+0000","last_undegraded":"2023-11-28T13:02:21.479463+0000","last_fullsized":"2023-11-28T13:02:21.479463+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:28:46.196825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.472947+0000","last_change":"2023-11-28T13:02:20.097662+0000","last_active":"2023-11-28T13:02:20.472947+0000","last_peered":"2023-11-28T13:02:20.472947+0000","last_clean":"2023-11-28T13:02:20.472947+0000","last_became_active":"2023-11-28T13:02:20.097360+0000","last_became_peered":"2023-11-28T13:02:20.097360+0000","last_unstale":"2023-11-28T13:02:20.472947+0000","last_undegraded":"2023-11-28T13:02:20.472947+0000","last_fullsized":"2023-11-28T13:02:20.472947+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:47.491241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.929745+0000","last_change":"2023-11-28T13:02:20.481622+0000","last_active":"2023-11-28T13:02:21.929745+0000","last_peered":"2023-11-28T13:02:21.929745+0000","last_clean":"2023-11-28T13:02:21.929745+0000","last_became_active":"2023-11-28T13:02:20.481372+0000","last_became_peered":"2023-11-28T13:02:20.481372+0000","last_unstale":"2023-11-28T13:02:21.929745+0000","last_undegraded":"2023-11-28T13:02:21.929745+0000","last_fullsized":"2023-11-28T13:02:21.929745+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:44:43.901562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.469727+0000","last_change":"2023-11-28T13:02:20.094157+0000","last_active":"2023-11-28T13:02:20.469727+0000","last_peered":"2023-11-28T13:02:20.469727+0000","last_clean":"2023-11-28T13:02:20.469727+0000","last_became_active":"2023-11-28T13:02:20.093826+0000","last_became_peered":"2023-11-28T13:02:20.093826+0000","last_unstale":"2023-11-28T13:02:20.469727+0000","last_undegraded":"2023-11-28T13:02:20.469727+0000","last_fullsized":"2023-11-28T13:02:20.469727+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:33:36.451705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930127+0000","last_change":"2023-11-28T13:02:20.482901+0000","last_active":"2023-11-28T13:02:21.930127+0000","last_peered":"2023-11-28T13:02:21.930127+0000","last_clean":"2023-11-28T13:02:21.930127+0000","last_became_active":"2023-11-28T13:02:20.482661+0000","last_became_peered":"2023-11-28T13:02:20.482661+0000","last_unstale":"2023-11-28T13:02:21.930127+0000","last_undegraded":"2023-11-28T13:02:21.930127+0000","last_fullsized":"2023-11-28T13:02:21.930127+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:12.276000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.487443+0000","last_change":"2023-11-28T13:02:20.103164+0000","last_active":"2023-11-28T13:02:20.487443+0000","last_peered":"2023-11-28T13:02:20.487443+0000","last_clean":"2023-11-28T13:02:20.487443+0000","last_became_active":"2023-11-28T13:02:20.102765+0000","last_became_peered":"2023-11-28T13:02:20.102765+0000","last_unstale":"2023-11-28T13:02:20.487443+0000","last_undegraded":"2023-11-28T13:02:20.487443+0000","last_fullsized":"2023-11-28T13:02:20.487443+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:54.789622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.480113+0000","last_change":"2023-11-28T13:02:20.481286+0000","last_active":"2023-11-28T13:02:21.480113+0000","last_peered":"2023-11-28T13:02:21.480113+0000","last_clean":"2023-11-28T13:02:21.480113+0000","last_became_active":"2023-11-28T13:02:20.480771+0000","last_became_peered":"2023-11-28T13:02:20.480771+0000","last_unstale":"2023-11-28T13:02:21.480113+0000","last_undegraded":"2023-11-28T13:02:21.480113+0000","last_fullsized":"2023-11-28T13:02:21.480113+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:43:39.177433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.499168+0000","last_change":"2023-11-28T13:02:20.103851+0000","last_active":"2023-11-28T13:02:20.499168+0000","last_peered":"2023-11-28T13:02:20.499168+0000","last_clean":"2023-11-28T13:02:20.499168+0000","last_became_active":"2023-11-28T13:02:20.103578+0000","last_became_peered":"2023-11-28T13:02:20.103578+0000","last_unstale":"2023-11-28T13:02:20.499168+0000","last_undegraded":"2023-11-28T13:02:20.499168+0000","last_fullsized":"2023-11-28T13:02:20.499168+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:47.914711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930291+0000","last_change":"2023-11-28T13:02:20.492538+0000","last_active":"2023-11-28T13:02:21.930291+0000","last_peered":"2023-11-28T13:02:21.930291+0000","last_clean":"2023-11-28T13:02:21.930291+0000","last_became_active":"2023-11-28T13:02:20.491849+0000","last_became_peered":"2023-11-28T13:02:20.491849+0000","last_unstale":"2023-11-28T13:02:21.930291+0000","last_undegraded":"2023-11-28T13:02:21.930291+0000","last_fullsized":"2023-11-28T13:02:21.930291+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:37:29.772655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.492620+0000","last_change":"2023-11-28T13:02:20.094131+0000","last_active":"2023-11-28T13:02:20.492620+0000","last_peered":"2023-11-28T13:02:20.492620+0000","last_clean":"2023-11-28T13:02:20.492620+0000","last_became_active":"2023-11-28T13:02:20.093677+0000","last_became_peered":"2023-11-28T13:02:20.093677+0000","last_unstale":"2023-11-28T13:02:20.492620+0000","last_undegraded":"2023-11-28T13:02:20.492620+0000","last_fullsized":"2023-11-28T13:02:20.492620+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:14.909436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930834+0000","last_change":"2023-11-28T13:02:20.491326+0000","last_active":"2023-11-28T13:02:21.930834+0000","last_peered":"2023-11-28T13:02:21.930834+0000","last_clean":"2023-11-28T13:02:21.930834+0000","last_became_active":"2023-11-28T13:02:20.488372+0000","last_became_peered":"2023-11-28T13:02:20.488372+0000","last_unstale":"2023-11-28T13:02:21.930834+0000","last_undegraded":"2023-11-28T13:02:21.930834+0000","last_fullsized":"2023-11-28T13:02:21.930834+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:29:36.605472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.471902+0000","last_change":"2023-11-28T13:02:20.108552+0000","last_active":"2023-11-28T13:02:20.471902+0000","last_peered":"2023-11-28T13:02:20.471902+0000","last_clean":"2023-11-28T13:02:20.471902+0000","last_became_active":"2023-11-28T13:02:20.108180+0000","last_became_peered":"2023-11-28T13:02:20.108180+0000","last_unstale":"2023-11-28T13:02:20.471902+0000","last_undegraded":"2023-11-28T13:02:20.471902+0000","last_fullsized":"2023-11-28T13:02:20.471902+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:31.937666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.628557+0000","last_change":"2023-11-28T13:02:20.491060+0000","last_active":"2023-11-28T13:02:21.628557+0000","last_peered":"2023-11-28T13:02:21.628557+0000","last_clean":"2023-11-28T13:02:21.628557+0000","last_became_active":"2023-11-28T13:02:20.490815+0000","last_became_peered":"2023-11-28T13:02:20.490815+0000","last_unstale":"2023-11-28T13:02:21.628557+0000","last_undegraded":"2023-11-28T13:02:21.628557+0000","last_fullsized":"2023-11-28T13:02:21.628557+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:04:19.965382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.470062+0000","last_change":"2023-11-28T13:02:20.100521+0000","last_active":"2023-11-28T13:02:20.470062+0000","last_peered":"2023-11-28T13:02:20.470062+0000","last_clean":"2023-11-28T13:02:20.470062+0000","last_became_active":"2023-11-28T13:02:20.100173+0000","last_became_peered":"2023-11-28T13:02:20.100173+0000","last_unstale":"2023-11-28T13:02:20.470062+0000","last_undegraded":"2023-11-28T13:02:20.470062+0000","last_fullsized":"2023-11-28T13:02:20.470062+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:37.011377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.931119+0000","last_change":"2023-11-28T13:02:20.486512+0000","last_active":"2023-11-28T13:02:21.931119+0000","last_peered":"2023-11-28T13:02:21.931119+0000","last_clean":"2023-11-28T13:02:21.931119+0000","last_became_active":"2023-11-28T13:02:20.486161+0000","last_became_peered":"2023-11-28T13:02:20.486161+0000","last_unstale":"2023-11-28T13:02:21.931119+0000","last_undegraded":"2023-11-28T13:02:21.931119+0000","last_fullsized":"2023-11-28T13:02:21.931119+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:54.660349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.496415+0000","last_change":"2023-11-28T13:02:20.103804+0000","last_active":"2023-11-28T13:02:20.496415+0000","last_peered":"2023-11-28T13:02:20.496415+0000","last_clean":"2023-11-28T13:02:20.496415+0000","last_became_active":"2023-11-28T13:02:20.103068+0000","last_became_peered":"2023-11-28T13:02:20.103068+0000","last_unstale":"2023-11-28T13:02:20.496415+0000","last_undegraded":"2023-11-28T13:02:20.496415+0000","last_fullsized":"2023-11-28T13:02:20.496415+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:55.285175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.628357+0000","last_change":"2023-11-28T13:02:20.490605+0000","last_active":"2023-11-28T13:02:21.628357+0000","last_peered":"2023-11-28T13:02:21.628357+0000","last_clean":"2023-11-28T13:02:21.628357+0000","last_became_active":"2023-11-28T13:02:20.490245+0000","last_became_peered":"2023-11-28T13:02:20.490245+0000","last_unstale":"2023-11-28T13:02:21.628357+0000","last_undegraded":"2023-11-28T13:02:21.628357+0000","last_fullsized":"2023-11-28T13:02:21.628357+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:39:27.639303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.497369+0000","last_change":"2023-11-28T13:02:20.105396+0000","last_active":"2023-11-28T13:02:20.497369+0000","last_peered":"2023-11-28T13:02:20.497369+0000","last_clean":"2023-11-28T13:02:20.497369+0000","last_became_active":"2023-11-28T13:02:20.105115+0000","last_became_peered":"2023-11-28T13:02:20.105115+0000","last_unstale":"2023-11-28T13:02:20.497369+0000","last_undegraded":"2023-11-28T13:02:20.497369+0000","last_fullsized":"2023-11-28T13:02:20.497369+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:15:56.250681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.542045+0000","last_change":"2023-11-28T13:02:20.482763+0000","last_active":"2023-11-28T13:02:21.542045+0000","last_peered":"2023-11-28T13:02:21.542045+0000","last_clean":"2023-11-28T13:02:21.542045+0000","last_became_active":"2023-11-28T13:02:20.482549+0000","last_became_peered":"2023-11-28T13:02:20.482549+0000","last_unstale":"2023-11-28T13:02:21.542045+0000","last_undegraded":"2023-11-28T13:02:21.542045+0000","last_fullsized":"2023-11-28T13:02:21.542045+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:56.290302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.491539+0000","last_change":"2023-11-28T13:02:20.102513+0000","last_active":"2023-11-28T13:02:20.491539+0000","last_peered":"2023-11-28T13:02:20.491539+0000","last_clean":"2023-11-28T13:02:20.491539+0000","last_became_active":"2023-11-28T13:02:20.102256+0000","last_became_peered":"2023-11-28T13:02:20.102256+0000","last_unstale":"2023-11-28T13:02:20.491539+0000","last_undegraded":"2023-11-28T13:02:20.491539+0000","last_fullsized":"2023-11-28T13:02:20.491539+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:56:09.688582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.479557+0000","last_change":"2023-11-28T13:02:20.485072+0000","last_active":"2023-11-28T13:02:21.479557+0000","last_peered":"2023-11-28T13:02:21.479557+0000","last_clean":"2023-11-28T13:02:21.479557+0000","last_became_active":"2023-11-28T13:02:20.483997+0000","last_became_peered":"2023-11-28T13:02:20.483997+0000","last_unstale":"2023-11-28T13:02:21.479557+0000","last_undegraded":"2023-11-28T13:02:21.479557+0000","last_fullsized":"2023-11-28T13:02:21.479557+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:37:29.772655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.487275+0000","last_change":"2023-11-28T13:02:20.107738+0000","last_active":"2023-11-28T13:02:20.487275+0000","last_peered":"2023-11-28T13:02:20.487275+0000","last_clean":"2023-11-28T13:02:20.487275+0000","last_became_active":"2023-11-28T13:02:20.107480+0000","last_became_peered":"2023-11-28T13:02:20.107480+0000","last_unstale":"2023-11-28T13:02:20.487275+0000","last_undegraded":"2023-11-28T13:02:20.487275+0000","last_fullsized":"2023-11-28T13:02:20.487275+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:24:50.411915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.542330+0000","last_change":"2023-11-28T13:02:20.486597+0000","last_active":"2023-11-28T13:02:21.542330+0000","last_peered":"2023-11-28T13:02:21.542330+0000","last_clean":"2023-11-28T13:02:21.542330+0000","last_became_active":"2023-11-28T13:02:20.485110+0000","last_became_peered":"2023-11-28T13:02:20.485110+0000","last_unstale":"2023-11-28T13:02:21.542330+0000","last_undegraded":"2023-11-28T13:02:21.542330+0000","last_fullsized":"2023-11-28T13:02:21.542330+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:33:37.456831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.472779+0000","last_change":"2023-11-28T13:02:20.100922+0000","last_active":"2023-11-28T13:02:20.472779+0000","last_peered":"2023-11-28T13:02:20.472779+0000","last_clean":"2023-11-28T13:02:20.472779+0000","last_became_active":"2023-11-28T13:02:20.100519+0000","last_became_peered":"2023-11-28T13:02:20.100519+0000","last_unstale":"2023-11-28T13:02:20.472779+0000","last_undegraded":"2023-11-28T13:02:20.472779+0000","last_fullsized":"2023-11-28T13:02:20.472779+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:45.041829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930512+0000","last_change":"2023-11-28T13:02:20.487025+0000","last_active":"2023-11-28T13:02:21.930512+0000","last_peered":"2023-11-28T13:02:21.930512+0000","last_clean":"2023-11-28T13:02:21.930512+0000","last_became_active":"2023-11-28T13:02:20.486686+0000","last_became_peered":"2023-11-28T13:02:20.486686+0000","last_unstale":"2023-11-28T13:02:21.930512+0000","last_undegraded":"2023-11-28T13:02:21.930512+0000","last_fullsized":"2023-11-28T13:02:21.930512+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:14.899317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.486958+0000","last_change":"2023-11-28T13:02:20.099308+0000","last_active":"2023-11-28T13:02:20.486958+0000","last_peered":"2023-11-28T13:02:20.486958+0000","last_clean":"2023-11-28T13:02:20.486958+0000","last_became_active":"2023-11-28T13:02:20.099051+0000","last_became_peered":"2023-11-28T13:02:20.099051+0000","last_unstale":"2023-11-28T13:02:20.486958+0000","last_undegraded":"2023-11-28T13:02:20.486958+0000","last_fullsized":"2023-11-28T13:02:20.486958+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:14:46.191864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930661+0000","last_change":"2023-11-28T13:02:20.483545+0000","last_active":"2023-11-28T13:02:21.930661+0000","last_peered":"2023-11-28T13:02:21.930661+0000","last_clean":"2023-11-28T13:02:21.930661+0000","last_became_active":"2023-11-28T13:02:20.483189+0000","last_became_peered":"2023-11-28T13:02:20.483189+0000","last_unstale":"2023-11-28T13:02:21.930661+0000","last_undegraded":"2023-11-28T13:02:21.930661+0000","last_fullsized":"2023-11-28T13:02:21.930661+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:08.280978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.463866+0000","last_change":"2023-11-28T13:02:20.106651+0000","last_active":"2023-11-28T13:02:20.463866+0000","last_peered":"2023-11-28T13:02:20.463866+0000","last_clean":"2023-11-28T13:02:20.463866+0000","last_became_active":"2023-11-28T13:02:20.106340+0000","last_became_peered":"2023-11-28T13:02:20.106340+0000","last_unstale":"2023-11-28T13:02:20.463866+0000","last_undegraded":"2023-11-28T13:02:20.463866+0000","last_fullsized":"2023-11-28T13:02:20.463866+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:28:45.191699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930857+0000","last_change":"2023-11-28T13:02:20.484587+0000","last_active":"2023-11-28T13:02:21.930857+0000","last_peered":"2023-11-28T13:02:21.930857+0000","last_clean":"2023-11-28T13:02:21.930857+0000","last_became_active":"2023-11-28T13:02:20.484352+0000","last_became_peered":"2023-11-28T13:02:20.484352+0000","last_unstale":"2023-11-28T13:02:21.930857+0000","last_undegraded":"2023-11-28T13:02:21.930857+0000","last_fullsized":"2023-11-28T13:02:21.930857+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:26.231477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.479762+0000","last_change":"2023-11-28T13:02:20.103739+0000","last_active":"2023-11-28T13:02:20.479762+0000","last_peered":"2023-11-28T13:02:20.479762+0000","last_clean":"2023-11-28T13:02:20.479762+0000","last_became_active":"2023-11-28T13:02:20.103467+0000","last_became_peered":"2023-11-28T13:02:20.103467+0000","last_unstale":"2023-11-28T13:02:20.479762+0000","last_undegraded":"2023-11-28T13:02:20.479762+0000","last_fullsized":"2023-11-28T13:02:20.479762+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:30:54.767899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.542546+0000","last_change":"2023-11-28T13:02:20.496378+0000","last_active":"2023-11-28T13:02:21.542546+0000","last_peered":"2023-11-28T13:02:21.542546+0000","last_clean":"2023-11-28T13:02:21.542546+0000","last_became_active":"2023-11-28T13:02:20.496105+0000","last_became_peered":"2023-11-28T13:02:20.496105+0000","last_unstale":"2023-11-28T13:02:21.542546+0000","last_undegraded":"2023-11-28T13:02:21.542546+0000","last_fullsized":"2023-11-28T13:02:21.542546+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:48.919837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.472735+0000","last_change":"2023-11-28T13:02:20.105836+0000","last_active":"2023-11-28T13:02:20.472735+0000","last_peered":"2023-11-28T13:02:20.472735+0000","last_clean":"2023-11-28T13:02:20.472735+0000","last_became_active":"2023-11-28T13:02:20.105637+0000","last_became_peered":"2023-11-28T13:02:20.105637+0000","last_unstale":"2023-11-28T13:02:20.472735+0000","last_undegraded":"2023-11-28T13:02:20.472735+0000","last_fullsized":"2023-11-28T13:02:20.472735+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:43.577442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.929637+0000","last_change":"2023-11-28T13:02:20.484753+0000","last_active":"2023-11-28T13:02:21.929637+0000","last_peered":"2023-11-28T13:02:21.929637+0000","last_clean":"2023-11-28T13:02:21.929637+0000","last_became_active":"2023-11-28T13:02:20.484467+0000","last_became_peered":"2023-11-28T13:02:20.484467+0000","last_unstale":"2023-11-28T13:02:21.929637+0000","last_undegraded":"2023-11-28T13:02:21.929637+0000","last_fullsized":"2023-11-28T13:02:21.929637+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:17:33.409993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.480413+0000","last_change":"2023-11-28T13:02:20.099034+0000","last_active":"2023-11-28T13:02:20.480413+0000","last_peered":"2023-11-28T13:02:20.480413+0000","last_clean":"2023-11-28T13:02:20.480413+0000","last_became_active":"2023-11-28T13:02:20.098726+0000","last_became_peered":"2023-11-28T13:02:20.098726+0000","last_unstale":"2023-11-28T13:02:20.480413+0000","last_undegraded":"2023-11-28T13:02:20.480413+0000","last_fullsized":"2023-11-28T13:02:20.480413+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:09.884077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":195,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.468266+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:02:20.468266+0000","last_peered":"2023-11-28T13:02:20.468266+0000","last_clean":"2023-11-28T13:02:20.468266+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:02:20.468266+0000","last_undegraded":"2023-11-28T13:02:20.468266+0000","last_fullsized":"2023-11-28T13:02:20.468266+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.477522+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:02:20.477522+0000","last_peered":"2023-11-28T13:02:20.477522+0000","last_clean":"2023-11-28T13:02:20.477522+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:02:20.477522+0000","last_undegraded":"2023-11-28T13:02:20.477522+0000","last_fullsized":"2023-11-28T13:02:20.477522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.542354+0000","last_change":"2023-11-28T13:02:20.483039+0000","last_active":"2023-11-28T13:02:21.542354+0000","last_peered":"2023-11-28T13:02:21.542354+0000","last_clean":"2023-11-28T13:02:21.542354+0000","last_became_active":"2023-11-28T13:02:20.482722+0000","last_became_peered":"2023-11-28T13:02:20.482722+0000","last_unstale":"2023-11-28T13:02:21.542354+0000","last_undegraded":"2023-11-28T13:02:21.542354+0000","last_fullsized":"2023-11-28T13:02:21.542354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:28:46.196825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.469283+0000","last_change":"2023-11-28T13:02:20.102926+0000","last_active":"2023-11-28T13:02:20.469283+0000","last_peered":"2023-11-28T13:02:20.469283+0000","last_clean":"2023-11-28T13:02:20.469283+0000","last_became_active":"2023-11-28T13:02:20.102318+0000","last_became_peered":"2023-11-28T13:02:20.102318+0000","last_unstale":"2023-11-28T13:02:20.469283+0000","last_undegraded":"2023-11-28T13:02:20.469283+0000","last_fullsized":"2023-11-28T13:02:20.469283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:11.227538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.478634+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:02:21.478634+0000","last_peered":"2023-11-28T13:02:21.478634+0000","last_clean":"2023-11-28T13:02:21.478634+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:02:21.478634+0000","last_undegraded":"2023-11-28T13:02:21.478634+0000","last_fullsized":"2023-11-28T13:02:21.478634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.628143+0000","last_change":"2023-11-28T13:02:20.478008+0000","last_active":"2023-11-28T13:02:21.628143+0000","last_peered":"2023-11-28T13:02:21.628143+0000","last_clean":"2023-11-28T13:02:21.628143+0000","last_became_active":"2023-11-28T13:02:20.477737+0000","last_became_peered":"2023-11-28T13:02:20.477737+0000","last_unstale":"2023-11-28T13:02:21.628143+0000","last_undegraded":"2023-11-28T13:02:21.628143+0000","last_fullsized":"2023-11-28T13:02:21.628143+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:23:48.335246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.479881+0000","last_change":"2023-11-28T13:02:20.096598+0000","last_active":"2023-11-28T13:02:20.479881+0000","last_peered":"2023-11-28T13:02:20.479881+0000","last_clean":"2023-11-28T13:02:20.479881+0000","last_became_active":"2023-11-28T13:02:20.096267+0000","last_became_peered":"2023-11-28T13:02:20.096267+0000","last_unstale":"2023-11-28T13:02:20.479881+0000","last_undegraded":"2023-11-28T13:02:20.479881+0000","last_fullsized":"2023-11-28T13:02:20.479881+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:32.316383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.472651+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:02:20.472651+0000","last_peered":"2023-11-28T13:02:20.472651+0000","last_clean":"2023-11-28T13:02:20.472651+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:02:20.472651+0000","last_undegraded":"2023-11-28T13:02:20.472651+0000","last_fullsized":"2023-11-28T13:02:20.472651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.929513+0000","last_change":"2023-11-28T13:02:20.496730+0000","last_active":"2023-11-28T13:02:21.929513+0000","last_peered":"2023-11-28T13:02:21.929513+0000","last_clean":"2023-11-28T13:02:21.929513+0000","last_became_active":"2023-11-28T13:02:20.496434+0000","last_became_peered":"2023-11-28T13:02:20.496434+0000","last_unstale":"2023-11-28T13:02:21.929513+0000","last_undegraded":"2023-11-28T13:02:21.929513+0000","last_fullsized":"2023-11-28T13:02:21.929513+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:42.036693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.478359+0000","last_change":"2023-11-28T13:02:20.108336+0000","last_active":"2023-11-28T13:02:20.478359+0000","last_peered":"2023-11-28T13:02:20.478359+0000","last_clean":"2023-11-28T13:02:20.478359+0000","last_became_active":"2023-11-28T13:02:20.108081+0000","last_became_peered":"2023-11-28T13:02:20.108081+0000","last_unstale":"2023-11-28T13:02:20.478359+0000","last_undegraded":"2023-11-28T13:02:20.478359+0000","last_fullsized":"2023-11-28T13:02:20.478359+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:52.544723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.477396+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:02:20.477396+0000","last_peered":"2023-11-28T13:02:20.477396+0000","last_clean":"2023-11-28T13:02:20.477396+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:02:20.477396+0000","last_undegraded":"2023-11-28T13:02:20.477396+0000","last_fullsized":"2023-11-28T13:02:20.477396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930534+0000","last_change":"2023-11-28T13:02:20.490440+0000","last_active":"2023-11-28T13:02:21.930534+0000","last_peered":"2023-11-28T13:02:21.930534+0000","last_clean":"2023-11-28T13:02:21.930534+0000","last_became_active":"2023-11-28T13:02:20.488328+0000","last_became_peered":"2023-11-28T13:02:20.488328+0000","last_unstale":"2023-11-28T13:02:21.930534+0000","last_undegraded":"2023-11-28T13:02:21.930534+0000","last_fullsized":"2023-11-28T13:02:21.930534+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:43:53.954131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.468281+0000","last_change":"2023-11-28T13:02:20.104985+0000","last_active":"2023-11-28T13:02:20.468281+0000","last_peered":"2023-11-28T13:02:20.468281+0000","last_clean":"2023-11-28T13:02:20.468281+0000","last_became_active":"2023-11-28T13:02:20.104691+0000","last_became_peered":"2023-11-28T13:02:20.104691+0000","last_unstale":"2023-11-28T13:02:20.468281+0000","last_undegraded":"2023-11-28T13:02:20.468281+0000","last_fullsized":"2023-11-28T13:02:20.468281+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:14.909436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.469096+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:02:20.469096+0000","last_peered":"2023-11-28T13:02:20.469096+0000","last_clean":"2023-11-28T13:02:20.469096+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:02:20.469096+0000","last_undegraded":"2023-11-28T13:02:20.469096+0000","last_fullsized":"2023-11-28T13:02:20.469096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.628695+0000","last_change":"2023-11-28T13:02:20.491302+0000","last_active":"2023-11-28T13:02:21.628695+0000","last_peered":"2023-11-28T13:02:21.628695+0000","last_clean":"2023-11-28T13:02:21.628695+0000","last_became_active":"2023-11-28T13:02:20.491074+0000","last_became_peered":"2023-11-28T13:02:20.491074+0000","last_unstale":"2023-11-28T13:02:21.628695+0000","last_undegraded":"2023-11-28T13:02:21.628695+0000","last_fullsized":"2023-11-28T13:02:21.628695+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:12.049704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.478081+0000","last_change":"2023-11-28T13:02:20.102946+0000","last_active":"2023-11-28T13:02:20.478081+0000","last_peered":"2023-11-28T13:02:20.478081+0000","last_clean":"2023-11-28T13:02:20.478081+0000","last_became_active":"2023-11-28T13:02:20.102672+0000","last_became_peered":"2023-11-28T13:02:20.102672+0000","last_unstale":"2023-11-28T13:02:20.478081+0000","last_undegraded":"2023-11-28T13:02:20.478081+0000","last_fullsized":"2023-11-28T13:02:20.478081+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:33:36.451705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.469361+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:02:20.469361+0000","last_peered":"2023-11-28T13:02:20.469361+0000","last_clean":"2023-11-28T13:02:20.469361+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:02:20.469361+0000","last_undegraded":"2023-11-28T13:02:20.469361+0000","last_fullsized":"2023-11-28T13:02:20.469361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.930158+0000","last_change":"2023-11-28T13:02:20.497892+0000","last_active":"2023-11-28T13:02:21.930158+0000","last_peered":"2023-11-28T13:02:21.930158+0000","last_clean":"2023-11-28T13:02:21.930158+0000","last_became_active":"2023-11-28T13:02:20.497604+0000","last_became_peered":"2023-11-28T13:02:20.497604+0000","last_unstale":"2023-11-28T13:02:21.930158+0000","last_undegraded":"2023-11-28T13:02:21.930158+0000","last_fullsized":"2023-11-28T13:02:21.930158+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:57:45.588310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.465156+0000","last_change":"2023-11-28T13:02:20.104067+0000","last_active":"2023-11-28T13:02:20.465156+0000","last_peered":"2023-11-28T13:02:20.465156+0000","last_clean":"2023-11-28T13:02:20.465156+0000","last_became_active":"2023-11-28T13:02:20.103087+0000","last_became_peered":"2023-11-28T13:02:20.103087+0000","last_unstale":"2023-11-28T13:02:20.465156+0000","last_undegraded":"2023-11-28T13:02:20.465156+0000","last_fullsized":"2023-11-28T13:02:20.465156+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:13.894190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.471360+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:02:20.471360+0000","last_peered":"2023-11-28T13:02:20.471360+0000","last_clean":"2023-11-28T13:02:20.471360+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:02:20.471360+0000","last_undegraded":"2023-11-28T13:02:20.471360+0000","last_fullsized":"2023-11-28T13:02:20.471360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T13:02:21.929852+0000","last_change":"2023-11-28T13:02:20.492227+0000","last_active":"2023-11-28T13:02:21.929852+0000","last_peered":"2023-11-28T13:02:21.929852+0000","last_clean":"2023-11-28T13:02:21.929852+0000","last_became_active":"2023-11-28T13:02:20.491872+0000","last_became_peered":"2023-11-28T13:02:20.491872+0000","last_unstale":"2023-11-28T13:02:21.929852+0000","last_undegraded":"2023-11-28T13:02:21.929852+0000","last_fullsized":"2023-11-28T13:02:21.929852+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:20.067476+0000","last_clean_scrub_stamp":"2023-11-28T13:02:20.067476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:03:57.222909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.463967+0000","last_change":"2023-11-28T13:02:20.109497+0000","last_active":"2023-11-28T13:02:20.463967+0000","last_peered":"2023-11-28T13:02:20.463967+0000","last_clean":"2023-11-28T13:02:20.463967+0000","last_became_active":"2023-11-28T13:02:20.109212+0000","last_became_peered":"2023-11-28T13:02:20.109212+0000","last_unstale":"2023-11-28T13:02:20.463967+0000","last_undegraded":"2023-11-28T13:02:20.463967+0000","last_fullsized":"2023-11-28T13:02:20.463967+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:02:19.062350+0000","last_clean_scrub_stamp":"2023-11-28T13:02:19.062350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:32.316383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-28T13:02:20.471138+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:02:20.471138+0000","last_peered":"2023-11-28T13:02:20.471138+0000","last_clean":"2023-11-28T13:02:20.471138+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:02:20.471138+0000","last_undegraded":"2023-11-28T13:02:20.471138+0000","last_fullsized":"2023-11-28T13:02:20.471138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10272,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361568,"statfs":{"total":96636764160,"available":96626245632,"internally_reserved":0,"allocated":1204224,"data_stored":849763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.82699999999999996,"15min":0.81499999999999995},"min":{"1min":0.625,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.90200000000000002,"15min":0.91100000000000003},"min":{"1min":0.50900000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.222,"5min":1.377,"15min":1.377},"last":0.52500000000000002}]},{"osd":1,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.91400000000000003,"15min":0.92000000000000004},"min":{"1min":0.58399999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.242,"5min":1.599,"15min":1.599},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.871,"5min":0.93600000000000005,"15min":0.94699999999999995},"min":{"1min":0.63400000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.161,"5min":1.375,"15min":1.375},"last":0.71199999999999997}]},{"osd":2,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.92700000000000005,"15min":0.94099999999999995},"min":{"1min":0.58799999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2949999999999999,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.60999999999999999,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.329,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.88600000000000001}]},{"osd":3,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.93999999999999995,"15min":0.95199999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.1839999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.92800000000000005,"15min":0.92200000000000004},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.752}]},{"osd":4,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0029999999999999,"15min":1.0089999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.504,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.96399999999999997,"15min":0.96599999999999997},"min":{"1min":0.72899999999999998,"5min":0.621,"15min":0.621},"max":{"1min":1.296,"5min":1.409,"15min":1.409},"last":0.84899999999999998}]},{"osd":5,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.0449999999999999,"15min":1.0309999999999999},"min":{"1min":0.872,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.1020000000000001,"15min":1.107},"min":{"1min":0.76800000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4530000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.93400000000000005}]},{"osd":6,"last update":"Tue Nov 28 13:02:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.179,"15min":1.1870000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3500000000000001,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.052},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1699999999999999,"15min":1.175},"min":{"1min":0.879,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.4299999999999999,"5min":1.794,"15min":1.794},"last":1.0329999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8860,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362980,"statfs":{"total":96636764160,"available":96627691520,"internally_reserved":0,"allocated":610304,"data_stored":259907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.83399999999999996,"15min":0.83599999999999997},"min":{"1min":0.64500000000000002,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0960000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.85399999999999998,"15min":0.84199999999999997},"min":{"1min":0.65200000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1539999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.196}]},{"osd":1,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.87,"15min":0.86199999999999999},"min":{"1min":0.65800000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2370000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.871,"15min":0.86499999999999999},"min":{"1min":0.68600000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.218,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.008}]},{"osd":2,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.875,"15min":0.88400000000000001},"min":{"1min":0.57899999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1339999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.87,"5min":0.88800000000000001,"15min":0.89100000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1819999999999999,"5min":1.639,"15min":1.639},"last":0.93100000000000005}]},{"osd":3,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.88400000000000001,"15min":0.88},"min":{"1min":0.67800000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1399999999999999,"5min":1.141,"15min":1.141},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.97499999999999998,"15min":0.97699999999999998},"min":{"1min":0.74099999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.1259999999999999,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.0509999999999999}]},{"osd":4,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.95199999999999996,"15min":0.94899999999999995},"min":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2390000000000001,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.4390000000000001,"15min":1.506},"min":{"1min":0.66100000000000003,"5min":0.629,"15min":0.629},"max":{"1min":1.266,"5min":10.566000000000001,"15min":10.566000000000001},"last":0.80800000000000005}]},{"osd":5,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.0780000000000001,"15min":1.0860000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.21,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.151,"5min":1.0940000000000001,"15min":1.0840000000000001},"min":{"1min":0.91500000000000004,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.3160000000000001,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.125}]},{"osd":7,"last update":"Tue Nov 28 13:02:18 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.234,"15min":1.25},"min":{"1min":0.877,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.3819999999999999,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.155,"5min":1.306,"15min":1.331},"min":{"1min":0.97399999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":1.351,"5min":3.593,"15min":3.593},"last":1.1579999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9044,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362796,"statfs":{"total":96636764160,"available":96627503104,"internally_reserved":0,"allocated":602112,"data_stored":259271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.81699999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82599999999999996,"15min":0.81999999999999995},"min":{"1min":0.628,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0680000000000001,"5min":1.248,"15min":1.248},"last":0.749}]},{"osd":1,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82299999999999995,"15min":0.82199999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1100000000000001,"5min":1.274,"15min":1.274},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.56299999999999994,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.109,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.57699999999999996}]},{"osd":2,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81499999999999995,"15min":0.81100000000000005},"min":{"1min":0.505,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.92900000000000005,"15min":0.93999999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2010000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.72199999999999998}]},{"osd":3,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.88500000000000001,"15min":0.871},"min":{"1min":0.69999999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.998,"5min":1.0229999999999999,"15min":1.0269999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.391,"5min":1.403,"15min":1.403},"last":0.86699999999999999}]},{"osd":4,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.88300000000000001,"15min":0.89000000000000001},"min":{"1min":0.63,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1719999999999999,"5min":1.216,"15min":1.216},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.153,"5min":0.98299999999999998,"15min":0.95499999999999996},"min":{"1min":0.72499999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":4.3300000000000001,"5min":4.3300000000000001,"15min":4.3300000000000001},"last":1.0589999999999999}]},{"osd":6,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.02,"15min":1.0289999999999999},"min":{"1min":0.76800000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0269999999999999,"15min":1.0289999999999999},"min":{"1min":0.74299999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.448,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.92000000000000004}]},{"osd":7,"last update":"Tue Nov 28 13:02:13 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.0620000000000001,"15min":1.038},"min":{"1min":0.71699999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":4.234,"5min":4.234,"15min":4.234},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.133,"15min":1.1399999999999999},"min":{"1min":0.82199999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.377,"5min":1.466,"15min":1.466},"last":0.79800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9112,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362728,"statfs":{"total":96636764160,"available":96627433472,"internally_reserved":0,"allocated":606208,"data_stored":259837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.59799999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.73199999999999998}]},{"osd":1,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81399999999999995,"15min":0.81599999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0880000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.153,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.58299999999999996}]},{"osd":2,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.83899999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.133,"5min":1.357,"15min":1.357},"last":0.62},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.54600000000000004}]},{"osd":3,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.88300000000000001,"15min":0.872},"min":{"1min":0.64600000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.004,"5min":0.99299999999999999,"15min":0.99099999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.89600000000000002}]},{"osd":5,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.63700000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4039999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.98699999999999999,"15min":0.997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.871}]},{"osd":6,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0269999999999999,"15min":1.034},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.296,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0840000000000001,"15min":1.0800000000000001},"min":{"1min":0.86299999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.0169999999999999}]},{"osd":7,"last update":"Tue Nov 28 13:02:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0880000000000001,"15min":1.093},"min":{"1min":0.81999999999999995,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.151,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.98899999999999999,"5min":0.871,"15min":0.871},"max":{"1min":1.571,"5min":1.655,"15min":1.655},"last":1.03}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9188,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362652,"statfs":{"total":96636764160,"available":96627355648,"internally_reserved":0,"allocated":618496,"data_stored":260841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.46300000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98099999999999998,"5min":0.998,"15min":0.998},"last":0.53500000000000003}]},{"osd":1,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68100000000000005,"15min":0.69199999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86499999999999999,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.65200000000000002}]},{"osd":2,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.5,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0289999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82699999999999996,"15min":0.82899999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0740000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.751}]},{"osd":4,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.97799999999999998,"15min":1},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.194,"5min":1.405,"15min":1.405},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.038,"15min":1.05},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.409,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.0529999999999999,"15min":1.0669999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2430000000000001,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.012,"5min":1.081,"15min":1.093},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.321,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.874}]},{"osd":6,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.073,"15min":1.101},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.196,"5min":1.446,"15min":1.446},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.038,"5min":1.1040000000000001,"15min":1.115},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.3500000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.84699999999999998}]},{"osd":7,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.145,"15min":1.1579999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3640000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.105},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.153,"15min":1.1819999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.2290000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.071}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8992,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362848,"statfs":{"total":96636764160,"available":96627556352,"internally_reserved":0,"allocated":614400,"data_stored":260819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.52200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81999999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.68700000000000006}]},{"osd":1,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.629,"15min":0.61599999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.94399999999999995,"5min":1.123,"15min":1.123},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97899999999999998,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.85199999999999998}]},{"osd":3,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.73799999999999999,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.317,"15min":0.317},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.74199999999999999,"15min":0.74099999999999999},"min":{"1min":0.46400000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.018,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.77100000000000002}]},{"osd":4,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91200000000000003,"15min":0.91600000000000004},"min":{"1min":0.64300000000000002,"5min":0.498,"15min":0.498},"max":{"1min":1.1519999999999999,"5min":1.327,"15min":1.327},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.002,"15min":1.0049999999999999},"min":{"1min":0.69999999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3129999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.96999999999999997}]},{"osd":5,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.76800000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.202,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.006,"15min":0.98399999999999999},"min":{"1min":0.73899999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.95099999999999996}]},{"osd":6,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.0569999999999999,"15min":1.0309999999999999},"min":{"1min":0.66900000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1,"15min":1.0009999999999999},"min":{"1min":0.72499999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.2450000000000001,"5min":1.359,"15min":1.359},"last":1.143}]},{"osd":7,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.74399999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.431,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.1160000000000001,"15min":1.0960000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.107}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8988,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362852,"statfs":{"total":96636764160,"available":96627560448,"internally_reserved":0,"allocated":610304,"data_stored":259431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.96599999999999997,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.66800000000000004,"15min":0.68200000000000005},"min":{"1min":0.39100000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.749,"5min":1.181,"15min":1.181},"last":0.69899999999999995}]},{"osd":2,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78500000000000003,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.752,"15min":0.755},"min":{"1min":0.53700000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97599999999999998,"5min":1.409,"15min":1.409},"last":0.48799999999999999}]},{"osd":3,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.81599999999999995,"15min":0.82799999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.069,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.073,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.64100000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.98299999999999998,"15min":0.99299999999999999},"min":{"1min":0.65000000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1.284},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.93400000000000005,"15min":0.94199999999999995},"min":{"1min":0.68100000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1850000000000001,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.1060000000000001}]},{"osd":5,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.96899999999999997,"15min":0.97699999999999998},"min":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.3580000000000001,"5min":1.425,"15min":1.425},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0369999999999999,"15min":1.0509999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.234,"5min":2.004,"15min":2.004},"last":1.0580000000000001}]},{"osd":6,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.99299999999999999,"15min":1.0089999999999999},"min":{"1min":0.64100000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.101,"5min":1.889,"15min":1.889},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.097,"15min":1.1100000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4119999999999999,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.127}]},{"osd":7,"last update":"Tue Nov 28 13:02:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.085,"15min":1.0940000000000001},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.3029999999999999,"5min":1.766,"15min":1.766},"last":1.236},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.107,"15min":1.123},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.3109999999999999,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.2030000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10144,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94361696,"statfs":{"total":96636764160,"available":96626376704,"internally_reserved":0,"allocated":1204224,"data_stored":849695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63500000000000001,"15min":0.63100000000000001},"min":{"1min":0.499,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92800000000000005,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.49199999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88300000000000001,"5min":1.198,"15min":1.198},"last":0.65000000000000002}]},{"osd":2,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70799999999999996,"15min":0.70699999999999996},"min":{"1min":0.53100000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.878,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.47699999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.101,"5min":1.143,"15min":1.143},"last":0.72899999999999998}]},{"osd":3,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.50900000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82399999999999995,"5min":1.298,"15min":1.298},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.84199999999999997,"15min":0.84699999999999998},"min":{"1min":0.53900000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0249999999999999,"5min":1.629,"15min":1.629},"last":0.754}]},{"osd":4,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.88900000000000001,"15min":0.89300000000000002},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.95899999999999996,"15min":0.95599999999999996},"min":{"1min":0.76400000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.155,"5min":1.242,"15min":1.242},"last":1.1399999999999999}]},{"osd":5,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.98699999999999999,"15min":0.98899999999999999},"min":{"1min":0.71999999999999997,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.2769999999999999,"5min":1.895,"15min":1.895},"last":1.2430000000000001},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.93799999999999994,"15min":0.93999999999999995},"min":{"1min":0.71799999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.196,"5min":1.319,"15min":1.319},"last":1.155}]},{"osd":6,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0449999999999999,"15min":1.0489999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.252,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0800000000000001,"15min":1.083},"min":{"1min":0.88300000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.363,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.288}]},{"osd":7,"last update":"Tue Nov 28 13:02:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1060000000000001,"15min":1.113},"min":{"1min":0.77100000000000002,"5min":0.746,"15min":0.746},"max":{"1min":1.3129999999999999,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.014,"15min":1.0149999999999999},"min":{"1min":0.83299999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.0489999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:02:29.207 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T13:02:29.208 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-28T13:02:29.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.325+0000 7f73c759e700 1 Processor -- start 2023-11-28T13:02:29.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.325+0000 7f73c759e700 1 -- start start 2023-11-28T13:02:29.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.325+0000 7f73c759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73c80b1d10 0x7f73c80cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:29.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.325+0000 7f73c759e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f73c80d25b0 0x7f73c806ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:29.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.325+0000 7f73c759e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c8069bc0 con 0x7f73c80b5940 2023-11-28T13:02:29.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.325+0000 7f73c759e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c80d1480 con 0x7f73c80d25b0 2023-11-28T13:02:29.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.325+0000 7f73c759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c80cd280 con 0x7f73c80b1d10 2023-11-28T13:02:29.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.325+0000 7f73c5d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f73c80d25b0 0x7f73c806ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:29.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.325+0000 7f73c5d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f73c80d25b0 0x7f73c806ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46620/0 (socket says 172.21.15.82:46620) 2023-11-28T13:02:29.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.325+0000 7f73c5d9b700 1 -- 172.21.15.82:0/1080266412 learned_addr learned my addr 172.21.15.82:0/1080266412 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:29.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.325+0000 7f73c659c700 1 --2- 172.21.15.82:0/1080266412 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73c80b1d10 0x7f73c80cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:29.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.325+0000 7f73c5d9b700 1 -- 172.21.15.82:0/1080266412 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73c80b1d10 msgr2=0x7f73c80cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:29.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.325+0000 7f73c5d9b700 1 --2- 172.21.15.82:0/1080266412 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73c80b1d10 0x7f73c80cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.325+0000 7f73c5d9b700 1 -- 172.21.15.82:0/1080266412 >> v1:172.21.15.114:6789/0 conn(0x7f73c80b5940 legacy=0x7f73c806a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:29.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.325+0000 7f73c5d9b700 1 -- 172.21.15.82:0/1080266412 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c80cd560 con 0x7f73c80d25b0 2023-11-28T13:02:29.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.325+0000 7f73c659c700 1 --2- 172.21.15.82:0/1080266412 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73c80b1d10 0x7f73c80cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:02:29.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.325+0000 7f73c5d9b700 1 --2- 172.21.15.82:0/1080266412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c80d25b0 0x7f73c806ba30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f73b8009940 tx=0x7f73b8009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55b891f63a3dae3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:29.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.325+0000 7f73c559a700 1 -- 172.21.15.82:0/1080266412 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b800ba20 con 0x7f73c80d25b0 2023-11-28T13:02:29.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.325+0000 7f73c559a700 1 -- 172.21.15.82:0/1080266412 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b8009e90 con 0x7f73c80d25b0 2023-11-28T13:02:29.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.325+0000 7f73c559a700 1 -- 172.21.15.82:0/1080266412 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b800bda0 con 0x7f73c80d25b0 2023-11-28T13:02:29.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.329+0000 7f73c759e700 1 -- 172.21.15.82:0/1080266412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c80d25b0 msgr2=0x7f73c806ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:29.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.329+0000 7f73c759e700 1 --2- 172.21.15.82:0/1080266412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c80d25b0 0x7f73c806ba30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f73b8009940 tx=0x7f73b8009c50 comp rx=0 tx=0).stop 2023-11-28T13:02:29.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.329+0000 7f73c759e700 1 -- 172.21.15.82:0/1080266412 shutdown_connections 2023-11-28T13:02:29.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.329+0000 7f73c759e700 1 --2- 172.21.15.82:0/1080266412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c80d25b0 0x7f73c806ba30 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.329+0000 7f73c759e700 1 --2- 172.21.15.82:0/1080266412 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73c80b1d10 0x7f73c80cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.329+0000 7f73c759e700 1 -- 172.21.15.82:0/1080266412 >> 172.21.15.82:0/1080266412 conn(0x7f73c80b52a0 msgr2=0x7f73c80d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:29.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.329+0000 7f73c759e700 1 -- 172.21.15.82:0/1080266412 shutdown_connections 2023-11-28T13:02:29.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.329+0000 7f73c759e700 1 -- 172.21.15.82:0/1080266412 wait complete. 2023-11-28T13:02:29.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.329+0000 7f73c759e700 1 Processor -- start 2023-11-28T13:02:29.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.329+0000 7f73c759e700 1 -- start start 2023-11-28T13:02:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73c759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c80b1d10 0x7f73c8158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73c759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73c80b5940 0x7f73c80c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73c759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73c80d25b0 0x7f73c80c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73c759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c80cb440 con 0x7f73c80b1d10 2023-11-28T13:02:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73c759e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c80ca550 con 0x7f73c80b5940 2023-11-28T13:02:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73c759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c80ca830 con 0x7f73c80d25b0 2023-11-28T13:02:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73c659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c80b1d10 0x7f73c8158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73c659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c80b1d10 0x7f73c8158060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46634/0 (socket says 172.21.15.82:46634) 2023-11-28T13:02:29.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73c659c700 1 -- 172.21.15.82:0/3735932822 learned_addr learned my addr 172.21.15.82:0/3735932822 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:29.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73c5d9b700 1 --2- 172.21.15.82:0/3735932822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73c80b5940 0x7f73c80c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:29.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73c6d9d700 1 --2- 172.21.15.82:0/3735932822 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73c80d25b0 0x7f73c80c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:29.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73c659c700 1 -- 172.21.15.82:0/3735932822 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73c80d25b0 msgr2=0x7f73c80c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:29.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73c659c700 1 --2- 172.21.15.82:0/3735932822 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73c80d25b0 0x7f73c80c90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73c659c700 1 -- 172.21.15.82:0/3735932822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73c80b5940 msgr2=0x7f73c80c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:29.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73c659c700 1 --2- 172.21.15.82:0/3735932822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73c80b5940 0x7f73c80c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73c659c700 1 -- 172.21.15.82:0/3735932822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b8009570 con 0x7f73c80b1d10 2023-11-28T13:02:29.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73c659c700 1 --2- 172.21.15.82:0/3735932822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c80b1d10 0x7f73c8158060 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f73b000c770 tx=0x7f73b000ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:29.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73beffd700 1 -- 172.21.15.82:0/3735932822 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b0011800 con 0x7f73c80b1d10 2023-11-28T13:02:29.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73beffd700 1 -- 172.21.15.82:0/3735932822 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b0011960 con 0x7f73c80b1d10 2023-11-28T13:02:29.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73c759e700 1 -- 172.21.15.82:0/3735932822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c80d1050 con 0x7f73c80b1d10 2023-11-28T13:02:29.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73beffd700 1 -- 172.21.15.82:0/3735932822 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b0011d10 con 0x7f73c80b1d10 2023-11-28T13:02:29.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73c759e700 1 -- 172.21.15.82:0/3735932822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c80b20e0 con 0x7f73c80b1d10 2023-11-28T13:02:29.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.333+0000 7f73c759e700 1 -- 172.21.15.82:0/3735932822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c80d11e0 con 0x7f73c80b1d10 2023-11-28T13:02:29.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.337+0000 7f73beffd700 1 -- 172.21.15.82:0/3735932822 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f73b0021070 con 0x7f73c80b1d10 2023-11-28T13:02:29.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.337+0000 7f73beffd700 1 --2- 172.21.15.82:0/3735932822 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f73a8064ee0 0x7f73a8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:29.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.337+0000 7f73beffd700 1 -- 172.21.15.82:0/3735932822 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f73b0081e10 con 0x7f73c80b1d10 2023-11-28T13:02:29.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.337+0000 7f73c5d9b700 1 --2- 172.21.15.82:0/3735932822 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f73a8064ee0 0x7f73a8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:29.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.337+0000 7f73c5d9b700 1 --2- 172.21.15.82:0/3735932822 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f73a8064ee0 0x7f73a8067390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f73b8000c00 tx=0x7f73b8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:29.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.345+0000 7f73beffd700 1 -- 172.21.15.82:0/3735932822 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f73b004fed0 con 0x7f73c80b1d10 2023-11-28T13:02:29.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.565+0000 7f73c759e700 1 -- 172.21.15.82:0/3735932822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f73c8065fc0 con 0x7f73c80b1d10 2023-11-28T13:02:29.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.573+0000 7f73beffd700 1 -- 172.21.15.82:0/3735932822 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v10) v1 ==== 184+0+0 (secure 0 0 0) 0x7f73b00534f0 con 0x7f73c80b1d10 2023-11-28T13:02:29.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.573+0000 7f73c759e700 1 -- 172.21.15.82:0/3735932822 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f73a8064ee0 msgr2=0x7f73a8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:29.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.573+0000 7f73c759e700 1 --2- 172.21.15.82:0/3735932822 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f73a8064ee0 0x7f73a8067390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f73b8000c00 tx=0x7f73b8008030 comp rx=0 tx=0).stop 2023-11-28T13:02:29.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.573+0000 7f73c759e700 1 -- 172.21.15.82:0/3735932822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c80b1d10 msgr2=0x7f73c8158060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:29.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.573+0000 7f73c759e700 1 --2- 172.21.15.82:0/3735932822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c80b1d10 0x7f73c8158060 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f73b000c770 tx=0x7f73b000ca80 comp rx=0 tx=0).stop 2023-11-28T13:02:29.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.573+0000 7f73c759e700 1 -- 172.21.15.82:0/3735932822 shutdown_connections 2023-11-28T13:02:29.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.573+0000 7f73c759e700 1 --2- 172.21.15.82:0/3735932822 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f73a8064ee0 0x7f73a8067390 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.573+0000 7f73c759e700 1 --2- 172.21.15.82:0/3735932822 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73c80d25b0 0x7f73c80c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.573+0000 7f73c759e700 1 --2- 172.21.15.82:0/3735932822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73c80b5940 0x7f73c80c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.573+0000 7f73c759e700 1 --2- 172.21.15.82:0/3735932822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c80b1d10 0x7f73c8158060 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.573+0000 7f73c759e700 1 -- 172.21.15.82:0/3735932822 >> 172.21.15.82:0/3735932822 conn(0x7f73c80b52a0 msgr2=0x7f73c80b3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:29.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.573+0000 7f73c759e700 1 -- 172.21.15.82:0/3735932822 shutdown_connections 2023-11-28T13:02:29.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.573+0000 7f73c759e700 1 -- 172.21.15.82:0/3735932822 wait complete. 2023-11-28T13:02:29.580 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2023-11-28T13:02:29.593 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:02:29.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.705+0000 7fb023fff700 1 Processor -- start 2023-11-28T13:02:29.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.705+0000 7fb023fff700 1 -- start start 2023-11-28T13:02:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb023fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0240b1ce0 0x7fb024070730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb023fff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02415de60 con 0x7fb024070c70 2023-11-28T13:02:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb023fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02415e140 con 0x7fb02415d420 2023-11-28T13:02:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb023fff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02415e420 con 0x7fb0240b1ce0 2023-11-28T13:02:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0237fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb024070c70 0x7fb02406cad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43482/0 (socket says 172.21.15.82:43482) 2023-11-28T13:02:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0237fe700 1 -- 172.21.15.82:0/3186192624 learned_addr learned my addr 172.21.15.82:0/3186192624 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb01a7fc700 1 --2- 172.21.15.82:0/3186192624 >> v2:172.21.15.114:3300/0 conn(0x7fb0240b1ce0 0x7fb024070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0227fc700 1 -- 172.21.15.82:0/3186192624 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3313410684 0 0) 0x7fb02415de60 con 0x7fb024070c70 2023-11-28T13:02:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0227fc700 1 -- 172.21.15.82:0/3186192624 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0100035d0 con 0x7fb024070c70 2023-11-28T13:02:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0227fc700 1 -- 172.21.15.82:0/3186192624 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2292795026 0 0) 0x7fb0100035d0 con 0x7fb024070c70 2023-11-28T13:02:29.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0227fc700 1 -- 172.21.15.82:0/3186192624 >> v2:172.21.15.114:3300/0 conn(0x7fb0240b1ce0 msgr2=0x7fb024070730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:29.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0227fc700 1 --2- 172.21.15.82:0/3186192624 >> v2:172.21.15.114:3300/0 conn(0x7fb0240b1ce0 0x7fb024070730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0227fc700 1 -- 172.21.15.82:0/3186192624 >> v1:172.21.15.114:6789/0 conn(0x7fb02415d420 legacy=0x7fb0240ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:29.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0227fc700 1 -- 172.21.15.82:0/3186192624 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02415e700 con 0x7fb024070c70 2023-11-28T13:02:29.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0227fc700 1 -- 172.21.15.82:0/3186192624 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7fb01c0019f0 con 0x7fb024070c70 2023-11-28T13:02:29.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0227fc700 1 -- 172.21.15.82:0/3186192624 >> v1:172.21.15.82:6789/0 conn(0x7fb024070c70 legacy=0x7fb02406cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:29.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0227fc700 1 --2- 172.21.15.82:0/3186192624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb010003a20 0x7fb010003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:29.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0227fc700 1 --2- 172.21.15.82:0/3186192624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb010004410 0x7fb0100048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:29.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0227fc700 1 --2- 172.21.15.82:0/3186192624 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb0100050d0 0x7fb01000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:29.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0227fc700 1 -- 172.21.15.82:0/3186192624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02415e420 con 0x7fb010003a20 2023-11-28T13:02:29.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0227fc700 1 -- 172.21.15.82:0/3186192624 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01000c020 con 0x7fb010004410 2023-11-28T13:02:29.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0227fc700 1 -- 172.21.15.82:0/3186192624 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01000c1e0 con 0x7fb0100050d0 2023-11-28T13:02:29.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb022ffd700 1 --2- 172.21.15.82:0/3186192624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb010003a20 0x7fb010003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:29.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb01a7fc700 1 --2- 172.21.15.82:0/3186192624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb010004410 0x7fb0100048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:29.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb022ffd700 1 -- 172.21.15.82:0/3186192624 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb0100050d0 msgr2=0x7fb01000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:29.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0237fe700 1 --2- 172.21.15.82:0/3186192624 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb0100050d0 0x7fb01000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:29.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb022ffd700 1 --2- 172.21.15.82:0/3186192624 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb0100050d0 0x7fb01000ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb022ffd700 1 -- 172.21.15.82:0/3186192624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb010004410 msgr2=0x7fb0100048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:29.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb022ffd700 1 --2- 172.21.15.82:0/3186192624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb010004410 0x7fb0100048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb022ffd700 1 -- 172.21.15.82:0/3186192624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0100035d0 con 0x7fb010003a20 2023-11-28T13:02:29.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0237fe700 1 -- 172.21.15.82:0/3186192624 reap_dead start 2023-11-28T13:02:29.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb022ffd700 1 --2- 172.21.15.82:0/3186192624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb010003a20 0x7fb010003df0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb0140018f0 tx=0x7fb0100058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9fac2dd74366813 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:29.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0227fc700 1 -- 172.21.15.82:0/3186192624 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb014001390 con 0x7fb010003a20 2023-11-28T13:02:29.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0227fc700 1 -- 172.21.15.82:0/3186192624 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0140052d0 con 0x7fb010003a20 2023-11-28T13:02:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb0227fc700 1 -- 172.21.15.82:0/3186192624 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0140036a0 con 0x7fb010003a20 2023-11-28T13:02:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb023fff700 1 -- 172.21.15.82:0/3186192624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb010003a20 msgr2=0x7fb010003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb023fff700 1 --2- 172.21.15.82:0/3186192624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb010003a20 0x7fb010003df0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb0140018f0 tx=0x7fb0100058a0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb023fff700 1 -- 172.21.15.82:0/3186192624 shutdown_connections 2023-11-28T13:02:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb023fff700 1 --2- 172.21.15.82:0/3186192624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb010003a20 0x7fb010003df0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb023fff700 1 -- 172.21.15.82:0/3186192624 >> 172.21.15.82:0/3186192624 conn(0x7fb0240cb890 msgr2=0x7fb0240cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb023fff700 1 -- 172.21.15.82:0/3186192624 shutdown_connections 2023-11-28T13:02:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.709+0000 7fb023fff700 1 -- 172.21.15.82:0/3186192624 wait complete. 2023-11-28T13:02:29.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb023fff700 1 Processor -- start 2023-11-28T13:02:29.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb023fff700 1 -- start start 2023-11-28T13:02:29.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb023fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb010003a20 0x7fb02414c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:29.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb023fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb0240a74a0 0x7fb0240a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:29.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb023fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0240a8370 0x7fb0241f2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:29.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb023fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240a87e0 con 0x7fb0240a8370 2023-11-28T13:02:29.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb023fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240c5e50 con 0x7fb010003a20 2023-11-28T13:02:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb023fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240c60a0 con 0x7fb0240a74a0 2023-11-28T13:02:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb0237fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0240a8370 0x7fb0241f2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb0237fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0240a8370 0x7fb0241f2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46660/0 (socket says 172.21.15.82:46660) 2023-11-28T13:02:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb0237fe700 1 -- 172.21.15.82:0/1549941414 learned_addr learned my addr 172.21.15.82:0/1549941414 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb022ffd700 1 --2- 172.21.15.82:0/1549941414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb010003a20 0x7fb02414c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb01a7fc700 1 --2- 172.21.15.82:0/1549941414 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb0240a74a0 0x7fb0240a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb0237fe700 1 -- 172.21.15.82:0/1549941414 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb0240a74a0 msgr2=0x7fb0240a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb0237fe700 1 --2- 172.21.15.82:0/1549941414 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb0240a74a0 0x7fb0240a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb0237fe700 1 -- 172.21.15.82:0/1549941414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb010003a20 msgr2=0x7fb02414c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb0237fe700 1 --2- 172.21.15.82:0/1549941414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb010003a20 0x7fb02414c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb0237fe700 1 -- 172.21.15.82:0/1549941414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02415e9e0 con 0x7fb0240a8370 2023-11-28T13:02:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb0237fe700 1 --2- 172.21.15.82:0/1549941414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0240a8370 0x7fb0241f2ca0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb0240ca4c0 tx=0x7fb01c00dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:29.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb01bfff700 1 -- 172.21.15.82:0/1549941414 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c007440 con 0x7fb0240a8370 2023-11-28T13:02:29.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb01bfff700 1 -- 172.21.15.82:0/1549941414 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c0075a0 con 0x7fb0240a8370 2023-11-28T13:02:29.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb023fff700 1 -- 172.21.15.82:0/1549941414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb024071070 con 0x7fb0240a8370 2023-11-28T13:02:29.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb01bfff700 1 -- 172.21.15.82:0/1549941414 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c007950 con 0x7fb0240a8370 2023-11-28T13:02:29.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.713+0000 7fb023fff700 1 -- 172.21.15.82:0/1549941414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02415db30 con 0x7fb0240a8370 2023-11-28T13:02:29.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.717+0000 7fb023fff700 1 -- 172.21.15.82:0/1549941414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb024065fc0 con 0x7fb0240a8370 2023-11-28T13:02:29.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.717+0000 7fb01bfff700 1 -- 172.21.15.82:0/1549941414 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb01c011370 con 0x7fb0240a8370 2023-11-28T13:02:29.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.717+0000 7fb01bfff700 1 --2- 172.21.15.82:0/1549941414 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb004064ee0 0x7fb004067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:29.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.717+0000 7fb01bfff700 1 -- 172.21.15.82:0/1549941414 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb01c081790 con 0x7fb0240a8370 2023-11-28T13:02:29.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.717+0000 7fb022ffd700 1 --2- 172.21.15.82:0/1549941414 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb004064ee0 0x7fb004067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:29.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.717+0000 7fb022ffd700 1 --2- 172.21.15.82:0/1549941414 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb004064ee0 0x7fb004067390 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb014015040 tx=0x7fb014005000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:29.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.725+0000 7fb01bfff700 1 -- 172.21.15.82:0/1549941414 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb01c04f8d0 con 0x7fb0240a8370 2023-11-28T13:02:29.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.929+0000 7fb023fff700 1 -- 172.21.15.82:0/1549941414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb02406dc10 con 0x7fb0240a8370 2023-11-28T13:02:29.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.929+0000 7fb01bfff700 1 -- 172.21.15.82:0/1549941414 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4651 (secure 0 0 0) 0x7fb01c052ef0 con 0x7fb0240a8370 2023-11-28T13:02:29.933 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:29.933 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/704061431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":704061431},{"type":"v1","addr":"172.21.15.114:6834","nonce":704061431}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3972503523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3972503523},{"type":"v1","addr":"172.21.15.82:6836","nonce":3972503523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5811,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2000262220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2000262220},{"type":"v1","addr":"172.21.15.82:6837","nonce":2000262220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:02:20.454524+0000","modified":"2023-11-28T13:02:23.476763+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5814":{"gid":5814,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/4092152651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":4092152651},{"type":"v1","addr":"172.21.15.114:6835","nonce":4092152651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T13:02:29.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.933+0000 7fb023fff700 1 -- 172.21.15.82:0/1549941414 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb004064ee0 msgr2=0x7fb004067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:29.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.933+0000 7fb023fff700 1 --2- 172.21.15.82:0/1549941414 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb004064ee0 0x7fb004067390 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb014015040 tx=0x7fb014005000 comp rx=0 tx=0).stop 2023-11-28T13:02:29.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.933+0000 7fb023fff700 1 -- 172.21.15.82:0/1549941414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0240a8370 msgr2=0x7fb0241f2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:29.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.933+0000 7fb023fff700 1 --2- 172.21.15.82:0/1549941414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0240a8370 0x7fb0241f2ca0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb0240ca4c0 tx=0x7fb01c00dbf0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.933+0000 7fb023fff700 1 -- 172.21.15.82:0/1549941414 shutdown_connections 2023-11-28T13:02:29.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.933+0000 7fb023fff700 1 --2- 172.21.15.82:0/1549941414 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb004064ee0 0x7fb004067390 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.933+0000 7fb023fff700 1 --2- 172.21.15.82:0/1549941414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0240a8370 0x7fb0241f2ca0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.933+0000 7fb023fff700 1 --2- 172.21.15.82:0/1549941414 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb0240a74a0 0x7fb0240a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.933+0000 7fb023fff700 1 --2- 172.21.15.82:0/1549941414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb010003a20 0x7fb02414c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:29.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.933+0000 7fb023fff700 1 -- 172.21.15.82:0/1549941414 >> 172.21.15.82:0/1549941414 conn(0x7fb0240cb890 msgr2=0x7fb02415c650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:29.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.933+0000 7fb023fff700 1 -- 172.21.15.82:0/1549941414 shutdown_connections 2023-11-28T13:02:29.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:29.933+0000 7fb023fff700 1 -- 172.21.15.82:0/1549941414 wait complete. 2023-11-28T13:02:29.939 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 22 2023-11-28T13:02:30.356 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T13:02:20.454524+0000', 'modified': '2023-11-28T13:02:23.476763+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5814}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5814': {'gid': 5814, 'name': 'd', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6835/4092152651', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6833', 'nonce': 4092152651}, {'type': 'v1', 'addr': '172.21.15.114:6835', 'nonce': 4092152651}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T13:02:30.356 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T13:02:30.357 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-28T13:02:30.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.477+0000 7f75ad007700 1 Processor -- start 2023-11-28T13:02:30.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.477+0000 7f75ad007700 1 -- start start 2023-11-28T13:02:30.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.477+0000 7f75ad007700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f75a8160900 0x7f75a80cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.477+0000 7f75ad007700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a80ce030 con 0x7f75a80c1910 2023-11-28T13:02:30.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.477+0000 7f75ad007700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a80ce310 con 0x7f75a8070070 2023-11-28T13:02:30.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.477+0000 7f75ad007700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a806a5d0 con 0x7f75a8160900 2023-11-28T13:02:30.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.477+0000 7f75ac806700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f75a80c1910 0x7f75a806c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43498/0 (socket says 172.21.15.82:43498) 2023-11-28T13:02:30.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.477+0000 7f75ac806700 1 -- 172.21.15.82:0/1987953515 learned_addr learned my addr 172.21.15.82:0/1987953515 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:30.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.477+0000 7f75a77fe700 1 --2- 172.21.15.82:0/1987953515 >> v2:172.21.15.114:3300/0 conn(0x7f75a8160900 0x7f75a80cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.477+0000 7f75a6ffd700 1 -- 172.21.15.82:0/1987953515 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754917696 0 0) 0x7f75a80ce030 con 0x7f75a80c1910 2023-11-28T13:02:30.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.477+0000 7f75a6ffd700 1 -- 172.21.15.82:0/1987953515 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75940035d0 con 0x7f75a80c1910 2023-11-28T13:02:30.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.477+0000 7f75a77fe700 1 -- 172.21.15.82:0/1987953515 >> v1:172.21.15.114:6789/0 conn(0x7f75a8070070 legacy=0x7f75a8070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:30.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.477+0000 7f75a77fe700 1 -- 172.21.15.82:0/1987953515 >> v1:172.21.15.82:6789/0 conn(0x7f75a80c1910 legacy=0x7f75a806c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:30.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.477+0000 7f75a77fe700 1 -- 172.21.15.82:0/1987953515 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a806a8b0 con 0x7f75a8160900 2023-11-28T13:02:30.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.481+0000 7f75a77fe700 1 --2- 172.21.15.82:0/1987953515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75a8160900 0x7f75a80cc1d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7590009850 tx=0x7f7590009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73f9e440e60afcff server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:30.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.481+0000 7f75a6ffd700 1 -- 172.21.15.82:0/1987953515 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590011830 con 0x7f75a8160900 2023-11-28T13:02:30.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.481+0000 7f75a6ffd700 1 -- 172.21.15.82:0/1987953515 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7590011990 con 0x7f75a8160900 2023-11-28T13:02:30.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.481+0000 7f75a6ffd700 1 -- 172.21.15.82:0/1987953515 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590011d00 con 0x7f75a8160900 2023-11-28T13:02:30.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.481+0000 7f75ad007700 1 -- 172.21.15.82:0/1987953515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75a8160900 msgr2=0x7f75a80cc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:30.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.481+0000 7f75ad007700 1 --2- 172.21.15.82:0/1987953515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75a8160900 0x7f75a80cc1d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7590009850 tx=0x7f7590009b60 comp rx=0 tx=0).stop 2023-11-28T13:02:30.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.481+0000 7f75ad007700 1 -- 172.21.15.82:0/1987953515 shutdown_connections 2023-11-28T13:02:30.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.481+0000 7f75ad007700 1 --2- 172.21.15.82:0/1987953515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75a8160900 0x7f75a80cc1d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.481+0000 7f75ad007700 1 -- 172.21.15.82:0/1987953515 >> 172.21.15.82:0/1987953515 conn(0x7f75a80ce600 msgr2=0x7f75a80ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:30.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.481+0000 7f75ad007700 1 -- 172.21.15.82:0/1987953515 shutdown_connections 2023-11-28T13:02:30.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.481+0000 7f75ad007700 1 -- 172.21.15.82:0/1987953515 wait complete. 2023-11-28T13:02:30.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.485+0000 7f75ad007700 1 Processor -- start 2023-11-28T13:02:30.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.485+0000 7f75ad007700 1 -- start start 2023-11-28T13:02:30.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.485+0000 7f75ad007700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75a8070070 0x7f75a8162b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.485+0000 7f75ad007700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a81539a0 0x7f75a80b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.485+0000 7f75ad007700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75a80b2ed0 0x7f75a81f96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.485+0000 7f75ad007700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a80b3340 con 0x7f75a81539a0 2023-11-28T13:02:30.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.485+0000 7f75ad007700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a8160ce0 con 0x7f75a80b2ed0 2023-11-28T13:02:30.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.485+0000 7f75ad007700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a81630a0 con 0x7f75a8070070 2023-11-28T13:02:30.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.485+0000 7f75a77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a81539a0 0x7f75a80b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.485+0000 7f75a77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a81539a0 0x7f75a80b2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46662/0 (socket says 172.21.15.82:46662) 2023-11-28T13:02:30.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.485+0000 7f75a77fe700 1 -- 172.21.15.82:0/4173651344 learned_addr learned my addr 172.21.15.82:0/4173651344 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:30.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.485+0000 7f75a7fff700 1 --2- 172.21.15.82:0/4173651344 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75a8070070 0x7f75a8162b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.485+0000 7f75ac806700 1 --2- 172.21.15.82:0/4173651344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75a80b2ed0 0x7f75a81f96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.489+0000 7f75a77fe700 1 -- 172.21.15.82:0/4173651344 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75a8070070 msgr2=0x7f75a8162b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:30.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.489+0000 7f75a77fe700 1 --2- 172.21.15.82:0/4173651344 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75a8070070 0x7f75a8162b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.489+0000 7f75a77fe700 1 -- 172.21.15.82:0/4173651344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75a80b2ed0 msgr2=0x7f75a81f96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:30.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.489+0000 7f75a77fe700 1 --2- 172.21.15.82:0/4173651344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75a80b2ed0 0x7f75a81f96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.489+0000 7f75a77fe700 1 -- 172.21.15.82:0/4173651344 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75900094b0 con 0x7f75a81539a0 2023-11-28T13:02:30.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.489+0000 7f75a77fe700 1 --2- 172.21.15.82:0/4173651344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a81539a0 0x7f75a80b2990 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f75900090b0 tx=0x7f7590004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:30.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.489+0000 7f75a4ff9700 1 -- 172.21.15.82:0/4173651344 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590004550 con 0x7f75a81539a0 2023-11-28T13:02:30.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.489+0000 7f75a4ff9700 1 -- 172.21.15.82:0/4173651344 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759001f070 con 0x7f75a81539a0 2023-11-28T13:02:30.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.489+0000 7f75ad007700 1 -- 172.21.15.82:0/4173651344 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a80cc710 con 0x7f75a81539a0 2023-11-28T13:02:30.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.489+0000 7f75a4ff9700 1 -- 172.21.15.82:0/4173651344 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590003900 con 0x7f75a81539a0 2023-11-28T13:02:30.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.489+0000 7f75ad007700 1 -- 172.21.15.82:0/4173651344 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a806ab90 con 0x7f75a81539a0 2023-11-28T13:02:30.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.489+0000 7f75a4ff9700 1 -- 172.21.15.82:0/4173651344 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f759000f050 con 0x7f75a81539a0 2023-11-28T13:02:30.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.489+0000 7f75a4ff9700 1 --2- 172.21.15.82:0/4173651344 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7588064ee0 0x7f7588067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.489+0000 7f75a4ff9700 1 -- 172.21.15.82:0/4173651344 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7590021070 con 0x7f75a81539a0 2023-11-28T13:02:30.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.489+0000 7f75a7fff700 1 --2- 172.21.15.82:0/4173651344 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7588064ee0 0x7f7588067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75a7fff700 1 --2- 172.21.15.82:0/4173651344 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7588064ee0 0x7f7588067390 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7598001800 tx=0x7f7598009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:30.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75b14e9740 1 Processor -- start 2023-11-28T13:02:30.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75b14e9740 1 -- start start 2023-11-28T13:02:30.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75b14e9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x279aae0 0x2a4ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75b14e9740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x279a710 0x2a4b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75b14e9740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x27e5790 0x2a4b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75b14e9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x2909ae0 con 0x279aae0 2023-11-28T13:02:30.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75b14e9740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x2979bd0 con 0x279a710 2023-11-28T13:02:30.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75b14e9740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x2972ed0 con 0x27e5790 2023-11-28T13:02:30.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75a7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x279aae0 0x2a4ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75a7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x279aae0 0x2a4ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46666/0 (socket says 172.21.15.82:46666) 2023-11-28T13:02:30.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75a7fff700 1 -- 172.21.15.82:0/2103624040 learned_addr learned my addr 172.21.15.82:0/2103624040 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:30.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75ac806700 1 --2- 172.21.15.82:0/2103624040 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x27e5790 0x2a4b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75a77fe700 1 --2- 172.21.15.82:0/2103624040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x279a710 0x2a4b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75a7fff700 1 -- 172.21.15.82:0/2103624040 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x27e5790 msgr2=0x2a4b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:30.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75a7fff700 1 --2- 172.21.15.82:0/2103624040 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x27e5790 0x2a4b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75a7fff700 1 -- 172.21.15.82:0/2103624040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x279a710 msgr2=0x2a4b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:30.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75a7fff700 1 --2- 172.21.15.82:0/2103624040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x279a710 0x2a4b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75a7fff700 1 -- 172.21.15.82:0/2103624040 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2998cc0 con 0x279aae0 2023-11-28T13:02:30.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75a7fff700 1 --2- 172.21.15.82:0/2103624040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x279aae0 0x2a4ae00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f759800f770 tx=0x7f7598000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58521b008b8e70d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:30.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f759dffb700 1 -- 172.21.15.82:0/2103624040 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759800fe40 con 0x279aae0 2023-11-28T13:02:30.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f759dffb700 1 -- 172.21.15.82:0/2103624040 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7598014450 con 0x279aae0 2023-11-28T13:02:30.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f759dffb700 1 -- 172.21.15.82:0/2103624040 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75980147c0 con 0x279aae0 2023-11-28T13:02:30.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75b14e9740 1 -- 172.21.15.82:0/2103624040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x279aae0 msgr2=0x2a4ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:30.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75b14e9740 1 --2- 172.21.15.82:0/2103624040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x279aae0 0x2a4ae00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f759800f770 tx=0x7f7598000ed0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75b14e9740 1 -- 172.21.15.82:0/2103624040 shutdown_connections 2023-11-28T13:02:30.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75b14e9740 1 --2- 172.21.15.82:0/2103624040 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x27e5790 0x2a4b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75b14e9740 1 --2- 172.21.15.82:0/2103624040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x279a710 0x2a4b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75b14e9740 1 --2- 172.21.15.82:0/2103624040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x279aae0 0x2a4ae00 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75b14e9740 1 -- 172.21.15.82:0/2103624040 >> 172.21.15.82:0/2103624040 conn(0x279aeb0 msgr2=0x2a33700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:30.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75b14e9740 1 -- 172.21.15.82:0/2103624040 shutdown_connections 2023-11-28T13:02:30.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.493+0000 7f75b14e9740 1 -- 172.21.15.82:0/2103624040 wait complete. 2023-11-28T13:02:30.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75b14e9740 1 -- start start 2023-11-28T13:02:30.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75b14e9740 1 Processor -- start 2023-11-28T13:02:30.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75b14e9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x279a710 0x2a0a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75b14e9740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x279aae0 0x2a0c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75b14e9740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x27e5790 0x2a0ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75b14e9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x281fb20 con 0x279a710 2023-11-28T13:02:30.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75b14e9740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a0bb00 con 0x279aae0 2023-11-28T13:02:30.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75b14e9740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a48d00 con 0x27e5790 2023-11-28T13:02:30.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75b14e9740 10 client.0 _ll_register_callbacks cb 0x29cf0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:02:30.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75a7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x279a710 0x2a0a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75a7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x279a710 0x2a0a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46682/0 (socket says 172.21.15.82:46682) 2023-11-28T13:02:30.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75a7fff700 1 -- 172.21.15.82:0/4268736928 learned_addr learned my addr 172.21.15.82:0/4268736928 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:30.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75a77fe700 1 --2- 172.21.15.82:0/4268736928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x279aae0 0x2a0c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75ac806700 1 --2- 172.21.15.82:0/4268736928 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x27e5790 0x2a0ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75a7fff700 1 -- 172.21.15.82:0/4268736928 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x27e5790 msgr2=0x2a0ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:30.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75a7fff700 1 --2- 172.21.15.82:0/4268736928 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x27e5790 0x2a0ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75a7fff700 1 -- 172.21.15.82:0/4268736928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x279aae0 msgr2=0x2a0c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:30.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75a7fff700 1 --2- 172.21.15.82:0/4268736928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x279aae0 0x2a0c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75a7fff700 1 -- 172.21.15.82:0/4268736928 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a80ce310 con 0x279a710 2023-11-28T13:02:30.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75a77fe700 1 --2- 172.21.15.82:0/4268736928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x279aae0 0x2a0c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:30.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75a7fff700 1 --2- 172.21.15.82:0/4268736928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x279a710 0x2a0a8c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f759800fa80 tx=0x7f7598000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668aeba8bac109a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:30.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f7586ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-11-28T13:02:30.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f7586ffd700 1 -- 172.21.15.82:0/4268736928 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759802a610 con 0x279a710 2023-11-28T13:02:30.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f7586ffd700 1 -- 172.21.15.82:0/4268736928 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f759800fe40 con 0x279a710 2023-11-28T13:02:30.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75b14e9740 1 -- 172.21.15.82:0/4268736928 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x296bf50 con 0x279a710 2023-11-28T13:02:30.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f7586ffd700 1 -- 172.21.15.82:0/4268736928 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7598000fe0 con 0x279a710 2023-11-28T13:02:30.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75b14e9740 10 client.5991 fetch_fsmap learned FSMap version 22 2023-11-28T13:02:30.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75b14e9740 1 -- 172.21.15.82:0/4268736928 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x27e69e0 con 0x279a710 2023-11-28T13:02:30.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f7586ffd700 1 -- 172.21.15.82:0/4268736928 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x296bf50 con 0x279a710 2023-11-28T13:02:30.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f7586ffd700 1 -- 172.21.15.82:0/4268736928 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f759802a770 con 0x279a710 2023-11-28T13:02:30.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75b14e9740 10 client.5991 fetch_fsmap finished waiting for FSMap version 22 2023-11-28T13:02:30.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75b14e9740 10 client.5991 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-28T13:02:30.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75b14e9740 20 client.5991 populate_metadata read hostname 'smithi082' 2023-11-28T13:02:30.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75b14e9740 1 --2- 172.21.15.82:0/4268736928 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x2a09950 0x2a64f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75b14e9740 4 client.5991 mds_command: new command op to 5814 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T13:02:30.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.497+0000 7f75b14e9740 1 -- 172.21.15.82:0/4268736928 --> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x296bc70 con 0x2a09950 2023-11-28T13:02:30.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.501+0000 7f75a77fe700 1 --2- 172.21.15.82:0/4268736928 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x2a09950 0x2a64f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.501+0000 7f75a77fe700 1 --2- 172.21.15.82:0/4268736928 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x2a09950 0x2a64f30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2329dec11717ce28 server_cookie=f69f2afa3d046b05 in_seq=0 out_seq=0 2023-11-28T13:02:30.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.501+0000 7f7586ffd700 10 client.5991 ms_handle_connect on v2:172.21.15.114:6833/4092152651 2023-11-28T13:02:30.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.501+0000 7f7586ffd700 1 -- 172.21.15.82:0/4268736928 <== mds.0 v2:172.21.15.114:6833/4092152651 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x296bc70 con 0x2a09950 2023-11-28T13:02:30.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.501+0000 7f7586ffd700 10 client.5991 handle_command_reply: tid=0 2023-11-28T13:02:30.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.501+0000 7f75b14e9740 1 client.5991 shutdown 2023-11-28T13:02:30.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.501+0000 7f75b14e9740 1 -- 172.21.15.82:0/4268736928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x279a710 msgr2=0x2a0a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:30.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.501+0000 7f75b14e9740 1 --2- 172.21.15.82:0/4268736928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x279a710 0x2a0a8c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f759800fa80 tx=0x7f7598000bc0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.501+0000 7f75b14e9740 1 -- 172.21.15.82:0/4268736928 shutdown_connections 2023-11-28T13:02:30.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.501+0000 7f75b14e9740 1 --2- 172.21.15.82:0/4268736928 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x2a09950 0x2a64f30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.501+0000 7f75b14e9740 1 --2- 172.21.15.82:0/4268736928 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x27e5790 0x2a0ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.501+0000 7f7586ffd700 0 client.5991 ms_handle_reset on v2:172.21.15.114:6833/4092152651 2023-11-28T13:02:30.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.501+0000 7f75b14e9740 1 --2- 172.21.15.82:0/4268736928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x279aae0 0x2a0c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.501+0000 7f75b14e9740 1 --2- 172.21.15.82:0/4268736928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x279a710 0x2a0a8c0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.501+0000 7f75b14e9740 1 -- 172.21.15.82:0/4268736928 >> 172.21.15.82:0/4268736928 conn(0x279aeb0 msgr2=0x2a33840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:30.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.501+0000 7f75b14e9740 1 -- 172.21.15.82:0/4268736928 shutdown_connections 2023-11-28T13:02:30.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.501+0000 7f75b14e9740 1 -- 172.21.15.82:0/4268736928 wait complete. 2023-11-28T13:02:30.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.501+0000 7f75b14e9740 20 client.5991 trim_cache size 0 max 16384 2023-11-28T13:02:30.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f75b14e9740 1 Processor -- start 2023-11-28T13:02:30.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f75b14e9740 1 -- start start 2023-11-28T13:02:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f75b14e9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x279a710 0x2a09d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f75b14e9740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x279aae0 0x2a0a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f75b14e9740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27e5790 0x2a64f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f75b14e9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x2971d60 con 0x279a710 2023-11-28T13:02:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f75b14e9740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x2943ec0 con 0x27e5790 2023-11-28T13:02:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f75b14e9740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x297ae60 con 0x279aae0 2023-11-28T13:02:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f75a7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x279a710 0x2a09d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f75a7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x279a710 0x2a09d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46694/0 (socket says 172.21.15.82:46694) 2023-11-28T13:02:30.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f75a7fff700 1 -- 172.21.15.82:0/1771362780 learned_addr learned my addr 172.21.15.82:0/1771362780 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:30.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f75a77fe700 1 --2- 172.21.15.82:0/1771362780 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x279aae0 0x2a0a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f75ac806700 1 --2- 172.21.15.82:0/1771362780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27e5790 0x2a64f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f75a7fff700 1 -- 172.21.15.82:0/1771362780 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x279aae0 msgr2=0x2a0a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:30.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f75a7fff700 1 --2- 172.21.15.82:0/1771362780 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x279aae0 0x2a0a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f75a7fff700 1 -- 172.21.15.82:0/1771362780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27e5790 msgr2=0x2a64f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:30.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f75a7fff700 1 --2- 172.21.15.82:0/1771362780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27e5790 0x2a64f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f75a7fff700 1 -- 172.21.15.82:0/1771362780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x29398a0 con 0x279a710 2023-11-28T13:02:30.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f75a77fe700 1 --2- 172.21.15.82:0/1771362780 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x279aae0 0x2a0a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:30.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f75a7fff700 1 --2- 172.21.15.82:0/1771362780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x279a710 0x2a09d20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f7598000f10 tx=0x7f759802a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ad9ce8037cdeb6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:30.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f759e7fc700 1 -- 172.21.15.82:0/1771362780 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7598033640 con 0x279a710 2023-11-28T13:02:30.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f759e7fc700 1 -- 172.21.15.82:0/1771362780 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7598001d50 con 0x279a710 2023-11-28T13:02:30.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.525+0000 7f759e7fc700 1 -- 172.21.15.82:0/1771362780 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759802a630 con 0x279a710 2023-11-28T13:02:30.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 1 -- 172.21.15.82:0/1771362780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x279a710 msgr2=0x2a09d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:30.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 1 --2- 172.21.15.82:0/1771362780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x279a710 0x2a09d20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f7598000f10 tx=0x7f759802a000 comp rx=0 tx=0).stop 2023-11-28T13:02:30.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 1 -- 172.21.15.82:0/1771362780 shutdown_connections 2023-11-28T13:02:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 1 --2- 172.21.15.82:0/1771362780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27e5790 0x2a64f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 1 --2- 172.21.15.82:0/1771362780 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x279aae0 0x2a0a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 1 --2- 172.21.15.82:0/1771362780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x279a710 0x2a09d20 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 1 -- 172.21.15.82:0/1771362780 >> 172.21.15.82:0/1771362780 conn(0x279aeb0 msgr2=0x2a0bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 1 -- 172.21.15.82:0/1771362780 shutdown_connections 2023-11-28T13:02:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 1 -- 172.21.15.82:0/1771362780 wait complete. 2023-11-28T13:02:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 1 -- start start 2023-11-28T13:02:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 1 Processor -- start 2023-11-28T13:02:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x279a710 0x2a2efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x279aae0 0x2ab0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x27e5790 0x2a2fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x29702d0 con 0x27e5790 2023-11-28T13:02:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x2971bf0 con 0x279a710 2023-11-28T13:02:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x2975a30 con 0x279aae0 2023-11-28T13:02:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 10 client.0 _ll_register_callbacks cb 0x291f2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:02:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75ac806700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x27e5790 0x2a2fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75ac806700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x27e5790 0x2a2fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46706/0 (socket says 172.21.15.82:46706) 2023-11-28T13:02:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75ac806700 1 -- 172.21.15.82:0/1133259873 learned_addr learned my addr 172.21.15.82:0/1133259873 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75a77fe700 1 --2- 172.21.15.82:0/1133259873 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x279aae0 0x2ab0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75a7fff700 1 --2- 172.21.15.82:0/1133259873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x279a710 0x2a2efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75ac806700 1 -- 172.21.15.82:0/1133259873 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x279aae0 msgr2=0x2ab0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75ac806700 1 --2- 172.21.15.82:0/1133259873 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x279aae0 0x2ab0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75ac806700 1 -- 172.21.15.82:0/1133259873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x279a710 msgr2=0x2a2efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75ac806700 1 --2- 172.21.15.82:0/1133259873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x279a710 0x2a2efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75ac806700 1 -- 172.21.15.82:0/1133259873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x27e69e0 con 0x27e5790 2023-11-28T13:02:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75a7fff700 1 --2- 172.21.15.82:0/1133259873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x279a710 0x2a2efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75ac806700 1 --2- 172.21.15.82:0/1133259873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x27e5790 0x2a2fbc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f75a0002230 tx=0x7f75a0017ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4246204b8acd42e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f7586ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-11-28T13:02:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f7586ffd700 1 -- 172.21.15.82:0/1133259873 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a0015a90 con 0x27e5790 2023-11-28T13:02:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f7586ffd700 1 -- 172.21.15.82:0/1133259873 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75a0015bf0 con 0x27e5790 2023-11-28T13:02:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 1 -- 172.21.15.82:0/1133259873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7598014450 con 0x27e5790 2023-11-28T13:02:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f7586ffd700 1 -- 172.21.15.82:0/1133259873 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75a0015db0 con 0x27e5790 2023-11-28T13:02:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 10 client.5997 fetch_fsmap learned FSMap version 22 2023-11-28T13:02:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 1 -- 172.21.15.82:0/1133259873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x291f380 con 0x27e5790 2023-11-28T13:02:30.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f7586ffd700 1 -- 172.21.15.82:0/1133259873 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7598014450 con 0x27e5790 2023-11-28T13:02:30.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f7586ffd700 1 -- 172.21.15.82:0/1133259873 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f75a0012050 con 0x27e5790 2023-11-28T13:02:30.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 10 client.5997 fetch_fsmap finished waiting for FSMap version 22 2023-11-28T13:02:30.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 10 client.5997 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-28T13:02:30.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.529+0000 7f75b14e9740 20 client.5997 populate_metadata read hostname 'smithi082' 2023-11-28T13:02:30.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75b14e9740 1 --2- 172.21.15.82:0/1133259873 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x2a09950 0x2a30aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75b14e9740 4 client.5997 mds_command: new command op to 5814 tid=0[{"prefix": "status"}] 2023-11-28T13:02:30.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75b14e9740 1 -- 172.21.15.82:0/1133259873 --> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] -- command(tid 0: {"prefix": "status"}) v1 -- 0x2817260 con 0x2a09950 2023-11-28T13:02:30.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75a7fff700 1 --2- 172.21.15.82:0/1133259873 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x2a09950 0x2a30aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f7586ffd700 10 client.5997 ms_handle_connect on v2:172.21.15.114:6833/4092152651 2023-11-28T13:02:30.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75a7fff700 1 --2- 172.21.15.82:0/1133259873 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x2a09950 0x2a30aa0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2993aaa29534b3d server_cookie=7528b7d533d924a3 in_seq=0 out_seq=0 2023-11-28T13:02:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f7586ffd700 1 -- 172.21.15.82:0/1133259873 <== mds.0 v2:172.21.15.114:6833/4092152651 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x2817260 con 0x2a09950 2023-11-28T13:02:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f7586ffd700 10 client.5997 handle_command_reply: tid=0 2023-11-28T13:02:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75b14e9740 1 client.5997 shutdown 2023-11-28T13:02:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75b14e9740 1 -- 172.21.15.82:0/1133259873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x27e5790 msgr2=0x2a2fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75b14e9740 1 --2- 172.21.15.82:0/1133259873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x27e5790 0x2a2fbc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f75a0002230 tx=0x7f75a0017ed0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75b14e9740 1 -- 172.21.15.82:0/1133259873 shutdown_connections 2023-11-28T13:02:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75b14e9740 1 --2- 172.21.15.82:0/1133259873 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x2a09950 0x2a30aa0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75b14e9740 1 --2- 172.21.15.82:0/1133259873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x27e5790 0x2a2fbc0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75b14e9740 1 --2- 172.21.15.82:0/1133259873 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x279aae0 0x2ab0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75b14e9740 1 --2- 172.21.15.82:0/1133259873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x279a710 0x2a2efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75b14e9740 1 -- 172.21.15.82:0/1133259873 >> 172.21.15.82:0/1133259873 conn(0x279aeb0 msgr2=0x2a614a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f7586ffd700 0 client.5997 ms_handle_reset on v2:172.21.15.114:6833/4092152651 2023-11-28T13:02:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75b14e9740 1 -- 172.21.15.82:0/1133259873 shutdown_connections 2023-11-28T13:02:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75b14e9740 1 -- 172.21.15.82:0/1133259873 wait complete. 2023-11-28T13:02:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75b14e9740 20 client.5997 trim_cache size 0 max 16384 2023-11-28T13:02:30.545 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:02:30.546 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "aef8a97f-1d6c-4a2b-9410-16861b3e9e35", 2023-11-28T13:02:30.546 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-11-28T13:02:30.546 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 5814, 2023-11-28T13:02:30.546 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-11-28T13:02:30.546 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-11-28T13:02:30.546 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-11-28T13:02:30.546 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 10.076436412, 2023-11-28T13:02:30.546 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 22, 2023-11-28T13:02:30.546 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 51, 2023-11-28T13:02:30.546 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 51, 2023-11-28T13:02:30.546 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 14.588300028999999 2023-11-28T13:02:30.547 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:02:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75ad007700 1 -- 172.21.15.82:0/4173651344 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7588064ee0 msgr2=0x7f7588067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75ad007700 1 --2- 172.21.15.82:0/4173651344 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7588064ee0 0x7f7588067390 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7598001800 tx=0x7f7598009040 comp rx=0 tx=0).stop 2023-11-28T13:02:30.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75ad007700 1 -- 172.21.15.82:0/4173651344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a81539a0 msgr2=0x7f75a80b2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:30.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75ad007700 1 --2- 172.21.15.82:0/4173651344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a81539a0 0x7f75a80b2990 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f75900090b0 tx=0x7f7590004770 comp rx=0 tx=0).stop 2023-11-28T13:02:30.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75ad007700 1 -- 172.21.15.82:0/4173651344 shutdown_connections 2023-11-28T13:02:30.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75ad007700 1 --2- 172.21.15.82:0/4173651344 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7588064ee0 0x7f7588067390 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75ad007700 1 --2- 172.21.15.82:0/4173651344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75a80b2ed0 0x7f75a81f96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75ad007700 1 --2- 172.21.15.82:0/4173651344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a81539a0 0x7f75a80b2990 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75ad007700 1 --2- 172.21.15.82:0/4173651344 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75a8070070 0x7f75a8162b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75ad007700 1 -- 172.21.15.82:0/4173651344 >> 172.21.15.82:0/4173651344 conn(0x7f75a80ce600 msgr2=0x7f75a80c8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:30.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75ad007700 1 -- 172.21.15.82:0/4173651344 shutdown_connections 2023-11-28T13:02:30.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.533+0000 7f75ad007700 1 -- 172.21.15.82:0/4173651344 wait complete. 2023-11-28T13:02:30.554 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T13:02:30.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.669+0000 7fa84bfff700 1 Processor -- start 2023-11-28T13:02:30.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.669+0000 7fa84bfff700 1 -- start start 2023-11-28T13:02:30.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84bfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa84c1591c0 0x7fa84c15d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84bfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa84c070070 0x7fa84c0704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84bfff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa84c15da50 con 0x7fa84c158df0 2023-11-28T13:02:30.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84bfff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa84c070a30 con 0x7fa84c070070 2023-11-28T13:02:30.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84bfff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c0c9e20 con 0x7fa84c1591c0 2023-11-28T13:02:30.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84affd700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa84c158df0 0x7fa84c06c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:48892/0 (socket says 172.21.15.82:48892) 2023-11-28T13:02:30.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84affd700 1 -- 172.21.15.82:0/3010662779 learned_addr learned my addr 172.21.15.82:0/3010662779 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:30.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84b7fe700 1 --2- 172.21.15.82:0/3010662779 >> v2:172.21.15.114:3300/0 conn(0x7fa84c070070 0x7fa84c0704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84a7fc700 1 --2- 172.21.15.82:0/3010662779 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa84c1591c0 0x7fa84c15d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84b7fe700 1 -- 172.21.15.82:0/3010662779 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa84c1591c0 msgr2=0x7fa84c15d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:30.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84b7fe700 1 --2- 172.21.15.82:0/3010662779 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa84c1591c0 0x7fa84c15d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84b7fe700 1 -- 172.21.15.82:0/3010662779 >> v1:172.21.15.114:6789/0 conn(0x7fa84c158df0 legacy=0x7fa84c06c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:30.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84b7fe700 1 -- 172.21.15.82:0/3010662779 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84c0cc640 con 0x7fa84c070070 2023-11-28T13:02:30.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84b7fe700 1 --2- 172.21.15.82:0/3010662779 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa84c070070 0x7fa84c0704f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa844009d90 tx=0x7fa84400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b01291b066068cf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:30.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa849ffb700 1 -- 172.21.15.82:0/3010662779 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84400e070 con 0x7fa84c070070 2023-11-28T13:02:30.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa849ffb700 1 -- 172.21.15.82:0/3010662779 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84400bb20 con 0x7fa84c070070 2023-11-28T13:02:30.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa849ffb700 1 -- 172.21.15.82:0/3010662779 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844012430 con 0x7fa84c070070 2023-11-28T13:02:30.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84bfff700 1 -- 172.21.15.82:0/3010662779 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa84c070070 msgr2=0x7fa84c0704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:30.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84bfff700 1 --2- 172.21.15.82:0/3010662779 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa84c070070 0x7fa84c0704f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa844009d90 tx=0x7fa84400b330 comp rx=0 tx=0).stop 2023-11-28T13:02:30.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84bfff700 1 -- 172.21.15.82:0/3010662779 shutdown_connections 2023-11-28T13:02:30.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84bfff700 1 --2- 172.21.15.82:0/3010662779 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa84c070070 0x7fa84c0704f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84bfff700 1 --2- 172.21.15.82:0/3010662779 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa84c1591c0 0x7fa84c15d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84bfff700 1 -- 172.21.15.82:0/3010662779 >> 172.21.15.82:0/3010662779 conn(0x7fa84c0ce600 msgr2=0x7fa84c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:30.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84bfff700 1 -- 172.21.15.82:0/3010662779 shutdown_connections 2023-11-28T13:02:30.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.673+0000 7fa84bfff700 1 -- 172.21.15.82:0/3010662779 wait complete. 2023-11-28T13:02:30.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84bfff700 1 Processor -- start 2023-11-28T13:02:30.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84bfff700 1 -- start start 2023-11-28T13:02:30.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa84c070070 0x7fa84c153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84bfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa84c158df0 0x7fa84c1577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa84c1591c0 0x7fa84c0c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84bfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c153fa0 con 0x7fa84c1591c0 2023-11-28T13:02:30.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84bfff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c157d00 con 0x7fa84c070070 2023-11-28T13:02:30.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84bfff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c1556f0 con 0x7fa84c158df0 2023-11-28T13:02:30.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa84c070070 0x7fa84c153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa84c1591c0 0x7fa84c0c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa84c070070 0x7fa84c153a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:49422/0 (socket says 172.21.15.82:49422) 2023-11-28T13:02:30.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84a7fc700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa84c158df0 0x7fa84c1577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84affd700 1 -- 172.21.15.82:0/1475395455 learned_addr learned my addr 172.21.15.82:0/1475395455 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:30.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa84c1591c0 0x7fa84c0c37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46718/0 (socket says 172.21.15.82:46718) 2023-11-28T13:02:30.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84b7fe700 1 -- 172.21.15.82:0/1475395455 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa84c158df0 msgr2=0x7fa84c1577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:30.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84b7fe700 1 --2- 172.21.15.82:0/1475395455 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa84c158df0 0x7fa84c1577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84b7fe700 1 -- 172.21.15.82:0/1475395455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa84c070070 msgr2=0x7fa84c153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:30.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84b7fe700 1 --2- 172.21.15.82:0/1475395455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa84c070070 0x7fa84c153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84b7fe700 1 -- 172.21.15.82:0/1475395455 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa844009a70 con 0x7fa84c1591c0 2023-11-28T13:02:30.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84affd700 1 --2- 172.21.15.82:0/1475395455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa84c070070 0x7fa84c153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:02:30.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84b7fe700 1 --2- 172.21.15.82:0/1475395455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa84c1591c0 0x7fa84c0c37f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa844016000 tx=0x7fa844004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:30.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa8337fe700 1 -- 172.21.15.82:0/1475395455 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844012430 con 0x7fa84c1591c0 2023-11-28T13:02:30.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa8337fe700 1 -- 172.21.15.82:0/1475395455 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa844020070 con 0x7fa84c1591c0 2023-11-28T13:02:30.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84bfff700 1 -- 172.21.15.82:0/1475395455 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa84c0c9ab0 con 0x7fa84c1591c0 2023-11-28T13:02:30.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa8337fe700 1 -- 172.21.15.82:0/1475395455 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844004280 con 0x7fa84c1591c0 2023-11-28T13:02:30.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.677+0000 7fa84bfff700 1 -- 172.21.15.82:0/1475395455 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84c0c97d0 con 0x7fa84c1591c0 2023-11-28T13:02:30.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.681+0000 7fa84bfff700 1 -- 172.21.15.82:0/1475395455 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84c0c9480 con 0x7fa84c1591c0 2023-11-28T13:02:30.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.681+0000 7fa8337fe700 1 -- 172.21.15.82:0/1475395455 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa84402e070 con 0x7fa84c1591c0 2023-11-28T13:02:30.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.681+0000 7fa8337fe700 1 --2- 172.21.15.82:0/1475395455 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa838064ee0 0x7fa838067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:30.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.681+0000 7fa8337fe700 1 -- 172.21.15.82:0/1475395455 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa844022070 con 0x7fa84c1591c0 2023-11-28T13:02:30.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.681+0000 7fa84affd700 1 --2- 172.21.15.82:0/1475395455 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa838064ee0 0x7fa838067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:30.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.681+0000 7fa84affd700 1 --2- 172.21.15.82:0/1475395455 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa838064ee0 0x7fa838067390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa83c004f10 tx=0x7fa83c001120 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:30.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.689+0000 7fa8337fe700 1 -- 172.21.15.82:0/1475395455 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa844051c20 con 0x7fa84c1591c0 2023-11-28T13:02:30.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.885+0000 7fa84bfff700 1 -- 172.21.15.82:0/1475395455 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa84c065fc0 con 0x7fa84c1591c0 2023-11-28T13:02:30.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.885+0000 7fa8337fe700 1 -- 172.21.15.82:0/1475395455 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa84402c060 con 0x7fa84c1591c0 2023-11-28T13:02:30.889 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T13:02:30.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.889+0000 7fa84bfff700 1 -- 172.21.15.82:0/1475395455 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa838064ee0 msgr2=0x7fa838067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:30.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.889+0000 7fa84bfff700 1 --2- 172.21.15.82:0/1475395455 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa838064ee0 0x7fa838067390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa83c004f10 tx=0x7fa83c001120 comp rx=0 tx=0).stop 2023-11-28T13:02:30.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.889+0000 7fa84bfff700 1 -- 172.21.15.82:0/1475395455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa84c1591c0 msgr2=0x7fa84c0c37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:30.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.889+0000 7fa84bfff700 1 --2- 172.21.15.82:0/1475395455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa84c1591c0 0x7fa84c0c37f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa844016000 tx=0x7fa844004af0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.889+0000 7fa84bfff700 1 -- 172.21.15.82:0/1475395455 shutdown_connections 2023-11-28T13:02:30.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.889+0000 7fa84bfff700 1 --2- 172.21.15.82:0/1475395455 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa838064ee0 0x7fa838067390 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.889+0000 7fa84bfff700 1 --2- 172.21.15.82:0/1475395455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa84c1591c0 0x7fa84c0c37f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.889+0000 7fa84bfff700 1 --2- 172.21.15.82:0/1475395455 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa84c158df0 0x7fa84c1577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.889+0000 7fa84bfff700 1 --2- 172.21.15.82:0/1475395455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa84c070070 0x7fa84c153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:30.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.889+0000 7fa84bfff700 1 -- 172.21.15.82:0/1475395455 >> 172.21.15.82:0/1475395455 conn(0x7fa84c0ce600 msgr2=0x7fa84c0ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:30.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.889+0000 7fa84bfff700 1 -- 172.21.15.82:0/1475395455 shutdown_connections 2023-11-28T13:02:30.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:30.889+0000 7fa84bfff700 1 -- 172.21.15.82:0/1475395455 wait complete. 2023-11-28T13:02:30.904 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T13:02:30.904 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T13:02:30.904 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-11-28T13:02:30.904 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T13:02:30.904 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T13:02:30.904 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T13:02:30.905 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T13:02:30.905 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T13:02:30.905 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T13:02:30.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:02:30.905 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-11-28T13:02:30.911 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T13:02:30.911 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T13:02:30.911 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T13:02:30.911 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:02:30.911 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-11-28T13:02:30.911 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:02:30.911 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T13:02:30.911 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:02:30.911 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T13:02:30.912 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:02:30.912 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T13:02:30.912 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-11-28T13:02:30.912 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T13:02:30.912 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-11-28T13:02:30.912 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T13:02:30.912 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42431sec preferred_lft 42431sec 2023-11-28T13:02:30.912 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-11-28T13:02:30.912 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:02:30.912 INFO:teuthology.orchestra.run.smithi082.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T13:02:30.912 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:42:02:22:90:39 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:02:30.912 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T13:02:30.913 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:02:30.913 INFO:teuthology.orchestra.run.smithi082.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T13:02:30.913 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether ba:e2:2a:24:1a:10 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:02:30.913 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T13:02:30.913 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:02:30.913 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::78c5:d7ff:fe17:75c8/64 scope link 2023-11-28T13:02:30.913 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:02:30.913 INFO:teuthology.orchestra.run.smithi082.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T13:02:30.913 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether f2:23:62:63:4a:4e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T13:02:30.913 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::f023:62ff:fe63:4a4e/64 scope link 2023-11-28T13:02:30.913 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:02:30.913 INFO:teuthology.orchestra.run.smithi082.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T13:02:30.914 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether ba:e2:2a:24:1a:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T13:02:30.914 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::b8e2:2aff:fe24:1a10/64 scope link 2023-11-28T13:02:30.914 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:02:30.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:02:30.914 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T13:02:30.928 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-11-28T13:02:30.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:02:30.929 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-11-28T13:02:30.979 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-11-28T13:02:30.979 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T13:02:30.979 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T13:02:30.979 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T13:02:30.979 INFO:teuthology.orchestra.run.smithi082.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T13:02:30.979 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-28T13:02:30.980 INFO:teuthology.orchestra.run.smithi082.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T13:02:30.980 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T13:02:30.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:02:30.980 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-11-28T13:02:30.980 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-11-28T13:02:30.980 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T13:02:30.980 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T13:02:30.980 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T13:02:30.980 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-11-28T13:02:31.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:02:31.021 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-11-28T13:02:31.026 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T13:02:31.026 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T13:02:31.026 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T13:02:31.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:02:31.026 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-11-28T13:02:31.041 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T13:02:31.041 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T13:02:31.041 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T13:02:31.093 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T13:02:31.094 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T13:02:31.094 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T13:02:31.100 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2023-11-28T13:02:31.159 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T13:02:31.159 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T13:02:31.173 INFO:teuthology.orchestra.run.smithi082.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T13:02:31.173 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T13:02:31.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:02:31.174 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2023-11-28T13:02:31.180 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T13:02:31.180 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-28T13:02:31.224 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2023-11-28T13:02:31.242 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T13:02:31.242 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T13:02:31.251 INFO:teuthology.orchestra.run.smithi082.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T13:02:31.251 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T13:02:31.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:02:31.254 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2023-11-28T13:02:31.317 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:2023-11-28T13:02:31.313+0000 7fbc9d938640 -1 init, newargv = 0x560def493ad0 newargc=15 2023-11-28T13:02:31.317 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[49988]: starting ceph client 2023-11-28T13:02:31.326 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[49988]: starting fuse 2023-11-28T13:02:32.360 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2023-11-28T13:02:32.382 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T13:02:32.382 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T13:02:32.398 INFO:teuthology.orchestra.run.smithi082.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T13:02:32.399 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T13:02:32.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:02:32.400 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2023-11-28T13:02:32.407 INFO:teuthology.orchestra.run.smithi082.stdout:52 2023-11-28T13:02:32.408 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-28T13:02:32.408 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T13:02:32.408 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2023-11-28T13:02:32.408 DEBUG:teuthology.orchestra.run.smithi082:> import re 2023-11-28T13:02:32.408 DEBUG:teuthology.orchestra.run.smithi082:> import os 2023-11-28T13:02:32.409 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2023-11-28T13:02:32.409 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:02:32.409 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2023-11-28T13:02:32.409 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T13:02:32.409 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2023-11-28T13:02:32.409 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T13:02:32.409 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:02:32.409 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2023-11-28T13:02:32.409 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2023-11-28T13:02:32.409 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2023-11-28T13:02:32.409 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2023-11-28T13:02:32.410 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:02:32.410 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2023-11-28T13:02:32.410 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T13:02:32.410 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T13:02:32.410 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T13:02:32.410 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2023-11-28T13:02:32.410 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2023-11-28T13:02:32.411 DEBUG:teuthology.orchestra.run.smithi082:> return f 2023-11-28T13:02:32.411 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T13:02:32.411 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:02:32.411 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.0")) 2023-11-28T13:02:32.411 DEBUG:teuthology.orchestra.run.smithi082:> ' 2023-11-28T13:02:32.533 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.0.49988.asok 2023-11-28T13:02:32.717 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49988.asok 2023-11-28T13:02:32.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:02:32.717 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49988.asok status 2023-11-28T13:02:32.819 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:02:32.820 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2023-11-28T13:02:32.820 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T13:02:32.820 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T13:02:32.821 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "0", 2023-11-28T13:02:32.821 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2023-11-28T13:02:32.821 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T13:02:32.821 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "49988", 2023-11-28T13:02:32.821 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/" 2023-11-28T13:02:32.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:32.821 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2023-11-28T13:02:32.821 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2023-11-28T13:02:32.821 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 6009, 2023-11-28T13:02:32.822 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2023-11-28T13:02:32.822 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2023-11-28T13:02:32.822 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2023-11-28T13:02:32.822 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 6009 2023-11-28T13:02:32.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:32.822 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2023-11-28T13:02:32.822 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2023-11-28T13:02:32.822 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2023-11-28T13:02:32.822 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 889288337 2023-11-28T13:02:32.822 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:32.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:32.822 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2023-11-28T13:02:32.823 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2023-11-28T13:02:32.823 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2023-11-28T13:02:32.823 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 889288337 2023-11-28T13:02:32.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:32.823 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.6009 192.168.0.1:0/889288337", 2023-11-28T13:02:32.823 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "192.168.0.1:0/889288337", 2023-11-28T13:02:32.823 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 1, 2023-11-28T13:02:32.823 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 22, 2023-11-28T13:02:32.823 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 51, 2023-11-28T13:02:32.823 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2023-11-28T13:02:32.823 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2023-11-28T13:02:32.823 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2023-11-28T13:02:32.823 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:02:32.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:02:32.829 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2023-11-28T13:02:32.829 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T13:02:32.837 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2023-11-28T13:02:32.837 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T13:02:32.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:02:32.837 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T13:02:32.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:02:32.897 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2023-11-28T13:02:32.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:02:32.915 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2023-11-28T13:02:32.929 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T13:02:32.929 DEBUG:teuthology.orchestra.run.smithi082:> import os 2023-11-28T13:02:32.930 DEBUG:teuthology.orchestra.run.smithi082:> import stat 2023-11-28T13:02:32.930 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:02:32.930 DEBUG:teuthology.orchestra.run.smithi082:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2023-11-28T13:02:32.930 DEBUG:teuthology.orchestra.run.smithi082:> ' 2023-11-28T13:02:32.997 INFO:teuthology.orchestra.run.smithi082.stdout:1099511627777 2023-11-28T13:02:33.188 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:02:33.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.345+0000 7f77a67b0700 1 Processor -- start 2023-11-28T13:02:33.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.345+0000 7f77a67b0700 1 -- start start 2023-11-28T13:02:33.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.345+0000 7f77a67b0700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77a015c1c0 0x7f77a00c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.345+0000 7f77a67b0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a00cd2e0 con 0x7f77a006dae0 2023-11-28T13:02:33.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.345+0000 7f77a67b0700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a00ca9c0 con 0x7f77a00ca4b0 2023-11-28T13:02:33.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.345+0000 7f77a67b0700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00cd530 con 0x7f77a015c1c0 2023-11-28T13:02:33.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.345+0000 7f77a5faf700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f77a006dae0 0x7f77a00ce010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43508/0 (socket says 172.21.15.82:43508) 2023-11-28T13:02:33.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.345+0000 7f77a5faf700 1 -- 172.21.15.82:0/1736364557 learned_addr learned my addr 172.21.15.82:0/1736364557 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:33.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.345+0000 7f77a57ae700 1 --2- 172.21.15.82:0/1736364557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77a015c1c0 0x7f77a00c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.345+0000 7f7797fff700 1 -- 172.21.15.82:0/1736364557 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1837264814 0 0) 0x7f77a00cd2e0 con 0x7f77a006dae0 2023-11-28T13:02:33.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.345+0000 7f7797fff700 1 -- 172.21.15.82:0/1736364557 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f778c0035d0 con 0x7f77a006dae0 2023-11-28T13:02:33.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f7797fff700 1 -- 172.21.15.82:0/1736364557 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3178654532 0 0) 0x7f778c0035d0 con 0x7f77a006dae0 2023-11-28T13:02:33.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f7797fff700 1 -- 172.21.15.82:0/1736364557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77a015c1c0 msgr2=0x7f77a00c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:33.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f7797fff700 1 --2- 172.21.15.82:0/1736364557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77a015c1c0 0x7f77a00c9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f7797fff700 1 -- 172.21.15.82:0/1736364557 >> v1:172.21.15.114:6789/0 conn(0x7f77a00ca4b0 legacy=0x7f77a006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:33.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f7797fff700 1 -- 172.21.15.82:0/1736364557 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a00cd810 con 0x7f77a006dae0 2023-11-28T13:02:33.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f7797fff700 1 -- 172.21.15.82:0/1736364557 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f77980019f0 con 0x7f77a006dae0 2023-11-28T13:02:33.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f7797fff700 1 -- 172.21.15.82:0/1736364557 >> v1:172.21.15.82:6789/0 conn(0x7f77a006dae0 legacy=0x7f77a00ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:33.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f7797fff700 1 --2- 172.21.15.82:0/1736364557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f778c003a50 0x7f778c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f7797fff700 1 --2- 172.21.15.82:0/1736364557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77a015c1c0 0x7f778c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f7797fff700 1 --2- 172.21.15.82:0/1736364557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f778c004db0 0x7f778c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f7797fff700 1 -- 172.21.15.82:0/1736364557 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00cd530 con 0x7f778c004db0 2023-11-28T13:02:33.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f7797fff700 1 -- 172.21.15.82:0/1736364557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c00bae0 con 0x7f778c003a50 2023-11-28T13:02:33.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f7797fff700 1 -- 172.21.15.82:0/1736364557 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778c00bc70 con 0x7f77a015c1c0 2023-11-28T13:02:33.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f77a5faf700 1 --2- 172.21.15.82:0/1736364557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f778c004db0 0x7f778c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f77a57ae700 1 --2- 172.21.15.82:0/1736364557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f778c003a50 0x7f778c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f77a4fad700 1 --2- 172.21.15.82:0/1736364557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77a015c1c0 0x7f778c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f77a5faf700 1 -- 172.21.15.82:0/1736364557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77a015c1c0 msgr2=0x7f778c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:33.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f77a5faf700 1 --2- 172.21.15.82:0/1736364557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77a015c1c0 0x7f778c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f77a5faf700 1 -- 172.21.15.82:0/1736364557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f778c003a50 msgr2=0x7f778c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:33.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f77a5faf700 1 --2- 172.21.15.82:0/1736364557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f778c003a50 0x7f778c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f77a5faf700 1 -- 172.21.15.82:0/1736364557 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778c0035d0 con 0x7f778c004db0 2023-11-28T13:02:33.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f77a5faf700 1 --2- 172.21.15.82:0/1736364557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f778c004db0 0x7f778c005220 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f77a0071060 tx=0x7f778c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5290103d95f58590 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:33.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f7797fff700 1 -- 172.21.15.82:0/1736364557 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77980072d0 con 0x7f778c004db0 2023-11-28T13:02:33.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f7797fff700 1 -- 172.21.15.82:0/1736364557 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779800ae90 con 0x7f778c004db0 2023-11-28T13:02:33.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f7797fff700 1 -- 172.21.15.82:0/1736364557 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7798007690 con 0x7f778c004db0 2023-11-28T13:02:33.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f77a67b0700 1 -- 172.21.15.82:0/1736364557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f778c004db0 msgr2=0x7f778c005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:33.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f77a67b0700 1 --2- 172.21.15.82:0/1736364557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f778c004db0 0x7f778c005220 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f77a0071060 tx=0x7f778c0058a0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f77a5faf700 1 -- 172.21.15.82:0/1736364557 reap_dead start 2023-11-28T13:02:33.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f77a67b0700 1 -- 172.21.15.82:0/1736364557 shutdown_connections 2023-11-28T13:02:33.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f77a67b0700 1 -- 172.21.15.82:0/1736364557 >> 172.21.15.82:0/1736364557 conn(0x7f77a00cf710 msgr2=0x7f77a00cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:33.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f77a67b0700 1 -- 172.21.15.82:0/1736364557 shutdown_connections 2023-11-28T13:02:33.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.349+0000 7f77a67b0700 1 -- 172.21.15.82:0/1736364557 wait complete. 2023-11-28T13:02:33.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a67b0700 1 Processor -- start 2023-11-28T13:02:33.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a67b0700 1 -- start start 2023-11-28T13:02:33.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a67b0700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77a01ef200 0x7f77a006a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a67b0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77a006aa20 0x7f77a01f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a67b0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77a01f2420 0x7f77a01f5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a67b0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a0158720 con 0x7f77a01f2420 2023-11-28T13:02:33.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a67b0700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a006ae90 con 0x7f77a006aa20 2023-11-28T13:02:33.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a67b0700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a01f2c30 con 0x7f77a01ef200 2023-11-28T13:02:33.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a5faf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77a01f2420 0x7f77a01f5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a5faf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77a01f2420 0x7f77a01f5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46740/0 (socket says 172.21.15.82:46740) 2023-11-28T13:02:33.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a5faf700 1 -- 172.21.15.82:0/2734187294 learned_addr learned my addr 172.21.15.82:0/2734187294 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:33.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a4fad700 1 --2- 172.21.15.82:0/2734187294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77a006aa20 0x7f77a01f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a57ae700 1 --2- 172.21.15.82:0/2734187294 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77a01ef200 0x7f77a006a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a5faf700 1 -- 172.21.15.82:0/2734187294 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77a01ef200 msgr2=0x7f77a006a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:33.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a5faf700 1 --2- 172.21.15.82:0/2734187294 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77a01ef200 0x7f77a006a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a5faf700 1 -- 172.21.15.82:0/2734187294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77a006aa20 msgr2=0x7f77a01f1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:33.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a5faf700 1 --2- 172.21.15.82:0/2734187294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77a006aa20 0x7f77a01f1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a5faf700 1 -- 172.21.15.82:0/2734187294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a015c590 con 0x7f77a01f2420 2023-11-28T13:02:33.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a57ae700 1 --2- 172.21.15.82:0/2734187294 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77a01ef200 0x7f77a006a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:02:33.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a4fad700 1 --2- 172.21.15.82:0/2734187294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77a006aa20 0x7f77a01f1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:02:33.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a5faf700 1 --2- 172.21.15.82:0/2734187294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77a01f2420 0x7f77a01f5310 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f778c0047c0 tx=0x7f7798001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:33.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f7795ffb700 1 -- 172.21.15.82:0/2734187294 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77980019b0 con 0x7f77a01f2420 2023-11-28T13:02:33.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f7795ffb700 1 -- 172.21.15.82:0/2734187294 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779801f400 con 0x7f77a01f2420 2023-11-28T13:02:33.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a67b0700 1 -- 172.21.15.82:0/2734187294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a00cdaf0 con 0x7f77a01f2420 2023-11-28T13:02:33.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f7795ffb700 1 -- 172.21.15.82:0/2734187294 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779801f7b0 con 0x7f77a01f2420 2023-11-28T13:02:33.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.353+0000 7f77a67b0700 1 -- 172.21.15.82:0/2734187294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a0160b70 con 0x7f77a01f2420 2023-11-28T13:02:33.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.357+0000 7f77a67b0700 1 -- 172.21.15.82:0/2734187294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a0158860 con 0x7f77a01f2420 2023-11-28T13:02:33.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.357+0000 7f7795ffb700 1 -- 172.21.15.82:0/2734187294 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7798010070 con 0x7f77a01f2420 2023-11-28T13:02:33.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.357+0000 7f7795ffb700 1 --2- 172.21.15.82:0/2734187294 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7784064f10 0x7f77840673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.357+0000 7f7795ffb700 1 -- 172.21.15.82:0/2734187294 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7798083e60 con 0x7f77a01f2420 2023-11-28T13:02:33.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.357+0000 7f77a57ae700 1 --2- 172.21.15.82:0/2734187294 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7784064f10 0x7f77840673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.357+0000 7f77a57ae700 1 --2- 172.21.15.82:0/2734187294 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7784064f10 0x7f77840673c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f77900144c0 tx=0x7f7790009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:33.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.365+0000 7f7795ffb700 1 -- 172.21.15.82:0/2734187294 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7798052050 con 0x7f77a01f2420 2023-11-28T13:02:33.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.557+0000 7f77a67b0700 1 -- 172.21.15.82:0/2734187294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77a0158860 con 0x7f77a01f2420 2023-11-28T13:02:33.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.561+0000 7f7795ffb700 1 -- 172.21.15.82:0/2734187294 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f77a0158860 con 0x7f77a01f2420 2023-11-28T13:02:33.563 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:33.563 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/704061431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":704061431},{"type":"v1","addr":"172.21.15.114:6834","nonce":704061431}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3972503523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3972503523},{"type":"v1","addr":"172.21.15.82:6836","nonce":3972503523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5811,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2000262220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2000262220},{"type":"v1","addr":"172.21.15.82:6837","nonce":2000262220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:02:20.454524+0000","modified":"2023-11-28T13:02:23.476763+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5814":{"gid":5814,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/4092152651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":4092152651},{"type":"v1","addr":"172.21.15.114:6835","nonce":4092152651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T13:02:33.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.561+0000 7f77a67b0700 1 -- 172.21.15.82:0/2734187294 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7784064f10 msgr2=0x7f77840673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:33.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.561+0000 7f77a67b0700 1 --2- 172.21.15.82:0/2734187294 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7784064f10 0x7f77840673c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f77900144c0 tx=0x7f7790009240 comp rx=0 tx=0).stop 2023-11-28T13:02:33.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.561+0000 7f77a67b0700 1 -- 172.21.15.82:0/2734187294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77a01f2420 msgr2=0x7f77a01f5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:33.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.561+0000 7f77a67b0700 1 --2- 172.21.15.82:0/2734187294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77a01f2420 0x7f77a01f5310 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f778c0047c0 tx=0x7f7798001d80 comp rx=0 tx=0).stop 2023-11-28T13:02:33.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.561+0000 7f77a67b0700 1 -- 172.21.15.82:0/2734187294 shutdown_connections 2023-11-28T13:02:33.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.561+0000 7f77a67b0700 1 --2- 172.21.15.82:0/2734187294 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7784064f10 0x7f77840673c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.561+0000 7f77a67b0700 1 --2- 172.21.15.82:0/2734187294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77a01f2420 0x7f77a01f5310 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.561+0000 7f77a67b0700 1 --2- 172.21.15.82:0/2734187294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77a006aa20 0x7f77a01f1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.561+0000 7f77a67b0700 1 --2- 172.21.15.82:0/2734187294 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77a01ef200 0x7f77a006a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.561+0000 7f77a67b0700 1 -- 172.21.15.82:0/2734187294 >> 172.21.15.82:0/2734187294 conn(0x7f77a00cf710 msgr2=0x7f77a0071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:33.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.561+0000 7f77a67b0700 1 -- 172.21.15.82:0/2734187294 shutdown_connections 2023-11-28T13:02:33.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.561+0000 7f77a67b0700 1 -- 172.21.15.82:0/2734187294 wait complete. 2023-11-28T13:02:33.567 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 22 2023-11-28T13:02:33.577 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2023-11-28T13:02:33.723 INFO:teuthology.orchestra.run.smithi114.stdout:{"message":"","return_code":0} 2023-11-28T13:02:33.723 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-28T13:02:33.724 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-11-28T13:02:33.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c5692c140 1 Processor -- start 2023-11-28T13:02:33.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c5692c140 1 -- start start 2023-11-28T13:02:33.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c5692c140 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d066605d80 0x55d0666d64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c5692c140 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55d0666d7250 0x55d0666043a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c5692c140 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0666d7620 0x55d0666d8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c5692c140 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d066529240 con 0x55d0666d7620 2023-11-28T13:02:33.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c5692c140 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0666d9a30 con 0x55d066605d80 2023-11-28T13:02:33.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c5692c140 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d0666d9c60 con 0x55d0666d7250 2023-11-28T13:02:33.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c54c62700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0666d7620 0x55d0666d8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c54461700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d066605d80 0x55d0666d64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c53c60700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55d0666d7250 0x55d0666043a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c54c62700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0666d7620 0x55d0666d8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46748/0 (socket says 172.21.15.82:46748) 2023-11-28T13:02:33.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c54c62700 1 -- 172.21.15.82:0/1894618571 learned_addr learned my addr 172.21.15.82:0/1894618571 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:33.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c54c62700 1 -- 172.21.15.82:0/1894618571 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55d0666d7250 msgr2=0x55d0666043a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:33.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c54c62700 1 --2- 172.21.15.82:0/1894618571 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55d0666d7250 0x55d0666043a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c54c62700 1 -- 172.21.15.82:0/1894618571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d066605d80 msgr2=0x55d0666d64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:33.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c54c62700 1 --2- 172.21.15.82:0/1894618571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d066605d80 0x55d0666d64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c54c62700 1 -- 172.21.15.82:0/1894618571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4400a1c0 con 0x55d0666d7620 2023-11-28T13:02:33.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c54c62700 1 --2- 172.21.15.82:0/1894618571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0666d7620 0x55d0666d8010 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x55d066632710 tx=0x7f6c4400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511b7ed883dccde0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:33.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c52c5e700 1 -- 172.21.15.82:0/1894618571 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4400e710 con 0x55d0666d7620 2023-11-28T13:02:33.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c52c5e700 1 -- 172.21.15.82:0/1894618571 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4400e9e0 con 0x55d0666d7620 2023-11-28T13:02:33.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.761+0000 7f6c52c5e700 1 -- 172.21.15.82:0/1894618571 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4400ed90 con 0x55d0666d7620 2023-11-28T13:02:33.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.765+0000 7f6c5692c140 1 -- 172.21.15.82:0/1894618571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0666d7620 msgr2=0x55d0666d8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:33.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.765+0000 7f6c5692c140 1 --2- 172.21.15.82:0/1894618571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0666d7620 0x55d0666d8010 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x55d066632710 tx=0x7f6c4400e000 comp rx=0 tx=0).stop 2023-11-28T13:02:33.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.765+0000 7f6c5692c140 1 -- 172.21.15.82:0/1894618571 shutdown_connections 2023-11-28T13:02:33.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.765+0000 7f6c5692c140 1 --2- 172.21.15.82:0/1894618571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0666d7620 0x55d0666d8010 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.765+0000 7f6c5692c140 1 --2- 172.21.15.82:0/1894618571 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55d0666d7250 0x55d0666043a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.765+0000 7f6c5692c140 1 --2- 172.21.15.82:0/1894618571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d066605d80 0x55d0666d64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.765+0000 7f6c5692c140 1 -- 172.21.15.82:0/1894618571 >> 172.21.15.82:0/1894618571 conn(0x55d066630d50 msgr2=0x55d0666d3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:33.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.765+0000 7f6c5692c140 1 -- 172.21.15.82:0/1894618571 shutdown_connections 2023-11-28T13:02:33.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.765+0000 7f6c5692c140 1 -- 172.21.15.82:0/1894618571 wait complete. 2023-11-28T13:02:33.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.765+0000 7f6c5692c140 1 Processor -- start 2023-11-28T13:02:33.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.765+0000 7f6c5692c140 1 -- start start 2023-11-28T13:02:33.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c5692c140 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d066605d80 0x55d0666c2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c5692c140 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d0666d7250 0x55d06662d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c5692c140 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55d0666d7620 0x55d0666d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c5692c140 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d066647810 con 0x55d066605d80 2023-11-28T13:02:33.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c5692c140 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d066647ab0 con 0x55d0666d7250 2023-11-28T13:02:33.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c5692c140 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d066647d50 con 0x55d0666d7620 2023-11-28T13:02:33.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c54461700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d066605d80 0x55d0666c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c54461700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d066605d80 0x55d0666c2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46752/0 (socket says 172.21.15.82:46752) 2023-11-28T13:02:33.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c54461700 1 -- 172.21.15.82:0/4293081443 learned_addr learned my addr 172.21.15.82:0/4293081443 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:33.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c54c62700 1 --2- 172.21.15.82:0/4293081443 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55d0666d7620 0x55d0666d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c53c60700 1 --2- 172.21.15.82:0/4293081443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d0666d7250 0x55d06662d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c54461700 1 -- 172.21.15.82:0/4293081443 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55d0666d7620 msgr2=0x55d0666d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:33.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c54461700 1 --2- 172.21.15.82:0/4293081443 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55d0666d7620 0x55d0666d55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c54461700 1 -- 172.21.15.82:0/4293081443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d0666d7250 msgr2=0x55d06662d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:33.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c54461700 1 --2- 172.21.15.82:0/4293081443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d0666d7250 0x55d06662d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c54461700 1 -- 172.21.15.82:0/4293081443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d06655b760 con 0x55d066605d80 2023-11-28T13:02:33.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c54461700 1 --2- 172.21.15.82:0/4293081443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d066605d80 0x55d0666c2660 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c002d10 tx=0x7f6c4c00c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:33.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c51c5c700 1 -- 172.21.15.82:0/4293081443 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c002bb0 con 0x55d066605d80 2023-11-28T13:02:33.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c51c5c700 1 -- 172.21.15.82:0/4293081443 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c008030 con 0x55d066605d80 2023-11-28T13:02:33.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c5692c140 1 -- 172.21.15.82:0/4293081443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d066541390 con 0x55d066605d80 2023-11-28T13:02:33.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c51c5c700 1 -- 172.21.15.82:0/4293081443 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c00cd60 con 0x55d066605d80 2023-11-28T13:02:33.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c5692c140 1 -- 172.21.15.82:0/4293081443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d0665348b0 con 0x55d066605d80 2023-11-28T13:02:33.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.769+0000 7f6c51c5c700 1 -- 172.21.15.82:0/4293081443 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6c4c021070 con 0x55d066605d80 2023-11-28T13:02:33.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.773+0000 7f6c51c5c700 1 --2- 172.21.15.82:0/4293081443 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c34063810 0x7f6c34065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.773+0000 7f6c51c5c700 1 -- 172.21.15.82:0/4293081443 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6c4c080a30 con 0x55d066605d80 2023-11-28T13:02:33.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.773+0000 7f6c53c60700 1 --2- 172.21.15.82:0/4293081443 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c34063810 0x7f6c34065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.773+0000 7f6c5692c140 1 --2- 172.21.15.82:0/4293081443 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x55d066648730 0x55d066646990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.773+0000 7f6c5692c140 1 -- 172.21.15.82:0/4293081443 --> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55d066646ed0 con 0x55d066648730 2023-11-28T13:02:33.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.773+0000 7f6c53c60700 1 --2- 172.21.15.82:0/4293081443 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c34063810 0x7f6c34065cc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0097e0 tx=0x7f6c3c005ae0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:33.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.773+0000 7f6c54c62700 1 --2- 172.21.15.82:0/4293081443 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x55d066648730 0x55d066646990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.773+0000 7f6c54c62700 1 --2- 172.21.15.82:0/4293081443 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x55d066648730 0x55d066646990 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:33.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.773+0000 7f6c54c62700 1 -- 172.21.15.82:0/4293081443 <== osd.1 v2:172.21.15.82:6808/36628 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f6c4402c040 con 0x55d066648730 2023-11-28T13:02:33.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.773+0000 7f6c5692c140 1 -- 172.21.15.82:0/4293081443 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x55d066648730 msgr2=0x55d066646990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:33.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.773+0000 7f6c5692c140 1 --2- 172.21.15.82:0/4293081443 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x55d066648730 0x55d066646990 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.773+0000 7f6c5692c140 1 -- 172.21.15.82:0/4293081443 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c34063810 msgr2=0x7f6c34065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:33.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.773+0000 7f6c5692c140 1 --2- 172.21.15.82:0/4293081443 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6c34063810 0x7f6c34065cc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0097e0 tx=0x7f6c3c005ae0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.773+0000 7f6c5692c140 1 -- 172.21.15.82:0/4293081443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d066605d80 msgr2=0x55d0666c2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:33.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.773+0000 7f6c5692c140 1 --2- 172.21.15.82:0/4293081443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d066605d80 0x55d0666c2660 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c002d10 tx=0x7f6c4c00c530 comp rx=0 tx=0).stop 2023-11-28T13:02:33.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.773+0000 7f6c54c62700 1 -- 172.21.15.82:0/4293081443 reap_dead start 2023-11-28T13:02:33.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.773+0000 7f6c5692c140 1 -- 172.21.15.82:0/4293081443 shutdown_connections 2023-11-28T13:02:33.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.773+0000 7f6c5692c140 1 -- 172.21.15.82:0/4293081443 >> 172.21.15.82:0/4293081443 conn(0x55d066630d50 msgr2=0x55d0666d4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:33.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.773+0000 7f6c5692c140 1 -- 172.21.15.82:0/4293081443 shutdown_connections 2023-11-28T13:02:33.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.773+0000 7f6c5692c140 1 -- 172.21.15.82:0/4293081443 wait complete. 2023-11-28T13:02:33.783 INFO:teuthology.orchestra.run.smithi082.stdout:Yalphaparent_a 2023-11-28T13:02:33.783 DEBUG:teuthology.orchestra.run.smithi082:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-11-28T13:02:33.889 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:02:33.890 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511627777, 2023-11-28T13:02:33.890 INFO:teuthology.orchestra.run.smithi082.stdout: "ancestors": [ 2023-11-28T13:02:33.890 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:33.890 INFO:teuthology.orchestra.run.smithi082.stdout: "dirino": 1099511627776, 2023-11-28T13:02:33.890 INFO:teuthology.orchestra.run.smithi082.stdout: "dname": "alpha", 2023-11-28T13:02:33.890 INFO:teuthology.orchestra.run.smithi082.stdout: "version": 2 2023-11-28T13:02:33.890 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:02:33.890 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:02:33.890 INFO:teuthology.orchestra.run.smithi082.stdout: "dirino": 1, 2023-11-28T13:02:33.891 INFO:teuthology.orchestra.run.smithi082.stdout: "dname": "parent_a", 2023-11-28T13:02:33.891 INFO:teuthology.orchestra.run.smithi082.stdout: "version": 4 2023-11-28T13:02:33.891 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:33.891 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-11-28T13:02:33.891 INFO:teuthology.orchestra.run.smithi082.stdout: "pool": 8, 2023-11-28T13:02:33.891 INFO:teuthology.orchestra.run.smithi082.stdout: "old_pools": [] 2023-11-28T13:02:33.891 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:02:33.891 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:33.892 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2023-11-28T13:02:33.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f236db1e140 1 Processor -- start 2023-11-28T13:02:33.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f236db1e140 1 -- start start 2023-11-28T13:02:33.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f236db1e140 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5631b447c850 0x5631b44c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f236db1e140 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5631b44c11d0 0x5631b44a5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f236db1e140 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631b454e260 0x5631b44ba340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f236db1e140 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631b43a0240 con 0x5631b454e260 2023-11-28T13:02:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f236db1e140 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631b454d660 con 0x5631b447c850 2023-11-28T13:02:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f236db1e140 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631b454af60 con 0x5631b44c11d0 2023-11-28T13:02:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f236be54700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631b454e260 0x5631b44ba340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f236be54700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631b454e260 0x5631b44ba340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46760/0 (socket says 172.21.15.82:46760) 2023-11-28T13:02:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f236b653700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5631b447c850 0x5631b44c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f236be54700 1 -- 172.21.15.82:0/3338885204 learned_addr learned my addr 172.21.15.82:0/3338885204 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:33.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f236ae52700 1 --2- 172.21.15.82:0/3338885204 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5631b44c11d0 0x5631b44a5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f236be54700 1 -- 172.21.15.82:0/3338885204 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5631b44c11d0 msgr2=0x5631b44a5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:33.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f236be54700 1 --2- 172.21.15.82:0/3338885204 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5631b44c11d0 0x5631b44a5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f236be54700 1 -- 172.21.15.82:0/3338885204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5631b447c850 msgr2=0x5631b44c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:33.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f236be54700 1 --2- 172.21.15.82:0/3338885204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5631b447c850 0x5631b44c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f236be54700 1 -- 172.21.15.82:0/3338885204 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2354005d20 con 0x5631b454e260 2023-11-28T13:02:33.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f236be54700 1 --2- 172.21.15.82:0/3338885204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631b454e260 0x5631b44ba340 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f235c001e60 tx=0x7f235c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6dd82d195fcc401 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:33.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f2369e50700 1 -- 172.21.15.82:0/3338885204 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c00f3a0 con 0x5631b454e260 2023-11-28T13:02:33.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f2369e50700 1 -- 172.21.15.82:0/3338885204 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c00a040 con 0x5631b454e260 2023-11-28T13:02:33.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f2369e50700 1 -- 172.21.15.82:0/3338885204 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c00f740 con 0x5631b454e260 2023-11-28T13:02:33.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f236db1e140 1 -- 172.21.15.82:0/3338885204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631b454e260 msgr2=0x5631b44ba340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:33.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.929+0000 7f236db1e140 1 --2- 172.21.15.82:0/3338885204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631b454e260 0x5631b44ba340 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f235c001e60 tx=0x7f235c00b4a0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236db1e140 1 -- 172.21.15.82:0/3338885204 shutdown_connections 2023-11-28T13:02:33.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236db1e140 1 --2- 172.21.15.82:0/3338885204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631b454e260 0x5631b44ba340 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236db1e140 1 --2- 172.21.15.82:0/3338885204 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5631b44c11d0 0x5631b44a5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236db1e140 1 --2- 172.21.15.82:0/3338885204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5631b447c850 0x5631b44c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236db1e140 1 -- 172.21.15.82:0/3338885204 >> 172.21.15.82:0/3338885204 conn(0x5631b44a7d60 msgr2=0x5631b44a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:33.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236db1e140 1 -- 172.21.15.82:0/3338885204 shutdown_connections 2023-11-28T13:02:33.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236db1e140 1 -- 172.21.15.82:0/3338885204 wait complete. 2023-11-28T13:02:33.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236db1e140 1 Processor -- start 2023-11-28T13:02:33.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236db1e140 1 -- start start 2023-11-28T13:02:33.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236db1e140 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5631b447c850 0x5631b44a6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236db1e140 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631b44c11d0 0x5631b447b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236db1e140 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5631b454e260 0x5631b447b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236db1e140 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631b45da690 con 0x5631b44c11d0 2023-11-28T13:02:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236db1e140 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631b44a6e40 con 0x5631b447c850 2023-11-28T13:02:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236db1e140 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631b454fc50 con 0x5631b454e260 2023-11-28T13:02:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236ae52700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631b44c11d0 0x5631b447b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236ae52700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631b44c11d0 0x5631b447b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46770/0 (socket says 172.21.15.82:46770) 2023-11-28T13:02:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236ae52700 1 -- 172.21.15.82:0/62257057 learned_addr learned my addr 172.21.15.82:0/62257057 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236be54700 1 --2- 172.21.15.82:0/62257057 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5631b454e260 0x5631b447b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236b653700 1 --2- 172.21.15.82:0/62257057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5631b447c850 0x5631b44a6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236ae52700 1 -- 172.21.15.82:0/62257057 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5631b454e260 msgr2=0x5631b447b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236ae52700 1 --2- 172.21.15.82:0/62257057 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5631b454e260 0x5631b447b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236ae52700 1 -- 172.21.15.82:0/62257057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5631b447c850 msgr2=0x5631b44a6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236ae52700 1 --2- 172.21.15.82:0/62257057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5631b447c850 0x5631b44a6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236ae52700 1 -- 172.21.15.82:0/62257057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c001ac0 con 0x5631b44c11d0 2023-11-28T13:02:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236be54700 1 --2- 172.21.15.82:0/62257057 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5631b454e260 0x5631b447b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:02:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236b653700 1 --2- 172.21.15.82:0/62257057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5631b447c850 0x5631b44a6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:02:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236ae52700 1 --2- 172.21.15.82:0/62257057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631b44c11d0 0x5631b447b130 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2354008a40 tx=0x7f2354008e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f2368e4e700 1 -- 172.21.15.82:0/62257057 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235400f040 con 0x5631b44c11d0 2023-11-28T13:02:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f2368e4e700 1 -- 172.21.15.82:0/62257057 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2354010ab0 con 0x5631b44c11d0 2023-11-28T13:02:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.933+0000 7f236db1e140 1 -- 172.21.15.82:0/62257057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5631b43ab8b0 con 0x5631b44c11d0 2023-11-28T13:02:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.937+0000 7f2368e4e700 1 -- 172.21.15.82:0/62257057 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2354010e20 con 0x5631b44c11d0 2023-11-28T13:02:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.937+0000 7f236db1e140 1 -- 172.21.15.82:0/62257057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236400a1c0 con 0x5631b44c11d0 2023-11-28T13:02:33.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.937+0000 7f2368e4e700 1 -- 172.21.15.82:0/62257057 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2354025070 con 0x5631b44c11d0 2023-11-28T13:02:33.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.937+0000 7f2368e4e700 1 --2- 172.21.15.82:0/62257057 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f234c063840 0x7f234c065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.941+0000 7f236b653700 1 --2- 172.21.15.82:0/62257057 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f234c063840 0x7f234c065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.941+0000 7f2368e4e700 1 -- 172.21.15.82:0/62257057 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f23540816a0 con 0x5631b44c11d0 2023-11-28T13:02:33.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.941+0000 7f236db1e140 1 --2- 172.21.15.82:0/62257057 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x5631b45d80b0 0x5631b45f02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:33.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.941+0000 7f236db1e140 1 -- 172.21.15.82:0/62257057 --> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5631b454f740 con 0x5631b45d80b0 2023-11-28T13:02:33.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.941+0000 7f236be54700 1 --2- 172.21.15.82:0/62257057 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x5631b45d80b0 0x5631b45f02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:33.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.941+0000 7f236b653700 1 --2- 172.21.15.82:0/62257057 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f234c063840 0x7f234c065cf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f236400a190 tx=0x7f2364007030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:33.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.941+0000 7f236be54700 1 --2- 172.21.15.82:0/62257057 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x5631b45d80b0 0x5631b45f02c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:33.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.941+0000 7f236be54700 1 -- 172.21.15.82:0/62257057 <== osd.1 v2:172.21.15.82:6808/36628 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v51'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f235c0114d0 con 0x5631b45d80b0 2023-11-28T13:02:33.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.941+0000 7f236db1e140 1 -- 172.21.15.82:0/62257057 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x5631b45d80b0 msgr2=0x5631b45f02c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.941+0000 7f236db1e140 1 --2- 172.21.15.82:0/62257057 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x5631b45d80b0 0x5631b45f02c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.941+0000 7f236db1e140 1 -- 172.21.15.82:0/62257057 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f234c063840 msgr2=0x7f234c065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.941+0000 7f236db1e140 1 --2- 172.21.15.82:0/62257057 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f234c063840 0x7f234c065cf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f236400a190 tx=0x7f2364007030 comp rx=0 tx=0).stop 2023-11-28T13:02:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.941+0000 7f236db1e140 1 -- 172.21.15.82:0/62257057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631b44c11d0 msgr2=0x5631b447b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.941+0000 7f236db1e140 1 --2- 172.21.15.82:0/62257057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631b44c11d0 0x5631b447b130 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2354008a40 tx=0x7f2354008e00 comp rx=0 tx=0).stop 2023-11-28T13:02:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.941+0000 7f236be54700 1 -- 172.21.15.82:0/62257057 reap_dead start 2023-11-28T13:02:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.941+0000 7f236db1e140 1 -- 172.21.15.82:0/62257057 shutdown_connections 2023-11-28T13:02:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.941+0000 7f236db1e140 1 -- 172.21.15.82:0/62257057 >> 172.21.15.82:0/62257057 conn(0x5631b44a7d60 msgr2=0x5631b44c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.941+0000 7f236db1e140 1 -- 172.21.15.82:0/62257057 shutdown_connections 2023-11-28T13:02:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:33.945+0000 7f236db1e140 1 -- 172.21.15.82:0/62257057 wait complete. 2023-11-28T13:02:33.950 DEBUG:teuthology.orchestra.run.smithi082:> sudo daemon-helper kill ceph --cluster ceph -w 2023-11-28T13:02:33.952 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2023-11-28T13:02:34.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.069+0000 7fda96b63700 1 Processor -- start 2023-11-28T13:02:34.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda96b63700 1 -- start start 2023-11-28T13:02:34.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda96b63700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fda9006dd50 0x7fda900c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda96b63700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda900ccbf0 0x7fda9006e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda96b63700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9015d560 con 0x7fda900cd120 2023-11-28T13:02:34.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda96b63700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda900c4fb0 con 0x7fda9006dd50 2023-11-28T13:02:34.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda96b63700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda900c45e0 con 0x7fda900ccbf0 2023-11-28T13:02:34.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda95100700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fda900cd120 0x7fda900ca180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43516/0 (socket says 172.21.15.82:43516) 2023-11-28T13:02:34.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda95100700 1 -- 172.21.15.82:0/2538139148 learned_addr learned my addr 172.21.15.82:0/2538139148 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:34.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda948ff700 1 --2- 172.21.15.82:0/2538139148 >> v2:172.21.15.114:3300/0 conn(0x7fda9006dd50 0x7fda900c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda87fff700 1 --2- 172.21.15.82:0/2538139148 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda900ccbf0 0x7fda9006e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda877fe700 1 -- 172.21.15.82:0/2538139148 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562604598 0 0) 0x7fda9015d560 con 0x7fda900cd120 2023-11-28T13:02:34.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda877fe700 1 -- 172.21.15.82:0/2538139148 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda780035d0 con 0x7fda900cd120 2023-11-28T13:02:34.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda877fe700 1 -- 172.21.15.82:0/2538139148 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3791187966 0 0) 0x7fda780035d0 con 0x7fda900cd120 2023-11-28T13:02:34.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda877fe700 1 -- 172.21.15.82:0/2538139148 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda900ccbf0 msgr2=0x7fda9006e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:34.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda877fe700 1 --2- 172.21.15.82:0/2538139148 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda900ccbf0 0x7fda9006e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda877fe700 1 -- 172.21.15.82:0/2538139148 >> v2:172.21.15.114:3300/0 conn(0x7fda9006dd50 msgr2=0x7fda900c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:34.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda877fe700 1 --2- 172.21.15.82:0/2538139148 >> v2:172.21.15.114:3300/0 conn(0x7fda9006dd50 0x7fda900c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda877fe700 1 -- 172.21.15.82:0/2538139148 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9006f440 con 0x7fda900cd120 2023-11-28T13:02:34.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda877fe700 1 -- 172.21.15.82:0/2538139148 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7fda880019f0 con 0x7fda900cd120 2023-11-28T13:02:34.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda877fe700 1 -- 172.21.15.82:0/2538139148 >> v1:172.21.15.82:6789/0 conn(0x7fda900cd120 legacy=0x7fda900ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda877fe700 1 --2- 172.21.15.82:0/2538139148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda78003a20 0x7fda78003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda877fe700 1 --2- 172.21.15.82:0/2538139148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda78004870 0x7fda78004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda877fe700 1 --2- 172.21.15.82:0/2538139148 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda900ccbf0 0x7fda78005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda877fe700 1 -- 172.21.15.82:0/2538139148 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda900c4fb0 con 0x7fda78004870 2023-11-28T13:02:34.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda877fe700 1 -- 172.21.15.82:0/2538139148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda900c45e0 con 0x7fda78003a20 2023-11-28T13:02:34.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda877fe700 1 -- 172.21.15.82:0/2538139148 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7800dcc0 con 0x7fda900ccbf0 2023-11-28T13:02:34.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda87fff700 1 --2- 172.21.15.82:0/2538139148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda78004870 0x7fda78004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda948ff700 1 --2- 172.21.15.82:0/2538139148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda78003a20 0x7fda78003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda95100700 1 --2- 172.21.15.82:0/2538139148 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda900ccbf0 0x7fda78005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda87fff700 1 -- 172.21.15.82:0/2538139148 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda900ccbf0 msgr2=0x7fda78005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:34.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda87fff700 1 --2- 172.21.15.82:0/2538139148 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda900ccbf0 0x7fda78005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda87fff700 1 -- 172.21.15.82:0/2538139148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda78003a20 msgr2=0x7fda78003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:34.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda87fff700 1 --2- 172.21.15.82:0/2538139148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda78003a20 0x7fda78003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda87fff700 1 -- 172.21.15.82:0/2538139148 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda780035d0 con 0x7fda78004870 2023-11-28T13:02:34.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda95100700 1 --2- 172.21.15.82:0/2538139148 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda900ccbf0 0x7fda78005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:34.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda87fff700 1 --2- 172.21.15.82:0/2538139148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda78004870 0x7fda78004ce0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fda80009b70 tx=0x7fda780058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c56c65d9899dd15 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:34.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda877fe700 1 -- 172.21.15.82:0/2538139148 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8000e6c0 con 0x7fda78004870 2023-11-28T13:02:34.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda877fe700 1 -- 172.21.15.82:0/2538139148 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8000e820 con 0x7fda78004870 2023-11-28T13:02:34.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.073+0000 7fda877fe700 1 -- 172.21.15.82:0/2538139148 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8000eb90 con 0x7fda78004870 2023-11-28T13:02:34.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.077+0000 7fda96b63700 1 -- 172.21.15.82:0/2538139148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda78004870 msgr2=0x7fda78004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.077+0000 7fda96b63700 1 --2- 172.21.15.82:0/2538139148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda78004870 0x7fda78004ce0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fda80009b70 tx=0x7fda780058a0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.077+0000 7fda95100700 1 -- 172.21.15.82:0/2538139148 reap_dead start 2023-11-28T13:02:34.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.077+0000 7fda96b63700 1 -- 172.21.15.82:0/2538139148 shutdown_connections 2023-11-28T13:02:34.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.077+0000 7fda96b63700 1 -- 172.21.15.82:0/2538139148 >> 172.21.15.82:0/2538139148 conn(0x7fda900b18c0 msgr2=0x7fda900cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:34.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.077+0000 7fda96b63700 1 -- 172.21.15.82:0/2538139148 shutdown_connections 2023-11-28T13:02:34.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.077+0000 7fda96b63700 1 -- 172.21.15.82:0/2538139148 wait complete. 2023-11-28T13:02:34.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.077+0000 7fda96b63700 1 Processor -- start 2023-11-28T13:02:34.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.077+0000 7fda96b63700 1 -- start start 2023-11-28T13:02:34.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda96b63700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda9014a8d0 0x7fda900ad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda96b63700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda900add20 0x7fda9006ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda96b63700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda9006b280 0x7fda900b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda96b63700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9006b700 con 0x7fda900add20 2023-11-28T13:02:34.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda96b63700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda900ae640 con 0x7fda9006b280 2023-11-28T13:02:34.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda96b63700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda900c6670 con 0x7fda9014a8d0 2023-11-28T13:02:34.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0f59e700 1 Processor -- start 2023-11-28T13:02:34.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda87fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda900add20 0x7fda9006ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0f59e700 1 -- start start 2023-11-28T13:02:34.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda87fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda900add20 0x7fda9006ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46796/0 (socket says 172.21.15.82:46796) 2023-11-28T13:02:34.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda87fff700 1 -- 172.21.15.82:0/834745322 learned_addr learned my addr 172.21.15.82:0/834745322 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:34.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda948ff700 1 --2- 172.21.15.82:0/834745322 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda9014a8d0 0x7fda900ad7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda95100700 1 --2- 172.21.15.82:0/834745322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda9006b280 0x7fda900b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda87fff700 1 -- 172.21.15.82:0/834745322 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda9014a8d0 msgr2=0x7fda900ad7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda87fff700 1 --2- 172.21.15.82:0/834745322 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda9014a8d0 0x7fda900ad7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda87fff700 1 -- 172.21.15.82:0/834745322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda9006b280 msgr2=0x7fda900b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda87fff700 1 --2- 172.21.15.82:0/834745322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda9006b280 0x7fda900b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda87fff700 1 -- 172.21.15.82:0/834745322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda900c3fd0 con 0x7fda900add20 2023-11-28T13:02:34.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda95100700 1 --2- 172.21.15.82:0/834745322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda9006b280 0x7fda900b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:34.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda87fff700 1 --2- 172.21.15.82:0/834745322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda900add20 0x7fda9006ad40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fda80016000 tx=0x7fda800047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:34.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0f59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8c10159160 0x7f8c100ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0f59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1015d070 con 0x7f8c100701f0 2023-11-28T13:02:34.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0f59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1006d940 con 0x7f8c100af8f0 2023-11-28T13:02:34.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0f59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1015dc10 con 0x7f8c10159160 2023-11-28T13:02:34.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0ed9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8c100701f0 0x7f8c100ca910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43524/0 (socket says 172.21.15.82:43524) 2023-11-28T13:02:34.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0ed9d700 1 -- 172.21.15.82:0/2160271655 learned_addr learned my addr 172.21.15.82:0/2160271655 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:34.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda857fa700 1 -- 172.21.15.82:0/834745322 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8000e6c0 con 0x7fda900add20 2023-11-28T13:02:34.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda857fa700 1 -- 172.21.15.82:0/834745322 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda80003af0 con 0x7fda900add20 2023-11-28T13:02:34.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda96b63700 1 -- 172.21.15.82:0/834745322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9015da90 con 0x7fda900add20 2023-11-28T13:02:34.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda857fa700 1 -- 172.21.15.82:0/834745322 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda80003ea0 con 0x7fda900add20 2023-11-28T13:02:34.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7fda96b63700 1 -- 172.21.15.82:0/834745322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9015d7b0 con 0x7fda900add20 2023-11-28T13:02:34.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0e59c700 1 --2- 172.21.15.82:0/2160271655 >> v2:172.21.15.114:3300/0 conn(0x7f8c10159160 0x7f8c100ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0e59c700 1 -- 172.21.15.82:0/2160271655 >> v1:172.21.15.114:6789/0 conn(0x7f8c100af8f0 legacy=0x7f8c1015d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0e59c700 1 -- 172.21.15.82:0/2160271655 >> v1:172.21.15.82:6789/0 conn(0x7f8c100701f0 legacy=0x7f8c100ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0e59c700 1 -- 172.21.15.82:0/2160271655 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1015cd40 con 0x7f8c10159160 2023-11-28T13:02:34.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0e59c700 1 --2- 172.21.15.82:0/2160271655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c10159160 0x7f8c100ce180 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009850 tx=0x7f8c00009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dabdf0dc6d46d33 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:34.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0d59a700 1 -- 172.21.15.82:0/2160271655 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c00011830 con 0x7f8c10159160 2023-11-28T13:02:34.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0d59a700 1 -- 172.21.15.82:0/2160271655 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c00011990 con 0x7f8c10159160 2023-11-28T13:02:34.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0d59a700 1 -- 172.21.15.82:0/2160271655 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c00011d20 con 0x7f8c10159160 2023-11-28T13:02:34.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0f59e700 1 -- 172.21.15.82:0/2160271655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c10159160 msgr2=0x7f8c100ce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0f59e700 1 --2- 172.21.15.82:0/2160271655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c10159160 0x7f8c100ce180 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009850 tx=0x7f8c00009b60 comp rx=0 tx=0).stop 2023-11-28T13:02:34.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0f59e700 1 -- 172.21.15.82:0/2160271655 shutdown_connections 2023-11-28T13:02:34.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0f59e700 1 --2- 172.21.15.82:0/2160271655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c10159160 0x7f8c100ce180 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0f59e700 1 -- 172.21.15.82:0/2160271655 >> 172.21.15.82:0/2160271655 conn(0x7f8c100b04a0 msgr2=0x7f8c100b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:34.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0f59e700 1 -- 172.21.15.82:0/2160271655 shutdown_connections 2023-11-28T13:02:34.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.081+0000 7f8c0f59e700 1 -- 172.21.15.82:0/2160271655 wait complete. 2023-11-28T13:02:34.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda857fa700 1 -- 172.21.15.82:0/834745322 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fda8002c030 con 0x7fda900add20 2023-11-28T13:02:34.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8c0f59e700 1 Processor -- start 2023-11-28T13:02:34.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda857fa700 1 --2- 172.21.15.82:0/834745322 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fda7c064f30 0x7fda7c0673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8c0f59e700 1 -- start start 2023-11-28T13:02:34.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda857fa700 1 -- 172.21.15.82:0/834745322 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fda80082fa0 con 0x7fda900add20 2023-11-28T13:02:34.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda948ff700 1 --2- 172.21.15.82:0/834745322 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fda7c064f30 0x7fda7c0673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda99de3740 1 Processor -- start 2023-11-28T13:02:34.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda99de3740 1 -- start start 2023-11-28T13:02:34.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda948ff700 1 --2- 172.21.15.82:0/834745322 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fda7c064f30 0x7fda7c0673e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fda900ca870 tx=0x7fda8c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:34.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8c0f59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c100701f0 0x7f8c10153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8c0f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c100af8f0 0x7f8c100c3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8c0f59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c10159160 0x7f8c100c4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8c0f59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c100c7d30 con 0x7f8c100af8f0 2023-11-28T13:02:34.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8c0f59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c10159780 con 0x7f8c100701f0 2023-11-28T13:02:34.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8c0f59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c10155240 con 0x7f8c10159160 2023-11-28T13:02:34.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8c0dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c100af8f0 0x7f8c100c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8c0dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c100af8f0 0x7f8c100c3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46806/0 (socket says 172.21.15.82:46806) 2023-11-28T13:02:34.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8c0dd9b700 1 -- 172.21.15.82:0/1508942624 learned_addr learned my addr 172.21.15.82:0/1508942624 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:34.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8c0e59c700 1 --2- 172.21.15.82:0/1508942624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c100701f0 0x7f8c10153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8c0ed9d700 1 --2- 172.21.15.82:0/1508942624 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c10159160 0x7f8c100c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8c0dd9b700 1 -- 172.21.15.82:0/1508942624 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c10159160 msgr2=0x7f8c100c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8c0dd9b700 1 --2- 172.21.15.82:0/1508942624 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c10159160 0x7f8c100c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8c0dd9b700 1 -- 172.21.15.82:0/1508942624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c100701f0 msgr2=0x7f8c10153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8c0dd9b700 1 --2- 172.21.15.82:0/1508942624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c100701f0 0x7f8c10153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8c0dd9b700 1 -- 172.21.15.82:0/1508942624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c000094b0 con 0x7f8c100af8f0 2023-11-28T13:02:34.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8c0dd9b700 1 --2- 172.21.15.82:0/1508942624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c100af8f0 0x7f8c100c3710 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8c0400c530 tx=0x7f8c0400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:34.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8bfeffd700 1 -- 172.21.15.82:0/1508942624 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c040052d0 con 0x7f8c100af8f0 2023-11-28T13:02:34.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8bfeffd700 1 -- 172.21.15.82:0/1508942624 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c04005430 con 0x7f8c100af8f0 2023-11-28T13:02:34.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8c0f59e700 1 -- 172.21.15.82:0/1508942624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1006dec0 con 0x7f8c100af8f0 2023-11-28T13:02:34.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8bfeffd700 1 -- 172.21.15.82:0/1508942624 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c040055a0 con 0x7f8c100af8f0 2023-11-28T13:02:34.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8c0f59e700 1 -- 172.21.15.82:0/1508942624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1006dbe0 con 0x7f8c100af8f0 2023-11-28T13:02:34.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda99de3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d3d80 0x2481b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda99de3740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x21d39b0 0x248b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda99de3740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 0x248b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda99de3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x2342c80 con 0x21d3d80 2023-11-28T13:02:34.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda99de3740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x23b2d60 con 0x221ea30 2023-11-28T13:02:34.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda99de3740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x23ac060 con 0x21d39b0 2023-11-28T13:02:34.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda948ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d3d80 0x2481b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda948ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d3d80 0x2481b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46814/0 (socket says 172.21.15.82:46814) 2023-11-28T13:02:34.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda948ff700 1 -- 172.21.15.82:0/3751918743 learned_addr learned my addr 172.21.15.82:0/3751918743 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:34.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda87fff700 1 --2- 172.21.15.82:0/3751918743 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x21d39b0 0x248b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda95100700 1 --2- 172.21.15.82:0/3751918743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 0x248b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda948ff700 1 -- 172.21.15.82:0/3751918743 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x21d39b0 msgr2=0x248b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:34.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda948ff700 1 --2- 172.21.15.82:0/3751918743 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x21d39b0 0x248b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda948ff700 1 -- 172.21.15.82:0/3751918743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 msgr2=0x248b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:34.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda948ff700 1 --2- 172.21.15.82:0/3751918743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 0x248b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda948ff700 1 -- 172.21.15.82:0/3751918743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x23d14e0 con 0x21d3d80 2023-11-28T13:02:34.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda95100700 1 --2- 172.21.15.82:0/3751918743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 0x248b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:02:34.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda948ff700 1 --2- 172.21.15.82:0/3751918743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d3d80 0x2481b20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fda8c026f30 tx=0x7fda8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f22255d18fe1787 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:34.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda767fc700 1 -- 172.21.15.82:0/3751918743 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c02b070 con 0x21d3d80 2023-11-28T13:02:34.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7f8bfcff9700 1 -- 172.21.15.82:0/1508942624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f8be80052f0 con 0x7f8c100af8f0 2023-11-28T13:02:34.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7f8bfeffd700 1 -- 172.21.15.82:0/1508942624 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8c04010050 con 0x7f8c100af8f0 2023-11-28T13:02:34.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda767fc700 1 -- 172.21.15.82:0/3751918743 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c019070 con 0x21d3d80 2023-11-28T13:02:34.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.085+0000 7fda767fc700 1 -- 172.21.15.82:0/3751918743 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c024d90 con 0x21d3d80 2023-11-28T13:02:34.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 1 -- 172.21.15.82:0/3751918743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d3d80 msgr2=0x2481b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 1 --2- 172.21.15.82:0/3751918743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d3d80 0x2481b20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fda8c026f30 tx=0x7fda8c017000 comp rx=0 tx=0).stop 2023-11-28T13:02:34.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 1 -- 172.21.15.82:0/3751918743 shutdown_connections 2023-11-28T13:02:34.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 1 --2- 172.21.15.82:0/3751918743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 0x248b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 1 --2- 172.21.15.82:0/3751918743 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x21d39b0 0x248b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 1 --2- 172.21.15.82:0/3751918743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d3d80 0x2481b20 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 1 -- 172.21.15.82:0/3751918743 >> 172.21.15.82:0/3751918743 conn(0x21d4150 msgr2=0x246c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:34.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 1 -- 172.21.15.82:0/3751918743 shutdown_connections 2023-11-28T13:02:34.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 1 -- 172.21.15.82:0/3751918743 wait complete. 2023-11-28T13:02:34.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7f8bfeffd700 1 --2- 172.21.15.82:0/1508942624 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8bf0064ee0 0x7f8bf0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7f8c0e59c700 1 --2- 172.21.15.82:0/1508942624 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8bf0064ee0 0x7f8bf0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7f8bfeffd700 1 -- 172.21.15.82:0/1508942624 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c04081070 con 0x7f8c100af8f0 2023-11-28T13:02:34.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7f8bfeffd700 1 -- 172.21.15.82:0/1508942624 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+502 (secure 0 0 0) 0x7f8c04088070 con 0x7f8c100af8f0 2023-11-28T13:02:34.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 1 -- start start 2023-11-28T13:02:34.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 1 Processor -- start 2023-11-28T13:02:34.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7f8bfcff9700 1 -- 172.21.15.82:0/1508942624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f8be8005590 con 0x7f8c100af8f0 2023-11-28T13:02:34.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7f8c0e59c700 1 --2- 172.21.15.82:0/1508942624 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8bf0064ee0 0x7f8bf0067390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009fd0 tx=0x7f8c00008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:34.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x21d39b0 0x24905c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d3d80 0x2490b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 0x24919c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x2258dc0 con 0x21d3d80 2023-11-28T13:02:34.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x2481880 con 0x221ea30 2023-11-28T13:02:34.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x2492690 con 0x21d39b0 2023-11-28T13:02:34.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 10 client.0 _ll_register_callbacks cb 0x2407b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:02:34.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda87fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d3d80 0x2490b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda87fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d3d80 0x2490b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46818/0 (socket says 172.21.15.82:46818) 2023-11-28T13:02:34.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda87fff700 1 -- 172.21.15.82:0/831684139 learned_addr learned my addr 172.21.15.82:0/831684139 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:34.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda948ff700 1 --2- 172.21.15.82:0/831684139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x21d39b0 0x24905c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda95100700 1 --2- 172.21.15.82:0/831684139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 0x24919c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda87fff700 1 -- 172.21.15.82:0/831684139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x21d39b0 msgr2=0x24905c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:34.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda87fff700 1 --2- 172.21.15.82:0/831684139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x21d39b0 0x24905c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda87fff700 1 -- 172.21.15.82:0/831684139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 msgr2=0x24919c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:34.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda87fff700 1 --2- 172.21.15.82:0/831684139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 0x24919c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda87fff700 1 -- 172.21.15.82:0/831684139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8c026b80 con 0x21d3d80 2023-11-28T13:02:34.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda95100700 1 --2- 172.21.15.82:0/831684139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 0x24919c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:34.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda87fff700 1 --2- 172.21.15.82:0/831684139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d3d80 0x2490b00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fda80051460 tx=0x7fda800549c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e1a5c46d0dcd52 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:34.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda6f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-11-28T13:02:34.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda6f7fe700 1 -- 172.21.15.82:0/831684139 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda80054720 con 0x21d3d80 2023-11-28T13:02:34.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda6f7fe700 1 -- 172.21.15.82:0/831684139 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fda8005cd60 con 0x21d3d80 2023-11-28T13:02:34.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 1 -- 172.21.15.82:0/831684139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x23a50e0 con 0x21d3d80 2023-11-28T13:02:34.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda6f7fe700 1 -- 172.21.15.82:0/831684139 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda80081260 con 0x21d3d80 2023-11-28T13:02:34.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 10 client.6051 fetch_fsmap learned FSMap version 22 2023-11-28T13:02:34.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 1 -- 172.21.15.82:0/831684139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x221fc80 con 0x21d3d80 2023-11-28T13:02:34.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda6f7fe700 1 -- 172.21.15.82:0/831684139 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x23a50e0 con 0x21d3d80 2023-11-28T13:02:34.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda6f7fe700 1 -- 172.21.15.82:0/831684139 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fda80050d50 con 0x21d3d80 2023-11-28T13:02:34.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 10 client.6051 fetch_fsmap finished waiting for FSMap version 22 2023-11-28T13:02:34.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 10 client.6051 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2023-11-28T13:02:34.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 20 client.6051 populate_metadata read hostname 'smithi082' 2023-11-28T13:02:34.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 1 --2- 172.21.15.82:0/831684139 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x24935b0 0x244e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 4 client.6051 mds_command: new command op to 5814 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T13:02:34.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.089+0000 7fda99de3740 1 -- 172.21.15.82:0/831684139 --> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x23a4e00 con 0x24935b0 2023-11-28T13:02:34.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.093+0000 7fda948ff700 1 --2- 172.21.15.82:0/831684139 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x24935b0 0x244e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.093+0000 7fda6f7fe700 10 client.6051 ms_handle_connect on v2:172.21.15.114:6833/4092152651 2023-11-28T13:02:34.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.093+0000 7fda948ff700 1 --2- 172.21.15.82:0/831684139 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x24935b0 0x244e530 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d846a91d2cfa695d server_cookie=a32f9eff8a2368ef in_seq=0 out_seq=0 2023-11-28T13:02:34.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.093+0000 7fda6f7fe700 1 -- 172.21.15.82:0/831684139 <== mds.0 v2:172.21.15.114:6833/4092152651 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x23a4e00 con 0x24935b0 2023-11-28T13:02:34.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.093+0000 7fda6f7fe700 10 client.6051 handle_command_reply: tid=0 2023-11-28T13:02:34.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.093+0000 7fda99de3740 1 client.6051 shutdown 2023-11-28T13:02:34.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.093+0000 7fda99de3740 1 -- 172.21.15.82:0/831684139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d3d80 msgr2=0x2490b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.093+0000 7fda99de3740 1 --2- 172.21.15.82:0/831684139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d3d80 0x2490b00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fda80051460 tx=0x7fda800549c0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.093+0000 7fda99de3740 1 -- 172.21.15.82:0/831684139 shutdown_connections 2023-11-28T13:02:34.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.093+0000 7fda99de3740 1 --2- 172.21.15.82:0/831684139 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x24935b0 0x244e530 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.093+0000 7fda99de3740 1 --2- 172.21.15.82:0/831684139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 0x24919c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.093+0000 7fda6f7fe700 0 client.6051 ms_handle_reset on v2:172.21.15.114:6833/4092152651 2023-11-28T13:02:34.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.093+0000 7fda99de3740 1 --2- 172.21.15.82:0/831684139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d3d80 0x2490b00 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.093+0000 7fda99de3740 1 --2- 172.21.15.82:0/831684139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x21d39b0 0x24905c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.093+0000 7fda99de3740 1 -- 172.21.15.82:0/831684139 >> 172.21.15.82:0/831684139 conn(0x21d4150 msgr2=0x2462930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:34.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.093+0000 7fda99de3740 1 -- 172.21.15.82:0/831684139 shutdown_connections 2023-11-28T13:02:34.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.093+0000 7fda99de3740 1 -- 172.21.15.82:0/831684139 wait complete. 2023-11-28T13:02:34.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.093+0000 7fda99de3740 20 client.6051 trim_cache size 0 max 16384 2023-11-28T13:02:34.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda99de3740 1 Processor -- start 2023-11-28T13:02:34.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda99de3740 1 -- start start 2023-11-28T13:02:34.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda99de3740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x21d39b0 0x246bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda99de3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d3d80 0x246c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda99de3740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 0x24613a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda99de3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x23b0060 con 0x21d3d80 2023-11-28T13:02:34.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda99de3740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x23a9870 con 0x221ea30 2023-11-28T13:02:34.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda99de3740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x23a5610 con 0x21d39b0 2023-11-28T13:02:34.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda87fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d3d80 0x246c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda87fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d3d80 0x246c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46822/0 (socket says 172.21.15.82:46822) 2023-11-28T13:02:34.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda87fff700 1 -- 172.21.15.82:0/3177232064 learned_addr learned my addr 172.21.15.82:0/3177232064 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:34.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda95100700 1 --2- 172.21.15.82:0/3177232064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 0x24613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda948ff700 1 --2- 172.21.15.82:0/3177232064 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x21d39b0 0x246bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda87fff700 1 -- 172.21.15.82:0/3177232064 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x21d39b0 msgr2=0x246bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:34.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda87fff700 1 --2- 172.21.15.82:0/3177232064 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x21d39b0 0x246bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda87fff700 1 -- 172.21.15.82:0/3177232064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 msgr2=0x24613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:34.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda87fff700 1 --2- 172.21.15.82:0/3177232064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 0x24613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda87fff700 1 -- 172.21.15.82:0/3177232064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda900cb120 con 0x21d3d80 2023-11-28T13:02:34.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda948ff700 1 --2- 172.21.15.82:0/3177232064 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x21d39b0 0x246bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:02:34.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda87fff700 1 --2- 172.21.15.82:0/3177232064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d3d80 0x246c050 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fda8000a010 tx=0x7fda80058000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c700e35afa9ca5ec server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:34.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda76ffd700 1 -- 172.21.15.82:0/3177232064 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda80081260 con 0x21d3d80 2023-11-28T13:02:34.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda76ffd700 1 -- 172.21.15.82:0/3177232064 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda80081410 con 0x21d3d80 2023-11-28T13:02:34.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda76ffd700 1 -- 172.21.15.82:0/3177232064 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda80054720 con 0x21d3d80 2023-11-28T13:02:34.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda99de3740 1 -- 172.21.15.82:0/3177232064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d3d80 msgr2=0x246c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda99de3740 1 --2- 172.21.15.82:0/3177232064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d3d80 0x246c050 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fda8000a010 tx=0x7fda80058000 comp rx=0 tx=0).stop 2023-11-28T13:02:34.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda99de3740 1 -- 172.21.15.82:0/3177232064 shutdown_connections 2023-11-28T13:02:34.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda99de3740 1 --2- 172.21.15.82:0/3177232064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 0x24613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda99de3740 1 --2- 172.21.15.82:0/3177232064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d3d80 0x246c050 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda99de3740 1 --2- 172.21.15.82:0/3177232064 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x21d39b0 0x246bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda99de3740 1 -- 172.21.15.82:0/3177232064 >> 172.21.15.82:0/3177232064 conn(0x21d4150 msgr2=0x2484270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:34.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda99de3740 1 -- 172.21.15.82:0/3177232064 shutdown_connections 2023-11-28T13:02:34.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda99de3740 1 -- 172.21.15.82:0/3177232064 wait complete. 2023-11-28T13:02:34.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda99de3740 1 -- start start 2023-11-28T13:02:34.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.113+0000 7fda99de3740 1 Processor -- start 2023-11-28T13:02:34.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda99de3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d39b0 0x24ea5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda99de3740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x21d3d80 0x24eab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda99de3740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 0x245f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda99de3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x24eb050 con 0x21d39b0 2023-11-28T13:02:34.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda99de3740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x2492860 con 0x221ea30 2023-11-28T13:02:34.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda99de3740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x2469220 con 0x21d3d80 2023-11-28T13:02:34.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda99de3740 10 client.0 _ll_register_callbacks cb 0x23d2910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:02:34.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda948ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d39b0 0x24ea5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda948ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d39b0 0x24ea5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46824/0 (socket says 172.21.15.82:46824) 2023-11-28T13:02:34.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda948ff700 1 -- 172.21.15.82:0/2304315672 learned_addr learned my addr 172.21.15.82:0/2304315672 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:34.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda95100700 1 --2- 172.21.15.82:0/2304315672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 0x245f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda87fff700 1 --2- 172.21.15.82:0/2304315672 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x21d3d80 0x24eab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda948ff700 1 -- 172.21.15.82:0/2304315672 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x21d3d80 msgr2=0x24eab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:34.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda948ff700 1 --2- 172.21.15.82:0/2304315672 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x21d3d80 0x24eab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda948ff700 1 -- 172.21.15.82:0/2304315672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 msgr2=0x245f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:34.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda948ff700 1 --2- 172.21.15.82:0/2304315672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 0x245f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda948ff700 1 -- 172.21.15.82:0/2304315672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x221fc80 con 0x21d39b0 2023-11-28T13:02:34.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda95100700 1 --2- 172.21.15.82:0/2304315672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 0x245f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:34.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda948ff700 1 --2- 172.21.15.82:0/2304315672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d39b0 0x24ea5d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fda8c017040 tx=0x7fda8c017070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f658deb6afbe09d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:34.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda6f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-11-28T13:02:34.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda6f7fe700 1 -- 172.21.15.82:0/2304315672 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c02b070 con 0x21d39b0 2023-11-28T13:02:34.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda6f7fe700 1 -- 172.21.15.82:0/2304315672 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fda8c0148a0 con 0x21d39b0 2023-11-28T13:02:34.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda99de3740 1 -- 172.21.15.82:0/2304315672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda8c019070 con 0x21d39b0 2023-11-28T13:02:34.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda6f7fe700 1 -- 172.21.15.82:0/2304315672 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda8c039460 con 0x21d39b0 2023-11-28T13:02:34.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda99de3740 10 client.6057 fetch_fsmap learned FSMap version 22 2023-11-28T13:02:34.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda99de3740 1 -- 172.21.15.82:0/2304315672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x2358bb0 con 0x21d39b0 2023-11-28T13:02:34.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda6f7fe700 1 -- 172.21.15.82:0/2304315672 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c019070 con 0x21d39b0 2023-11-28T13:02:34.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda6f7fe700 1 -- 172.21.15.82:0/2304315672 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fda8c005a40 con 0x21d39b0 2023-11-28T13:02:34.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda99de3740 10 client.6057 fetch_fsmap finished waiting for FSMap version 22 2023-11-28T13:02:34.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda99de3740 10 client.6057 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2023-11-28T13:02:34.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda99de3740 20 client.6057 populate_metadata read hostname 'smithi082' 2023-11-28T13:02:34.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda99de3740 1 --2- 172.21.15.82:0/2304315672 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x245fa20 0x245fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda99de3740 4 client.6057 mds_command: new command op to 5814 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2023-11-28T13:02:34.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda99de3740 1 -- 172.21.15.82:0/2304315672 --> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x2250500 con 0x245fa20 2023-11-28T13:02:34.125 INFO:tasks.ceph.mds.d.smithi114.stderr:2023-11-28T13:02:34.119+0000 7f08895ff700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6009=0-4194304@1} caps={6009=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6009 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55c59c273700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-28T13:02:34.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.117+0000 7fda87fff700 1 --2- 172.21.15.82:0/2304315672 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x245fa20 0x245fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda6f7fe700 10 client.6057 ms_handle_connect on v2:172.21.15.114:6833/4092152651 2023-11-28T13:02:34.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda87fff700 1 --2- 172.21.15.82:0/2304315672 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x245fa20 0x245fe20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6062db2d72bd0d1e server_cookie=890285a86522344a in_seq=0 out_seq=0 2023-11-28T13:02:34.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda6f7fe700 1 -- 172.21.15.82:0/2304315672 <== mds.0 v2:172.21.15.114:6833/4092152651 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x2250500 con 0x245fa20 2023-11-28T13:02:34.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda6f7fe700 10 client.6057 handle_command_reply: tid=0 2023-11-28T13:02:34.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda99de3740 1 client.6057 shutdown 2023-11-28T13:02:34.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda99de3740 1 -- 172.21.15.82:0/2304315672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d39b0 msgr2=0x24ea5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda99de3740 1 --2- 172.21.15.82:0/2304315672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d39b0 0x24ea5d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fda8c017040 tx=0x7fda8c017070 comp rx=0 tx=0).stop 2023-11-28T13:02:34.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda99de3740 1 -- 172.21.15.82:0/2304315672 shutdown_connections 2023-11-28T13:02:34.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda99de3740 1 --2- 172.21.15.82:0/2304315672 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x245fa20 0x245fe20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda99de3740 1 --2- 172.21.15.82:0/2304315672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x221ea30 0x245f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda99de3740 1 --2- 172.21.15.82:0/2304315672 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x21d3d80 0x24eab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda99de3740 1 --2- 172.21.15.82:0/2304315672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x21d39b0 0x24ea5d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda6f7fe700 0 client.6057 ms_handle_reset on v2:172.21.15.114:6833/4092152651 2023-11-28T13:02:34.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda99de3740 1 -- 172.21.15.82:0/2304315672 >> 172.21.15.82:0/2304315672 conn(0x21d4150 msgr2=0x24839e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:34.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda99de3740 1 -- 172.21.15.82:0/2304315672 shutdown_connections 2023-11-28T13:02:34.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda99de3740 1 -- 172.21.15.82:0/2304315672 wait complete. 2023-11-28T13:02:34.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda99de3740 20 client.6057 trim_cache size 0 max 16384 2023-11-28T13:02:34.128 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:02:34.128 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2023-11-28T13:02:34.128 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "e2aa363d-1176-485b-b979-29347a235f43", 2023-11-28T13:02:34.128 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2023-11-28T13:02:34.128 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:02:34.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda96b63700 1 -- 172.21.15.82:0/834745322 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fda7c064f30 msgr2=0x7fda7c0673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda96b63700 1 --2- 172.21.15.82:0/834745322 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fda7c064f30 0x7fda7c0673e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fda900ca870 tx=0x7fda8c009240 comp rx=0 tx=0).stop 2023-11-28T13:02:34.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda96b63700 1 -- 172.21.15.82:0/834745322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda900add20 msgr2=0x7fda9006ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda96b63700 1 --2- 172.21.15.82:0/834745322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda900add20 0x7fda9006ad40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fda80016000 tx=0x7fda800047e0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda96b63700 1 -- 172.21.15.82:0/834745322 shutdown_connections 2023-11-28T13:02:34.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda96b63700 1 --2- 172.21.15.82:0/834745322 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fda7c064f30 0x7fda7c0673e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda96b63700 1 --2- 172.21.15.82:0/834745322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda9006b280 0x7fda900b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda96b63700 1 --2- 172.21.15.82:0/834745322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda900add20 0x7fda9006ad40 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda96b63700 1 --2- 172.21.15.82:0/834745322 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda9014a8d0 0x7fda900ad7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda96b63700 1 -- 172.21.15.82:0/834745322 >> 172.21.15.82:0/834745322 conn(0x7fda900b18c0 msgr2=0x7fda900aff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:34.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda96b63700 1 -- 172.21.15.82:0/834745322 shutdown_connections 2023-11-28T13:02:34.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.121+0000 7fda96b63700 1 -- 172.21.15.82:0/834745322 wait complete. 2023-11-28T13:02:34.141 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-11-28T13:02:34.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.261+0000 7f26e359e700 1 Processor -- start 2023-11-28T13:02:34.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.261+0000 7f26e359e700 1 -- start start 2023-11-28T13:02:34.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26e415c220 0x7f26e415c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e359e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e406ad40 con 0x7f26e4070730 2023-11-28T13:02:34.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e359e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e406a450 con 0x7f26e4158800 2023-11-28T13:02:34.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e359e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e415cfa0 con 0x7f26e415c220 2023-11-28T13:02:34.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e2d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26e415c220 0x7f26e415c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e259c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f26e4070730 0x7f26e4070b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43532/0 (socket says 172.21.15.82:43532) 2023-11-28T13:02:34.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e259c700 1 -- 172.21.15.82:0/2386395323 learned_addr learned my addr 172.21.15.82:0/2386395323 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:02:34.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e2d9d700 1 -- 172.21.15.82:0/2386395323 >> v1:172.21.15.114:6789/0 conn(0x7f26e4158800 legacy=0x7f26e40c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e2d9d700 1 -- 172.21.15.82:0/2386395323 >> v1:172.21.15.82:6789/0 conn(0x7f26e4070730 legacy=0x7f26e4070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e159a700 1 -- 172.21.15.82:0/2386395323 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427485596 0 0) 0x7f26e406ad40 con 0x7f26e4070730 2023-11-28T13:02:34.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e2d9d700 1 -- 172.21.15.82:0/2386395323 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e406a6f0 con 0x7f26e415c220 2023-11-28T13:02:34.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e2d9d700 1 --2- 172.21.15.82:0/2386395323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e415c220 0x7f26e415c6c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f26dc009d90 tx=0x7f26dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c0b2ed0d4568c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:34.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e159a700 1 -- 172.21.15.82:0/2386395323 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc00e070 con 0x7f26e415c220 2023-11-28T13:02:34.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e159a700 1 -- 172.21.15.82:0/2386395323 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26dc00bbd0 con 0x7f26e415c220 2023-11-28T13:02:34.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e159a700 1 -- 172.21.15.82:0/2386395323 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc012430 con 0x7f26e415c220 2023-11-28T13:02:34.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e359e700 1 -- 172.21.15.82:0/2386395323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e415c220 msgr2=0x7f26e415c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e359e700 1 --2- 172.21.15.82:0/2386395323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e415c220 0x7f26e415c6c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f26dc009d90 tx=0x7f26dc00b330 comp rx=0 tx=0).stop 2023-11-28T13:02:34.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e359e700 1 -- 172.21.15.82:0/2386395323 shutdown_connections 2023-11-28T13:02:34.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e359e700 1 --2- 172.21.15.82:0/2386395323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e415c220 0x7f26e415c6c0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e359e700 1 -- 172.21.15.82:0/2386395323 >> 172.21.15.82:0/2386395323 conn(0x7f26e40cb890 msgr2=0x7f26e40cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:34.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e359e700 1 -- 172.21.15.82:0/2386395323 shutdown_connections 2023-11-28T13:02:34.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e359e700 1 -- 172.21.15.82:0/2386395323 wait complete. 2023-11-28T13:02:34.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e359e700 1 Processor -- start 2023-11-28T13:02:34.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.265+0000 7f26e359e700 1 -- start start 2023-11-28T13:02:34.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26e359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26e4070730 0x7f26e41410d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26e359e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26e4158800 0x7f26e414fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26e359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e415c220 0x7f26e40c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26e359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e4154a50 con 0x7f26e415c220 2023-11-28T13:02:34.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26e359e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e4156190 con 0x7f26e4070730 2023-11-28T13:02:34.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26e359e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e4150680 con 0x7f26e4158800 2023-11-28T13:02:34.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26e2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e415c220 0x7f26e40c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26e2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e415c220 0x7f26e40c7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46834/0 (socket says 172.21.15.82:46834) 2023-11-28T13:02:34.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26e2d9d700 1 -- 172.21.15.82:0/3025642848 learned_addr learned my addr 172.21.15.82:0/3025642848 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:34.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26e1d9b700 1 --2- 172.21.15.82:0/3025642848 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26e4158800 0x7f26e414fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26e259c700 1 --2- 172.21.15.82:0/3025642848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26e4070730 0x7f26e41410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26e2d9d700 1 -- 172.21.15.82:0/3025642848 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26e4158800 msgr2=0x7f26e414fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26e2d9d700 1 --2- 172.21.15.82:0/3025642848 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26e4158800 0x7f26e414fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26e2d9d700 1 -- 172.21.15.82:0/3025642848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26e4070730 msgr2=0x7f26e41410d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26e2d9d700 1 --2- 172.21.15.82:0/3025642848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26e4070730 0x7f26e41410d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26e2d9d700 1 -- 172.21.15.82:0/3025642848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc009a70 con 0x7f26e415c220 2023-11-28T13:02:34.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26e2d9d700 1 --2- 172.21.15.82:0/3025642848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e415c220 0x7f26e40c7890 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f26dc014040 tx=0x7f26dc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:34.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26d2ffd700 1 -- 172.21.15.82:0/3025642848 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc01b810 con 0x7f26e415c220 2023-11-28T13:02:34.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26d2ffd700 1 -- 172.21.15.82:0/3025642848 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26dc020070 con 0x7f26e415c220 2023-11-28T13:02:34.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26e359e700 1 -- 172.21.15.82:0/3025642848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e415cc00 con 0x7f26e415c220 2023-11-28T13:02:34.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26d2ffd700 1 -- 172.21.15.82:0/3025642848 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc01bbb0 con 0x7f26e415c220 2023-11-28T13:02:34.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.269+0000 7f26e359e700 1 -- 172.21.15.82:0/3025642848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e406a9d0 con 0x7f26e415c220 2023-11-28T13:02:34.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.273+0000 7f26d2ffd700 1 -- 172.21.15.82:0/3025642848 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f26dc01bd10 con 0x7f26e415c220 2023-11-28T13:02:34.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.273+0000 7f26d2ffd700 1 --2- 172.21.15.82:0/3025642848 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f26c4064f10 0x7f26c40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.273+0000 7f26d2ffd700 1 -- 172.21.15.82:0/3025642848 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f26dc022070 con 0x7f26e415c220 2023-11-28T13:02:34.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.273+0000 7f26e259c700 1 --2- 172.21.15.82:0/3025642848 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f26c4064f10 0x7f26c40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.273+0000 7f26e259c700 1 --2- 172.21.15.82:0/3025642848 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f26c4064f10 0x7f26c40673c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f26d4007b30 tx=0x7f26d4007a80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:34.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26ebdf6740 1 Processor -- start 2023-11-28T13:02:34.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26ebdf6740 1 -- start start 2023-11-28T13:02:34.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26ebdf6740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x189dc10 0x1b1d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26ebdf6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x189d840 0x1b1dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26ebdf6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x18e88c0 0x1b1e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26ebdf6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a0cd20 con 0x18e88c0 2023-11-28T13:02:34.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26ebdf6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a7cd60 con 0x189d840 2023-11-28T13:02:34.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26ebdf6740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a76060 con 0x189dc10 2023-11-28T13:02:34.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26e2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x18e88c0 0x1b1e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26e2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x18e88c0 0x1b1e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46850/0 (socket says 172.21.15.82:46850) 2023-11-28T13:02:34.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26e2d9d700 1 -- 172.21.15.82:0/588343557 learned_addr learned my addr 172.21.15.82:0/588343557 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:34.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26e259c700 1 --2- 172.21.15.82:0/588343557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x189dc10 0x1b1d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26e1d9b700 1 --2- 172.21.15.82:0/588343557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x189d840 0x1b1dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26e2d9d700 1 -- 172.21.15.82:0/588343557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x189dc10 msgr2=0x1b1d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:34.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26e2d9d700 1 --2- 172.21.15.82:0/588343557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x189dc10 0x1b1d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26e2d9d700 1 -- 172.21.15.82:0/588343557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x189d840 msgr2=0x1b1dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:34.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26e2d9d700 1 --2- 172.21.15.82:0/588343557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x189d840 0x1b1dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26e2d9d700 1 -- 172.21.15.82:0/588343557 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1a9c0a0 con 0x18e88c0 2023-11-28T13:02:34.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26e2d9d700 1 --2- 172.21.15.82:0/588343557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x18e88c0 0x1b1e250 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f26dc05e500 tx=0x7f26dc05e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c041141ce033879 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:34.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26c3fff700 1 -- 172.21.15.82:0/588343557 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc05e140 con 0x18e88c0 2023-11-28T13:02:34.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26c3fff700 1 -- 172.21.15.82:0/588343557 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26dc0840b0 con 0x18e88c0 2023-11-28T13:02:34.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26c3fff700 1 -- 172.21.15.82:0/588343557 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc084420 con 0x18e88c0 2023-11-28T13:02:34.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26ebdf6740 1 -- 172.21.15.82:0/588343557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x18e88c0 msgr2=0x1b1e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26ebdf6740 1 --2- 172.21.15.82:0/588343557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x18e88c0 0x1b1e250 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f26dc05e500 tx=0x7f26dc05e530 comp rx=0 tx=0).stop 2023-11-28T13:02:34.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26ebdf6740 1 -- 172.21.15.82:0/588343557 shutdown_connections 2023-11-28T13:02:34.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26ebdf6740 1 --2- 172.21.15.82:0/588343557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x18e88c0 0x1b1e250 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26ebdf6740 1 --2- 172.21.15.82:0/588343557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x189d840 0x1b1dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26ebdf6740 1 --2- 172.21.15.82:0/588343557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x189dc10 0x1b1d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26ebdf6740 1 -- 172.21.15.82:0/588343557 >> 172.21.15.82:0/588343557 conn(0x189dfe0 msgr2=0x1b36b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:34.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26ebdf6740 1 -- 172.21.15.82:0/588343557 shutdown_connections 2023-11-28T13:02:34.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.277+0000 7f26ebdf6740 1 -- 172.21.15.82:0/588343557 wait complete. 2023-11-28T13:02:34.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26ebdf6740 1 -- start start 2023-11-28T13:02:34.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26ebdf6740 1 Processor -- start 2023-11-28T13:02:34.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26ebdf6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x189d840 0x1b5d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26ebdf6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x189dc10 0x1b11510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26ebdf6740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x18e88c0 0x1b11a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26ebdf6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1922c50 con 0x189dc10 2023-11-28T13:02:34.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26ebdf6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b0e230 con 0x189d840 2023-11-28T13:02:34.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26ebdf6740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b0e4d0 con 0x18e88c0 2023-11-28T13:02:34.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26ebdf6740 10 client.0 _ll_register_callbacks cb 0x1a6f9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:02:34.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26e1d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x189dc10 0x1b11510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26e1d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x189dc10 0x1b11510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46858/0 (socket says 172.21.15.82:46858) 2023-11-28T13:02:34.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26e1d9b700 1 -- 172.21.15.82:0/2465115809 learned_addr learned my addr 172.21.15.82:0/2465115809 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:34.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26e259c700 1 --2- 172.21.15.82:0/2465115809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x189d840 0x1b5d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26e2d9d700 1 --2- 172.21.15.82:0/2465115809 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x18e88c0 0x1b11a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26e1d9b700 1 -- 172.21.15.82:0/2465115809 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x18e88c0 msgr2=0x1b11a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:34.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26e1d9b700 1 --2- 172.21.15.82:0/2465115809 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x18e88c0 0x1b11a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26e1d9b700 1 -- 172.21.15.82:0/2465115809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x189d840 msgr2=0x1b5d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:34.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26e1d9b700 1 --2- 172.21.15.82:0/2465115809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x189d840 0x1b5d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26e1d9b700 1 -- 172.21.15.82:0/2465115809 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e406a9d0 con 0x189dc10 2023-11-28T13:02:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26e1d9b700 1 --2- 172.21.15.82:0/2465115809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x189dc10 0x1b11510 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f26d8000f60 tx=0x7f26d8005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9887629d61ea46 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-11-28T13:02:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26c17fa700 1 -- 172.21.15.82:0/2465115809 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d801a070 con 0x189dc10 2023-11-28T13:02:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26c17fa700 1 -- 172.21.15.82:0/2465115809 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f26d8001b20 con 0x189dc10 2023-11-28T13:02:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26ebdf6740 1 -- 172.21.15.82:0/2465115809 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1a6f0e0 con 0x189dc10 2023-11-28T13:02:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26c17fa700 1 -- 172.21.15.82:0/2465115809 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26d8001ce0 con 0x189dc10 2023-11-28T13:02:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26ebdf6740 10 client.6072 fetch_fsmap learned FSMap version 22 2023-11-28T13:02:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26ebdf6740 1 -- 172.21.15.82:0/2465115809 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x18e9b10 con 0x189dc10 2023-11-28T13:02:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26c17fa700 1 -- 172.21.15.82:0/2465115809 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d8024020 con 0x189dc10 2023-11-28T13:02:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26c17fa700 1 -- 172.21.15.82:0/2465115809 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f26d801d020 con 0x189dc10 2023-11-28T13:02:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26ebdf6740 10 client.6072 fetch_fsmap finished waiting for FSMap version 22 2023-11-28T13:02:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26ebdf6740 10 client.6072 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2023-11-28T13:02:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26ebdf6740 20 client.6072 populate_metadata read hostname 'smithi082' 2023-11-28T13:02:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26ebdf6740 1 --2- 172.21.15.82:0/2465115809 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x1b0dd20 0x1b0c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26ebdf6740 4 client.6072 mds_command: new command op to 5814 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T13:02:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26ebdf6740 1 -- 172.21.15.82:0/2465115809 --> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1a6ee00 con 0x1b0dd20 2023-11-28T13:02:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.281+0000 7f26e259c700 1 --2- 172.21.15.82:0/2465115809 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x1b0dd20 0x1b0c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.285+0000 7f26e259c700 1 --2- 172.21.15.82:0/2465115809 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x1b0dd20 0x1b0c950 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6eb5a66d74adddf5 server_cookie=8a6d5da7fa8c6419 in_seq=0 out_seq=0 2023-11-28T13:02:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.285+0000 7f26c17fa700 10 client.6072 ms_handle_connect on v2:172.21.15.114:6833/4092152651 2023-11-28T13:02:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.285+0000 7f26c17fa700 1 -- 172.21.15.82:0/2465115809 <== mds.0 v2:172.21.15.114:6833/4092152651 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1a6ee00 con 0x1b0dd20 2023-11-28T13:02:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.285+0000 7f26c17fa700 10 client.6072 handle_command_reply: tid=0 2023-11-28T13:02:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.285+0000 7f26ebdf6740 1 client.6072 shutdown 2023-11-28T13:02:34.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.285+0000 7f26ebdf6740 1 -- 172.21.15.82:0/2465115809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x189dc10 msgr2=0x1b11510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.285+0000 7f26ebdf6740 1 --2- 172.21.15.82:0/2465115809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x189dc10 0x1b11510 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f26d8000f60 tx=0x7f26d8005620 comp rx=0 tx=0).stop 2023-11-28T13:02:34.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.285+0000 7f26ebdf6740 1 -- 172.21.15.82:0/2465115809 shutdown_connections 2023-11-28T13:02:34.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.285+0000 7f26ebdf6740 1 --2- 172.21.15.82:0/2465115809 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x1b0dd20 0x1b0c950 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.285+0000 7f26ebdf6740 1 --2- 172.21.15.82:0/2465115809 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x18e88c0 0x1b11a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.285+0000 7f26ebdf6740 1 --2- 172.21.15.82:0/2465115809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x189dc10 0x1b11510 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.285+0000 7f26c17fa700 0 client.6072 ms_handle_reset on v2:172.21.15.114:6833/4092152651 2023-11-28T13:02:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.285+0000 7f26ebdf6740 1 --2- 172.21.15.82:0/2465115809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x189d840 0x1b5d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.285+0000 7f26ebdf6740 1 -- 172.21.15.82:0/2465115809 >> 172.21.15.82:0/2465115809 conn(0x189dfe0 msgr2=0x1b361a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.285+0000 7f26ebdf6740 1 -- 172.21.15.82:0/2465115809 shutdown_connections 2023-11-28T13:02:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.285+0000 7f26ebdf6740 1 -- 172.21.15.82:0/2465115809 wait complete. 2023-11-28T13:02:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.285+0000 7f26ebdf6740 20 client.6072 trim_cache size 0 max 16384 2023-11-28T13:02:34.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26ebdf6740 1 Processor -- start 2023-11-28T13:02:34.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26ebdf6740 1 -- start start 2023-11-28T13:02:34.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26ebdf6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x189d840 0x1b0fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26ebdf6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x189dc10 0x1b5c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26ebdf6740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x18e88c0 0x1b5c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26ebdf6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a0c200 con 0x189dc10 2023-11-28T13:02:34.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26ebdf6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a45ba0 con 0x189d840 2023-11-28T13:02:34.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26ebdf6740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a4bf70 con 0x18e88c0 2023-11-28T13:02:34.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26e1d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x189dc10 0x1b5c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26e1d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x189dc10 0x1b5c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46862/0 (socket says 172.21.15.82:46862) 2023-11-28T13:02:34.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26e1d9b700 1 -- 172.21.15.82:0/3331738789 learned_addr learned my addr 172.21.15.82:0/3331738789 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:34.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26e259c700 1 --2- 172.21.15.82:0/3331738789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x189d840 0x1b0fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26e2d9d700 1 --2- 172.21.15.82:0/3331738789 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x18e88c0 0x1b5c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26e1d9b700 1 -- 172.21.15.82:0/3331738789 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x18e88c0 msgr2=0x1b5c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26e1d9b700 1 --2- 172.21.15.82:0/3331738789 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x18e88c0 0x1b5c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26e1d9b700 1 -- 172.21.15.82:0/3331738789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x189d840 msgr2=0x1b0fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26e1d9b700 1 --2- 172.21.15.82:0/3331738789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x189d840 0x1b0fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26e1d9b700 1 -- 172.21.15.82:0/3331738789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e40c8130 con 0x189dc10 2023-11-28T13:02:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26e1d9b700 1 --2- 172.21.15.82:0/3331738789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x189dc10 0x1b5c2f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f26d80050d0 tx=0x7f26d800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce377bd8006cb874 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26d0ff9700 1 -- 172.21.15.82:0/3331738789 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d801a040 con 0x189dc10 2023-11-28T13:02:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26d0ff9700 1 -- 172.21.15.82:0/3331738789 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d8024070 con 0x189dc10 2023-11-28T13:02:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.305+0000 7f26d0ff9700 1 -- 172.21.15.82:0/3331738789 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d8001d60 con 0x189dc10 2023-11-28T13:02:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26ebdf6740 1 -- 172.21.15.82:0/3331738789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x189dc10 msgr2=0x1b5c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26ebdf6740 1 --2- 172.21.15.82:0/3331738789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x189dc10 0x1b5c2f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f26d80050d0 tx=0x7f26d800f000 comp rx=0 tx=0).stop 2023-11-28T13:02:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26ebdf6740 1 -- 172.21.15.82:0/3331738789 shutdown_connections 2023-11-28T13:02:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26ebdf6740 1 --2- 172.21.15.82:0/3331738789 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x18e88c0 0x1b5c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26ebdf6740 1 --2- 172.21.15.82:0/3331738789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x189dc10 0x1b5c2f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26ebdf6740 1 --2- 172.21.15.82:0/3331738789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x189d840 0x1b0fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26ebdf6740 1 -- 172.21.15.82:0/3331738789 >> 172.21.15.82:0/3331738789 conn(0x189dfe0 msgr2=0x1b1cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:34.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26ebdf6740 1 -- 172.21.15.82:0/3331738789 shutdown_connections 2023-11-28T13:02:34.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26ebdf6740 1 -- 172.21.15.82:0/3331738789 wait complete. 2023-11-28T13:02:34.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26ebdf6740 1 -- start start 2023-11-28T13:02:34.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26ebdf6740 1 Processor -- start 2023-11-28T13:02:34.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26ebdf6740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x189d840 0x1b6a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26ebdf6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x189dc10 0x1b68800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26ebdf6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e88c0 0x1b6b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26ebdf6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b0eb70 con 0x189dc10 2023-11-28T13:02:34.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26ebdf6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b6a900 con 0x18e88c0 2023-11-28T13:02:34.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26ebdf6740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b0ee00 con 0x189d840 2023-11-28T13:02:34.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26ebdf6740 10 client.0 _ll_register_callbacks cb 0x7f26dc056020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:02:34.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26e1d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x189dc10 0x1b68800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26e1d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x189dc10 0x1b68800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46874/0 (socket says 172.21.15.82:46874) 2023-11-28T13:02:34.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26e1d9b700 1 -- 172.21.15.82:0/3336245380 learned_addr learned my addr 172.21.15.82:0/3336245380 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:02:34.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26e259c700 1 --2- 172.21.15.82:0/3336245380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x189d840 0x1b6a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26e2d9d700 1 --2- 172.21.15.82:0/3336245380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e88c0 0x1b6b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26e1d9b700 1 -- 172.21.15.82:0/3336245380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x189d840 msgr2=0x1b6a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:34.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26e1d9b700 1 --2- 172.21.15.82:0/3336245380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x189d840 0x1b6a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26e1d9b700 1 -- 172.21.15.82:0/3336245380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e88c0 msgr2=0x1b6b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:02:34.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26e1d9b700 1 --2- 172.21.15.82:0/3336245380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e88c0 0x1b6b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26e1d9b700 1 -- 172.21.15.82:0/3336245380 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x18e9b10 con 0x189dc10 2023-11-28T13:02:34.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26e259c700 1 --2- 172.21.15.82:0/3336245380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x189d840 0x1b6a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:02:34.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26e1d9b700 1 --2- 172.21.15.82:0/3336245380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x189dc10 0x1b68800 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f26d8001050 tx=0x7f26d8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e516f0d4f5e259b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:02:34.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-11-28T13:02:34.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26c17fa700 1 -- 172.21.15.82:0/3336245380 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d802e070 con 0x189dc10 2023-11-28T13:02:34.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26c17fa700 1 -- 172.21.15.82:0/3336245380 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f26d8025080 con 0x189dc10 2023-11-28T13:02:34.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.309+0000 7f26ebdf6740 1 -- 172.21.15.82:0/3336245380 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f26dc0840b0 con 0x189dc10 2023-11-28T13:02:34.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26c17fa700 1 -- 172.21.15.82:0/3336245380 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26d801a040 con 0x189dc10 2023-11-28T13:02:34.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26ebdf6740 10 client.6078 fetch_fsmap learned FSMap version 22 2023-11-28T13:02:34.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26ebdf6740 1 -- 172.21.15.82:0/3336245380 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x1a22af0 con 0x189dc10 2023-11-28T13:02:34.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26c17fa700 1 -- 172.21.15.82:0/3336245380 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26dc0840b0 con 0x189dc10 2023-11-28T13:02:34.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26c17fa700 1 -- 172.21.15.82:0/3336245380 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f26d8003cc0 con 0x189dc10 2023-11-28T13:02:34.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26ebdf6740 10 client.6078 fetch_fsmap finished waiting for FSMap version 22 2023-11-28T13:02:34.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26ebdf6740 10 client.6078 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2023-11-28T13:02:34.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26ebdf6740 20 client.6078 populate_metadata read hostname 'smithi082' 2023-11-28T13:02:34.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26ebdf6740 1 --2- 172.21.15.82:0/3336245380 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x1b0dd20 0x1b6b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:02:34.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26ebdf6740 4 client.6078 mds_command: new command op to 5814 tid=0[{"prefix": "scrub status"}] 2023-11-28T13:02:34.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26ebdf6740 1 -- 172.21.15.82:0/3336245380 --> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x191a390 con 0x1b0dd20 2023-11-28T13:02:34.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26e259c700 1 --2- 172.21.15.82:0/3336245380 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x1b0dd20 0x1b6b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:02:34.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26e259c700 1 --2- 172.21.15.82:0/3336245380 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x1b0dd20 0x1b6b670 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec83119f6feb7b58 server_cookie=ffd4c9e2d6d55d2c in_seq=0 out_seq=0 2023-11-28T13:02:34.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26c17fa700 10 client.6078 ms_handle_connect on v2:172.21.15.114:6833/4092152651 2023-11-28T13:02:34.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26c17fa700 1 -- 172.21.15.82:0/3336245380 <== mds.0 v2:172.21.15.114:6833/4092152651 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x191a390 con 0x1b0dd20 2023-11-28T13:02:34.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26c17fa700 10 client.6078 handle_command_reply: tid=0 2023-11-28T13:02:34.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26ebdf6740 1 client.6078 shutdown 2023-11-28T13:02:34.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26ebdf6740 1 -- 172.21.15.82:0/3336245380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x189dc10 msgr2=0x1b68800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26ebdf6740 1 --2- 172.21.15.82:0/3336245380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x189dc10 0x1b68800 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f26d8001050 tx=0x7f26d8001120 comp rx=0 tx=0).stop 2023-11-28T13:02:34.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26ebdf6740 1 -- 172.21.15.82:0/3336245380 shutdown_connections 2023-11-28T13:02:34.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26ebdf6740 1 --2- 172.21.15.82:0/3336245380 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x1b0dd20 0x1b6b670 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26ebdf6740 1 --2- 172.21.15.82:0/3336245380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e88c0 0x1b6b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26ebdf6740 1 --2- 172.21.15.82:0/3336245380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x189dc10 0x1b68800 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26c17fa700 0 client.6078 ms_handle_reset on v2:172.21.15.114:6833/4092152651 2023-11-28T13:02:34.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26ebdf6740 1 --2- 172.21.15.82:0/3336245380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x189d840 0x1b6a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26ebdf6740 1 -- 172.21.15.82:0/3336245380 >> 172.21.15.82:0/3336245380 conn(0x189dfe0 msgr2=0x1b361a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:34.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26ebdf6740 1 -- 172.21.15.82:0/3336245380 shutdown_connections 2023-11-28T13:02:34.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26ebdf6740 1 -- 172.21.15.82:0/3336245380 wait complete. 2023-11-28T13:02:34.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26ebdf6740 20 client.6078 trim_cache size 0 max 16384 2023-11-28T13:02:34.326 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:02:34.326 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-28T13:02:34.326 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-11-28T13:02:34.326 INFO:teuthology.orchestra.run.smithi082.stdout: "e2aa363d-1176-485b-b979-29347a235f43": { 2023-11-28T13:02:34.326 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-11-28T13:02:34.326 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "e2aa363d-1176-485b-b979-29347a235f43", 2023-11-28T13:02:34.327 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,repair" 2023-11-28T13:02:34.327 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:34.327 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:02:34.327 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:02:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26e359e700 1 -- 172.21.15.82:0/3025642848 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f26c4064f10 msgr2=0x7f26c40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26e359e700 1 --2- 172.21.15.82:0/3025642848 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f26c4064f10 0x7f26c40673c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f26d4007b30 tx=0x7f26d4007a80 comp rx=0 tx=0).stop 2023-11-28T13:02:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26e359e700 1 -- 172.21.15.82:0/3025642848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e415c220 msgr2=0x7f26e40c7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:02:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26e359e700 1 --2- 172.21.15.82:0/3025642848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e415c220 0x7f26e40c7890 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f26dc014040 tx=0x7f26dc004af0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26e359e700 1 -- 172.21.15.82:0/3025642848 shutdown_connections 2023-11-28T13:02:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26e359e700 1 --2- 172.21.15.82:0/3025642848 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f26c4064f10 0x7f26c40673c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26e359e700 1 --2- 172.21.15.82:0/3025642848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e415c220 0x7f26e40c7890 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26e359e700 1 --2- 172.21.15.82:0/3025642848 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26e4158800 0x7f26e414fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26e359e700 1 --2- 172.21.15.82:0/3025642848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26e4070730 0x7f26e41410d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:02:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.313+0000 7f26e359e700 1 -- 172.21.15.82:0/3025642848 >> 172.21.15.82:0/3025642848 conn(0x7f26e40cb890 msgr2=0x7f26e4157600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:02:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.317+0000 7f26e359e700 1 -- 172.21.15.82:0/3025642848 shutdown_connections 2023-11-28T13:02:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:34.317+0000 7f26e359e700 1 -- 172.21.15.82:0/3025642848 wait complete. 2023-11-28T13:02:34.336 INFO:tasks.cephfs.filesystem:scrub status for tag:e2aa363d-1176-485b-b979-29347a235f43 - {'path': '/', 'tag': 'e2aa363d-1176-485b-b979-29347a235f43', 'options': 'recursive,repair'} 2023-11-28T13:02:35.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:35.909+0000 7f8bfeffd700 1 -- 172.21.15.82:0/1508942624 <== mon.0 v2:172.21.15.82:3300/0 7 ==== log(6 entries from seq 1 at 2023-11-28T13:02:34.122520+0000) v1 ==== 1078+0+0 (secure 0 0 0) 0x7f8c0405af60 con 0x7f8c100af8f0 2023-11-28T13:02:35.915 INFO:teuthology.orchestra.run.smithi082.stdout: cluster: 2023-11-28T13:02:35.915 INFO:teuthology.orchestra.run.smithi082.stdout: id: aef8a97f-1d6c-4a2b-9410-16861b3e9e35 2023-11-28T13:02:35.915 INFO:teuthology.orchestra.run.smithi082.stdout: health: HEALTH_OK 2023-11-28T13:02:35.915 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:35.915 INFO:teuthology.orchestra.run.smithi082.stdout: services: 2023-11-28T13:02:35.915 INFO:teuthology.orchestra.run.smithi082.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2023-11-28T13:02:35.915 INFO:teuthology.orchestra.run.smithi082.stdout: mgr: y(active, since 2m), standbys: x 2023-11-28T13:02:35.916 INFO:teuthology.orchestra.run.smithi082.stdout: mds: 1/1 daemons up, 3 standby 2023-11-28T13:02:35.916 INFO:teuthology.orchestra.run.smithi082.stdout: osd: 8 osds: 8 up (since 2m), 8 in (since 2m) 2023-11-28T13:02:35.916 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:35.916 INFO:teuthology.orchestra.run.smithi082.stdout: data: 2023-11-28T13:02:35.916 INFO:teuthology.orchestra.run.smithi082.stdout: volumes: 1/1 healthy 2023-11-28T13:02:35.916 INFO:teuthology.orchestra.run.smithi082.stdout: pools: 4 pools, 105 pgs 2023-11-28T13:02:35.916 INFO:teuthology.orchestra.run.smithi082.stdout: objects: 24 objects, 579 KiB 2023-11-28T13:02:35.916 INFO:teuthology.orchestra.run.smithi082.stdout: usage: 73 MiB used, 720 GiB / 720 GiB avail 2023-11-28T13:02:35.916 INFO:teuthology.orchestra.run.smithi082.stdout: pgs: 105 active+clean 2023-11-28T13:02:35.916 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:35.916 INFO:teuthology.orchestra.run.smithi082.stdout: io: 2023-11-28T13:02:35.916 INFO:teuthology.orchestra.run.smithi082.stdout: client: 1.2 KiB/s wr, 0 op/s rd, 3 op/s wr 2023-11-28T13:02:35.917 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:35.917 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:02:35.917 INFO:teuthology.orchestra.run.smithi082.stdout:2023-11-28T13:02:34.122520+0000 mds.d [INF] scrub queued for path: / 2023-11-28T13:02:35.917 INFO:teuthology.orchestra.run.smithi082.stdout:2023-11-28T13:02:34.122529+0000 mds.d [INF] scrub summary: idle+waiting paths [/] 2023-11-28T13:02:35.917 INFO:teuthology.orchestra.run.smithi082.stdout:2023-11-28T13:02:34.122539+0000 mds.d [INF] scrub summary: active paths [/] 2023-11-28T13:02:35.917 INFO:teuthology.orchestra.run.smithi082.stdout:2023-11-28T13:02:34.124147+0000 mds.d [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2023-11-28T13:02:35.917 INFO:teuthology.orchestra.run.smithi082.stdout:2023-11-28T13:02:34.124166+0000 mds.d [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2023-11-28T13:02:35.917 INFO:teuthology.orchestra.run.smithi082.stdout:2023-11-28T13:02:34.124989+0000 mds.d [INF] scrub summary: idle+waiting paths [/] 2023-11-28T13:02:37.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:02:37.921+0000 7f8bfeffd700 1 -- 172.21.15.82:0/1508942624 <== mon.0 v2:172.21.15.82:3300/0 8 ==== log(1 entries from seq 7 at 2023-11-28T13:02:35.950374+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7f8c04051010 con 0x7f8c100af8f0 2023-11-28T13:02:37.926 INFO:teuthology.orchestra.run.smithi082.stdout:2023-11-28T13:02:35.950374+0000 mds.d [INF] scrub summary: idle 2023-11-28T13:02:57.418 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:02:57.421 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:03:04.336 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-11-28T13:03:04.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.460+0000 7fe015151700 1 Processor -- start 2023-11-28T13:03:04.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.460+0000 7fe015151700 1 -- start start 2023-11-28T13:03:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.460+0000 7fe015151700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe01015fcb0 0x7fe0100ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.460+0000 7fe015151700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0100cd200 0x7fe01006b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.460+0000 7fe015151700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01006af10 con 0x7fe0100cd650 2023-11-28T13:03:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.460+0000 7fe015151700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0100d0820 con 0x7fe0100cd200 2023-11-28T13:03:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.460+0000 7fe015151700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01006a670 con 0x7fe01015fcb0 2023-11-28T13:03:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.460+0000 7fe00e59c700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0100cd200 0x7fe01006b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.460+0000 7fe00ed9d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe01015fcb0 0x7fe0100ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.460+0000 7fe00e59c700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0100cd200 0x7fe01006b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:40010/0 (socket says 172.21.15.82:40010) 2023-11-28T13:03:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.460+0000 7fe00f59e700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe0100cd650 0x7fe010160160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:41732/0 (socket says 172.21.15.82:41732) 2023-11-28T13:03:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.460+0000 7fe00e59c700 1 -- 172.21.15.82:0/3265545206 learned_addr learned my addr 172.21.15.82:0/3265545206 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:04.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.460+0000 7fe00e59c700 1 -- 172.21.15.82:0/3265545206 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe01015fcb0 msgr2=0x7fe0100ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:04.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.460+0000 7fe00e59c700 1 --2- 172.21.15.82:0/3265545206 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe01015fcb0 0x7fe0100ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.460+0000 7fe00e59c700 1 -- 172.21.15.82:0/3265545206 >> v1:172.21.15.114:6789/0 conn(0x7fe0100cd650 legacy=0x7fe010160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:04.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.460+0000 7fe00e59c700 1 -- 172.21.15.82:0/3265545206 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01006a950 con 0x7fe0100cd200 2023-11-28T13:03:04.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.464+0000 7fe00e59c700 1 --2- 172.21.15.82:0/3265545206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0100cd200 0x7fe01006b800 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdff8009940 tx=0x7fdff8009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df7336ce8c5d3a88 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:04.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.464+0000 7fe00dd9b700 1 -- 172.21.15.82:0/3265545206 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff8011830 con 0x7fe0100cd200 2023-11-28T13:03:04.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.464+0000 7fe00dd9b700 1 -- 172.21.15.82:0/3265545206 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff8011990 con 0x7fe0100cd200 2023-11-28T13:03:04.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.464+0000 7fe00dd9b700 1 -- 172.21.15.82:0/3265545206 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff8011d20 con 0x7fe0100cd200 2023-11-28T13:03:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.464+0000 7fe015151700 1 -- 172.21.15.82:0/3265545206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0100cd200 msgr2=0x7fe01006b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.464+0000 7fe015151700 1 --2- 172.21.15.82:0/3265545206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0100cd200 0x7fe01006b800 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdff8009940 tx=0x7fdff8009c50 comp rx=0 tx=0).stop 2023-11-28T13:03:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.464+0000 7fe015151700 1 -- 172.21.15.82:0/3265545206 shutdown_connections 2023-11-28T13:03:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.464+0000 7fe015151700 1 --2- 172.21.15.82:0/3265545206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0100cd200 0x7fe01006b800 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.464+0000 7fe015151700 1 --2- 172.21.15.82:0/3265545206 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe01015fcb0 0x7fe0100ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.464+0000 7fe015151700 1 -- 172.21.15.82:0/3265545206 >> 172.21.15.82:0/3265545206 conn(0x7fe0100d02c0 msgr2=0x7fe0100d2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:04.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.464+0000 7fe015151700 1 -- 172.21.15.82:0/3265545206 shutdown_connections 2023-11-28T13:03:04.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.464+0000 7fe015151700 1 -- 172.21.15.82:0/3265545206 wait complete. 2023-11-28T13:03:04.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.464+0000 7fe015151700 1 Processor -- start 2023-11-28T13:03:04.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.464+0000 7fe015151700 1 -- start start 2023-11-28T13:03:04.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe015151700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0100cd200 0x7fe0100cc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe015151700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0100cd650 0x7fe01014d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe015151700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe01015fcb0 0x7fe0100d2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe015151700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01014d7d0 con 0x7fe01015fcb0 2023-11-28T13:03:04.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe015151700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0100c66e0 con 0x7fe0100cd200 2023-11-28T13:03:04.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe015151700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01015b840 con 0x7fe0100cd650 2023-11-28T13:03:04.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe00f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe01015fcb0 0x7fe0100d2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe00f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe01015fcb0 0x7fe0100d2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34654/0 (socket says 172.21.15.82:34654) 2023-11-28T13:03:04.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe00f59e700 1 -- 172.21.15.82:0/1731282403 learned_addr learned my addr 172.21.15.82:0/1731282403 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:04.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe00ed9d700 1 --2- 172.21.15.82:0/1731282403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0100cd200 0x7fe0100cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe00e59c700 1 --2- 172.21.15.82:0/1731282403 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0100cd650 0x7fe01014d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe00f59e700 1 -- 172.21.15.82:0/1731282403 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0100cd650 msgr2=0x7fe01014d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:04.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe00f59e700 1 --2- 172.21.15.82:0/1731282403 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0100cd650 0x7fe01014d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe00f59e700 1 -- 172.21.15.82:0/1731282403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0100cd200 msgr2=0x7fe0100cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:04.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe00f59e700 1 --2- 172.21.15.82:0/1731282403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0100cd200 0x7fe0100cc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe00f59e700 1 -- 172.21.15.82:0/1731282403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff8009570 con 0x7fe01015fcb0 2023-11-28T13:03:04.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe00f59e700 1 --2- 172.21.15.82:0/1731282403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe01015fcb0 0x7fe0100d2b40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe00800c3e0 tx=0x7fe00800c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:04.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe0077fe700 1 -- 172.21.15.82:0/1731282403 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe008004a90 con 0x7fe01015fcb0 2023-11-28T13:03:04.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe0077fe700 1 -- 172.21.15.82:0/1731282403 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe008004bf0 con 0x7fe01015fcb0 2023-11-28T13:03:04.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe015151700 1 -- 172.21.15.82:0/1731282403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0100d1d30 con 0x7fe01015fcb0 2023-11-28T13:03:04.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe0077fe700 1 -- 172.21.15.82:0/1731282403 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0080070d0 con 0x7fe01015fcb0 2023-11-28T13:03:04.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.468+0000 7fe015151700 1 -- 172.21.15.82:0/1731282403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01006ac30 con 0x7fe01015fcb0 2023-11-28T13:03:04.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe0077fe700 1 -- 172.21.15.82:0/1731282403 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe008010070 con 0x7fe01015fcb0 2023-11-28T13:03:04.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe0077fe700 1 --2- 172.21.15.82:0/1731282403 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdff0064ee0 0x7fdff0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe00ed9d700 1 --2- 172.21.15.82:0/1731282403 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdff0064ee0 0x7fdff0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe0077fe700 1 -- 172.21.15.82:0/1731282403 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe008081520 con 0x7fe01015fcb0 2023-11-28T13:03:04.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe0183d1740 1 Processor -- start 2023-11-28T13:03:04.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe0183d1740 1 -- start start 2023-11-28T13:03:04.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe00ed9d700 1 --2- 172.21.15.82:0/1731282403 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdff0064ee0 0x7fdff0067390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe0000113e0 tx=0x7fe00000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:04.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe0183d1740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x14b0c10 0x1767b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe0183d1740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x14b0840 0x17680a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe0183d1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14fb8c0 0x17642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe0183d1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x161fd20 con 0x14fb8c0 2023-11-28T13:03:04.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe0183d1740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x168fd60 con 0x14b0840 2023-11-28T13:03:04.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe0183d1740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x1689060 con 0x14b0c10 2023-11-28T13:03:04.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe00f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14fb8c0 0x17642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe00f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14fb8c0 0x17642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34658/0 (socket says 172.21.15.82:34658) 2023-11-28T13:03:04.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe00f59e700 1 -- 172.21.15.82:0/3347840922 learned_addr learned my addr 172.21.15.82:0/3347840922 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:04.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe00e59c700 1 --2- 172.21.15.82:0/3347840922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x14b0840 0x17680a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe00ed9d700 1 --2- 172.21.15.82:0/3347840922 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x14b0c10 0x1767b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe00f59e700 1 -- 172.21.15.82:0/3347840922 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x14b0c10 msgr2=0x1767b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:04.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe00f59e700 1 --2- 172.21.15.82:0/3347840922 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x14b0c10 0x1767b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe00f59e700 1 -- 172.21.15.82:0/3347840922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x14b0840 msgr2=0x17680a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:04.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe00f59e700 1 --2- 172.21.15.82:0/3347840922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x14b0840 0x17680a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe00f59e700 1 -- 172.21.15.82:0/3347840922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x16af0a0 con 0x14fb8c0 2023-11-28T13:03:04.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe00f59e700 1 --2- 172.21.15.82:0/3347840922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14fb8c0 0x17642c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe00807fb30 tx=0x7fe008010300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f1a242d1e500d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:04.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe004ff9700 1 -- 172.21.15.82:0/3347840922 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00806a070 con 0x14fb8c0 2023-11-28T13:03:04.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.472+0000 7fe004ff9700 1 -- 172.21.15.82:0/3347840922 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00805ae50 con 0x14fb8c0 2023-11-28T13:03:04.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.476+0000 7fe004ff9700 1 -- 172.21.15.82:0/3347840922 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe008081070 con 0x14fb8c0 2023-11-28T13:03:04.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.476+0000 7fe0183d1740 1 -- 172.21.15.82:0/3347840922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14fb8c0 msgr2=0x17642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:04.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.476+0000 7fe0183d1740 1 --2- 172.21.15.82:0/3347840922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14fb8c0 0x17642c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe00807fb30 tx=0x7fe008010300 comp rx=0 tx=0).stop 2023-11-28T13:03:04.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.476+0000 7fe0183d1740 1 -- 172.21.15.82:0/3347840922 shutdown_connections 2023-11-28T13:03:04.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.476+0000 7fe0183d1740 1 --2- 172.21.15.82:0/3347840922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14fb8c0 0x17642c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.476+0000 7fe0183d1740 1 --2- 172.21.15.82:0/3347840922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x14b0840 0x17680a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.476+0000 7fe0183d1740 1 --2- 172.21.15.82:0/3347840922 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x14b0c10 0x1767b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.476+0000 7fe0183d1740 1 -- 172.21.15.82:0/3347840922 >> 172.21.15.82:0/3347840922 conn(0x14b0fe0 msgr2=0x1749b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:04.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.476+0000 7fe0183d1740 1 -- 172.21.15.82:0/3347840922 shutdown_connections 2023-11-28T13:03:04.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.476+0000 7fe0183d1740 1 -- 172.21.15.82:0/3347840922 wait complete. 2023-11-28T13:03:04.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.476+0000 7fe0183d1740 1 -- start start 2023-11-28T13:03:04.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.476+0000 7fe0183d1740 1 Processor -- start 2023-11-28T13:03:04.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.476+0000 7fe0183d1740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x14b0840 0x171eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.476+0000 7fe0183d1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14b0c10 0x1746240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.476+0000 7fe0183d1740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x14fb8c0 0x1720630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.476+0000 7fe0183d1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1535c50 con 0x14b0c10 2023-11-28T13:03:04.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.476+0000 7fe0183d1740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x171dfd0 con 0x14b0840 2023-11-28T13:03:04.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.476+0000 7fe0183d1740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x171e270 con 0x14fb8c0 2023-11-28T13:03:04.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe0183d1740 10 client.0 _ll_register_callbacks cb 0x16829a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:03:04.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe00e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14b0c10 0x1746240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe00e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14b0c10 0x1746240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34660/0 (socket says 172.21.15.82:34660) 2023-11-28T13:03:04.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe00e59c700 1 -- 172.21.15.82:0/1080411519 learned_addr learned my addr 172.21.15.82:0/1080411519 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:04.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe00ed9d700 1 --2- 172.21.15.82:0/1080411519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x14b0840 0x171eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe00f59e700 1 --2- 172.21.15.82:0/1080411519 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x14fb8c0 0x1720630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe00e59c700 1 -- 172.21.15.82:0/1080411519 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x14fb8c0 msgr2=0x1720630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:04.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe00e59c700 1 --2- 172.21.15.82:0/1080411519 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x14fb8c0 0x1720630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe00e59c700 1 -- 172.21.15.82:0/1080411519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x14b0840 msgr2=0x171eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:04.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe00e59c700 1 --2- 172.21.15.82:0/1080411519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x14b0840 0x171eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe00e59c700 1 -- 172.21.15.82:0/1080411519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01006ac30 con 0x14b0c10 2023-11-28T13:03:04.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe00e59c700 1 --2- 172.21.15.82:0/1080411519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14b0c10 0x1746240 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fdff8009150 tx=0x7fdff800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3e35898963a58d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:04.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fdfedffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-11-28T13:03:04.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fdfedffb700 1 -- 172.21.15.82:0/1080411519 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff801f040 con 0x14b0c10 2023-11-28T13:03:04.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fdfedffb700 1 -- 172.21.15.82:0/1080411519 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdff8004450 con 0x14b0c10 2023-11-28T13:03:04.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe0183d1740 1 -- 172.21.15.82:0/1080411519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x16820e0 con 0x14b0c10 2023-11-28T13:03:04.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fdfedffb700 1 -- 172.21.15.82:0/1080411519 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdff8004610 con 0x14b0c10 2023-11-28T13:03:04.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe0183d1740 10 client.6087 fetch_fsmap learned FSMap version 22 2023-11-28T13:03:04.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe0183d1740 1 -- 172.21.15.82:0/1080411519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x14fcb10 con 0x14b0c10 2023-11-28T13:03:04.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fdfedffb700 1 -- 172.21.15.82:0/1080411519 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x16820e0 con 0x14b0c10 2023-11-28T13:03:04.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fdfedffb700 1 -- 172.21.15.82:0/1080411519 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fdff8022030 con 0x14b0c10 2023-11-28T13:03:04.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe0183d1740 10 client.6087 fetch_fsmap finished waiting for FSMap version 22 2023-11-28T13:03:04.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe0183d1740 10 client.6087 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2023-11-28T13:03:04.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe0183d1740 20 client.6087 populate_metadata read hostname 'smithi082' 2023-11-28T13:03:04.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe0183d1740 1 --2- 172.21.15.82:0/1080411519 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x1743530 0x1721060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe0183d1740 4 client.6087 mds_command: new command op to 5814 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T13:03:04.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe0183d1740 1 -- 172.21.15.82:0/1080411519 --> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1681e00 con 0x1743530 2023-11-28T13:03:04.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe00ed9d700 1 --2- 172.21.15.82:0/1080411519 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x1743530 0x1721060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fdfedffb700 10 client.6087 ms_handle_connect on v2:172.21.15.114:6833/4092152651 2023-11-28T13:03:04.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.480+0000 7fe00ed9d700 1 --2- 172.21.15.82:0/1080411519 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x1743530 0x1721060 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84d09e99a578b8a6 server_cookie=7630a50d8e875fe1 in_seq=0 out_seq=0 2023-11-28T13:03:04.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.484+0000 7fdfedffb700 1 -- 172.21.15.82:0/1080411519 <== mds.0 v2:172.21.15.114:6833/4092152651 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1681e00 con 0x1743530 2023-11-28T13:03:04.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.484+0000 7fdfedffb700 10 client.6087 handle_command_reply: tid=0 2023-11-28T13:03:04.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.484+0000 7fe0183d1740 1 client.6087 shutdown 2023-11-28T13:03:04.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.484+0000 7fe0183d1740 1 -- 172.21.15.82:0/1080411519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14b0c10 msgr2=0x1746240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:04.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.484+0000 7fe0183d1740 1 --2- 172.21.15.82:0/1080411519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14b0c10 0x1746240 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fdff8009150 tx=0x7fdff800e000 comp rx=0 tx=0).stop 2023-11-28T13:03:04.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.484+0000 7fe0183d1740 1 -- 172.21.15.82:0/1080411519 shutdown_connections 2023-11-28T13:03:04.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.484+0000 7fe0183d1740 1 --2- 172.21.15.82:0/1080411519 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x1743530 0x1721060 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.484+0000 7fe0183d1740 1 --2- 172.21.15.82:0/1080411519 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x14fb8c0 0x1720630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.484+0000 7fe0183d1740 1 --2- 172.21.15.82:0/1080411519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14b0c10 0x1746240 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.484+0000 7fe0183d1740 1 --2- 172.21.15.82:0/1080411519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x14b0840 0x171eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.484+0000 7fe0183d1740 1 -- 172.21.15.82:0/1080411519 >> 172.21.15.82:0/1080411519 conn(0x14b0fe0 msgr2=0x1742690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:04.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.484+0000 7fdfedffb700 0 client.6087 ms_handle_reset on v2:172.21.15.114:6833/4092152651 2023-11-28T13:03:04.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.484+0000 7fe0183d1740 1 -- 172.21.15.82:0/1080411519 shutdown_connections 2023-11-28T13:03:04.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.484+0000 7fe0183d1740 1 -- 172.21.15.82:0/1080411519 wait complete. 2023-11-28T13:03:04.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.484+0000 7fe0183d1740 20 client.6087 trim_cache size 0 max 16384 2023-11-28T13:03:04.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.500+0000 7fe0183d1740 1 Processor -- start 2023-11-28T13:03:04.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.500+0000 7fe0183d1740 1 -- start start 2023-11-28T13:03:04.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x14b0840 0x1742200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x14b0c10 0x1742740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14fb8c0 0x177c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1682610 con 0x14fb8c0 2023-11-28T13:03:04.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1654570 con 0x14b0840 2023-11-28T13:03:04.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x164a130 con 0x14b0c10 2023-11-28T13:03:04.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe00f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14fb8c0 0x177c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe00f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14fb8c0 0x177c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34662/0 (socket says 172.21.15.82:34662) 2023-11-28T13:03:04.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe00f59e700 1 -- 172.21.15.82:0/2923083972 learned_addr learned my addr 172.21.15.82:0/2923083972 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:04.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe00ed9d700 1 --2- 172.21.15.82:0/2923083972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x14b0840 0x1742200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe00e59c700 1 --2- 172.21.15.82:0/2923083972 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x14b0c10 0x1742740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe00f59e700 1 -- 172.21.15.82:0/2923083972 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x14b0c10 msgr2=0x1742740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:04.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe00f59e700 1 --2- 172.21.15.82:0/2923083972 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x14b0c10 0x1742740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe00f59e700 1 -- 172.21.15.82:0/2923083972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x14b0840 msgr2=0x1742200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:04.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe00f59e700 1 --2- 172.21.15.82:0/2923083972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x14b0840 0x1742200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe00f59e700 1 -- 172.21.15.82:0/2923083972 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0100d33e0 con 0x14fb8c0 2023-11-28T13:03:04.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe00e59c700 1 --2- 172.21.15.82:0/2923083972 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x14b0c10 0x1742740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:03:04.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe00f59e700 1 --2- 172.21.15.82:0/2923083972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14fb8c0 0x177c440 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe00805adb0 tx=0x7fe00801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a4ac427dc38c50 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:04.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0057fa700 1 -- 172.21.15.82:0/2923083972 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00806f070 con 0x14fb8c0 2023-11-28T13:03:04.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0057fa700 1 -- 172.21.15.82:0/2923083972 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe008079e90 con 0x14fb8c0 2023-11-28T13:03:04.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0057fa700 1 -- 172.21.15.82:0/2923083972 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00806a040 con 0x14fb8c0 2023-11-28T13:03:04.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 -- 172.21.15.82:0/2923083972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14fb8c0 msgr2=0x177c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:04.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 --2- 172.21.15.82:0/2923083972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14fb8c0 0x177c440 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe00805adb0 tx=0x7fe00801d000 comp rx=0 tx=0).stop 2023-11-28T13:03:04.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 -- 172.21.15.82:0/2923083972 shutdown_connections 2023-11-28T13:03:04.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 --2- 172.21.15.82:0/2923083972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14fb8c0 0x177c440 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 --2- 172.21.15.82:0/2923083972 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x14b0c10 0x1742740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 --2- 172.21.15.82:0/2923083972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x14b0840 0x1742200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 -- 172.21.15.82:0/2923083972 >> 172.21.15.82:0/2923083972 conn(0x14b0fe0 msgr2=0x1749520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:04.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 -- 172.21.15.82:0/2923083972 shutdown_connections 2023-11-28T13:03:04.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 -- 172.21.15.82:0/2923083972 wait complete. 2023-11-28T13:03:04.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 -- start start 2023-11-28T13:03:04.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 Processor -- start 2023-11-28T13:03:04.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x14b0840 0x17cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14b0c10 0x177eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x14fb8c0 0x177f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x177f720 con 0x14b0c10 2023-11-28T13:03:04.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x17cf310 con 0x14b0840 2023-11-28T13:03:04.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x1745ac0 con 0x14fb8c0 2023-11-28T13:03:04.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe0183d1740 10 client.0 _ll_register_callbacks cb 0x7fe008052fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:03:04.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe00e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14b0c10 0x177eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.504+0000 7fe00e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14b0c10 0x177eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34670/0 (socket says 172.21.15.82:34670) 2023-11-28T13:03:04.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe00e59c700 1 -- 172.21.15.82:0/1954519930 learned_addr learned my addr 172.21.15.82:0/1954519930 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:04.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe00ed9d700 1 --2- 172.21.15.82:0/1954519930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x14b0840 0x17cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe00f59e700 1 --2- 172.21.15.82:0/1954519930 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x14fb8c0 0x177f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe00ed9d700 1 -- 172.21.15.82:0/1954519930 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x14fb8c0 msgr2=0x177f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:04.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe00ed9d700 1 --2- 172.21.15.82:0/1954519930 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x14fb8c0 0x177f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe00ed9d700 1 -- 172.21.15.82:0/1954519930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14b0c10 msgr2=0x177eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:04.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe00ed9d700 1 --2- 172.21.15.82:0/1954519930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14b0c10 0x177eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe00ed9d700 1 -- 172.21.15.82:0/1954519930 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x16af0a0 con 0x14b0840 2023-11-28T13:03:04.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe00ed9d700 1 --2- 172.21.15.82:0/1954519930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x14b0840 0x17cedd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x171c510 tx=0x7fe000004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ead05c1d7f617c06 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:04.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fdfedffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-28T13:03:04.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fdfedffb700 1 -- 172.21.15.82:0/1954519930 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00001c040 con 0x14b0840 2023-11-28T13:03:04.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe0183d1740 1 -- 172.21.15.82:0/1954519930 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe00805ae50 con 0x14b0840 2023-11-28T13:03:04.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fdfedffb700 1 -- 172.21.15.82:0/1954519930 <== mon.1 v2:172.21.15.114:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe000017ca0 con 0x14b0840 2023-11-28T13:03:04.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fdfedffb700 1 -- 172.21.15.82:0/1954519930 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe00000e040 con 0x14b0840 2023-11-28T13:03:04.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe0183d1740 10 client.5980 fetch_fsmap learned FSMap version 22 2023-11-28T13:03:04.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe0183d1740 1 -- 172.21.15.82:0/1954519930 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x1635af0 con 0x14b0840 2023-11-28T13:03:04.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fdfedffb700 1 -- 172.21.15.82:0/1954519930 <== mon.1 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00805ae50 con 0x14b0840 2023-11-28T13:03:04.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fdfedffb700 1 -- 172.21.15.82:0/1954519930 <== mon.1 v2:172.21.15.114:3300/0 5 ==== fsmap(e 22) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fe000030020 con 0x14b0840 2023-11-28T13:03:04.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe0183d1740 10 client.5980 fetch_fsmap finished waiting for FSMap version 22 2023-11-28T13:03:04.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe0183d1740 10 client.5980 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2023-11-28T13:03:04.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe0183d1740 20 client.5980 populate_metadata read hostname 'smithi082' 2023-11-28T13:03:04.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe0183d1740 1 --2- 172.21.15.82:0/1954519930 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x173bfb0 0x173c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe0183d1740 4 client.5980 mds_command: new command op to 5814 tid=0[{"prefix": "scrub status"}] 2023-11-28T13:03:04.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe0183d1740 1 -- 172.21.15.82:0/1954519930 --> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x152d390 con 0x173bfb0 2023-11-28T13:03:04.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe00e59c700 1 --2- 172.21.15.82:0/1954519930 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x173bfb0 0x173c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fdfedffb700 10 client.5980 ms_handle_connect on v2:172.21.15.114:6833/4092152651 2023-11-28T13:03:04.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe00e59c700 1 --2- 172.21.15.82:0/1954519930 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x173bfb0 0x173c3b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=380ab30e2cb8ea7a server_cookie=75e0bf7f14f718de in_seq=0 out_seq=0 2023-11-28T13:03:04.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fdfedffb700 1 -- 172.21.15.82:0/1954519930 <== mds.0 v2:172.21.15.114:6833/4092152651 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x152d390 con 0x173bfb0 2023-11-28T13:03:04.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fdfedffb700 10 client.5980 handle_command_reply: tid=0 2023-11-28T13:03:04.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe0183d1740 1 client.5980 shutdown 2023-11-28T13:03:04.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe0183d1740 1 -- 172.21.15.82:0/1954519930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x14b0840 msgr2=0x17cedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:04.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe0183d1740 1 --2- 172.21.15.82:0/1954519930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x14b0840 0x17cedd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x171c510 tx=0x7fe000004af0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe0183d1740 1 -- 172.21.15.82:0/1954519930 shutdown_connections 2023-11-28T13:03:04.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe0183d1740 1 --2- 172.21.15.82:0/1954519930 >> [v2:172.21.15.114:6833/4092152651,v1:172.21.15.114:6835/4092152651] conn(0x173bfb0 0x173c3b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe0183d1740 1 --2- 172.21.15.82:0/1954519930 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x14fb8c0 0x177f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe0183d1740 1 --2- 172.21.15.82:0/1954519930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x14b0c10 0x177eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe0183d1740 1 --2- 172.21.15.82:0/1954519930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x14b0840 0x17cedd0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fdfedffb700 0 client.5980 ms_handle_reset on v2:172.21.15.114:6833/4092152651 2023-11-28T13:03:04.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe0183d1740 1 -- 172.21.15.82:0/1954519930 >> 172.21.15.82:0/1954519930 conn(0x14b0fe0 msgr2=0x1749520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:04.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe0183d1740 1 -- 172.21.15.82:0/1954519930 shutdown_connections 2023-11-28T13:03:04.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.508+0000 7fe0183d1740 1 -- 172.21.15.82:0/1954519930 wait complete. 2023-11-28T13:03:04.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.512+0000 7fe0183d1740 20 client.5980 trim_cache size 0 max 16384 2023-11-28T13:03:04.519 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:03:04.519 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2023-11-28T13:03:04.519 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2023-11-28T13:03:04.519 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:03:04.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.512+0000 7fe015151700 1 -- 172.21.15.82:0/1731282403 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdff0064ee0 msgr2=0x7fdff0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:04.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.512+0000 7fe015151700 1 --2- 172.21.15.82:0/1731282403 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdff0064ee0 0x7fdff0067390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe0000113e0 tx=0x7fe00000b040 comp rx=0 tx=0).stop 2023-11-28T13:03:04.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.512+0000 7fe015151700 1 -- 172.21.15.82:0/1731282403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe01015fcb0 msgr2=0x7fe0100d2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:04.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.512+0000 7fe015151700 1 --2- 172.21.15.82:0/1731282403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe01015fcb0 0x7fe0100d2b40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe00800c3e0 tx=0x7fe00800c6f0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.512+0000 7fe015151700 1 -- 172.21.15.82:0/1731282403 shutdown_connections 2023-11-28T13:03:04.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.512+0000 7fe015151700 1 --2- 172.21.15.82:0/1731282403 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdff0064ee0 0x7fdff0067390 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.512+0000 7fe015151700 1 --2- 172.21.15.82:0/1731282403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe01015fcb0 0x7fe0100d2b40 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.512+0000 7fe015151700 1 --2- 172.21.15.82:0/1731282403 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0100cd650 0x7fe01014d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.512+0000 7fe015151700 1 --2- 172.21.15.82:0/1731282403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0100cd200 0x7fe0100cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.512+0000 7fe015151700 1 -- 172.21.15.82:0/1731282403 >> 172.21.15.82:0/1731282403 conn(0x7fe0100d02c0 msgr2=0x7fe0100b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:04.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.512+0000 7fe015151700 1 -- 172.21.15.82:0/1731282403 shutdown_connections 2023-11-28T13:03:04.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.512+0000 7fe015151700 1 -- 172.21.15.82:0/1731282403 wait complete. 2023-11-28T13:03:04.528 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-28T13:03:04.629 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:03:04.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.744+0000 7fc638a21700 1 Processor -- start 2023-11-28T13:03:04.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.744+0000 7fc638a21700 1 -- start start 2023-11-28T13:03:04.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.744+0000 7fc638a21700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc6340b6060 0x7fc6340cae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.744+0000 7fc638a21700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6340cfe90 con 0x7fc6340cd900 2023-11-28T13:03:04.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.744+0000 7fc638a21700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6340cd470 con 0x7fc63406de80 2023-11-28T13:03:04.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.744+0000 7fc638a21700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6340d06a0 con 0x7fc6340b6060 2023-11-28T13:03:04.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.744+0000 7fc63259c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc6340cd900 0x7fc63406d770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54376/0 (socket says 172.21.15.82:54376) 2023-11-28T13:03:04.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.744+0000 7fc63259c700 1 -- 172.21.15.82:0/1950289363 learned_addr learned my addr 172.21.15.82:0/1950289363 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:04.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.744+0000 7fc632d9d700 1 --2- 172.21.15.82:0/1950289363 >> v2:172.21.15.82:3300/0 conn(0x7fc6340b6060 0x7fc6340cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.744+0000 7fc632d9d700 1 -- 172.21.15.82:0/1950289363 >> v1:172.21.15.114:6789/0 conn(0x7fc63406de80 legacy=0x7fc6340ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:04.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.744+0000 7fc632d9d700 1 -- 172.21.15.82:0/1950289363 >> v1:172.21.15.82:6789/0 conn(0x7fc6340cd900 legacy=0x7fc63406d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:04.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.744+0000 7fc632d9d700 1 -- 172.21.15.82:0/1950289363 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6340d00e0 con 0x7fc6340b6060 2023-11-28T13:03:04.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.744+0000 7fc632d9d700 1 --2- 172.21.15.82:0/1950289363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6340b6060 0x7fc6340cae60 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009850 tx=0x7fc61c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd4b06321bfae87 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:04.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.744+0000 7fc631d9b700 1 -- 172.21.15.82:0/1950289363 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c011830 con 0x7fc6340b6060 2023-11-28T13:03:04.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.744+0000 7fc631d9b700 1 -- 172.21.15.82:0/1950289363 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c011990 con 0x7fc6340b6060 2023-11-28T13:03:04.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.744+0000 7fc631d9b700 1 -- 172.21.15.82:0/1950289363 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c011d20 con 0x7fc6340b6060 2023-11-28T13:03:04.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc638a21700 1 -- 172.21.15.82:0/1950289363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6340b6060 msgr2=0x7fc6340cae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:04.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc638a21700 1 --2- 172.21.15.82:0/1950289363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6340b6060 0x7fc6340cae60 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009850 tx=0x7fc61c009b60 comp rx=0 tx=0).stop 2023-11-28T13:03:04.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc638a21700 1 -- 172.21.15.82:0/1950289363 shutdown_connections 2023-11-28T13:03:04.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc638a21700 1 --2- 172.21.15.82:0/1950289363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6340b6060 0x7fc6340cae60 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc638a21700 1 -- 172.21.15.82:0/1950289363 >> 172.21.15.82:0/1950289363 conn(0x7fc6340b2320 msgr2=0x7fc6340b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:04.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc638a21700 1 -- 172.21.15.82:0/1950289363 shutdown_connections 2023-11-28T13:03:04.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc638a21700 1 -- 172.21.15.82:0/1950289363 wait complete. 2023-11-28T13:03:04.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc638a21700 1 Processor -- start 2023-11-28T13:03:04.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc638a21700 1 -- start start 2023-11-28T13:03:04.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc638a21700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63406de80 0x7fc63415b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc638a21700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6340b6060 0x7fc6340ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc638a21700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6340cd900 0x7fc6341f0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc638a21700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6340cac50 con 0x7fc6340b6060 2023-11-28T13:03:04.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc638a21700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63415b8f0 con 0x7fc63406de80 2023-11-28T13:03:04.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc638a21700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63415bbd0 con 0x7fc6340cd900 2023-11-28T13:03:04.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc63259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6340b6060 0x7fc6340ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc63259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6340b6060 0x7fc6340ca710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34676/0 (socket says 172.21.15.82:34676) 2023-11-28T13:03:04.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc63259c700 1 -- 172.21.15.82:0/411248648 learned_addr learned my addr 172.21.15.82:0/411248648 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:04.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc632d9d700 1 --2- 172.21.15.82:0/411248648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63406de80 0x7fc63415b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc63359e700 1 --2- 172.21.15.82:0/411248648 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6340cd900 0x7fc6341f0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc63259c700 1 -- 172.21.15.82:0/411248648 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6340cd900 msgr2=0x7fc6341f0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:04.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc63259c700 1 --2- 172.21.15.82:0/411248648 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6340cd900 0x7fc6341f0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc63259c700 1 -- 172.21.15.82:0/411248648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63406de80 msgr2=0x7fc63415b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:04.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc63259c700 1 --2- 172.21.15.82:0/411248648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63406de80 0x7fc63415b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc63259c700 1 -- 172.21.15.82:0/411248648 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c0094b0 con 0x7fc6340b6060 2023-11-28T13:03:04.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc63359e700 1 --2- 172.21.15.82:0/411248648 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6340cd900 0x7fc6341f0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:04.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc63259c700 1 --2- 172.21.15.82:0/411248648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6340b6060 0x7fc6340ca710 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc62c00cb10 tx=0x7fc62c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:04.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc62b7fe700 1 -- 172.21.15.82:0/411248648 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c00a770 con 0x7fc6340b6060 2023-11-28T13:03:04.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc62b7fe700 1 -- 172.21.15.82:0/411248648 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c00a8d0 con 0x7fc6340b6060 2023-11-28T13:03:04.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc638a21700 1 -- 172.21.15.82:0/411248648 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6340afa80 con 0x7fc6340b6060 2023-11-28T13:03:04.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc62b7fe700 1 -- 172.21.15.82:0/411248648 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c00ac40 con 0x7fc6340b6060 2023-11-28T13:03:04.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.748+0000 7fc638a21700 1 -- 172.21.15.82:0/411248648 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6340d03c0 con 0x7fc6340b6060 2023-11-28T13:03:04.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.752+0000 7fc62b7fe700 1 -- 172.21.15.82:0/411248648 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc62c019030 con 0x7fc6340b6060 2023-11-28T13:03:04.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.752+0000 7fc638a21700 1 -- 172.21.15.82:0/411248648 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6340afc10 con 0x7fc6340b6060 2023-11-28T13:03:04.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.752+0000 7fc62b7fe700 1 --2- 172.21.15.82:0/411248648 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc614064ee0 0x7fc614067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:04.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.752+0000 7fc62b7fe700 1 -- 172.21.15.82:0/411248648 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc62c081600 con 0x7fc6340b6060 2023-11-28T13:03:04.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.752+0000 7fc632d9d700 1 --2- 172.21.15.82:0/411248648 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc614064ee0 0x7fc614067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:04.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.752+0000 7fc632d9d700 1 --2- 172.21.15.82:0/411248648 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc614064ee0 0x7fc614067390 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009fd0 tx=0x7fc61c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:04.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.760+0000 7fc62b7fe700 1 -- 172.21.15.82:0/411248648 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc62c04a400 con 0x7fc6340b6060 2023-11-28T13:03:04.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.952+0000 7fc638a21700 1 -- 172.21.15.82:0/411248648 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc63406e7d0 con 0x7fc6340b6060 2023-11-28T13:03:04.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.952+0000 7fc62b7fe700 1 -- 172.21.15.82:0/411248648 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4651 (secure 0 0 0) 0x7fc62c04f760 con 0x7fc6340b6060 2023-11-28T13:03:04.958 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:04.959 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/704061431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":704061431},{"type":"v1","addr":"172.21.15.114:6834","nonce":704061431}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3972503523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3972503523},{"type":"v1","addr":"172.21.15.82:6836","nonce":3972503523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5811,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2000262220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2000262220},{"type":"v1","addr":"172.21.15.82:6837","nonce":2000262220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:02:20.454524+0000","modified":"2023-11-28T13:02:23.476763+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5814":{"gid":5814,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/4092152651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":4092152651},{"type":"v1","addr":"172.21.15.114:6835","nonce":4092152651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T13:03:04.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.956+0000 7fc638a21700 1 -- 172.21.15.82:0/411248648 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc614064ee0 msgr2=0x7fc614067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:04.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.956+0000 7fc638a21700 1 --2- 172.21.15.82:0/411248648 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc614064ee0 0x7fc614067390 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009fd0 tx=0x7fc61c008030 comp rx=0 tx=0).stop 2023-11-28T13:03:04.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.956+0000 7fc638a21700 1 -- 172.21.15.82:0/411248648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6340b6060 msgr2=0x7fc6340ca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:04.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.956+0000 7fc638a21700 1 --2- 172.21.15.82:0/411248648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6340b6060 0x7fc6340ca710 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc62c00cb10 tx=0x7fc62c00cb40 comp rx=0 tx=0).stop 2023-11-28T13:03:04.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.956+0000 7fc638a21700 1 -- 172.21.15.82:0/411248648 shutdown_connections 2023-11-28T13:03:04.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.956+0000 7fc638a21700 1 --2- 172.21.15.82:0/411248648 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc614064ee0 0x7fc614067390 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.956+0000 7fc638a21700 1 --2- 172.21.15.82:0/411248648 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6340cd900 0x7fc6341f0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.956+0000 7fc638a21700 1 --2- 172.21.15.82:0/411248648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6340b6060 0x7fc6340ca710 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.956+0000 7fc638a21700 1 --2- 172.21.15.82:0/411248648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63406de80 0x7fc63415b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:04.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.956+0000 7fc638a21700 1 -- 172.21.15.82:0/411248648 >> 172.21.15.82:0/411248648 conn(0x7fc6340b2320 msgr2=0x7fc6340b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:04.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.956+0000 7fc638a21700 1 -- 172.21.15.82:0/411248648 shutdown_connections 2023-11-28T13:03:04.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:04.956+0000 7fc638a21700 1 -- 172.21.15.82:0/411248648 wait complete. 2023-11-28T13:03:04.963 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 22 2023-11-28T13:03:04.973 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2023-11-28T13:03:05.119 INFO:teuthology.orchestra.run.smithi114.stdout:{"message":"","return_code":0} 2023-11-28T13:03:05.119 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-28T13:03:05.120 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-11-28T13:03:05.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.156+0000 7fd1b6629140 1 Processor -- start 2023-11-28T13:03:05.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.156+0000 7fd1b6629140 1 -- start start 2023-11-28T13:03:05.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b6629140 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55de48463db0 0x55de4853c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:05.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b6629140 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4851fae0 0x55de484a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:05.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b6629140 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55de4851feb0 0x55de485c1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:05.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b6629140 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de48389240 con 0x55de4851fae0 2023-11-28T13:03:05.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b6629140 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de485c3c20 con 0x55de4851feb0 2023-11-28T13:03:05.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b6629140 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de485c3ec0 con 0x55de48463db0 2023-11-28T13:03:05.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b395d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4851fae0 0x55de484a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:05.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b395d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4851fae0 0x55de484a5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34694/0 (socket says 172.21.15.82:34694) 2023-11-28T13:03:05.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b395d700 1 -- 172.21.15.82:0/3811484298 learned_addr learned my addr 172.21.15.82:0/3811484298 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:05.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b415e700 1 --2- 172.21.15.82:0/3811484298 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55de48463db0 0x55de4853c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:05.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b495f700 1 --2- 172.21.15.82:0/3811484298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55de4851feb0 0x55de485c1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:05.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b395d700 1 -- 172.21.15.82:0/3811484298 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55de48463db0 msgr2=0x55de4853c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:05.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b395d700 1 --2- 172.21.15.82:0/3811484298 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55de48463db0 0x55de4853c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b395d700 1 -- 172.21.15.82:0/3811484298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55de4851feb0 msgr2=0x55de485c1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:05.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b395d700 1 --2- 172.21.15.82:0/3811484298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55de4851feb0 0x55de485c1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b395d700 1 -- 172.21.15.82:0/3811484298 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac005d20 con 0x55de4851fae0 2023-11-28T13:03:05.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b495f700 1 --2- 172.21.15.82:0/3811484298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55de4851feb0 0x55de485c1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:03:05.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b395d700 1 --2- 172.21.15.82:0/3811484298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4851fae0 0x55de484a5bf0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0017b0 tx=0x7fd19c001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780551c26a61ed14 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:05.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b295b700 1 -- 172.21.15.82:0/3811484298 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c003650 con 0x55de4851fae0 2023-11-28T13:03:05.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b295b700 1 -- 172.21.15.82:0/3811484298 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19c0037b0 con 0x55de4851fae0 2023-11-28T13:03:05.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b295b700 1 -- 172.21.15.82:0/3811484298 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c003b40 con 0x55de4851fae0 2023-11-28T13:03:05.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b6629140 1 -- 172.21.15.82:0/3811484298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4851fae0 msgr2=0x55de484a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:05.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b6629140 1 --2- 172.21.15.82:0/3811484298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4851fae0 0x55de484a5bf0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0017b0 tx=0x7fd19c001ac0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b6629140 1 -- 172.21.15.82:0/3811484298 shutdown_connections 2023-11-28T13:03:05.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b6629140 1 --2- 172.21.15.82:0/3811484298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55de4851feb0 0x55de485c1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b6629140 1 --2- 172.21.15.82:0/3811484298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4851fae0 0x55de484a5bf0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b6629140 1 --2- 172.21.15.82:0/3811484298 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55de48463db0 0x55de4853c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.160+0000 7fd1b6629140 1 -- 172.21.15.82:0/3811484298 >> 172.21.15.82:0/3811484298 conn(0x55de484922e0 msgr2=0x55de48460e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:05.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.164+0000 7fd1b6629140 1 -- 172.21.15.82:0/3811484298 shutdown_connections 2023-11-28T13:03:05.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.164+0000 7fd1b6629140 1 -- 172.21.15.82:0/3811484298 wait complete. 2023-11-28T13:03:05.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.164+0000 7fd1b6629140 1 Processor -- start 2023-11-28T13:03:05.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.164+0000 7fd1b6629140 1 -- start start 2023-11-28T13:03:05.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.164+0000 7fd1b6629140 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55de48463db0 0x55de4853aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:05.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.164+0000 7fd1b6629140 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4851fae0 0x55de485c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:05.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.164+0000 7fd1b6629140 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55de4851feb0 0x55de485393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:05.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.164+0000 7fd1b6629140 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de4853a0d0 con 0x55de4851fae0 2023-11-28T13:03:05.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.164+0000 7fd1b6629140 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de4853a370 con 0x55de4851feb0 2023-11-28T13:03:05.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.164+0000 7fd1b6629140 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de4853a610 con 0x55de48463db0 2023-11-28T13:03:05.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.164+0000 7fd1b395d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4851fae0 0x55de485c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:05.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.164+0000 7fd1b395d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4851fae0 0x55de485c30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34696/0 (socket says 172.21.15.82:34696) 2023-11-28T13:03:05.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.164+0000 7fd1b395d700 1 -- 172.21.15.82:0/3907962104 learned_addr learned my addr 172.21.15.82:0/3907962104 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:05.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.164+0000 7fd1b415e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55de48463db0 0x55de4853aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.164+0000 7fd1b495f700 1 --2- 172.21.15.82:0/3907962104 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55de4851feb0 0x55de485393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.168+0000 7fd1b395d700 1 -- 172.21.15.82:0/3907962104 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55de48463db0 msgr2=0x55de4853aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.168+0000 7fd1b395d700 1 --2- 172.21.15.82:0/3907962104 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55de48463db0 0x55de4853aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.168+0000 7fd1b395d700 1 -- 172.21.15.82:0/3907962104 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55de4851feb0 msgr2=0x55de485393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.168+0000 7fd1b395d700 1 --2- 172.21.15.82:0/3907962104 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55de4851feb0 0x55de485393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.168+0000 7fd1b395d700 1 -- 172.21.15.82:0/3907962104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c006d50 con 0x55de4851fae0 2023-11-28T13:03:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.168+0000 7fd1b395d700 1 --2- 172.21.15.82:0/3907962104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4851fae0 0x55de485c30c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd19c000f80 tx=0x7fd19c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.168+0000 7fd1b1959700 1 -- 172.21.15.82:0/3907962104 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c013420 con 0x55de4851fae0 2023-11-28T13:03:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.168+0000 7fd1b1959700 1 -- 172.21.15.82:0/3907962104 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19c013580 con 0x55de4851fae0 2023-11-28T13:03:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.168+0000 7fd1b6629140 1 -- 172.21.15.82:0/3907962104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55de483a1390 con 0x55de4851fae0 2023-11-28T13:03:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.168+0000 7fd1b1959700 1 -- 172.21.15.82:0/3907962104 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c013910 con 0x55de4851fae0 2023-11-28T13:03:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.168+0000 7fd1b6629140 1 -- 172.21.15.82:0/3907962104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de483948b0 con 0x55de4851fae0 2023-11-28T13:03:05.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.168+0000 7fd1b1959700 1 -- 172.21.15.82:0/3907962104 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd19c01b040 con 0x55de4851fae0 2023-11-28T13:03:05.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.172+0000 7fd1b1959700 1 --2- 172.21.15.82:0/3907962104 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd194063840 0x7fd194065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:05.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.172+0000 7fd1b1959700 1 -- 172.21.15.82:0/3907962104 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd19c081500 con 0x55de4851fae0 2023-11-28T13:03:05.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.172+0000 7fd1b415e700 1 --2- 172.21.15.82:0/3907962104 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd194063840 0x7fd194065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:05.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.172+0000 7fd1b6629140 1 --2- 172.21.15.82:0/3907962104 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x55de485c3600 0x55de484aa040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:05.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.172+0000 7fd1b6629140 1 -- 172.21.15.82:0/3907962104 --> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55de484aa580 con 0x55de485c3600 2023-11-28T13:03:05.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.172+0000 7fd1b495f700 1 --2- 172.21.15.82:0/3907962104 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x55de485c3600 0x55de484aa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:05.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.172+0000 7fd1b415e700 1 --2- 172.21.15.82:0/3907962104 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd194063840 0x7fd194065cf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00a440 tx=0x7fd1ac00f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:05.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.172+0000 7fd1b495f700 1 --2- 172.21.15.82:0/3907962104 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x55de485c3600 0x55de484aa040 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:05.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.172+0000 7fd1b495f700 1 -- 172.21.15.82:0/3907962104 <== osd.1 v2:172.21.15.82:6808/36628 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7fd1a4013040 con 0x55de485c3600 2023-11-28T13:03:05.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.172+0000 7fd1b6629140 1 -- 172.21.15.82:0/3907962104 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x55de485c3600 msgr2=0x55de484aa040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:05.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.172+0000 7fd1b6629140 1 --2- 172.21.15.82:0/3907962104 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x55de485c3600 0x55de484aa040 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.172+0000 7fd1b6629140 1 -- 172.21.15.82:0/3907962104 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd194063840 msgr2=0x7fd194065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:05.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.172+0000 7fd1b6629140 1 --2- 172.21.15.82:0/3907962104 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd194063840 0x7fd194065cf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00a440 tx=0x7fd1ac00f000 comp rx=0 tx=0).stop 2023-11-28T13:03:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.172+0000 7fd1b6629140 1 -- 172.21.15.82:0/3907962104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4851fae0 msgr2=0x55de485c30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.172+0000 7fd1b6629140 1 --2- 172.21.15.82:0/3907962104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4851fae0 0x55de485c30c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd19c000f80 tx=0x7fd19c001250 comp rx=0 tx=0).stop 2023-11-28T13:03:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.172+0000 7fd1b495f700 1 -- 172.21.15.82:0/3907962104 reap_dead start 2023-11-28T13:03:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.172+0000 7fd1b6629140 1 -- 172.21.15.82:0/3907962104 shutdown_connections 2023-11-28T13:03:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.172+0000 7fd1b6629140 1 -- 172.21.15.82:0/3907962104 >> 172.21.15.82:0/3907962104 conn(0x55de484922e0 msgr2=0x55de48520360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.172+0000 7fd1b6629140 1 -- 172.21.15.82:0/3907962104 shutdown_connections 2023-11-28T13:03:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.172+0000 7fd1b6629140 1 -- 172.21.15.82:0/3907962104 wait complete. 2023-11-28T13:03:05.183 INFO:teuthology.orchestra.run.smithi082.stdout:Yalphaparent_a 2023-11-28T13:03:05.184 DEBUG:teuthology.orchestra.run.smithi082:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-11-28T13:03:05.287 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:03:05.287 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511627777, 2023-11-28T13:03:05.287 INFO:teuthology.orchestra.run.smithi082.stdout: "ancestors": [ 2023-11-28T13:03:05.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:05.287 INFO:teuthology.orchestra.run.smithi082.stdout: "dirino": 1099511627776, 2023-11-28T13:03:05.287 INFO:teuthology.orchestra.run.smithi082.stdout: "dname": "alpha", 2023-11-28T13:03:05.287 INFO:teuthology.orchestra.run.smithi082.stdout: "version": 4 2023-11-28T13:03:05.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:05.288 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:05.288 INFO:teuthology.orchestra.run.smithi082.stdout: "dirino": 1, 2023-11-28T13:03:05.288 INFO:teuthology.orchestra.run.smithi082.stdout: "dname": "parent_a", 2023-11-28T13:03:05.288 INFO:teuthology.orchestra.run.smithi082.stdout: "version": 7 2023-11-28T13:03:05.288 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:05.288 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-11-28T13:03:05.288 INFO:teuthology.orchestra.run.smithi082.stdout: "pool": 8, 2023-11-28T13:03:05.288 INFO:teuthology.orchestra.run.smithi082.stdout: "old_pools": [] 2023-11-28T13:03:05.288 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:03:05.288 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:05.290 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T13:03:05.290 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T13:03:05.305 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T13:03:05.327 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T13:03:05.327 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:03:05.327 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:03:05.335 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:03:05.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.496+0000 7f578ffff700 1 Processor -- start 2023-11-28T13:03:05.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.496+0000 7f578ffff700 1 -- start start 2023-11-28T13:03:05.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.496+0000 7f578ffff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5790160900 0x7f57900cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:05.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.496+0000 7f578ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f57900c1910 0x7f579006c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:05.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.496+0000 7f578ffff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57900ce030 con 0x7f5790070070 2023-11-28T13:03:05.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f578ffff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57900ce310 con 0x7f57900c1910 2023-11-28T13:03:05.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f578ffff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579006a5d0 con 0x7f5790160900 2023-11-28T13:03:05.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f578f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f57900c1910 0x7f579006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:05.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f578f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f57900c1910 0x7f579006c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34708/0 (socket says 172.21.15.82:34708) 2023-11-28T13:03:05.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f578f7fe700 1 -- 172.21.15.82:0/1875004175 learned_addr learned my addr 172.21.15.82:0/1875004175 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:05.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f57867fc700 1 --2- 172.21.15.82:0/1875004175 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5790160900 0x7f57900cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:05.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f578f7fe700 1 -- 172.21.15.82:0/1875004175 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5790160900 msgr2=0x7f57900cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:05.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f578f7fe700 1 --2- 172.21.15.82:0/1875004175 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5790160900 0x7f57900cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f578f7fe700 1 -- 172.21.15.82:0/1875004175 >> v1:172.21.15.114:6789/0 conn(0x7f5790070070 legacy=0x7f5790070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:05.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f578f7fe700 1 -- 172.21.15.82:0/1875004175 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579006a8b0 con 0x7f57900c1910 2023-11-28T13:03:05.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f57867fc700 1 --2- 172.21.15.82:0/1875004175 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5790160900 0x7f57900cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:05.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f578f7fe700 1 --2- 172.21.15.82:0/1875004175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57900c1910 0x7f579006c070 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5788009e50 tx=0x7f578800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3655555360d37a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:05.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f578e7fc700 1 -- 172.21.15.82:0/1875004175 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578800e070 con 0x7f57900c1910 2023-11-28T13:03:05.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f578e7fc700 1 -- 172.21.15.82:0/1875004175 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578800b9c0 con 0x7f57900c1910 2023-11-28T13:03:05.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f578e7fc700 1 -- 172.21.15.82:0/1875004175 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578800bd70 con 0x7f57900c1910 2023-11-28T13:03:05.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f578ffff700 1 -- 172.21.15.82:0/1875004175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57900c1910 msgr2=0x7f579006c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:05.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f578ffff700 1 --2- 172.21.15.82:0/1875004175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57900c1910 0x7f579006c070 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5788009e50 tx=0x7f578800b330 comp rx=0 tx=0).stop 2023-11-28T13:03:05.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f578ffff700 1 -- 172.21.15.82:0/1875004175 shutdown_connections 2023-11-28T13:03:05.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f578ffff700 1 --2- 172.21.15.82:0/1875004175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57900c1910 0x7f579006c070 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f578ffff700 1 --2- 172.21.15.82:0/1875004175 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5790160900 0x7f57900cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f578ffff700 1 -- 172.21.15.82:0/1875004175 >> 172.21.15.82:0/1875004175 conn(0x7f57900ce600 msgr2=0x7f57900ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:05.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f578ffff700 1 -- 172.21.15.82:0/1875004175 shutdown_connections 2023-11-28T13:03:05.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.500+0000 7f578ffff700 1 -- 172.21.15.82:0/1875004175 wait complete. 2023-11-28T13:03:05.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f578ffff700 1 Processor -- start 2023-11-28T13:03:05.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f578ffff700 1 -- start start 2023-11-28T13:03:05.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f578ffff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5790070070 0x7f57900c0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:05.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f578ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f579015f1f0 0x7f57900b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:05.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f578ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57900c4300 0x7f57900c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:05.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f578ffff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57900c4ce0 con 0x7f579015f1f0 2023-11-28T13:03:05.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f578ffff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57900b4330 con 0x7f57900c4300 2023-11-28T13:03:05.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f578ffff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579015f660 con 0x7f5790070070 2023-11-28T13:03:05.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f57867fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f579015f1f0 0x7f57900b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:05.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f57867fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f579015f1f0 0x7f57900b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34712/0 (socket says 172.21.15.82:34712) 2023-11-28T13:03:05.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f57867fc700 1 -- 172.21.15.82:0/1027936462 learned_addr learned my addr 172.21.15.82:0/1027936462 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:05.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f578effd700 1 --2- 172.21.15.82:0/1027936462 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5790070070 0x7f57900c0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:05.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f578f7fe700 1 --2- 172.21.15.82:0/1027936462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57900c4300 0x7f57900c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:05.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f57867fc700 1 -- 172.21.15.82:0/1027936462 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5790070070 msgr2=0x7f57900c0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:05.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f57867fc700 1 --2- 172.21.15.82:0/1027936462 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5790070070 0x7f57900c0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f57867fc700 1 -- 172.21.15.82:0/1027936462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57900c4300 msgr2=0x7f57900c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:05.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f57867fc700 1 --2- 172.21.15.82:0/1027936462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57900c4300 0x7f57900c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f57867fc700 1 -- 172.21.15.82:0/1027936462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5788009b30 con 0x7f579015f1f0 2023-11-28T13:03:05.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f578effd700 1 --2- 172.21.15.82:0/1027936462 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5790070070 0x7f57900c0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:05.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f57867fc700 1 --2- 172.21.15.82:0/1027936462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f579015f1f0 0x7f57900b3df0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f577800e760 tx=0x7f577800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:05.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f5787fff700 1 -- 172.21.15.82:0/1027936462 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5778004230 con 0x7f579015f1f0 2023-11-28T13:03:05.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f5787fff700 1 -- 172.21.15.82:0/1027936462 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57780043b0 con 0x7f579015f1f0 2023-11-28T13:03:05.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f5787fff700 1 -- 172.21.15.82:0/1027936462 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57780036c0 con 0x7f579015f1f0 2023-11-28T13:03:05.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f578ffff700 1 -- 172.21.15.82:0/1027936462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57900cc710 con 0x7f579015f1f0 2023-11-28T13:03:05.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.504+0000 7f578ffff700 1 -- 172.21.15.82:0/1027936462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579006ab90 con 0x7f579015f1f0 2023-11-28T13:03:05.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.508+0000 7f578ffff700 1 -- 172.21.15.82:0/1027936462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57900cdc50 con 0x7f579015f1f0 2023-11-28T13:03:05.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.508+0000 7f5787fff700 1 -- 172.21.15.82:0/1027936462 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5778022070 con 0x7f579015f1f0 2023-11-28T13:03:05.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.508+0000 7f5787fff700 1 --2- 172.21.15.82:0/1027936462 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5770064f10 0x7f57700673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:05.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.508+0000 7f5787fff700 1 -- 172.21.15.82:0/1027936462 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5778081990 con 0x7f579015f1f0 2023-11-28T13:03:05.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.508+0000 7f578effd700 1 --2- 172.21.15.82:0/1027936462 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5770064f10 0x7f57700673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:05.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.508+0000 7f578effd700 1 --2- 172.21.15.82:0/1027936462 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5770064f10 0x7f57700673c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f57900c4fe0 tx=0x7f5780009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:05.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.516+0000 7f5787fff700 1 -- 172.21.15.82:0/1027936462 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f577804fb30 con 0x7f579015f1f0 2023-11-28T13:03:05.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.676+0000 7f578ffff700 1 -- 172.21.15.82:0/1027936462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5790065fc0 con 0x7f579015f1f0 2023-11-28T13:03:05.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.680+0000 7f5787fff700 1 -- 172.21.15.82:0/1027936462 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+17883 (secure 0 0 0) 0x7f57780094e0 con 0x7f579015f1f0 2023-11-28T13:03:05.685 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:05.685 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":51,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:02:21.459082+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:02:19.012136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T13:02:19.431685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:03:05.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.684+0000 7f578ffff700 1 -- 172.21.15.82:0/1027936462 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5770064f10 msgr2=0x7f57700673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:05.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.684+0000 7f578ffff700 1 --2- 172.21.15.82:0/1027936462 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5770064f10 0x7f57700673c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f57900c4fe0 tx=0x7f5780009040 comp rx=0 tx=0).stop 2023-11-28T13:03:05.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.684+0000 7f578ffff700 1 -- 172.21.15.82:0/1027936462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f579015f1f0 msgr2=0x7f57900b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:05.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.684+0000 7f578ffff700 1 --2- 172.21.15.82:0/1027936462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f579015f1f0 0x7f57900b3df0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f577800e760 tx=0x7f577800eb20 comp rx=0 tx=0).stop 2023-11-28T13:03:05.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.684+0000 7f578ffff700 1 -- 172.21.15.82:0/1027936462 shutdown_connections 2023-11-28T13:03:05.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.684+0000 7f578ffff700 1 --2- 172.21.15.82:0/1027936462 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5770064f10 0x7f57700673c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.684+0000 7f578ffff700 1 --2- 172.21.15.82:0/1027936462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57900c4300 0x7f57900c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.684+0000 7f578ffff700 1 --2- 172.21.15.82:0/1027936462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f579015f1f0 0x7f57900b3df0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.684+0000 7f578ffff700 1 --2- 172.21.15.82:0/1027936462 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5790070070 0x7f57900c0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.684+0000 7f578ffff700 1 -- 172.21.15.82:0/1027936462 >> 172.21.15.82:0/1027936462 conn(0x7f57900ce600 msgr2=0x7f5790070440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:05.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.684+0000 7f578ffff700 1 -- 172.21.15.82:0/1027936462 shutdown_connections 2023-11-28T13:03:05.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.684+0000 7f578ffff700 1 -- 172.21.15.82:0/1027936462 wait complete. 2023-11-28T13:03:05.700 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T13:02:19.012136+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T13:02:19.431685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:03:05.700 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:03:05.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.820+0000 7f36fa10b700 1 Processor -- start 2023-11-28T13:03:05.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.820+0000 7f36fa10b700 1 -- start start 2023-11-28T13:03:05.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.820+0000 7f36fa10b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f36f4150ee0 0x7f36f4070120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:05.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.820+0000 7f36fa10b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f36f40ad8b0 0x7f36f40add10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:05.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.820+0000 7f36fa10b700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f40ae250 con 0x7f36f4070660 2023-11-28T13:03:05.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.820+0000 7f36fa10b700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f4069bc0 con 0x7f36f40ad8b0 2023-11-28T13:03:05.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.820+0000 7f36fa10b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f4069e80 con 0x7f36f4150ee0 2023-11-28T13:03:05.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.820+0000 7f36f990a700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f36f40ad8b0 0x7f36f40add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:05.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.820+0000 7f36f9109700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f36f4150ee0 0x7f36f4070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:05.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.820+0000 7f36f990a700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f36f40ad8b0 0x7f36f40add10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:40092/0 (socket says 172.21.15.82:40092) 2023-11-28T13:03:05.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.820+0000 7f36f8908700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f36f4070660 0x7f36f406ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:41748/0 (socket says 172.21.15.82:41748) 2023-11-28T13:03:05.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.820+0000 7f36f9109700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f36f4150ee0 0x7f36f4070120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:44080/0 (socket says 172.21.15.82:44080) 2023-11-28T13:03:05.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.820+0000 7f36f990a700 1 -- 172.21.15.82:0/3149246274 learned_addr learned my addr 172.21.15.82:0/3149246274 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:05.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.820+0000 7f36f990a700 1 -- 172.21.15.82:0/3149246274 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f36f4150ee0 msgr2=0x7f36f4070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:05.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.820+0000 7f36f990a700 1 --2- 172.21.15.82:0/3149246274 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f36f4150ee0 0x7f36f4070120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.820+0000 7f36f990a700 1 -- 172.21.15.82:0/3149246274 >> v1:172.21.15.114:6789/0 conn(0x7f36f4070660 legacy=0x7f36f406ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:05.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.820+0000 7f36f990a700 1 -- 172.21.15.82:0/3149246274 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f406a160 con 0x7f36f40ad8b0 2023-11-28T13:03:05.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.820+0000 7f36f990a700 1 --2- 172.21.15.82:0/3149246274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36f40ad8b0 0x7f36f40add10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009e50 tx=0x7f36ec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b52ca99239b1c2e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:05.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.824+0000 7f36ebfff700 1 -- 172.21.15.82:0/3149246274 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec00e070 con 0x7f36f40ad8b0 2023-11-28T13:03:05.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.824+0000 7f36ebfff700 1 -- 172.21.15.82:0/3149246274 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec00b910 con 0x7f36f40ad8b0 2023-11-28T13:03:05.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.824+0000 7f36ebfff700 1 -- 172.21.15.82:0/3149246274 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec00bcc0 con 0x7f36f40ad8b0 2023-11-28T13:03:05.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.824+0000 7f36fa10b700 1 -- 172.21.15.82:0/3149246274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36f40ad8b0 msgr2=0x7f36f40add10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:05.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.824+0000 7f36fa10b700 1 --2- 172.21.15.82:0/3149246274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36f40ad8b0 0x7f36f40add10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009e50 tx=0x7f36ec00b330 comp rx=0 tx=0).stop 2023-11-28T13:03:05.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.824+0000 7f36fa10b700 1 -- 172.21.15.82:0/3149246274 shutdown_connections 2023-11-28T13:03:05.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.824+0000 7f36fa10b700 1 --2- 172.21.15.82:0/3149246274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36f40ad8b0 0x7f36f40add10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.824+0000 7f36fa10b700 1 --2- 172.21.15.82:0/3149246274 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f36f4150ee0 0x7f36f4070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.824+0000 7f36fa10b700 1 -- 172.21.15.82:0/3149246274 >> 172.21.15.82:0/3149246274 conn(0x7f36f40ce630 msgr2=0x7f36f40cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:05.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.824+0000 7f36fa10b700 1 -- 172.21.15.82:0/3149246274 shutdown_connections 2023-11-28T13:03:05.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.824+0000 7f36fa10b700 1 -- 172.21.15.82:0/3149246274 wait complete. 2023-11-28T13:03:05.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.824+0000 7f36fa10b700 1 Processor -- start 2023-11-28T13:03:05.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.824+0000 7f36fa10b700 1 -- start start 2023-11-28T13:03:05.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36fa10b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36f4070660 0x7f36f4141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:05.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36fa10b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f36f40ad8b0 0x7f36f4155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:05.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36fa10b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36f4150ee0 0x7f36f4156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:05.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36fa10b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f4156750 con 0x7f36f4070660 2023-11-28T13:03:05.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36fa10b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f4156a30 con 0x7f36f4150ee0 2023-11-28T13:03:05.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36fa10b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f4156d10 con 0x7f36f40ad8b0 2023-11-28T13:03:05.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36f9109700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36f4070660 0x7f36f4141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:05.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36f9109700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36f4070660 0x7f36f4141cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34714/0 (socket says 172.21.15.82:34714) 2023-11-28T13:03:05.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36f9109700 1 -- 172.21.15.82:0/3253129794 learned_addr learned my addr 172.21.15.82:0/3253129794 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:05.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36f8908700 1 --2- 172.21.15.82:0/3253129794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f36f40ad8b0 0x7f36f4155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:05.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36f990a700 1 --2- 172.21.15.82:0/3253129794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36f4150ee0 0x7f36f4156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:05.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36f9109700 1 -- 172.21.15.82:0/3253129794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f36f40ad8b0 msgr2=0x7f36f4155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:05.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36f9109700 1 --2- 172.21.15.82:0/3253129794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f36f40ad8b0 0x7f36f4155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36f9109700 1 -- 172.21.15.82:0/3253129794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36f4150ee0 msgr2=0x7f36f4156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:05.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36f9109700 1 --2- 172.21.15.82:0/3253129794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36f4150ee0 0x7f36f4156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:05.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36f9109700 1 -- 172.21.15.82:0/3253129794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ec009b30 con 0x7f36f4070660 2023-11-28T13:03:05.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36f9109700 1 --2- 172.21.15.82:0/3253129794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36f4070660 0x7f36f4141cd0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f36f000e840 tx=0x7f36f000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:05.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36e9ffb700 1 -- 172.21.15.82:0/3253129794 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f00095a0 con 0x7f36f4070660 2023-11-28T13:03:05.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36e9ffb700 1 -- 172.21.15.82:0/3253129794 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f0013680 con 0x7f36f4070660 2023-11-28T13:03:05.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36fa10b700 1 -- 172.21.15.82:0/3253129794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f406a720 con 0x7f36f4070660 2023-11-28T13:03:05.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36e9ffb700 1 -- 172.21.15.82:0/3253129794 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f00139f0 con 0x7f36f4070660 2023-11-28T13:03:05.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.828+0000 7f36fa10b700 1 -- 172.21.15.82:0/3253129794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f406a440 con 0x7f36f4070660 2023-11-28T13:03:05.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.832+0000 7f36fa10b700 1 -- 172.21.15.82:0/3253129794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f406b350 con 0x7f36f4070660 2023-11-28T13:03:05.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.832+0000 7f36e9ffb700 1 -- 172.21.15.82:0/3253129794 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f36f0019030 con 0x7f36f4070660 2023-11-28T13:03:05.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.832+0000 7f36e9ffb700 1 --2- 172.21.15.82:0/3253129794 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f36d8064ee0 0x7f36d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:05.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.832+0000 7f36e9ffb700 1 -- 172.21.15.82:0/3253129794 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f36f0081c80 con 0x7f36f4070660 2023-11-28T13:03:05.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.832+0000 7f36f8908700 1 --2- 172.21.15.82:0/3253129794 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f36d8064ee0 0x7f36d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:05.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.832+0000 7f36f8908700 1 --2- 172.21.15.82:0/3253129794 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f36d8064ee0 0x7f36d8067390 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f36e4000f60 tx=0x7f36e4007eb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:05.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:05.840+0000 7f36e9ffb700 1 -- 172.21.15.82:0/3253129794 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f36f004fd30 con 0x7f36f4070660 2023-11-28T13:03:06.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.004+0000 7f36fa10b700 1 -- 172.21.15.82:0/3253129794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36f4065fc0 con 0x7f36f4070660 2023-11-28T13:03:06.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.004+0000 7f36e9ffb700 1 -- 172.21.15.82:0/3253129794 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f36f0017020 con 0x7f36f4070660 2023-11-28T13:03:06.008 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:03:06.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.004+0000 7f36fa10b700 1 -- 172.21.15.82:0/3253129794 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f36d8064ee0 msgr2=0x7f36d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:06.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.004+0000 7f36fa10b700 1 --2- 172.21.15.82:0/3253129794 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f36d8064ee0 0x7f36d8067390 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f36e4000f60 tx=0x7f36e4007eb0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.004+0000 7f36fa10b700 1 -- 172.21.15.82:0/3253129794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36f4070660 msgr2=0x7f36f4141cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:06.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.004+0000 7f36fa10b700 1 --2- 172.21.15.82:0/3253129794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36f4070660 0x7f36f4141cd0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f36f000e840 tx=0x7f36f000eb50 comp rx=0 tx=0).stop 2023-11-28T13:03:06.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.004+0000 7f36fa10b700 1 -- 172.21.15.82:0/3253129794 shutdown_connections 2023-11-28T13:03:06.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.004+0000 7f36fa10b700 1 --2- 172.21.15.82:0/3253129794 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f36d8064ee0 0x7f36d8067390 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.004+0000 7f36fa10b700 1 --2- 172.21.15.82:0/3253129794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36f4150ee0 0x7f36f4156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.008+0000 7f36fa10b700 1 --2- 172.21.15.82:0/3253129794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f36f40ad8b0 0x7f36f4155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.008+0000 7f36fa10b700 1 --2- 172.21.15.82:0/3253129794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36f4070660 0x7f36f4141cd0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.008+0000 7f36fa10b700 1 -- 172.21.15.82:0/3253129794 >> 172.21.15.82:0/3253129794 conn(0x7f36f40ce630 msgr2=0x7f36f415c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:06.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.008+0000 7f36fa10b700 1 -- 172.21.15.82:0/3253129794 shutdown_connections 2023-11-28T13:03:06.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.008+0000 7f36fa10b700 1 -- 172.21.15.82:0/3253129794 wait complete. 2023-11-28T13:03:06.023 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:03:06.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.132+0000 7fe1e66f0700 1 Processor -- start 2023-11-28T13:03:06.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.132+0000 7fe1e66f0700 1 -- start start 2023-11-28T13:03:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.136+0000 7fe1e66f0700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1e00cba10 0x7fe1e00ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.136+0000 7fe1e66f0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe1e00ce2d0 0x7fe1e00ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.136+0000 7fe1e66f0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e015a4b0 con 0x7fe1e0071110 2023-11-28T13:03:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.136+0000 7fe1e66f0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e0159930 con 0x7fe1e00ce2d0 2023-11-28T13:03:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.136+0000 7fe1e66f0700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e0159c10 con 0x7fe1e00cba10 2023-11-28T13:03:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.136+0000 7fe1e5eef700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe1e0071110 0x7fe1e015ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54394/0 (socket says 172.21.15.82:54394) 2023-11-28T13:03:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.136+0000 7fe1e5eef700 1 -- 172.21.15.82:0/50450615 learned_addr learned my addr 172.21.15.82:0/50450615 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.136+0000 7fe1e4eed700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe1e00ce2d0 0x7fe1e00ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.136+0000 7fe1e56ee700 1 --2- 172.21.15.82:0/50450615 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1e00cba10 0x7fe1e00ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.136+0000 7fe1d7fff700 1 -- 172.21.15.82:0/50450615 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926943677 0 0) 0x7fe1e015a4b0 con 0x7fe1e0071110 2023-11-28T13:03:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.136+0000 7fe1d7fff700 1 -- 172.21.15.82:0/50450615 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1cc0035d0 con 0x7fe1e0071110 2023-11-28T13:03:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.136+0000 7fe1e4eed700 1 -- 172.21.15.82:0/50450615 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1e00cba10 msgr2=0x7fe1e00ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.136+0000 7fe1e4eed700 1 --2- 172.21.15.82:0/50450615 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1e00cba10 0x7fe1e00ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.136+0000 7fe1e4eed700 1 -- 172.21.15.82:0/50450615 >> v1:172.21.15.82:6789/0 conn(0x7fe1e0071110 legacy=0x7fe1e015ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.136+0000 7fe1e4eed700 1 -- 172.21.15.82:0/50450615 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e0159ef0 con 0x7fe1e00ce2d0 2023-11-28T13:03:06.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.136+0000 7fe1e4eed700 1 --2- 172.21.15.82:0/50450615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1e00ce2d0 0x7fe1e00ce740 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009850 tx=0x7fe1d0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbdc695b57d9d4d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:06.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.136+0000 7fe1d7fff700 1 -- 172.21.15.82:0/50450615 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0011830 con 0x7fe1e00ce2d0 2023-11-28T13:03:06.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.136+0000 7fe1d7fff700 1 -- 172.21.15.82:0/50450615 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d0011990 con 0x7fe1e00ce2d0 2023-11-28T13:03:06.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.136+0000 7fe1d7fff700 1 -- 172.21.15.82:0/50450615 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0011d40 con 0x7fe1e00ce2d0 2023-11-28T13:03:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.136+0000 7fe1e66f0700 1 -- 172.21.15.82:0/50450615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1e00ce2d0 msgr2=0x7fe1e00ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.136+0000 7fe1e66f0700 1 --2- 172.21.15.82:0/50450615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1e00ce2d0 0x7fe1e00ce740 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009850 tx=0x7fe1d0009b60 comp rx=0 tx=0).stop 2023-11-28T13:03:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.140+0000 7fe1e66f0700 1 -- 172.21.15.82:0/50450615 shutdown_connections 2023-11-28T13:03:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.140+0000 7fe1e66f0700 1 --2- 172.21.15.82:0/50450615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1e00ce2d0 0x7fe1e00ce740 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.140+0000 7fe1e66f0700 1 --2- 172.21.15.82:0/50450615 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1e00cba10 0x7fe1e00ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.140+0000 7fe1e66f0700 1 -- 172.21.15.82:0/50450615 >> 172.21.15.82:0/50450615 conn(0x7fe1e00b1f50 msgr2=0x7fe1e00cf790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.140+0000 7fe1e66f0700 1 -- 172.21.15.82:0/50450615 shutdown_connections 2023-11-28T13:03:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.140+0000 7fe1e66f0700 1 -- 172.21.15.82:0/50450615 wait complete. 2023-11-28T13:03:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.140+0000 7fe1e66f0700 1 Processor -- start 2023-11-28T13:03:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.140+0000 7fe1e66f0700 1 -- start start 2023-11-28T13:03:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1e66f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1e0071110 0x7fe1e00c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1e66f0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1e00cba10 0x7fe1e00b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1e66f0700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1e00ce2d0 0x7fe1e00c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1e66f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e015c530 con 0x7fe1e0071110 2023-11-28T13:03:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1e66f0700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e00c6f60 con 0x7fe1e00cba10 2023-11-28T13:03:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1e66f0700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e00c7240 con 0x7fe1e00ce2d0 2023-11-28T13:03:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1e56ee700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1e0071110 0x7fe1e00c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1e56ee700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1e0071110 0x7fe1e00c6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34744/0 (socket says 172.21.15.82:34744) 2023-11-28T13:03:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1e56ee700 1 -- 172.21.15.82:0/814204240 learned_addr learned my addr 172.21.15.82:0/814204240 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1e5eef700 1 --2- 172.21.15.82:0/814204240 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1e00ce2d0 0x7fe1e00c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1e4eed700 1 --2- 172.21.15.82:0/814204240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1e00cba10 0x7fe1e00b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1e56ee700 1 -- 172.21.15.82:0/814204240 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1e00ce2d0 msgr2=0x7fe1e00c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1e56ee700 1 --2- 172.21.15.82:0/814204240 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1e00ce2d0 0x7fe1e00c8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1e56ee700 1 -- 172.21.15.82:0/814204240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1e00cba10 msgr2=0x7fe1e00b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1e56ee700 1 --2- 172.21.15.82:0/814204240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1e00cba10 0x7fe1e00b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1e56ee700 1 -- 172.21.15.82:0/814204240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d00094b0 con 0x7fe1e0071110 2023-11-28T13:03:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1e4eed700 1 --2- 172.21.15.82:0/814204240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1e00cba10 0x7fe1e00b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:03:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1e5eef700 1 --2- 172.21.15.82:0/814204240 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1e00ce2d0 0x7fe1e00c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:03:06.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1e56ee700 1 --2- 172.21.15.82:0/814204240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1e0071110 0x7fe1e00c6860 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00e9d0 tx=0x7fe1dc00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:06.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1d5ffb700 1 -- 172.21.15.82:0/814204240 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc009720 con 0x7fe1e0071110 2023-11-28T13:03:06.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1d5ffb700 1 -- 172.21.15.82:0/814204240 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc00c850 con 0x7fe1e0071110 2023-11-28T13:03:06.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1e66f0700 1 -- 172.21.15.82:0/814204240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e00cac00 con 0x7fe1e0071110 2023-11-28T13:03:06.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1d5ffb700 1 -- 172.21.15.82:0/814204240 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc00cbc0 con 0x7fe1e0071110 2023-11-28T13:03:06.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.144+0000 7fe1e66f0700 1 -- 172.21.15.82:0/814204240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e015a1d0 con 0x7fe1e0071110 2023-11-28T13:03:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.148+0000 7fe1e66f0700 1 -- 172.21.15.82:0/814204240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e01594e0 con 0x7fe1e0071110 2023-11-28T13:03:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.148+0000 7fe1d5ffb700 1 -- 172.21.15.82:0/814204240 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe1dc019030 con 0x7fe1e0071110 2023-11-28T13:03:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.148+0000 7fe1d5ffb700 1 --2- 172.21.15.82:0/814204240 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe1c4064ee0 0x7fe1c4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:06.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.148+0000 7fe1e4eed700 1 --2- 172.21.15.82:0/814204240 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe1c4064ee0 0x7fe1c4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:06.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.148+0000 7fe1d5ffb700 1 -- 172.21.15.82:0/814204240 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe1dc081fb0 con 0x7fe1e0071110 2023-11-28T13:03:06.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.148+0000 7fe1e4eed700 1 --2- 172.21.15.82:0/814204240 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe1c4064ee0 0x7fe1c4067390 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00ae5e0 tx=0x7fe1d0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:06.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.152+0000 7fe1d5ffb700 1 -- 172.21.15.82:0/814204240 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe1dc050060 con 0x7fe1e0071110 2023-11-28T13:03:06.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.316+0000 7fe1e66f0700 1 -- 172.21.15.82:0/814204240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe1e0065fc0 con 0x7fe1e0071110 2023-11-28T13:03:06.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.316+0000 7fe1d5ffb700 1 -- 172.21.15.82:0/814204240 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v51) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe1dc053680 con 0x7fe1e0071110 2023-11-28T13:03:06.322 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:03:06.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.320+0000 7fe1e66f0700 1 -- 172.21.15.82:0/814204240 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe1c4064ee0 msgr2=0x7fe1c4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:06.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.320+0000 7fe1e66f0700 1 --2- 172.21.15.82:0/814204240 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe1c4064ee0 0x7fe1c4067390 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00ae5e0 tx=0x7fe1d0008030 comp rx=0 tx=0).stop 2023-11-28T13:03:06.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.320+0000 7fe1e66f0700 1 -- 172.21.15.82:0/814204240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1e0071110 msgr2=0x7fe1e00c6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:06.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.320+0000 7fe1e66f0700 1 --2- 172.21.15.82:0/814204240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1e0071110 0x7fe1e00c6860 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00e9d0 tx=0x7fe1dc00ed90 comp rx=0 tx=0).stop 2023-11-28T13:03:06.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.320+0000 7fe1e66f0700 1 -- 172.21.15.82:0/814204240 shutdown_connections 2023-11-28T13:03:06.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.320+0000 7fe1e66f0700 1 --2- 172.21.15.82:0/814204240 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe1c4064ee0 0x7fe1c4067390 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.320+0000 7fe1e66f0700 1 --2- 172.21.15.82:0/814204240 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1e00ce2d0 0x7fe1e00c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.320+0000 7fe1e66f0700 1 --2- 172.21.15.82:0/814204240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1e00cba10 0x7fe1e00b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.320+0000 7fe1e66f0700 1 --2- 172.21.15.82:0/814204240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1e0071110 0x7fe1e00c6860 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.320+0000 7fe1e66f0700 1 -- 172.21.15.82:0/814204240 >> 172.21.15.82:0/814204240 conn(0x7fe1e00b1f50 msgr2=0x7fe1e00ce6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:06.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.320+0000 7fe1e66f0700 1 -- 172.21.15.82:0/814204240 shutdown_connections 2023-11-28T13:03:06.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.320+0000 7fe1e66f0700 1 -- 172.21.15.82:0/814204240 wait complete. 2023-11-28T13:03:06.337 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T13:03:06.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.452+0000 7f752bfff700 1 Processor -- start 2023-11-28T13:03:06.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.452+0000 7f752bfff700 1 -- start start 2023-11-28T13:03:06.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.452+0000 7f752bfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f752c0b1f30 0x7f752c0d2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:06.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.452+0000 7f752bfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f752c06ba30 0x7f752c06be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:06.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.452+0000 7f752bfff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752c0d1050 con 0x7f752c069bc0 2023-11-28T13:03:06.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.452+0000 7f752bfff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752c0b2300 con 0x7f752c0b1f30 2023-11-28T13:03:06.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.452+0000 7f752bfff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c06c3a0 con 0x7f752c06ba30 2023-11-28T13:03:06.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.452+0000 7f752b7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f752c069bc0 0x7f752c06a040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54400/0 (socket says 172.21.15.82:54400) 2023-11-28T13:03:06.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.452+0000 7f752b7fe700 1 -- 172.21.15.82:0/2622158486 learned_addr learned my addr 172.21.15.82:0/2622158486 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:06.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.452+0000 7f752a7fc700 1 --2- 172.21.15.82:0/2622158486 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f752c06ba30 0x7f752c06be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:06.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.452+0000 7f752affd700 1 --2- 172.21.15.82:0/2622158486 >> v2:172.21.15.114:3300/0 conn(0x7f752c0b1f30 0x7f752c0d2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:06.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.452+0000 7f7529ffb700 1 -- 172.21.15.82:0/2622158486 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299920276 0 0) 0x7f752c0d1050 con 0x7f752c069bc0 2023-11-28T13:03:06.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.452+0000 7f7529ffb700 1 -- 172.21.15.82:0/2622158486 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f750c0035d0 con 0x7f752c069bc0 2023-11-28T13:03:06.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.452+0000 7f7529ffb700 1 -- 172.21.15.82:0/2622158486 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4008628808 0 0) 0x7f750c0035d0 con 0x7f752c069bc0 2023-11-28T13:03:06.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.452+0000 7f752a7fc700 1 -- 172.21.15.82:0/2622158486 >> v2:172.21.15.114:3300/0 conn(0x7f752c0b1f30 msgr2=0x7f752c0d2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:06.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.452+0000 7f752a7fc700 1 --2- 172.21.15.82:0/2622158486 >> v2:172.21.15.114:3300/0 conn(0x7f752c0b1f30 0x7f752c0d2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.452+0000 7f752a7fc700 1 -- 172.21.15.82:0/2622158486 >> v1:172.21.15.82:6789/0 conn(0x7f752c069bc0 legacy=0x7f752c06a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:06.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.452+0000 7f752a7fc700 1 -- 172.21.15.82:0/2622158486 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c0cd0c0 con 0x7f752c06ba30 2023-11-28T13:03:06.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.456+0000 7f752a7fc700 1 --2- 172.21.15.82:0/2622158486 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f752c06ba30 0x7f752c06be60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7514009850 tx=0x7f7514009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6d39dcbc2ee1bc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:06.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.456+0000 7f7529ffb700 1 -- 172.21.15.82:0/2622158486 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75240019f0 con 0x7f752c06ba30 2023-11-28T13:03:06.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.456+0000 7f7529ffb700 1 -- 172.21.15.82:0/2622158486 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7514004030 con 0x7f752c06ba30 2023-11-28T13:03:06.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.456+0000 7f7529ffb700 1 -- 172.21.15.82:0/2622158486 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75140043a0 con 0x7f752c06ba30 2023-11-28T13:03:06.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.456+0000 7f752bfff700 1 -- 172.21.15.82:0/2622158486 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f752c06ba30 msgr2=0x7f752c06be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:06.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.456+0000 7f752bfff700 1 --2- 172.21.15.82:0/2622158486 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f752c06ba30 0x7f752c06be60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7514009850 tx=0x7f7514009b60 comp rx=0 tx=0).stop 2023-11-28T13:03:06.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.456+0000 7f752bfff700 1 -- 172.21.15.82:0/2622158486 shutdown_connections 2023-11-28T13:03:06.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.456+0000 7f752bfff700 1 --2- 172.21.15.82:0/2622158486 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f752c06ba30 0x7f752c06be60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.456+0000 7f752bfff700 1 --2- 172.21.15.82:0/2622158486 >> v2:172.21.15.114:3300/0 conn(0x7f752c0b1f30 0x7f752c0d2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.456+0000 7f752bfff700 1 -- 172.21.15.82:0/2622158486 >> 172.21.15.82:0/2622158486 conn(0x7f752c0b52d0 msgr2=0x7f752c0d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:06.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.456+0000 7f752bfff700 1 -- 172.21.15.82:0/2622158486 shutdown_connections 2023-11-28T13:03:06.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.456+0000 7f752bfff700 1 -- 172.21.15.82:0/2622158486 wait complete. 2023-11-28T13:03:06.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.456+0000 7f752bfff700 1 Processor -- start 2023-11-28T13:03:06.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.456+0000 7f752bfff700 1 -- start start 2023-11-28T13:03:06.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f752bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f752c069bc0 0x7f752c0b0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:06.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f752bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f752c06ba30 0x7f752c0b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:06.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f752bfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f752c0b1f30 0x7f752c0b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:06.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f752bfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c0b1460 con 0x7f752c069bc0 2023-11-28T13:03:06.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f752bfff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c0b7ed0 con 0x7f752c06ba30 2023-11-28T13:03:06.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f752bfff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c0cb250 con 0x7f752c0b1f30 2023-11-28T13:03:06.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f752affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f752c069bc0 0x7f752c0b0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:06.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f752affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f752c069bc0 0x7f752c0b0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34754/0 (socket says 172.21.15.82:34754) 2023-11-28T13:03:06.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f752affd700 1 -- 172.21.15.82:0/700918673 learned_addr learned my addr 172.21.15.82:0/700918673 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:06.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f752b7fe700 1 --2- 172.21.15.82:0/700918673 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f752c0b1f30 0x7f752c0b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:06.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f752a7fc700 1 --2- 172.21.15.82:0/700918673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f752c06ba30 0x7f752c0b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:06.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f752affd700 1 -- 172.21.15.82:0/700918673 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f752c0b1f30 msgr2=0x7f752c0b6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:06.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f752affd700 1 --2- 172.21.15.82:0/700918673 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f752c0b1f30 0x7f752c0b6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f752affd700 1 -- 172.21.15.82:0/700918673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f752c06ba30 msgr2=0x7f752c0b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:06.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f752affd700 1 --2- 172.21.15.82:0/700918673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f752c06ba30 0x7f752c0b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f752affd700 1 -- 172.21.15.82:0/700918673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75140094b0 con 0x7f752c069bc0 2023-11-28T13:03:06.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f752affd700 1 --2- 172.21.15.82:0/700918673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f752c069bc0 0x7f752c0b0f20 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f751c00e9d0 tx=0x7f751c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:06.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f7523fff700 1 -- 172.21.15.82:0/700918673 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c009720 con 0x7f752c069bc0 2023-11-28T13:03:06.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f7523fff700 1 -- 172.21.15.82:0/700918673 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c00ee70 con 0x7f752c069bc0 2023-11-28T13:03:06.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f752bfff700 1 -- 172.21.15.82:0/700918673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752c0d1580 con 0x7f752c069bc0 2023-11-28T13:03:06.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f7523fff700 1 -- 172.21.15.82:0/700918673 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c00ca50 con 0x7f752c069bc0 2023-11-28T13:03:06.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.460+0000 7f752bfff700 1 -- 172.21.15.82:0/700918673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752c0d12a0 con 0x7f752c069bc0 2023-11-28T13:03:06.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.464+0000 7f7523fff700 1 -- 172.21.15.82:0/700918673 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f751c019030 con 0x7f752c069bc0 2023-11-28T13:03:06.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.464+0000 7f752bfff700 1 -- 172.21.15.82:0/700918673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752c0cd380 con 0x7f752c069bc0 2023-11-28T13:03:06.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.464+0000 7f7523fff700 1 --2- 172.21.15.82:0/700918673 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7510064ee0 0x7f7510067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:06.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.464+0000 7f752a7fc700 1 --2- 172.21.15.82:0/700918673 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7510064ee0 0x7f7510067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:06.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.464+0000 7f7523fff700 1 -- 172.21.15.82:0/700918673 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f751c081dc0 con 0x7f752c069bc0 2023-11-28T13:03:06.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.464+0000 7f752a7fc700 1 --2- 172.21.15.82:0/700918673 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7510064ee0 0x7f7510067390 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f75140090b0 tx=0x7f7514008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:06.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.472+0000 7f7523fff700 1 -- 172.21.15.82:0/700918673 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f751c04fee0 con 0x7f752c069bc0 2023-11-28T13:03:06.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.632+0000 7f752bfff700 1 -- 172.21.15.82:0/700918673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f752c065fc0 con 0x7f752c069bc0 2023-11-28T13:03:06.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.632+0000 7f7523fff700 1 -- 172.21.15.82:0/700918673 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7f751c053500 con 0x7f752c069bc0 2023-11-28T13:03:06.636 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-11-28T13:03:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.636+0000 7f752bfff700 1 -- 172.21.15.82:0/700918673 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7510064ee0 msgr2=0x7f7510067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.636+0000 7f752bfff700 1 --2- 172.21.15.82:0/700918673 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7510064ee0 0x7f7510067390 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f75140090b0 tx=0x7f7514008030 comp rx=0 tx=0).stop 2023-11-28T13:03:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.636+0000 7f752bfff700 1 -- 172.21.15.82:0/700918673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f752c069bc0 msgr2=0x7f752c0b0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.636+0000 7f752bfff700 1 --2- 172.21.15.82:0/700918673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f752c069bc0 0x7f752c0b0f20 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f751c00e9d0 tx=0x7f751c00ece0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.636+0000 7f752bfff700 1 -- 172.21.15.82:0/700918673 shutdown_connections 2023-11-28T13:03:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.636+0000 7f752bfff700 1 --2- 172.21.15.82:0/700918673 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7510064ee0 0x7f7510067390 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.636+0000 7f752bfff700 1 --2- 172.21.15.82:0/700918673 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f752c0b1f30 0x7f752c0b6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.636+0000 7f752bfff700 1 --2- 172.21.15.82:0/700918673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f752c06ba30 0x7f752c0b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.636+0000 7f752bfff700 1 --2- 172.21.15.82:0/700918673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f752c069bc0 0x7f752c0b0f20 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.636+0000 7f752bfff700 1 -- 172.21.15.82:0/700918673 >> 172.21.15.82:0/700918673 conn(0x7f752c0b52d0 msgr2=0x7f752c0b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.636+0000 7f752bfff700 1 -- 172.21.15.82:0/700918673 shutdown_connections 2023-11-28T13:03:06.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.636+0000 7f752bfff700 1 -- 172.21.15.82:0/700918673 wait complete. 2023-11-28T13:03:06.656 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T13:03:06.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.764+0000 7fb84b59e700 1 Processor -- start 2023-11-28T13:03:06.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.764+0000 7fb84b59e700 1 -- start start 2023-11-28T13:03:06.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84b59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb84c0b1d10 0x7fb84c0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:06.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84b59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb84c06c140 0x7fb84c06a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:06.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84b59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb84c069bc0 con 0x7fb84c0d25b0 2023-11-28T13:03:06.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84b59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84c0d1480 con 0x7fb84c06c140 2023-11-28T13:03:06.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84b59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84c0cd280 con 0x7fb84c0b1d10 2023-11-28T13:03:06.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84ad9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb84c06c140 0x7fb84c06a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:06.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb849d9b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb84c0d25b0 0x7fb84c06ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39922/0 (socket says 172.21.15.82:39922) 2023-11-28T13:03:06.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84ad9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb84c06c140 0x7fb84c06a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41656/0 (socket says 172.21.15.82:41656) 2023-11-28T13:03:06.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb849d9b700 1 -- 172.21.15.82:0/1602714027 learned_addr learned my addr 172.21.15.82:0/1602714027 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:06.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84a59c700 1 --2- 172.21.15.82:0/1602714027 >> v2:172.21.15.114:3300/0 conn(0x7fb84c0b1d10 0x7fb84c0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:06.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84ad9d700 1 -- 172.21.15.82:0/1602714027 >> v2:172.21.15.114:3300/0 conn(0x7fb84c0b1d10 msgr2=0x7fb84c0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:06.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84ad9d700 1 --2- 172.21.15.82:0/1602714027 >> v2:172.21.15.114:3300/0 conn(0x7fb84c0b1d10 0x7fb84c0cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84959a700 1 -- 172.21.15.82:0/1602714027 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649848756 0 0) 0x7fb84c069bc0 con 0x7fb84c0d25b0 2023-11-28T13:03:06.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84ad9d700 1 -- 172.21.15.82:0/1602714027 >> v1:172.21.15.82:6789/0 conn(0x7fb84c0d25b0 legacy=0x7fb84c06ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:06.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84ad9d700 1 -- 172.21.15.82:0/1602714027 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c0cd560 con 0x7fb84c06c140 2023-11-28T13:03:06.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84ad9d700 1 --2- 172.21.15.82:0/1602714027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb84c06c140 0x7fb84c06a050 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb84c08bb10 tx=0x7fb84400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec109f1abe41727 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:06.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84959a700 1 -- 172.21.15.82:0/1602714027 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84400e070 con 0x7fb84c06c140 2023-11-28T13:03:06.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84959a700 1 -- 172.21.15.82:0/1602714027 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84400bb20 con 0x7fb84c06c140 2023-11-28T13:03:06.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84959a700 1 -- 172.21.15.82:0/1602714027 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844012430 con 0x7fb84c06c140 2023-11-28T13:03:06.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84b59e700 1 -- 172.21.15.82:0/1602714027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb84c06c140 msgr2=0x7fb84c06a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:06.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84b59e700 1 --2- 172.21.15.82:0/1602714027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb84c06c140 0x7fb84c06a050 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb84c08bb10 tx=0x7fb84400b330 comp rx=0 tx=0).stop 2023-11-28T13:03:06.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84b59e700 1 -- 172.21.15.82:0/1602714027 shutdown_connections 2023-11-28T13:03:06.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84b59e700 1 --2- 172.21.15.82:0/1602714027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb84c06c140 0x7fb84c06a050 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84b59e700 1 --2- 172.21.15.82:0/1602714027 >> v2:172.21.15.114:3300/0 conn(0x7fb84c0b1d10 0x7fb84c0cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84b59e700 1 -- 172.21.15.82:0/1602714027 >> 172.21.15.82:0/1602714027 conn(0x7fb84c0b52a0 msgr2=0x7fb84c0d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:06.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84b59e700 1 -- 172.21.15.82:0/1602714027 shutdown_connections 2023-11-28T13:03:06.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.768+0000 7fb84b59e700 1 -- 172.21.15.82:0/1602714027 wait complete. 2023-11-28T13:03:06.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.772+0000 7fb84b59e700 1 Processor -- start 2023-11-28T13:03:06.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.772+0000 7fb84b59e700 1 -- start start 2023-11-28T13:03:06.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.772+0000 7fb84b59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb84c06c140 0x7fb84c1f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:06.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.772+0000 7fb84b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb84c0b1d10 0x7fb84c0b6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:06.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.772+0000 7fb84b59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb84c0d25b0 0x7fb84c0b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:06.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.772+0000 7fb84b59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c1f18a0 con 0x7fb84c0b1d10 2023-11-28T13:03:06.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.772+0000 7fb84b59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c1f1b80 con 0x7fb84c0d25b0 2023-11-28T13:03:06.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.772+0000 7fb84b59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c1f1e60 con 0x7fb84c06c140 2023-11-28T13:03:06.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.772+0000 7fb849d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb84c0b1d10 0x7fb84c0b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:06.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.772+0000 7fb849d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb84c0b1d10 0x7fb84c0b6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41666/0 (socket says 172.21.15.82:41666) 2023-11-28T13:03:06.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.772+0000 7fb849d9b700 1 -- 172.21.15.82:0/2628954323 learned_addr learned my addr 172.21.15.82:0/2628954323 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:06.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.772+0000 7fb84a59c700 1 --2- 172.21.15.82:0/2628954323 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb84c06c140 0x7fb84c1f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:06.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.772+0000 7fb84ad9d700 1 --2- 172.21.15.82:0/2628954323 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb84c0d25b0 0x7fb84c0b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:06.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.772+0000 7fb849d9b700 1 -- 172.21.15.82:0/2628954323 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb84c06c140 msgr2=0x7fb84c1f42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:06.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.772+0000 7fb849d9b700 1 --2- 172.21.15.82:0/2628954323 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb84c06c140 0x7fb84c1f42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.772+0000 7fb849d9b700 1 -- 172.21.15.82:0/2628954323 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb84c0d25b0 msgr2=0x7fb84c0b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:06.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.772+0000 7fb849d9b700 1 --2- 172.21.15.82:0/2628954323 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb84c0d25b0 0x7fb84c0b6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.772+0000 7fb849d9b700 1 -- 172.21.15.82:0/2628954323 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb844009a70 con 0x7fb84c0b1d10 2023-11-28T13:03:06.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.772+0000 7fb849d9b700 1 --2- 172.21.15.82:0/2628954323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb84c0b1d10 0x7fb84c0b6990 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00c4a0 tx=0x7fb83c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:06.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.772+0000 7fb83affd700 1 -- 172.21.15.82:0/2628954323 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c004ca0 con 0x7fb84c0b1d10 2023-11-28T13:03:06.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.776+0000 7fb83affd700 1 -- 172.21.15.82:0/2628954323 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c004e00 con 0x7fb84c0b1d10 2023-11-28T13:03:06.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.776+0000 7fb83affd700 1 -- 172.21.15.82:0/2628954323 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c007310 con 0x7fb84c0b1d10 2023-11-28T13:03:06.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.776+0000 7fb84b59e700 1 -- 172.21.15.82:0/2628954323 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84c0d1050 con 0x7fb84c0b1d10 2023-11-28T13:03:06.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.776+0000 7fb84b59e700 1 -- 172.21.15.82:0/2628954323 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84c0b20e0 con 0x7fb84c0b1d10 2023-11-28T13:03:06.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.776+0000 7fb84b59e700 1 -- 172.21.15.82:0/2628954323 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb84c0d11e0 con 0x7fb84c0b1d10 2023-11-28T13:03:06.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.776+0000 7fb83affd700 1 -- 172.21.15.82:0/2628954323 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb83c01a020 con 0x7fb84c0b1d10 2023-11-28T13:03:06.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.776+0000 7fb83affd700 1 --2- 172.21.15.82:0/2628954323 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb82c064ee0 0x7fb82c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:06.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.776+0000 7fb83affd700 1 -- 172.21.15.82:0/2628954323 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb83c081880 con 0x7fb84c0b1d10 2023-11-28T13:03:06.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.776+0000 7fb84a59c700 1 --2- 172.21.15.82:0/2628954323 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb82c064ee0 0x7fb82c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:06.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.776+0000 7fb84a59c700 1 --2- 172.21.15.82:0/2628954323 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb82c064ee0 0x7fb82c067390 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb840009bf0 tx=0x7fb840009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:06.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.788+0000 7fb83affd700 1 -- 172.21.15.82:0/2628954323 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb83c04fa20 con 0x7fb84c0b1d10 2023-11-28T13:03:06.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.948+0000 7fb84b59e700 1 -- 172.21.15.82:0/2628954323 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb84c1f19e0 con 0x7fb84c0b1d10 2023-11-28T13:03:06.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.948+0000 7fb83affd700 1 -- 172.21.15.82:0/2628954323 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb84c1f19e0 con 0x7fb84c0b1d10 2023-11-28T13:03:06.954 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-11-28T13:03:06.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.952+0000 7fb84b59e700 1 -- 172.21.15.82:0/2628954323 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb82c064ee0 msgr2=0x7fb82c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:06.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.952+0000 7fb84b59e700 1 --2- 172.21.15.82:0/2628954323 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb82c064ee0 0x7fb82c067390 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb840009bf0 tx=0x7fb840009240 comp rx=0 tx=0).stop 2023-11-28T13:03:06.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.952+0000 7fb84b59e700 1 -- 172.21.15.82:0/2628954323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb84c0b1d10 msgr2=0x7fb84c0b6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:06.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.952+0000 7fb84b59e700 1 --2- 172.21.15.82:0/2628954323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb84c0b1d10 0x7fb84c0b6990 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00c4a0 tx=0x7fb83c00c7b0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.952+0000 7fb84b59e700 1 -- 172.21.15.82:0/2628954323 shutdown_connections 2023-11-28T13:03:06.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.952+0000 7fb84b59e700 1 --2- 172.21.15.82:0/2628954323 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb82c064ee0 0x7fb82c067390 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.952+0000 7fb84b59e700 1 --2- 172.21.15.82:0/2628954323 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb84c0d25b0 0x7fb84c0b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.952+0000 7fb84b59e700 1 --2- 172.21.15.82:0/2628954323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb84c0b1d10 0x7fb84c0b6990 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.952+0000 7fb84b59e700 1 --2- 172.21.15.82:0/2628954323 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb84c06c140 0x7fb84c1f42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:06.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.952+0000 7fb84b59e700 1 -- 172.21.15.82:0/2628954323 >> 172.21.15.82:0/2628954323 conn(0x7fb84c0b52a0 msgr2=0x7fb84c06ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:06.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.952+0000 7fb84b59e700 1 -- 172.21.15.82:0/2628954323 shutdown_connections 2023-11-28T13:03:06.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:06.952+0000 7fb84b59e700 1 -- 172.21.15.82:0/2628954323 wait complete. 2023-11-28T13:03:06.967 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T13:03:07.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.076+0000 7ff867a11700 1 Processor -- start 2023-11-28T13:03:07.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.076+0000 7ff867a11700 1 -- start start 2023-11-28T13:03:07.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.076+0000 7ff867a11700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff860070c80 0x7ff86006adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:07.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.076+0000 7ff867a11700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff86015c5b0 0x7ff86006c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:07.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.076+0000 7ff867a11700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff86006b3d0 con 0x7ff86015c1e0 2023-11-28T13:03:07.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.076+0000 7ff867a11700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff86015ffa0 con 0x7ff860070c80 2023-11-28T13:03:07.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.076+0000 7ff867a11700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff860160280 con 0x7ff86015c5b0 2023-11-28T13:03:07.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.076+0000 7ff864fac700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff860070c80 0x7ff86006adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.076+0000 7ff8657ad700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff86015c1e0 0x7ff860070570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39932/0 (socket says 172.21.15.82:39932) 2023-11-28T13:03:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.076+0000 7ff8657ad700 1 -- 172.21.15.82:0/1438106059 learned_addr learned my addr 172.21.15.82:0/1438106059 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.080+0000 7ff865fae700 1 --2- 172.21.15.82:0/1438106059 >> v2:172.21.15.114:3300/0 conn(0x7ff86015c5b0 0x7ff86006c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.080+0000 7ff864fac700 1 -- 172.21.15.82:0/1438106059 >> v2:172.21.15.114:3300/0 conn(0x7ff86015c5b0 msgr2=0x7ff86006c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.080+0000 7ff864fac700 1 --2- 172.21.15.82:0/1438106059 >> v2:172.21.15.114:3300/0 conn(0x7ff86015c5b0 0x7ff86006c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.080+0000 7ff864fac700 1 -- 172.21.15.82:0/1438106059 >> v1:172.21.15.82:6789/0 conn(0x7ff86015c1e0 legacy=0x7ff860070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.080+0000 7ff857fff700 1 -- 172.21.15.82:0/1438106059 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756415160 0 0) 0x7ff86006b3d0 con 0x7ff86015c1e0 2023-11-28T13:03:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.080+0000 7ff864fac700 1 -- 172.21.15.82:0/1438106059 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff860160560 con 0x7ff860070c80 2023-11-28T13:03:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.080+0000 7ff864fac700 1 --2- 172.21.15.82:0/1438106059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff860070c80 0x7ff86006adf0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff86015fed0 tx=0x7ff850009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe524c4e20da1133 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.080+0000 7ff857fff700 1 -- 172.21.15.82:0/1438106059 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff850011830 con 0x7ff860070c80 2023-11-28T13:03:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.080+0000 7ff857fff700 1 -- 172.21.15.82:0/1438106059 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff850011990 con 0x7ff860070c80 2023-11-28T13:03:07.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.080+0000 7ff857fff700 1 -- 172.21.15.82:0/1438106059 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff850011d20 con 0x7ff860070c80 2023-11-28T13:03:07.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.080+0000 7ff867a11700 1 -- 172.21.15.82:0/1438106059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff860070c80 msgr2=0x7ff86006adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:07.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.080+0000 7ff867a11700 1 --2- 172.21.15.82:0/1438106059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff860070c80 0x7ff86006adf0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff86015fed0 tx=0x7ff850009b30 comp rx=0 tx=0).stop 2023-11-28T13:03:07.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.080+0000 7ff867a11700 1 -- 172.21.15.82:0/1438106059 shutdown_connections 2023-11-28T13:03:07.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.080+0000 7ff867a11700 1 --2- 172.21.15.82:0/1438106059 >> v2:172.21.15.114:3300/0 conn(0x7ff86015c5b0 0x7ff86006c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:07.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.080+0000 7ff867a11700 1 --2- 172.21.15.82:0/1438106059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff860070c80 0x7ff86006adf0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:07.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.080+0000 7ff867a11700 1 -- 172.21.15.82:0/1438106059 >> 172.21.15.82:0/1438106059 conn(0x7ff8600cb700 msgr2=0x7ff8600cbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:07.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.080+0000 7ff867a11700 1 -- 172.21.15.82:0/1438106059 shutdown_connections 2023-11-28T13:03:07.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.080+0000 7ff867a11700 1 -- 172.21.15.82:0/1438106059 wait complete. 2023-11-28T13:03:07.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff867a11700 1 Processor -- start 2023-11-28T13:03:07.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff867a11700 1 -- start start 2023-11-28T13:03:07.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff867a11700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff860070c80 0x7ff86014c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:07.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff867a11700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff86015c1e0 0x7ff86015af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:07.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff867a11700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff86015c5b0 0x7ff86015b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:07.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff867a11700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff860154080 con 0x7ff86015c5b0 2023-11-28T13:03:07.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff867a11700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff860154360 con 0x7ff86015c1e0 2023-11-28T13:03:07.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff867a11700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff86014ce50 con 0x7ff860070c80 2023-11-28T13:03:07.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff865fae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff86015c5b0 0x7ff86015b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:07.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff8657ad700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff860070c80 0x7ff86014c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:07.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff864fac700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff86015c1e0 0x7ff86015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:07.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff865fae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff86015c5b0 0x7ff86015b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41682/0 (socket says 172.21.15.82:41682) 2023-11-28T13:03:07.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff865fae700 1 -- 172.21.15.82:0/1706194008 learned_addr learned my addr 172.21.15.82:0/1706194008 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:07.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff865fae700 1 -- 172.21.15.82:0/1706194008 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff860070c80 msgr2=0x7ff86014c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:07.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff865fae700 1 --2- 172.21.15.82:0/1706194008 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff860070c80 0x7ff86014c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:07.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff865fae700 1 -- 172.21.15.82:0/1706194008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff86015c1e0 msgr2=0x7ff86015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:07.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff865fae700 1 --2- 172.21.15.82:0/1706194008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff86015c1e0 0x7ff86015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:07.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff865fae700 1 -- 172.21.15.82:0/1706194008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8500094b0 con 0x7ff86015c5b0 2023-11-28T13:03:07.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff8657ad700 1 --2- 172.21.15.82:0/1706194008 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff860070c80 0x7ff86014c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:03:07.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff864fac700 1 --2- 172.21.15.82:0/1706194008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff86015c1e0 0x7ff86015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:03:07.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff865fae700 1 --2- 172.21.15.82:0/1706194008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff86015c5b0 0x7ff86015b440 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff85800e820 tx=0x7ff85800eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:07.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff855ffb700 1 -- 172.21.15.82:0/1706194008 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8580095c0 con 0x7ff86015c5b0 2023-11-28T13:03:07.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff855ffb700 1 -- 172.21.15.82:0/1706194008 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff858013680 con 0x7ff86015c5b0 2023-11-28T13:03:07.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff867a11700 1 -- 172.21.15.82:0/1706194008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff860160d60 con 0x7ff86015c5b0 2023-11-28T13:03:07.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.084+0000 7ff855ffb700 1 -- 172.21.15.82:0/1706194008 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858013a10 con 0x7ff86015c5b0 2023-11-28T13:03:07.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.088+0000 7ff867a11700 1 -- 172.21.15.82:0/1706194008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff860160840 con 0x7ff86015c5b0 2023-11-28T13:03:07.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.088+0000 7ff867a11700 1 -- 172.21.15.82:0/1706194008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8600adf60 con 0x7ff86015c5b0 2023-11-28T13:03:07.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.088+0000 7ff855ffb700 1 -- 172.21.15.82:0/1706194008 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff858019030 con 0x7ff86015c5b0 2023-11-28T13:03:07.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.088+0000 7ff855ffb700 1 --2- 172.21.15.82:0/1706194008 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff844064ee0 0x7ff844067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:07.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.088+0000 7ff855ffb700 1 -- 172.21.15.82:0/1706194008 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff858081c90 con 0x7ff86015c5b0 2023-11-28T13:03:07.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.092+0000 7ff8657ad700 1 --2- 172.21.15.82:0/1706194008 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff844064ee0 0x7ff844067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:07.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.092+0000 7ff8657ad700 1 --2- 172.21.15.82:0/1706194008 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff844064ee0 0x7ff844067390 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff85c002230 tx=0x7ff85c001b70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:07.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.096+0000 7ff855ffb700 1 -- 172.21.15.82:0/1706194008 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff85804fd40 con 0x7ff86015c5b0 2023-11-28T13:03:07.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.276+0000 7ff867a11700 1 -- 172.21.15.82:0/1706194008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff860073e20 con 0x7ff86015c5b0 2023-11-28T13:03:07.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.276+0000 7ff855ffb700 1 -- 172.21.15.82:0/1706194008 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff858053360 con 0x7ff86015c5b0 2023-11-28T13:03:07.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.276+0000 7ff867a11700 1 -- 172.21.15.82:0/1706194008 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff844064ee0 msgr2=0x7ff844067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:07.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.276+0000 7ff867a11700 1 --2- 172.21.15.82:0/1706194008 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff844064ee0 0x7ff844067390 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff85c002230 tx=0x7ff85c001b70 comp rx=0 tx=0).stop 2023-11-28T13:03:07.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.276+0000 7ff867a11700 1 -- 172.21.15.82:0/1706194008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff86015c5b0 msgr2=0x7ff86015b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:07.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.276+0000 7ff867a11700 1 --2- 172.21.15.82:0/1706194008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff86015c5b0 0x7ff86015b440 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff85800e820 tx=0x7ff85800eb30 comp rx=0 tx=0).stop 2023-11-28T13:03:07.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.276+0000 7ff867a11700 1 -- 172.21.15.82:0/1706194008 shutdown_connections 2023-11-28T13:03:07.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.276+0000 7ff867a11700 1 --2- 172.21.15.82:0/1706194008 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff844064ee0 0x7ff844067390 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:07.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.276+0000 7ff867a11700 1 --2- 172.21.15.82:0/1706194008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff86015c5b0 0x7ff86015b440 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:07.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.276+0000 7ff867a11700 1 --2- 172.21.15.82:0/1706194008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff86015c1e0 0x7ff86015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:07.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.276+0000 7ff867a11700 1 --2- 172.21.15.82:0/1706194008 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff860070c80 0x7ff86014c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:07.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.276+0000 7ff867a11700 1 -- 172.21.15.82:0/1706194008 >> 172.21.15.82:0/1706194008 conn(0x7ff8600cb700 msgr2=0x7ff86006c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:07.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.276+0000 7ff867a11700 1 -- 172.21.15.82:0/1706194008 shutdown_connections 2023-11-28T13:03:07.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.276+0000 7ff867a11700 1 -- 172.21.15.82:0/1706194008 wait complete. 2023-11-28T13:03:07.283 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2023-11-28T13:03:07.294 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2023-11-28T13:03:07.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:03:07.294 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T13:03:07.303 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[49988]: fuse finished with error 0 and tester_r 0 2023-11-28T13:03:07.304 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-11-28T13:03:07.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:03:07.305 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T13:03:07.472 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:03:07.472 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:03:07.480 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19664 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T13:03:07.480 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-28T13:03:07.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:03:07.480 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T13:03:07.487 INFO:teuthology.orchestra.run.smithi114.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-28T13:03:07.487 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T13:03:07.489 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:03:07.489 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:03:07.497 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346276k,nr_inodes=4086569,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=221 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275484k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T13:03:07.497 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-11-28T13:03:07.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:03:07.497 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T13:03:07.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T13:03:07.545 INFO:teuthology.orchestra.run.smithi082.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-28T13:03:07.546 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:03:07.546 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:03:07.553 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19664 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T13:03:07.553 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-28T13:03:07.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:03:07.553 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T13:03:07.603 INFO:teuthology.orchestra.run.smithi114.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-28T13:03:07.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T13:03:07.604 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:03:07.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.720+0000 7fc6409d3700 1 Processor -- start 2023-11-28T13:03:07.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.720+0000 7fc6409d3700 1 -- start start 2023-11-28T13:03:07.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.720+0000 7fc6409d3700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc63c158df0 0x7fc63c15d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:07.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.720+0000 7fc6409d3700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc63c070070 0x7fc63c0704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:07.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.720+0000 7fc6409d3700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63c15da50 con 0x7fc63c1591c0 2023-11-28T13:03:07.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.720+0000 7fc6409d3700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63c070a30 con 0x7fc63c070070 2023-11-28T13:03:07.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.720+0000 7fc6409d3700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c0c9e20 con 0x7fc63c158df0 2023-11-28T13:03:07.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.720+0000 7fc63bfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc63c070070 0x7fc63c0704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:07.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.720+0000 7fc63b7fe700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc63c158df0 0x7fc63c15d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:07.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.720+0000 7fc63bfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc63c070070 0x7fc63c0704f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:43716/0 (socket says 172.21.15.82:43716) 2023-11-28T13:03:07.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.720+0000 7fc63b7fe700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc63c158df0 0x7fc63c15d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:43550/0 (socket says 172.21.15.82:43550) 2023-11-28T13:03:07.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.720+0000 7fc63affd700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc63c1591c0 0x7fc63c06c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:58262/0 (socket says 172.21.15.82:58262) 2023-11-28T13:03:07.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.720+0000 7fc63bfff700 1 -- 172.21.15.82:0/3943887290 learned_addr learned my addr 172.21.15.82:0/3943887290 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:07.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.720+0000 7fc63a7fc700 1 -- 172.21.15.82:0/3943887290 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020474688 0 0) 0x7fc62c001490 con 0x7fc63c1591c0 2023-11-28T13:03:07.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.720+0000 7fc63a7fc700 1 -- 172.21.15.82:0/3943887290 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6240035d0 con 0x7fc63c1591c0 2023-11-28T13:03:07.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.720+0000 7fc63bfff700 1 -- 172.21.15.82:0/3943887290 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc63c158df0 msgr2=0x7fc63c15d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:07.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.720+0000 7fc63bfff700 1 --2- 172.21.15.82:0/3943887290 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc63c158df0 0x7fc63c15d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:07.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.720+0000 7fc63bfff700 1 -- 172.21.15.82:0/3943887290 >> v1:172.21.15.114:6789/0 conn(0x7fc63c1591c0 legacy=0x7fc63c06c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:07.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.724+0000 7fc63bfff700 1 -- 172.21.15.82:0/3943887290 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c0cc640 con 0x7fc63c070070 2023-11-28T13:03:07.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.724+0000 7fc63b7fe700 1 --2- 172.21.15.82:0/3943887290 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc63c158df0 0x7fc63c15d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:03:07.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.724+0000 7fc63bfff700 1 --2- 172.21.15.82:0/3943887290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63c070070 0x7fc63c0704f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc634009910 tx=0x7fc634009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e46ddbe13f496e7c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:07.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.724+0000 7fc63a7fc700 1 -- 172.21.15.82:0/3943887290 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc634011830 con 0x7fc63c070070 2023-11-28T13:03:07.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.724+0000 7fc63a7fc700 1 -- 172.21.15.82:0/3943887290 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc634011990 con 0x7fc63c070070 2023-11-28T13:03:07.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.724+0000 7fc63a7fc700 1 -- 172.21.15.82:0/3943887290 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc634011d40 con 0x7fc63c070070 2023-11-28T13:03:07.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.724+0000 7fc6409d3700 1 -- 172.21.15.82:0/3943887290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63c070070 msgr2=0x7fc63c0704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:07.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.724+0000 7fc6409d3700 1 --2- 172.21.15.82:0/3943887290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63c070070 0x7fc63c0704f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc634009910 tx=0x7fc634009c20 comp rx=0 tx=0).stop 2023-11-28T13:03:07.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.724+0000 7fc6409d3700 1 -- 172.21.15.82:0/3943887290 shutdown_connections 2023-11-28T13:03:07.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.724+0000 7fc6409d3700 1 --2- 172.21.15.82:0/3943887290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63c070070 0x7fc63c0704f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:07.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.724+0000 7fc6409d3700 1 --2- 172.21.15.82:0/3943887290 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc63c158df0 0x7fc63c15d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:07.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.724+0000 7fc6409d3700 1 -- 172.21.15.82:0/3943887290 >> 172.21.15.82:0/3943887290 conn(0x7fc63c0ce600 msgr2=0x7fc63c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:07.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.724+0000 7fc6409d3700 1 -- 172.21.15.82:0/3943887290 shutdown_connections 2023-11-28T13:03:07.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.724+0000 7fc6409d3700 1 -- 172.21.15.82:0/3943887290 wait complete. 2023-11-28T13:03:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.724+0000 7fc6409d3700 1 Processor -- start 2023-11-28T13:03:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.724+0000 7fc6409d3700 1 -- start start 2023-11-28T13:03:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc6409d3700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc63c070070 0x7fc63c15b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc6409d3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63c158df0 0x7fc63c1eec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc6409d3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc63c1591c0 0x7fc63c1ef1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc6409d3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c1f3d60 con 0x7fc63c1591c0 2023-11-28T13:03:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc6409d3700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c1ef700 con 0x7fc63c158df0 2023-11-28T13:03:07.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc6409d3700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c0c4580 con 0x7fc63c070070 2023-11-28T13:03:07.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc63bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc63c1591c0 0x7fc63c1ef1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:07.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc63b7fe700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc63c070070 0x7fc63c15b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:07.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc63affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63c158df0 0x7fc63c1eec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:07.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc63bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc63c1591c0 0x7fc63c1ef1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41692/0 (socket says 172.21.15.82:41692) 2023-11-28T13:03:07.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc63bfff700 1 -- 172.21.15.82:0/2565234680 learned_addr learned my addr 172.21.15.82:0/2565234680 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:07.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc63affd700 1 -- 172.21.15.82:0/2565234680 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc63c070070 msgr2=0x7fc63c15b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:07.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc63affd700 1 --2- 172.21.15.82:0/2565234680 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc63c070070 0x7fc63c15b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:07.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc63affd700 1 -- 172.21.15.82:0/2565234680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc63c1591c0 msgr2=0x7fc63c1ef1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:07.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc63affd700 1 --2- 172.21.15.82:0/2565234680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc63c1591c0 0x7fc63c1ef1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:07.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc63affd700 1 -- 172.21.15.82:0/2565234680 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6300094b0 con 0x7fc63c158df0 2023-11-28T13:03:07.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc63b7fe700 1 --2- 172.21.15.82:0/2565234680 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc63c070070 0x7fc63c15b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:03:07.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc63bfff700 1 --2- 172.21.15.82:0/2565234680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc63c1591c0 0x7fc63c1ef1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:03:07.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc63affd700 1 --2- 172.21.15.82:0/2565234680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63c158df0 0x7fc63c1eec80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc63c1595d0 tx=0x7fc62c00ce90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:07.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc623fff700 1 -- 172.21.15.82:0/2565234680 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c00a9e0 con 0x7fc63c158df0 2023-11-28T13:03:07.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc623fff700 1 -- 172.21.15.82:0/2565234680 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c00ab40 con 0x7fc63c158df0 2023-11-28T13:03:07.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc6409d3700 1 -- 172.21.15.82:0/2565234680 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc634009570 con 0x7fc63c158df0 2023-11-28T13:03:07.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc623fff700 1 -- 172.21.15.82:0/2565234680 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c007070 con 0x7fc63c158df0 2023-11-28T13:03:07.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc6409d3700 1 -- 172.21.15.82:0/2565234680 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63c0c9ab0 con 0x7fc63c158df0 2023-11-28T13:03:07.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.728+0000 7fc6409d3700 1 -- 172.21.15.82:0/2565234680 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63c0c97d0 con 0x7fc63c158df0 2023-11-28T13:03:07.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.732+0000 7fc623fff700 1 -- 172.21.15.82:0/2565234680 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc62c019030 con 0x7fc63c158df0 2023-11-28T13:03:07.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.732+0000 7fc623fff700 1 --2- 172.21.15.82:0/2565234680 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc628064ee0 0x7fc628067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:07.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.732+0000 7fc623fff700 1 -- 172.21.15.82:0/2565234680 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc62c081950 con 0x7fc63c158df0 2023-11-28T13:03:07.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.732+0000 7fc63b7fe700 1 --2- 172.21.15.82:0/2565234680 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc628064ee0 0x7fc628067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:07.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.732+0000 7fc63b7fe700 1 --2- 172.21.15.82:0/2565234680 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc628064ee0 0x7fc628067390 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc6300114b0 tx=0x7fc630009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:07.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.740+0000 7fc623fff700 1 -- 172.21.15.82:0/2565234680 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc62c04fa80 con 0x7fc63c158df0 2023-11-28T13:03:07.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.940+0000 7fc6409d3700 1 -- 172.21.15.82:0/2565234680 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc63c0c9480 con 0x7fc63c158df0 2023-11-28T13:03:07.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.952+0000 7fc623fff700 1 -- 172.21.15.82:0/2565234680 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4651 (secure 0 0 0) 0x7fc62c001bf0 con 0x7fc63c158df0 2023-11-28T13:03:07.956 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:07.956 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/704061431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":704061431},{"type":"v1","addr":"172.21.15.114:6834","nonce":704061431}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3972503523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3972503523},{"type":"v1","addr":"172.21.15.82:6836","nonce":3972503523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5811,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2000262220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2000262220},{"type":"v1","addr":"172.21.15.82:6837","nonce":2000262220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:02:20.454524+0000","modified":"2023-11-28T13:02:23.476763+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5814":{"gid":5814,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/4092152651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":4092152651},{"type":"v1","addr":"172.21.15.114:6835","nonce":4092152651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T13:03:07.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.956+0000 7fc6409d3700 1 -- 172.21.15.82:0/2565234680 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc628064ee0 msgr2=0x7fc628067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:07.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.956+0000 7fc6409d3700 1 --2- 172.21.15.82:0/2565234680 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc628064ee0 0x7fc628067390 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc6300114b0 tx=0x7fc630009240 comp rx=0 tx=0).stop 2023-11-28T13:03:07.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.956+0000 7fc6409d3700 1 -- 172.21.15.82:0/2565234680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63c158df0 msgr2=0x7fc63c1eec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:07.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.956+0000 7fc6409d3700 1 --2- 172.21.15.82:0/2565234680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63c158df0 0x7fc63c1eec80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc63c1595d0 tx=0x7fc62c00ce90 comp rx=0 tx=0).stop 2023-11-28T13:03:07.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.956+0000 7fc6409d3700 1 -- 172.21.15.82:0/2565234680 shutdown_connections 2023-11-28T13:03:07.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.956+0000 7fc6409d3700 1 --2- 172.21.15.82:0/2565234680 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc628064ee0 0x7fc628067390 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:07.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.956+0000 7fc6409d3700 1 --2- 172.21.15.82:0/2565234680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc63c1591c0 0x7fc63c1ef1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:07.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.956+0000 7fc6409d3700 1 --2- 172.21.15.82:0/2565234680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63c158df0 0x7fc63c1eec80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:07.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.956+0000 7fc6409d3700 1 --2- 172.21.15.82:0/2565234680 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc63c070070 0x7fc63c15b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:07.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.956+0000 7fc6409d3700 1 -- 172.21.15.82:0/2565234680 >> 172.21.15.82:0/2565234680 conn(0x7fc63c0ce600 msgr2=0x7fc63c06dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:07.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.956+0000 7fc6409d3700 1 -- 172.21.15.82:0/2565234680 shutdown_connections 2023-11-28T13:03:07.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:07.956+0000 7fc6409d3700 1 -- 172.21.15.82:0/2565234680 wait complete. 2023-11-28T13:03:07.963 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 22 2023-11-28T13:03:07.974 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:03:08.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.076+0000 7fe21f59e700 1 Processor -- start 2023-11-28T13:03:08.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe21f59e700 1 -- start start 2023-11-28T13:03:08.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe21f59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2201591c0 0x7fe22015d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:08.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe21f59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe220070070 0x7fe2200704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:08.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe21f59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22015da50 con 0x7fe220158df0 2023-11-28T13:03:08.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe21f59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe220070a30 con 0x7fe220070070 2023-11-28T13:03:08.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe21f59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2200c9e20 con 0x7fe2201591c0 2023-11-28T13:03:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe21ed9d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe220070070 0x7fe2200704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe215d9b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2201591c0 0x7fe22015d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe21ed9d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe220070070 0x7fe2200704f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:43742/0 (socket says 172.21.15.82:43742) 2023-11-28T13:03:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe21ed9d700 1 -- 172.21.15.82:0/48223587 learned_addr learned my addr 172.21.15.82:0/48223587 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe21e59c700 1 --1- 172.21.15.82:0/48223587 >> v1:172.21.15.114:6789/0 conn(0x7fe220158df0 0x7fe22006c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:58274/0 (socket says 172.21.15.82:58274) 2023-11-28T13:03:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe215d9b700 1 -- 172.21.15.82:0/48223587 >> v2:172.21.15.114:3300/0 conn(0x7fe220070070 msgr2=0x7fe2200704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe215d9b700 1 --2- 172.21.15.82:0/48223587 >> v2:172.21.15.114:3300/0 conn(0x7fe220070070 0x7fe2200704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe215d9b700 1 -- 172.21.15.82:0/48223587 >> v1:172.21.15.114:6789/0 conn(0x7fe220158df0 legacy=0x7fe22006c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe215d9b700 1 -- 172.21.15.82:0/48223587 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2200cc640 con 0x7fe2201591c0 2023-11-28T13:03:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe215d9b700 1 --2- 172.21.15.82:0/48223587 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2201591c0 0x7fe22015d510 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe208009850 tx=0x7fe208009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bc6258a8c7d69bc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe21dd9b700 1 -- 172.21.15.82:0/48223587 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe208011830 con 0x7fe2201591c0 2023-11-28T13:03:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe21dd9b700 1 -- 172.21.15.82:0/48223587 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe208011990 con 0x7fe2201591c0 2023-11-28T13:03:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe21dd9b700 1 -- 172.21.15.82:0/48223587 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe208011d40 con 0x7fe2201591c0 2023-11-28T13:03:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe21f59e700 1 -- 172.21.15.82:0/48223587 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2201591c0 msgr2=0x7fe22015d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe21f59e700 1 --2- 172.21.15.82:0/48223587 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2201591c0 0x7fe22015d510 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe208009850 tx=0x7fe208009b60 comp rx=0 tx=0).stop 2023-11-28T13:03:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe21f59e700 1 -- 172.21.15.82:0/48223587 shutdown_connections 2023-11-28T13:03:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe21f59e700 1 --2- 172.21.15.82:0/48223587 >> v2:172.21.15.114:3300/0 conn(0x7fe220070070 0x7fe2200704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe21f59e700 1 --2- 172.21.15.82:0/48223587 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2201591c0 0x7fe22015d510 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe21f59e700 1 -- 172.21.15.82:0/48223587 >> 172.21.15.82:0/48223587 conn(0x7fe2200ce600 msgr2=0x7fe2200ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe21f59e700 1 -- 172.21.15.82:0/48223587 shutdown_connections 2023-11-28T13:03:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.080+0000 7fe21f59e700 1 -- 172.21.15.82:0/48223587 wait complete. 2023-11-28T13:03:08.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.084+0000 7fe21f59e700 1 Processor -- start 2023-11-28T13:03:08.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.084+0000 7fe21f59e700 1 -- start start 2023-11-28T13:03:08.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.084+0000 7fe21f59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe220070070 0x7fe2200c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:08.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.084+0000 7fe21f59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe220158df0 0x7fe2200af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:08.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.084+0000 7fe21f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2201591c0 0x7fe2200ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:08.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.084+0000 7fe21f59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2200b2a30 con 0x7fe2201591c0 2023-11-28T13:03:08.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.084+0000 7fe21f59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22006d570 con 0x7fe220158df0 2023-11-28T13:03:08.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.084+0000 7fe21f59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2200ac590 con 0x7fe220070070 2023-11-28T13:03:08.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.084+0000 7fe21ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2201591c0 0x7fe2200ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:08.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.084+0000 7fe21ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2201591c0 0x7fe2200ac050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41704/0 (socket says 172.21.15.82:41704) 2023-11-28T13:03:08.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.084+0000 7fe21ed9d700 1 -- 172.21.15.82:0/985487310 learned_addr learned my addr 172.21.15.82:0/985487310 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:08.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.084+0000 7fe215d9b700 1 --2- 172.21.15.82:0/985487310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe220158df0 0x7fe2200af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:08.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.084+0000 7fe21e59c700 1 --2- 172.21.15.82:0/985487310 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe220070070 0x7fe2200c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:08.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.088+0000 7fe21ed9d700 1 -- 172.21.15.82:0/985487310 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe220070070 msgr2=0x7fe2200c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:08.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.088+0000 7fe21ed9d700 1 --2- 172.21.15.82:0/985487310 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe220070070 0x7fe2200c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.088+0000 7fe21ed9d700 1 -- 172.21.15.82:0/985487310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe220158df0 msgr2=0x7fe2200af9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:08.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.088+0000 7fe21ed9d700 1 --2- 172.21.15.82:0/985487310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe220158df0 0x7fe2200af9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.088+0000 7fe21ed9d700 1 -- 172.21.15.82:0/985487310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2080094b0 con 0x7fe2201591c0 2023-11-28T13:03:08.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.088+0000 7fe21ed9d700 1 --2- 172.21.15.82:0/985487310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2201591c0 0x7fe2200ac050 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe21800efc0 tx=0x7fe21800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:08.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.088+0000 7fe2177fe700 1 -- 172.21.15.82:0/985487310 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe218003c40 con 0x7fe2201591c0 2023-11-28T13:03:08.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.088+0000 7fe2177fe700 1 -- 172.21.15.82:0/985487310 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21800f040 con 0x7fe2201591c0 2023-11-28T13:03:08.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.088+0000 7fe21f59e700 1 -- 172.21.15.82:0/985487310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2200c9ab0 con 0x7fe2201591c0 2023-11-28T13:03:08.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.088+0000 7fe2177fe700 1 -- 172.21.15.82:0/985487310 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe218009e60 con 0x7fe2201591c0 2023-11-28T13:03:08.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.088+0000 7fe21f59e700 1 -- 172.21.15.82:0/985487310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2200c97d0 con 0x7fe2201591c0 2023-11-28T13:03:08.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.088+0000 7fe21f59e700 1 -- 172.21.15.82:0/985487310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2200c9480 con 0x7fe2201591c0 2023-11-28T13:03:08.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.088+0000 7fe2177fe700 1 -- 172.21.15.82:0/985487310 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe21800c880 con 0x7fe2201591c0 2023-11-28T13:03:08.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.088+0000 7fe2177fe700 1 --2- 172.21.15.82:0/985487310 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe204064ee0 0x7fe204067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:08.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.088+0000 7fe21e59c700 1 --2- 172.21.15.82:0/985487310 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe204064ee0 0x7fe204067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:08.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.088+0000 7fe2177fe700 1 -- 172.21.15.82:0/985487310 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe218082210 con 0x7fe2201591c0 2023-11-28T13:03:08.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.092+0000 7fe21e59c700 1 --2- 172.21.15.82:0/985487310 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe204064ee0 0x7fe204067390 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe210000f60 tx=0x7fe210007ef0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:08.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.096+0000 7fe2177fe700 1 -- 172.21.15.82:0/985487310 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe2180503b0 con 0x7fe2201591c0 2023-11-28T13:03:08.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.260+0000 7fe21f59e700 1 -- 172.21.15.82:0/985487310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe220065fc0 con 0x7fe2201591c0 2023-11-28T13:03:08.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.264+0000 7fe2177fe700 1 -- 172.21.15.82:0/985487310 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+17883 (secure 0 0 0) 0x7fe2180539d0 con 0x7fe2201591c0 2023-11-28T13:03:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:08.269 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":51,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:02:21.459082+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:02:19.012136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T13:02:19.431685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:03:08.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.268+0000 7fe21f59e700 1 -- 172.21.15.82:0/985487310 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe204064ee0 msgr2=0x7fe204067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:08.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.268+0000 7fe21f59e700 1 --2- 172.21.15.82:0/985487310 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe204064ee0 0x7fe204067390 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe210000f60 tx=0x7fe210007ef0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.268+0000 7fe21f59e700 1 -- 172.21.15.82:0/985487310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2201591c0 msgr2=0x7fe2200ac050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:08.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.268+0000 7fe21f59e700 1 --2- 172.21.15.82:0/985487310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2201591c0 0x7fe2200ac050 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe21800efc0 tx=0x7fe21800c3a0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.268+0000 7fe21f59e700 1 -- 172.21.15.82:0/985487310 shutdown_connections 2023-11-28T13:03:08.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.268+0000 7fe21f59e700 1 --2- 172.21.15.82:0/985487310 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe204064ee0 0x7fe204067390 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.268+0000 7fe21f59e700 1 --2- 172.21.15.82:0/985487310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2201591c0 0x7fe2200ac050 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.268+0000 7fe21f59e700 1 --2- 172.21.15.82:0/985487310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe220158df0 0x7fe2200af9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.268+0000 7fe21f59e700 1 --2- 172.21.15.82:0/985487310 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe220070070 0x7fe2200c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.268+0000 7fe21f59e700 1 -- 172.21.15.82:0/985487310 >> 172.21.15.82:0/985487310 conn(0x7fe2200ce600 msgr2=0x7fe2200b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:08.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.268+0000 7fe21f59e700 1 -- 172.21.15.82:0/985487310 shutdown_connections 2023-11-28T13:03:08.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.268+0000 7fe21f59e700 1 -- 172.21.15.82:0/985487310 wait complete. 2023-11-28T13:03:08.289 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T13:02:19.012136+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T13:02:19.431685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:03:08.289 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:03:08.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.412+0000 7fc9e1ef3700 1 Processor -- start 2023-11-28T13:03:08.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.412+0000 7fc9e1ef3700 1 -- start start 2023-11-28T13:03:08.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.412+0000 7fc9e1ef3700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc9dc0cf060 0x7fc9dc1607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:08.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.412+0000 7fc9e1ef3700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9dc071110 0x7fc9dc071500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:08.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.412+0000 7fc9e1ef3700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9dc15d840 con 0x7fc9dc0caaa0 2023-11-28T13:03:08.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.412+0000 7fc9e1ef3700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9dc06a450 con 0x7fc9dc0cf060 2023-11-28T13:03:08.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.412+0000 7fc9e1ef3700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc071a40 con 0x7fc9dc071110 2023-11-28T13:03:08.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.416+0000 7fc9e0ef1700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc9dc0cf060 0x7fc9dc1607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:08.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.416+0000 7fc9e16f2700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9dc071110 0x7fc9dc071500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:08.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.416+0000 7fc9dbfff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc9dc0caaa0 0x7fc9dc15c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:58290/0 (socket says 172.21.15.82:58290) 2023-11-28T13:03:08.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.416+0000 7fc9dbfff700 1 -- 172.21.15.82:0/1629386723 learned_addr learned my addr 172.21.15.82:0/1629386723 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:08.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.416+0000 7fc9e16f2700 1 -- 172.21.15.82:0/1629386723 >> v2:172.21.15.114:3300/0 conn(0x7fc9dc0cf060 msgr2=0x7fc9dc1607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:08.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.416+0000 7fc9e16f2700 1 --2- 172.21.15.82:0/1629386723 >> v2:172.21.15.114:3300/0 conn(0x7fc9dc0cf060 0x7fc9dc1607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.416+0000 7fc9e16f2700 1 -- 172.21.15.82:0/1629386723 >> v1:172.21.15.114:6789/0 conn(0x7fc9dc0caaa0 legacy=0x7fc9dc15c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:08.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.416+0000 7fc9e16f2700 1 -- 172.21.15.82:0/1629386723 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc15d280 con 0x7fc9dc071110 2023-11-28T13:03:08.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.416+0000 7fc9e16f2700 1 --2- 172.21.15.82:0/1629386723 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9dc071110 0x7fc9dc071500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009d90 tx=0x7fc9d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7660ea9d50142bb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:08.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.416+0000 7fc9db7fe700 1 -- 172.21.15.82:0/1629386723 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d400e070 con 0x7fc9dc071110 2023-11-28T13:03:08.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.416+0000 7fc9db7fe700 1 -- 172.21.15.82:0/1629386723 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d400bb20 con 0x7fc9dc071110 2023-11-28T13:03:08.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.416+0000 7fc9db7fe700 1 -- 172.21.15.82:0/1629386723 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4012430 con 0x7fc9dc071110 2023-11-28T13:03:08.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.416+0000 7fc9e1ef3700 1 -- 172.21.15.82:0/1629386723 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9dc071110 msgr2=0x7fc9dc071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:08.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.416+0000 7fc9e1ef3700 1 --2- 172.21.15.82:0/1629386723 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9dc071110 0x7fc9dc071500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009d90 tx=0x7fc9d400b330 comp rx=0 tx=0).stop 2023-11-28T13:03:08.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.416+0000 7fc9e1ef3700 1 -- 172.21.15.82:0/1629386723 shutdown_connections 2023-11-28T13:03:08.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.416+0000 7fc9e1ef3700 1 --2- 172.21.15.82:0/1629386723 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9dc071110 0x7fc9dc071500 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.416+0000 7fc9e1ef3700 1 --2- 172.21.15.82:0/1629386723 >> v2:172.21.15.114:3300/0 conn(0x7fc9dc0cf060 0x7fc9dc1607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.416+0000 7fc9e1ef3700 1 -- 172.21.15.82:0/1629386723 >> 172.21.15.82:0/1629386723 conn(0x7fc9dc0b1f50 msgr2=0x7fc9dc0cf790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:08.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.416+0000 7fc9e1ef3700 1 -- 172.21.15.82:0/1629386723 shutdown_connections 2023-11-28T13:03:08.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.416+0000 7fc9e1ef3700 1 -- 172.21.15.82:0/1629386723 wait complete. 2023-11-28T13:03:08.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9e1ef3700 1 Processor -- start 2023-11-28T13:03:08.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9e1ef3700 1 -- start start 2023-11-28T13:03:08.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9e1ef3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9dc071110 0x7fc9dc158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:08.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9e1ef3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9dc0caaa0 0x7fc9dc0ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:08.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9e1ef3700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9dc0cf060 0x7fc9dc1f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:08.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9e1ef3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc159190 con 0x7fc9dc0caaa0 2023-11-28T13:03:08.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9e1ef3700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc0ad370 con 0x7fc9dc071110 2023-11-28T13:03:08.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9e1ef3700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc0ad650 con 0x7fc9dc0cf060 2023-11-28T13:03:08.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9dbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9dc0caaa0 0x7fc9dc0ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:08.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9e0ef1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9dc071110 0x7fc9dc158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:08.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9dbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9dc0caaa0 0x7fc9dc0ae200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41712/0 (socket says 172.21.15.82:41712) 2023-11-28T13:03:08.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9e0ef1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9dc071110 0x7fc9dc158c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:43756/0 (socket says 172.21.15.82:43756) 2023-11-28T13:03:08.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9dbfff700 1 -- 172.21.15.82:0/2698680719 learned_addr learned my addr 172.21.15.82:0/2698680719 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:08.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9e16f2700 1 --2- 172.21.15.82:0/2698680719 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9dc0cf060 0x7fc9dc1f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:08.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9e0ef1700 1 -- 172.21.15.82:0/2698680719 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9dc0cf060 msgr2=0x7fc9dc1f2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:08.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9e0ef1700 1 --2- 172.21.15.82:0/2698680719 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9dc0cf060 0x7fc9dc1f2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9e0ef1700 1 -- 172.21.15.82:0/2698680719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9dc0caaa0 msgr2=0x7fc9dc0ae200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:08.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9e0ef1700 1 --2- 172.21.15.82:0/2698680719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9dc0caaa0 0x7fc9dc0ae200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9e0ef1700 1 -- 172.21.15.82:0/2698680719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d4009a70 con 0x7fc9dc071110 2023-11-28T13:03:08.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9e0ef1700 1 --2- 172.21.15.82:0/2698680719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9dc071110 0x7fc9dc158c50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000e870 tx=0x7fc9d000eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:08.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9d97fa700 1 -- 172.21.15.82:0/2698680719 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0013680 con 0x7fc9dc071110 2023-11-28T13:03:08.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9d97fa700 1 -- 172.21.15.82:0/2698680719 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d00137e0 con 0x7fc9dc071110 2023-11-28T13:03:08.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9e1ef3700 1 -- 172.21.15.82:0/2698680719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9dc15ffc0 con 0x7fc9dc071110 2023-11-28T13:03:08.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9d97fa700 1 -- 172.21.15.82:0/2698680719 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0013b70 con 0x7fc9dc071110 2023-11-28T13:03:08.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.420+0000 7fc9e1ef3700 1 -- 172.21.15.82:0/2698680719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9dc15d560 con 0x7fc9dc071110 2023-11-28T13:03:08.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.424+0000 7fc9e1ef3700 1 -- 172.21.15.82:0/2698680719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9dc1602a0 con 0x7fc9dc071110 2023-11-28T13:03:08.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.424+0000 7fc9d97fa700 1 -- 172.21.15.82:0/2698680719 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc9d0019030 con 0x7fc9dc071110 2023-11-28T13:03:08.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.424+0000 7fc9d97fa700 1 --2- 172.21.15.82:0/2698680719 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc9c8064ee0 0x7fc9c8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:08.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.424+0000 7fc9d97fa700 1 -- 172.21.15.82:0/2698680719 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc9d0081be0 con 0x7fc9dc071110 2023-11-28T13:03:08.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.424+0000 7fc9dbfff700 1 --2- 172.21.15.82:0/2698680719 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc9c8064ee0 0x7fc9c8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:08.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.424+0000 7fc9dbfff700 1 --2- 172.21.15.82:0/2698680719 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc9c8064ee0 0x7fc9c8067390 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc15c2d0 tx=0x7fc9cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:08.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.436+0000 7fc9d97fa700 1 -- 172.21.15.82:0/2698680719 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc9d004fc90 con 0x7fc9dc071110 2023-11-28T13:03:08.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.604+0000 7fc9e1ef3700 1 -- 172.21.15.82:0/2698680719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc9dc065fc0 con 0x7fc9dc071110 2023-11-28T13:03:08.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.604+0000 7fc9d97fa700 1 -- 172.21.15.82:0/2698680719 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc9d00170a0 con 0x7fc9dc071110 2023-11-28T13:03:08.610 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:03:08.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.608+0000 7fc9e1ef3700 1 -- 172.21.15.82:0/2698680719 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc9c8064ee0 msgr2=0x7fc9c8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:08.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.608+0000 7fc9e1ef3700 1 --2- 172.21.15.82:0/2698680719 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc9c8064ee0 0x7fc9c8067390 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc15c2d0 tx=0x7fc9cc009040 comp rx=0 tx=0).stop 2023-11-28T13:03:08.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.608+0000 7fc9e1ef3700 1 -- 172.21.15.82:0/2698680719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9dc071110 msgr2=0x7fc9dc158c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:08.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.608+0000 7fc9e1ef3700 1 --2- 172.21.15.82:0/2698680719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9dc071110 0x7fc9dc158c50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000e870 tx=0x7fc9d000eb80 comp rx=0 tx=0).stop 2023-11-28T13:03:08.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.608+0000 7fc9e1ef3700 1 -- 172.21.15.82:0/2698680719 shutdown_connections 2023-11-28T13:03:08.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.608+0000 7fc9e1ef3700 1 --2- 172.21.15.82:0/2698680719 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc9c8064ee0 0x7fc9c8067390 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.608+0000 7fc9e1ef3700 1 --2- 172.21.15.82:0/2698680719 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9dc0cf060 0x7fc9dc1f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.608+0000 7fc9e1ef3700 1 --2- 172.21.15.82:0/2698680719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9dc0caaa0 0x7fc9dc0ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.608+0000 7fc9e1ef3700 1 --2- 172.21.15.82:0/2698680719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9dc071110 0x7fc9dc158c50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.608+0000 7fc9e1ef3700 1 -- 172.21.15.82:0/2698680719 >> 172.21.15.82:0/2698680719 conn(0x7fc9dc0b1f50 msgr2=0x7fc9dc0cdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:08.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.608+0000 7fc9e1ef3700 1 -- 172.21.15.82:0/2698680719 shutdown_connections 2023-11-28T13:03:08.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.608+0000 7fc9e1ef3700 1 -- 172.21.15.82:0/2698680719 wait complete. 2023-11-28T13:03:08.625 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:03:08.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.740+0000 7f24749d9700 1 Processor -- start 2023-11-28T13:03:08.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.740+0000 7f24749d9700 1 -- start start 2023-11-28T13:03:08.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.744+0000 7f24749d9700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f247006ba30 0x7f247006be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:08.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.744+0000 7f24749d9700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24700d1050 con 0x7f24700b5c20 2023-11-28T13:03:08.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.744+0000 7f24749d9700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f247006c3a0 con 0x7f24700b1f30 2023-11-28T13:03:08.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.744+0000 7f24749d9700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24700b2300 con 0x7f247006ba30 2023-11-28T13:03:08.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.744+0000 7f246e59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f247006ba30 0x7f247006be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:08.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.744+0000 7f246e59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f247006ba30 0x7f247006be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41720/0 (socket says 172.21.15.82:41720) 2023-11-28T13:03:08.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.744+0000 7f246e59c700 1 -- 172.21.15.82:0/2128877960 learned_addr learned my addr 172.21.15.82:0/2128877960 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:08.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.744+0000 7f246e59c700 1 -- 172.21.15.82:0/2128877960 >> v1:172.21.15.114:6789/0 conn(0x7f24700b1f30 legacy=0x7f24700d2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:08.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.744+0000 7f246e59c700 1 -- 172.21.15.82:0/2128877960 >> v1:172.21.15.82:6789/0 conn(0x7f24700b5c20 legacy=0x7f24700b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:08.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.744+0000 7f246e59c700 1 -- 172.21.15.82:0/2128877960 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24700cd0c0 con 0x7f247006ba30 2023-11-28T13:03:08.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.744+0000 7f246e59c700 1 --2- 172.21.15.82:0/2128877960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247006ba30 0x7f247006be60 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f2464009910 tx=0x7f2464009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6cf007aa51eb96 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:08.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.744+0000 7f246dd9b700 1 -- 172.21.15.82:0/2128877960 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246400ba60 con 0x7f247006ba30 2023-11-28T13:03:08.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.744+0000 7f246dd9b700 1 -- 172.21.15.82:0/2128877960 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246400bbc0 con 0x7f247006ba30 2023-11-28T13:03:08.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.744+0000 7f246dd9b700 1 -- 172.21.15.82:0/2128877960 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2464009e60 con 0x7f247006ba30 2023-11-28T13:03:08.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.744+0000 7f24749d9700 1 -- 172.21.15.82:0/2128877960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247006ba30 msgr2=0x7f247006be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:08.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.744+0000 7f24749d9700 1 --2- 172.21.15.82:0/2128877960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247006ba30 0x7f247006be60 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f2464009910 tx=0x7f2464009c20 comp rx=0 tx=0).stop 2023-11-28T13:03:08.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.744+0000 7f24749d9700 1 -- 172.21.15.82:0/2128877960 shutdown_connections 2023-11-28T13:03:08.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.744+0000 7f24749d9700 1 --2- 172.21.15.82:0/2128877960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247006ba30 0x7f247006be60 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.744+0000 7f24749d9700 1 -- 172.21.15.82:0/2128877960 >> 172.21.15.82:0/2128877960 conn(0x7f24700b52d0 msgr2=0x7f24700d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:08.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.744+0000 7f24749d9700 1 -- 172.21.15.82:0/2128877960 shutdown_connections 2023-11-28T13:03:08.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.744+0000 7f24749d9700 1 -- 172.21.15.82:0/2128877960 wait complete. 2023-11-28T13:03:08.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.748+0000 7f24749d9700 1 Processor -- start 2023-11-28T13:03:08.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.748+0000 7f24749d9700 1 -- start start 2023-11-28T13:03:08.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.748+0000 7f24749d9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247006ba30 0x7f24700a9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:08.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.748+0000 7f24749d9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24700b1f30 0x7f247015da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:08.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.748+0000 7f24749d9700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24700b5c20 0x7f24700b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:08.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.748+0000 7f24749d9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24701f25c0 con 0x7f247006ba30 2023-11-28T13:03:08.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.748+0000 7f24749d9700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247015f1a0 con 0x7f24700b1f30 2023-11-28T13:03:08.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.748+0000 7f24749d9700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247015e590 con 0x7f24700b5c20 2023-11-28T13:03:08.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.748+0000 7f246ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247006ba30 0x7f24700a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:08.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.748+0000 7f246ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247006ba30 0x7f24700a9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41728/0 (socket says 172.21.15.82:41728) 2023-11-28T13:03:08.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.748+0000 7f246ed9d700 1 -- 172.21.15.82:0/2938819388 learned_addr learned my addr 172.21.15.82:0/2938819388 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:08.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.748+0000 7f246e59c700 1 --2- 172.21.15.82:0/2938819388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24700b1f30 0x7f247015da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:08.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.748+0000 7f246f59e700 1 --2- 172.21.15.82:0/2938819388 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24700b5c20 0x7f24700b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:08.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.748+0000 7f246ed9d700 1 -- 172.21.15.82:0/2938819388 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24700b5c20 msgr2=0x7f24700b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:08.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.748+0000 7f246ed9d700 1 --2- 172.21.15.82:0/2938819388 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24700b5c20 0x7f24700b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.748+0000 7f246ed9d700 1 -- 172.21.15.82:0/2938819388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24700b1f30 msgr2=0x7f247015da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:08.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.748+0000 7f246ed9d700 1 --2- 172.21.15.82:0/2938819388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24700b1f30 0x7f247015da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.748+0000 7f246ed9d700 1 -- 172.21.15.82:0/2938819388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2464009570 con 0x7f247006ba30 2023-11-28T13:03:08.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.748+0000 7f246e59c700 1 --2- 172.21.15.82:0/2938819388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24700b1f30 0x7f247015da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:08.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.748+0000 7f246ed9d700 1 --2- 172.21.15.82:0/2938819388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247006ba30 0x7f24700a9860 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f246000c6b0 tx=0x7f246000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:08.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.752+0000 7f24577fe700 1 -- 172.21.15.82:0/2938819388 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24600052d0 con 0x7f247006ba30 2023-11-28T13:03:08.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.752+0000 7f24577fe700 1 -- 172.21.15.82:0/2938819388 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2460005450 con 0x7f247006ba30 2023-11-28T13:03:08.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.752+0000 7f24749d9700 1 -- 172.21.15.82:0/2938819388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24700d1580 con 0x7f247006ba30 2023-11-28T13:03:08.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.752+0000 7f24577fe700 1 -- 172.21.15.82:0/2938819388 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24600038e0 con 0x7f247006ba30 2023-11-28T13:03:08.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.752+0000 7f24749d9700 1 -- 172.21.15.82:0/2938819388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24700d12a0 con 0x7f247006ba30 2023-11-28T13:03:08.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.752+0000 7f24577fe700 1 -- 172.21.15.82:0/2938819388 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2460019030 con 0x7f247006ba30 2023-11-28T13:03:08.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.752+0000 7f24749d9700 1 -- 172.21.15.82:0/2938819388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24700cd380 con 0x7f247006ba30 2023-11-28T13:03:08.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.752+0000 7f24577fe700 1 --2- 172.21.15.82:0/2938819388 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f245c064f10 0x7f245c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:08.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.752+0000 7f24577fe700 1 -- 172.21.15.82:0/2938819388 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2460081200 con 0x7f247006ba30 2023-11-28T13:03:08.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.756+0000 7f246e59c700 1 --2- 172.21.15.82:0/2938819388 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f245c064f10 0x7f245c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:08.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.756+0000 7f246e59c700 1 --2- 172.21.15.82:0/2938819388 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f245c064f10 0x7f245c0673c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2464006f80 tx=0x7f2464008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:08.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.760+0000 7f24577fe700 1 -- 172.21.15.82:0/2938819388 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f246004f2c0 con 0x7f247006ba30 2023-11-28T13:03:08.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.920+0000 7f24749d9700 1 -- 172.21.15.82:0/2938819388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2470065fc0 con 0x7f247006ba30 2023-11-28T13:03:08.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.920+0000 7f24577fe700 1 -- 172.21.15.82:0/2938819388 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v51) v1 ==== 92+0+10 (secure 0 0 0) 0x7f24600528e0 con 0x7f247006ba30 2023-11-28T13:03:08.926 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:03:08.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.924+0000 7f24749d9700 1 -- 172.21.15.82:0/2938819388 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f245c064f10 msgr2=0x7f245c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:08.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.924+0000 7f24749d9700 1 --2- 172.21.15.82:0/2938819388 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f245c064f10 0x7f245c0673c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2464006f80 tx=0x7f2464008030 comp rx=0 tx=0).stop 2023-11-28T13:03:08.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.924+0000 7f24749d9700 1 -- 172.21.15.82:0/2938819388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247006ba30 msgr2=0x7f24700a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:08.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.924+0000 7f24749d9700 1 --2- 172.21.15.82:0/2938819388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247006ba30 0x7f24700a9860 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f246000c6b0 tx=0x7f246000c9c0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.924+0000 7f24749d9700 1 -- 172.21.15.82:0/2938819388 shutdown_connections 2023-11-28T13:03:08.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.924+0000 7f24749d9700 1 --2- 172.21.15.82:0/2938819388 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f245c064f10 0x7f245c0673c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.924+0000 7f24749d9700 1 --2- 172.21.15.82:0/2938819388 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24700b5c20 0x7f24700b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.924+0000 7f24749d9700 1 --2- 172.21.15.82:0/2938819388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24700b1f30 0x7f247015da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.924+0000 7f24749d9700 1 --2- 172.21.15.82:0/2938819388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247006ba30 0x7f24700a9860 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:08.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.924+0000 7f24749d9700 1 -- 172.21.15.82:0/2938819388 >> 172.21.15.82:0/2938819388 conn(0x7f24700b52d0 msgr2=0x7f24700d1880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:08.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.924+0000 7f24749d9700 1 -- 172.21.15.82:0/2938819388 shutdown_connections 2023-11-28T13:03:08.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:08.924+0000 7f24749d9700 1 -- 172.21.15.82:0/2938819388 wait complete. 2023-11-28T13:03:08.940 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T13:03:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a488ab700 1 Processor -- start 2023-11-28T13:03:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a488ab700 1 -- start start 2023-11-28T13:03:09.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a488ab700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a4406b180 0x7f7a441608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:09.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a488ab700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7a440c79a0 0x7f7a440c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:09.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a488ab700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a440c8340 con 0x7f7a441568b0 2023-11-28T13:03:09.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a488ab700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a44156c80 con 0x7f7a440c79a0 2023-11-28T13:03:09.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a488ab700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a44071f30 con 0x7f7a4406b180 2023-11-28T13:03:09.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a4359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7a440c79a0 0x7f7a440c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:09.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a4359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7a440c79a0 0x7f7a440c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41740/0 (socket says 172.21.15.82:41740) 2023-11-28T13:03:09.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a4359e700 1 -- 172.21.15.82:0/109820902 learned_addr learned my addr 172.21.15.82:0/109820902 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:09.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a4259c700 1 --2- 172.21.15.82:0/109820902 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a4406b180 0x7f7a441608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:09.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a4359e700 1 -- 172.21.15.82:0/109820902 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a4406b180 msgr2=0x7f7a441608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:09.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a4359e700 1 --2- 172.21.15.82:0/109820902 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a4406b180 0x7f7a441608a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a4359e700 1 -- 172.21.15.82:0/109820902 >> v1:172.21.15.114:6789/0 conn(0x7f7a441568b0 legacy=0x7f7a44071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:09.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a4359e700 1 -- 172.21.15.82:0/109820902 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a44072210 con 0x7f7a440c79a0 2023-11-28T13:03:09.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a4259c700 1 --2- 172.21.15.82:0/109820902 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a4406b180 0x7f7a441608a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:03:09.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a4359e700 1 --2- 172.21.15.82:0/109820902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a440c79a0 0x7f7a440c7e00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009e50 tx=0x7f7a3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0884a9425b2cfb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:09.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a41d9b700 1 -- 172.21.15.82:0/109820902 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c00e070 con 0x7f7a440c79a0 2023-11-28T13:03:09.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a41d9b700 1 -- 172.21.15.82:0/109820902 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c00b9c0 con 0x7f7a440c79a0 2023-11-28T13:03:09.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a41d9b700 1 -- 172.21.15.82:0/109820902 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c00bd70 con 0x7f7a440c79a0 2023-11-28T13:03:09.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a488ab700 1 -- 172.21.15.82:0/109820902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a440c79a0 msgr2=0x7f7a440c7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:09.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a488ab700 1 --2- 172.21.15.82:0/109820902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a440c79a0 0x7f7a440c7e00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009e50 tx=0x7f7a3c00b330 comp rx=0 tx=0).stop 2023-11-28T13:03:09.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a488ab700 1 -- 172.21.15.82:0/109820902 shutdown_connections 2023-11-28T13:03:09.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a488ab700 1 --2- 172.21.15.82:0/109820902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a440c79a0 0x7f7a440c7e00 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a488ab700 1 --2- 172.21.15.82:0/109820902 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a4406b180 0x7f7a441608a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a488ab700 1 -- 172.21.15.82:0/109820902 >> 172.21.15.82:0/109820902 conn(0x7f7a440ce630 msgr2=0x7f7a440cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:09.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a488ab700 1 -- 172.21.15.82:0/109820902 shutdown_connections 2023-11-28T13:03:09.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.048+0000 7f7a488ab700 1 -- 172.21.15.82:0/109820902 wait complete. 2023-11-28T13:03:09.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.052+0000 7f7a488ab700 1 Processor -- start 2023-11-28T13:03:09.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.052+0000 7f7a488ab700 1 -- start start 2023-11-28T13:03:09.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.052+0000 7f7a488ab700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a4406b180 0x7f7a440b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:09.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.052+0000 7f7a488ab700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a440c79a0 0x7f7a441f2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:09.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.052+0000 7f7a488ab700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a441568b0 0x7f7a44158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:09.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.052+0000 7f7a488ab700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a44159e80 con 0x7f7a4406b180 2023-11-28T13:03:09.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.052+0000 7f7a488ab700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a440b42d0 con 0x7f7a441568b0 2023-11-28T13:03:09.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.052+0000 7f7a488ab700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a441598c0 con 0x7f7a440c79a0 2023-11-28T13:03:09.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.052+0000 7f7a42d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a4406b180 0x7f7a440b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:09.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.052+0000 7f7a42d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a4406b180 0x7f7a440b3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41754/0 (socket says 172.21.15.82:41754) 2023-11-28T13:03:09.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.052+0000 7f7a42d9d700 1 -- 172.21.15.82:0/989957026 learned_addr learned my addr 172.21.15.82:0/989957026 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:09.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.052+0000 7f7a4259c700 1 --2- 172.21.15.82:0/989957026 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a440c79a0 0x7f7a441f2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:09.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.052+0000 7f7a4359e700 1 --2- 172.21.15.82:0/989957026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a441568b0 0x7f7a44158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:09.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.052+0000 7f7a42d9d700 1 -- 172.21.15.82:0/989957026 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a440c79a0 msgr2=0x7f7a441f2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:09.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.052+0000 7f7a42d9d700 1 --2- 172.21.15.82:0/989957026 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a440c79a0 0x7f7a441f2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.052+0000 7f7a42d9d700 1 -- 172.21.15.82:0/989957026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a441568b0 msgr2=0x7f7a44158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:09.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.052+0000 7f7a42d9d700 1 --2- 172.21.15.82:0/989957026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a441568b0 0x7f7a44158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.052+0000 7f7a42d9d700 1 -- 172.21.15.82:0/989957026 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c009b30 con 0x7f7a4406b180 2023-11-28T13:03:09.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.056+0000 7f7a42d9d700 1 --2- 172.21.15.82:0/989957026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a4406b180 0x7f7a440b3d90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7a3400c500 tx=0x7f7a3400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:09.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.056+0000 7f7a2b7fe700 1 -- 172.21.15.82:0/989957026 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a340052d0 con 0x7f7a4406b180 2023-11-28T13:03:09.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.056+0000 7f7a2b7fe700 1 -- 172.21.15.82:0/989957026 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a34005430 con 0x7f7a4406b180 2023-11-28T13:03:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.056+0000 7f7a488ab700 1 -- 172.21.15.82:0/989957026 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a441600a0 con 0x7f7a4406b180 2023-11-28T13:03:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.056+0000 7f7a2b7fe700 1 -- 172.21.15.82:0/989957026 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a340055a0 con 0x7f7a4406b180 2023-11-28T13:03:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.056+0000 7f7a488ab700 1 -- 172.21.15.82:0/989957026 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a4415fdc0 con 0x7f7a4406b180 2023-11-28T13:03:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.056+0000 7f7a488ab700 1 -- 172.21.15.82:0/989957026 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a44160380 con 0x7f7a4406b180 2023-11-28T13:03:09.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.056+0000 7f7a2b7fe700 1 -- 172.21.15.82:0/989957026 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7a34019030 con 0x7f7a4406b180 2023-11-28T13:03:09.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.056+0000 7f7a2b7fe700 1 --2- 172.21.15.82:0/989957026 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a30064ee0 0x7f7a30067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:09.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.060+0000 7f7a2b7fe700 1 -- 172.21.15.82:0/989957026 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7a34081210 con 0x7f7a4406b180 2023-11-28T13:03:09.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.060+0000 7f7a4259c700 1 --2- 172.21.15.82:0/989957026 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a30064ee0 0x7f7a30067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:09.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.060+0000 7f7a4259c700 1 --2- 172.21.15.82:0/989957026 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a30064ee0 0x7f7a30067390 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7a441f5d50 tx=0x7f7a38008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.064+0000 7f7a2b7fe700 1 -- 172.21.15.82:0/989957026 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7a3404f370 con 0x7f7a4406b180 2023-11-28T13:03:09.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.228+0000 7f7a488ab700 1 -- 172.21.15.82:0/989957026 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7a44065fc0 con 0x7f7a4406b180 2023-11-28T13:03:09.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.228+0000 7f7a2b7fe700 1 -- 172.21.15.82:0/989957026 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v52) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7a34052990 con 0x7f7a4406b180 2023-11-28T13:03:09.233 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-11-28T13:03:09.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.232+0000 7f7a488ab700 1 -- 172.21.15.82:0/989957026 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a30064ee0 msgr2=0x7f7a30067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:09.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.232+0000 7f7a488ab700 1 --2- 172.21.15.82:0/989957026 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a30064ee0 0x7f7a30067390 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7a441f5d50 tx=0x7f7a38008040 comp rx=0 tx=0).stop 2023-11-28T13:03:09.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.232+0000 7f7a488ab700 1 -- 172.21.15.82:0/989957026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a4406b180 msgr2=0x7f7a440b3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:09.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.232+0000 7f7a488ab700 1 --2- 172.21.15.82:0/989957026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a4406b180 0x7f7a440b3d90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7a3400c500 tx=0x7f7a3400c8c0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.232+0000 7f7a488ab700 1 -- 172.21.15.82:0/989957026 shutdown_connections 2023-11-28T13:03:09.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.232+0000 7f7a488ab700 1 --2- 172.21.15.82:0/989957026 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a30064ee0 0x7f7a30067390 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.232+0000 7f7a488ab700 1 --2- 172.21.15.82:0/989957026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a441568b0 0x7f7a44158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.232+0000 7f7a488ab700 1 --2- 172.21.15.82:0/989957026 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a440c79a0 0x7f7a441f2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.232+0000 7f7a488ab700 1 --2- 172.21.15.82:0/989957026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a4406b180 0x7f7a440b3d90 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.232+0000 7f7a488ab700 1 -- 172.21.15.82:0/989957026 >> 172.21.15.82:0/989957026 conn(0x7f7a440ce630 msgr2=0x7f7a44150ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:09.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.232+0000 7f7a488ab700 1 -- 172.21.15.82:0/989957026 shutdown_connections 2023-11-28T13:03:09.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.232+0000 7f7a488ab700 1 -- 172.21.15.82:0/989957026 wait complete. 2023-11-28T13:03:09.248 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T13:03:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.364+0000 7fe837fff700 1 Processor -- start 2023-11-28T13:03:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.364+0000 7fe837fff700 1 -- start start 2023-11-28T13:03:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.364+0000 7fe837fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8380d25b0 0x7fe8380cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe837fff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe838069bc0 con 0x7fe83806c140 2023-11-28T13:03:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe837fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8380d1480 con 0x7fe8380b1d10 2023-11-28T13:03:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe837fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8380cd280 con 0x7fe8380d25b0 2023-11-28T13:03:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe8367fc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe83806c140 0x7fe83806a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39946/0 (socket says 172.21.15.82:39946) 2023-11-28T13:03:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe8367fc700 1 -- 172.21.15.82:0/1338745858 learned_addr learned my addr 172.21.15.82:0/1338745858 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe8377fe700 1 --2- 172.21.15.82:0/1338745858 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8380d25b0 0x7fe8380cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:09.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe835ffb700 1 -- 172.21.15.82:0/1338745858 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542141767 0 0) 0x7fe838069bc0 con 0x7fe83806c140 2023-11-28T13:03:09.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe835ffb700 1 -- 172.21.15.82:0/1338745858 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8200035d0 con 0x7fe83806c140 2023-11-28T13:03:09.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe835ffb700 1 -- 172.21.15.82:0/1338745858 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649841537 0 0) 0x7fe8380d1480 con 0x7fe8380b1d10 2023-11-28T13:03:09.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe835ffb700 1 -- 172.21.15.82:0/1338745858 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe838069bc0 con 0x7fe8380b1d10 2023-11-28T13:03:09.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe8377fe700 1 -- 172.21.15.82:0/1338745858 >> v1:172.21.15.114:6789/0 conn(0x7fe8380b1d10 legacy=0x7fe83806ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:09.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe8377fe700 1 -- 172.21.15.82:0/1338745858 >> v1:172.21.15.82:6789/0 conn(0x7fe83806c140 legacy=0x7fe83806a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:09.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe8377fe700 1 -- 172.21.15.82:0/1338745858 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8380cd560 con 0x7fe8380d25b0 2023-11-28T13:03:09.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe8377fe700 1 --2- 172.21.15.82:0/1338745858 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8380d25b0 0x7fe8380cec20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe830009dc0 tx=0x7fe83000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87afad4d9e7917a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:09.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe835ffb700 1 -- 172.21.15.82:0/1338745858 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83000e070 con 0x7fe8380d25b0 2023-11-28T13:03:09.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe835ffb700 1 -- 172.21.15.82:0/1338745858 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83000bb20 con 0x7fe8380d25b0 2023-11-28T13:03:09.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe835ffb700 1 -- 172.21.15.82:0/1338745858 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830012430 con 0x7fe8380d25b0 2023-11-28T13:03:09.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe837fff700 1 -- 172.21.15.82:0/1338745858 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8380d25b0 msgr2=0x7fe8380cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:09.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe837fff700 1 --2- 172.21.15.82:0/1338745858 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8380d25b0 0x7fe8380cec20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe830009dc0 tx=0x7fe83000b330 comp rx=0 tx=0).stop 2023-11-28T13:03:09.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe837fff700 1 -- 172.21.15.82:0/1338745858 shutdown_connections 2023-11-28T13:03:09.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe837fff700 1 --2- 172.21.15.82:0/1338745858 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8380d25b0 0x7fe8380cec20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe837fff700 1 -- 172.21.15.82:0/1338745858 >> 172.21.15.82:0/1338745858 conn(0x7fe8380b52a0 msgr2=0x7fe8380d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:09.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe837fff700 1 -- 172.21.15.82:0/1338745858 shutdown_connections 2023-11-28T13:03:09.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.368+0000 7fe837fff700 1 -- 172.21.15.82:0/1338745858 wait complete. 2023-11-28T13:03:09.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.372+0000 7fe837fff700 1 Processor -- start 2023-11-28T13:03:09.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.372+0000 7fe837fff700 1 -- start start 2023-11-28T13:03:09.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.372+0000 7fe837fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe83806c140 0x7fe83815ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:09.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.372+0000 7fe837fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8380b1d10 0x7fe83815da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:09.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.372+0000 7fe837fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8380d25b0 0x7fe8380b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:09.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.372+0000 7fe837fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8381f1950 con 0x7fe83806c140 2023-11-28T13:03:09.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.372+0000 7fe837fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83815df90 con 0x7fe8380d25b0 2023-11-28T13:03:09.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.372+0000 7fe837fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8380b1340 con 0x7fe8380b1d10 2023-11-28T13:03:09.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.372+0000 7fe836ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe83806c140 0x7fe83815ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:09.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.372+0000 7fe836ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe83806c140 0x7fe83815ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41768/0 (socket says 172.21.15.82:41768) 2023-11-28T13:03:09.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.372+0000 7fe836ffd700 1 -- 172.21.15.82:0/2275683404 learned_addr learned my addr 172.21.15.82:0/2275683404 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:09.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.372+0000 7fe8377fe700 1 --2- 172.21.15.82:0/2275683404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8380d25b0 0x7fe8380b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:09.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.372+0000 7fe836ffd700 1 -- 172.21.15.82:0/2275683404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8380b1d10 msgr2=0x7fe83815da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:09.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.372+0000 7fe8367fc700 1 --2- 172.21.15.82:0/2275683404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8380b1d10 0x7fe83815da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:09.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.372+0000 7fe836ffd700 1 --2- 172.21.15.82:0/2275683404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8380b1d10 0x7fe83815da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.372+0000 7fe836ffd700 1 -- 172.21.15.82:0/2275683404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8380d25b0 msgr2=0x7fe8380b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:09.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.372+0000 7fe836ffd700 1 --2- 172.21.15.82:0/2275683404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8380d25b0 0x7fe8380b0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.372+0000 7fe836ffd700 1 -- 172.21.15.82:0/2275683404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe830009a70 con 0x7fe83806c140 2023-11-28T13:03:09.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.372+0000 7fe8377fe700 1 --2- 172.21.15.82:0/2275683404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8380d25b0 0x7fe8380b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:03:09.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.372+0000 7fe8367fc700 1 --2- 172.21.15.82:0/2275683404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8380b1d10 0x7fe83815da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:03:09.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.372+0000 7fe836ffd700 1 --2- 172.21.15.82:0/2275683404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe83806c140 0x7fe83815ba90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00c730 tx=0x7fe82c00caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:09.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.376+0000 7fe81f7fe700 1 -- 172.21.15.82:0/2275683404 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c0052d0 con 0x7fe83806c140 2023-11-28T13:03:09.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.376+0000 7fe81f7fe700 1 -- 172.21.15.82:0/2275683404 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c005430 con 0x7fe83806c140 2023-11-28T13:03:09.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.376+0000 7fe837fff700 1 -- 172.21.15.82:0/2275683404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8380d1050 con 0x7fe83806c140 2023-11-28T13:03:09.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.376+0000 7fe81f7fe700 1 -- 172.21.15.82:0/2275683404 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c0055a0 con 0x7fe83806c140 2023-11-28T13:03:09.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.376+0000 7fe837fff700 1 -- 172.21.15.82:0/2275683404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8380b20e0 con 0x7fe83806c140 2023-11-28T13:03:09.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.376+0000 7fe837fff700 1 -- 172.21.15.82:0/2275683404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8380d11e0 con 0x7fe83806c140 2023-11-28T13:03:09.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.376+0000 7fe81f7fe700 1 -- 172.21.15.82:0/2275683404 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe82c019030 con 0x7fe83806c140 2023-11-28T13:03:09.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.376+0000 7fe81f7fe700 1 --2- 172.21.15.82:0/2275683404 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe824064ee0 0x7fe824067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:09.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.376+0000 7fe8367fc700 1 --2- 172.21.15.82:0/2275683404 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe824064ee0 0x7fe824067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:09.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.376+0000 7fe81f7fe700 1 -- 172.21.15.82:0/2275683404 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe82c0813a0 con 0x7fe83806c140 2023-11-28T13:03:09.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.380+0000 7fe8367fc700 1 --2- 172.21.15.82:0/2275683404 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe824064ee0 0x7fe824067390 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe8380b5e80 tx=0x7fe828009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:09.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.380+0000 7fe81f7fe700 1 -- 172.21.15.82:0/2275683404 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe82c04f480 con 0x7fe83806c140 2023-11-28T13:03:09.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.544+0000 7fe837fff700 1 -- 172.21.15.82:0/2275683404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe838065fc0 con 0x7fe83806c140 2023-11-28T13:03:09.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.544+0000 7fe81f7fe700 1 -- 172.21.15.82:0/2275683404 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v52) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe82c017020 con 0x7fe83806c140 2023-11-28T13:03:09.548 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-11-28T13:03:09.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.544+0000 7fe837fff700 1 -- 172.21.15.82:0/2275683404 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe824064ee0 msgr2=0x7fe824067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:09.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.544+0000 7fe837fff700 1 --2- 172.21.15.82:0/2275683404 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe824064ee0 0x7fe824067390 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe8380b5e80 tx=0x7fe828009040 comp rx=0 tx=0).stop 2023-11-28T13:03:09.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.544+0000 7fe837fff700 1 -- 172.21.15.82:0/2275683404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe83806c140 msgr2=0x7fe83815ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:09.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.544+0000 7fe837fff700 1 --2- 172.21.15.82:0/2275683404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe83806c140 0x7fe83815ba90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00c730 tx=0x7fe82c00caf0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.544+0000 7fe837fff700 1 -- 172.21.15.82:0/2275683404 shutdown_connections 2023-11-28T13:03:09.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.544+0000 7fe837fff700 1 --2- 172.21.15.82:0/2275683404 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe824064ee0 0x7fe824067390 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.544+0000 7fe837fff700 1 --2- 172.21.15.82:0/2275683404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8380d25b0 0x7fe8380b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.544+0000 7fe837fff700 1 --2- 172.21.15.82:0/2275683404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8380b1d10 0x7fe83815da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.544+0000 7fe837fff700 1 --2- 172.21.15.82:0/2275683404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe83806c140 0x7fe83815ba90 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.544+0000 7fe837fff700 1 -- 172.21.15.82:0/2275683404 >> 172.21.15.82:0/2275683404 conn(0x7fe8380b52a0 msgr2=0x7fe8380d16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:09.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.544+0000 7fe837fff700 1 -- 172.21.15.82:0/2275683404 shutdown_connections 2023-11-28T13:03:09.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.544+0000 7fe837fff700 1 -- 172.21.15.82:0/2275683404 wait complete. 2023-11-28T13:03:09.563 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:03:09.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1df59e700 1 Processor -- start 2023-11-28T13:03:09.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1df59e700 1 -- start start 2023-11-28T13:03:09.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1df59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc1e0160900 0x7fc1e00cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:09.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1df59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1e00c1910 0x7fc1e006c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:09.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1df59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e00ce030 con 0x7fc1e0070070 2023-11-28T13:03:09.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1df59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e00ce310 con 0x7fc1e0160900 2023-11-28T13:03:09.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1df59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e006a5d0 con 0x7fc1e00c1910 2023-11-28T13:03:09.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1ddd9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc1e0160900 0x7fc1e00cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:09.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1ddd9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc1e0160900 0x7fc1e00cc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41774/0 (socket says 172.21.15.82:41774) 2023-11-28T13:03:09.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1ddd9b700 1 -- 172.21.15.82:0/3414727889 learned_addr learned my addr 172.21.15.82:0/3414727889 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:09.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1ded9d700 1 --2- 172.21.15.82:0/3414727889 >> v2:172.21.15.114:3300/0 conn(0x7fc1e00c1910 0x7fc1e006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:09.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1ddd9b700 1 -- 172.21.15.82:0/3414727889 >> v2:172.21.15.114:3300/0 conn(0x7fc1e00c1910 msgr2=0x7fc1e006c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:09.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1ddd9b700 1 --2- 172.21.15.82:0/3414727889 >> v2:172.21.15.114:3300/0 conn(0x7fc1e00c1910 0x7fc1e006c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1ddd9b700 1 -- 172.21.15.82:0/3414727889 >> v1:172.21.15.114:6789/0 conn(0x7fc1e0070070 legacy=0x7fc1e0070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:09.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1ddd9b700 1 -- 172.21.15.82:0/3414727889 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e006a8b0 con 0x7fc1e0160900 2023-11-28T13:03:09.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1ddd9b700 1 --2- 172.21.15.82:0/3414727889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e0160900 0x7fc1e00cc1d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00b4530 tx=0x7fc1d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e968e9da29726a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:09.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1dd59a700 1 -- 172.21.15.82:0/3414727889 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d800e070 con 0x7fc1e0160900 2023-11-28T13:03:09.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1dd59a700 1 -- 172.21.15.82:0/3414727889 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d800b910 con 0x7fc1e0160900 2023-11-28T13:03:09.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1dd59a700 1 -- 172.21.15.82:0/3414727889 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d800bcc0 con 0x7fc1e0160900 2023-11-28T13:03:09.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1df59e700 1 -- 172.21.15.82:0/3414727889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e0160900 msgr2=0x7fc1e00cc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:09.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1df59e700 1 --2- 172.21.15.82:0/3414727889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e0160900 0x7fc1e00cc1d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00b4530 tx=0x7fc1d800b330 comp rx=0 tx=0).stop 2023-11-28T13:03:09.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1df59e700 1 -- 172.21.15.82:0/3414727889 shutdown_connections 2023-11-28T13:03:09.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1df59e700 1 --2- 172.21.15.82:0/3414727889 >> v2:172.21.15.114:3300/0 conn(0x7fc1e00c1910 0x7fc1e006c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1df59e700 1 --2- 172.21.15.82:0/3414727889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e0160900 0x7fc1e00cc1d0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1df59e700 1 -- 172.21.15.82:0/3414727889 >> 172.21.15.82:0/3414727889 conn(0x7fc1e00ce600 msgr2=0x7fc1e00ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:09.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1df59e700 1 -- 172.21.15.82:0/3414727889 shutdown_connections 2023-11-28T13:03:09.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.676+0000 7fc1df59e700 1 -- 172.21.15.82:0/3414727889 wait complete. 2023-11-28T13:03:09.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.680+0000 7fc1df59e700 1 Processor -- start 2023-11-28T13:03:09.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.680+0000 7fc1df59e700 1 -- start start 2023-11-28T13:03:09.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.680+0000 7fc1df59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1e0070070 0x7fc1e00c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:09.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.680+0000 7fc1df59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e00c2330 0x7fc1e01f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:09.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.680+0000 7fc1df59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e01f9b80 0x7fc1e01f9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:09.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.680+0000 7fc1df59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e01f6430 con 0x7fc1e01f9b80 2023-11-28T13:03:09.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.680+0000 7fc1df59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e00c27a0 con 0x7fc1e00c2330 2023-11-28T13:03:09.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.680+0000 7fc1df59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e01f6660 con 0x7fc1e0070070 2023-11-28T13:03:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.680+0000 7fc1ded9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e01f9b80 0x7fc1e01f9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.680+0000 7fc1ddd9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e00c2330 0x7fc1e01f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.680+0000 7fc1de59c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1e0070070 0x7fc1e00c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.680+0000 7fc1ddd9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e00c2330 0x7fc1e01f5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:43798/0 (socket says 172.21.15.82:43798) 2023-11-28T13:03:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.680+0000 7fc1ddd9b700 1 -- 172.21.15.82:0/1522451643 learned_addr learned my addr 172.21.15.82:0/1522451643 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.680+0000 7fc1ddd9b700 1 -- 172.21.15.82:0/1522451643 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1e0070070 msgr2=0x7fc1e00c32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.680+0000 7fc1ddd9b700 1 --2- 172.21.15.82:0/1522451643 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1e0070070 0x7fc1e00c32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.680+0000 7fc1ddd9b700 1 -- 172.21.15.82:0/1522451643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e01f9b80 msgr2=0x7fc1e01f9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:09.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.680+0000 7fc1ddd9b700 1 --2- 172.21.15.82:0/1522451643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e01f9b80 0x7fc1e01f9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.680+0000 7fc1ddd9b700 1 -- 172.21.15.82:0/1522451643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d8009b30 con 0x7fc1e00c2330 2023-11-28T13:03:09.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.680+0000 7fc1ded9d700 1 --2- 172.21.15.82:0/1522451643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e01f9b80 0x7fc1e01f9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:03:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.680+0000 7fc1ddd9b700 1 --2- 172.21.15.82:0/1522451643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e00c2330 0x7fc1e01f5ef0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0071980 tx=0x7fc1d8004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:09.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.684+0000 7fc1d6ffd700 1 -- 172.21.15.82:0/1522451643 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80048c0 con 0x7fc1e00c2330 2023-11-28T13:03:09.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.684+0000 7fc1d6ffd700 1 -- 172.21.15.82:0/1522451643 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d80099b0 con 0x7fc1e00c2330 2023-11-28T13:03:09.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.684+0000 7fc1df59e700 1 -- 172.21.15.82:0/1522451643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e00cc710 con 0x7fc1e00c2330 2023-11-28T13:03:09.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.684+0000 7fc1d6ffd700 1 -- 172.21.15.82:0/1522451643 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d801c680 con 0x7fc1e00c2330 2023-11-28T13:03:09.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.684+0000 7fc1df59e700 1 -- 172.21.15.82:0/1522451643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e006ab90 con 0x7fc1e00c2330 2023-11-28T13:03:09.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.684+0000 7fc1df59e700 1 -- 172.21.15.82:0/1522451643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e00cdc50 con 0x7fc1e00c2330 2023-11-28T13:03:09.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.684+0000 7fc1d6ffd700 1 -- 172.21.15.82:0/1522451643 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc1d8022030 con 0x7fc1e00c2330 2023-11-28T13:03:09.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.684+0000 7fc1d6ffd700 1 --2- 172.21.15.82:0/1522451643 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc1c0064ee0 0x7fc1c0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:09.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.684+0000 7fc1de59c700 1 --2- 172.21.15.82:0/1522451643 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc1c0064ee0 0x7fc1c0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:09.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.688+0000 7fc1d6ffd700 1 -- 172.21.15.82:0/1522451643 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc1d80838c0 con 0x7fc1e00c2330 2023-11-28T13:03:09.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.688+0000 7fc1de59c700 1 --2- 172.21.15.82:0/1522451643 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc1c0064ee0 0x7fc1c0067390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8000f60 tx=0x7fc1c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:09.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.696+0000 7fc1d6ffd700 1 -- 172.21.15.82:0/1522451643 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc1d8051a60 con 0x7fc1e00c2330 2023-11-28T13:03:09.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.892+0000 7fc1df59e700 1 -- 172.21.15.82:0/1522451643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1e0065fc0 con 0x7fc1e00c2330 2023-11-28T13:03:09.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.896+0000 7fc1d6ffd700 1 -- 172.21.15.82:0/1522451643 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4651 (secure 0 0 0) 0x7fc1d8055080 con 0x7fc1e00c2330 2023-11-28T13:03:09.900 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:09.900 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/704061431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":704061431},{"type":"v1","addr":"172.21.15.114:6834","nonce":704061431}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3972503523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3972503523},{"type":"v1","addr":"172.21.15.82:6836","nonce":3972503523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5811,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2000262220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2000262220},{"type":"v1","addr":"172.21.15.82:6837","nonce":2000262220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:02:20.454524+0000","modified":"2023-11-28T13:02:23.476763+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5814":{"gid":5814,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/4092152651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":4092152651},{"type":"v1","addr":"172.21.15.114:6835","nonce":4092152651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T13:03:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.900+0000 7fc1df59e700 1 -- 172.21.15.82:0/1522451643 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc1c0064ee0 msgr2=0x7fc1c0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.900+0000 7fc1df59e700 1 --2- 172.21.15.82:0/1522451643 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc1c0064ee0 0x7fc1c0067390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8000f60 tx=0x7fc1c8009040 comp rx=0 tx=0).stop 2023-11-28T13:03:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.900+0000 7fc1df59e700 1 -- 172.21.15.82:0/1522451643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e00c2330 msgr2=0x7fc1e01f5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.900+0000 7fc1df59e700 1 --2- 172.21.15.82:0/1522451643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e00c2330 0x7fc1e01f5ef0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0071980 tx=0x7fc1d8004af0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.900+0000 7fc1df59e700 1 -- 172.21.15.82:0/1522451643 shutdown_connections 2023-11-28T13:03:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.900+0000 7fc1df59e700 1 --2- 172.21.15.82:0/1522451643 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc1c0064ee0 0x7fc1c0067390 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.900+0000 7fc1df59e700 1 --2- 172.21.15.82:0/1522451643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e01f9b80 0x7fc1e01f9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.900+0000 7fc1df59e700 1 --2- 172.21.15.82:0/1522451643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e00c2330 0x7fc1e01f5ef0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.900+0000 7fc1df59e700 1 --2- 172.21.15.82:0/1522451643 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1e0070070 0x7fc1e00c32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.900+0000 7fc1df59e700 1 -- 172.21.15.82:0/1522451643 >> 172.21.15.82:0/1522451643 conn(0x7fc1e00ce600 msgr2=0x7fc1e00af5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:09.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.900+0000 7fc1df59e700 1 -- 172.21.15.82:0/1522451643 shutdown_connections 2023-11-28T13:03:09.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:09.900+0000 7fc1df59e700 1 -- 172.21.15.82:0/1522451643 wait complete. 2023-11-28T13:03:09.907 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 22 2023-11-28T13:03:09.921 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:03:10.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.028+0000 7f02d7092700 1 Processor -- start 2023-11-28T13:03:10.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.028+0000 7f02d7092700 1 -- start start 2023-11-28T13:03:10.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d7092700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02d0070070 0x7f02d0070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:10.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d7092700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f02d0160900 0x7f02d00cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:10.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d7092700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d0070980 con 0x7f02d00c1910 2023-11-28T13:03:10.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d7092700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d00ce030 con 0x7f02d0160900 2023-11-28T13:03:10.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d7092700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d00ce310 con 0x7f02d0070070 2023-11-28T13:03:10.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d588f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f02d0160900 0x7f02d00cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:10.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d6891700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f02d00c1910 0x7f02d01641e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39960/0 (socket says 172.21.15.82:39960) 2023-11-28T13:03:10.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d6891700 1 -- 172.21.15.82:0/405295464 learned_addr learned my addr 172.21.15.82:0/405295464 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:10.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d6090700 1 --2- 172.21.15.82:0/405295464 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02d0070070 0x7f02d0070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:10.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d508e700 1 -- 172.21.15.82:0/405295464 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851734291 0 0) 0x7f02d0070980 con 0x7f02d00c1910 2023-11-28T13:03:10.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d508e700 1 -- 172.21.15.82:0/405295464 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02b80035d0 con 0x7f02d00c1910 2023-11-28T13:03:10.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d588f700 1 -- 172.21.15.82:0/405295464 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02d0070070 msgr2=0x7f02d0070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:10.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d588f700 1 --2- 172.21.15.82:0/405295464 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02d0070070 0x7f02d0070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d588f700 1 -- 172.21.15.82:0/405295464 >> v1:172.21.15.82:6789/0 conn(0x7f02d00c1910 legacy=0x7f02d01641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:10.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d588f700 1 -- 172.21.15.82:0/405295464 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d006a5d0 con 0x7f02d0160900 2023-11-28T13:03:10.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d588f700 1 --2- 172.21.15.82:0/405295464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d0160900 0x7f02d00cc1d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009850 tx=0x7f02c4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b791f8acc521e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:10.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d508e700 1 -- 172.21.15.82:0/405295464 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4011830 con 0x7f02d0160900 2023-11-28T13:03:10.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d508e700 1 -- 172.21.15.82:0/405295464 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c4011990 con 0x7f02d0160900 2023-11-28T13:03:10.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d508e700 1 -- 172.21.15.82:0/405295464 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4011d40 con 0x7f02d0160900 2023-11-28T13:03:10.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d7092700 1 -- 172.21.15.82:0/405295464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d0160900 msgr2=0x7f02d00cc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:10.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d7092700 1 --2- 172.21.15.82:0/405295464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d0160900 0x7f02d00cc1d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009850 tx=0x7f02c4009b60 comp rx=0 tx=0).stop 2023-11-28T13:03:10.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d7092700 1 -- 172.21.15.82:0/405295464 shutdown_connections 2023-11-28T13:03:10.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d7092700 1 --2- 172.21.15.82:0/405295464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d0160900 0x7f02d00cc1d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d7092700 1 --2- 172.21.15.82:0/405295464 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02d0070070 0x7f02d0070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d7092700 1 -- 172.21.15.82:0/405295464 >> 172.21.15.82:0/405295464 conn(0x7f02d00ce600 msgr2=0x7f02d00ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:10.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d7092700 1 -- 172.21.15.82:0/405295464 shutdown_connections 2023-11-28T13:03:10.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.032+0000 7f02d7092700 1 -- 172.21.15.82:0/405295464 wait complete. 2023-11-28T13:03:10.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.036+0000 7f02d7092700 1 Processor -- start 2023-11-28T13:03:10.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.036+0000 7f02d7092700 1 -- start start 2023-11-28T13:03:10.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.036+0000 7f02d7092700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02d0070070 0x7f02d01f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:10.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.036+0000 7f02d7092700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02d00c47a0 0x7f02d0162a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:10.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.036+0000 7f02d7092700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d00c2b40 0x7f02d0162fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:10.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.036+0000 7f02d7092700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d00c64a0 con 0x7f02d00c2b40 2023-11-28T13:03:10.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.036+0000 7f02d7092700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d01f5de0 con 0x7f02d0070070 2023-11-28T13:03:10.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.036+0000 7f02d7092700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d00c3c60 con 0x7f02d00c47a0 2023-11-28T13:03:10.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.036+0000 7f02d6891700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d00c2b40 0x7f02d0162fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:10.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.036+0000 7f02d6891700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d00c2b40 0x7f02d0162fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41802/0 (socket says 172.21.15.82:41802) 2023-11-28T13:03:10.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.036+0000 7f02d6090700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02d0070070 0x7f02d01f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:10.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.036+0000 7f02d6891700 1 -- 172.21.15.82:0/271170412 learned_addr learned my addr 172.21.15.82:0/271170412 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:10.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.040+0000 7f02d588f700 1 --2- 172.21.15.82:0/271170412 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02d00c47a0 0x7f02d0162a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:10.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.040+0000 7f02d6891700 1 -- 172.21.15.82:0/271170412 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02d00c47a0 msgr2=0x7f02d0162a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:10.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.040+0000 7f02d6891700 1 --2- 172.21.15.82:0/271170412 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02d00c47a0 0x7f02d0162a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.040+0000 7f02d6891700 1 -- 172.21.15.82:0/271170412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02d0070070 msgr2=0x7f02d01f58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:10.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.040+0000 7f02d6891700 1 --2- 172.21.15.82:0/271170412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02d0070070 0x7f02d01f58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.040+0000 7f02d6891700 1 -- 172.21.15.82:0/271170412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c40094b0 con 0x7f02d00c2b40 2023-11-28T13:03:10.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.040+0000 7f02d6891700 1 --2- 172.21.15.82:0/271170412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d00c2b40 0x7f02d0162fb0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f02c0005930 tx=0x7f02c000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:10.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.040+0000 7f02ceffd700 1 -- 172.21.15.82:0/271170412 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c0005d90 con 0x7f02d00c2b40 2023-11-28T13:03:10.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.040+0000 7f02ceffd700 1 -- 172.21.15.82:0/271170412 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c000ce50 con 0x7f02d00c2b40 2023-11-28T13:03:10.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.040+0000 7f02ceffd700 1 -- 172.21.15.82:0/271170412 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c00072d0 con 0x7f02d00c2b40 2023-11-28T13:03:10.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.040+0000 7f02d7092700 1 -- 172.21.15.82:0/271170412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d006ab90 con 0x7f02d00c2b40 2023-11-28T13:03:10.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.040+0000 7f02d7092700 1 -- 172.21.15.82:0/271170412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d006a8b0 con 0x7f02d00c2b40 2023-11-28T13:03:10.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.040+0000 7f02d7092700 1 -- 172.21.15.82:0/271170412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d00cc710 con 0x7f02d00c2b40 2023-11-28T13:03:10.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.040+0000 7f02ceffd700 1 -- 172.21.15.82:0/271170412 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f02c0019030 con 0x7f02d00c2b40 2023-11-28T13:03:10.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.040+0000 7f02ceffd700 1 --2- 172.21.15.82:0/271170412 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f02bc064ee0 0x7f02bc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:10.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.040+0000 7f02ceffd700 1 -- 172.21.15.82:0/271170412 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f02c0080f80 con 0x7f02d00c2b40 2023-11-28T13:03:10.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.044+0000 7f02d6090700 1 --2- 172.21.15.82:0/271170412 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f02bc064ee0 0x7f02bc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:10.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.044+0000 7f02d6090700 1 --2- 172.21.15.82:0/271170412 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f02bc064ee0 0x7f02bc067390 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f02d00ccc20 tx=0x7f02c800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:10.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.048+0000 7f02ceffd700 1 -- 172.21.15.82:0/271170412 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f02c004a400 con 0x7f02d00c2b40 2023-11-28T13:03:10.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.208+0000 7f02d7092700 1 -- 172.21.15.82:0/271170412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02d0065fc0 con 0x7f02d00c2b40 2023-11-28T13:03:10.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.212+0000 7f02ceffd700 1 -- 172.21.15.82:0/271170412 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+17923 (secure 0 0 0) 0x7f02c004f190 con 0x7f02d00c2b40 2023-11-28T13:03:10.217 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:10.217 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":53,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:03:09.963667+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:02:19.012136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T13:02:19.431685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1d","mappings":[{"from":0,"to":6}]},{"pgid":"8.37","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:03:10.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.216+0000 7f02d7092700 1 -- 172.21.15.82:0/271170412 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f02bc064ee0 msgr2=0x7f02bc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:10.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.216+0000 7f02d7092700 1 --2- 172.21.15.82:0/271170412 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f02bc064ee0 0x7f02bc067390 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f02d00ccc20 tx=0x7f02c800b040 comp rx=0 tx=0).stop 2023-11-28T13:03:10.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.216+0000 7f02d7092700 1 -- 172.21.15.82:0/271170412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d00c2b40 msgr2=0x7f02d0162fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:10.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.216+0000 7f02d7092700 1 --2- 172.21.15.82:0/271170412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d00c2b40 0x7f02d0162fb0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f02c0005930 tx=0x7f02c000c7b0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.216+0000 7f02d7092700 1 -- 172.21.15.82:0/271170412 shutdown_connections 2023-11-28T13:03:10.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.216+0000 7f02d7092700 1 --2- 172.21.15.82:0/271170412 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f02bc064ee0 0x7f02bc067390 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.216+0000 7f02d7092700 1 --2- 172.21.15.82:0/271170412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02d00c2b40 0x7f02d0162fb0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.216+0000 7f02d7092700 1 --2- 172.21.15.82:0/271170412 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02d00c47a0 0x7f02d0162a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.216+0000 7f02d7092700 1 --2- 172.21.15.82:0/271170412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02d0070070 0x7f02d01f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.216+0000 7f02d7092700 1 -- 172.21.15.82:0/271170412 >> 172.21.15.82:0/271170412 conn(0x7f02d00ce600 msgr2=0x7f02d0070440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:10.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.216+0000 7f02d7092700 1 -- 172.21.15.82:0/271170412 shutdown_connections 2023-11-28T13:03:10.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.216+0000 7f02d7092700 1 -- 172.21.15.82:0/271170412 wait complete. 2023-11-28T13:03:10.231 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T13:03:10.231 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:03:10.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.340+0000 7f5eee2b3700 1 Processor -- start 2023-11-28T13:03:10.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.340+0000 7f5eee2b3700 1 -- start start 2023-11-28T13:03:10.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.340+0000 7f5eee2b3700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5ee80b6140 0x7f5ee80afb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:10.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.340+0000 7f5eee2b3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5ee815b6e0 0x7f5ee80d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:10.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.340+0000 7f5eee2b3700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5ee815a580 0x7f5ee815aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:10.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.340+0000 7f5eee2b3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee80cb240 con 0x7f5ee815b6e0 2023-11-28T13:03:10.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eee2b3700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee815c820 con 0x7f5ee815a580 2023-11-28T13:03:10.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eee2b3700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee815af40 con 0x7f5ee80b6140 2023-11-28T13:03:10.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eecab0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5ee815b6e0 0x7f5ee80d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:10.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eecab0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5ee815b6e0 0x7f5ee80d0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41812/0 (socket says 172.21.15.82:41812) 2023-11-28T13:03:10.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eecab0700 1 -- 172.21.15.82:0/221783955 learned_addr learned my addr 172.21.15.82:0/221783955 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:10.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eed2b1700 1 --2- 172.21.15.82:0/221783955 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5ee80b6140 0x7f5ee80afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:10.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eedab2700 1 --2- 172.21.15.82:0/221783955 >> v2:172.21.15.114:3300/0 conn(0x7f5ee815a580 0x7f5ee815aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:10.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eecab0700 1 -- 172.21.15.82:0/221783955 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5ee80b6140 msgr2=0x7f5ee80afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:10.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eecab0700 1 --2- 172.21.15.82:0/221783955 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5ee80b6140 0x7f5ee80afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eecab0700 1 -- 172.21.15.82:0/221783955 >> v2:172.21.15.114:3300/0 conn(0x7f5ee815a580 msgr2=0x7f5ee815aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:10.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eecab0700 1 --2- 172.21.15.82:0/221783955 >> v2:172.21.15.114:3300/0 conn(0x7f5ee815a580 0x7f5ee815aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eecab0700 1 -- 172.21.15.82:0/221783955 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee80b0050 con 0x7f5ee815b6e0 2023-11-28T13:03:10.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eecab0700 1 --2- 172.21.15.82:0/221783955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ee815b6e0 0x7f5ee80d0f40 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5ee806a5c0 tx=0x7f5ee4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42dc618f99a1ed29 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:10.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5edbfff700 1 -- 172.21.15.82:0/221783955 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee400b8a0 con 0x7f5ee815b6e0 2023-11-28T13:03:10.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5edbfff700 1 -- 172.21.15.82:0/221783955 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee400ba00 con 0x7f5ee815b6e0 2023-11-28T13:03:10.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5edbfff700 1 -- 172.21.15.82:0/221783955 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee400bd90 con 0x7f5ee815b6e0 2023-11-28T13:03:10.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eee2b3700 1 -- 172.21.15.82:0/221783955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ee815b6e0 msgr2=0x7f5ee80d0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:10.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eee2b3700 1 --2- 172.21.15.82:0/221783955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ee815b6e0 0x7f5ee80d0f40 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5ee806a5c0 tx=0x7f5ee4009bf0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eee2b3700 1 -- 172.21.15.82:0/221783955 shutdown_connections 2023-11-28T13:03:10.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eee2b3700 1 --2- 172.21.15.82:0/221783955 >> v2:172.21.15.114:3300/0 conn(0x7f5ee815a580 0x7f5ee815aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eee2b3700 1 --2- 172.21.15.82:0/221783955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ee815b6e0 0x7f5ee80d0f40 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eee2b3700 1 --2- 172.21.15.82:0/221783955 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5ee80b6140 0x7f5ee80afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eee2b3700 1 -- 172.21.15.82:0/221783955 >> 172.21.15.82:0/221783955 conn(0x7f5ee80cdf40 msgr2=0x7f5ee80d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:10.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eee2b3700 1 -- 172.21.15.82:0/221783955 shutdown_connections 2023-11-28T13:03:10.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.344+0000 7f5eee2b3700 1 -- 172.21.15.82:0/221783955 wait complete. 2023-11-28T13:03:10.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.348+0000 7f5eee2b3700 1 Processor -- start 2023-11-28T13:03:10.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.348+0000 7f5eee2b3700 1 -- start start 2023-11-28T13:03:10.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.348+0000 7f5eee2b3700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5ee80b6140 0x7f5ee8155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:10.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.348+0000 7f5eee2b3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ee815a580 0x7f5ee80b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:10.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.348+0000 7f5eee2b3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ee815b6e0 0x7f5ee8157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:10.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.348+0000 7f5eee2b3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80c92c0 con 0x7f5ee815a580 2023-11-28T13:03:10.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.348+0000 7f5eee2b3700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee8156340 con 0x7f5ee815b6e0 2023-11-28T13:03:10.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.348+0000 7f5eee2b3700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80c86b0 con 0x7f5ee80b6140 2023-11-28T13:03:10.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.348+0000 7f5eecab0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ee815a580 0x7f5ee80b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:10.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.348+0000 7f5eecab0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ee815a580 0x7f5ee80b4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41824/0 (socket says 172.21.15.82:41824) 2023-11-28T13:03:10.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.348+0000 7f5eecab0700 1 -- 172.21.15.82:0/2618664184 learned_addr learned my addr 172.21.15.82:0/2618664184 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:10.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.348+0000 7f5eed2b1700 1 --2- 172.21.15.82:0/2618664184 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5ee80b6140 0x7f5ee8155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:10.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.348+0000 7f5eedab2700 1 --2- 172.21.15.82:0/2618664184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ee815b6e0 0x7f5ee8157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:10.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.348+0000 7f5eecab0700 1 -- 172.21.15.82:0/2618664184 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5ee80b6140 msgr2=0x7f5ee8155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:10.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.348+0000 7f5eecab0700 1 --2- 172.21.15.82:0/2618664184 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5ee80b6140 0x7f5ee8155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.348+0000 7f5eecab0700 1 -- 172.21.15.82:0/2618664184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ee815b6e0 msgr2=0x7f5ee8157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.348+0000 7f5eecab0700 1 --2- 172.21.15.82:0/2618664184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ee815b6e0 0x7f5ee8157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.348+0000 7f5eecab0700 1 -- 172.21.15.82:0/2618664184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee4009570 con 0x7f5ee815a580 2023-11-28T13:03:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.348+0000 7f5eedab2700 1 --2- 172.21.15.82:0/2618664184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ee815b6e0 0x7f5ee8157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.348+0000 7f5eecab0700 1 --2- 172.21.15.82:0/2618664184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ee815a580 0x7f5ee80b4910 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80666e0 tx=0x7f5ee4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.352+0000 7f5ed9ffb700 1 -- 172.21.15.82:0/2618664184 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4004460 con 0x7f5ee815a580 2023-11-28T13:03:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.352+0000 7f5ed9ffb700 1 -- 172.21.15.82:0/2618664184 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee401e070 con 0x7f5ee815a580 2023-11-28T13:03:10.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.352+0000 7f5eee2b3700 1 -- 172.21.15.82:0/2618664184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee815bc10 con 0x7f5ee815a580 2023-11-28T13:03:10.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.352+0000 7f5ed9ffb700 1 -- 172.21.15.82:0/2618664184 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4012ad0 con 0x7f5ee815a580 2023-11-28T13:03:10.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.352+0000 7f5eee2b3700 1 -- 172.21.15.82:0/2618664184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee80d1480 con 0x7f5ee815a580 2023-11-28T13:03:10.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.352+0000 7f5eee2b3700 1 -- 172.21.15.82:0/2618664184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee815bef0 con 0x7f5ee815a580 2023-11-28T13:03:10.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.352+0000 7f5ed9ffb700 1 -- 172.21.15.82:0/2618664184 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5ee400f050 con 0x7f5ee815a580 2023-11-28T13:03:10.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.352+0000 7f5ed9ffb700 1 --2- 172.21.15.82:0/2618664184 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5ecc064ee0 0x7f5ecc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:10.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.352+0000 7f5ed9ffb700 1 -- 172.21.15.82:0/2618664184 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5ee4020070 con 0x7f5ee815a580 2023-11-28T13:03:10.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.352+0000 7f5eed2b1700 1 --2- 172.21.15.82:0/2618664184 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5ecc064ee0 0x7f5ecc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:10.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.356+0000 7f5eed2b1700 1 --2- 172.21.15.82:0/2618664184 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5ecc064ee0 0x7f5ecc067390 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009970 tx=0x7f5edc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:10.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.360+0000 7f5ed9ffb700 1 -- 172.21.15.82:0/2618664184 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5ee4051900 con 0x7f5ee815a580 2023-11-28T13:03:10.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.560+0000 7f5eee2b3700 1 -- 172.21.15.82:0/2618664184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ee8065fc0 con 0x7f5ee815a580 2023-11-28T13:03:10.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.564+0000 7f5ed9ffb700 1 -- 172.21.15.82:0/2618664184 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f5ee4054f20 con 0x7f5ee815a580 2023-11-28T13:03:10.568 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:10.568 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/704061431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":704061431},{"type":"v1","addr":"172.21.15.114:6834","nonce":704061431}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3972503523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3972503523},{"type":"v1","addr":"172.21.15.82:6836","nonce":3972503523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5811,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2000262220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2000262220},{"type":"v1","addr":"172.21.15.82:6837","nonce":2000262220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:02:20.454524+0000","modified":"2023-11-28T13:02:23.476763+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5814":{"gid":5814,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/4092152651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":4092152651},{"type":"v1","addr":"172.21.15.114:6835","nonce":4092152651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T13:03:10.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.564+0000 7f5eee2b3700 1 -- 172.21.15.82:0/2618664184 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5ecc064ee0 msgr2=0x7f5ecc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:10.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.564+0000 7f5eee2b3700 1 --2- 172.21.15.82:0/2618664184 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5ecc064ee0 0x7f5ecc067390 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009970 tx=0x7f5edc008040 comp rx=0 tx=0).stop 2023-11-28T13:03:10.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.564+0000 7f5eee2b3700 1 -- 172.21.15.82:0/2618664184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ee815a580 msgr2=0x7f5ee80b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:10.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.564+0000 7f5eee2b3700 1 --2- 172.21.15.82:0/2618664184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ee815a580 0x7f5ee80b4910 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80666e0 tx=0x7f5ee4004770 comp rx=0 tx=0).stop 2023-11-28T13:03:10.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.564+0000 7f5eee2b3700 1 -- 172.21.15.82:0/2618664184 shutdown_connections 2023-11-28T13:03:10.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.564+0000 7f5eee2b3700 1 --2- 172.21.15.82:0/2618664184 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5ecc064ee0 0x7f5ecc067390 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.564+0000 7f5eee2b3700 1 --2- 172.21.15.82:0/2618664184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ee815b6e0 0x7f5ee8157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.564+0000 7f5eee2b3700 1 --2- 172.21.15.82:0/2618664184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ee815a580 0x7f5ee80b4910 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.564+0000 7f5eee2b3700 1 --2- 172.21.15.82:0/2618664184 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5ee80b6140 0x7f5ee8155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.564+0000 7f5eee2b3700 1 -- 172.21.15.82:0/2618664184 >> 172.21.15.82:0/2618664184 conn(0x7f5ee80cdf40 msgr2=0x7f5ee815e320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:10.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.564+0000 7f5eee2b3700 1 -- 172.21.15.82:0/2618664184 shutdown_connections 2023-11-28T13:03:10.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.564+0000 7f5eee2b3700 1 -- 172.21.15.82:0/2618664184 wait complete. 2023-11-28T13:03:10.571 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 22 2023-11-28T13:03:10.582 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:03:10.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.688+0000 7f4a1359e700 1 Processor -- start 2023-11-28T13:03:10.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.688+0000 7f4a1359e700 1 -- start start 2023-11-28T13:03:10.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a1359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4a1406b910 0x7f4a14160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:10.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a1359e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a140d28e0 con 0x7f4a140d06f0 2023-11-28T13:03:10.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a1359e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a14160cc0 con 0x7f4a140ced70 2023-11-28T13:03:10.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a1359e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a140cdfe0 con 0x7f4a1406b910 2023-11-28T13:03:10.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a12d9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4a140d06f0 0x7f4a140d0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39974/0 (socket says 172.21.15.82:39974) 2023-11-28T13:03:10.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a12d9d700 1 -- 172.21.15.82:0/3069372371 learned_addr learned my addr 172.21.15.82:0/3069372371 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:10.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a1259c700 1 --2- 172.21.15.82:0/3069372371 >> v2:172.21.15.82:3300/0 conn(0x7f4a1406b910 0x7f4a14160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:10.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a1159a700 1 -- 172.21.15.82:0/3069372371 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591349316 0 0) 0x7f4a0c001490 con 0x7f4a140d06f0 2023-11-28T13:03:10.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a1159a700 1 -- 172.21.15.82:0/3069372371 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a000035d0 con 0x7f4a140d06f0 2023-11-28T13:03:10.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a1259c700 1 -- 172.21.15.82:0/3069372371 >> v1:172.21.15.114:6789/0 conn(0x7f4a140ced70 legacy=0x7f4a1406bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:10.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a1259c700 1 -- 172.21.15.82:0/3069372371 >> v1:172.21.15.82:6789/0 conn(0x7f4a140d06f0 legacy=0x7f4a140d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:10.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a1259c700 1 -- 172.21.15.82:0/3069372371 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a140b2040 con 0x7f4a1406b910 2023-11-28T13:03:10.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a1259c700 1 --2- 172.21.15.82:0/3069372371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a1406b910 0x7f4a14160780 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f49fc009850 tx=0x7f49fc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b143d0f8f23a74 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:10.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a1159a700 1 -- 172.21.15.82:0/3069372371 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc011830 con 0x7f4a1406b910 2023-11-28T13:03:10.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a1159a700 1 -- 172.21.15.82:0/3069372371 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc011990 con 0x7f4a1406b910 2023-11-28T13:03:10.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a1159a700 1 -- 172.21.15.82:0/3069372371 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc011d40 con 0x7f4a1406b910 2023-11-28T13:03:10.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a1359e700 1 -- 172.21.15.82:0/3069372371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a1406b910 msgr2=0x7f4a14160780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:10.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a1359e700 1 --2- 172.21.15.82:0/3069372371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a1406b910 0x7f4a14160780 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f49fc009850 tx=0x7f49fc009b60 comp rx=0 tx=0).stop 2023-11-28T13:03:10.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a1359e700 1 -- 172.21.15.82:0/3069372371 shutdown_connections 2023-11-28T13:03:10.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a1359e700 1 --2- 172.21.15.82:0/3069372371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a1406b910 0x7f4a14160780 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a1359e700 1 -- 172.21.15.82:0/3069372371 >> 172.21.15.82:0/3069372371 conn(0x7f4a140d2b20 msgr2=0x7f4a140d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:10.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a1359e700 1 -- 172.21.15.82:0/3069372371 shutdown_connections 2023-11-28T13:03:10.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.692+0000 7f4a1359e700 1 -- 172.21.15.82:0/3069372371 wait complete. 2023-11-28T13:03:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a1359e700 1 Processor -- start 2023-11-28T13:03:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a1359e700 1 -- start start 2023-11-28T13:03:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a1359e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a1406b910 0x7f4a140c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a1359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a140ced70 0x7f4a140ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a1359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a140d06f0 0x7f4a140c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a1359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a140caea0 con 0x7f4a140ced70 2023-11-28T13:03:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a1359e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a140c7d60 con 0x7f4a140d06f0 2023-11-28T13:03:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a1359e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a140c8040 con 0x7f4a1406b910 2023-11-28T13:03:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a11d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a140ced70 0x7f4a140ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a11d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a140ced70 0x7f4a140ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41836/0 (socket says 172.21.15.82:41836) 2023-11-28T13:03:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a11d9b700 1 -- 172.21.15.82:0/2799388333 learned_addr learned my addr 172.21.15.82:0/2799388333 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a1259c700 1 --2- 172.21.15.82:0/2799388333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a1406b910 0x7f4a140c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a12d9d700 1 --2- 172.21.15.82:0/2799388333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a140d06f0 0x7f4a140c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a11d9b700 1 -- 172.21.15.82:0/2799388333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a1406b910 msgr2=0x7f4a140c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a11d9b700 1 --2- 172.21.15.82:0/2799388333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a1406b910 0x7f4a140c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a11d9b700 1 -- 172.21.15.82:0/2799388333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a140d06f0 msgr2=0x7f4a140c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a11d9b700 1 --2- 172.21.15.82:0/2799388333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a140d06f0 0x7f4a140c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a11d9b700 1 -- 172.21.15.82:0/2799388333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc0094b0 con 0x7f4a140ced70 2023-11-28T13:03:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a12d9d700 1 --2- 172.21.15.82:0/2799388333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a140d06f0 0x7f4a140c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a11d9b700 1 --2- 172.21.15.82:0/2799388333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a140ced70 0x7f4a140ca960 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400c4d0 tx=0x7f4a0400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a0affd700 1 -- 172.21.15.82:0/2799388333 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a040052d0 con 0x7f4a140ced70 2023-11-28T13:03:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a0affd700 1 -- 172.21.15.82:0/2799388333 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a04005430 con 0x7f4a140ced70 2023-11-28T13:03:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a1359e700 1 -- 172.21.15.82:0/2799388333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a140d2320 con 0x7f4a140ced70 2023-11-28T13:03:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a0affd700 1 -- 172.21.15.82:0/2799388333 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a040055a0 con 0x7f4a140ced70 2023-11-28T13:03:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.696+0000 7f4a1359e700 1 -- 172.21.15.82:0/2799388333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a140cf2c0 con 0x7f4a140ced70 2023-11-28T13:03:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.700+0000 7f4a1359e700 1 -- 172.21.15.82:0/2799388333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a140d2600 con 0x7f4a140ced70 2023-11-28T13:03:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.700+0000 7f4a0affd700 1 -- 172.21.15.82:0/2799388333 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4a04019030 con 0x7f4a140ced70 2023-11-28T13:03:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.700+0000 7f4a0affd700 1 --2- 172.21.15.82:0/2799388333 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f49f4064ee0 0x7f49f4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.700+0000 7f4a0affd700 1 -- 172.21.15.82:0/2799388333 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4a040811b0 con 0x7f4a140ced70 2023-11-28T13:03:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.700+0000 7f4a1259c700 1 --2- 172.21.15.82:0/2799388333 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f49f4064ee0 0x7f49f4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.700+0000 7f4a1259c700 1 --2- 172.21.15.82:0/2799388333 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f49f4064ee0 0x7f49f4067390 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0090b0 tx=0x7f49fc01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:10.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.708+0000 7f4a0affd700 1 -- 172.21.15.82:0/2799388333 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4a0404f310 con 0x7f4a140ced70 2023-11-28T13:03:10.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.908+0000 7f4a1359e700 1 -- 172.21.15.82:0/2799388333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a14065fc0 con 0x7f4a140ced70 2023-11-28T13:03:10.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.908+0000 7f4a0affd700 1 -- 172.21.15.82:0/2799388333 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f4a04052930 con 0x7f4a140ced70 2023-11-28T13:03:10.913 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:10.913 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/704061431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":704061431},{"type":"v1","addr":"172.21.15.114:6834","nonce":704061431}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3972503523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3972503523},{"type":"v1","addr":"172.21.15.82:6836","nonce":3972503523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5811,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2000262220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2000262220},{"type":"v1","addr":"172.21.15.82:6837","nonce":2000262220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:02:20.454524+0000","modified":"2023-11-28T13:02:23.476763+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5814":{"gid":5814,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/4092152651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":4092152651},{"type":"v1","addr":"172.21.15.114:6835","nonce":4092152651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T13:03:10.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.912+0000 7f4a1359e700 1 -- 172.21.15.82:0/2799388333 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f49f4064ee0 msgr2=0x7f49f4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:10.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.912+0000 7f4a1359e700 1 --2- 172.21.15.82:0/2799388333 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f49f4064ee0 0x7f49f4067390 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0090b0 tx=0x7f49fc01c040 comp rx=0 tx=0).stop 2023-11-28T13:03:10.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.912+0000 7f4a1359e700 1 -- 172.21.15.82:0/2799388333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a140ced70 msgr2=0x7f4a140ca960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:10.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.912+0000 7f4a1359e700 1 --2- 172.21.15.82:0/2799388333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a140ced70 0x7f4a140ca960 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400c4d0 tx=0x7f4a0400c7e0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.912+0000 7f4a1359e700 1 -- 172.21.15.82:0/2799388333 shutdown_connections 2023-11-28T13:03:10.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.912+0000 7f4a1359e700 1 --2- 172.21.15.82:0/2799388333 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f49f4064ee0 0x7f49f4067390 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.912+0000 7f4a1359e700 1 --2- 172.21.15.82:0/2799388333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a140d06f0 0x7f4a140c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.912+0000 7f4a1359e700 1 --2- 172.21.15.82:0/2799388333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a140ced70 0x7f4a140ca960 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.912+0000 7f4a1359e700 1 --2- 172.21.15.82:0/2799388333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a1406b910 0x7f4a140c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:10.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.912+0000 7f4a1359e700 1 -- 172.21.15.82:0/2799388333 >> 172.21.15.82:0/2799388333 conn(0x7f4a140d2b20 msgr2=0x7f4a1406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:10.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.912+0000 7f4a1359e700 1 -- 172.21.15.82:0/2799388333 shutdown_connections 2023-11-28T13:03:10.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:10.912+0000 7f4a1359e700 1 -- 172.21.15.82:0/2799388333 wait complete. 2023-11-28T13:03:10.917 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 22 2023-11-28T13:03:10.928 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:03:11.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.036+0000 7f299a819700 1 Processor -- start 2023-11-28T13:03:11.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.036+0000 7f299a819700 1 -- start start 2023-11-28T13:03:11.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.036+0000 7f299a819700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2994157db0 0x7f299406a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:11.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.036+0000 7f299a819700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f299415b270 0x7f29940703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:11.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.036+0000 7f299a819700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2994070d60 con 0x7f2994070920 2023-11-28T13:03:11.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.036+0000 7f299a819700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29940cb040 con 0x7f2994157db0 2023-11-28T13:03:11.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.036+0000 7f299a819700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29940c9430 con 0x7f299415b270 2023-11-28T13:03:11.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.036+0000 7f2993fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2994157db0 0x7f299406a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:11.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.036+0000 7f2993fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2994157db0 0x7f299406a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41840/0 (socket says 172.21.15.82:41840) 2023-11-28T13:03:11.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.036+0000 7f2993fff700 1 -- 172.21.15.82:0/3538694576 learned_addr learned my addr 172.21.15.82:0/3538694576 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:11.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.036+0000 7f29937fe700 1 --2- 172.21.15.82:0/3538694576 >> v2:172.21.15.114:3300/0 conn(0x7f299415b270 0x7f29940703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:11.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.036+0000 7f2993fff700 1 -- 172.21.15.82:0/3538694576 >> v2:172.21.15.114:3300/0 conn(0x7f299415b270 msgr2=0x7f29940703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:11.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.036+0000 7f2993fff700 1 --2- 172.21.15.82:0/3538694576 >> v2:172.21.15.114:3300/0 conn(0x7f299415b270 0x7f29940703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:11.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.036+0000 7f2993fff700 1 -- 172.21.15.82:0/3538694576 >> v1:172.21.15.114:6789/0 conn(0x7f2994070920 legacy=0x7f299415b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:11.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.036+0000 7f2993fff700 1 -- 172.21.15.82:0/3538694576 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29940c9710 con 0x7f2994157db0 2023-11-28T13:03:11.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.036+0000 7f2993fff700 1 --2- 172.21.15.82:0/3538694576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2994157db0 0x7f299406a740 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f299406e590 tx=0x7f2988009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df067d2aca1698b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:11.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.036+0000 7f2992ffd700 1 -- 172.21.15.82:0/3538694576 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2988011830 con 0x7f2994157db0 2023-11-28T13:03:11.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.036+0000 7f2992ffd700 1 -- 172.21.15.82:0/3538694576 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2988011990 con 0x7f2994157db0 2023-11-28T13:03:11.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.036+0000 7f2992ffd700 1 -- 172.21.15.82:0/3538694576 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2988011d20 con 0x7f2994157db0 2023-11-28T13:03:11.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.040+0000 7f299a819700 1 -- 172.21.15.82:0/3538694576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2994157db0 msgr2=0x7f299406a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:11.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.040+0000 7f299a819700 1 --2- 172.21.15.82:0/3538694576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2994157db0 0x7f299406a740 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f299406e590 tx=0x7f2988009bf0 comp rx=0 tx=0).stop 2023-11-28T13:03:11.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.040+0000 7f299a819700 1 -- 172.21.15.82:0/3538694576 shutdown_connections 2023-11-28T13:03:11.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.040+0000 7f299a819700 1 --2- 172.21.15.82:0/3538694576 >> v2:172.21.15.114:3300/0 conn(0x7f299415b270 0x7f29940703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:11.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.040+0000 7f299a819700 1 --2- 172.21.15.82:0/3538694576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2994157db0 0x7f299406a740 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:11.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.040+0000 7f299a819700 1 -- 172.21.15.82:0/3538694576 >> 172.21.15.82:0/3538694576 conn(0x7f29940ce9b0 msgr2=0x7f29940ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:11.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.040+0000 7f299a819700 1 -- 172.21.15.82:0/3538694576 shutdown_connections 2023-11-28T13:03:11.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.040+0000 7f299a819700 1 -- 172.21.15.82:0/3538694576 wait complete. 2023-11-28T13:03:11.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.040+0000 7f299a819700 1 Processor -- start 2023-11-28T13:03:11.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.040+0000 7f299a819700 1 -- start start 2023-11-28T13:03:11.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.040+0000 7f299a819700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2994070920 0x7f2994152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:11.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.040+0000 7f299a819700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2994157db0 0x7f29940c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:11.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.040+0000 7f299a819700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f299415b270 0x7f29940b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:11.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.040+0000 7f299a819700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29940c4670 con 0x7f2994157db0 2023-11-28T13:03:11.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.040+0000 7f299a819700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29940b29e0 con 0x7f2994070920 2023-11-28T13:03:11.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.040+0000 7f299a819700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29940c4390 con 0x7f299415b270 2023-11-28T13:03:11.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.044+0000 7f2993fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2994070920 0x7f2994152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:11.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.044+0000 7f2993fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2994070920 0x7f2994152d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:43848/0 (socket says 172.21.15.82:43848) 2023-11-28T13:03:11.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.044+0000 7f29937fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2994157db0 0x7f29940c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:11.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.044+0000 7f2993fff700 1 -- 172.21.15.82:0/4110748990 learned_addr learned my addr 172.21.15.82:0/4110748990 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:11.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.044+0000 7f2998db6700 1 --2- 172.21.15.82:0/4110748990 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f299415b270 0x7f29940b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.044+0000 7f2993fff700 1 -- 172.21.15.82:0/4110748990 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f299415b270 msgr2=0x7f29940b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.044+0000 7f2993fff700 1 --2- 172.21.15.82:0/4110748990 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f299415b270 0x7f29940b2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.044+0000 7f2993fff700 1 -- 172.21.15.82:0/4110748990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2994157db0 msgr2=0x7f29940c4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.044+0000 7f2993fff700 1 --2- 172.21.15.82:0/4110748990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2994157db0 0x7f29940c4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.044+0000 7f2993fff700 1 -- 172.21.15.82:0/4110748990 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2988009570 con 0x7f2994070920 2023-11-28T13:03:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.044+0000 7f29937fe700 1 --2- 172.21.15.82:0/4110748990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2994157db0 0x7f29940c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:03:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.044+0000 7f2993fff700 1 --2- 172.21.15.82:0/4110748990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2994070920 0x7f2994152d60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f299406e7f0 tx=0x7f2988004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.044+0000 7f2990ff9700 1 -- 172.21.15.82:0/4110748990 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2988004450 con 0x7f2994070920 2023-11-28T13:03:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.044+0000 7f299a819700 1 -- 172.21.15.82:0/4110748990 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2994069f40 con 0x7f2994070920 2023-11-28T13:03:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.044+0000 7f2990ff9700 1 -- 172.21.15.82:0/4110748990 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298801f070 con 0x7f2994070920 2023-11-28T13:03:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.044+0000 7f299a819700 1 -- 172.21.15.82:0/4110748990 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2994069c60 con 0x7f2994070920 2023-11-28T13:03:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.044+0000 7f2990ff9700 1 -- 172.21.15.82:0/4110748990 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880038c0 con 0x7f2994070920 2023-11-28T13:03:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.044+0000 7f299a819700 1 -- 172.21.15.82:0/4110748990 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299406a220 con 0x7f2994070920 2023-11-28T13:03:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.048+0000 7f2990ff9700 1 -- 172.21.15.82:0/4110748990 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f298800f050 con 0x7f2994070920 2023-11-28T13:03:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.048+0000 7f2990ff9700 1 --2- 172.21.15.82:0/4110748990 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2980064ee0 0x7f2980067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:11.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.048+0000 7f2990ff9700 1 -- 172.21.15.82:0/4110748990 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2988021070 con 0x7f2994070920 2023-11-28T13:03:11.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.048+0000 7f29937fe700 1 --2- 172.21.15.82:0/4110748990 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2980064ee0 0x7f2980067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:11.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.048+0000 7f29937fe700 1 --2- 172.21.15.82:0/4110748990 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2980064ee0 0x7f2980067390 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2984009fd0 tx=0x7f298400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:11.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.056+0000 7f2990ff9700 1 -- 172.21.15.82:0/4110748990 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f29880516f0 con 0x7f2994070920 2023-11-28T13:03:11.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.220+0000 7f299a819700 1 -- 172.21.15.82:0/4110748990 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29940b2790 con 0x7f2994070920 2023-11-28T13:03:11.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.224+0000 7f2990ff9700 1 -- 172.21.15.82:0/4110748990 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+17923 (secure 0 0 0) 0x7f2988015090 con 0x7f2994070920 2023-11-28T13:03:11.230 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:11.230 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":53,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:03:09.963667+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:02:19.012136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T13:02:19.431685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1d","mappings":[{"from":0,"to":6}]},{"pgid":"8.37","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:03:11.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.228+0000 7f299a819700 1 -- 172.21.15.82:0/4110748990 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2980064ee0 msgr2=0x7f2980067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:11.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.228+0000 7f299a819700 1 --2- 172.21.15.82:0/4110748990 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2980064ee0 0x7f2980067390 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2984009fd0 tx=0x7f298400b040 comp rx=0 tx=0).stop 2023-11-28T13:03:11.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.228+0000 7f299a819700 1 -- 172.21.15.82:0/4110748990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2994070920 msgr2=0x7f2994152d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:11.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.228+0000 7f299a819700 1 --2- 172.21.15.82:0/4110748990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2994070920 0x7f2994152d60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f299406e7f0 tx=0x7f2988004770 comp rx=0 tx=0).stop 2023-11-28T13:03:11.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.228+0000 7f299a819700 1 -- 172.21.15.82:0/4110748990 shutdown_connections 2023-11-28T13:03:11.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.228+0000 7f299a819700 1 --2- 172.21.15.82:0/4110748990 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2980064ee0 0x7f2980067390 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:11.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.228+0000 7f299a819700 1 --2- 172.21.15.82:0/4110748990 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f299415b270 0x7f29940b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:11.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.228+0000 7f299a819700 1 --2- 172.21.15.82:0/4110748990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2994157db0 0x7f29940c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:11.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.228+0000 7f299a819700 1 --2- 172.21.15.82:0/4110748990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2994070920 0x7f2994152d60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:11.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.228+0000 7f299a819700 1 -- 172.21.15.82:0/4110748990 >> 172.21.15.82:0/4110748990 conn(0x7f29940ce9b0 msgr2=0x7f29940ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:11.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.228+0000 7f299a819700 1 -- 172.21.15.82:0/4110748990 shutdown_connections 2023-11-28T13:03:11.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.228+0000 7f299a819700 1 -- 172.21.15.82:0/4110748990 wait complete. 2023-11-28T13:03:11.249 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T13:03:11.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.360+0000 7f6bd9e40700 1 Processor -- start 2023-11-28T13:03:11.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.360+0000 7f6bd9e40700 1 -- start start 2023-11-28T13:03:11.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.360+0000 7f6bd9e40700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6bd406b0a0 0x7f6bd406d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:11.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.360+0000 7f6bd9e40700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd406c480 con 0x7f6bd4070070 2023-11-28T13:03:11.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.360+0000 7f6bd9e40700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd406dbe0 con 0x7f6bd40b3910 2023-11-28T13:03:11.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.364+0000 7f6bd9e40700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd406dec0 con 0x7f6bd406b0a0 2023-11-28T13:03:11.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.364+0000 7f6bd963f700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6bd4070070 0x7f6bd4070470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39990/0 (socket says 172.21.15.82:39990) 2023-11-28T13:03:11.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.364+0000 7f6bd963f700 1 -- 172.21.15.82:0/2281260053 learned_addr learned my addr 172.21.15.82:0/2281260053 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:11.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.364+0000 7f6bd3fff700 1 --2- 172.21.15.82:0/2281260053 >> v2:172.21.15.114:3300/0 conn(0x7f6bd406b0a0 0x7f6bd406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:11.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.364+0000 7f6bd37fe700 1 -- 172.21.15.82:0/2281260053 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228375755 0 0) 0x7f6bd406c480 con 0x7f6bd4070070 2023-11-28T13:03:11.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.364+0000 7f6bd37fe700 1 -- 172.21.15.82:0/2281260053 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bbc0035d0 con 0x7f6bd4070070 2023-11-28T13:03:11.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.364+0000 7f6bd3fff700 1 -- 172.21.15.82:0/2281260053 >> v1:172.21.15.114:6789/0 conn(0x7f6bd40b3910 legacy=0x7f6bd406c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:11.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.364+0000 7f6bd3fff700 1 -- 172.21.15.82:0/2281260053 >> v1:172.21.15.82:6789/0 conn(0x7f6bd4070070 legacy=0x7f6bd4070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:11.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.364+0000 7f6bd3fff700 1 -- 172.21.15.82:0/2281260053 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd406c110 con 0x7f6bd406b0a0 2023-11-28T13:03:11.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.364+0000 7f6bd3fff700 1 --2- 172.21.15.82:0/2281260053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bd406b0a0 0x7f6bd406d320 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009d90 tx=0x7f6bcc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdec759f668d6e9c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:11.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.364+0000 7f6bd37fe700 1 -- 172.21.15.82:0/2281260053 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc00e070 con 0x7f6bd406b0a0 2023-11-28T13:03:11.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.364+0000 7f6bd37fe700 1 -- 172.21.15.82:0/2281260053 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc00bb20 con 0x7f6bd406b0a0 2023-11-28T13:03:11.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.364+0000 7f6bd37fe700 1 -- 172.21.15.82:0/2281260053 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc012430 con 0x7f6bd406b0a0 2023-11-28T13:03:11.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.364+0000 7f6bd9e40700 1 -- 172.21.15.82:0/2281260053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bd406b0a0 msgr2=0x7f6bd406d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:11.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.364+0000 7f6bd9e40700 1 --2- 172.21.15.82:0/2281260053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bd406b0a0 0x7f6bd406d320 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009d90 tx=0x7f6bcc00b330 comp rx=0 tx=0).stop 2023-11-28T13:03:11.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.364+0000 7f6bd9e40700 1 -- 172.21.15.82:0/2281260053 shutdown_connections 2023-11-28T13:03:11.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.364+0000 7f6bd9e40700 1 --2- 172.21.15.82:0/2281260053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bd406b0a0 0x7f6bd406d320 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:11.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.364+0000 7f6bd9e40700 1 -- 172.21.15.82:0/2281260053 >> 172.21.15.82:0/2281260053 conn(0x7f6bd40ce600 msgr2=0x7f6bd40ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:11.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.364+0000 7f6bd9e40700 1 -- 172.21.15.82:0/2281260053 shutdown_connections 2023-11-28T13:03:11.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.364+0000 7f6bd9e40700 1 -- 172.21.15.82:0/2281260053 wait complete. 2023-11-28T13:03:11.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd9e40700 1 Processor -- start 2023-11-28T13:03:11.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd9e40700 1 -- start start 2023-11-28T13:03:11.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd9e40700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6bd406b0a0 0x7f6bd4147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:11.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd9e40700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd4070070 0x7f6bd40acb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:11.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd9e40700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bd40b3910 0x7f6bd40b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:11.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd9e40700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd4147680 con 0x7f6bd4070070 2023-11-28T13:03:11.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd9e40700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd4149910 con 0x7f6bd40b3910 2023-11-28T13:03:11.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd9e40700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd4149bc0 con 0x7f6bd406b0a0 2023-11-28T13:03:11.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd4070070 0x7f6bd40acb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:11.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd4070070 0x7f6bd40acb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41852/0 (socket says 172.21.15.82:41852) 2023-11-28T13:03:11.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd3fff700 1 -- 172.21.15.82:0/1721573983 learned_addr learned my addr 172.21.15.82:0/1721573983 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:11.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd8e3e700 1 --2- 172.21.15.82:0/1721573983 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6bd406b0a0 0x7f6bd4147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:11.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd963f700 1 --2- 172.21.15.82:0/1721573983 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bd40b3910 0x7f6bd40b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:11.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd3fff700 1 -- 172.21.15.82:0/1721573983 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6bd406b0a0 msgr2=0x7f6bd4147140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:11.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd3fff700 1 --2- 172.21.15.82:0/1721573983 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6bd406b0a0 0x7f6bd4147140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:11.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd3fff700 1 -- 172.21.15.82:0/1721573983 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bd40b3910 msgr2=0x7f6bd40b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:11.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd3fff700 1 --2- 172.21.15.82:0/1721573983 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bd40b3910 0x7f6bd40b2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:11.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd3fff700 1 -- 172.21.15.82:0/1721573983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc009a70 con 0x7f6bd4070070 2023-11-28T13:03:11.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd963f700 1 --2- 172.21.15.82:0/1721573983 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bd40b3910 0x7f6bd40b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:11.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd3fff700 1 --2- 172.21.15.82:0/1721573983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd4070070 0x7f6bd40acb90 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc014040 tx=0x7f6bcc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:11.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd17fa700 1 -- 172.21.15.82:0/1721573983 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc012430 con 0x7f6bd4070070 2023-11-28T13:03:11.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd17fa700 1 -- 172.21.15.82:0/1721573983 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc020070 con 0x7f6bd4070070 2023-11-28T13:03:11.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd9e40700 1 -- 172.21.15.82:0/1721573983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd406d860 con 0x7f6bd4070070 2023-11-28T13:03:11.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd17fa700 1 -- 172.21.15.82:0/1721573983 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc004280 con 0x7f6bd4070070 2023-11-28T13:03:11.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.368+0000 7f6bd9e40700 1 -- 172.21.15.82:0/1721573983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd40c8f80 con 0x7f6bd4070070 2023-11-28T13:03:11.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.372+0000 7f6bd9e40700 1 -- 172.21.15.82:0/1721573983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd40b3ce0 con 0x7f6bd4070070 2023-11-28T13:03:11.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.372+0000 7f6bd17fa700 1 -- 172.21.15.82:0/1721573983 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6bcc0043e0 con 0x7f6bd4070070 2023-11-28T13:03:11.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.372+0000 7f6bd17fa700 1 --2- 172.21.15.82:0/1721573983 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6bc0064ee0 0x7f6bc0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:11.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.372+0000 7f6bd17fa700 1 -- 172.21.15.82:0/1721573983 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6bcc022070 con 0x7f6bd4070070 2023-11-28T13:03:11.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.372+0000 7f6bd8e3e700 1 --2- 172.21.15.82:0/1721573983 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6bc0064ee0 0x7f6bc0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:11.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.372+0000 7f6bd8e3e700 1 --2- 172.21.15.82:0/1721573983 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6bc0064ee0 0x7f6bc0067390 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8000f60 tx=0x7f6bc8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:11.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.376+0000 7f6bd17fa700 1 -- 172.21.15.82:0/1721573983 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6bcc052190 con 0x7f6bd4070070 2023-11-28T13:03:11.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.576+0000 7f6bd9e40700 1 -- 172.21.15.82:0/1721573983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6bd4065fc0 con 0x7f6bd4070070 2023-11-28T13:03:11.982 INFO:tasks.ceph.mon.a.smithi082.stderr:2023-11-28T13:03:11.976+0000 7f1907e90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T13:03:11.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:11.992+0000 7f6bd17fa700 1 -- 172.21.15.82:0/1721573983 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6bcc0557b0 con 0x7f6bd4070070 2023-11-28T13:03:12.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.000+0000 7f6bd9e40700 1 -- 172.21.15.82:0/1721573983 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6bc0064ee0 msgr2=0x7f6bc0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.000+0000 7f6bd9e40700 1 --2- 172.21.15.82:0/1721573983 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6bc0064ee0 0x7f6bc0067390 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8000f60 tx=0x7f6bc8009040 comp rx=0 tx=0).stop 2023-11-28T13:03:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.000+0000 7f6bd9e40700 1 -- 172.21.15.82:0/1721573983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd4070070 msgr2=0x7f6bd40acb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.000+0000 7f6bd9e40700 1 --2- 172.21.15.82:0/1721573983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd4070070 0x7f6bd40acb90 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc014040 tx=0x7f6bcc004af0 comp rx=0 tx=0).stop 2023-11-28T13:03:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.000+0000 7f6bd9e40700 1 -- 172.21.15.82:0/1721573983 shutdown_connections 2023-11-28T13:03:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.000+0000 7f6bd9e40700 1 --2- 172.21.15.82:0/1721573983 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6bc0064ee0 0x7f6bc0067390 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.000+0000 7f6bd9e40700 1 --2- 172.21.15.82:0/1721573983 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bd40b3910 0x7f6bd40b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.000+0000 7f6bd9e40700 1 --2- 172.21.15.82:0/1721573983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd4070070 0x7f6bd40acb90 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.000+0000 7f6bd9e40700 1 --2- 172.21.15.82:0/1721573983 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6bd406b0a0 0x7f6bd4147140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.000+0000 7f6bd9e40700 1 -- 172.21.15.82:0/1721573983 >> 172.21.15.82:0/1721573983 conn(0x7f6bd40ce600 msgr2=0x7f6bd406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.000+0000 7f6bd9e40700 1 -- 172.21.15.82:0/1721573983 shutdown_connections 2023-11-28T13:03:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.000+0000 7f6bd9e40700 1 -- 172.21.15.82:0/1721573983 wait complete. 2023-11-28T13:03:12.005 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T13:03:12.007 INFO:tasks.ceph.mds.d.smithi114.stderr: -4585> 2023-11-28T13:02:26.327+0000 7f088ce06700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T13:03:12.010 INFO:tasks.ceph.mds.d.smithi114.stderr: -2978> 2023-11-28T13:02:34.119+0000 7f08895ff700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6009=0-4194304@1} caps={6009=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6009 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55c59c273700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-28T13:03:12.021 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T13:03:12.042 INFO:tasks.ceph.mds.d.smithi114.stdout:starting mds.d at 2023-11-28T13:03:12.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.140+0000 7f14d153f700 1 Processor -- start 2023-11-28T13:03:12.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.140+0000 7f14d153f700 1 -- start start 2023-11-28T13:03:12.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.140+0000 7f14d153f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f14cc071130 0x7f14cc0715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:12.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.140+0000 7f14d153f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14cc0c8c80 0x7f14cc0c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:12.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.140+0000 7f14d153f700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14cc158af0 con 0x7f14cc158720 2023-11-28T13:03:12.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.140+0000 7f14d153f700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14cc0af490 con 0x7f14cc071130 2023-11-28T13:03:12.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.140+0000 7f14d153f700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc0af770 con 0x7f14cc0c8c80 2023-11-28T13:03:12.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.140+0000 7f14cbfff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f14cc158720 0x7f14cc0b0250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39996/0 (socket says 172.21.15.82:39996) 2023-11-28T13:03:12.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.140+0000 7f14cbfff700 1 -- 172.21.15.82:0/2840459707 learned_addr learned my addr 172.21.15.82:0/2840459707 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:12.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.140+0000 7f14cb7fe700 1 --2- 172.21.15.82:0/2840459707 >> v2:172.21.15.114:3300/0 conn(0x7f14cc071130 0x7f14cc0715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.140+0000 7f14d0d3e700 1 --2- 172.21.15.82:0/2840459707 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14cc0c8c80 0x7f14cc0c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:12.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14caffd700 1 -- 172.21.15.82:0/2840459707 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965283239 0 0) 0x7f14cc158af0 con 0x7f14cc158720 2023-11-28T13:03:12.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14caffd700 1 -- 172.21.15.82:0/2840459707 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14ac0035d0 con 0x7f14cc158720 2023-11-28T13:03:12.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14d0d3e700 1 -- 172.21.15.82:0/2840459707 >> v2:172.21.15.114:3300/0 conn(0x7f14cc071130 msgr2=0x7f14cc0715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:12.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14d0d3e700 1 --2- 172.21.15.82:0/2840459707 >> v2:172.21.15.114:3300/0 conn(0x7f14cc071130 0x7f14cc0715b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:12.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14d0d3e700 1 -- 172.21.15.82:0/2840459707 >> v1:172.21.15.82:6789/0 conn(0x7f14cc158720 legacy=0x7f14cc0b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:12.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14d0d3e700 1 -- 172.21.15.82:0/2840459707 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14cc0afa50 con 0x7f14cc0c8c80 2023-11-28T13:03:12.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14d0d3e700 1 --2- 172.21.15.82:0/2840459707 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14cc0c8c80 0x7f14cc0c90e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f14c4009d90 tx=0x7f14c400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=806e927b34ed97d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:12.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14caffd700 1 -- 172.21.15.82:0/2840459707 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c400e070 con 0x7f14cc0c8c80 2023-11-28T13:03:12.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14caffd700 1 -- 172.21.15.82:0/2840459707 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c400bb20 con 0x7f14cc0c8c80 2023-11-28T13:03:12.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14caffd700 1 -- 172.21.15.82:0/2840459707 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c400be90 con 0x7f14cc0c8c80 2023-11-28T13:03:12.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14d153f700 1 -- 172.21.15.82:0/2840459707 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14cc0c8c80 msgr2=0x7f14cc0c90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:12.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14d153f700 1 --2- 172.21.15.82:0/2840459707 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14cc0c8c80 0x7f14cc0c90e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f14c4009d90 tx=0x7f14c400b330 comp rx=0 tx=0).stop 2023-11-28T13:03:12.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14d153f700 1 -- 172.21.15.82:0/2840459707 shutdown_connections 2023-11-28T13:03:12.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14d153f700 1 --2- 172.21.15.82:0/2840459707 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14cc0c8c80 0x7f14cc0c90e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:12.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14d153f700 1 --2- 172.21.15.82:0/2840459707 >> v2:172.21.15.114:3300/0 conn(0x7f14cc071130 0x7f14cc0715b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:12.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14d153f700 1 -- 172.21.15.82:0/2840459707 >> 172.21.15.82:0/2840459707 conn(0x7f14cc0ce630 msgr2=0x7f14cc0cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:12.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14d153f700 1 -- 172.21.15.82:0/2840459707 shutdown_connections 2023-11-28T13:03:12.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14d153f700 1 -- 172.21.15.82:0/2840459707 wait complete. 2023-11-28T13:03:12.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14d153f700 1 Processor -- start 2023-11-28T13:03:12.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14d153f700 1 -- start start 2023-11-28T13:03:12.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14d153f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14cc071130 0x7f14cc13b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:12.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14d153f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14cc0c8c80 0x7f14cc0b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14d153f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14cc158720 0x7f14cc0b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14d153f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc13b950 con 0x7f14cc158720 2023-11-28T13:03:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14d153f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc0b4640 con 0x7f14cc071130 2023-11-28T13:03:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.144+0000 7f14d153f700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc1389c0 con 0x7f14cc0c8c80 2023-11-28T13:03:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.148+0000 7f14d0d3e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14cc158720 0x7f14cc0b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.148+0000 7f14d0d3e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14cc158720 0x7f14cc0b1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41858/0 (socket says 172.21.15.82:41858) 2023-11-28T13:03:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.148+0000 7f14d0d3e700 1 -- 172.21.15.82:0/1146093684 learned_addr learned my addr 172.21.15.82:0/1146093684 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.148+0000 7f14cb7fe700 1 --2- 172.21.15.82:0/1146093684 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14cc0c8c80 0x7f14cc0b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.148+0000 7f14cbfff700 1 --2- 172.21.15.82:0/1146093684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14cc071130 0x7f14cc13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.148+0000 7f14d0d3e700 1 -- 172.21.15.82:0/1146093684 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14cc0c8c80 msgr2=0x7f14cc0b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.148+0000 7f14d0d3e700 1 --2- 172.21.15.82:0/1146093684 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14cc0c8c80 0x7f14cc0b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:12.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.148+0000 7f14d0d3e700 1 -- 172.21.15.82:0/1146093684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14cc071130 msgr2=0x7f14cc13b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:12.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.148+0000 7f14d0d3e700 1 --2- 172.21.15.82:0/1146093684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14cc071130 0x7f14cc13b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:12.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.148+0000 7f14d0d3e700 1 -- 172.21.15.82:0/1146093684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c4009a70 con 0x7f14cc158720 2023-11-28T13:03:12.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.148+0000 7f14d0d3e700 1 --2- 172.21.15.82:0/1146093684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14cc158720 0x7f14cc0b1b60 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f14c4014040 tx=0x7f14c4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:12.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.148+0000 7f14c8ff9700 1 -- 172.21.15.82:0/1146093684 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c4007000 con 0x7f14cc158720 2023-11-28T13:03:12.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.148+0000 7f14c8ff9700 1 -- 172.21.15.82:0/1146093684 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c4012650 con 0x7f14cc158720 2023-11-28T13:03:12.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.148+0000 7f14d153f700 1 -- 172.21.15.82:0/1146093684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14cc071af0 con 0x7f14cc158720 2023-11-28T13:03:12.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.148+0000 7f14c8ff9700 1 -- 172.21.15.82:0/1146093684 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c4012a00 con 0x7f14cc158720 2023-11-28T13:03:12.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.148+0000 7f14d153f700 1 -- 172.21.15.82:0/1146093684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14cc0afd30 con 0x7f14cc158720 2023-11-28T13:03:12.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.148+0000 7f14d153f700 1 -- 172.21.15.82:0/1146093684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14cc0af0f0 con 0x7f14cc158720 2023-11-28T13:03:12.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.148+0000 7f14c8ff9700 1 -- 172.21.15.82:0/1146093684 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f14c4012b60 con 0x7f14cc158720 2023-11-28T13:03:12.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.152+0000 7f14c8ff9700 1 --2- 172.21.15.82:0/1146093684 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f14b0064ee0 0x7f14b0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:12.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.152+0000 7f14cbfff700 1 --2- 172.21.15.82:0/1146093684 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f14b0064ee0 0x7f14b0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:12.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.152+0000 7f14c8ff9700 1 -- 172.21.15.82:0/1146093684 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f14c40841f0 con 0x7f14cc158720 2023-11-28T13:03:12.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.152+0000 7f14cbfff700 1 --2- 172.21.15.82:0/1146093684 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f14b0064ee0 0x7f14b0067390 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f14bc007fd0 tx=0x7f14bc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:12.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.160+0000 7f14c8ff9700 1 -- 172.21.15.82:0/1146093684 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f14c40521b0 con 0x7f14cc158720 2023-11-28T13:03:12.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:12.352+0000 7f14d153f700 1 -- 172.21.15.82:0/1146093684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f14cc065fc0 con 0x7f14cc158720 2023-11-28T13:03:13.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.000+0000 7f14c8ff9700 1 -- 172.21.15.82:0/1146093684 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f14c40557d0 con 0x7f14cc158720 2023-11-28T13:03:13.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.004+0000 7f14d153f700 1 -- 172.21.15.82:0/1146093684 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f14b0064ee0 msgr2=0x7f14b0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:13.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.004+0000 7f14d153f700 1 --2- 172.21.15.82:0/1146093684 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f14b0064ee0 0x7f14b0067390 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f14bc007fd0 tx=0x7f14bc009040 comp rx=0 tx=0).stop 2023-11-28T13:03:13.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.004+0000 7f14d153f700 1 -- 172.21.15.82:0/1146093684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14cc158720 msgr2=0x7f14cc0b1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:13.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.004+0000 7f14d153f700 1 --2- 172.21.15.82:0/1146093684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14cc158720 0x7f14cc0b1b60 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f14c4014040 tx=0x7f14c4004af0 comp rx=0 tx=0).stop 2023-11-28T13:03:13.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.004+0000 7f14d153f700 1 -- 172.21.15.82:0/1146093684 shutdown_connections 2023-11-28T13:03:13.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.004+0000 7f14d153f700 1 --2- 172.21.15.82:0/1146093684 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f14b0064ee0 0x7f14b0067390 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:13.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.004+0000 7f14d153f700 1 --2- 172.21.15.82:0/1146093684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14cc158720 0x7f14cc0b1b60 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:13.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.004+0000 7f14d153f700 1 --2- 172.21.15.82:0/1146093684 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14cc0c8c80 0x7f14cc0b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:13.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.004+0000 7f14d153f700 1 --2- 172.21.15.82:0/1146093684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14cc071130 0x7f14cc13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:13.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.004+0000 7f14d153f700 1 -- 172.21.15.82:0/1146093684 >> 172.21.15.82:0/1146093684 conn(0x7f14cc0ce630 msgr2=0x7f14cc069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:13.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.004+0000 7f14d153f700 1 -- 172.21.15.82:0/1146093684 shutdown_connections 2023-11-28T13:03:13.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.004+0000 7f14d153f700 1 -- 172.21.15.82:0/1146093684 wait complete. 2023-11-28T13:03:13.023 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T13:03:13.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.148+0000 7f71e7211700 1 Processor -- start 2023-11-28T13:03:13.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.148+0000 7f71e7211700 1 -- start start 2023-11-28T13:03:13.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.148+0000 7f71e7211700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f71e0069bc0 0x7f71e00cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:13.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.148+0000 7f71e7211700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e015fec0 con 0x7f71e006b800 2023-11-28T13:03:13.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.148+0000 7f71e7211700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e006a230 con 0x7f71e0160350 2023-11-28T13:03:13.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.148+0000 7f71e7211700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e006a030 con 0x7f71e0069bc0 2023-11-28T13:03:13.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.148+0000 7f71e620f700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f71e006b800 0x7f71e006bbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:40008/0 (socket says 172.21.15.82:40008) 2023-11-28T13:03:13.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.148+0000 7f71e620f700 1 -- 172.21.15.82:0/2180775633 learned_addr learned my addr 172.21.15.82:0/2180775633 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:13.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.148+0000 7f71e5a0e700 1 --2- 172.21.15.82:0/2180775633 >> v2:172.21.15.114:3300/0 conn(0x7f71e0069bc0 0x7f71e00cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:13.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.152+0000 7f71e520d700 1 -- 172.21.15.82:0/2180775633 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 191763714 0 0) 0x7f71e015fec0 con 0x7f71e006b800 2023-11-28T13:03:13.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.152+0000 7f71e520d700 1 -- 172.21.15.82:0/2180775633 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71cc0035d0 con 0x7f71e006b800 2023-11-28T13:03:13.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.152+0000 7f71e5a0e700 1 -- 172.21.15.82:0/2180775633 >> v1:172.21.15.114:6789/0 conn(0x7f71e0160350 legacy=0x7f71e015c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:13.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.152+0000 7f71e5a0e700 1 -- 172.21.15.82:0/2180775633 >> v1:172.21.15.82:6789/0 conn(0x7f71e006b800 legacy=0x7f71e006bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:13.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.152+0000 7f71e5a0e700 1 -- 172.21.15.82:0/2180775633 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e006a510 con 0x7f71e0069bc0 2023-11-28T13:03:13.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.152+0000 7f71e5a0e700 1 --2- 172.21.15.82:0/2180775633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71e0069bc0 0x7f71e00cd060 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009850 tx=0x7f71dc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=241b8e9f89f380f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:13.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.152+0000 7f71e520d700 1 -- 172.21.15.82:0/2180775633 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc011830 con 0x7f71e0069bc0 2023-11-28T13:03:13.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.152+0000 7f71e520d700 1 -- 172.21.15.82:0/2180775633 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71dc011990 con 0x7f71e0069bc0 2023-11-28T13:03:13.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.152+0000 7f71e520d700 1 -- 172.21.15.82:0/2180775633 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc011d40 con 0x7f71e0069bc0 2023-11-28T13:03:13.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.152+0000 7f71e7211700 1 -- 172.21.15.82:0/2180775633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71e0069bc0 msgr2=0x7f71e00cd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:13.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.152+0000 7f71e7211700 1 --2- 172.21.15.82:0/2180775633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71e0069bc0 0x7f71e00cd060 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009850 tx=0x7f71dc009b60 comp rx=0 tx=0).stop 2023-11-28T13:03:13.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.152+0000 7f71e7211700 1 -- 172.21.15.82:0/2180775633 shutdown_connections 2023-11-28T13:03:13.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.152+0000 7f71e7211700 1 --2- 172.21.15.82:0/2180775633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71e0069bc0 0x7f71e00cd060 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:13.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.152+0000 7f71e7211700 1 -- 172.21.15.82:0/2180775633 >> 172.21.15.82:0/2180775633 conn(0x7f71e00d0090 msgr2=0x7f71e00d2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:13.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.152+0000 7f71e7211700 1 -- 172.21.15.82:0/2180775633 shutdown_connections 2023-11-28T13:03:13.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.152+0000 7f71e7211700 1 -- 172.21.15.82:0/2180775633 wait complete. 2023-11-28T13:03:13.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e7211700 1 Processor -- start 2023-11-28T13:03:13.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e7211700 1 -- start start 2023-11-28T13:03:13.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e7211700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71e0069bc0 0x7f71e00cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:13.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e7211700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71e006b800 0x7f71e014f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:13.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e7211700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71e0160350 0x7f71e014ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:13.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e7211700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e00c9330 con 0x7f71e0069bc0 2023-11-28T13:03:13.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e7211700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e00c8d20 con 0x7f71e006b800 2023-11-28T13:03:13.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e7211700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e00b6dd0 con 0x7f71e0160350 2023-11-28T13:03:13.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e620f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71e0069bc0 0x7f71e00cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:13.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e620f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71e0069bc0 0x7f71e00cbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41868/0 (socket says 172.21.15.82:41868) 2023-11-28T13:03:13.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e620f700 1 -- 172.21.15.82:0/589292291 learned_addr learned my addr 172.21.15.82:0/589292291 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:13.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e6a10700 1 --2- 172.21.15.82:0/589292291 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71e0160350 0x7f71e014ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:13.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e5a0e700 1 --2- 172.21.15.82:0/589292291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71e006b800 0x7f71e014f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:13.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e620f700 1 -- 172.21.15.82:0/589292291 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71e0160350 msgr2=0x7f71e014ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:13.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e620f700 1 --2- 172.21.15.82:0/589292291 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71e0160350 0x7f71e014ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:13.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e620f700 1 -- 172.21.15.82:0/589292291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71e006b800 msgr2=0x7f71e014f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:13.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e620f700 1 --2- 172.21.15.82:0/589292291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71e006b800 0x7f71e014f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:13.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e620f700 1 -- 172.21.15.82:0/589292291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc0094b0 con 0x7f71e0069bc0 2023-11-28T13:03:13.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e6a10700 1 --2- 172.21.15.82:0/589292291 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71e0160350 0x7f71e014ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:13.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e620f700 1 --2- 172.21.15.82:0/589292291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71e0069bc0 0x7f71e00cbe90 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f71d000c700 tx=0x7f71d000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:13.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71d6ffd700 1 -- 172.21.15.82:0/589292291 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d0005d90 con 0x7f71e0069bc0 2023-11-28T13:03:13.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71d6ffd700 1 -- 172.21.15.82:0/589292291 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d00070d0 con 0x7f71e0069bc0 2023-11-28T13:03:13.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e7211700 1 -- 172.21.15.82:0/589292291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e0156a10 con 0x7f71e0069bc0 2023-11-28T13:03:13.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71e7211700 1 -- 172.21.15.82:0/589292291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e006a7f0 con 0x7f71e0069bc0 2023-11-28T13:03:13.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.156+0000 7f71d6ffd700 1 -- 172.21.15.82:0/589292291 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d0007480 con 0x7f71e0069bc0 2023-11-28T13:03:13.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.160+0000 7f71e7211700 1 -- 172.21.15.82:0/589292291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e0156ba0 con 0x7f71e0069bc0 2023-11-28T13:03:13.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.160+0000 7f71d6ffd700 1 -- 172.21.15.82:0/589292291 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f71d0019030 con 0x7f71e0069bc0 2023-11-28T13:03:13.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.160+0000 7f71d6ffd700 1 --2- 172.21.15.82:0/589292291 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f71c4064ee0 0x7f71c4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:13.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.160+0000 7f71e5a0e700 1 --2- 172.21.15.82:0/589292291 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f71c4064ee0 0x7f71c4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:13.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.160+0000 7f71d6ffd700 1 -- 172.21.15.82:0/589292291 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f71d0081490 con 0x7f71e0069bc0 2023-11-28T13:03:13.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.160+0000 7f71e5a0e700 1 --2- 172.21.15.82:0/589292291 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f71c4064ee0 0x7f71c4067390 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0090b0 tx=0x7f71dc01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:13.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.168+0000 7f71d6ffd700 1 -- 172.21.15.82:0/589292291 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f71d004f430 con 0x7f71e0069bc0 2023-11-28T13:03:13.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:13.332+0000 7f71e7211700 1 -- 172.21.15.82:0/589292291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f71e00b7170 con 0x7f71e0069bc0 2023-11-28T13:03:14.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.004+0000 7f71d6ffd700 1 -- 172.21.15.82:0/589292291 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v55) v1 ==== 181+0+0 (secure 0 0 0) 0x7f71e00b7170 con 0x7f71e0069bc0 2023-11-28T13:03:14.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.008+0000 7f71e7211700 1 -- 172.21.15.82:0/589292291 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f71c4064ee0 msgr2=0x7f71c4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:14.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.008+0000 7f71e7211700 1 --2- 172.21.15.82:0/589292291 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f71c4064ee0 0x7f71c4067390 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0090b0 tx=0x7f71dc01c040 comp rx=0 tx=0).stop 2023-11-28T13:03:14.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.008+0000 7f71e7211700 1 -- 172.21.15.82:0/589292291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71e0069bc0 msgr2=0x7f71e00cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:14.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.008+0000 7f71e7211700 1 --2- 172.21.15.82:0/589292291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71e0069bc0 0x7f71e00cbe90 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f71d000c700 tx=0x7f71d000ca10 comp rx=0 tx=0).stop 2023-11-28T13:03:14.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.012+0000 7f71e7211700 1 -- 172.21.15.82:0/589292291 shutdown_connections 2023-11-28T13:03:14.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.012+0000 7f71e7211700 1 --2- 172.21.15.82:0/589292291 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f71c4064ee0 0x7f71c4067390 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:14.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.012+0000 7f71e7211700 1 --2- 172.21.15.82:0/589292291 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71e0160350 0x7f71e014ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:14.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.012+0000 7f71e7211700 1 --2- 172.21.15.82:0/589292291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71e006b800 0x7f71e014f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:14.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.012+0000 7f71e7211700 1 --2- 172.21.15.82:0/589292291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71e0069bc0 0x7f71e00cbe90 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:14.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.012+0000 7f71e7211700 1 -- 172.21.15.82:0/589292291 >> 172.21.15.82:0/589292291 conn(0x7f71e00d0090 msgr2=0x7f71e00b64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:14.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.012+0000 7f71e7211700 1 -- 172.21.15.82:0/589292291 shutdown_connections 2023-11-28T13:03:14.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.012+0000 7f71e7211700 1 -- 172.21.15.82:0/589292291 wait complete. 2023-11-28T13:03:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2023-11-28T13:03:14.032 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T13:03:14.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.140+0000 7f11b8dda700 1 Processor -- start 2023-11-28T13:03:14.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.140+0000 7f11b8dda700 1 -- start start 2023-11-28T13:03:14.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.140+0000 7f11b8dda700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f11b415a670 0x7f11b40b0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:14.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.140+0000 7f11b8dda700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f11b40d0350 0x7f11b40ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:14.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.140+0000 7f11b8dda700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b40b0590 con 0x7f11b40b1860 2023-11-28T13:03:14.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.140+0000 7f11b8dda700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b40c71d0 con 0x7f11b415a670 2023-11-28T13:03:14.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.140+0000 7f11b8dda700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b415aa40 con 0x7f11b40d0350 2023-11-28T13:03:14.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.140+0000 7f11aaffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f11b40b1860 0x7f11b40cfc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:40016/0 (socket says 172.21.15.82:40016) 2023-11-28T13:03:14.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.140+0000 7f11aaffd700 1 -- 172.21.15.82:0/1658660334 learned_addr learned my addr 172.21.15.82:0/1658660334 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:14.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.140+0000 7f11b37fe700 1 --2- 172.21.15.82:0/1658660334 >> v2:172.21.15.114:3300/0 conn(0x7f11b415a670 0x7f11b40b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:14.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.140+0000 7f11b3fff700 1 --2- 172.21.15.82:0/1658660334 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f11b40d0350 0x7f11b40ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:14.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.140+0000 7f11b2ffd700 1 -- 172.21.15.82:0/1658660334 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232705614 0 0) 0x7f11b40b0590 con 0x7f11b40b1860 2023-11-28T13:03:14.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.140+0000 7f11b2ffd700 1 -- 172.21.15.82:0/1658660334 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11a00035d0 con 0x7f11b40b1860 2023-11-28T13:03:14.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.144+0000 7f11b3fff700 1 -- 172.21.15.82:0/1658660334 >> v2:172.21.15.114:3300/0 conn(0x7f11b415a670 msgr2=0x7f11b40b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:14.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.144+0000 7f11b3fff700 1 --2- 172.21.15.82:0/1658660334 >> v2:172.21.15.114:3300/0 conn(0x7f11b415a670 0x7f11b40b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:14.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.144+0000 7f11b3fff700 1 -- 172.21.15.82:0/1658660334 >> v1:172.21.15.82:6789/0 conn(0x7f11b40b1860 legacy=0x7f11b40cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:14.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.144+0000 7f11b3fff700 1 -- 172.21.15.82:0/1658660334 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b40b07c0 con 0x7f11b40d0350 2023-11-28T13:03:14.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.144+0000 7f11b37fe700 1 --2- 172.21.15.82:0/1658660334 >> v2:172.21.15.114:3300/0 conn(0x7f11b415a670 0x7f11b40b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:03:14.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.144+0000 7f11b3fff700 1 --2- 172.21.15.82:0/1658660334 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f11b40d0350 0x7f11b40ce380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f11ac009d90 tx=0x7f11ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2c23f039268cca8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:14.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.144+0000 7f11b2ffd700 1 -- 172.21.15.82:0/1658660334 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac00e070 con 0x7f11b40d0350 2023-11-28T13:03:14.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.144+0000 7f11b2ffd700 1 -- 172.21.15.82:0/1658660334 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ac00bb20 con 0x7f11b40d0350 2023-11-28T13:03:14.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.144+0000 7f11b2ffd700 1 -- 172.21.15.82:0/1658660334 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac00be90 con 0x7f11b40d0350 2023-11-28T13:03:14.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.144+0000 7f11b8dda700 1 -- 172.21.15.82:0/1658660334 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f11b40d0350 msgr2=0x7f11b40ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:14.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.144+0000 7f11b8dda700 1 --2- 172.21.15.82:0/1658660334 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f11b40d0350 0x7f11b40ce380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f11ac009d90 tx=0x7f11ac00b330 comp rx=0 tx=0).stop 2023-11-28T13:03:14.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.144+0000 7f11b8dda700 1 -- 172.21.15.82:0/1658660334 shutdown_connections 2023-11-28T13:03:14.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.144+0000 7f11b8dda700 1 --2- 172.21.15.82:0/1658660334 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f11b40d0350 0x7f11b40ce380 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:14.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.144+0000 7f11b8dda700 1 --2- 172.21.15.82:0/1658660334 >> v2:172.21.15.114:3300/0 conn(0x7f11b415a670 0x7f11b40b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:14.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.144+0000 7f11b8dda700 1 -- 172.21.15.82:0/1658660334 >> 172.21.15.82:0/1658660334 conn(0x7f11b40cdec0 msgr2=0x7f11b40d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:14.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.144+0000 7f11b8dda700 1 -- 172.21.15.82:0/1658660334 shutdown_connections 2023-11-28T13:03:14.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.144+0000 7f11b8dda700 1 -- 172.21.15.82:0/1658660334 wait complete. 2023-11-28T13:03:14.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.148+0000 7f11b8dda700 1 Processor -- start 2023-11-28T13:03:14.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.148+0000 7f11b8dda700 1 -- start start 2023-11-28T13:03:14.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.148+0000 7f11b8dda700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11b40b1860 0x7f11b4153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:14.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.148+0000 7f11b8dda700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f11b40d0350 0x7f11b40b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:14.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.148+0000 7f11b8dda700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11b415a670 0x7f11b415d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:14.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.148+0000 7f11b8dda700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b415db50 con 0x7f11b415a670 2023-11-28T13:03:14.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.148+0000 7f11b8dda700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b40b4090 con 0x7f11b40b1860 2023-11-28T13:03:14.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.148+0000 7f11b8dda700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b40b4370 con 0x7f11b40d0350 2023-11-28T13:03:14.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.148+0000 7f11b3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11b415a670 0x7f11b415d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:14.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.148+0000 7f11b3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11b415a670 0x7f11b415d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41876/0 (socket says 172.21.15.82:41876) 2023-11-28T13:03:14.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.148+0000 7f11b3fff700 1 -- 172.21.15.82:0/3902784094 learned_addr learned my addr 172.21.15.82:0/3902784094 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:14.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.148+0000 7f11b37fe700 1 --2- 172.21.15.82:0/3902784094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11b40b1860 0x7f11b4153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:14.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.148+0000 7f11aaffd700 1 --2- 172.21.15.82:0/3902784094 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f11b40d0350 0x7f11b40b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:14.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.148+0000 7f11b3fff700 1 -- 172.21.15.82:0/3902784094 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f11b40d0350 msgr2=0x7f11b40b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:14.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.148+0000 7f11b3fff700 1 --2- 172.21.15.82:0/3902784094 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f11b40d0350 0x7f11b40b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:14.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.148+0000 7f11b3fff700 1 -- 172.21.15.82:0/3902784094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11b40b1860 msgr2=0x7f11b4153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:14.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.148+0000 7f11b3fff700 1 --2- 172.21.15.82:0/3902784094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11b40b1860 0x7f11b4153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:14.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.148+0000 7f11b3fff700 1 -- 172.21.15.82:0/3902784094 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a40094b0 con 0x7f11b415a670 2023-11-28T13:03:14.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.152+0000 7f11b3fff700 1 --2- 172.21.15.82:0/3902784094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11b415a670 0x7f11b415d170 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f11ac014040 tx=0x7f11ac004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:14.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.152+0000 7f11b0ff9700 1 -- 172.21.15.82:0/3902784094 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac004960 con 0x7f11b415a670 2023-11-28T13:03:14.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.152+0000 7f11b0ff9700 1 -- 172.21.15.82:0/3902784094 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ac020070 con 0x7f11b415a670 2023-11-28T13:03:14.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.152+0000 7f11b8dda700 1 -- 172.21.15.82:0/3902784094 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11ac009a70 con 0x7f11b415a670 2023-11-28T13:03:14.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.152+0000 7f11b0ff9700 1 -- 172.21.15.82:0/3902784094 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac0276c0 con 0x7f11b415a670 2023-11-28T13:03:14.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.152+0000 7f11b8dda700 1 -- 172.21.15.82:0/3902784094 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b40b0d80 con 0x7f11b415a670 2023-11-28T13:03:14.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.152+0000 7f11b8dda700 1 -- 172.21.15.82:0/3902784094 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b40b0aa0 con 0x7f11b415a670 2023-11-28T13:03:14.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.152+0000 7f11b0ff9700 1 -- 172.21.15.82:0/3902784094 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f11ac012430 con 0x7f11b415a670 2023-11-28T13:03:14.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.152+0000 7f11b0ff9700 1 --2- 172.21.15.82:0/3902784094 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1194064ee0 0x7f1194067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:14.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.152+0000 7f11b0ff9700 1 -- 172.21.15.82:0/3902784094 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f11ac022070 con 0x7f11b415a670 2023-11-28T13:03:14.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.152+0000 7f11b37fe700 1 --2- 172.21.15.82:0/3902784094 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1194064ee0 0x7f1194067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:14.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.156+0000 7f11b37fe700 1 --2- 172.21.15.82:0/3902784094 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1194064ee0 0x7f1194067390 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f11b40af6d0 tx=0x7f11a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:14.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.160+0000 7f11b0ff9700 1 -- 172.21.15.82:0/3902784094 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f11ac0522a0 con 0x7f11b415a670 2023-11-28T13:03:14.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:14.324+0000 7f11b8dda700 1 -- 172.21.15.82:0/3902784094 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f11b40b1060 con 0x7f11b415a670 2023-11-28T13:03:15.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.020+0000 7f11b0ff9700 1 -- 172.21.15.82:0/3902784094 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v56) v1 ==== 169+0+0 (secure 0 0 0) 0x7f11ac0558c0 con 0x7f11b415a670 2023-11-28T13:03:15.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.028+0000 7f11b8dda700 1 -- 172.21.15.82:0/3902784094 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1194064ee0 msgr2=0x7f1194067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:15.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.028+0000 7f11b8dda700 1 --2- 172.21.15.82:0/3902784094 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1194064ee0 0x7f1194067390 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f11b40af6d0 tx=0x7f11a4008040 comp rx=0 tx=0).stop 2023-11-28T13:03:15.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.028+0000 7f11b8dda700 1 -- 172.21.15.82:0/3902784094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11b415a670 msgr2=0x7f11b415d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:15.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.028+0000 7f11b8dda700 1 --2- 172.21.15.82:0/3902784094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11b415a670 0x7f11b415d170 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f11ac014040 tx=0x7f11ac004af0 comp rx=0 tx=0).stop 2023-11-28T13:03:15.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.028+0000 7f11b8dda700 1 -- 172.21.15.82:0/3902784094 shutdown_connections 2023-11-28T13:03:15.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.028+0000 7f11b8dda700 1 --2- 172.21.15.82:0/3902784094 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1194064ee0 0x7f1194067390 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:15.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.028+0000 7f11b8dda700 1 --2- 172.21.15.82:0/3902784094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11b415a670 0x7f11b415d170 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:15.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.028+0000 7f11b8dda700 1 --2- 172.21.15.82:0/3902784094 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f11b40d0350 0x7f11b40b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:15.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.028+0000 7f11b8dda700 1 --2- 172.21.15.82:0/3902784094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11b40b1860 0x7f11b4153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:15.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.028+0000 7f11b8dda700 1 -- 172.21.15.82:0/3902784094 >> 172.21.15.82:0/3902784094 conn(0x7f11b40cdec0 msgr2=0x7f11b40cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:15.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.028+0000 7f11b8dda700 1 -- 172.21.15.82:0/3902784094 shutdown_connections 2023-11-28T13:03:15.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.028+0000 7f11b8dda700 1 -- 172.21.15.82:0/3902784094 wait complete. 2023-11-28T13:03:15.038 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2023-11-28T13:03:15.052 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T13:03:15.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.160+0000 7f8aff59e700 1 Processor -- start 2023-11-28T13:03:15.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.160+0000 7f8aff59e700 1 -- start start 2023-11-28T13:03:15.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.160+0000 7f8aff59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8b0006caa0 0x7f8b00069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:15.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.160+0000 7f8aff59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8b001500e0 0x7f8b000c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:15.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.160+0000 7f8aff59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b000ccb60 con 0x7f8b0006ce70 2023-11-28T13:03:15.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.160+0000 7f8aff59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b000ca930 con 0x7f8b001500e0 2023-11-28T13:03:15.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.160+0000 7f8aff59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b000cac10 con 0x7f8b0006caa0 2023-11-28T13:03:15.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.164+0000 7f8afed9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8b001500e0 0x7f8b000c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:15.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.164+0000 7f8afed9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8b001500e0 0x7f8b000c9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41878/0 (socket says 172.21.15.82:41878) 2023-11-28T13:03:15.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.164+0000 7f8afed9d700 1 -- 172.21.15.82:0/4132998828 learned_addr learned my addr 172.21.15.82:0/4132998828 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:15.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.164+0000 7f8afe59c700 1 --2- 172.21.15.82:0/4132998828 >> v2:172.21.15.114:3300/0 conn(0x7f8b0006caa0 0x7f8b00069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:15.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.164+0000 7f8afed9d700 1 -- 172.21.15.82:0/4132998828 >> v2:172.21.15.114:3300/0 conn(0x7f8b0006caa0 msgr2=0x7f8b00069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:15.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.164+0000 7f8afed9d700 1 --2- 172.21.15.82:0/4132998828 >> v2:172.21.15.114:3300/0 conn(0x7f8b0006caa0 0x7f8b00069bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:15.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.164+0000 7f8afed9d700 1 -- 172.21.15.82:0/4132998828 >> v1:172.21.15.114:6789/0 conn(0x7f8b0006ce70 legacy=0x7f8b0014f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:15.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.164+0000 7f8afed9d700 1 -- 172.21.15.82:0/4132998828 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b000caef0 con 0x7f8b001500e0 2023-11-28T13:03:15.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.164+0000 7f8afe59c700 1 --2- 172.21.15.82:0/4132998828 >> v2:172.21.15.114:3300/0 conn(0x7f8b0006caa0 0x7f8b00069bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:03:15.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.164+0000 7f8afed9d700 1 --2- 172.21.15.82:0/4132998828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b001500e0 0x7f8b000c9c00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f8b00070120 tx=0x7f8af800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d297415446a2ce server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:15.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.164+0000 7f8afd59a700 1 -- 172.21.15.82:0/4132998828 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8010070 con 0x7f8b001500e0 2023-11-28T13:03:15.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.164+0000 7f8afd59a700 1 -- 172.21.15.82:0/4132998828 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af800dce0 con 0x7f8b001500e0 2023-11-28T13:03:15.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.164+0000 7f8afd59a700 1 -- 172.21.15.82:0/4132998828 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af800b310 con 0x7f8b001500e0 2023-11-28T13:03:15.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.164+0000 7f8aff59e700 1 -- 172.21.15.82:0/4132998828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b001500e0 msgr2=0x7f8b000c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:15.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.164+0000 7f8aff59e700 1 --2- 172.21.15.82:0/4132998828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b001500e0 0x7f8b000c9c00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f8b00070120 tx=0x7f8af800d430 comp rx=0 tx=0).stop 2023-11-28T13:03:15.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.164+0000 7f8aff59e700 1 -- 172.21.15.82:0/4132998828 shutdown_connections 2023-11-28T13:03:15.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.164+0000 7f8aff59e700 1 --2- 172.21.15.82:0/4132998828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b001500e0 0x7f8b000c9c00 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:15.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.164+0000 7f8aff59e700 1 --2- 172.21.15.82:0/4132998828 >> v2:172.21.15.114:3300/0 conn(0x7f8b0006caa0 0x7f8b00069bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:15.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.164+0000 7f8aff59e700 1 -- 172.21.15.82:0/4132998828 >> 172.21.15.82:0/4132998828 conn(0x7f8b000cb890 msgr2=0x7f8b000cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:15.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.164+0000 7f8aff59e700 1 -- 172.21.15.82:0/4132998828 shutdown_connections 2023-11-28T13:03:15.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.164+0000 7f8aff59e700 1 -- 172.21.15.82:0/4132998828 wait complete. 2023-11-28T13:03:15.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8aff59e700 1 Processor -- start 2023-11-28T13:03:15.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8aff59e700 1 -- start start 2023-11-28T13:03:15.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8aff59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8b0006caa0 0x7f8b000af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:15.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8aff59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b0006ce70 0x7f8b000b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:15.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8aff59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b001500e0 0x7f8b0015b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:15.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8aff59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000af940 con 0x7f8b0006ce70 2023-11-28T13:03:15.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8aff59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000afc20 con 0x7f8b001500e0 2023-11-28T13:03:15.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8aff59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000aff00 con 0x7f8b0006caa0 2023-11-28T13:03:15.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8afdd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b0006ce70 0x7f8b000b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:15.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8afdd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b0006ce70 0x7f8b000b09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41890/0 (socket says 172.21.15.82:41890) 2023-11-28T13:03:15.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8afdd9b700 1 -- 172.21.15.82:0/3066791975 learned_addr learned my addr 172.21.15.82:0/3066791975 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:15.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8afe59c700 1 --2- 172.21.15.82:0/3066791975 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8b0006caa0 0x7f8b000af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:15.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8afed9d700 1 --2- 172.21.15.82:0/3066791975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b001500e0 0x7f8b0015b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:15.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8afdd9b700 1 -- 172.21.15.82:0/3066791975 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8b0006caa0 msgr2=0x7f8b000af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:15.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8afdd9b700 1 --2- 172.21.15.82:0/3066791975 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8b0006caa0 0x7f8b000af360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:15.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8afdd9b700 1 -- 172.21.15.82:0/3066791975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b001500e0 msgr2=0x7f8b0015b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:15.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8afdd9b700 1 --2- 172.21.15.82:0/3066791975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b001500e0 0x7f8b0015b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:15.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8afdd9b700 1 -- 172.21.15.82:0/3066791975 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af00094b0 con 0x7f8b0006ce70 2023-11-28T13:03:15.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8afdd9b700 1 --2- 172.21.15.82:0/3066791975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b0006ce70 0x7f8b000b09e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8af400c500 tx=0x7f8af400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:15.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8aeeffd700 1 -- 172.21.15.82:0/3066791975 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af40052d0 con 0x7f8b0006ce70 2023-11-28T13:03:15.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8aeeffd700 1 -- 172.21.15.82:0/3066791975 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af4005430 con 0x7f8b0006ce70 2023-11-28T13:03:15.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8aff59e700 1 -- 172.21.15.82:0/3066791975 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af800bd40 con 0x7f8b0006ce70 2023-11-28T13:03:15.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8aeeffd700 1 -- 172.21.15.82:0/3066791975 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af40055a0 con 0x7f8b0006ce70 2023-11-28T13:03:15.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.168+0000 7f8aff59e700 1 -- 172.21.15.82:0/3066791975 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b000ca140 con 0x7f8b0006ce70 2023-11-28T13:03:15.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.172+0000 7f8aff59e700 1 -- 172.21.15.82:0/3066791975 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b000ccdb0 con 0x7f8b0006ce70 2023-11-28T13:03:15.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.172+0000 7f8aeeffd700 1 -- 172.21.15.82:0/3066791975 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8af4019030 con 0x7f8b0006ce70 2023-11-28T13:03:15.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.172+0000 7f8aeeffd700 1 --2- 172.21.15.82:0/3066791975 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8ae0064ee0 0x7f8ae0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:15.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.172+0000 7f8afe59c700 1 --2- 172.21.15.82:0/3066791975 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8ae0064ee0 0x7f8ae0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:15.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.172+0000 7f8aeeffd700 1 -- 172.21.15.82:0/3066791975 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8af4080e10 con 0x7f8b0006ce70 2023-11-28T13:03:15.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.172+0000 7f8afe59c700 1 --2- 172.21.15.82:0/3066791975 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8ae0064ee0 0x7f8ae0067390 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8af0009d80 tx=0x7f8af0009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:15.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.180+0000 7f8aeeffd700 1 -- 172.21.15.82:0/3066791975 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8af404f250 con 0x7f8b0006ce70 2023-11-28T13:03:15.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.344+0000 7f8aff59e700 1 -- 172.21.15.82:0/3066791975 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8b000ae7c0 con 0x7f8b0006ce70 2023-11-28T13:03:15.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.352+0000 7f8aeeffd700 1 -- 172.21.15.82:0/3066791975 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8af4052870 con 0x7f8b0006ce70 2023-11-28T13:03:15.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.356+0000 7f8aff59e700 1 -- 172.21.15.82:0/3066791975 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8ae0064ee0 msgr2=0x7f8ae0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:15.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.356+0000 7f8aff59e700 1 --2- 172.21.15.82:0/3066791975 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8ae0064ee0 0x7f8ae0067390 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8af0009d80 tx=0x7f8af0009240 comp rx=0 tx=0).stop 2023-11-28T13:03:15.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.356+0000 7f8aff59e700 1 -- 172.21.15.82:0/3066791975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b0006ce70 msgr2=0x7f8b000b09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:15.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.356+0000 7f8aff59e700 1 --2- 172.21.15.82:0/3066791975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b0006ce70 0x7f8b000b09e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8af400c500 tx=0x7f8af400c810 comp rx=0 tx=0).stop 2023-11-28T13:03:15.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.356+0000 7f8aff59e700 1 -- 172.21.15.82:0/3066791975 shutdown_connections 2023-11-28T13:03:15.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.356+0000 7f8aff59e700 1 --2- 172.21.15.82:0/3066791975 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8ae0064ee0 0x7f8ae0067390 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:15.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.356+0000 7f8aff59e700 1 --2- 172.21.15.82:0/3066791975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b001500e0 0x7f8b0015b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:15.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.356+0000 7f8aff59e700 1 --2- 172.21.15.82:0/3066791975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b0006ce70 0x7f8b000b09e0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:15.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.356+0000 7f8aff59e700 1 --2- 172.21.15.82:0/3066791975 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8b0006caa0 0x7f8b000af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:15.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.356+0000 7f8aff59e700 1 -- 172.21.15.82:0/3066791975 >> 172.21.15.82:0/3066791975 conn(0x7f8b000cb890 msgr2=0x7f8b0006aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:15.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.356+0000 7f8aff59e700 1 -- 172.21.15.82:0/3066791975 shutdown_connections 2023-11-28T13:03:15.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.356+0000 7f8aff59e700 1 -- 172.21.15.82:0/3066791975 wait complete. 2023-11-28T13:03:15.374 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2023-11-28T13:03:15.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a47fff700 1 Processor -- start 2023-11-28T13:03:15.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a47fff700 1 -- start start 2023-11-28T13:03:15.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a47fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a400dd280 0x7f7a40050760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:15.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a47fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7a400dfb70 0x7f7a40036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:15.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a47fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7a40036cb0 0x7f7a400e3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:15.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a47fff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a400dd650 con 0x7f7a40036cb0 2023-11-28T13:03:15.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a47fff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a40037130 con 0x7f7a400dfb70 2023-11-28T13:03:15.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a47fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a40052bf0 con 0x7f7a400dd280 2023-11-28T13:03:15.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a477fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7a40036cb0 0x7f7a400e3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:15.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a477fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7a40036cb0 0x7f7a400e3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41904/0 (socket says 172.21.15.82:41904) 2023-11-28T13:03:15.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a477fe700 1 -- 172.21.15.82:0/2894969131 learned_addr learned my addr 172.21.15.82:0/2894969131 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:15.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a46ffd700 1 --2- 172.21.15.82:0/2894969131 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a400dd280 0x7f7a40050760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:15.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a467fc700 1 --2- 172.21.15.82:0/2894969131 >> v2:172.21.15.114:3300/0 conn(0x7f7a400dfb70 0x7f7a40036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:15.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a477fe700 1 -- 172.21.15.82:0/2894969131 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a400dd280 msgr2=0x7f7a40050760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:15.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a477fe700 1 --2- 172.21.15.82:0/2894969131 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a400dd280 0x7f7a40050760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:15.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a477fe700 1 -- 172.21.15.82:0/2894969131 >> v2:172.21.15.114:3300/0 conn(0x7f7a400dfb70 msgr2=0x7f7a40036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:15.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a477fe700 1 --2- 172.21.15.82:0/2894969131 >> v2:172.21.15.114:3300/0 conn(0x7f7a400dfb70 0x7f7a40036770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:15.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a477fe700 1 -- 172.21.15.82:0/2894969131 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a400528c0 con 0x7f7a40036cb0 2023-11-28T13:03:15.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a477fe700 1 --2- 172.21.15.82:0/2894969131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a40036cb0 0x7f7a400e3160 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7a4804ed50 tx=0x7f7a48072430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c731ebe4234cf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:15.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a45ffb700 1 -- 172.21.15.82:0/2894969131 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a480657e0 con 0x7f7a40036cb0 2023-11-28T13:03:15.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a45ffb700 1 -- 172.21.15.82:0/2894969131 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a48065940 con 0x7f7a40036cb0 2023-11-28T13:03:15.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a45ffb700 1 -- 172.21.15.82:0/2894969131 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48066230 con 0x7f7a40036cb0 2023-11-28T13:03:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a47fff700 1 -- 172.21.15.82:0/2894969131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a40036cb0 msgr2=0x7f7a400e3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a47fff700 1 --2- 172.21.15.82:0/2894969131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a40036cb0 0x7f7a400e3160 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7a4804ed50 tx=0x7f7a48072430 comp rx=0 tx=0).stop 2023-11-28T13:03:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a47fff700 1 -- 172.21.15.82:0/2894969131 shutdown_connections 2023-11-28T13:03:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a47fff700 1 --2- 172.21.15.82:0/2894969131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a40036cb0 0x7f7a400e3160 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a47fff700 1 --2- 172.21.15.82:0/2894969131 >> v2:172.21.15.114:3300/0 conn(0x7f7a400dfb70 0x7f7a40036770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a47fff700 1 --2- 172.21.15.82:0/2894969131 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a400dd280 0x7f7a40050760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a47fff700 1 -- 172.21.15.82:0/2894969131 >> 172.21.15.82:0/2894969131 conn(0x7f7a40051770 msgr2=0x7f7a40051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a47fff700 1 -- 172.21.15.82:0/2894969131 shutdown_connections 2023-11-28T13:03:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.480+0000 7f7a47fff700 1 -- 172.21.15.82:0/2894969131 wait complete. 2023-11-28T13:03:15.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a47fff700 1 Processor -- start 2023-11-28T13:03:15.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a47fff700 1 -- start start 2023-11-28T13:03:15.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a47fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a40036cb0 0x7f7a400ded70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:15.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a47fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a400dd280 0x7f7a400d8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:15.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a47fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a400dfb70 0x7f7a400d88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:15.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a47fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400530e0 con 0x7f7a400dfb70 2023-11-28T13:03:15.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a47fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400533c0 con 0x7f7a40036cb0 2023-11-28T13:03:15.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a47fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400536a0 con 0x7f7a400dd280 2023-11-28T13:03:15.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a477fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a400dfb70 0x7f7a400d88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:15.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a46ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a40036cb0 0x7f7a400ded70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:15.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a467fc700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a400dd280 0x7f7a400d8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:15.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a467fc700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a400dd280 0x7f7a400d8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:43782/0 (socket says 172.21.15.82:43782) 2023-11-28T13:03:15.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a46ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a40036cb0 0x7f7a400ded70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:43944/0 (socket says 172.21.15.82:43944) 2023-11-28T13:03:15.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a467fc700 1 -- 172.21.15.82:0/1374068546 learned_addr learned my addr 172.21.15.82:0/1374068546 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:15.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a477fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a400dfb70 0x7f7a400d88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41908/0 (socket says 172.21.15.82:41908) 2023-11-28T13:03:15.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a477fe700 1 -- 172.21.15.82:0/1374068546 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a400dd280 msgr2=0x7f7a400d8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:15.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a477fe700 1 --2- 172.21.15.82:0/1374068546 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a400dd280 0x7f7a400d8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:15.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a477fe700 1 -- 172.21.15.82:0/1374068546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a40036cb0 msgr2=0x7f7a400ded70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:15.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a477fe700 1 --2- 172.21.15.82:0/1374068546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a40036cb0 0x7f7a400ded70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:15.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a477fe700 1 -- 172.21.15.82:0/1374068546 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a400e0710 con 0x7f7a400dfb70 2023-11-28T13:03:15.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a46ffd700 1 --2- 172.21.15.82:0/1374068546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a40036cb0 0x7f7a400ded70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:03:15.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a477fe700 1 --2- 172.21.15.82:0/1374068546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a400dfb70 0x7f7a400d88b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7a48074a60 tx=0x7f7a48069a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:15.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a2f7fe700 1 -- 172.21.15.82:0/1374068546 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a480a0070 con 0x7f7a400dfb70 2023-11-28T13:03:15.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a47fff700 1 -- 172.21.15.82:0/1374068546 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a400e0430 con 0x7f7a400dfb70 2023-11-28T13:03:15.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a2f7fe700 1 -- 172.21.15.82:0/1374068546 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a48098040 con 0x7f7a400dfb70 2023-11-28T13:03:15.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a2f7fe700 1 -- 172.21.15.82:0/1374068546 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48066de0 con 0x7f7a400dfb70 2023-11-28T13:03:15.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.484+0000 7f7a47fff700 1 -- 172.21.15.82:0/1374068546 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a400e09f0 con 0x7f7a400dfb70 2023-11-28T13:03:15.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.488+0000 7f7a47fff700 1 -- 172.21.15.82:0/1374068546 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a40005570 con 0x7f7a400dfb70 2023-11-28T13:03:15.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.488+0000 7f7a2f7fe700 1 -- 172.21.15.82:0/1374068546 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7a48061020 con 0x7f7a400dfb70 2023-11-28T13:03:15.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.488+0000 7f7a2f7fe700 1 --2- 172.21.15.82:0/1374068546 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a34064ee0 0x7f7a34067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:15.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.488+0000 7f7a2f7fe700 1 -- 172.21.15.82:0/1374068546 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7a480fc340 con 0x7f7a400dfb70 2023-11-28T13:03:15.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.488+0000 7f7a46ffd700 1 --2- 172.21.15.82:0/1374068546 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a34064ee0 0x7f7a34067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:15.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.488+0000 7f7a46ffd700 1 --2- 172.21.15.82:0/1374068546 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a34064ee0 0x7f7a34067390 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009f40 tx=0x7f7a38009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:15.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.496+0000 7f7a2f7fe700 1 -- 172.21.15.82:0/1374068546 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7a480ca630 con 0x7f7a400dfb70 2023-11-28T13:03:15.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:15.712+0000 7f7a47fff700 1 -- 172.21.15.82:0/1374068546 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7f7a400df690 con 0x7f7a400dfb70 2023-11-28T13:03:16.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.032+0000 7f7a2f7fe700 1 -- 172.21.15.82:0/1374068546 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v160) v1 ==== 149+0+0 (secure 0 0 0) 0x7f7a480cdc50 con 0x7f7a400dfb70 2023-11-28T13:03:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.036+0000 7f7a47fff700 1 -- 172.21.15.82:0/1374068546 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a34064ee0 msgr2=0x7f7a34067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.036+0000 7f7a47fff700 1 --2- 172.21.15.82:0/1374068546 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a34064ee0 0x7f7a34067390 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009f40 tx=0x7f7a38009240 comp rx=0 tx=0).stop 2023-11-28T13:03:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.036+0000 7f7a47fff700 1 -- 172.21.15.82:0/1374068546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a400dfb70 msgr2=0x7f7a400d88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.036+0000 7f7a47fff700 1 --2- 172.21.15.82:0/1374068546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a400dfb70 0x7f7a400d88b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7a48074a60 tx=0x7f7a48069a10 comp rx=0 tx=0).stop 2023-11-28T13:03:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.036+0000 7f7a47fff700 1 -- 172.21.15.82:0/1374068546 shutdown_connections 2023-11-28T13:03:16.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.036+0000 7f7a47fff700 1 --2- 172.21.15.82:0/1374068546 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7a34064ee0 0x7f7a34067390 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:16.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.036+0000 7f7a47fff700 1 --2- 172.21.15.82:0/1374068546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a400dfb70 0x7f7a400d88b0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:16.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.036+0000 7f7a47fff700 1 --2- 172.21.15.82:0/1374068546 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a400dd280 0x7f7a400d8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:16.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.036+0000 7f7a47fff700 1 --2- 172.21.15.82:0/1374068546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a40036cb0 0x7f7a400ded70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:16.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.036+0000 7f7a47fff700 1 -- 172.21.15.82:0/1374068546 >> 172.21.15.82:0/1374068546 conn(0x7f7a40051770 msgr2=0x7f7a4004fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:16.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.036+0000 7f7a47fff700 1 -- 172.21.15.82:0/1374068546 shutdown_connections 2023-11-28T13:03:16.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.036+0000 7f7a47fff700 1 -- 172.21.15.82:0/1374068546 wait complete. 2023-11-28T13:03:16.057 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2023-11-28T13:03:16.058 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2023-11-28T13:03:16.058 INFO:tasks.cephfs_test_runner:test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T13:03:16.058 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2023-11-28T13:03:16.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.172+0000 7fe8a4b20700 1 Processor -- start 2023-11-28T13:03:16.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.172+0000 7fe8a4b20700 1 -- start start 2023-11-28T13:03:16.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.172+0000 7fe8a4b20700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe8a015c1c0 0x7fe8a00c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:16.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.172+0000 7fe8a4b20700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe8a00ca4b0 0x7fe8a006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:16.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.172+0000 7fe8a4b20700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a00cd2e0 con 0x7fe8a006d910 2023-11-28T13:03:16.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.172+0000 7fe8a4b20700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a006dd50 con 0x7fe8a015c1c0 2023-11-28T13:03:16.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.172+0000 7fe8a4b20700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a00ca9c0 con 0x7fe8a00ca4b0 2023-11-28T13:03:16.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.172+0000 7fe89f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe8a015c1c0 0x7fe8a00c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:16.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.172+0000 7fe89f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe8a015c1c0 0x7fe8a00c9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41912/0 (socket says 172.21.15.82:41912) 2023-11-28T13:03:16.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.172+0000 7fe89f7fe700 1 -- 172.21.15.82:0/3430759884 learned_addr learned my addr 172.21.15.82:0/3430759884 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.172+0000 7fe89effd700 1 --2- 172.21.15.82:0/3430759884 >> v2:172.21.15.114:3300/0 conn(0x7fe8a00ca4b0 0x7fe8a006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.172+0000 7fe89f7fe700 1 -- 172.21.15.82:0/3430759884 >> v2:172.21.15.114:3300/0 conn(0x7fe8a00ca4b0 msgr2=0x7fe8a006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.172+0000 7fe89f7fe700 1 --2- 172.21.15.82:0/3430759884 >> v2:172.21.15.114:3300/0 conn(0x7fe8a00ca4b0 0x7fe8a006d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.172+0000 7fe89f7fe700 1 -- 172.21.15.82:0/3430759884 >> v1:172.21.15.114:6789/0 conn(0x7fe8a006d910 legacy=0x7fe8a00710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.172+0000 7fe89f7fe700 1 -- 172.21.15.82:0/3430759884 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a00cd530 con 0x7fe8a015c1c0 2023-11-28T13:03:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.172+0000 7fe89f7fe700 1 --2- 172.21.15.82:0/3430759884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8a015c1c0 0x7fe8a00c9f70 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe8a006e6b0 tx=0x7fe888009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=342d2b073213ff7d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.172+0000 7fe89e7fc700 1 -- 172.21.15.82:0/3430759884 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe888004230 con 0x7fe8a015c1c0 2023-11-28T13:03:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.172+0000 7fe89e7fc700 1 -- 172.21.15.82:0/3430759884 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe888004390 con 0x7fe8a015c1c0 2023-11-28T13:03:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.172+0000 7fe89e7fc700 1 -- 172.21.15.82:0/3430759884 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8880036c0 con 0x7fe8a015c1c0 2023-11-28T13:03:16.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe8a4b20700 1 -- 172.21.15.82:0/3430759884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8a015c1c0 msgr2=0x7fe8a00c9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:16.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe8a4b20700 1 --2- 172.21.15.82:0/3430759884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8a015c1c0 0x7fe8a00c9f70 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe8a006e6b0 tx=0x7fe888009bf0 comp rx=0 tx=0).stop 2023-11-28T13:03:16.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe8a4b20700 1 -- 172.21.15.82:0/3430759884 shutdown_connections 2023-11-28T13:03:16.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe8a4b20700 1 --2- 172.21.15.82:0/3430759884 >> v2:172.21.15.114:3300/0 conn(0x7fe8a00ca4b0 0x7fe8a006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:16.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe8a4b20700 1 --2- 172.21.15.82:0/3430759884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8a015c1c0 0x7fe8a00c9f70 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:16.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe8a4b20700 1 -- 172.21.15.82:0/3430759884 >> 172.21.15.82:0/3430759884 conn(0x7fe8a00cf710 msgr2=0x7fe8a00cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:16.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe8a4b20700 1 -- 172.21.15.82:0/3430759884 shutdown_connections 2023-11-28T13:03:16.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe8a4b20700 1 -- 172.21.15.82:0/3430759884 wait complete. 2023-11-28T13:03:16.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe8a4b20700 1 Processor -- start 2023-11-28T13:03:16.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe8a4b20700 1 -- start start 2023-11-28T13:03:16.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe8a4b20700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8a006d910 0x7fe8a00ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:16.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe8a4b20700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8a00ca4b0 0x7fe8a01f13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:16.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe8a4b20700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8a015c1c0 0x7fe8a00c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:16.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe8a4b20700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a00ae0b0 con 0x7fe8a015c1c0 2023-11-28T13:03:16.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe8a4b20700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a00ae320 con 0x7fe8a00ca4b0 2023-11-28T13:03:16.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe8a4b20700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a00ae600 con 0x7fe8a006d910 2023-11-28T13:03:16.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe89ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8a015c1c0 0x7fe8a00c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:16.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe89ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8a015c1c0 0x7fe8a00c4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41928/0 (socket says 172.21.15.82:41928) 2023-11-28T13:03:16.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe89ffff700 1 -- 172.21.15.82:0/4066911998 learned_addr learned my addr 172.21.15.82:0/4066911998 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:16.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe89effd700 1 --2- 172.21.15.82:0/4066911998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8a00ca4b0 0x7fe8a01f13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:16.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe89f7fe700 1 --2- 172.21.15.82:0/4066911998 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8a006d910 0x7fe8a00ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:16.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe89ffff700 1 -- 172.21.15.82:0/4066911998 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8a006d910 msgr2=0x7fe8a00ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:16.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe89ffff700 1 --2- 172.21.15.82:0/4066911998 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8a006d910 0x7fe8a00ab8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:16.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe89ffff700 1 -- 172.21.15.82:0/4066911998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8a00ca4b0 msgr2=0x7fe8a01f13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:16.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe89ffff700 1 --2- 172.21.15.82:0/4066911998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8a00ca4b0 0x7fe8a01f13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:16.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe89ffff700 1 -- 172.21.15.82:0/4066911998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe888009570 con 0x7fe8a015c1c0 2023-11-28T13:03:16.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.176+0000 7fe89ffff700 1 --2- 172.21.15.82:0/4066911998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8a015c1c0 0x7fe8a00c4f10 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe89800b970 tx=0x7fe89800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:16.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.180+0000 7fe897fff700 1 -- 172.21.15.82:0/4066911998 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89800c930 con 0x7fe8a015c1c0 2023-11-28T13:03:16.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.180+0000 7fe897fff700 1 -- 172.21.15.82:0/4066911998 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89800cad0 con 0x7fe8a015c1c0 2023-11-28T13:03:16.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.180+0000 7fe897fff700 1 -- 172.21.15.82:0/4066911998 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89800ce80 con 0x7fe8a015c1c0 2023-11-28T13:03:16.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.180+0000 7fe8a4b20700 1 -- 172.21.15.82:0/4066911998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a00cdaf0 con 0x7fe8a015c1c0 2023-11-28T13:03:16.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.180+0000 7fe8a4b20700 1 -- 172.21.15.82:0/4066911998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a00cd810 con 0x7fe8a015c1c0 2023-11-28T13:03:16.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.180+0000 7fe8a4b20700 1 -- 172.21.15.82:0/4066911998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a015c590 con 0x7fe8a015c1c0 2023-11-28T13:03:16.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.180+0000 7fe897fff700 1 -- 172.21.15.82:0/4066911998 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe89801b030 con 0x7fe8a015c1c0 2023-11-28T13:03:16.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.180+0000 7fe897fff700 1 --2- 172.21.15.82:0/4066911998 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe880064ee0 0x7fe880067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:16.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.180+0000 7fe897fff700 1 -- 172.21.15.82:0/4066911998 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe8980815a0 con 0x7fe8a015c1c0 2023-11-28T13:03:16.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.180+0000 7fe89f7fe700 1 --2- 172.21.15.82:0/4066911998 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe880064ee0 0x7fe880067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:16.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.180+0000 7fe89f7fe700 1 --2- 172.21.15.82:0/4066911998 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe880064ee0 0x7fe880067390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe8a006e6b0 tx=0x7fe888008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:16.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.188+0000 7fe897fff700 1 -- 172.21.15.82:0/4066911998 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe89804c400 con 0x7fe8a015c1c0 2023-11-28T13:03:16.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:16.416+0000 7fe8a4b20700 1 -- 172.21.15.82:0/4066911998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7fe8a015da50 con 0x7fe8a015c1c0 2023-11-28T13:03:17.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.036+0000 7fe897fff700 1 -- 172.21.15.82:0/4066911998 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v161) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe89804faf0 con 0x7fe8a015c1c0 2023-11-28T13:03:17.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.040+0000 7fe8a4b20700 1 -- 172.21.15.82:0/4066911998 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe880064ee0 msgr2=0x7fe880067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:17.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.040+0000 7fe8a4b20700 1 --2- 172.21.15.82:0/4066911998 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe880064ee0 0x7fe880067390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe8a006e6b0 tx=0x7fe888008030 comp rx=0 tx=0).stop 2023-11-28T13:03:17.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.040+0000 7fe8a4b20700 1 -- 172.21.15.82:0/4066911998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8a015c1c0 msgr2=0x7fe8a00c4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:17.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.040+0000 7fe8a4b20700 1 --2- 172.21.15.82:0/4066911998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8a015c1c0 0x7fe8a00c4f10 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe89800b970 tx=0x7fe89800bc80 comp rx=0 tx=0).stop 2023-11-28T13:03:17.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.040+0000 7fe8a4b20700 1 -- 172.21.15.82:0/4066911998 shutdown_connections 2023-11-28T13:03:17.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.040+0000 7fe8a4b20700 1 --2- 172.21.15.82:0/4066911998 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fe880064ee0 0x7fe880067390 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.040+0000 7fe8a4b20700 1 --2- 172.21.15.82:0/4066911998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8a015c1c0 0x7fe8a00c4f10 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.040+0000 7fe8a4b20700 1 --2- 172.21.15.82:0/4066911998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8a00ca4b0 0x7fe8a01f13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.040+0000 7fe8a4b20700 1 --2- 172.21.15.82:0/4066911998 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8a006d910 0x7fe8a00ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.040+0000 7fe8a4b20700 1 -- 172.21.15.82:0/4066911998 >> 172.21.15.82:0/4066911998 conn(0x7fe8a00cf710 msgr2=0x7fe8a00cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:17.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.040+0000 7fe8a4b20700 1 -- 172.21.15.82:0/4066911998 shutdown_connections 2023-11-28T13:03:17.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.040+0000 7fe8a4b20700 1 -- 172.21.15.82:0/4066911998 wait complete. 2023-11-28T13:03:17.063 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T13:03:17.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.184+0000 7f04f888c700 1 Processor -- start 2023-11-28T13:03:17.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.184+0000 7f04f888c700 1 -- start start 2023-11-28T13:03:17.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.184+0000 7f04f888c700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f04f4150ee0 0x7f04f4070120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.184+0000 7f04f888c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04f4070660 0x7f04f406ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.184+0000 7f04f888c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f04f406b180 0x7f04f40ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.184+0000 7f04f888c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f4069bc0 con 0x7f04f406b180 2023-11-28T13:03:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.184+0000 7f04f888c700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f4069e80 con 0x7f04f4150ee0 2023-11-28T13:03:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.184+0000 7f04f888c700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f406a160 con 0x7f04f4070660 2023-11-28T13:03:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.184+0000 7f04f359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f04f406b180 0x7f04f40ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.184+0000 7f04f359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f04f406b180 0x7f04f40ad8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58548/0 (socket says 172.21.15.82:58548) 2023-11-28T13:03:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.184+0000 7f04f359e700 1 -- 172.21.15.82:0/223465250 learned_addr learned my addr 172.21.15.82:0/223465250 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.184+0000 7f04f259c700 1 --2- 172.21.15.82:0/223465250 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04f4070660 0x7f04f406ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.184+0000 7f04f2d9d700 1 --2- 172.21.15.82:0/223465250 >> v2:172.21.15.114:3300/0 conn(0x7f04f4150ee0 0x7f04f4070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:17.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.184+0000 7f04f359e700 1 -- 172.21.15.82:0/223465250 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04f4070660 msgr2=0x7f04f406ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:17.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.184+0000 7f04f359e700 1 --2- 172.21.15.82:0/223465250 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04f4070660 0x7f04f406ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.184+0000 7f04f359e700 1 -- 172.21.15.82:0/223465250 >> v2:172.21.15.114:3300/0 conn(0x7f04f4150ee0 msgr2=0x7f04f4070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:17.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.184+0000 7f04f359e700 1 --2- 172.21.15.82:0/223465250 >> v2:172.21.15.114:3300/0 conn(0x7f04f4150ee0 0x7f04f4070120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.184+0000 7f04f359e700 1 -- 172.21.15.82:0/223465250 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f406a440 con 0x7f04f406b180 2023-11-28T13:03:17.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.184+0000 7f04f359e700 1 --2- 172.21.15.82:0/223465250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04f406b180 0x7f04f40ad8b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f04f406b760 tx=0x7f04ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2bf1ec4f8017f14 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:17.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f1d9b700 1 -- 172.21.15.82:0/223465250 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec00e070 con 0x7f04f406b180 2023-11-28T13:03:17.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f1d9b700 1 -- 172.21.15.82:0/223465250 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ec00b910 con 0x7f04f406b180 2023-11-28T13:03:17.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f1d9b700 1 -- 172.21.15.82:0/223465250 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec00bcc0 con 0x7f04f406b180 2023-11-28T13:03:17.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f888c700 1 -- 172.21.15.82:0/223465250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04f406b180 msgr2=0x7f04f40ad8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:17.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f888c700 1 --2- 172.21.15.82:0/223465250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04f406b180 0x7f04f40ad8b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f04f406b760 tx=0x7f04ec00b330 comp rx=0 tx=0).stop 2023-11-28T13:03:17.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f888c700 1 -- 172.21.15.82:0/223465250 shutdown_connections 2023-11-28T13:03:17.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f888c700 1 --2- 172.21.15.82:0/223465250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04f406b180 0x7f04f40ad8b0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f888c700 1 --2- 172.21.15.82:0/223465250 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04f4070660 0x7f04f406ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f888c700 1 --2- 172.21.15.82:0/223465250 >> v2:172.21.15.114:3300/0 conn(0x7f04f4150ee0 0x7f04f4070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f888c700 1 -- 172.21.15.82:0/223465250 >> 172.21.15.82:0/223465250 conn(0x7f04f40ce630 msgr2=0x7f04f40cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:17.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f888c700 1 -- 172.21.15.82:0/223465250 shutdown_connections 2023-11-28T13:03:17.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f888c700 1 -- 172.21.15.82:0/223465250 wait complete. 2023-11-28T13:03:17.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f888c700 1 Processor -- start 2023-11-28T13:03:17.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f888c700 1 -- start start 2023-11-28T13:03:17.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f888c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04f406b180 0x7f04f41ef350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:17.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f888c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04f4070660 0x7f04f40c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:17.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f888c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04f4150ee0 0x7f04f40c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:17.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f888c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f40c64e0 con 0x7f04f406b180 2023-11-28T13:03:17.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f888c700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f41ef890 con 0x7f04f4070660 2023-11-28T13:03:17.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f888c700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f415d510 con 0x7f04f4150ee0 2023-11-28T13:03:17.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04f406b180 0x7f04f41ef350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:17.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04f406b180 0x7f04f41ef350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58564/0 (socket says 172.21.15.82:58564) 2023-11-28T13:03:17.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f359e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04f4150ee0 0x7f04f40c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:17.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f2d9d700 1 -- 172.21.15.82:0/1074005222 learned_addr learned my addr 172.21.15.82:0/1074005222 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:17.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f259c700 1 --2- 172.21.15.82:0/1074005222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04f4070660 0x7f04f40c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:17.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.188+0000 7f04f2d9d700 1 -- 172.21.15.82:0/1074005222 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04f4150ee0 msgr2=0x7f04f40c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:17.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.192+0000 7f04f2d9d700 1 --2- 172.21.15.82:0/1074005222 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04f4150ee0 0x7f04f40c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.192+0000 7f04f2d9d700 1 -- 172.21.15.82:0/1074005222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04f4070660 msgr2=0x7f04f40c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:17.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.192+0000 7f04f2d9d700 1 --2- 172.21.15.82:0/1074005222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04f4070660 0x7f04f40c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.192+0000 7f04f2d9d700 1 -- 172.21.15.82:0/1074005222 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ec009b30 con 0x7f04f406b180 2023-11-28T13:03:17.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.192+0000 7f04f359e700 1 --2- 172.21.15.82:0/1074005222 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04f4150ee0 0x7f04f40c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:03:17.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.192+0000 7f04f2d9d700 1 --2- 172.21.15.82:0/1074005222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04f406b180 0x7f04f41ef350 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f04e400e840 tx=0x7f04e400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:17.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.192+0000 7f04db7fe700 1 -- 172.21.15.82:0/1074005222 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e40095a0 con 0x7f04f406b180 2023-11-28T13:03:17.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.192+0000 7f04db7fe700 1 -- 172.21.15.82:0/1074005222 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e4013680 con 0x7f04f406b180 2023-11-28T13:03:17.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.192+0000 7f04db7fe700 1 -- 172.21.15.82:0/1074005222 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e40139f0 con 0x7f04f406b180 2023-11-28T13:03:17.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.192+0000 7f04f888c700 1 -- 172.21.15.82:0/1074005222 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f41512b0 con 0x7f04f406b180 2023-11-28T13:03:17.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.192+0000 7f04f888c700 1 -- 172.21.15.82:0/1074005222 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f406a720 con 0x7f04f406b180 2023-11-28T13:03:17.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.192+0000 7f04f888c700 1 -- 172.21.15.82:0/1074005222 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f4151440 con 0x7f04f406b180 2023-11-28T13:03:17.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.192+0000 7f04db7fe700 1 -- 172.21.15.82:0/1074005222 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f04e4019030 con 0x7f04f406b180 2023-11-28T13:03:17.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.192+0000 7f04db7fe700 1 --2- 172.21.15.82:0/1074005222 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f04e0064ee0 0x7f04e0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:17.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.192+0000 7f04db7fe700 1 -- 172.21.15.82:0/1074005222 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f04e40818c0 con 0x7f04f406b180 2023-11-28T13:03:17.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.192+0000 7f04f259c700 1 --2- 172.21.15.82:0/1074005222 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f04e0064ee0 0x7f04e0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:17.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.196+0000 7f04f259c700 1 --2- 172.21.15.82:0/1074005222 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f04e0064ee0 0x7f04e0067390 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f04f41503a0 tx=0x7f04e8009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:17.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.200+0000 7f04db7fe700 1 -- 172.21.15.82:0/1074005222 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f04e404fd60 con 0x7f04f406b180 2023-11-28T13:03:17.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.368+0000 7f04f888c700 1 -- 172.21.15.82:0/1074005222 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f04f4065fc0 con 0x7f04f406b180 2023-11-28T13:03:17.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.376+0000 7f04db7fe700 1 -- 172.21.15.82:0/1074005222 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f04e4053380 con 0x7f04f406b180 2023-11-28T13:03:17.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.380+0000 7f04f888c700 1 -- 172.21.15.82:0/1074005222 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f04e0064ee0 msgr2=0x7f04e0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:17.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.380+0000 7f04f888c700 1 --2- 172.21.15.82:0/1074005222 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f04e0064ee0 0x7f04e0067390 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f04f41503a0 tx=0x7f04e8009240 comp rx=0 tx=0).stop 2023-11-28T13:03:17.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.380+0000 7f04f888c700 1 -- 172.21.15.82:0/1074005222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04f406b180 msgr2=0x7f04f41ef350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.380+0000 7f04f888c700 1 --2- 172.21.15.82:0/1074005222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04f406b180 0x7f04f41ef350 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f04e400e840 tx=0x7f04e400eb50 comp rx=0 tx=0).stop 2023-11-28T13:03:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.380+0000 7f04f888c700 1 -- 172.21.15.82:0/1074005222 shutdown_connections 2023-11-28T13:03:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.380+0000 7f04f888c700 1 --2- 172.21.15.82:0/1074005222 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f04e0064ee0 0x7f04e0067390 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.380+0000 7f04f888c700 1 --2- 172.21.15.82:0/1074005222 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04f4150ee0 0x7f04f40c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.380+0000 7f04f888c700 1 --2- 172.21.15.82:0/1074005222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04f4070660 0x7f04f40c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.380+0000 7f04f888c700 1 --2- 172.21.15.82:0/1074005222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04f406b180 0x7f04f41ef350 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.380+0000 7f04f888c700 1 -- 172.21.15.82:0/1074005222 >> 172.21.15.82:0/1074005222 conn(0x7f04f40ce630 msgr2=0x7f04f40b3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.380+0000 7f04f888c700 1 -- 172.21.15.82:0/1074005222 shutdown_connections 2023-11-28T13:03:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.380+0000 7f04f888c700 1 -- 172.21.15.82:0/1074005222 wait complete. 2023-11-28T13:03:17.444 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T13:03:17.444 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T13:03:17.465 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T13:03:17.486 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T13:03:17.486 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:03:17.486 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:03:17.494 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346276k,nr_inodes=4086569,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=221 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275484k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T13:03:17.494 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:03:17.495 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:03:17.502 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19664 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T13:03:17.502 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:03:17.502 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:03:17.509 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346276k,nr_inodes=4086569,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=221 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275484k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T13:03:17.509 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:03:17.509 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:03:17.552 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19664 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T13:03:17.553 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T13:03:17.553 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:03:17.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.668+0000 7f0476a2f700 1 Processor -- start 2023-11-28T13:03:17.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f0476a2f700 1 -- start start 2023-11-28T13:03:17.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f0476a2f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0470152ad0 0x7f04700caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:17.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f0476a2f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f04700cafc0 0x7f04700703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:17.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f0476a2f700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0470158a80 con 0x7f047006e4d0 2023-11-28T13:03:17.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f0476a2f700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04701598e0 con 0x7f04700cafc0 2023-11-28T13:03:17.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f0476a2f700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04700ae280 con 0x7f0470152ad0 2023-11-28T13:03:17.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f046f7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f04700cafc0 0x7f04700703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:17.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f0474fcc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f047006e4d0 0x7f0470069d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55780/0 (socket says 172.21.15.82:55780) 2023-11-28T13:03:17.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f0474fcc700 1 -- 172.21.15.82:0/2523043441 learned_addr learned my addr 172.21.15.82:0/2523043441 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:17.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f046ffff700 1 --2- 172.21.15.82:0/2523043441 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0470152ad0 0x7f04700caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:17.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f046f7fe700 1 -- 172.21.15.82:0/2523043441 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0470152ad0 msgr2=0x7f04700caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:17.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f046f7fe700 1 --2- 172.21.15.82:0/2523043441 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0470152ad0 0x7f04700caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f046f7fe700 1 -- 172.21.15.82:0/2523043441 >> v1:172.21.15.82:6789/0 conn(0x7f047006e4d0 legacy=0x7f0470069d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:17.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f046effd700 1 -- 172.21.15.82:0/2523043441 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716131745 0 0) 0x7f0470158a80 con 0x7f047006e4d0 2023-11-28T13:03:17.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f046f7fe700 1 -- 172.21.15.82:0/2523043441 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0470158cd0 con 0x7f04700cafc0 2023-11-28T13:03:17.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f046f7fe700 1 --2- 172.21.15.82:0/2523043441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04700cafc0 0x7f04700703e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f0464009850 tx=0x7f0464009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50bf81665694348e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:17.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f046effd700 1 -- 172.21.15.82:0/2523043441 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0464011830 con 0x7f04700cafc0 2023-11-28T13:03:17.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f046effd700 1 -- 172.21.15.82:0/2523043441 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0464011990 con 0x7f04700cafc0 2023-11-28T13:03:17.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f046effd700 1 -- 172.21.15.82:0/2523043441 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0464011d40 con 0x7f04700cafc0 2023-11-28T13:03:17.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f0476a2f700 1 -- 172.21.15.82:0/2523043441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04700cafc0 msgr2=0x7f04700703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:17.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f0476a2f700 1 --2- 172.21.15.82:0/2523043441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04700cafc0 0x7f04700703e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f0464009850 tx=0x7f0464009b60 comp rx=0 tx=0).stop 2023-11-28T13:03:17.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f0476a2f700 1 -- 172.21.15.82:0/2523043441 shutdown_connections 2023-11-28T13:03:17.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f0476a2f700 1 --2- 172.21.15.82:0/2523043441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04700cafc0 0x7f04700703e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f0476a2f700 1 --2- 172.21.15.82:0/2523043441 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0470152ad0 0x7f04700caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f0476a2f700 1 -- 172.21.15.82:0/2523043441 >> 172.21.15.82:0/2523043441 conn(0x7f04700ce9b0 msgr2=0x7f04700ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:17.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.672+0000 7f0476a2f700 1 -- 172.21.15.82:0/2523043441 shutdown_connections 2023-11-28T13:03:17.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.676+0000 7f0476a2f700 1 -- 172.21.15.82:0/2523043441 wait complete. 2023-11-28T13:03:17.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.676+0000 7f0476a2f700 1 Processor -- start 2023-11-28T13:03:17.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.676+0000 7f0476a2f700 1 -- start start 2023-11-28T13:03:17.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f0476a2f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f047006e4d0 0x7f0470150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:17.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f0476a2f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04700cafc0 0x7f04700c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:17.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f0476a2f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0470152ad0 0x7f04700702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:17.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f0476a2f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04700b3fe0 con 0x7f0470152ad0 2023-11-28T13:03:17.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f0476a2f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04700b36f0 con 0x7f04700cafc0 2023-11-28T13:03:17.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f0476a2f700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04700c9ef0 con 0x7f047006e4d0 2023-11-28T13:03:17.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f0474fcc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0470152ad0 0x7f04700702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:17.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f046ffff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f047006e4d0 0x7f0470150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:17.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f0474fcc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0470152ad0 0x7f04700702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58580/0 (socket says 172.21.15.82:58580) 2023-11-28T13:03:17.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f0474fcc700 1 -- 172.21.15.82:0/3945382224 learned_addr learned my addr 172.21.15.82:0/3945382224 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:17.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f046f7fe700 1 --2- 172.21.15.82:0/3945382224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04700cafc0 0x7f04700c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:17.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f0474fcc700 1 -- 172.21.15.82:0/3945382224 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f047006e4d0 msgr2=0x7f0470150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:17.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f0474fcc700 1 --2- 172.21.15.82:0/3945382224 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f047006e4d0 0x7f0470150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f0474fcc700 1 -- 172.21.15.82:0/3945382224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04700cafc0 msgr2=0x7f04700c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:17.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f0474fcc700 1 --2- 172.21.15.82:0/3945382224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04700cafc0 0x7f04700c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f0474fcc700 1 -- 172.21.15.82:0/3945382224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04640094b0 con 0x7f0470152ad0 2023-11-28T13:03:17.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f046f7fe700 1 --2- 172.21.15.82:0/3945382224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04700cafc0 0x7f04700c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:03:17.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f0474fcc700 1 --2- 172.21.15.82:0/3945382224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0470152ad0 0x7f04700702e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0468002230 tx=0x7f046800cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:17.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f046cff9700 1 -- 172.21.15.82:0/3945382224 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046800aaa0 con 0x7f0470152ad0 2023-11-28T13:03:17.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f046cff9700 1 -- 172.21.15.82:0/3945382224 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046800ac20 con 0x7f0470152ad0 2023-11-28T13:03:17.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f0476a2f700 1 -- 172.21.15.82:0/3945382224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0470159290 con 0x7f0470152ad0 2023-11-28T13:03:17.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f046cff9700 1 -- 172.21.15.82:0/3945382224 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04680070d0 con 0x7f0470152ad0 2023-11-28T13:03:17.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f0476a2f700 1 -- 172.21.15.82:0/3945382224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0470158fb0 con 0x7f0470152ad0 2023-11-28T13:03:17.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.680+0000 7f0476a2f700 1 -- 172.21.15.82:0/3945382224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0470159570 con 0x7f0470152ad0 2023-11-28T13:03:17.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.684+0000 7f046cff9700 1 -- 172.21.15.82:0/3945382224 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0468010070 con 0x7f0470152ad0 2023-11-28T13:03:17.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.684+0000 7f046cff9700 1 --2- 172.21.15.82:0/3945382224 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f045c064ee0 0x7f045c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:17.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.684+0000 7f046cff9700 1 -- 172.21.15.82:0/3945382224 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0468081590 con 0x7f0470152ad0 2023-11-28T13:03:17.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.684+0000 7f046ffff700 1 --2- 172.21.15.82:0/3945382224 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f045c064ee0 0x7f045c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:17.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.684+0000 7f046ffff700 1 --2- 172.21.15.82:0/3945382224 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f045c064ee0 0x7f045c067390 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0460009b50 tx=0x7f0460009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:17.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.692+0000 7f046cff9700 1 -- 172.21.15.82:0/3945382224 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f046804f960 con 0x7f0470152ad0 2023-11-28T13:03:17.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.892+0000 7f0476a2f700 1 -- 172.21.15.82:0/3945382224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04700b4120 con 0x7f0470152ad0 2023-11-28T13:03:17.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.892+0000 7f046cff9700 1 -- 172.21.15.82:0/3945382224 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f04700b4120 con 0x7f0470152ad0 2023-11-28T13:03:17.897 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:17.897 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/704061431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":704061431},{"type":"v1","addr":"172.21.15.114:6834","nonce":704061431}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3972503523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3972503523},{"type":"v1","addr":"172.21.15.82:6836","nonce":3972503523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5811,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2000262220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2000262220},{"type":"v1","addr":"172.21.15.82:6837","nonce":2000262220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":6237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/878385246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":878385246},{"type":"v1","addr":"172.21.15.114:6835","nonce":878385246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[]} 2023-11-28T13:03:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.896+0000 7f0476a2f700 1 -- 172.21.15.82:0/3945382224 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f045c064ee0 msgr2=0x7f045c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.896+0000 7f0476a2f700 1 --2- 172.21.15.82:0/3945382224 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f045c064ee0 0x7f045c067390 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0460009b50 tx=0x7f0460009240 comp rx=0 tx=0).stop 2023-11-28T13:03:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.896+0000 7f0476a2f700 1 -- 172.21.15.82:0/3945382224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0470152ad0 msgr2=0x7f04700702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.896+0000 7f0476a2f700 1 --2- 172.21.15.82:0/3945382224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0470152ad0 0x7f04700702e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0468002230 tx=0x7f046800cec0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.896+0000 7f0476a2f700 1 -- 172.21.15.82:0/3945382224 shutdown_connections 2023-11-28T13:03:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.896+0000 7f0476a2f700 1 --2- 172.21.15.82:0/3945382224 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f045c064ee0 0x7f045c067390 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.896+0000 7f0476a2f700 1 --2- 172.21.15.82:0/3945382224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0470152ad0 0x7f04700702e0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.896+0000 7f0476a2f700 1 --2- 172.21.15.82:0/3945382224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04700cafc0 0x7f04700c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.896+0000 7f0476a2f700 1 --2- 172.21.15.82:0/3945382224 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f047006e4d0 0x7f0470150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.896+0000 7f0476a2f700 1 -- 172.21.15.82:0/3945382224 >> 172.21.15.82:0/3945382224 conn(0x7f04700ce9b0 msgr2=0x7f047006c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:17.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.896+0000 7f0476a2f700 1 -- 172.21.15.82:0/3945382224 shutdown_connections 2023-11-28T13:03:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:17.896+0000 7f0476a2f700 1 -- 172.21.15.82:0/3945382224 wait complete. 2023-11-28T13:03:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 24 2023-11-28T13:03:17.912 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T13:03:17.913 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T13:03:17.913 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T13:03:17.913 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:03:17.913 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T13:03:17.913 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T13:03:17.913 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T13:03:17.913 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:03:17.914 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T13:03:17.914 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T13:03:17.914 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T13:03:17.914 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:03:17.914 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T13:03:17.914 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T13:03:17.915 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T13:03:17.915 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:03:17.924 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T13:03:17.925 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T13:03:17.926 INFO:tasks.ceph.mds.c:Started 2023-11-28T13:03:17.926 DEBUG:teuthology.parallel:result is None 2023-11-28T13:03:17.929 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T13:03:17.929 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T13:03:17.930 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T13:03:17.931 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T13:03:17.933 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T13:03:17.933 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T13:03:17.934 INFO:tasks.ceph.mds.b:Started 2023-11-28T13:03:17.935 DEBUG:teuthology.parallel:result is None 2023-11-28T13:03:17.936 INFO:tasks.ceph.mds.a:Started 2023-11-28T13:03:17.936 DEBUG:teuthology.parallel:result is None 2023-11-28T13:03:17.982 INFO:tasks.ceph.mds.d:Started 2023-11-28T13:03:17.983 DEBUG:teuthology.parallel:result is None 2023-11-28T13:03:17.983 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T13:03:18.002 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-11-28T13:03:18.014 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-11-28T13:03:18.014 INFO:tasks.ceph.mds.b.smithi114.stdout:starting mds.b at 2023-11-28T13:03:18.065 INFO:tasks.ceph.mds.d.smithi114.stdout:starting mds.d at 2023-11-28T13:03:18.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.084+0000 7f7c6188f700 1 Processor -- start 2023-11-28T13:03:18.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6188f700 1 -- start start 2023-11-28T13:03:18.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6188f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c5c15d420 0x7f7c5c0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:18.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6188f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c5c0b1ce0 0x7f7c5c070730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:18.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6188f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7c5c070c70 0x7f7c5c0cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:18.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6188f700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5c0cec30 con 0x7f7c5c15d420 2023-11-28T13:03:18.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6188f700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5c0710d0 con 0x7f7c5c070c70 2023-11-28T13:03:18.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6188f700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c15de60 con 0x7f7c5c0b1ce0 2023-11-28T13:03:18.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6088d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c5c15d420 0x7f7c5c0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:18.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6088d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c5c15d420 0x7f7c5c0ce6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58622/0 (socket says 172.21.15.82:58622) 2023-11-28T13:03:18.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6088d700 1 -- 172.21.15.82:0/2125430282 learned_addr learned my addr 172.21.15.82:0/2125430282 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:18.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c5bfff700 1 --2- 172.21.15.82:0/2125430282 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c5c0b1ce0 0x7f7c5c070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:18.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6088d700 1 -- 172.21.15.82:0/2125430282 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c5c0b1ce0 msgr2=0x7f7c5c070730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:18.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6088d700 1 --2- 172.21.15.82:0/2125430282 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c5c0b1ce0 0x7f7c5c070730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:18.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6088d700 1 -- 172.21.15.82:0/2125430282 >> v2:172.21.15.114:3300/0 conn(0x7f7c5c070c70 msgr2=0x7f7c5c0cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:18.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6108e700 1 --2- 172.21.15.82:0/2125430282 >> v2:172.21.15.114:3300/0 conn(0x7f7c5c070c70 0x7f7c5c0cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:18.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6088d700 1 --2- 172.21.15.82:0/2125430282 >> v2:172.21.15.114:3300/0 conn(0x7f7c5c070c70 0x7f7c5c0cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:18.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6088d700 1 -- 172.21.15.82:0/2125430282 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c15e140 con 0x7f7c5c15d420 2023-11-28T13:03:18.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6108e700 1 --2- 172.21.15.82:0/2125430282 >> v2:172.21.15.114:3300/0 conn(0x7f7c5c070c70 0x7f7c5c0cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:03:18.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6088d700 1 --2- 172.21.15.82:0/2125430282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5c15d420 0x7f7c5c0ce6f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c071480 tx=0x7f7c50009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21dbc5f5bfd47f7e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:18.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c5b7fe700 1 -- 172.21.15.82:0/2125430282 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5000b8a0 con 0x7f7c5c15d420 2023-11-28T13:03:18.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c5b7fe700 1 -- 172.21.15.82:0/2125430282 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5000ba00 con 0x7f7c5c15d420 2023-11-28T13:03:18.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c5b7fe700 1 -- 172.21.15.82:0/2125430282 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5000bd90 con 0x7f7c5c15d420 2023-11-28T13:03:18.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6188f700 1 -- 172.21.15.82:0/2125430282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5c15d420 msgr2=0x7f7c5c0ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:18.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6188f700 1 --2- 172.21.15.82:0/2125430282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5c15d420 0x7f7c5c0ce6f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c071480 tx=0x7f7c50009bf0 comp rx=0 tx=0).stop 2023-11-28T13:03:18.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6188f700 1 -- 172.21.15.82:0/2125430282 shutdown_connections 2023-11-28T13:03:18.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6188f700 1 --2- 172.21.15.82:0/2125430282 >> v2:172.21.15.114:3300/0 conn(0x7f7c5c070c70 0x7f7c5c0cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:18.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6188f700 1 --2- 172.21.15.82:0/2125430282 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c5c0b1ce0 0x7f7c5c070730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:18.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6188f700 1 --2- 172.21.15.82:0/2125430282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5c15d420 0x7f7c5c0ce6f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:18.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6188f700 1 -- 172.21.15.82:0/2125430282 >> 172.21.15.82:0/2125430282 conn(0x7f7c5c0cb890 msgr2=0x7f7c5c0cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:18.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6188f700 1 -- 172.21.15.82:0/2125430282 shutdown_connections 2023-11-28T13:03:18.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.088+0000 7f7c6188f700 1 -- 172.21.15.82:0/2125430282 wait complete. 2023-11-28T13:03:18.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c6188f700 1 Processor -- start 2023-11-28T13:03:18.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c6188f700 1 -- start start 2023-11-28T13:03:18.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c6188f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c5c070c70 0x7f7c5c158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:18.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c6188f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5c0b1ce0 0x7f7c5c0b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:18.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c6188f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c5c15d420 0x7f7c5c0b2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:18.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c6188f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c158880 con 0x7f7c5c0b1ce0 2023-11-28T13:03:18.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c6188f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c0a8dd0 con 0x7f7c5c15d420 2023-11-28T13:03:18.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c6188f700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c0c5ff0 con 0x7f7c5c070c70 2023-11-28T13:03:18.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c5bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5c0b1ce0 0x7f7c5c0b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:18.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c5bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5c0b1ce0 0x7f7c5c0b20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58636/0 (socket says 172.21.15.82:58636) 2023-11-28T13:03:18.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c5bfff700 1 -- 172.21.15.82:0/3125052192 learned_addr learned my addr 172.21.15.82:0/3125052192 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:18.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c6088d700 1 --2- 172.21.15.82:0/3125052192 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c5c070c70 0x7f7c5c158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:18.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c6108e700 1 --2- 172.21.15.82:0/3125052192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c5c15d420 0x7f7c5c0b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:18.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c5bfff700 1 -- 172.21.15.82:0/3125052192 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c5c070c70 msgr2=0x7f7c5c158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:18.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c5bfff700 1 --2- 172.21.15.82:0/3125052192 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c5c070c70 0x7f7c5c158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:18.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c5bfff700 1 -- 172.21.15.82:0/3125052192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c5c15d420 msgr2=0x7f7c5c0b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:18.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c5bfff700 1 --2- 172.21.15.82:0/3125052192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c5c15d420 0x7f7c5c0b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:18.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c5bfff700 1 -- 172.21.15.82:0/3125052192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c50009570 con 0x7f7c5c0b1ce0 2023-11-28T13:03:18.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c6108e700 1 --2- 172.21.15.82:0/3125052192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c5c15d420 0x7f7c5c0b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:18.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c5bfff700 1 --2- 172.21.15.82:0/3125052192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5c0b1ce0 0x7f7c5c0b20f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800c7f0 tx=0x7f7c4800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:18.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c597fa700 1 -- 172.21.15.82:0/3125052192 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48004220 con 0x7f7c5c0b1ce0 2023-11-28T13:03:18.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c597fa700 1 -- 172.21.15.82:0/3125052192 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c48004380 con 0x7f7c5c0b1ce0 2023-11-28T13:03:18.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c6188f700 1 -- 172.21.15.82:0/3125052192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5c15e700 con 0x7f7c5c0b1ce0 2023-11-28T13:03:18.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c597fa700 1 -- 172.21.15.82:0/3125052192 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c480036c0 con 0x7f7c5c0b1ce0 2023-11-28T13:03:18.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.092+0000 7f7c6188f700 1 -- 172.21.15.82:0/3125052192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5c15e420 con 0x7f7c5c0b1ce0 2023-11-28T13:03:18.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.096+0000 7f7c6188f700 1 -- 172.21.15.82:0/3125052192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c5c15e9e0 con 0x7f7c5c0b1ce0 2023-11-28T13:03:18.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.096+0000 7f7c597fa700 1 -- 172.21.15.82:0/3125052192 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7c48003820 con 0x7f7c5c0b1ce0 2023-11-28T13:03:18.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.096+0000 7f7c597fa700 1 --2- 172.21.15.82:0/3125052192 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7c40064ee0 0x7f7c40067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:18.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.096+0000 7f7c597fa700 1 -- 172.21.15.82:0/3125052192 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7c48081d90 con 0x7f7c5c0b1ce0 2023-11-28T13:03:18.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.096+0000 7f7c6088d700 1 --2- 172.21.15.82:0/3125052192 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7c40064ee0 0x7f7c40067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:18.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.096+0000 7f7c6088d700 1 --2- 172.21.15.82:0/3125052192 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7c40064ee0 0x7f7c40067390 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7c50014040 tx=0x7f7c50008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:18.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.108+0000 7f7c597fa700 1 -- 172.21.15.82:0/3125052192 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7c480500e0 con 0x7f7c5c0b1ce0 2023-11-28T13:03:18.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:18.280+0000 7f7c6188f700 1 -- 172.21.15.82:0/3125052192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7c5c065fc0 con 0x7f7c5c0b1ce0 2023-11-28T13:03:19.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.084+0000 7f7c597fa700 1 -- 172.21.15.82:0/3125052192 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v61) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7c4801e080 con 0x7f7c5c0b1ce0 2023-11-28T13:03:19.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.088+0000 7f7c6188f700 1 -- 172.21.15.82:0/3125052192 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7c40064ee0 msgr2=0x7f7c40067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:19.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.088+0000 7f7c6188f700 1 --2- 172.21.15.82:0/3125052192 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7c40064ee0 0x7f7c40067390 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7c50014040 tx=0x7f7c50008030 comp rx=0 tx=0).stop 2023-11-28T13:03:19.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.088+0000 7f7c6188f700 1 -- 172.21.15.82:0/3125052192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5c0b1ce0 msgr2=0x7f7c5c0b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:19.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.088+0000 7f7c6188f700 1 --2- 172.21.15.82:0/3125052192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5c0b1ce0 0x7f7c5c0b20f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800c7f0 tx=0x7f7c4800cb00 comp rx=0 tx=0).stop 2023-11-28T13:03:19.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.088+0000 7f7c6188f700 1 -- 172.21.15.82:0/3125052192 shutdown_connections 2023-11-28T13:03:19.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.088+0000 7f7c6188f700 1 --2- 172.21.15.82:0/3125052192 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7c40064ee0 0x7f7c40067390 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.088+0000 7f7c6188f700 1 --2- 172.21.15.82:0/3125052192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c5c15d420 0x7f7c5c0b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.088+0000 7f7c6188f700 1 --2- 172.21.15.82:0/3125052192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5c0b1ce0 0x7f7c5c0b20f0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.088+0000 7f7c6188f700 1 --2- 172.21.15.82:0/3125052192 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7c5c070c70 0x7f7c5c158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.088+0000 7f7c6188f700 1 -- 172.21.15.82:0/3125052192 >> 172.21.15.82:0/3125052192 conn(0x7f7c5c0cb890 msgr2=0x7f7c5c0c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:19.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.088+0000 7f7c6188f700 1 -- 172.21.15.82:0/3125052192 shutdown_connections 2023-11-28T13:03:19.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.088+0000 7f7c6188f700 1 -- 172.21.15.82:0/3125052192 wait complete. 2023-11-28T13:03:19.096 INFO:teuthology.orchestra.run.smithi082.stderr: removed all blocklist entries 2023-11-28T13:03:19.107 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T13:03:19.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.264+0000 7f89d622a700 1 Processor -- start 2023-11-28T13:03:19.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.264+0000 7f89d622a700 1 -- start start 2023-11-28T13:03:19.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.264+0000 7f89d622a700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f89d0158df0 0x7f89d015d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:19.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.264+0000 7f89d622a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89d0070070 0x7f89d00704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:19.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.264+0000 7f89d622a700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d015da50 con 0x7f89d01591c0 2023-11-28T13:03:19.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.264+0000 7f89d622a700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d0070a30 con 0x7f89d0158df0 2023-11-28T13:03:19.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.264+0000 7f89d622a700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d00c9e20 con 0x7f89d0070070 2023-11-28T13:03:19.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.264+0000 7f89d4a27700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f89d01591c0 0x7f89d006c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55804/0 (socket says 172.21.15.82:55804) 2023-11-28T13:03:19.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.264+0000 7f89d4a27700 1 -- 172.21.15.82:0/474408765 learned_addr learned my addr 172.21.15.82:0/474408765 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:19.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.264+0000 7f89d5228700 1 --2- 172.21.15.82:0/474408765 >> v2:172.21.15.114:3300/0 conn(0x7f89d0158df0 0x7f89d015d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:19.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.264+0000 7f89c3fff700 1 -- 172.21.15.82:0/474408765 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420304193 0 0) 0x7f89c4001110 con 0x7f89d01591c0 2023-11-28T13:03:19.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.264+0000 7f89d5a29700 1 --2- 172.21.15.82:0/474408765 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89d0070070 0x7f89d00704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:19.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.264+0000 7f89c3fff700 1 -- 172.21.15.82:0/474408765 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89bc0035d0 con 0x7f89d01591c0 2023-11-28T13:03:19.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89c3fff700 1 -- 172.21.15.82:0/474408765 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3142078865 0 0) 0x7f89bc0035d0 con 0x7f89d01591c0 2023-11-28T13:03:19.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89c3fff700 1 -- 172.21.15.82:0/474408765 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89d0070070 msgr2=0x7f89d00704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:19.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89c3fff700 1 --2- 172.21.15.82:0/474408765 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89d0070070 0x7f89d00704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89c3fff700 1 -- 172.21.15.82:0/474408765 >> v2:172.21.15.114:3300/0 conn(0x7f89d0158df0 msgr2=0x7f89d015d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:19.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89c3fff700 1 --2- 172.21.15.82:0/474408765 >> v2:172.21.15.114:3300/0 conn(0x7f89d0158df0 0x7f89d015d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89c3fff700 1 -- 172.21.15.82:0/474408765 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d00cc640 con 0x7f89d01591c0 2023-11-28T13:03:19.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89c3fff700 1 -- 172.21.15.82:0/474408765 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f89c4001800 con 0x7f89d01591c0 2023-11-28T13:03:19.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89d5a29700 1 --2- 172.21.15.82:0/474408765 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89d0070070 0x7f89d00704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:19.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89c3fff700 1 -- 172.21.15.82:0/474408765 >> v1:172.21.15.82:6789/0 conn(0x7f89d01591c0 legacy=0x7f89d006c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:19.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89c3fff700 1 --2- 172.21.15.82:0/474408765 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89d0070070 0x7f89bc003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:19.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89c3fff700 1 --2- 172.21.15.82:0/474408765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89bc004010 0x7f89bc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:19.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89c3fff700 1 --2- 172.21.15.82:0/474408765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89bc004db0 0x7f89bc005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:19.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89c3fff700 1 -- 172.21.15.82:0/474408765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d0070a30 con 0x7f89bc004010 2023-11-28T13:03:19.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89c3fff700 1 -- 172.21.15.82:0/474408765 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d00c9e20 con 0x7f89bc004db0 2023-11-28T13:03:19.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89c3fff700 1 -- 172.21.15.82:0/474408765 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc00bae0 con 0x7f89d0070070 2023-11-28T13:03:19.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89d4a27700 1 --2- 172.21.15.82:0/474408765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89bc004010 0x7f89bc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:19.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89d5228700 1 --2- 172.21.15.82:0/474408765 >> v2:172.21.15.114:3300/0 conn(0x7f89d0158df0 0x7f89d015d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:19.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89d5228700 1 --2- 172.21.15.82:0/474408765 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89d0070070 0x7f89bc003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:19.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89d4a27700 1 -- 172.21.15.82:0/474408765 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89d0070070 msgr2=0x7f89bc003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:19.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89d5a29700 1 --2- 172.21.15.82:0/474408765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89bc004db0 0x7f89bc005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:19.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89d4a27700 1 --2- 172.21.15.82:0/474408765 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89d0070070 0x7f89bc003a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89d4a27700 1 -- 172.21.15.82:0/474408765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89bc004db0 msgr2=0x7f89bc005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:19.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89d4a27700 1 --2- 172.21.15.82:0/474408765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89bc004db0 0x7f89bc005220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89d4a27700 1 -- 172.21.15.82:0/474408765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89bc0035d0 con 0x7f89bc004010 2023-11-28T13:03:19.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89d4a27700 1 --2- 172.21.15.82:0/474408765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89bc004010 0x7f89bc004870 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f89c4008fd0 tx=0x7f89bc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9254731e03540250 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:19.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89c3fff700 1 -- 172.21.15.82:0/474408765 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c4004d00 con 0x7f89bc004010 2023-11-28T13:03:19.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89c3fff700 1 -- 172.21.15.82:0/474408765 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c4005b80 con 0x7f89bc004010 2023-11-28T13:03:19.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89c3fff700 1 -- 172.21.15.82:0/474408765 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c40080e0 con 0x7f89bc004010 2023-11-28T13:03:19.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89d622a700 1 -- 172.21.15.82:0/474408765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89bc004010 msgr2=0x7f89bc004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:19.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89d622a700 1 --2- 172.21.15.82:0/474408765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89bc004010 0x7f89bc004870 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f89c4008fd0 tx=0x7f89bc0058a0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89d5a29700 1 -- 172.21.15.82:0/474408765 reap_dead start 2023-11-28T13:03:19.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89d622a700 1 -- 172.21.15.82:0/474408765 shutdown_connections 2023-11-28T13:03:19.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89d622a700 1 -- 172.21.15.82:0/474408765 >> 172.21.15.82:0/474408765 conn(0x7f89d00ce600 msgr2=0x7f89d00ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:19.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89d622a700 1 -- 172.21.15.82:0/474408765 shutdown_connections 2023-11-28T13:03:19.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.268+0000 7f89d622a700 1 -- 172.21.15.82:0/474408765 wait complete. 2023-11-28T13:03:19.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d622a700 1 Processor -- start 2023-11-28T13:03:19.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d622a700 1 -- start start 2023-11-28T13:03:19.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d622a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89bc004010 0x7f89d0148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:19.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d622a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89d00c1f40 0x7f89d00c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:19.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d622a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89d01f1fc0 0x7f89d01f2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:19.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d622a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d0148a90 con 0x7f89d00c1f40 2023-11-28T13:03:19.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d622a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d01f2970 con 0x7f89bc004010 2023-11-28T13:03:19.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d622a700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d00c27e0 con 0x7f89d01f1fc0 2023-11-28T13:03:19.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d4a27700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89d00c1f40 0x7f89d00c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:19.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d4a27700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89d00c1f40 0x7f89d00c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58644/0 (socket says 172.21.15.82:58644) 2023-11-28T13:03:19.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d4a27700 1 -- 172.21.15.82:0/946472381 learned_addr learned my addr 172.21.15.82:0/946472381 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:19.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d5228700 1 --2- 172.21.15.82:0/946472381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89bc004010 0x7f89d0148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:19.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d5a29700 1 --2- 172.21.15.82:0/946472381 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89d01f1fc0 0x7f89d01f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:19.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d4a27700 1 -- 172.21.15.82:0/946472381 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89d01f1fc0 msgr2=0x7f89d01f2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:19.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d4a27700 1 --2- 172.21.15.82:0/946472381 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89d01f1fc0 0x7f89d01f2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d4a27700 1 -- 172.21.15.82:0/946472381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89bc004010 msgr2=0x7f89d0148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:19.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d4a27700 1 --2- 172.21.15.82:0/946472381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89bc004010 0x7f89d0148550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d4a27700 1 -- 172.21.15.82:0/946472381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d00c9ab0 con 0x7f89d00c1f40 2023-11-28T13:03:19.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d5a29700 1 --2- 172.21.15.82:0/946472381 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89d01f1fc0 0x7f89d01f2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:03:19.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d4a27700 1 --2- 172.21.15.82:0/946472381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89d00c1f40 0x7f89d00c7fd0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f89c4004b40 tx=0x7f89c4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:19.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89c1ffb700 1 -- 172.21.15.82:0/946472381 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c40017c0 con 0x7f89d00c1f40 2023-11-28T13:03:19.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89c1ffb700 1 -- 172.21.15.82:0/946472381 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c4001a20 con 0x7f89d00c1f40 2023-11-28T13:03:19.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d622a700 1 -- 172.21.15.82:0/946472381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d00c97d0 con 0x7f89d00c1f40 2023-11-28T13:03:19.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89c1ffb700 1 -- 172.21.15.82:0/946472381 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c40080e0 con 0x7f89d00c1f40 2023-11-28T13:03:19.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.272+0000 7f89d622a700 1 -- 172.21.15.82:0/946472381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d00c9480 con 0x7f89d00c1f40 2023-11-28T13:03:19.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.276+0000 7f89d622a700 1 -- 172.21.15.82:0/946472381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d0065fc0 con 0x7f89d00c1f40 2023-11-28T13:03:19.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.276+0000 7f89c1ffb700 1 -- 172.21.15.82:0/946472381 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f89c4011030 con 0x7f89d00c1f40 2023-11-28T13:03:19.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.276+0000 7f89c1ffb700 1 --2- 172.21.15.82:0/946472381 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f89b4064ee0 0x7f89b4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:19.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.276+0000 7f89d5228700 1 --2- 172.21.15.82:0/946472381 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f89b4064ee0 0x7f89b4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:19.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.276+0000 7f89c1ffb700 1 -- 172.21.15.82:0/946472381 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f89c4084ec0 con 0x7f89d00c1f40 2023-11-28T13:03:19.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.276+0000 7f89d5228700 1 --2- 172.21.15.82:0/946472381 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f89b4064ee0 0x7f89b4067390 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f89d01f3030 tx=0x7f89cc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:19.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.280+0000 7f89c1ffb700 1 -- 172.21.15.82:0/946472381 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f89c40533f0 con 0x7f89d00c1f40 2023-11-28T13:03:19.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.500+0000 7f89d622a700 1 -- 172.21.15.82:0/946472381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f89d015da50 con 0x7f89d00c1f40 2023-11-28T13:03:19.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.500+0000 7f89c1ffb700 1 -- 172.21.15.82:0/946472381 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) v1 ==== 80+0+5298 (secure 0 0 0) 0x7f89d015da50 con 0x7f89d00c1f40 2023-11-28T13:03:19.506 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:19.507 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:03:19.507 INFO:teuthology.orchestra.run.smithi082.stdout: "auth_dump": [ 2023-11-28T13:03:19.507 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:19.507 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.a", 2023-11-28T13:03:19.507 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlCdS5DxAA6mejkVFcUsLxQRj3VIVjiA==", 2023-11-28T13:03:19.507 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:03:19.507 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:03:19.507 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-11-28T13:03:19.507 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-11-28T13:03:19.507 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:03:19.507 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:19.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:19.508 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:19.508 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.b", 2023-11-28T13:03:19.508 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVls/voFhAAwSFuDQwvvCr9AWGJTcYVYA==", 2023-11-28T13:03:19.508 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:03:19.508 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:03:19.508 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-11-28T13:03:19.508 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-11-28T13:03:19.508 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:03:19.508 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:19.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:19.508 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:19.509 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.c", 2023-11-28T13:03:19.509 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVltTgvExAA5x6bGq3lWvWbwnvFAHNIHQ==", 2023-11-28T13:03:19.509 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:03:19.509 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:03:19.509 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-11-28T13:03:19.509 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-11-28T13:03:19.509 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:03:19.509 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:19.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:19.509 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:19.509 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.d", 2023-11-28T13:03:19.509 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlT4ecGhAA/S/lIx6fXgbKUmDq6TXAag==", 2023-11-28T13:03:19.509 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:03:19.510 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:03:19.510 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-11-28T13:03:19.510 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-11-28T13:03:19.510 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:03:19.510 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:19.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:19.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:19.510 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.0", 2023-11-28T13:03:19.510 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAz5GVlMpQBERAAim3Dp31FdCvBHZRLRmpUEA==", 2023-11-28T13:03:19.510 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:03:19.510 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:03:19.510 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:03:19.511 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:03:19.511 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:19.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:19.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:19.511 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.1", 2023-11-28T13:03:19.511 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA25GVlbynJJhAAVPGWlzi2gCbAx8A2CtTDew==", 2023-11-28T13:03:19.511 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:03:19.511 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:03:19.511 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:03:19.511 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:03:19.511 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:19.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:19.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:19.512 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.2", 2023-11-28T13:03:19.512 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA55GVl8le5OBAA6KTsYliyG4l1fqTHluWUgA==", 2023-11-28T13:03:19.512 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:03:19.512 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:03:19.512 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:03:19.512 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:03:19.512 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:19.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:19.512 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:19.512 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.3", 2023-11-28T13:03:19.512 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA95GVlupEwAxAAb2UOrNbiicmvMKlJkWrwVA==", 2023-11-28T13:03:19.512 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:03:19.512 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:03:19.513 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:03:19.513 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:03:19.513 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:19.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:19.513 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:19.513 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.4", 2023-11-28T13:03:19.513 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBC5GVlXgk5KhAAUhkPiT909nUDc/DQ2uITYQ==", 2023-11-28T13:03:19.513 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:03:19.513 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:03:19.513 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:03:19.513 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:03:19.513 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:19.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:19.514 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:19.514 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.5", 2023-11-28T13:03:19.514 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBG5GVloYsaBBAAn1PYxCBVxsjA6Mmq/cnUrQ==", 2023-11-28T13:03:19.514 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:03:19.514 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:03:19.514 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:03:19.514 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:03:19.514 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:19.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:19.514 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:19.514 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.6", 2023-11-28T13:03:19.515 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBJ5GVljJcAFhAAVy/GB5HhhbKfmXji0e+7sw==", 2023-11-28T13:03:19.515 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:03:19.515 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:03:19.515 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:03:19.515 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:03:19.515 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:19.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:19.515 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:19.515 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.7", 2023-11-28T13:03:19.515 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBM5GVlNcBbHhAAvMcutUUBiQEgLHGFK4Nb7Q==", 2023-11-28T13:03:19.515 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:03:19.515 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-11-28T13:03:19.516 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-11-28T13:03:19.516 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:03:19.516 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:19.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:19.516 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:19.516 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.0", 2023-11-28T13:03:19.516 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlK0wtHhAAALaA+R3pU9RtJq4wvijo3Q==", 2023-11-28T13:03:19.516 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:03:19.516 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:03:19.516 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow r", 2023-11-28T13:03:19.516 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rw pool=cephfs_data" 2023-11-28T13:03:19.516 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:19.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:19.517 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:19.517 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.1", 2023-11-28T13:03:19.517 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlb19GJxAApBeChk0RMz7CTiIBPNn+kQ==", 2023-11-28T13:03:19.517 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:03:19.517 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:03:19.517 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-11-28T13:03:19.517 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-11-28T13:03:19.517 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-11-28T13:03:19.517 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:19.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:19.517 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:19.517 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.2", 2023-11-28T13:03:19.517 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlOosGJBAAO019e3SgRbOsmZWZdVihpA==", 2023-11-28T13:03:19.518 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:03:19.518 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:03:19.518 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-11-28T13:03:19.518 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-11-28T13:03:19.518 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-11-28T13:03:19.518 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:19.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:19.518 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:19.518 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.3", 2023-11-28T13:03:19.518 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlf59HKhAAvROZEH3qiOM8RLS2pgNGxw==", 2023-11-28T13:03:19.518 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:03:19.519 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-11-28T13:03:19.519 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-11-28T13:03:19.519 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-11-28T13:03:19.519 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-11-28T13:03:19.519 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:19.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:19.519 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:19.519 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.admin", 2023-11-28T13:03:19.519 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAv5GVlThU6NxAAKEg/veQS9Wg1PeZl3scbbQ==", 2023-11-28T13:03:19.519 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:03:19.519 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-11-28T13:03:19.519 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-11-28T13:03:19.520 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-11-28T13:03:19.520 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:03:19.520 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:19.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:19.520 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:19.520 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.x", 2023-11-28T13:03:19.520 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlas3pCxAAHp82YHi3DweifxetdtSMQg==", 2023-11-28T13:03:19.520 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:03:19.520 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-11-28T13:03:19.520 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-11-28T13:03:19.520 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:03:19.520 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:19.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:19.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:19.521 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.y", 2023-11-28T13:03:19.521 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAw5GVlpOu6CBAAlqY+m5+MrGgcRTUOT2+seQ==", 2023-11-28T13:03:19.521 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-11-28T13:03:19.521 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-11-28T13:03:19.521 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-11-28T13:03:19.521 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-11-28T13:03:19.521 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:19.521 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:19.521 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-11-28T13:03:19.521 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:03:19.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.504+0000 7f89d622a700 1 -- 172.21.15.82:0/946472381 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f89b4064ee0 msgr2=0x7f89b4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:19.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.504+0000 7f89d622a700 1 --2- 172.21.15.82:0/946472381 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f89b4064ee0 0x7f89b4067390 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f89d01f3030 tx=0x7f89cc008040 comp rx=0 tx=0).stop 2023-11-28T13:03:19.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.504+0000 7f89d622a700 1 -- 172.21.15.82:0/946472381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89d00c1f40 msgr2=0x7f89d00c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:19.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.504+0000 7f89d622a700 1 --2- 172.21.15.82:0/946472381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89d00c1f40 0x7f89d00c7fd0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f89c4004b40 tx=0x7f89c4004ab0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.504+0000 7f89d622a700 1 -- 172.21.15.82:0/946472381 shutdown_connections 2023-11-28T13:03:19.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.504+0000 7f89d622a700 1 --2- 172.21.15.82:0/946472381 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f89b4064ee0 0x7f89b4067390 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.504+0000 7f89d622a700 1 --2- 172.21.15.82:0/946472381 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89d01f1fc0 0x7f89d01f2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.504+0000 7f89d622a700 1 --2- 172.21.15.82:0/946472381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89d00c1f40 0x7f89d00c7fd0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.504+0000 7f89d622a700 1 --2- 172.21.15.82:0/946472381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89bc004010 0x7f89d0148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.504+0000 7f89d622a700 1 -- 172.21.15.82:0/946472381 >> 172.21.15.82:0/946472381 conn(0x7f89d00ce600 msgr2=0x7f89d00b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:19.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.504+0000 7f89d622a700 1 -- 172.21.15.82:0/946472381 shutdown_connections 2023-11-28T13:03:19.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.504+0000 7f89d622a700 1 -- 172.21.15.82:0/946472381 wait complete. 2023-11-28T13:03:19.524 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:03:19.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69359e700 1 Processor -- start 2023-11-28T13:03:19.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69359e700 1 -- start start 2023-11-28T13:03:19.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff694070070 0x7ff694070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:19.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69359e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff69406d980 0x7ff6940cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:19.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69359e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69406d780 con 0x7ff69406cfa0 2023-11-28T13:03:19.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69359e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69406cb10 con 0x7ff694070070 2023-11-28T13:03:19.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69359e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff694070980 con 0x7ff69406d980 2023-11-28T13:03:19.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69259c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff694070070 0x7ff694070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:19.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69259c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff694070070 0x7ff694070440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58646/0 (socket says 172.21.15.82:58646) 2023-11-28T13:03:19.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff691d9b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff69406d980 0x7ff6940cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:19.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69259c700 1 -- 172.21.15.82:0/1433497243 learned_addr learned my addr 172.21.15.82:0/1433497243 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:19.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69259c700 1 -- 172.21.15.82:0/1433497243 >> v2:172.21.15.114:3300/0 conn(0x7ff69406d980 msgr2=0x7ff6940cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:19.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69259c700 1 --2- 172.21.15.82:0/1433497243 >> v2:172.21.15.114:3300/0 conn(0x7ff69406d980 0x7ff6940cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69159a700 1 -- 172.21.15.82:0/1433497243 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653204804 0 0) 0x7ff69406d780 con 0x7ff69406cfa0 2023-11-28T13:03:19.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69259c700 1 -- 172.21.15.82:0/1433497243 >> v1:172.21.15.114:6789/0 conn(0x7ff69406cfa0 legacy=0x7ff69415fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:19.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69259c700 1 -- 172.21.15.82:0/1433497243 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69406ddf0 con 0x7ff694070070 2023-11-28T13:03:19.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69259c700 1 --2- 172.21.15.82:0/1433497243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff694070070 0x7ff694070440 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff6940cb050 tx=0x7ff688009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127dd8673e1dd90a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:19.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69159a700 1 -- 172.21.15.82:0/1433497243 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff688011830 con 0x7ff694070070 2023-11-28T13:03:19.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69159a700 1 -- 172.21.15.82:0/1433497243 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff688011990 con 0x7ff694070070 2023-11-28T13:03:19.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69159a700 1 -- 172.21.15.82:0/1433497243 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff688011d20 con 0x7ff694070070 2023-11-28T13:03:19.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69359e700 1 -- 172.21.15.82:0/1433497243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff694070070 msgr2=0x7ff694070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:19.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69359e700 1 --2- 172.21.15.82:0/1433497243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff694070070 0x7ff694070440 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff6940cb050 tx=0x7ff688009bf0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69359e700 1 -- 172.21.15.82:0/1433497243 shutdown_connections 2023-11-28T13:03:19.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69359e700 1 --2- 172.21.15.82:0/1433497243 >> v2:172.21.15.114:3300/0 conn(0x7ff69406d980 0x7ff6940cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69359e700 1 --2- 172.21.15.82:0/1433497243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff694070070 0x7ff694070440 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69359e700 1 -- 172.21.15.82:0/1433497243 >> 172.21.15.82:0/1433497243 conn(0x7ff6940ce600 msgr2=0x7ff6940ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:19.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69359e700 1 -- 172.21.15.82:0/1433497243 shutdown_connections 2023-11-28T13:03:19.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.636+0000 7ff69359e700 1 -- 172.21.15.82:0/1433497243 wait complete. 2023-11-28T13:03:19.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff69359e700 1 Processor -- start 2023-11-28T13:03:19.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff69359e700 1 -- start start 2023-11-28T13:03:19.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff69359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff69406cfa0 0x7ff6940c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:19.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff69359e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff69406d980 0x7ff6940ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:19.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff69359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff694070070 0x7ff6940aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:19.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff69359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6940c22d0 con 0x7ff694070070 2023-11-28T13:03:19.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff69359e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6940c25b0 con 0x7ff69406cfa0 2023-11-28T13:03:19.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff69359e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6940c2890 con 0x7ff69406d980 2023-11-28T13:03:19.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff692d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff694070070 0x7ff6940aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:19.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff692d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff694070070 0x7ff6940aea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58656/0 (socket says 172.21.15.82:58656) 2023-11-28T13:03:19.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff692d9d700 1 -- 172.21.15.82:0/874243853 learned_addr learned my addr 172.21.15.82:0/874243853 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:19.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff69259c700 1 --2- 172.21.15.82:0/874243853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff69406cfa0 0x7ff6940c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:19.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff691d9b700 1 --2- 172.21.15.82:0/874243853 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff69406d980 0x7ff6940ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:19.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff692d9d700 1 -- 172.21.15.82:0/874243853 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff69406d980 msgr2=0x7ff6940ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:19.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff692d9d700 1 --2- 172.21.15.82:0/874243853 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff69406d980 0x7ff6940ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff692d9d700 1 -- 172.21.15.82:0/874243853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff69406cfa0 msgr2=0x7ff6940c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:19.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff692d9d700 1 --2- 172.21.15.82:0/874243853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff69406cfa0 0x7ff6940c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff692d9d700 1 -- 172.21.15.82:0/874243853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff688009570 con 0x7ff694070070 2023-11-28T13:03:19.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff691d9b700 1 --2- 172.21.15.82:0/874243853 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff69406d980 0x7ff6940ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:19.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff69259c700 1 --2- 172.21.15.82:0/874243853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff69406cfa0 0x7ff6940c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:19.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff692d9d700 1 --2- 172.21.15.82:0/874243853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff694070070 0x7ff6940aea90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00c4b0 tx=0x7ff68c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:19.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff682ffd700 1 -- 172.21.15.82:0/874243853 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0054e0 con 0x7ff694070070 2023-11-28T13:03:19.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff69359e700 1 -- 172.21.15.82:0/874243853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6940ce310 con 0x7ff694070070 2023-11-28T13:03:19.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff682ffd700 1 -- 172.21.15.82:0/874243853 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68c0036a0 con 0x7ff694070070 2023-11-28T13:03:19.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff682ffd700 1 -- 172.21.15.82:0/874243853 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c003a50 con 0x7ff694070070 2023-11-28T13:03:19.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.640+0000 7ff69359e700 1 -- 172.21.15.82:0/874243853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6940ce030 con 0x7ff694070070 2023-11-28T13:03:19.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.644+0000 7ff69359e700 1 -- 172.21.15.82:0/874243853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6940cc710 con 0x7ff694070070 2023-11-28T13:03:19.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.644+0000 7ff682ffd700 1 -- 172.21.15.82:0/874243853 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff68c019030 con 0x7ff694070070 2023-11-28T13:03:19.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.644+0000 7ff682ffd700 1 --2- 172.21.15.82:0/874243853 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff674064ee0 0x7ff674067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:19.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.644+0000 7ff682ffd700 1 -- 172.21.15.82:0/874243853 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff68c080fb0 con 0x7ff694070070 2023-11-28T13:03:19.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.644+0000 7ff69259c700 1 --2- 172.21.15.82:0/874243853 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff674064ee0 0x7ff674067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:19.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.644+0000 7ff69259c700 1 --2- 172.21.15.82:0/874243853 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff674064ee0 0x7ff674067390 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff688000c00 tx=0x7ff688008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:19.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.648+0000 7ff682ffd700 1 -- 172.21.15.82:0/874243853 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff68c04f420 con 0x7ff694070070 2023-11-28T13:03:19.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.812+0000 7ff69359e700 1 -- 172.21.15.82:0/874243853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff694065fc0 con 0x7ff694070070 2023-11-28T13:03:19.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.812+0000 7ff682ffd700 1 -- 172.21.15.82:0/874243853 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+14171 (secure 0 0 0) 0x7ff68c017020 con 0x7ff694070070 2023-11-28T13:03:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:19.818 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":61,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:03:19.078506+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:03:19.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.816+0000 7ff69359e700 1 -- 172.21.15.82:0/874243853 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff674064ee0 msgr2=0x7ff674067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:19.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.816+0000 7ff69359e700 1 --2- 172.21.15.82:0/874243853 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff674064ee0 0x7ff674067390 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff688000c00 tx=0x7ff688008030 comp rx=0 tx=0).stop 2023-11-28T13:03:19.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.816+0000 7ff69359e700 1 -- 172.21.15.82:0/874243853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff694070070 msgr2=0x7ff6940aea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:19.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.816+0000 7ff69359e700 1 --2- 172.21.15.82:0/874243853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff694070070 0x7ff6940aea90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00c4b0 tx=0x7ff68c00c870 comp rx=0 tx=0).stop 2023-11-28T13:03:19.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.816+0000 7ff69359e700 1 -- 172.21.15.82:0/874243853 shutdown_connections 2023-11-28T13:03:19.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.816+0000 7ff69359e700 1 --2- 172.21.15.82:0/874243853 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff674064ee0 0x7ff674067390 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.816+0000 7ff69359e700 1 --2- 172.21.15.82:0/874243853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff694070070 0x7ff6940aea90 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.816+0000 7ff69359e700 1 --2- 172.21.15.82:0/874243853 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff69406d980 0x7ff6940ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.816+0000 7ff69359e700 1 --2- 172.21.15.82:0/874243853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff69406cfa0 0x7ff6940c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.816+0000 7ff69359e700 1 -- 172.21.15.82:0/874243853 >> 172.21.15.82:0/874243853 conn(0x7ff6940ce600 msgr2=0x7ff6940b00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:19.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.816+0000 7ff69359e700 1 -- 172.21.15.82:0/874243853 shutdown_connections 2023-11-28T13:03:19.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.816+0000 7ff69359e700 1 -- 172.21.15.82:0/874243853 wait complete. 2023-11-28T13:03:19.833 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:03:19.833 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:03:19.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.948+0000 7fc7e1362700 1 Processor -- start 2023-11-28T13:03:19.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.948+0000 7fc7e1362700 1 -- start start 2023-11-28T13:03:19.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7e1362700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc7dc0ad820 0x7fc7dc06a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:19.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7e1362700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc7dc0c9b10 0x7fc7dc0c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:19.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7e1362700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7dc0c93a0 con 0x7fc7dc070910 2023-11-28T13:03:19.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7e1362700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7dc0c96f0 con 0x7fc7dc0ad820 2023-11-28T13:03:19.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7e1362700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7dc071580 con 0x7fc7dc0c9b10 2023-11-28T13:03:19.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7d37fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc7dc0ad820 0x7fc7dc06a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:19.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7d37fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc7dc0ad820 0x7fc7dc06a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58660/0 (socket says 172.21.15.82:58660) 2023-11-28T13:03:19.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7dbfff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc7dc070910 0x7fc7dc070ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55812/0 (socket says 172.21.15.82:55812) 2023-11-28T13:03:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7d37fe700 1 -- 172.21.15.82:0/906924097 learned_addr learned my addr 172.21.15.82:0/906924097 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7e0b61700 1 --2- 172.21.15.82:0/906924097 >> v2:172.21.15.114:3300/0 conn(0x7fc7dc0c9b10 0x7fc7dc0c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7d37fe700 1 -- 172.21.15.82:0/906924097 >> v2:172.21.15.114:3300/0 conn(0x7fc7dc0c9b10 msgr2=0x7fc7dc0c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7d37fe700 1 --2- 172.21.15.82:0/906924097 >> v2:172.21.15.114:3300/0 conn(0x7fc7dc0c9b10 0x7fc7dc0c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7d37fe700 1 -- 172.21.15.82:0/906924097 >> v1:172.21.15.82:6789/0 conn(0x7fc7dc070910 legacy=0x7fc7dc070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:19.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7db7fe700 1 -- 172.21.15.82:0/906924097 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577064009 0 0) 0x7fc7dc0c93a0 con 0x7fc7dc070910 2023-11-28T13:03:19.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7d37fe700 1 -- 172.21.15.82:0/906924097 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc06ab10 con 0x7fc7dc0ad820 2023-11-28T13:03:19.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7e0b61700 1 --2- 172.21.15.82:0/906924097 >> v2:172.21.15.114:3300/0 conn(0x7fc7dc0c9b10 0x7fc7dc0c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:19.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7d37fe700 1 --2- 172.21.15.82:0/906924097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7dc0ad820 0x7fc7dc06a5d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc06fbd0 tx=0x7fc7c4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f6cd87d287788f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:19.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7db7fe700 1 -- 172.21.15.82:0/906924097 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c400ba20 con 0x7fc7dc0ad820 2023-11-28T13:03:19.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7db7fe700 1 -- 172.21.15.82:0/906924097 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c400bb80 con 0x7fc7dc0ad820 2023-11-28T13:03:19.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7db7fe700 1 -- 172.21.15.82:0/906924097 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4009e60 con 0x7fc7dc0ad820 2023-11-28T13:03:19.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7e1362700 1 -- 172.21.15.82:0/906924097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7dc0ad820 msgr2=0x7fc7dc06a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7e1362700 1 --2- 172.21.15.82:0/906924097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7dc0ad820 0x7fc7dc06a5d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc06fbd0 tx=0x7fc7c4009c20 comp rx=0 tx=0).stop 2023-11-28T13:03:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7e1362700 1 -- 172.21.15.82:0/906924097 shutdown_connections 2023-11-28T13:03:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7e1362700 1 --2- 172.21.15.82:0/906924097 >> v2:172.21.15.114:3300/0 conn(0x7fc7dc0c9b10 0x7fc7dc0c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7e1362700 1 --2- 172.21.15.82:0/906924097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7dc0ad820 0x7fc7dc06a5d0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7e1362700 1 -- 172.21.15.82:0/906924097 >> 172.21.15.82:0/906924097 conn(0x7fc7dc0ce630 msgr2=0x7fc7dc0cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7e1362700 1 -- 172.21.15.82:0/906924097 shutdown_connections 2023-11-28T13:03:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.952+0000 7fc7e1362700 1 -- 172.21.15.82:0/906924097 wait complete. 2023-11-28T13:03:19.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7e1362700 1 Processor -- start 2023-11-28T13:03:19.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7e1362700 1 -- start start 2023-11-28T13:03:19.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7e1362700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7dc070910 0x7fc7dc0cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:19.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7e1362700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7dc0ad820 0x7fc7dc15a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:19.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7e1362700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc7dc0c9b10 0x7fc7dc15ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:19.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7e1362700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc1639c0 con 0x7fc7dc070910 2023-11-28T13:03:19.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7e1362700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc163090 con 0x7fc7dc0ad820 2023-11-28T13:03:19.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7e1362700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc163370 con 0x7fc7dc0c9b10 2023-11-28T13:03:19.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7dbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7dc070910 0x7fc7dc0cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:19.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7dbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7dc070910 0x7fc7dc0cb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58664/0 (socket says 172.21.15.82:58664) 2023-11-28T13:03:19.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7dbfff700 1 -- 172.21.15.82:0/80272945 learned_addr learned my addr 172.21.15.82:0/80272945 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:19.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7d37fe700 1 --2- 172.21.15.82:0/80272945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7dc0ad820 0x7fc7dc15a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:19.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7e0b61700 1 --2- 172.21.15.82:0/80272945 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc7dc0c9b10 0x7fc7dc15ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:19.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7dbfff700 1 -- 172.21.15.82:0/80272945 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc7dc0c9b10 msgr2=0x7fc7dc15ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:19.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7dbfff700 1 --2- 172.21.15.82:0/80272945 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc7dc0c9b10 0x7fc7dc15ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7dbfff700 1 -- 172.21.15.82:0/80272945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7dc0ad820 msgr2=0x7fc7dc15a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:19.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7dbfff700 1 --2- 172.21.15.82:0/80272945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7dc0ad820 0x7fc7dc15a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:19.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7dbfff700 1 -- 172.21.15.82:0/80272945 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c4009570 con 0x7fc7dc070910 2023-11-28T13:03:19.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7dbfff700 1 --2- 172.21.15.82:0/80272945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7dc070910 0x7fc7dc0cb890 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00c4a0 tx=0x7fc7cc00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:19.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7d97fa700 1 -- 172.21.15.82:0/80272945 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc004ca0 con 0x7fc7dc070910 2023-11-28T13:03:19.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7d97fa700 1 -- 172.21.15.82:0/80272945 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7cc004e00 con 0x7fc7dc070910 2023-11-28T13:03:19.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7e1362700 1 -- 172.21.15.82:0/80272945 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7dc06b0c0 con 0x7fc7dc070910 2023-11-28T13:03:19.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7d97fa700 1 -- 172.21.15.82:0/80272945 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc007310 con 0x7fc7dc070910 2023-11-28T13:03:19.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.956+0000 7fc7e1362700 1 -- 172.21.15.82:0/80272945 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7dc06ade0 con 0x7fc7dc070910 2023-11-28T13:03:19.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.960+0000 7fc7e1362700 1 -- 172.21.15.82:0/80272945 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7dc06b3a0 con 0x7fc7dc070910 2023-11-28T13:03:19.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.960+0000 7fc7d97fa700 1 -- 172.21.15.82:0/80272945 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc7cc01a020 con 0x7fc7dc070910 2023-11-28T13:03:19.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.960+0000 7fc7d97fa700 1 --2- 172.21.15.82:0/80272945 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc7bc064ee0 0x7fc7bc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:19.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.960+0000 7fc7d37fe700 1 --2- 172.21.15.82:0/80272945 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc7bc064ee0 0x7fc7bc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:19.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.960+0000 7fc7d97fa700 1 -- 172.21.15.82:0/80272945 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc7cc081660 con 0x7fc7dc070910 2023-11-28T13:03:19.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.960+0000 7fc7d37fe700 1 --2- 172.21.15.82:0/80272945 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc7bc064ee0 0x7fc7bc067390 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc06fbd0 tx=0x7fc7c4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:19.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:19.968+0000 7fc7d97fa700 1 -- 172.21.15.82:0/80272945 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc7cc04fa60 con 0x7fc7dc070910 2023-11-28T13:03:20.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.132+0000 7fc7e1362700 1 -- 172.21.15.82:0/80272945 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7dc065fc0 con 0x7fc7dc070910 2023-11-28T13:03:20.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.132+0000 7fc7d97fa700 1 -- 172.21.15.82:0/80272945 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc7cc053080 con 0x7fc7dc070910 2023-11-28T13:03:20.138 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:03:20.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.136+0000 7fc7e1362700 1 -- 172.21.15.82:0/80272945 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc7bc064ee0 msgr2=0x7fc7bc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:20.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.136+0000 7fc7e1362700 1 --2- 172.21.15.82:0/80272945 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc7bc064ee0 0x7fc7bc067390 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc06fbd0 tx=0x7fc7c4008030 comp rx=0 tx=0).stop 2023-11-28T13:03:20.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.136+0000 7fc7e1362700 1 -- 172.21.15.82:0/80272945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7dc070910 msgr2=0x7fc7dc0cb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:20.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.136+0000 7fc7e1362700 1 --2- 172.21.15.82:0/80272945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7dc070910 0x7fc7dc0cb890 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00c4a0 tx=0x7fc7cc00c7b0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.136+0000 7fc7e1362700 1 -- 172.21.15.82:0/80272945 shutdown_connections 2023-11-28T13:03:20.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.136+0000 7fc7e1362700 1 --2- 172.21.15.82:0/80272945 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc7bc064ee0 0x7fc7bc067390 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.136+0000 7fc7e1362700 1 --2- 172.21.15.82:0/80272945 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc7dc0c9b10 0x7fc7dc15ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.136+0000 7fc7e1362700 1 --2- 172.21.15.82:0/80272945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7dc0ad820 0x7fc7dc15a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.136+0000 7fc7e1362700 1 --2- 172.21.15.82:0/80272945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7dc070910 0x7fc7dc0cb890 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.136+0000 7fc7e1362700 1 -- 172.21.15.82:0/80272945 >> 172.21.15.82:0/80272945 conn(0x7fc7dc0ce630 msgr2=0x7fc7dc0ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:20.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.136+0000 7fc7e1362700 1 -- 172.21.15.82:0/80272945 shutdown_connections 2023-11-28T13:03:20.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.136+0000 7fc7e1362700 1 -- 172.21.15.82:0/80272945 wait complete. 2023-11-28T13:03:20.153 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:03:20.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.264+0000 7f0c6a8d5700 1 Processor -- start 2023-11-28T13:03:20.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.264+0000 7f0c6a8d5700 1 -- start start 2023-11-28T13:03:20.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.264+0000 7f0c6a8d5700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c6406c140 0x7f0c640cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:20.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.264+0000 7f0c6a8d5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0c640d25b0 0x7f0c6406a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:20.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.264+0000 7f0c6a8d5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c64069bc0 con 0x7f0c640b1d10 2023-11-28T13:03:20.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.264+0000 7f0c6a8d5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c640d1480 con 0x7f0c640d25b0 2023-11-28T13:03:20.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.264+0000 7f0c6a8d5700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c640cd280 con 0x7f0c6406c140 2023-11-28T13:03:20.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.264+0000 7f0c698d3700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0c640b1d10 0x7f0c6406ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55826/0 (socket says 172.21.15.82:55826) 2023-11-28T13:03:20.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.264+0000 7f0c6a0d4700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0c640d25b0 0x7f0c6406a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:20.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.264+0000 7f0c698d3700 1 -- 172.21.15.82:0/233230686 learned_addr learned my addr 172.21.15.82:0/233230686 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:20.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.264+0000 7f0c690d2700 1 --2- 172.21.15.82:0/233230686 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c6406c140 0x7f0c640cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:20.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.264+0000 7f0c6a0d4700 1 -- 172.21.15.82:0/233230686 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c6406c140 msgr2=0x7f0c640cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:20.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.264+0000 7f0c6a0d4700 1 --2- 172.21.15.82:0/233230686 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c6406c140 0x7f0c640cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.264+0000 7f0c6a0d4700 1 -- 172.21.15.82:0/233230686 >> v1:172.21.15.82:6789/0 conn(0x7f0c640b1d10 legacy=0x7f0c6406ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:20.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.264+0000 7f0c6a0d4700 1 -- 172.21.15.82:0/233230686 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c640cd560 con 0x7f0c640d25b0 2023-11-28T13:03:20.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.264+0000 7f0c6a0d4700 1 --2- 172.21.15.82:0/233230686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c640d25b0 0x7f0c6406a050 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c009d90 tx=0x7f0c5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74c8ecfc938d366 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:20.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.268+0000 7f0c688d1700 1 -- 172.21.15.82:0/233230686 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c00e070 con 0x7f0c640d25b0 2023-11-28T13:03:20.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.268+0000 7f0c688d1700 1 -- 172.21.15.82:0/233230686 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5c00bb20 con 0x7f0c640d25b0 2023-11-28T13:03:20.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.268+0000 7f0c688d1700 1 -- 172.21.15.82:0/233230686 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c012430 con 0x7f0c640d25b0 2023-11-28T13:03:20.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.268+0000 7f0c6a8d5700 1 -- 172.21.15.82:0/233230686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c640d25b0 msgr2=0x7f0c6406a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:20.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.268+0000 7f0c6a8d5700 1 --2- 172.21.15.82:0/233230686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c640d25b0 0x7f0c6406a050 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c009d90 tx=0x7f0c5c00b330 comp rx=0 tx=0).stop 2023-11-28T13:03:20.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.268+0000 7f0c6a8d5700 1 -- 172.21.15.82:0/233230686 shutdown_connections 2023-11-28T13:03:20.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.268+0000 7f0c6a8d5700 1 --2- 172.21.15.82:0/233230686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c640d25b0 0x7f0c6406a050 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.268+0000 7f0c6a8d5700 1 --2- 172.21.15.82:0/233230686 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c6406c140 0x7f0c640cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.268+0000 7f0c6a8d5700 1 -- 172.21.15.82:0/233230686 >> 172.21.15.82:0/233230686 conn(0x7f0c640b52a0 msgr2=0x7f0c640d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:20.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.268+0000 7f0c6a8d5700 1 -- 172.21.15.82:0/233230686 shutdown_connections 2023-11-28T13:03:20.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.268+0000 7f0c6a8d5700 1 -- 172.21.15.82:0/233230686 wait complete. 2023-11-28T13:03:20.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.268+0000 7f0c6a8d5700 1 Processor -- start 2023-11-28T13:03:20.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.268+0000 7f0c6a8d5700 1 -- start start 2023-11-28T13:03:20.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c6a8d5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c6406c140 0x7f0c6414dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:20.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c6a8d5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c640b1d10 0x7f0c640cb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:20.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c6a8d5700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c640d25b0 0x7f0c640c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:20.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c6a8d5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c640c6940 con 0x7f0c640b1d10 2023-11-28T13:03:20.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c6a8d5700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6414e500 con 0x7f0c6406c140 2023-11-28T13:03:20.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c6a8d5700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c640c65a0 con 0x7f0c640d25b0 2023-11-28T13:03:20.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c690d2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c640b1d10 0x7f0c640cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:20.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c690d2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c640b1d10 0x7f0c640cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58684/0 (socket says 172.21.15.82:58684) 2023-11-28T13:03:20.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c690d2700 1 -- 172.21.15.82:0/2329473018 learned_addr learned my addr 172.21.15.82:0/2329473018 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:20.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c698d3700 1 --2- 172.21.15.82:0/2329473018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c6406c140 0x7f0c6414dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:20.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c6a0d4700 1 --2- 172.21.15.82:0/2329473018 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c640d25b0 0x7f0c640c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:20.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c690d2700 1 -- 172.21.15.82:0/2329473018 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c640d25b0 msgr2=0x7f0c640c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:20.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c690d2700 1 --2- 172.21.15.82:0/2329473018 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c640d25b0 0x7f0c640c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c690d2700 1 -- 172.21.15.82:0/2329473018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c6406c140 msgr2=0x7f0c6414dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:20.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c690d2700 1 --2- 172.21.15.82:0/2329473018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c6406c140 0x7f0c6414dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c690d2700 1 -- 172.21.15.82:0/2329473018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c009a70 con 0x7f0c640b1d10 2023-11-28T13:03:20.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c698d3700 1 --2- 172.21.15.82:0/2329473018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c6406c140 0x7f0c6414dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:20.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c6a0d4700 1 --2- 172.21.15.82:0/2329473018 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c640d25b0 0x7f0c640c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:20.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c690d2700 1 --2- 172.21.15.82:0/2329473018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c640b1d10 0x7f0c640cb400 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000e9a0 tx=0x7f0c6000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:20.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c5a7fc700 1 -- 172.21.15.82:0/2329473018 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60009720 con 0x7f0c640b1d10 2023-11-28T13:03:20.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c5a7fc700 1 -- 172.21.15.82:0/2329473018 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6000c850 con 0x7f0c640b1d10 2023-11-28T13:03:20.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c6a8d5700 1 -- 172.21.15.82:0/2329473018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c640d1050 con 0x7f0c640b1d10 2023-11-28T13:03:20.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c5a7fc700 1 -- 172.21.15.82:0/2329473018 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6000cc00 con 0x7f0c640b1d10 2023-11-28T13:03:20.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.272+0000 7f0c6a8d5700 1 -- 172.21.15.82:0/2329473018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c640b20e0 con 0x7f0c640b1d10 2023-11-28T13:03:20.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.276+0000 7f0c6a8d5700 1 -- 172.21.15.82:0/2329473018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c640d11e0 con 0x7f0c640b1d10 2023-11-28T13:03:20.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.276+0000 7f0c5a7fc700 1 -- 172.21.15.82:0/2329473018 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0c60019030 con 0x7f0c640b1d10 2023-11-28T13:03:20.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.276+0000 7f0c5a7fc700 1 --2- 172.21.15.82:0/2329473018 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0c48064ee0 0x7f0c48067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:20.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.276+0000 7f0c5a7fc700 1 -- 172.21.15.82:0/2329473018 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0c60081ad0 con 0x7f0c640b1d10 2023-11-28T13:03:20.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.276+0000 7f0c698d3700 1 --2- 172.21.15.82:0/2329473018 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0c48064ee0 0x7f0c48067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:20.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.276+0000 7f0c698d3700 1 --2- 172.21.15.82:0/2329473018 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0c48064ee0 0x7f0c48067390 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0c54000f60 tx=0x7f0c54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:20.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.284+0000 7f0c5a7fc700 1 -- 172.21.15.82:0/2329473018 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0c6004ffc0 con 0x7f0c640b1d10 2023-11-28T13:03:20.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.444+0000 7f0c6a8d5700 1 -- 172.21.15.82:0/2329473018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0c640c6bb0 con 0x7f0c640b1d10 2023-11-28T13:03:20.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.448+0000 7f0c5a7fc700 1 -- 172.21.15.82:0/2329473018 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v61) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0c600535e0 con 0x7f0c640b1d10 2023-11-28T13:03:20.452 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:03:20.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.448+0000 7f0c6a8d5700 1 -- 172.21.15.82:0/2329473018 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0c48064ee0 msgr2=0x7f0c48067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:20.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.448+0000 7f0c6a8d5700 1 --2- 172.21.15.82:0/2329473018 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0c48064ee0 0x7f0c48067390 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0c54000f60 tx=0x7f0c54009040 comp rx=0 tx=0).stop 2023-11-28T13:03:20.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.448+0000 7f0c6a8d5700 1 -- 172.21.15.82:0/2329473018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c640b1d10 msgr2=0x7f0c640cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:20.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.448+0000 7f0c6a8d5700 1 --2- 172.21.15.82:0/2329473018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c640b1d10 0x7f0c640cb400 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000e9a0 tx=0x7f0c6000ed60 comp rx=0 tx=0).stop 2023-11-28T13:03:20.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.448+0000 7f0c6a8d5700 1 -- 172.21.15.82:0/2329473018 shutdown_connections 2023-11-28T13:03:20.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.448+0000 7f0c6a8d5700 1 --2- 172.21.15.82:0/2329473018 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0c48064ee0 0x7f0c48067390 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.448+0000 7f0c6a8d5700 1 --2- 172.21.15.82:0/2329473018 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c640d25b0 0x7f0c640c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.448+0000 7f0c6a8d5700 1 --2- 172.21.15.82:0/2329473018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c640b1d10 0x7f0c640cb400 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.448+0000 7f0c6a8d5700 1 --2- 172.21.15.82:0/2329473018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c6406c140 0x7f0c6414dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.448+0000 7f0c6a8d5700 1 -- 172.21.15.82:0/2329473018 >> 172.21.15.82:0/2329473018 conn(0x7f0c640b52a0 msgr2=0x7f0c640b7950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:20.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.448+0000 7f0c6a8d5700 1 -- 172.21.15.82:0/2329473018 shutdown_connections 2023-11-28T13:03:20.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.448+0000 7f0c6a8d5700 1 -- 172.21.15.82:0/2329473018 wait complete. 2023-11-28T13:03:20.466 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T13:03:20.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f2443fff700 1 Processor -- start 2023-11-28T13:03:20.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f2443fff700 1 -- start start 2023-11-28T13:03:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f2443fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f244406b910 0x7f2444160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f2443fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f24440ced70 0x7f244406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f2443fff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24440d28e0 con 0x7f2444069bc0 2023-11-28T13:03:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f2443fff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24440cdfe0 con 0x7f24440ced70 2023-11-28T13:03:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f2443fff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2444160cc0 con 0x7f244406b910 2023-11-28T13:03:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f24437fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2444069bc0 0x7f2444069fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55832/0 (socket says 172.21.15.82:55832) 2023-11-28T13:03:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f24427fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f24440ced70 0x7f244406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f24437fe700 1 -- 172.21.15.82:0/2980907793 learned_addr learned my addr 172.21.15.82:0/2980907793 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f2442ffd700 1 --2- 172.21.15.82:0/2980907793 >> v2:172.21.15.114:3300/0 conn(0x7f244406b910 0x7f2444160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:20.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f24427fc700 1 -- 172.21.15.82:0/2980907793 >> v2:172.21.15.114:3300/0 conn(0x7f244406b910 msgr2=0x7f2444160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:20.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f24427fc700 1 --2- 172.21.15.82:0/2980907793 >> v2:172.21.15.114:3300/0 conn(0x7f244406b910 0x7f2444160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f24427fc700 1 -- 172.21.15.82:0/2980907793 >> v1:172.21.15.82:6789/0 conn(0x7f2444069bc0 legacy=0x7f2444069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:20.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f2441ffb700 1 -- 172.21.15.82:0/2980907793 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195598847 0 0) 0x7f2434001490 con 0x7f2444069bc0 2023-11-28T13:03:20.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f24427fc700 1 -- 172.21.15.82:0/2980907793 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244406c220 con 0x7f24440ced70 2023-11-28T13:03:20.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f24427fc700 1 --2- 172.21.15.82:0/2980907793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24440ced70 0x7f244406bce0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f24440d2a80 tx=0x7f243c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2afeb84445ecbf0e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:20.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f2441ffb700 1 -- 172.21.15.82:0/2980907793 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c011830 con 0x7f24440ced70 2023-11-28T13:03:20.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f2441ffb700 1 -- 172.21.15.82:0/2980907793 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c011990 con 0x7f24440ced70 2023-11-28T13:03:20.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f2441ffb700 1 -- 172.21.15.82:0/2980907793 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c011d20 con 0x7f24440ced70 2023-11-28T13:03:20.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f2443fff700 1 -- 172.21.15.82:0/2980907793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24440ced70 msgr2=0x7f244406bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:20.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.580+0000 7f2443fff700 1 --2- 172.21.15.82:0/2980907793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24440ced70 0x7f244406bce0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f24440d2a80 tx=0x7f243c009b30 comp rx=0 tx=0).stop 2023-11-28T13:03:20.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.584+0000 7f2443fff700 1 -- 172.21.15.82:0/2980907793 shutdown_connections 2023-11-28T13:03:20.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.584+0000 7f2443fff700 1 --2- 172.21.15.82:0/2980907793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24440ced70 0x7f244406bce0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.584+0000 7f2443fff700 1 --2- 172.21.15.82:0/2980907793 >> v2:172.21.15.114:3300/0 conn(0x7f244406b910 0x7f2444160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.584+0000 7f2443fff700 1 -- 172.21.15.82:0/2980907793 >> 172.21.15.82:0/2980907793 conn(0x7f24440d2b20 msgr2=0x7f24440d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:20.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.584+0000 7f2443fff700 1 -- 172.21.15.82:0/2980907793 shutdown_connections 2023-11-28T13:03:20.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.584+0000 7f2443fff700 1 -- 172.21.15.82:0/2980907793 wait complete. 2023-11-28T13:03:20.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.584+0000 7f2443fff700 1 Processor -- start 2023-11-28T13:03:20.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.584+0000 7f2443fff700 1 -- start start 2023-11-28T13:03:20.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f2443fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2444069bc0 0x7f2444155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:20.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f2443fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f244406b910 0x7f24440c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:20.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f2443fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24440ced70 0x7f24441f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:20.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f2443fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24440c67f0 con 0x7f244406b910 2023-11-28T13:03:20.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f2443fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24440c6a90 con 0x7f2444069bc0 2023-11-28T13:03:20.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f2443fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24440c6d70 con 0x7f24440ced70 2023-11-28T13:03:20.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f24427fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f244406b910 0x7f24440c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:20.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f24427fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f244406b910 0x7f24440c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58706/0 (socket says 172.21.15.82:58706) 2023-11-28T13:03:20.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f24427fc700 1 -- 172.21.15.82:0/2783539415 learned_addr learned my addr 172.21.15.82:0/2783539415 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:20.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f2442ffd700 1 --2- 172.21.15.82:0/2783539415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2444069bc0 0x7f2444155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:20.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f24437fe700 1 --2- 172.21.15.82:0/2783539415 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24440ced70 0x7f24441f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:20.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f24427fc700 1 -- 172.21.15.82:0/2783539415 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24440ced70 msgr2=0x7f24441f2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:20.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f24427fc700 1 --2- 172.21.15.82:0/2783539415 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24440ced70 0x7f24441f2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f24427fc700 1 -- 172.21.15.82:0/2783539415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2444069bc0 msgr2=0x7f2444155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:20.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f24427fc700 1 --2- 172.21.15.82:0/2783539415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2444069bc0 0x7f2444155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f24427fc700 1 -- 172.21.15.82:0/2783539415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243c0094b0 con 0x7f244406b910 2023-11-28T13:03:20.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f24427fc700 1 --2- 172.21.15.82:0/2783539415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f244406b910 0x7f24440c8f40 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f243c0090b0 tx=0x7f243c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:20.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f243bfff700 1 -- 172.21.15.82:0/2783539415 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c0036c0 con 0x7f244406b910 2023-11-28T13:03:20.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f243bfff700 1 -- 172.21.15.82:0/2783539415 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c01e070 con 0x7f244406b910 2023-11-28T13:03:20.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f243bfff700 1 -- 172.21.15.82:0/2783539415 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c003a40 con 0x7f244406b910 2023-11-28T13:03:20.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f2443fff700 1 -- 172.21.15.82:0/2783539415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24440d1700 con 0x7f244406b910 2023-11-28T13:03:20.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f2443fff700 1 -- 172.21.15.82:0/2783539415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24440b2040 con 0x7f244406b910 2023-11-28T13:03:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.588+0000 7f2443fff700 1 -- 172.21.15.82:0/2783539415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24440cf2c0 con 0x7f244406b910 2023-11-28T13:03:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.592+0000 7f243bfff700 1 -- 172.21.15.82:0/2783539415 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f243c00f050 con 0x7f244406b910 2023-11-28T13:03:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.592+0000 7f243bfff700 1 --2- 172.21.15.82:0/2783539415 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2428064ee0 0x7f2428067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.592+0000 7f2442ffd700 1 --2- 172.21.15.82:0/2783539415 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2428064ee0 0x7f2428067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.592+0000 7f243bfff700 1 -- 172.21.15.82:0/2783539415 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f243c082ac0 con 0x7f244406b910 2023-11-28T13:03:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.592+0000 7f2442ffd700 1 --2- 172.21.15.82:0/2783539415 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2428064ee0 0x7f2428067390 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f24440b3c60 tx=0x7f242c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:20.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.596+0000 7f243bfff700 1 -- 172.21.15.82:0/2783539415 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f243c050fb0 con 0x7f244406b910 2023-11-28T13:03:20.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.764+0000 7f2443fff700 1 -- 172.21.15.82:0/2783539415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2444065fc0 con 0x7f244406b910 2023-11-28T13:03:20.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.764+0000 7f243bfff700 1 -- 172.21.15.82:0/2783539415 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v61) v1 ==== 84+0+126 (secure 0 0 0) 0x7f243c0545d0 con 0x7f244406b910 2023-11-28T13:03:20.768 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:20.768 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-11-28T13:03:20.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:20.768 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2023-11-28T13:03:20.768 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2023-11-28T13:03:20.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:20.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:20.769 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 2, 2023-11-28T13:03:20.769 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "rbd" 2023-11-28T13:03:20.769 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:20.769 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-11-28T13:03:20.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.764+0000 7f2443fff700 1 -- 172.21.15.82:0/2783539415 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2428064ee0 msgr2=0x7f2428067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:20.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.764+0000 7f2443fff700 1 --2- 172.21.15.82:0/2783539415 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2428064ee0 0x7f2428067390 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f24440b3c60 tx=0x7f242c008040 comp rx=0 tx=0).stop 2023-11-28T13:03:20.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.764+0000 7f2443fff700 1 -- 172.21.15.82:0/2783539415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f244406b910 msgr2=0x7f24440c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:20.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.764+0000 7f2443fff700 1 --2- 172.21.15.82:0/2783539415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f244406b910 0x7f24440c8f40 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f243c0090b0 tx=0x7f243c004770 comp rx=0 tx=0).stop 2023-11-28T13:03:20.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.764+0000 7f2443fff700 1 -- 172.21.15.82:0/2783539415 shutdown_connections 2023-11-28T13:03:20.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.764+0000 7f2443fff700 1 --2- 172.21.15.82:0/2783539415 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2428064ee0 0x7f2428067390 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.764+0000 7f2443fff700 1 --2- 172.21.15.82:0/2783539415 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24440ced70 0x7f24441f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.764+0000 7f2443fff700 1 --2- 172.21.15.82:0/2783539415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f244406b910 0x7f24440c8f40 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.764+0000 7f2443fff700 1 --2- 172.21.15.82:0/2783539415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2444069bc0 0x7f2444155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.764+0000 7f2443fff700 1 -- 172.21.15.82:0/2783539415 >> 172.21.15.82:0/2783539415 conn(0x7f24440d2b20 msgr2=0x7f24440d3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:20.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.764+0000 7f2443fff700 1 -- 172.21.15.82:0/2783539415 shutdown_connections 2023-11-28T13:03:20.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.764+0000 7f2443fff700 1 -- 172.21.15.82:0/2783539415 wait complete. 2023-11-28T13:03:20.782 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T13:03:20.782 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T13:03:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.900+0000 7fcbed8d5700 1 Processor -- start 2023-11-28T13:03:20.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.900+0000 7fcbed8d5700 1 -- start start 2023-11-28T13:03:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbed8d5700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcbe80b37e0 0x7fcbe81609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbed8d5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcbe806fe00 0x7fcbe8070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbed8d5700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe8160ee0 con 0x7fcbe80b6470 2023-11-28T13:03:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbed8d5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe80cfc20 con 0x7fcbe806fe00 2023-11-28T13:03:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbed8d5700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe80d03c0 con 0x7fcbe80b37e0 2023-11-28T13:03:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbe77fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcbe806fe00 0x7fcbe8070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbe6ffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcbe80b6470 0x7fcbe815d100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55836/0 (socket says 172.21.15.82:55836) 2023-11-28T13:03:20.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbe6ffd700 1 -- 172.21.15.82:0/2401286982 learned_addr learned my addr 172.21.15.82:0/2401286982 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:20.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbde7fc700 1 --2- 172.21.15.82:0/2401286982 >> v2:172.21.15.114:3300/0 conn(0x7fcbe80b37e0 0x7fcbe81609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:20.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbe77fe700 1 -- 172.21.15.82:0/2401286982 >> v2:172.21.15.114:3300/0 conn(0x7fcbe80b37e0 msgr2=0x7fcbe81609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:20.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbe77fe700 1 --2- 172.21.15.82:0/2401286982 >> v2:172.21.15.114:3300/0 conn(0x7fcbe80b37e0 0x7fcbe81609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbe77fe700 1 -- 172.21.15.82:0/2401286982 >> v1:172.21.15.82:6789/0 conn(0x7fcbe80b6470 legacy=0x7fcbe815d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:20.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbe77fe700 1 -- 172.21.15.82:0/2401286982 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe80b3e10 con 0x7fcbe806fe00 2023-11-28T13:03:20.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbde7fc700 1 --2- 172.21.15.82:0/2401286982 >> v2:172.21.15.114:3300/0 conn(0x7fcbe80b37e0 0x7fcbe81609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:20.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbe77fe700 1 --2- 172.21.15.82:0/2401286982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbe806fe00 0x7fcbe8070240 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fcbe806f8f0 tx=0x7fcbe000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26d44499d8ab1ab server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:20.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbe67fc700 1 -- 172.21.15.82:0/2401286982 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe000e070 con 0x7fcbe806fe00 2023-11-28T13:03:20.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbe67fc700 1 -- 172.21.15.82:0/2401286982 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe000bbd0 con 0x7fcbe806fe00 2023-11-28T13:03:20.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbe67fc700 1 -- 172.21.15.82:0/2401286982 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0012430 con 0x7fcbe806fe00 2023-11-28T13:03:20.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbed8d5700 1 -- 172.21.15.82:0/2401286982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbe806fe00 msgr2=0x7fcbe8070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:20.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbed8d5700 1 --2- 172.21.15.82:0/2401286982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbe806fe00 0x7fcbe8070240 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fcbe806f8f0 tx=0x7fcbe000b330 comp rx=0 tx=0).stop 2023-11-28T13:03:20.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbed8d5700 1 -- 172.21.15.82:0/2401286982 shutdown_connections 2023-11-28T13:03:20.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbed8d5700 1 --2- 172.21.15.82:0/2401286982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbe806fe00 0x7fcbe8070240 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbed8d5700 1 --2- 172.21.15.82:0/2401286982 >> v2:172.21.15.114:3300/0 conn(0x7fcbe80b37e0 0x7fcbe81609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbed8d5700 1 -- 172.21.15.82:0/2401286982 >> 172.21.15.82:0/2401286982 conn(0x7fcbe80d0990 msgr2=0x7fcbe80d0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:20.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbed8d5700 1 -- 172.21.15.82:0/2401286982 shutdown_connections 2023-11-28T13:03:20.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbed8d5700 1 -- 172.21.15.82:0/2401286982 wait complete. 2023-11-28T13:03:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.904+0000 7fcbed8d5700 1 Processor -- start 2023-11-28T13:03:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbed8d5700 1 -- start start 2023-11-28T13:03:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbed8d5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbe806fe00 0x7fcbe8149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbed8d5700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcbe80b37e0 0x7fcbe80b1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbed8d5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbe80b6470 0x7fcbe806bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbed8d5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe814a300 con 0x7fcbe806fe00 2023-11-28T13:03:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbed8d5700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe806ee10 con 0x7fcbe80b6470 2023-11-28T13:03:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbed8d5700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe806f0f0 con 0x7fcbe80b37e0 2023-11-28T13:03:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbe6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbe806fe00 0x7fcbe8149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbe6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbe806fe00 0x7fcbe8149dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58730/0 (socket says 172.21.15.82:58730) 2023-11-28T13:03:20.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbe6ffd700 1 -- 172.21.15.82:0/939184566 learned_addr learned my addr 172.21.15.82:0/939184566 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:20.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbde7fc700 1 --2- 172.21.15.82:0/939184566 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcbe80b37e0 0x7fcbe80b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:20.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbe77fe700 1 --2- 172.21.15.82:0/939184566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbe80b6470 0x7fcbe806bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:20.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbe6ffd700 1 -- 172.21.15.82:0/939184566 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcbe80b37e0 msgr2=0x7fcbe80b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:20.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbe6ffd700 1 --2- 172.21.15.82:0/939184566 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcbe80b37e0 0x7fcbe80b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbe6ffd700 1 -- 172.21.15.82:0/939184566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbe80b6470 msgr2=0x7fcbe806bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbe6ffd700 1 --2- 172.21.15.82:0/939184566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbe80b6470 0x7fcbe806bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbe6ffd700 1 -- 172.21.15.82:0/939184566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe0009a70 con 0x7fcbe806fe00 2023-11-28T13:03:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbe6ffd700 1 --2- 172.21.15.82:0/939184566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbe806fe00 0x7fcbe8149dc0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8001eb0 tx=0x7fcbd800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbe4ff9700 1 -- 172.21.15.82:0/939184566 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8005d90 con 0x7fcbe806fe00 2023-11-28T13:03:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbe4ff9700 1 -- 172.21.15.82:0/939184566 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd80070d0 con 0x7fcbe806fe00 2023-11-28T13:03:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbe4ff9700 1 -- 172.21.15.82:0/939184566 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8007440 con 0x7fcbe806fe00 2023-11-28T13:03:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbed8d5700 1 -- 172.21.15.82:0/939184566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe80cfe00 con 0x7fcbe806fe00 2023-11-28T13:03:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbed8d5700 1 -- 172.21.15.82:0/939184566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe8070780 con 0x7fcbe806fe00 2023-11-28T13:03:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.908+0000 7fcbed8d5700 1 -- 172.21.15.82:0/939184566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe80d00e0 con 0x7fcbe806fe00 2023-11-28T13:03:20.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.912+0000 7fcbe4ff9700 1 -- 172.21.15.82:0/939184566 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcbd8019030 con 0x7fcbe806fe00 2023-11-28T13:03:20.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.912+0000 7fcbe4ff9700 1 --2- 172.21.15.82:0/939184566 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcbc8064f10 0x7fcbc80673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:20.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.912+0000 7fcbe4ff9700 1 -- 172.21.15.82:0/939184566 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcbd8080ee0 con 0x7fcbe806fe00 2023-11-28T13:03:20.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.912+0000 7fcbde7fc700 1 --2- 172.21.15.82:0/939184566 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcbc8064f10 0x7fcbc80673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:20.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.912+0000 7fcbde7fc700 1 --2- 172.21.15.82:0/939184566 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcbc8064f10 0x7fcbc80673c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcbe80b08f0 tx=0x7fcbd0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:20.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:20.920+0000 7fcbe4ff9700 1 -- 172.21.15.82:0/939184566 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcbd804f520 con 0x7fcbe806fe00 2023-11-28T13:03:21.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.084+0000 7fcbed8d5700 1 -- 172.21.15.82:0/939184566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcbe8160ee0 con 0x7fcbe806fe00 2023-11-28T13:03:21.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.180+0000 7fcbe4ff9700 1 -- 172.21.15.82:0/939184566 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v62) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcbe8160ee0 con 0x7fcbe806fe00 2023-11-28T13:03:21.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.188+0000 7fcbed8d5700 1 -- 172.21.15.82:0/939184566 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcbc8064f10 msgr2=0x7fcbc80673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:21.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.188+0000 7fcbed8d5700 1 --2- 172.21.15.82:0/939184566 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcbc8064f10 0x7fcbc80673c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcbe80b08f0 tx=0x7fcbd0008040 comp rx=0 tx=0).stop 2023-11-28T13:03:21.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.188+0000 7fcbed8d5700 1 -- 172.21.15.82:0/939184566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbe806fe00 msgr2=0x7fcbe8149dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:21.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.188+0000 7fcbed8d5700 1 --2- 172.21.15.82:0/939184566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbe806fe00 0x7fcbe8149dc0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8001eb0 tx=0x7fcbd800c7b0 comp rx=0 tx=0).stop 2023-11-28T13:03:21.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.188+0000 7fcbed8d5700 1 -- 172.21.15.82:0/939184566 shutdown_connections 2023-11-28T13:03:21.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.188+0000 7fcbed8d5700 1 --2- 172.21.15.82:0/939184566 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcbc8064f10 0x7fcbc80673c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:21.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.188+0000 7fcbed8d5700 1 --2- 172.21.15.82:0/939184566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbe80b6470 0x7fcbe806bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:21.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.188+0000 7fcbed8d5700 1 --2- 172.21.15.82:0/939184566 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcbe80b37e0 0x7fcbe80b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:21.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.188+0000 7fcbed8d5700 1 --2- 172.21.15.82:0/939184566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbe806fe00 0x7fcbe8149dc0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:21.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.188+0000 7fcbed8d5700 1 -- 172.21.15.82:0/939184566 >> 172.21.15.82:0/939184566 conn(0x7fcbe80d0990 msgr2=0x7fcbe80b5200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:21.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.188+0000 7fcbed8d5700 1 -- 172.21.15.82:0/939184566 shutdown_connections 2023-11-28T13:03:21.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.188+0000 7fcbed8d5700 1 -- 172.21.15.82:0/939184566 wait complete. 2023-11-28T13:03:21.193 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2023-11-28T13:03:21.207 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T13:03:21.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.320+0000 7fb205780700 1 Processor -- start 2023-11-28T13:03:21.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.320+0000 7fb205780700 1 -- start start 2023-11-28T13:03:21.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb205780700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb200159ff0 0x7fb2000cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:21.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb205780700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb200071820 0x7fb2000b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:21.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb205780700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20006c7c0 con 0x7fb20015a3c0 2023-11-28T13:03:21.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb205780700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20006ca60 con 0x7fb200159ff0 2023-11-28T13:03:21.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb205780700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20006cd40 con 0x7fb200071820 2023-11-28T13:03:21.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1ff7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb20015a3c0 0x7fb200071110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55844/0 (socket says 172.21.15.82:55844) 2023-11-28T13:03:21.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1ff7fe700 1 -- 172.21.15.82:0/2643452166 learned_addr learned my addr 172.21.15.82:0/2643452166 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:21.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1fffff700 1 --2- 172.21.15.82:0/2643452166 >> v2:172.21.15.114:3300/0 conn(0x7fb200159ff0 0x7fb2000cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:21.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb204f7f700 1 --2- 172.21.15.82:0/2643452166 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb200071820 0x7fb2000b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:21.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1feffd700 1 -- 172.21.15.82:0/2643452166 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4102971772 0 0) 0x7fb20006c7c0 con 0x7fb20015a3c0 2023-11-28T13:03:21.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1feffd700 1 -- 172.21.15.82:0/2643452166 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1e80035d0 con 0x7fb20015a3c0 2023-11-28T13:03:21.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1feffd700 1 -- 172.21.15.82:0/2643452166 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2496321082 0 0) 0x7fb1e80035d0 con 0x7fb20015a3c0 2023-11-28T13:03:21.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1feffd700 1 -- 172.21.15.82:0/2643452166 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb200071820 msgr2=0x7fb2000b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:21.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1feffd700 1 --2- 172.21.15.82:0/2643452166 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb200071820 0x7fb2000b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:21.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1feffd700 1 -- 172.21.15.82:0/2643452166 >> v2:172.21.15.114:3300/0 conn(0x7fb200159ff0 msgr2=0x7fb2000cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:21.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1feffd700 1 --2- 172.21.15.82:0/2643452166 >> v2:172.21.15.114:3300/0 conn(0x7fb200159ff0 0x7fb2000cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:21.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1feffd700 1 -- 172.21.15.82:0/2643452166 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2000ca4b0 con 0x7fb20015a3c0 2023-11-28T13:03:21.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1feffd700 1 -- 172.21.15.82:0/2643452166 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7fb1f4001670 con 0x7fb20015a3c0 2023-11-28T13:03:21.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1feffd700 1 -- 172.21.15.82:0/2643452166 >> v1:172.21.15.82:6789/0 conn(0x7fb20015a3c0 legacy=0x7fb200071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:21.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1feffd700 1 --2- 172.21.15.82:0/2643452166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e8003a90 0x7fb1e8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:21.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1feffd700 1 --2- 172.21.15.82:0/2643452166 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1e8004870 0x7fb1e8004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:21.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1feffd700 1 --2- 172.21.15.82:0/2643452166 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb200071820 0x7fb1e8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:21.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1feffd700 1 -- 172.21.15.82:0/2643452166 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20006ca60 con 0x7fb1e8003a90 2023-11-28T13:03:21.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1feffd700 1 -- 172.21.15.82:0/2643452166 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20006cd40 con 0x7fb1e8004870 2023-11-28T13:03:21.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1fffff700 1 --2- 172.21.15.82:0/2643452166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e8003a90 0x7fb1e8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:21.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1feffd700 1 -- 172.21.15.82:0/2643452166 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e800ba30 con 0x7fb200071820 2023-11-28T13:03:21.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1ff7fe700 1 --2- 172.21.15.82:0/2643452166 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1e8004870 0x7fb1e8004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:21.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb204f7f700 1 --2- 172.21.15.82:0/2643452166 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb200071820 0x7fb1e8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:21.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1fffff700 1 -- 172.21.15.82:0/2643452166 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb200071820 msgr2=0x7fb1e8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:21.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1fffff700 1 --2- 172.21.15.82:0/2643452166 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb200071820 0x7fb1e8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:21.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1fffff700 1 -- 172.21.15.82:0/2643452166 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1e8004870 msgr2=0x7fb1e8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:21.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1fffff700 1 --2- 172.21.15.82:0/2643452166 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1e8004870 0x7fb1e8004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:21.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1fffff700 1 -- 172.21.15.82:0/2643452166 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e80035d0 con 0x7fb1e8003a90 2023-11-28T13:03:21.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb204f7f700 1 --2- 172.21.15.82:0/2643452166 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb200071820 0x7fb1e8005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:21.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1ff7fe700 1 --2- 172.21.15.82:0/2643452166 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1e8004870 0x7fb1e8004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:21.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1fffff700 1 --2- 172.21.15.82:0/2643452166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e8003a90 0x7fb1e8003ea0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0009ba0 tx=0x7fb1e80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd3925c990e451b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:21.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1feffd700 1 -- 172.21.15.82:0/2643452166 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f000e6c0 con 0x7fb1e8003a90 2023-11-28T13:03:21.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1feffd700 1 -- 172.21.15.82:0/2643452166 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f000e820 con 0x7fb1e8003a90 2023-11-28T13:03:21.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb1feffd700 1 -- 172.21.15.82:0/2643452166 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f000eb90 con 0x7fb1e8003a90 2023-11-28T13:03:21.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb205780700 1 -- 172.21.15.82:0/2643452166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e8003a90 msgr2=0x7fb1e8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:21.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb205780700 1 --2- 172.21.15.82:0/2643452166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e8003a90 0x7fb1e8003ea0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0009ba0 tx=0x7fb1e80058a0 comp rx=0 tx=0).stop 2023-11-28T13:03:21.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb204f7f700 1 -- 172.21.15.82:0/2643452166 reap_dead start 2023-11-28T13:03:21.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb205780700 1 -- 172.21.15.82:0/2643452166 shutdown_connections 2023-11-28T13:03:21.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb205780700 1 -- 172.21.15.82:0/2643452166 >> 172.21.15.82:0/2643452166 conn(0x7fb2000b1f50 msgr2=0x7fb2000cf790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:21.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb205780700 1 -- 172.21.15.82:0/2643452166 shutdown_connections 2023-11-28T13:03:21.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.324+0000 7fb205780700 1 -- 172.21.15.82:0/2643452166 wait complete. 2023-11-28T13:03:21.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.328+0000 7fb205780700 1 Processor -- start 2023-11-28T13:03:21.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.328+0000 7fb205780700 1 -- start start 2023-11-28T13:03:21.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb205780700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1e8003a90 0x7fb2000b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:21.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb205780700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2000c82c0 0x7fb20015d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:21.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb205780700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2000b25c0 0x7fb2000b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:21.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb205780700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000c92b0 con 0x7fb2000b25c0 2023-11-28T13:03:21.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb205780700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000b2f70 con 0x7fb1e8003a90 2023-11-28T13:03:21.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb205780700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20013d8a0 con 0x7fb2000c82c0 2023-11-28T13:03:21.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb204f7f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2000b25c0 0x7fb2000b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:21.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb204f7f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2000b25c0 0x7fb2000b2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58746/0 (socket says 172.21.15.82:58746) 2023-11-28T13:03:21.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb204f7f700 1 -- 172.21.15.82:0/137345602 learned_addr learned my addr 172.21.15.82:0/137345602 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:21.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb1fffff700 1 --2- 172.21.15.82:0/137345602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1e8003a90 0x7fb2000b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:21.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb1ff7fe700 1 --2- 172.21.15.82:0/137345602 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2000c82c0 0x7fb20015d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:21.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb204f7f700 1 -- 172.21.15.82:0/137345602 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2000c82c0 msgr2=0x7fb20015d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:21.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb204f7f700 1 --2- 172.21.15.82:0/137345602 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2000c82c0 0x7fb20015d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:21.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb204f7f700 1 -- 172.21.15.82:0/137345602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1e8003a90 msgr2=0x7fb2000b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:21.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb204f7f700 1 --2- 172.21.15.82:0/137345602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1e8003a90 0x7fb2000b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:21.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb204f7f700 1 -- 172.21.15.82:0/137345602 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2000aefc0 con 0x7fb2000b25c0 2023-11-28T13:03:21.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb204f7f700 1 --2- 172.21.15.82:0/137345602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2000b25c0 0x7fb2000b2a30 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb200071c10 tx=0x7fb1f80104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:21.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb1fcff9700 1 -- 172.21.15.82:0/137345602 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f801b070 con 0x7fb2000b25c0 2023-11-28T13:03:21.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb1fcff9700 1 -- 172.21.15.82:0/137345602 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f800f040 con 0x7fb2000b25c0 2023-11-28T13:03:21.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb205780700 1 -- 172.21.15.82:0/137345602 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2000ca790 con 0x7fb2000b25c0 2023-11-28T13:03:21.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb1fcff9700 1 -- 172.21.15.82:0/137345602 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f800e050 con 0x7fb2000b25c0 2023-11-28T13:03:21.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb205780700 1 -- 172.21.15.82:0/137345602 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2000cb1f0 con 0x7fb2000b25c0 2023-11-28T13:03:21.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.332+0000 7fb205780700 1 -- 172.21.15.82:0/137345602 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20015d5f0 con 0x7fb2000b25c0 2023-11-28T13:03:21.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.336+0000 7fb1fcff9700 1 -- 172.21.15.82:0/137345602 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb1f8010da0 con 0x7fb2000b25c0 2023-11-28T13:03:21.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.336+0000 7fb1fcff9700 1 --2- 172.21.15.82:0/137345602 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb1ec064f10 0x7fb1ec0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:21.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.336+0000 7fb1fcff9700 1 -- 172.21.15.82:0/137345602 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fb1f8081d00 con 0x7fb2000b25c0 2023-11-28T13:03:21.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.336+0000 7fb1fffff700 1 --2- 172.21.15.82:0/137345602 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb1ec064f10 0x7fb1ec0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:21.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.336+0000 7fb1fffff700 1 --2- 172.21.15.82:0/137345602 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb1ec064f10 0x7fb1ec0673c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb1f00090b0 tx=0x7fb1f001e040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:21.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.344+0000 7fb1fcff9700 1 -- 172.21.15.82:0/137345602 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb1f8085030 con 0x7fb2000b25c0 2023-11-28T13:03:21.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:21.504+0000 7fb205780700 1 -- 172.21.15.82:0/137345602 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb20013da10 con 0x7fb2000b25c0 2023-11-28T13:03:22.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.192+0000 7fb1fcff9700 1 -- 172.21.15.82:0/137345602 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v63) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb1f8050080 con 0x7fb2000b25c0 2023-11-28T13:03:22.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.200+0000 7fb205780700 1 -- 172.21.15.82:0/137345602 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb1ec064f10 msgr2=0x7fb1ec0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:22.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.200+0000 7fb205780700 1 --2- 172.21.15.82:0/137345602 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb1ec064f10 0x7fb1ec0673c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb1f00090b0 tx=0x7fb1f001e040 comp rx=0 tx=0).stop 2023-11-28T13:03:22.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.200+0000 7fb205780700 1 -- 172.21.15.82:0/137345602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2000b25c0 msgr2=0x7fb2000b2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:22.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.200+0000 7fb205780700 1 --2- 172.21.15.82:0/137345602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2000b25c0 0x7fb2000b2a30 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb200071c10 tx=0x7fb1f80104a0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.204+0000 7fb205780700 1 -- 172.21.15.82:0/137345602 shutdown_connections 2023-11-28T13:03:22.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.204+0000 7fb205780700 1 --2- 172.21.15.82:0/137345602 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb1ec064f10 0x7fb1ec0673c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.204+0000 7fb205780700 1 --2- 172.21.15.82:0/137345602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2000b25c0 0x7fb2000b2a30 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.204+0000 7fb205780700 1 --2- 172.21.15.82:0/137345602 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2000c82c0 0x7fb20015d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.204+0000 7fb205780700 1 --2- 172.21.15.82:0/137345602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1e8003a90 0x7fb2000b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.204+0000 7fb205780700 1 -- 172.21.15.82:0/137345602 >> 172.21.15.82:0/137345602 conn(0x7fb2000b1f50 msgr2=0x7fb2000b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:22.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.204+0000 7fb205780700 1 -- 172.21.15.82:0/137345602 shutdown_connections 2023-11-28T13:03:22.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.204+0000 7fb205780700 1 -- 172.21.15.82:0/137345602 wait complete. 2023-11-28T13:03:22.216 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2023-11-28T13:03:22.230 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T13:03:22.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.336+0000 7f349359e700 1 Processor -- start 2023-11-28T13:03:22.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.336+0000 7f349359e700 1 -- start start 2023-11-28T13:03:22.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f349359e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3494158eb0 0x7f34940c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:22.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f349359e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f34940ae090 0x7f34940b0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:22.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f349359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f34940b0aa0 0x7f3494070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:22.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f349359e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34940adee0 con 0x7f34940b0aa0 2023-11-28T13:03:22.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f349359e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34940ad9b0 con 0x7f34940ae090 2023-11-28T13:03:22.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f349359e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3494159280 con 0x7f3494158eb0 2023-11-28T13:03:22.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f3492d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f34940b0aa0 0x7f3494070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:22.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f3492d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f34940b0aa0 0x7f3494070000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58750/0 (socket says 172.21.15.82:58750) 2023-11-28T13:03:22.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f3492d9d700 1 -- 172.21.15.82:0/3998228311 learned_addr learned my addr 172.21.15.82:0/3998228311 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:22.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f3489d9b700 1 --2- 172.21.15.82:0/3998228311 >> v2:172.21.15.114:3300/0 conn(0x7f34940ae090 0x7f34940b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:22.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f349259c700 1 --2- 172.21.15.82:0/3998228311 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3494158eb0 0x7f34940c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:22.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f3492d9d700 1 -- 172.21.15.82:0/3998228311 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3494158eb0 msgr2=0x7f34940c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:22.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f3492d9d700 1 --2- 172.21.15.82:0/3998228311 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3494158eb0 0x7f34940c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f3492d9d700 1 -- 172.21.15.82:0/3998228311 >> v2:172.21.15.114:3300/0 conn(0x7f34940ae090 msgr2=0x7f34940b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:22.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f3492d9d700 1 --2- 172.21.15.82:0/3998228311 >> v2:172.21.15.114:3300/0 conn(0x7f34940ae090 0x7f34940b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f3492d9d700 1 -- 172.21.15.82:0/3998228311 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3494069e60 con 0x7f34940b0aa0 2023-11-28T13:03:22.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f3489d9b700 1 --2- 172.21.15.82:0/3998228311 >> v2:172.21.15.114:3300/0 conn(0x7f34940ae090 0x7f34940b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:22.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f3492d9d700 1 --2- 172.21.15.82:0/3998228311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34940b0aa0 0x7f3494070000 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f349406b760 tx=0x7f348c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ef198551302d6f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:22.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f3491d9b700 1 -- 172.21.15.82:0/3998228311 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c00e070 con 0x7f34940b0aa0 2023-11-28T13:03:22.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f3491d9b700 1 -- 172.21.15.82:0/3998228311 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348c00b9c0 con 0x7f34940b0aa0 2023-11-28T13:03:22.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f3491d9b700 1 -- 172.21.15.82:0/3998228311 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c00bd70 con 0x7f34940b0aa0 2023-11-28T13:03:22.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f349359e700 1 -- 172.21.15.82:0/3998228311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34940b0aa0 msgr2=0x7f3494070000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:22.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f349359e700 1 --2- 172.21.15.82:0/3998228311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34940b0aa0 0x7f3494070000 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f349406b760 tx=0x7f348c00b330 comp rx=0 tx=0).stop 2023-11-28T13:03:22.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f349359e700 1 -- 172.21.15.82:0/3998228311 shutdown_connections 2023-11-28T13:03:22.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f349359e700 1 --2- 172.21.15.82:0/3998228311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34940b0aa0 0x7f3494070000 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f349359e700 1 --2- 172.21.15.82:0/3998228311 >> v2:172.21.15.114:3300/0 conn(0x7f34940ae090 0x7f34940b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f349359e700 1 --2- 172.21.15.82:0/3998228311 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3494158eb0 0x7f34940c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f349359e700 1 -- 172.21.15.82:0/3998228311 >> 172.21.15.82:0/3998228311 conn(0x7f34940ce630 msgr2=0x7f34940cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:22.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f349359e700 1 -- 172.21.15.82:0/3998228311 shutdown_connections 2023-11-28T13:03:22.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.340+0000 7f349359e700 1 -- 172.21.15.82:0/3998228311 wait complete. 2023-11-28T13:03:22.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f349359e700 1 Processor -- start 2023-11-28T13:03:22.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f349359e700 1 -- start start 2023-11-28T13:03:22.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f349359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34940ae090 0x7f349414e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:22.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f349359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34940b0aa0 0x7f34940b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:22.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f349359e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3494158eb0 0x7f34940cd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:22.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f349359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34940b2860 con 0x7f34940b0aa0 2023-11-28T13:03:22.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f349359e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349414f770 con 0x7f34940ae090 2023-11-28T13:03:22.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f349359e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34940b1be0 con 0x7f3494158eb0 2023-11-28T13:03:22.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f3489d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34940b0aa0 0x7f34940b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:22.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f3489d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34940b0aa0 0x7f34940b2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58756/0 (socket says 172.21.15.82:58756) 2023-11-28T13:03:22.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f3489d9b700 1 -- 172.21.15.82:0/161479279 learned_addr learned my addr 172.21.15.82:0/161479279 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:22.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f349259c700 1 --2- 172.21.15.82:0/161479279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34940ae090 0x7f349414e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:22.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f3492d9d700 1 --2- 172.21.15.82:0/161479279 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3494158eb0 0x7f34940cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:22.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f3489d9b700 1 -- 172.21.15.82:0/161479279 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3494158eb0 msgr2=0x7f34940cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:22.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f3489d9b700 1 --2- 172.21.15.82:0/161479279 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3494158eb0 0x7f34940cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f3489d9b700 1 -- 172.21.15.82:0/161479279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34940ae090 msgr2=0x7f349414e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:22.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f3489d9b700 1 --2- 172.21.15.82:0/161479279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34940ae090 0x7f349414e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f3489d9b700 1 -- 172.21.15.82:0/161479279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c009b30 con 0x7f34940b0aa0 2023-11-28T13:03:22.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f349259c700 1 --2- 172.21.15.82:0/161479279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34940ae090 0x7f349414e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:22.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f3492d9d700 1 --2- 172.21.15.82:0/161479279 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3494158eb0 0x7f34940cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:22.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f3489d9b700 1 --2- 172.21.15.82:0/161479279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34940b0aa0 0x7f34940b2c80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f347c00e730 tx=0x7f347c00eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:22.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.344+0000 7f348b7fe700 1 -- 172.21.15.82:0/161479279 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c013610 con 0x7f34940b0aa0 2023-11-28T13:03:22.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.348+0000 7f348b7fe700 1 -- 172.21.15.82:0/161479279 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347c013770 con 0x7f34940b0aa0 2023-11-28T13:03:22.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.348+0000 7f349359e700 1 -- 172.21.15.82:0/161479279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3494071c90 con 0x7f34940b0aa0 2023-11-28T13:03:22.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.348+0000 7f348b7fe700 1 -- 172.21.15.82:0/161479279 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c013b20 con 0x7f34940b0aa0 2023-11-28T13:03:22.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.348+0000 7f349359e700 1 -- 172.21.15.82:0/161479279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34940adc00 con 0x7f34940b0aa0 2023-11-28T13:03:22.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.348+0000 7f349359e700 1 -- 172.21.15.82:0/161479279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3494071f70 con 0x7f34940b0aa0 2023-11-28T13:03:22.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.348+0000 7f348b7fe700 1 -- 172.21.15.82:0/161479279 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f347c023070 con 0x7f34940b0aa0 2023-11-28T13:03:22.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.352+0000 7f348b7fe700 1 --2- 172.21.15.82:0/161479279 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3474064f10 0x7f34740673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:22.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.352+0000 7f349259c700 1 --2- 172.21.15.82:0/161479279 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3474064f10 0x7f34740673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:22.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.352+0000 7f348b7fe700 1 -- 172.21.15.82:0/161479279 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f347c081ee0 con 0x7f34940b0aa0 2023-11-28T13:03:22.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.352+0000 7f349259c700 1 --2- 172.21.15.82:0/161479279 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3474064f10 0x7f34740673c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3484009990 tx=0x7f3484008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:22.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.360+0000 7f348b7fe700 1 -- 172.21.15.82:0/161479279 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f347c050070 con 0x7f34940b0aa0 2023-11-28T13:03:22.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.552+0000 7f349359e700 1 -- 172.21.15.82:0/161479279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3494065fc0 con 0x7f34940b0aa0 2023-11-28T13:03:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.564+0000 7f348b7fe700 1 -- 172.21.15.82:0/161479279 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v26) v1 ==== 173+0+0 (secure 0 0 0) 0x7f347c0094e0 con 0x7f34940b0aa0 2023-11-28T13:03:22.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.572+0000 7f349359e700 1 -- 172.21.15.82:0/161479279 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3474064f10 msgr2=0x7f34740673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:22.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.572+0000 7f349359e700 1 --2- 172.21.15.82:0/161479279 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3474064f10 0x7f34740673c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3484009990 tx=0x7f3484008040 comp rx=0 tx=0).stop 2023-11-28T13:03:22.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.572+0000 7f349359e700 1 -- 172.21.15.82:0/161479279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34940b0aa0 msgr2=0x7f34940b2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:22.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.572+0000 7f349359e700 1 --2- 172.21.15.82:0/161479279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34940b0aa0 0x7f34940b2c80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f347c00e730 tx=0x7f347c00eaf0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.572+0000 7f349359e700 1 -- 172.21.15.82:0/161479279 shutdown_connections 2023-11-28T13:03:22.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.572+0000 7f349359e700 1 --2- 172.21.15.82:0/161479279 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3474064f10 0x7f34740673c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.572+0000 7f349359e700 1 --2- 172.21.15.82:0/161479279 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3494158eb0 0x7f34940cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.572+0000 7f349359e700 1 --2- 172.21.15.82:0/161479279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34940b0aa0 0x7f34940b2c80 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.576+0000 7f349359e700 1 --2- 172.21.15.82:0/161479279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34940ae090 0x7f349414e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.576+0000 7f349359e700 1 -- 172.21.15.82:0/161479279 >> 172.21.15.82:0/161479279 conn(0x7f34940ce630 msgr2=0x7f3494158130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:22.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.576+0000 7f349359e700 1 -- 172.21.15.82:0/161479279 shutdown_connections 2023-11-28T13:03:22.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.576+0000 7f349359e700 1 -- 172.21.15.82:0/161479279 wait complete. 2023-11-28T13:03:22.583 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 9 and data pool 10 2023-11-28T13:03:22.600 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:03:22.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.696+0000 7fbec3fff700 1 Processor -- start 2023-11-28T13:03:22.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.696+0000 7fbec3fff700 1 -- start start 2023-11-28T13:03:22.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.696+0000 7fbec3fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbec415c4b0 0x7fbec40ae400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:22.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.696+0000 7fbec3fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbec40ce550 0x7fbec4070730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:22.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.696+0000 7fbec3fff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec40cc950 con 0x7fbec415c0e0 2023-11-28T13:03:22.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.696+0000 7fbec3fff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec415fe00 con 0x7fbec40ce550 2023-11-28T13:03:22.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.696+0000 7fbec3fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec406cf40 con 0x7fbec415c4b0 2023-11-28T13:03:22.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.696+0000 7fbec2ffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbec415c0e0 0x7fbec406c830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55854/0 (socket says 172.21.15.82:55854) 2023-11-28T13:03:22.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.696+0000 7fbec2ffd700 1 -- 172.21.15.82:0/3924271265 learned_addr learned my addr 172.21.15.82:0/3924271265 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:22.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.696+0000 7fbec37fe700 1 --2- 172.21.15.82:0/3924271265 >> v2:172.21.15.82:3300/0 conn(0x7fbec40ce550 0x7fbec4070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:22.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.696+0000 7fbec27fc700 1 --2- 172.21.15.82:0/3924271265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbec415c4b0 0x7fbec40ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:22.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.696+0000 7fbec1ffb700 1 -- 172.21.15.82:0/3924271265 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319690115 0 0) 0x7fbec40cc950 con 0x7fbec415c0e0 2023-11-28T13:03:22.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.696+0000 7fbec37fe700 1 -- 172.21.15.82:0/3924271265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbec415c4b0 msgr2=0x7fbec40ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:22.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.696+0000 7fbec37fe700 1 --2- 172.21.15.82:0/3924271265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbec415c4b0 0x7fbec40ae400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.696+0000 7fbec37fe700 1 -- 172.21.15.82:0/3924271265 >> v1:172.21.15.82:6789/0 conn(0x7fbec415c0e0 legacy=0x7fbec406c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:22.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.696+0000 7fbec37fe700 1 -- 172.21.15.82:0/3924271265 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec40ceac0 con 0x7fbec40ce550 2023-11-28T13:03:22.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.696+0000 7fbec37fe700 1 --2- 172.21.15.82:0/3924271265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec40ce550 0x7fbec4070730 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009850 tx=0x7fbebc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3305c6c6b4640229 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:22.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.700+0000 7fbec1ffb700 1 -- 172.21.15.82:0/3924271265 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc011830 con 0x7fbec40ce550 2023-11-28T13:03:22.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.700+0000 7fbec1ffb700 1 -- 172.21.15.82:0/3924271265 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc011990 con 0x7fbec40ce550 2023-11-28T13:03:22.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.700+0000 7fbec1ffb700 1 -- 172.21.15.82:0/3924271265 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc011d20 con 0x7fbec40ce550 2023-11-28T13:03:22.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.700+0000 7fbec3fff700 1 -- 172.21.15.82:0/3924271265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec40ce550 msgr2=0x7fbec4070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:22.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.700+0000 7fbec3fff700 1 --2- 172.21.15.82:0/3924271265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec40ce550 0x7fbec4070730 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009850 tx=0x7fbebc009b60 comp rx=0 tx=0).stop 2023-11-28T13:03:22.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.700+0000 7fbec3fff700 1 -- 172.21.15.82:0/3924271265 shutdown_connections 2023-11-28T13:03:22.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.700+0000 7fbec3fff700 1 --2- 172.21.15.82:0/3924271265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec40ce550 0x7fbec4070730 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.700+0000 7fbec3fff700 1 --2- 172.21.15.82:0/3924271265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbec415c4b0 0x7fbec40ae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.700+0000 7fbec3fff700 1 -- 172.21.15.82:0/3924271265 >> 172.21.15.82:0/3924271265 conn(0x7fbec40cb890 msgr2=0x7fbec40cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:22.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.700+0000 7fbec3fff700 1 -- 172.21.15.82:0/3924271265 shutdown_connections 2023-11-28T13:03:22.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.700+0000 7fbec3fff700 1 -- 172.21.15.82:0/3924271265 wait complete. 2023-11-28T13:03:22.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.704+0000 7fbec3fff700 1 Processor -- start 2023-11-28T13:03:22.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.704+0000 7fbec3fff700 1 -- start start 2023-11-28T13:03:22.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.704+0000 7fbec3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec40ce550 0x7fbec40afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:22.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.704+0000 7fbec3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbec415c0e0 0x7fbec40c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:22.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.704+0000 7fbec3fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbec415c4b0 0x7fbec40b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:22.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.704+0000 7fbec3fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec415a780 con 0x7fbec40ce550 2023-11-28T13:03:22.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.704+0000 7fbec3fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40aeb70 con 0x7fbec415c0e0 2023-11-28T13:03:22.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.704+0000 7fbec3fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40aee50 con 0x7fbec415c4b0 2023-11-28T13:03:22.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.704+0000 7fbec2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec40ce550 0x7fbec40afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:22.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.704+0000 7fbec2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec40ce550 0x7fbec40afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58778/0 (socket says 172.21.15.82:58778) 2023-11-28T13:03:22.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.704+0000 7fbec2ffd700 1 -- 172.21.15.82:0/3325623957 learned_addr learned my addr 172.21.15.82:0/3325623957 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:22.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.704+0000 7fbec27fc700 1 --2- 172.21.15.82:0/3325623957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbec415c0e0 0x7fbec40c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:22.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.704+0000 7fbec37fe700 1 --2- 172.21.15.82:0/3325623957 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbec415c4b0 0x7fbec40b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:22.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.704+0000 7fbec2ffd700 1 -- 172.21.15.82:0/3325623957 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbec415c4b0 msgr2=0x7fbec40b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:22.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.704+0000 7fbec2ffd700 1 --2- 172.21.15.82:0/3325623957 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbec415c4b0 0x7fbec40b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.704+0000 7fbec2ffd700 1 -- 172.21.15.82:0/3325623957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbec415c0e0 msgr2=0x7fbec40c5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:22.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.704+0000 7fbec2ffd700 1 --2- 172.21.15.82:0/3325623957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbec415c0e0 0x7fbec40c5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.704+0000 7fbec2ffd700 1 -- 172.21.15.82:0/3325623957 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc0094b0 con 0x7fbec40ce550 2023-11-28T13:03:22.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.704+0000 7fbec27fc700 1 --2- 172.21.15.82:0/3325623957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbec415c0e0 0x7fbec40c5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:22.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.704+0000 7fbec37fe700 1 --2- 172.21.15.82:0/3325623957 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbec415c4b0 0x7fbec40b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:22.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.704+0000 7fbec2ffd700 1 --2- 172.21.15.82:0/3325623957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec40ce550 0x7fbec40afc10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4001f80 tx=0x7fbeb400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:22.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.708+0000 7fbebbfff700 1 -- 172.21.15.82:0/3325623957 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb400ad80 con 0x7fbec40ce550 2023-11-28T13:03:22.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.708+0000 7fbebbfff700 1 -- 172.21.15.82:0/3325623957 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb40070d0 con 0x7fbec40ce550 2023-11-28T13:03:22.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.708+0000 7fbec3fff700 1 -- 172.21.15.82:0/3325623957 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec40cce80 con 0x7fbec40ce550 2023-11-28T13:03:22.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.708+0000 7fbebbfff700 1 -- 172.21.15.82:0/3325623957 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4007480 con 0x7fbec40ce550 2023-11-28T13:03:22.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.708+0000 7fbec3fff700 1 -- 172.21.15.82:0/3325623957 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec40ccba0 con 0x7fbec40ce550 2023-11-28T13:03:22.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.708+0000 7fbec3fff700 1 -- 172.21.15.82:0/3325623957 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec4065fc0 con 0x7fbec40ce550 2023-11-28T13:03:22.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.708+0000 7fbebbfff700 1 -- 172.21.15.82:0/3325623957 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbeb401a030 con 0x7fbec40ce550 2023-11-28T13:03:22.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.708+0000 7fbebbfff700 1 --2- 172.21.15.82:0/3325623957 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbea4064ee0 0x7fbea4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:22.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.708+0000 7fbec27fc700 1 --2- 172.21.15.82:0/3325623957 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbea4064ee0 0x7fbea4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:22.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.708+0000 7fbebbfff700 1 -- 172.21.15.82:0/3325623957 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbeb4081d10 con 0x7fbec40ce550 2023-11-28T13:03:22.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.708+0000 7fbec27fc700 1 --2- 172.21.15.82:0/3325623957 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbea4064ee0 0x7fbea4067390 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbec41f4ad0 tx=0x7fbeac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:22.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.720+0000 7fbebbfff700 1 -- 172.21.15.82:0/3325623957 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbeb404feb0 con 0x7fbec40ce550 2023-11-28T13:03:22.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.880+0000 7fbec3fff700 1 -- 172.21.15.82:0/3325623957 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbec40ada00 con 0x7fbec40ce550 2023-11-28T13:03:22.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.884+0000 7fbebbfff700 1 -- 172.21.15.82:0/3325623957 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+17838 (secure 0 0 0) 0x7fbeb4018090 con 0x7fbec40ce550 2023-11-28T13:03:22.890 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:22.890 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":64,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:03:22.558904+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:03:21.126074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T13:03:21.545268+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:03:22.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.888+0000 7fbec3fff700 1 -- 172.21.15.82:0/3325623957 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbea4064ee0 msgr2=0x7fbea4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:22.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.888+0000 7fbec3fff700 1 --2- 172.21.15.82:0/3325623957 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbea4064ee0 0x7fbea4067390 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbec41f4ad0 tx=0x7fbeac008040 comp rx=0 tx=0).stop 2023-11-28T13:03:22.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.888+0000 7fbec3fff700 1 -- 172.21.15.82:0/3325623957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec40ce550 msgr2=0x7fbec40afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:22.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.888+0000 7fbec3fff700 1 --2- 172.21.15.82:0/3325623957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec40ce550 0x7fbec40afc10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4001f80 tx=0x7fbeb400a340 comp rx=0 tx=0).stop 2023-11-28T13:03:22.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.888+0000 7fbec3fff700 1 -- 172.21.15.82:0/3325623957 shutdown_connections 2023-11-28T13:03:22.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.888+0000 7fbec3fff700 1 --2- 172.21.15.82:0/3325623957 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbea4064ee0 0x7fbea4067390 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.888+0000 7fbec3fff700 1 --2- 172.21.15.82:0/3325623957 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbec415c4b0 0x7fbec40b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.888+0000 7fbec3fff700 1 --2- 172.21.15.82:0/3325623957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbec415c0e0 0x7fbec40c5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.888+0000 7fbec3fff700 1 --2- 172.21.15.82:0/3325623957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec40ce550 0x7fbec40afc10 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:22.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.888+0000 7fbec3fff700 1 -- 172.21.15.82:0/3325623957 >> 172.21.15.82:0/3325623957 conn(0x7fbec40cb890 msgr2=0x7fbec415c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:22.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.888+0000 7fbec3fff700 1 -- 172.21.15.82:0/3325623957 shutdown_connections 2023-11-28T13:03:22.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:22.888+0000 7fbec3fff700 1 -- 172.21.15.82:0/3325623957 wait complete. 2023-11-28T13:03:22.910 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:03:23.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.016+0000 7efd05c3e700 1 Processor -- start 2023-11-28T13:03:23.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.016+0000 7efd05c3e700 1 -- start start 2023-11-28T13:03:23.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efd05c3e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efd00070070 0x7efd00070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:23.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efd05c3e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd00070980 con 0x7efd000c1910 2023-11-28T13:03:23.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efd05c3e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd000ce030 con 0x7efd00160900 2023-11-28T13:03:23.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efd05c3e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd000ce310 con 0x7efd00070070 2023-11-28T13:03:23.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efd0543d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efd000c1910 0x7efd0006c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55866/0 (socket says 172.21.15.82:55866) 2023-11-28T13:03:23.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efd0543d700 1 -- 172.21.15.82:0/2523752456 learned_addr learned my addr 172.21.15.82:0/2523752456 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:23.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efd04c3c700 1 --2- 172.21.15.82:0/2523752456 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efd00070070 0x7efd00070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:23.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efcff7fe700 1 -- 172.21.15.82:0/2523752456 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559521308 0 0) 0x7efd00070980 con 0x7efd000c1910 2023-11-28T13:03:23.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efcff7fe700 1 -- 172.21.15.82:0/2523752456 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efce80035d0 con 0x7efd000c1910 2023-11-28T13:03:23.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efcff7fe700 1 -- 172.21.15.82:0/2523752456 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207334516 0 0) 0x7efd000ce030 con 0x7efd00160900 2023-11-28T13:03:23.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efcff7fe700 1 -- 172.21.15.82:0/2523752456 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd00070980 con 0x7efd00160900 2023-11-28T13:03:23.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efcff7fe700 1 -- 172.21.15.82:0/2523752456 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1428000907 0 0) 0x7efce80035d0 con 0x7efd000c1910 2023-11-28T13:03:23.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efcff7fe700 1 -- 172.21.15.82:0/2523752456 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efd00070070 msgr2=0x7efd00070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:23.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efcff7fe700 1 --2- 172.21.15.82:0/2523752456 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efd00070070 0x7efd00070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:23.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efcff7fe700 1 -- 172.21.15.82:0/2523752456 >> v1:172.21.15.114:6789/0 conn(0x7efd00160900 legacy=0x7efd000cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:23.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efcff7fe700 1 -- 172.21.15.82:0/2523752456 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0006a5d0 con 0x7efd000c1910 2023-11-28T13:03:23.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efcff7fe700 1 -- 172.21.15.82:0/2523752456 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7efcf80019f0 con 0x7efd000c1910 2023-11-28T13:03:23.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efcff7fe700 1 -- 172.21.15.82:0/2523752456 >> v1:172.21.15.82:6789/0 conn(0x7efd000c1910 legacy=0x7efd0006c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:23.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efcff7fe700 1 --2- 172.21.15.82:0/2523752456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efce8003be0 0x7efce8003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:23.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efcff7fe700 1 --2- 172.21.15.82:0/2523752456 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efd00070070 0x7efce8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:23.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efcff7fe700 1 --2- 172.21.15.82:0/2523752456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efce8004db0 0x7efce8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:23.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efcff7fe700 1 -- 172.21.15.82:0/2523752456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd000ce310 con 0x7efce8003be0 2023-11-28T13:03:23.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efcff7fe700 1 -- 172.21.15.82:0/2523752456 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce800bb40 con 0x7efce8004db0 2023-11-28T13:03:23.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efcff7fe700 1 -- 172.21.15.82:0/2523752456 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce800bd00 con 0x7efd00070070 2023-11-28T13:03:23.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efd04c3c700 1 --2- 172.21.15.82:0/2523752456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efce8003be0 0x7efce8003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:23.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efd0543d700 1 --2- 172.21.15.82:0/2523752456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efce8004db0 0x7efce8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:23.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efcfffff700 1 --2- 172.21.15.82:0/2523752456 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efd00070070 0x7efce8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:23.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efd04c3c700 1 -- 172.21.15.82:0/2523752456 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efd00070070 msgr2=0x7efce8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:23.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efd04c3c700 1 --2- 172.21.15.82:0/2523752456 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efd00070070 0x7efce8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:23.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efd04c3c700 1 -- 172.21.15.82:0/2523752456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efce8004db0 msgr2=0x7efce8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:23.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efd04c3c700 1 --2- 172.21.15.82:0/2523752456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efce8004db0 0x7efce8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:23.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efd04c3c700 1 -- 172.21.15.82:0/2523752456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce80035d0 con 0x7efce8003be0 2023-11-28T13:03:23.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efd04c3c700 1 --2- 172.21.15.82:0/2523752456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efce8003be0 0x7efce8003fd0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7efcf40098b0 tx=0x7efce80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28854411685b4e6c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:23.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efcff7fe700 1 -- 172.21.15.82:0/2523752456 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf400c070 con 0x7efce8003be0 2023-11-28T13:03:23.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efcff7fe700 1 -- 172.21.15.82:0/2523752456 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf4013610 con 0x7efce8003be0 2023-11-28T13:03:23.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.020+0000 7efcff7fe700 1 -- 172.21.15.82:0/2523752456 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf40139c0 con 0x7efce8003be0 2023-11-28T13:03:23.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efd05c3e700 1 -- 172.21.15.82:0/2523752456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efce8003be0 msgr2=0x7efce8003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:23.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efd05c3e700 1 --2- 172.21.15.82:0/2523752456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efce8003be0 0x7efce8003fd0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7efcf40098b0 tx=0x7efce80058a0 comp rx=0 tx=0).stop 2023-11-28T13:03:23.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efd0543d700 1 -- 172.21.15.82:0/2523752456 reap_dead start 2023-11-28T13:03:23.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efd05c3e700 1 -- 172.21.15.82:0/2523752456 shutdown_connections 2023-11-28T13:03:23.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efd05c3e700 1 -- 172.21.15.82:0/2523752456 >> 172.21.15.82:0/2523752456 conn(0x7efd000ce600 msgr2=0x7efd000ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:23.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efd05c3e700 1 -- 172.21.15.82:0/2523752456 shutdown_connections 2023-11-28T13:03:23.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efd05c3e700 1 -- 172.21.15.82:0/2523752456 wait complete. 2023-11-28T13:03:23.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efd05c3e700 1 Processor -- start 2023-11-28T13:03:23.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efd05c3e700 1 -- start start 2023-11-28T13:03:23.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efd05c3e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efce8003be0 0x7efd00157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:23.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efd05c3e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd001f58c0 0x7efd000c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:23.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efd05c3e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd000b2a20 0x7efd000b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:23.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efd05c3e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd000b33d0 con 0x7efd001f58c0 2023-11-28T13:03:23.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efd05c3e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd000c89a0 con 0x7efd000b2a20 2023-11-28T13:03:23.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efd05c3e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd00157900 con 0x7efce8003be0 2023-11-28T13:03:23.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efcfffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd001f58c0 0x7efd000c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:23.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efcfffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd001f58c0 0x7efd000c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58784/0 (socket says 172.21.15.82:58784) 2023-11-28T13:03:23.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efcfffff700 1 -- 172.21.15.82:0/1265131048 learned_addr learned my addr 172.21.15.82:0/1265131048 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:23.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efd0543d700 1 --2- 172.21.15.82:0/1265131048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd000b2a20 0x7efd000b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efd04c3c700 1 --2- 172.21.15.82:0/1265131048 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efce8003be0 0x7efd00157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efcfffff700 1 -- 172.21.15.82:0/1265131048 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efce8003be0 msgr2=0x7efd00157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efcfffff700 1 --2- 172.21.15.82:0/1265131048 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efce8003be0 0x7efd00157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efcfffff700 1 -- 172.21.15.82:0/1265131048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd000b2a20 msgr2=0x7efd000b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efcfffff700 1 --2- 172.21.15.82:0/1265131048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd000b2a20 0x7efd000b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efcfffff700 1 -- 172.21.15.82:0/1265131048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0006ab90 con 0x7efd001f58c0 2023-11-28T13:03:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efd04c3c700 1 --2- 172.21.15.82:0/1265131048 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efce8003be0 0x7efd00157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:03:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efcfffff700 1 --2- 172.21.15.82:0/1265131048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd001f58c0 0x7efd000c8460 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7efcf000f7e0 tx=0x7efcf000fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efcfd7fa700 1 -- 172.21.15.82:0/1265131048 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00052e0 con 0x7efd001f58c0 2023-11-28T13:03:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efcfd7fa700 1 -- 172.21.15.82:0/1265131048 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf0005460 con 0x7efd001f58c0 2023-11-28T13:03:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.024+0000 7efd05c3e700 1 -- 172.21.15.82:0/1265131048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0006a8b0 con 0x7efd001f58c0 2023-11-28T13:03:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.028+0000 7efcfd7fa700 1 -- 172.21.15.82:0/1265131048 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00038e0 con 0x7efd001f58c0 2023-11-28T13:03:23.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.028+0000 7efd05c3e700 1 -- 172.21.15.82:0/1265131048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd000cdc50 con 0x7efd001f58c0 2023-11-28T13:03:23.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.028+0000 7efd05c3e700 1 -- 172.21.15.82:0/1265131048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd00065fc0 con 0x7efd001f58c0 2023-11-28T13:03:23.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.028+0000 7efcfd7fa700 1 -- 172.21.15.82:0/1265131048 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efcf0003a40 con 0x7efd001f58c0 2023-11-28T13:03:23.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.028+0000 7efcfd7fa700 1 --2- 172.21.15.82:0/1265131048 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efcec064ee0 0x7efcec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:23.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.028+0000 7efcfd7fa700 1 -- 172.21.15.82:0/1265131048 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efcf0081f10 con 0x7efd001f58c0 2023-11-28T13:03:23.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.028+0000 7efd04c3c700 1 --2- 172.21.15.82:0/1265131048 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efcec064ee0 0x7efcec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:23.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.028+0000 7efd04c3c700 1 --2- 172.21.15.82:0/1265131048 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efcec064ee0 0x7efcec067390 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efcf4000c00 tx=0x7efcf400c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:23.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.036+0000 7efcfd7fa700 1 -- 172.21.15.82:0/1265131048 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efcf00500b0 con 0x7efd001f58c0 2023-11-28T13:03:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.204+0000 7efd05c3e700 1 -- 172.21.15.82:0/1265131048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd000adaa0 con 0x7efd001f58c0 2023-11-28T13:03:23.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.204+0000 7efcfd7fa700 1 -- 172.21.15.82:0/1265131048 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+17838 (secure 0 0 0) 0x7efcf00536d0 con 0x7efd001f58c0 2023-11-28T13:03:23.211 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:23.211 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":64,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:03:22.558904+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:03:21.126074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T13:03:21.545268+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:03:23.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.208+0000 7efd05c3e700 1 -- 172.21.15.82:0/1265131048 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efcec064ee0 msgr2=0x7efcec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:23.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.208+0000 7efd05c3e700 1 --2- 172.21.15.82:0/1265131048 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efcec064ee0 0x7efcec067390 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efcf4000c00 tx=0x7efcf400c000 comp rx=0 tx=0).stop 2023-11-28T13:03:23.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.208+0000 7efd05c3e700 1 -- 172.21.15.82:0/1265131048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd001f58c0 msgr2=0x7efd000c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:23.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.208+0000 7efd05c3e700 1 --2- 172.21.15.82:0/1265131048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd001f58c0 0x7efd000c8460 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7efcf000f7e0 tx=0x7efcf000fba0 comp rx=0 tx=0).stop 2023-11-28T13:03:23.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.208+0000 7efd05c3e700 1 -- 172.21.15.82:0/1265131048 shutdown_connections 2023-11-28T13:03:23.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.208+0000 7efd05c3e700 1 --2- 172.21.15.82:0/1265131048 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efcec064ee0 0x7efcec067390 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:23.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.208+0000 7efd05c3e700 1 --2- 172.21.15.82:0/1265131048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd000b2a20 0x7efd000b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:23.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.208+0000 7efd05c3e700 1 --2- 172.21.15.82:0/1265131048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd001f58c0 0x7efd000c8460 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:23.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.208+0000 7efd05c3e700 1 --2- 172.21.15.82:0/1265131048 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efce8003be0 0x7efd00157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:23.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.208+0000 7efd05c3e700 1 -- 172.21.15.82:0/1265131048 >> 172.21.15.82:0/1265131048 conn(0x7efd000ce600 msgr2=0x7efd000adcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:23.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.208+0000 7efd05c3e700 1 -- 172.21.15.82:0/1265131048 shutdown_connections 2023-11-28T13:03:23.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.208+0000 7efd05c3e700 1 -- 172.21.15.82:0/1265131048 wait complete. 2023-11-28T13:03:23.230 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T13:03:23.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.344+0000 7fc40759e700 1 Processor -- start 2023-11-28T13:03:23.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.344+0000 7fc40759e700 1 -- start start 2023-11-28T13:03:23.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc40759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc408070910 0x7fc408070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:23.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc40759e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc4080c9b10 0x7fc4080c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:23.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc40759e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4080c93a0 con 0x7fc4080ad820 2023-11-28T13:03:23.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc40759e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4080c96f0 con 0x7fc4080c9b10 2023-11-28T13:03:23.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc40759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc408071580 con 0x7fc408070910 2023-11-28T13:03:23.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc40659c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc408070910 0x7fc408070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:23.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc406d9d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc4080c9b10 0x7fc4080c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:23.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc405d9b700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc4080ad820 0x7fc40806a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:54894/0 (socket says 172.21.15.82:54894) 2023-11-28T13:03:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc405d9b700 1 -- 172.21.15.82:0/1359951953 learned_addr learned my addr 172.21.15.82:0/1359951953 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc406d9d700 1 -- 172.21.15.82:0/1359951953 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc408070910 msgr2=0x7fc408070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc406d9d700 1 --2- 172.21.15.82:0/1359951953 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc408070910 0x7fc408070ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc406d9d700 1 -- 172.21.15.82:0/1359951953 >> v1:172.21.15.114:6789/0 conn(0x7fc4080ad820 legacy=0x7fc40806a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc406d9d700 1 -- 172.21.15.82:0/1359951953 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc408071220 con 0x7fc4080c9b10 2023-11-28T13:03:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc406d9d700 1 --2- 172.21.15.82:0/1359951953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4080c9b10 0x7fc4080c9f80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8009dc0 tx=0x7fc3f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4896722ff817f7e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc40559a700 1 -- 172.21.15.82:0/1359951953 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f800e070 con 0x7fc4080c9b10 2023-11-28T13:03:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc40559a700 1 -- 172.21.15.82:0/1359951953 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f800bae0 con 0x7fc4080c9b10 2023-11-28T13:03:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc40559a700 1 -- 172.21.15.82:0/1359951953 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f800be90 con 0x7fc4080c9b10 2023-11-28T13:03:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc40759e700 1 -- 172.21.15.82:0/1359951953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4080c9b10 msgr2=0x7fc4080c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc40759e700 1 --2- 172.21.15.82:0/1359951953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4080c9b10 0x7fc4080c9f80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8009dc0 tx=0x7fc3f800b330 comp rx=0 tx=0).stop 2023-11-28T13:03:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc40759e700 1 -- 172.21.15.82:0/1359951953 shutdown_connections 2023-11-28T13:03:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc40759e700 1 --2- 172.21.15.82:0/1359951953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4080c9b10 0x7fc4080c9f80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc40759e700 1 --2- 172.21.15.82:0/1359951953 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc408070910 0x7fc408070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc40759e700 1 -- 172.21.15.82:0/1359951953 >> 172.21.15.82:0/1359951953 conn(0x7fc4080ce630 msgr2=0x7fc4080cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc40759e700 1 -- 172.21.15.82:0/1359951953 shutdown_connections 2023-11-28T13:03:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.348+0000 7fc40759e700 1 -- 172.21.15.82:0/1359951953 wait complete. 2023-11-28T13:03:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc40759e700 1 Processor -- start 2023-11-28T13:03:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc40759e700 1 -- start start 2023-11-28T13:03:23.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc40759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc408070910 0x7fc4081443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:23.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc40759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4080ad820 0x7fc4080cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:23.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc40759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4080c9b10 0x7fc4080cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:23.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc40759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc408144a30 con 0x7fc4080c9b10 2023-11-28T13:03:23.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc40759e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4080cd680 con 0x7fc408070910 2023-11-28T13:03:23.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc40759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4080cd920 con 0x7fc4080ad820 2023-11-28T13:03:23.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc406d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4080c9b10 0x7fc4080cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:23.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc405d9b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4080ad820 0x7fc4080cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:23.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc40659c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc408070910 0x7fc4081443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:23.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc406d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4080c9b10 0x7fc4080cd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58786/0 (socket says 172.21.15.82:58786) 2023-11-28T13:03:23.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc40659c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc408070910 0x7fc4081443f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:43268/0 (socket says 172.21.15.82:43268) 2023-11-28T13:03:23.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc406d9d700 1 -- 172.21.15.82:0/225741424 learned_addr learned my addr 172.21.15.82:0/225741424 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:23.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc406d9d700 1 -- 172.21.15.82:0/225741424 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4080ad820 msgr2=0x7fc4080cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:23.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc406d9d700 1 --2- 172.21.15.82:0/225741424 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4080ad820 0x7fc4080cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:23.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc406d9d700 1 -- 172.21.15.82:0/225741424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc408070910 msgr2=0x7fc4081443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:23.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc406d9d700 1 --2- 172.21.15.82:0/225741424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc408070910 0x7fc4081443f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:23.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc406d9d700 1 -- 172.21.15.82:0/225741424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f8009a70 con 0x7fc4080c9b10 2023-11-28T13:03:23.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc406d9d700 1 --2- 172.21.15.82:0/225741424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4080c9b10 0x7fc4080cd140 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800b370 tx=0x7fc3f8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:23.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc3feffd700 1 -- 172.21.15.82:0/225741424 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f80045d0 con 0x7fc4080c9b10 2023-11-28T13:03:23.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc3feffd700 1 -- 172.21.15.82:0/225741424 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f8020070 con 0x7fc4080c9b10 2023-11-28T13:03:23.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc40759e700 1 -- 172.21.15.82:0/225741424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40806b0c0 con 0x7fc4080c9b10 2023-11-28T13:03:23.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc3feffd700 1 -- 172.21.15.82:0/225741424 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8004990 con 0x7fc4080c9b10 2023-11-28T13:03:23.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.352+0000 7fc40759e700 1 -- 172.21.15.82:0/225741424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40806ade0 con 0x7fc4080c9b10 2023-11-28T13:03:23.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.356+0000 7fc40759e700 1 -- 172.21.15.82:0/225741424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40806b3a0 con 0x7fc4080c9b10 2023-11-28T13:03:23.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.356+0000 7fc3feffd700 1 -- 172.21.15.82:0/225741424 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc3f8012430 con 0x7fc4080c9b10 2023-11-28T13:03:23.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.356+0000 7fc3feffd700 1 --2- 172.21.15.82:0/225741424 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc3e8064ee0 0x7fc3e8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:23.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.356+0000 7fc3feffd700 1 -- 172.21.15.82:0/225741424 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc3f8022070 con 0x7fc4080c9b10 2023-11-28T13:03:23.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.356+0000 7fc40659c700 1 --2- 172.21.15.82:0/225741424 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc3e8064ee0 0x7fc3e8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:23.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.356+0000 7fc40659c700 1 --2- 172.21.15.82:0/225741424 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc3e8064ee0 0x7fc3e8067390 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc4080af400 tx=0x7fc400009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:23.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.364+0000 7fc3feffd700 1 -- 172.21.15.82:0/225741424 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc3f80525e0 con 0x7fc4080c9b10 2023-11-28T13:03:23.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:23.564+0000 7fc40759e700 1 -- 172.21.15.82:0/225741424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc408065fc0 con 0x7fc4080c9b10 2023-11-28T13:03:24.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.580+0000 7fc3feffd700 1 -- 172.21.15.82:0/225741424 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc3f8055c00 con 0x7fc4080c9b10 2023-11-28T13:03:24.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.584+0000 7fc40759e700 1 -- 172.21.15.82:0/225741424 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc3e8064ee0 msgr2=0x7fc3e8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:24.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.584+0000 7fc40759e700 1 --2- 172.21.15.82:0/225741424 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc3e8064ee0 0x7fc3e8067390 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc4080af400 tx=0x7fc400009240 comp rx=0 tx=0).stop 2023-11-28T13:03:24.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.584+0000 7fc40759e700 1 -- 172.21.15.82:0/225741424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4080c9b10 msgr2=0x7fc4080cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:24.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.584+0000 7fc40759e700 1 --2- 172.21.15.82:0/225741424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4080c9b10 0x7fc4080cd140 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800b370 tx=0x7fc3f8004af0 comp rx=0 tx=0).stop 2023-11-28T13:03:24.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.584+0000 7fc40759e700 1 -- 172.21.15.82:0/225741424 shutdown_connections 2023-11-28T13:03:24.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.584+0000 7fc40759e700 1 --2- 172.21.15.82:0/225741424 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc3e8064ee0 0x7fc3e8067390 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:24.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.584+0000 7fc40759e700 1 --2- 172.21.15.82:0/225741424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4080c9b10 0x7fc4080cd140 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:24.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.584+0000 7fc40759e700 1 --2- 172.21.15.82:0/225741424 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4080ad820 0x7fc4080cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:24.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.584+0000 7fc40759e700 1 --2- 172.21.15.82:0/225741424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc408070910 0x7fc4081443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:24.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.584+0000 7fc40759e700 1 -- 172.21.15.82:0/225741424 >> 172.21.15.82:0/225741424 conn(0x7fc4080ce630 msgr2=0x7fc4080b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:24.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.584+0000 7fc40759e700 1 -- 172.21.15.82:0/225741424 shutdown_connections 2023-11-28T13:03:24.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.584+0000 7fc40759e700 1 -- 172.21.15.82:0/225741424 wait complete. 2023-11-28T13:03:24.607 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T13:03:24.609 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T13:03:24.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.728+0000 7f1c26a2d700 1 Processor -- start 2023-11-28T13:03:24.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.728+0000 7f1c26a2d700 1 -- start start 2023-11-28T13:03:24.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c26a2d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1c200ad820 0x7f1c2006a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:24.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c26a2d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c200c9b10 0x7f1c200c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:24.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c26a2d700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c200c93a0 con 0x7f1c20070910 2023-11-28T13:03:24.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c26a2d700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c200c96f0 con 0x7f1c200ad820 2023-11-28T13:03:24.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c26a2d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c20071580 con 0x7f1c200c9b10 2023-11-28T13:03:24.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c2522a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1c200ad820 0x7f1c2006a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:24.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c2522a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1c200ad820 0x7f1c2006a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58802/0 (socket says 172.21.15.82:58802) 2023-11-28T13:03:24.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c2522a700 1 -- 172.21.15.82:0/646803995 learned_addr learned my addr 172.21.15.82:0/646803995 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:24.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c2622c700 1 --2- 172.21.15.82:0/646803995 >> v2:172.21.15.114:3300/0 conn(0x7f1c200c9b10 0x7f1c200c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:24.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c2522a700 1 -- 172.21.15.82:0/646803995 >> v2:172.21.15.114:3300/0 conn(0x7f1c200c9b10 msgr2=0x7f1c200c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:24.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c2522a700 1 --2- 172.21.15.82:0/646803995 >> v2:172.21.15.114:3300/0 conn(0x7f1c200c9b10 0x7f1c200c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:24.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c2522a700 1 -- 172.21.15.82:0/646803995 >> v1:172.21.15.114:6789/0 conn(0x7f1c20070910 legacy=0x7f1c20070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:24.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c24a29700 1 -- 172.21.15.82:0/646803995 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617698632 0 0) 0x7f1c200c93a0 con 0x7f1c20070910 2023-11-28T13:03:24.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c2522a700 1 -- 172.21.15.82:0/646803995 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2006ab10 con 0x7f1c200ad820 2023-11-28T13:03:24.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c2622c700 1 --2- 172.21.15.82:0/646803995 >> v2:172.21.15.114:3300/0 conn(0x7f1c200c9b10 0x7f1c200c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:03:24.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c2522a700 1 --2- 172.21.15.82:0/646803995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c200ad820 0x7f1c2006a5d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1c2006fbd0 tx=0x7f1c10009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834aedd5cb5f526e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:24.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c24a29700 1 -- 172.21.15.82:0/646803995 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10011830 con 0x7f1c200ad820 2023-11-28T13:03:24.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c24a29700 1 -- 172.21.15.82:0/646803995 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c10011990 con 0x7f1c200ad820 2023-11-28T13:03:24.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c24a29700 1 -- 172.21.15.82:0/646803995 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10011d40 con 0x7f1c200ad820 2023-11-28T13:03:24.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c26a2d700 1 -- 172.21.15.82:0/646803995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c200ad820 msgr2=0x7f1c2006a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:24.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c26a2d700 1 --2- 172.21.15.82:0/646803995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c200ad820 0x7f1c2006a5d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1c2006fbd0 tx=0x7f1c10009c20 comp rx=0 tx=0).stop 2023-11-28T13:03:24.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c26a2d700 1 -- 172.21.15.82:0/646803995 shutdown_connections 2023-11-28T13:03:24.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c26a2d700 1 --2- 172.21.15.82:0/646803995 >> v2:172.21.15.114:3300/0 conn(0x7f1c200c9b10 0x7f1c200c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:24.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c26a2d700 1 --2- 172.21.15.82:0/646803995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c200ad820 0x7f1c2006a5d0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:24.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c26a2d700 1 -- 172.21.15.82:0/646803995 >> 172.21.15.82:0/646803995 conn(0x7f1c200ce630 msgr2=0x7f1c200cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:24.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c26a2d700 1 -- 172.21.15.82:0/646803995 shutdown_connections 2023-11-28T13:03:24.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.732+0000 7f1c26a2d700 1 -- 172.21.15.82:0/646803995 wait complete. 2023-11-28T13:03:24.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.736+0000 7f1c26a2d700 1 Processor -- start 2023-11-28T13:03:24.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.736+0000 7f1c26a2d700 1 -- start start 2023-11-28T13:03:24.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.736+0000 7f1c26a2d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c20070910 0x7f1c20157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.736+0000 7f1c26a2d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c200ad820 0x7f1c200cd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.736+0000 7f1c26a2d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c200c9b10 0x7f1c201f9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.736+0000 7f1c26a2d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c200cc630 con 0x7f1c20070910 2023-11-28T13:03:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.736+0000 7f1c26a2d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c20158250 con 0x7f1c200c9b10 2023-11-28T13:03:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.736+0000 7f1c26a2d700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c200cc890 con 0x7f1c200ad820 2023-11-28T13:03:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.736+0000 7f1c25a2b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c20070910 0x7f1c20157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.736+0000 7f1c25a2b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c20070910 0x7f1c20157d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58812/0 (socket says 172.21.15.82:58812) 2023-11-28T13:03:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.736+0000 7f1c25a2b700 1 -- 172.21.15.82:0/1133439759 learned_addr learned my addr 172.21.15.82:0/1133439759 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.736+0000 7f1c2622c700 1 --2- 172.21.15.82:0/1133439759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c200c9b10 0x7f1c201f9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.740+0000 7f1c2522a700 1 --2- 172.21.15.82:0/1133439759 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c200ad820 0x7f1c200cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.740+0000 7f1c25a2b700 1 -- 172.21.15.82:0/1133439759 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c200ad820 msgr2=0x7f1c200cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.740+0000 7f1c25a2b700 1 --2- 172.21.15.82:0/1133439759 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c200ad820 0x7f1c200cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:24.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.740+0000 7f1c25a2b700 1 -- 172.21.15.82:0/1133439759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c200c9b10 msgr2=0x7f1c201f9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:24.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.740+0000 7f1c25a2b700 1 --2- 172.21.15.82:0/1133439759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c200c9b10 0x7f1c201f9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:24.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.740+0000 7f1c25a2b700 1 -- 172.21.15.82:0/1133439759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c18009a70 con 0x7f1c20070910 2023-11-28T13:03:24.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.740+0000 7f1c2622c700 1 --2- 172.21.15.82:0/1133439759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c200c9b10 0x7f1c201f9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:24.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.740+0000 7f1c25a2b700 1 --2- 172.21.15.82:0/1133439759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c20070910 0x7f1c20157d10 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00c520 tx=0x7f1c1c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:24.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.740+0000 7f1c167fc700 1 -- 172.21.15.82:0/1133439759 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0054e0 con 0x7f1c20070910 2023-11-28T13:03:24.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.740+0000 7f1c167fc700 1 -- 172.21.15.82:0/1133439759 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1c0036a0 con 0x7f1c20070910 2023-11-28T13:03:24.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.740+0000 7f1c167fc700 1 -- 172.21.15.82:0/1133439759 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c003a50 con 0x7f1c20070910 2023-11-28T13:03:24.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.740+0000 7f1c26a2d700 1 -- 172.21.15.82:0/1133439759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c10009570 con 0x7f1c20070910 2023-11-28T13:03:24.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.740+0000 7f1c26a2d700 1 -- 172.21.15.82:0/1133439759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2006b0c0 con 0x7f1c20070910 2023-11-28T13:03:24.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.740+0000 7f1c26a2d700 1 -- 172.21.15.82:0/1133439759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c2006ade0 con 0x7f1c20070910 2023-11-28T13:03:24.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.740+0000 7f1c167fc700 1 -- 172.21.15.82:0/1133439759 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1c1c019030 con 0x7f1c20070910 2023-11-28T13:03:24.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.744+0000 7f1c167fc700 1 --2- 172.21.15.82:0/1133439759 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1c04064f10 0x7f1c040673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:24.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.744+0000 7f1c167fc700 1 -- 172.21.15.82:0/1133439759 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1c1c081390 con 0x7f1c20070910 2023-11-28T13:03:24.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.744+0000 7f1c2522a700 1 --2- 172.21.15.82:0/1133439759 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1c04064f10 0x7f1c040673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:24.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.744+0000 7f1c2522a700 1 --2- 172.21.15.82:0/1133439759 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1c04064f10 0x7f1c040673c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1c2006fbd0 tx=0x7f1c10008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:24.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.748+0000 7f1c167fc700 1 -- 172.21.15.82:0/1133439759 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1c1c04f3c0 con 0x7f1c20070910 2023-11-28T13:03:24.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:24.948+0000 7f1c26a2d700 1 -- 172.21.15.82:0/1133439759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1c2006b3a0 con 0x7f1c20070910 2023-11-28T13:03:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.592+0000 7f1c167fc700 1 -- 172.21.15.82:0/1133439759 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1c1c0529e0 con 0x7f1c20070910 2023-11-28T13:03:25.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.596+0000 7f1c26a2d700 1 -- 172.21.15.82:0/1133439759 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1c04064f10 msgr2=0x7f1c040673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:25.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.596+0000 7f1c26a2d700 1 --2- 172.21.15.82:0/1133439759 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1c04064f10 0x7f1c040673c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1c2006fbd0 tx=0x7f1c10008030 comp rx=0 tx=0).stop 2023-11-28T13:03:25.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.596+0000 7f1c26a2d700 1 -- 172.21.15.82:0/1133439759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c20070910 msgr2=0x7f1c20157d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:25.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.596+0000 7f1c26a2d700 1 --2- 172.21.15.82:0/1133439759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c20070910 0x7f1c20157d10 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00c520 tx=0x7f1c1c00c8e0 comp rx=0 tx=0).stop 2023-11-28T13:03:25.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.596+0000 7f1c26a2d700 1 -- 172.21.15.82:0/1133439759 shutdown_connections 2023-11-28T13:03:25.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.596+0000 7f1c26a2d700 1 --2- 172.21.15.82:0/1133439759 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1c04064f10 0x7f1c040673c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:25.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.596+0000 7f1c26a2d700 1 --2- 172.21.15.82:0/1133439759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c200c9b10 0x7f1c201f9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.596+0000 7f1c26a2d700 1 --2- 172.21.15.82:0/1133439759 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c200ad820 0x7f1c200cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.596+0000 7f1c26a2d700 1 --2- 172.21.15.82:0/1133439759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c20070910 0x7f1c20157d10 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.596+0000 7f1c26a2d700 1 -- 172.21.15.82:0/1133439759 >> 172.21.15.82:0/1133439759 conn(0x7f1c200ce630 msgr2=0x7f1c200b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.596+0000 7f1c26a2d700 1 -- 172.21.15.82:0/1133439759 shutdown_connections 2023-11-28T13:03:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.596+0000 7f1c26a2d700 1 -- 172.21.15.82:0/1133439759 wait complete. 2023-11-28T13:03:25.621 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T13:03:25.621 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:03:25.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.736+0000 7f849359e700 1 Processor -- start 2023-11-28T13:03:25.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.736+0000 7f849359e700 1 -- start start 2023-11-28T13:03:25.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.740+0000 7f849359e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f849406d830 0x7f849415e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:25.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.740+0000 7f849359e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8494160b90 con 0x7f849406d3d0 2023-11-28T13:03:25.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.740+0000 7f849359e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849415fd30 con 0x7f8494156840 2023-11-28T13:03:25.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.740+0000 7f849359e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8494156c10 con 0x7f849406d830 2023-11-28T13:03:25.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.740+0000 7f8489d9b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f849406d3d0 0x7f849415dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55868/0 (socket says 172.21.15.82:55868) 2023-11-28T13:03:25.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.740+0000 7f8489d9b700 1 -- 172.21.15.82:0/1179059297 learned_addr learned my addr 172.21.15.82:0/1179059297 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:25.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.740+0000 7f8492d9d700 1 --2- 172.21.15.82:0/1179059297 >> v2:172.21.15.114:3300/0 conn(0x7f849406d830 0x7f849415e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:25.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.740+0000 7f8491d9b700 1 -- 172.21.15.82:0/1179059297 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274571227 0 0) 0x7f8494160b90 con 0x7f849406d3d0 2023-11-28T13:03:25.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.740+0000 7f8491d9b700 1 -- 172.21.15.82:0/1179059297 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84800035d0 con 0x7f849406d3d0 2023-11-28T13:03:25.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.740+0000 7f8492d9d700 1 -- 172.21.15.82:0/1179059297 >> v1:172.21.15.114:6789/0 conn(0x7f8494156840 legacy=0x7f84940ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:25.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.740+0000 7f8492d9d700 1 -- 172.21.15.82:0/1179059297 >> v1:172.21.15.82:6789/0 conn(0x7f849406d3d0 legacy=0x7f849415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:25.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.740+0000 7f8492d9d700 1 -- 172.21.15.82:0/1179059297 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849415ff80 con 0x7f849406d830 2023-11-28T13:03:25.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.740+0000 7f8492d9d700 1 --2- 172.21.15.82:0/1179059297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f849406d830 0x7f849415e1c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f848c009d90 tx=0x7f848c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33d94137292cb77 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:25.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.740+0000 7f8491d9b700 1 -- 172.21.15.82:0/1179059297 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c00e070 con 0x7f849406d830 2023-11-28T13:03:25.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.740+0000 7f8491d9b700 1 -- 172.21.15.82:0/1179059297 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848c00bb20 con 0x7f849406d830 2023-11-28T13:03:25.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.740+0000 7f8491d9b700 1 -- 172.21.15.82:0/1179059297 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c012430 con 0x7f849406d830 2023-11-28T13:03:25.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.740+0000 7f849359e700 1 -- 172.21.15.82:0/1179059297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f849406d830 msgr2=0x7f849415e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:25.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.740+0000 7f849359e700 1 --2- 172.21.15.82:0/1179059297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f849406d830 0x7f849415e1c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f848c009d90 tx=0x7f848c00b330 comp rx=0 tx=0).stop 2023-11-28T13:03:25.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.740+0000 7f849359e700 1 -- 172.21.15.82:0/1179059297 shutdown_connections 2023-11-28T13:03:25.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.740+0000 7f849359e700 1 --2- 172.21.15.82:0/1179059297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f849406d830 0x7f849415e1c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:25.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.740+0000 7f849359e700 1 -- 172.21.15.82:0/1179059297 >> 172.21.15.82:0/1179059297 conn(0x7f84940cce90 msgr2=0x7f84940cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:25.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.744+0000 7f849359e700 1 -- 172.21.15.82:0/1179059297 shutdown_connections 2023-11-28T13:03:25.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.744+0000 7f849359e700 1 -- 172.21.15.82:0/1179059297 wait complete. 2023-11-28T13:03:25.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.744+0000 7f849359e700 1 Processor -- start 2023-11-28T13:03:25.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.744+0000 7f849359e700 1 -- start start 2023-11-28T13:03:25.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.744+0000 7f849359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f849406d3d0 0x7f84941f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:25.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.744+0000 7f849359e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f849406d830 0x7f84941f0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:25.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.744+0000 7f849359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8494156840 0x7f84941f1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:25.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.744+0000 7f849359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849406b3b0 con 0x7f8494156840 2023-11-28T13:03:25.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.744+0000 7f849359e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849406b690 con 0x7f849406d3d0 2023-11-28T13:03:25.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.744+0000 7f849359e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849406b970 con 0x7f849406d830 2023-11-28T13:03:25.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.744+0000 7f849259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f849406d3d0 0x7f84941f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:25.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.744+0000 7f8492d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8494156840 0x7f84941f1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:25.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.744+0000 7f849259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f849406d3d0 0x7f84941f52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:43316/0 (socket says 172.21.15.82:43316) 2023-11-28T13:03:25.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.744+0000 7f849259c700 1 -- 172.21.15.82:0/898206230 learned_addr learned my addr 172.21.15.82:0/898206230 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:25.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.744+0000 7f8489d9b700 1 --2- 172.21.15.82:0/898206230 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f849406d830 0x7f84941f0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:25.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.744+0000 7f8492d9d700 1 -- 172.21.15.82:0/898206230 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f849406d830 msgr2=0x7f84941f0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:25.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.744+0000 7f8492d9d700 1 --2- 172.21.15.82:0/898206230 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f849406d830 0x7f84941f0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:25.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.744+0000 7f8492d9d700 1 -- 172.21.15.82:0/898206230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f849406d3d0 msgr2=0x7f84941f52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:25.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.744+0000 7f8492d9d700 1 --2- 172.21.15.82:0/898206230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f849406d3d0 0x7f84941f52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:25.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.744+0000 7f8492d9d700 1 -- 172.21.15.82:0/898206230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c009a70 con 0x7f8494156840 2023-11-28T13:03:25.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.748+0000 7f8492d9d700 1 --2- 172.21.15.82:0/898206230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8494156840 0x7f84941f1480 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f848c016000 tx=0x7f848c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:25.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.748+0000 7f848b7fe700 1 -- 172.21.15.82:0/898206230 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c012430 con 0x7f8494156840 2023-11-28T13:03:25.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.748+0000 7f848b7fe700 1 -- 172.21.15.82:0/898206230 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848c020070 con 0x7f8494156840 2023-11-28T13:03:25.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.748+0000 7f849359e700 1 -- 172.21.15.82:0/898206230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8494160540 con 0x7f8494156840 2023-11-28T13:03:25.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.748+0000 7f848b7fe700 1 -- 172.21.15.82:0/898206230 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c004280 con 0x7f8494156840 2023-11-28T13:03:25.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.748+0000 7f849359e700 1 -- 172.21.15.82:0/898206230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8494160260 con 0x7f8494156840 2023-11-28T13:03:25.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.748+0000 7f849359e700 1 -- 172.21.15.82:0/898206230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8494160820 con 0x7f8494156840 2023-11-28T13:03:25.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.748+0000 7f848b7fe700 1 -- 172.21.15.82:0/898206230 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f848c02e070 con 0x7f8494156840 2023-11-28T13:03:25.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.748+0000 7f848b7fe700 1 --2- 172.21.15.82:0/898206230 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8474064ee0 0x7f8474067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:25.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.752+0000 7f849259c700 1 --2- 172.21.15.82:0/898206230 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8474064ee0 0x7f8474067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:25.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.752+0000 7f848b7fe700 1 -- 172.21.15.82:0/898206230 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f848c022070 con 0x7f8494156840 2023-11-28T13:03:25.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.752+0000 7f849259c700 1 --2- 172.21.15.82:0/898206230 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8474064ee0 0x7f8474067390 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f84840018a0 tx=0x7f8484009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:25.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.756+0000 7f848b7fe700 1 -- 172.21.15.82:0/898206230 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f848c051ba0 con 0x7f8494156840 2023-11-28T13:03:25.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.960+0000 7f849359e700 1 -- 172.21.15.82:0/898206230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8494065fc0 con 0x7f8494156840 2023-11-28T13:03:25.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.960+0000 7f848b7fe700 1 -- 172.21.15.82:0/898206230 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4655 (secure 0 0 0) 0x7f848c012e60 con 0x7f8494156840 2023-11-28T13:03:25.966 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:25.966 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/3176308867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3176308867},{"type":"v1","addr":"172.21.15.114:6833","nonce":3176308867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6184,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1779270694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1779270694},{"type":"v1","addr":"172.21.15.114:6835","nonce":1779270694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1570999968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1570999968},{"type":"v1","addr":"172.21.15.82:6835","nonce":1570999968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:03:22.559646+0000","modified":"2023-11-28T13:03:25.579582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2902091405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2902091405},{"type":"v1","addr":"172.21.15.82:6837","nonce":2902091405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T13:03:25.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.964+0000 7f849359e700 1 -- 172.21.15.82:0/898206230 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8474064ee0 msgr2=0x7f8474067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:25.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.964+0000 7f849359e700 1 --2- 172.21.15.82:0/898206230 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8474064ee0 0x7f8474067390 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f84840018a0 tx=0x7f8484009040 comp rx=0 tx=0).stop 2023-11-28T13:03:25.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.964+0000 7f849359e700 1 -- 172.21.15.82:0/898206230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8494156840 msgr2=0x7f84941f1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:25.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.964+0000 7f849359e700 1 --2- 172.21.15.82:0/898206230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8494156840 0x7f84941f1480 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f848c016000 tx=0x7f848c004af0 comp rx=0 tx=0).stop 2023-11-28T13:03:25.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.964+0000 7f849359e700 1 -- 172.21.15.82:0/898206230 shutdown_connections 2023-11-28T13:03:25.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.964+0000 7f849359e700 1 --2- 172.21.15.82:0/898206230 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8474064ee0 0x7f8474067390 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:25.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.964+0000 7f849359e700 1 --2- 172.21.15.82:0/898206230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8494156840 0x7f84941f1480 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:25.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.964+0000 7f849359e700 1 --2- 172.21.15.82:0/898206230 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f849406d830 0x7f84941f0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:25.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.964+0000 7f849359e700 1 --2- 172.21.15.82:0/898206230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f849406d3d0 0x7f84941f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:25.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.964+0000 7f849359e700 1 -- 172.21.15.82:0/898206230 >> 172.21.15.82:0/898206230 conn(0x7f84940cce90 msgr2=0x7f84940af550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:25.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.964+0000 7f849359e700 1 -- 172.21.15.82:0/898206230 shutdown_connections 2023-11-28T13:03:25.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:25.964+0000 7f849359e700 1 -- 172.21.15.82:0/898206230 wait complete. 2023-11-28T13:03:25.969 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 30 2023-11-28T13:03:25.981 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:03:26.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.084+0000 7fd9c8c44700 1 Processor -- start 2023-11-28T13:03:26.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.084+0000 7fd9c8c44700 1 -- start start 2023-11-28T13:03:26.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c8c44700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd9c40b3910 0x7fd9c406b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:26.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c8c44700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd9c406c910 0x7fd9c406d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:26.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c8c44700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c406c480 con 0x7fd9c4070070 2023-11-28T13:03:26.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c8c44700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c406dbe0 con 0x7fd9c406c910 2023-11-28T13:03:26.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c8c44700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c406dec0 con 0x7fd9c40b3910 2023-11-28T13:03:26.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c2ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd9c406c910 0x7fd9c406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:26.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c2ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd9c406c910 0x7fd9c406d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58830/0 (socket says 172.21.15.82:58830) 2023-11-28T13:03:26.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c2ffd700 1 -- 172.21.15.82:0/1567771447 learned_addr learned my addr 172.21.15.82:0/1567771447 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:26.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c2ffd700 1 -- 172.21.15.82:0/1567771447 >> v2:172.21.15.114:3300/0 conn(0x7fd9c40b3910 msgr2=0x7fd9c406b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:26.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c2ffd700 1 --2- 172.21.15.82:0/1567771447 >> v2:172.21.15.114:3300/0 conn(0x7fd9c40b3910 0x7fd9c406b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c2ffd700 1 -- 172.21.15.82:0/1567771447 >> v1:172.21.15.114:6789/0 conn(0x7fd9c4070070 legacy=0x7fd9c4070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:26.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c2ffd700 1 -- 172.21.15.82:0/1567771447 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c406c110 con 0x7fd9c406c910 2023-11-28T13:03:26.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c2ffd700 1 --2- 172.21.15.82:0/1567771447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9c406c910 0x7fd9c406d320 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40cf630 tx=0x7fd9bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc031ab1ef9deaa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:26.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c27fc700 1 -- 172.21.15.82:0/1567771447 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc00e070 con 0x7fd9c406c910 2023-11-28T13:03:26.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c27fc700 1 -- 172.21.15.82:0/1567771447 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9bc003a40 con 0x7fd9c406c910 2023-11-28T13:03:26.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c27fc700 1 -- 172.21.15.82:0/1567771447 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc003df0 con 0x7fd9c406c910 2023-11-28T13:03:26.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c8c44700 1 -- 172.21.15.82:0/1567771447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9c406c910 msgr2=0x7fd9c406d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:26.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c8c44700 1 --2- 172.21.15.82:0/1567771447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9c406c910 0x7fd9c406d320 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40cf630 tx=0x7fd9bc00b330 comp rx=0 tx=0).stop 2023-11-28T13:03:26.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c8c44700 1 -- 172.21.15.82:0/1567771447 shutdown_connections 2023-11-28T13:03:26.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c8c44700 1 --2- 172.21.15.82:0/1567771447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9c406c910 0x7fd9c406d320 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c8c44700 1 --2- 172.21.15.82:0/1567771447 >> v2:172.21.15.114:3300/0 conn(0x7fd9c40b3910 0x7fd9c406b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c8c44700 1 -- 172.21.15.82:0/1567771447 >> 172.21.15.82:0/1567771447 conn(0x7fd9c40ce600 msgr2=0x7fd9c40ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:26.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c8c44700 1 -- 172.21.15.82:0/1567771447 shutdown_connections 2023-11-28T13:03:26.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c8c44700 1 -- 172.21.15.82:0/1567771447 wait complete. 2023-11-28T13:03:26.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c8c44700 1 Processor -- start 2023-11-28T13:03:26.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.088+0000 7fd9c8c44700 1 -- start start 2023-11-28T13:03:26.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c8c44700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9c406c910 0x7fd9c40b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:26.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c8c44700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c4070070 0x7fd9c4154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:26.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c8c44700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9c40b3910 0x7fd9c415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:26.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c8c44700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c40c56d0 con 0x7fd9c40b3910 2023-11-28T13:03:26.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c8c44700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c40c8440 con 0x7fd9c4070070 2023-11-28T13:03:26.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c8c44700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c40c5920 con 0x7fd9c406c910 2023-11-28T13:03:26.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9c40b3910 0x7fd9c415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:26.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9c40b3910 0x7fd9c415acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58846/0 (socket says 172.21.15.82:58846) 2023-11-28T13:03:26.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c3fff700 1 -- 172.21.15.82:0/3828008232 learned_addr learned my addr 172.21.15.82:0/3828008232 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:26.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c2ffd700 1 --2- 172.21.15.82:0/3828008232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c4070070 0x7fd9c4154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:26.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c37fe700 1 --2- 172.21.15.82:0/3828008232 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9c406c910 0x7fd9c40b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:26.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c3fff700 1 -- 172.21.15.82:0/3828008232 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9c406c910 msgr2=0x7fd9c40b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:26.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c3fff700 1 --2- 172.21.15.82:0/3828008232 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9c406c910 0x7fd9c40b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c3fff700 1 -- 172.21.15.82:0/3828008232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c4070070 msgr2=0x7fd9c4154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:26.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c3fff700 1 --2- 172.21.15.82:0/3828008232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c4070070 0x7fd9c4154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c3fff700 1 -- 172.21.15.82:0/3828008232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9bc009b30 con 0x7fd9c40b3910 2023-11-28T13:03:26.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c2ffd700 1 --2- 172.21.15.82:0/3828008232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c4070070 0x7fd9c4154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:03:26.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c37fe700 1 --2- 172.21.15.82:0/3828008232 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9c406c910 0x7fd9c40b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:03:26.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c3fff700 1 --2- 172.21.15.82:0/3828008232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9c40b3910 0x7fd9c415acd0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400c450 tx=0x7fd9b400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:26.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9bbfff700 1 -- 172.21.15.82:0/3828008232 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b40054e0 con 0x7fd9c40b3910 2023-11-28T13:03:26.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9bbfff700 1 -- 172.21.15.82:0/3828008232 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b40036a0 con 0x7fd9c40b3910 2023-11-28T13:03:26.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9bbfff700 1 -- 172.21.15.82:0/3828008232 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4003a50 con 0x7fd9c40b3910 2023-11-28T13:03:26.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c8c44700 1 -- 172.21.15.82:0/3828008232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c406d860 con 0x7fd9c40b3910 2023-11-28T13:03:26.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c8c44700 1 -- 172.21.15.82:0/3828008232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c40c8f80 con 0x7fd9c40b3910 2023-11-28T13:03:26.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.092+0000 7fd9c8c44700 1 -- 172.21.15.82:0/3828008232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c40b3ce0 con 0x7fd9c40b3910 2023-11-28T13:03:26.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.096+0000 7fd9bbfff700 1 -- 172.21.15.82:0/3828008232 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd9b4010070 con 0x7fd9c40b3910 2023-11-28T13:03:26.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.096+0000 7fd9bbfff700 1 --2- 172.21.15.82:0/3828008232 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9a4064ee0 0x7fd9a4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:26.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.096+0000 7fd9bbfff700 1 -- 172.21.15.82:0/3828008232 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd9b4080ff0 con 0x7fd9c40b3910 2023-11-28T13:03:26.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.096+0000 7fd9c37fe700 1 --2- 172.21.15.82:0/3828008232 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9a4064ee0 0x7fd9a4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:26.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.096+0000 7fd9c37fe700 1 --2- 172.21.15.82:0/3828008232 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9a4064ee0 0x7fd9a4067390 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40b0db0 tx=0x7fd9ac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:26.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.100+0000 7fd9bbfff700 1 -- 172.21.15.82:0/3828008232 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd9b404f100 con 0x7fd9c40b3910 2023-11-28T13:03:26.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.264+0000 7fd9c8c44700 1 -- 172.21.15.82:0/3828008232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9c4065fc0 con 0x7fd9c40b3910 2023-11-28T13:03:26.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.264+0000 7fd9bbfff700 1 -- 172.21.15.82:0/3828008232 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+17825 (secure 0 0 0) 0x7fd9b4017020 con 0x7fd9c40b3910 2023-11-28T13:03:26.269 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:26.270 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":65,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:03:23.564158+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:03:21.126074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T13:03:21.545268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:03:26.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.268+0000 7fd9c8c44700 1 -- 172.21.15.82:0/3828008232 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9a4064ee0 msgr2=0x7fd9a4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:26.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.268+0000 7fd9c8c44700 1 --2- 172.21.15.82:0/3828008232 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9a4064ee0 0x7fd9a4067390 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40b0db0 tx=0x7fd9ac008040 comp rx=0 tx=0).stop 2023-11-28T13:03:26.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.268+0000 7fd9c8c44700 1 -- 172.21.15.82:0/3828008232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9c40b3910 msgr2=0x7fd9c415acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:26.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.268+0000 7fd9c8c44700 1 --2- 172.21.15.82:0/3828008232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9c40b3910 0x7fd9c415acd0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400c450 tx=0x7fd9b400c810 comp rx=0 tx=0).stop 2023-11-28T13:03:26.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.268+0000 7fd9c8c44700 1 -- 172.21.15.82:0/3828008232 shutdown_connections 2023-11-28T13:03:26.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.268+0000 7fd9c8c44700 1 --2- 172.21.15.82:0/3828008232 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9a4064ee0 0x7fd9a4067390 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.268+0000 7fd9c8c44700 1 --2- 172.21.15.82:0/3828008232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9c40b3910 0x7fd9c415acd0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.268+0000 7fd9c8c44700 1 --2- 172.21.15.82:0/3828008232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c4070070 0x7fd9c4154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.268+0000 7fd9c8c44700 1 --2- 172.21.15.82:0/3828008232 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9c406c910 0x7fd9c40b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.268+0000 7fd9c8c44700 1 -- 172.21.15.82:0/3828008232 >> 172.21.15.82:0/3828008232 conn(0x7fd9c40ce600 msgr2=0x7fd9c4070440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:26.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.268+0000 7fd9c8c44700 1 -- 172.21.15.82:0/3828008232 shutdown_connections 2023-11-28T13:03:26.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.268+0000 7fd9c8c44700 1 -- 172.21.15.82:0/3828008232 wait complete. 2023-11-28T13:03:26.286 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T13:03:26.286 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:03:26.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.392+0000 7f01aa997700 1 Processor -- start 2023-11-28T13:03:26.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.392+0000 7f01aa997700 1 -- start start 2023-11-28T13:03:26.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.392+0000 7f01aa997700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f01a406b0a0 0x7f01a406d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:26.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.392+0000 7f01aa997700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01a4070070 0x7f01a40704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.392+0000 7f01aa997700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a406c480 con 0x7f01a40b3910 2023-11-28T13:03:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.392+0000 7f01aa997700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a40709f0 con 0x7f01a406b0a0 2023-11-28T13:03:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.392+0000 7f01aa997700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a406dbe0 con 0x7f01a4070070 2023-11-28T13:03:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.392+0000 7f01a9995700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f01a40b3910 0x7f01a406c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55884/0 (socket says 172.21.15.82:55884) 2023-11-28T13:03:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.392+0000 7f01a9995700 1 -- 172.21.15.82:0/3071257455 learned_addr learned my addr 172.21.15.82:0/3071257455 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.392+0000 7f01a9194700 1 --2- 172.21.15.82:0/3071257455 >> v2:172.21.15.82:3300/0 conn(0x7f01a406b0a0 0x7f01a406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.396+0000 7f01aa196700 1 --2- 172.21.15.82:0/3071257455 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01a4070070 0x7f01a40704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:26.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.396+0000 7f01a8993700 1 -- 172.21.15.82:0/3071257455 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229346126 0 0) 0x7f01a406c480 con 0x7f01a40b3910 2023-11-28T13:03:26.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.396+0000 7f01a8993700 1 -- 172.21.15.82:0/3071257455 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01900035d0 con 0x7f01a40b3910 2023-11-28T13:03:26.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.396+0000 7f01a9194700 1 -- 172.21.15.82:0/3071257455 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01a4070070 msgr2=0x7f01a40704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:26.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.396+0000 7f01a9194700 1 --2- 172.21.15.82:0/3071257455 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01a4070070 0x7f01a40704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.396+0000 7f01a9194700 1 -- 172.21.15.82:0/3071257455 >> v1:172.21.15.82:6789/0 conn(0x7f01a40b3910 legacy=0x7f01a406c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:26.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.396+0000 7f01a9194700 1 -- 172.21.15.82:0/3071257455 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a406dec0 con 0x7f01a406b0a0 2023-11-28T13:03:26.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.396+0000 7f01a9194700 1 --2- 172.21.15.82:0/3071257455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a406b0a0 0x7f01a406d320 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f0198009850 tx=0x7f0198009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488944ddb5ec9187 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:26.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.396+0000 7f01a8993700 1 -- 172.21.15.82:0/3071257455 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0198011830 con 0x7f01a406b0a0 2023-11-28T13:03:26.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.396+0000 7f01a8993700 1 -- 172.21.15.82:0/3071257455 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0198011990 con 0x7f01a406b0a0 2023-11-28T13:03:26.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.396+0000 7f01a8993700 1 -- 172.21.15.82:0/3071257455 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0198011d00 con 0x7f01a406b0a0 2023-11-28T13:03:26.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.396+0000 7f01aa997700 1 -- 172.21.15.82:0/3071257455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a406b0a0 msgr2=0x7f01a406d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:26.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.396+0000 7f01aa997700 1 --2- 172.21.15.82:0/3071257455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a406b0a0 0x7f01a406d320 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f0198009850 tx=0x7f0198009b60 comp rx=0 tx=0).stop 2023-11-28T13:03:26.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.396+0000 7f01aa997700 1 -- 172.21.15.82:0/3071257455 shutdown_connections 2023-11-28T13:03:26.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.396+0000 7f01aa997700 1 --2- 172.21.15.82:0/3071257455 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01a4070070 0x7f01a40704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.396+0000 7f01aa997700 1 --2- 172.21.15.82:0/3071257455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a406b0a0 0x7f01a406d320 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.396+0000 7f01aa997700 1 -- 172.21.15.82:0/3071257455 >> 172.21.15.82:0/3071257455 conn(0x7f01a40ce600 msgr2=0x7f01a40ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:26.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.396+0000 7f01aa997700 1 -- 172.21.15.82:0/3071257455 shutdown_connections 2023-11-28T13:03:26.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.396+0000 7f01aa997700 1 -- 172.21.15.82:0/3071257455 wait complete. 2023-11-28T13:03:26.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.400+0000 7f01aa997700 1 Processor -- start 2023-11-28T13:03:26.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.400+0000 7f01aa997700 1 -- start start 2023-11-28T13:03:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.400+0000 7f01aa997700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01a406b0a0 0x7f01a414d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.400+0000 7f01aa997700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a4070070 0x7f01a40ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.400+0000 7f01aa997700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01a40b3910 0x7f01a40ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.400+0000 7f01aa997700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a414a7a0 con 0x7f01a4070070 2023-11-28T13:03:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.400+0000 7f01aa997700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a414d610 con 0x7f01a40b3910 2023-11-28T13:03:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.400+0000 7f01aa997700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a4149b90 con 0x7f01a406b0a0 2023-11-28T13:03:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.404+0000 7f01a9194700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a4070070 0x7f01a40ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.404+0000 7f01a9194700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a4070070 0x7f01a40ae300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58870/0 (socket says 172.21.15.82:58870) 2023-11-28T13:03:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.404+0000 7f01a9194700 1 -- 172.21.15.82:0/1207652030 learned_addr learned my addr 172.21.15.82:0/1207652030 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.404+0000 7f01a9995700 1 --2- 172.21.15.82:0/1207652030 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01a406b0a0 0x7f01a414d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.404+0000 7f01aa196700 1 --2- 172.21.15.82:0/1207652030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01a40b3910 0x7f01a40ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:26.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.404+0000 7f01a9194700 1 -- 172.21.15.82:0/1207652030 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01a406b0a0 msgr2=0x7f01a414d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:26.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.404+0000 7f01a9194700 1 --2- 172.21.15.82:0/1207652030 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01a406b0a0 0x7f01a414d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.404+0000 7f01a9194700 1 -- 172.21.15.82:0/1207652030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01a40b3910 msgr2=0x7f01a40ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:26.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.404+0000 7f01a9194700 1 --2- 172.21.15.82:0/1207652030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01a40b3910 0x7f01a40ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.404+0000 7f01a9194700 1 -- 172.21.15.82:0/1207652030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01980094b0 con 0x7f01a4070070 2023-11-28T13:03:26.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.404+0000 7f01a9194700 1 --2- 172.21.15.82:0/1207652030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a4070070 0x7f01a40ae300 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f01a40717f0 tx=0x7f0198004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:26.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.404+0000 7f01967fc700 1 -- 172.21.15.82:0/1207652030 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01980044d0 con 0x7f01a4070070 2023-11-28T13:03:26.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.404+0000 7f01967fc700 1 -- 172.21.15.82:0/1207652030 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019801f070 con 0x7f01a4070070 2023-11-28T13:03:26.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.404+0000 7f01aa997700 1 -- 172.21.15.82:0/1207652030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a40c8f80 con 0x7f01a4070070 2023-11-28T13:03:26.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.404+0000 7f01967fc700 1 -- 172.21.15.82:0/1207652030 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0198003900 con 0x7f01a4070070 2023-11-28T13:03:26.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.404+0000 7f01aa997700 1 -- 172.21.15.82:0/1207652030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a406c110 con 0x7f01a4070070 2023-11-28T13:03:26.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.404+0000 7f01aa997700 1 -- 172.21.15.82:0/1207652030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a406d860 con 0x7f01a4070070 2023-11-28T13:03:26.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.408+0000 7f01967fc700 1 -- 172.21.15.82:0/1207652030 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f019800f050 con 0x7f01a4070070 2023-11-28T13:03:26.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.408+0000 7f01967fc700 1 --2- 172.21.15.82:0/1207652030 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0188064ee0 0x7f0188067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:26.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.408+0000 7f01967fc700 1 -- 172.21.15.82:0/1207652030 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0198021070 con 0x7f01a4070070 2023-11-28T13:03:26.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.408+0000 7f01a9995700 1 --2- 172.21.15.82:0/1207652030 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0188064ee0 0x7f0188067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:26.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.408+0000 7f01a9995700 1 --2- 172.21.15.82:0/1207652030 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0188064ee0 0x7f0188067390 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f01a0007fd0 tx=0x7f01a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:26.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.412+0000 7f01967fc700 1 -- 172.21.15.82:0/1207652030 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0198051750 con 0x7f01a4070070 2023-11-28T13:03:26.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.568+0000 7f01aa997700 1 -- 172.21.15.82:0/1207652030 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f01a4065fc0 con 0x7f0188064ee0 2023-11-28T13:03:26.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.584+0000 7f01967fc700 1 -- 172.21.15.82:0/1207652030 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309906 (secure 0 0 0) 0x7f01a4065fc0 con 0x7f0188064ee0 2023-11-28T13:03:26.591 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:26.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.588+0000 7f01aa997700 1 -- 172.21.15.82:0/1207652030 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0188064ee0 msgr2=0x7f0188067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:26.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.588+0000 7f01aa997700 1 --2- 172.21.15.82:0/1207652030 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0188064ee0 0x7f0188067390 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f01a0007fd0 tx=0x7f01a0009040 comp rx=0 tx=0).stop 2023-11-28T13:03:26.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.588+0000 7f01aa997700 1 -- 172.21.15.82:0/1207652030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a4070070 msgr2=0x7f01a40ae300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:26.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.588+0000 7f01aa997700 1 --2- 172.21.15.82:0/1207652030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a4070070 0x7f01a40ae300 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f01a40717f0 tx=0x7f0198004770 comp rx=0 tx=0).stop 2023-11-28T13:03:26.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.588+0000 7f01aa997700 1 -- 172.21.15.82:0/1207652030 shutdown_connections 2023-11-28T13:03:26.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.588+0000 7f01aa997700 1 --2- 172.21.15.82:0/1207652030 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0188064ee0 0x7f0188067390 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.588+0000 7f01aa997700 1 --2- 172.21.15.82:0/1207652030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01a40b3910 0x7f01a40ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.588+0000 7f01aa997700 1 --2- 172.21.15.82:0/1207652030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a4070070 0x7f01a40ae300 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.588+0000 7f01aa997700 1 --2- 172.21.15.82:0/1207652030 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01a406b0a0 0x7f01a414d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.588+0000 7f01aa997700 1 -- 172.21.15.82:0/1207652030 >> 172.21.15.82:0/1207652030 conn(0x7f01a40ce600 msgr2=0x7f01a4159a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:26.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.588+0000 7f01aa997700 1 -- 172.21.15.82:0/1207652030 shutdown_connections 2023-11-28T13:03:26.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.588+0000 7f01aa997700 1 -- 172.21.15.82:0/1207652030 wait complete. 2023-11-28T13:03:26.597 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:03:26.606 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2023-11-28T13:03:25.217179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":87072,"kb_used_data":7264,"kb_used_omap":0,"kb_used_meta":79744,"kb_avail":754887648,"statfs":{"total":773094113280,"available":773004951552,"internally_reserved":0,"allocated":7438336,"data_stored":3905894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81657856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.035813"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.603161+0000","last_change":"2023-11-28T13:03:22.599636+0000","last_active":"2023-11-28T13:03:22.603161+0000","last_peered":"2023-11-28T13:03:22.603161+0000","last_clean":"2023-11-28T13:03:22.603161+0000","last_became_active":"2023-11-28T13:03:22.599429+0000","last_became_peered":"2023-11-28T13:03:22.599429+0000","last_unstale":"2023-11-28T13:03:22.603161+0000","last_undegraded":"2023-11-28T13:03:22.603161+0000","last_fullsized":"2023-11-28T13:03:22.603161+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:53:03.697888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.593959+0000","last_change":"2023-11-28T13:03:22.592842+0000","last_active":"2023-11-28T13:03:22.593959+0000","last_peered":"2023-11-28T13:03:22.593959+0000","last_clean":"2023-11-28T13:03:22.593959+0000","last_became_active":"2023-11-28T13:03:22.592588+0000","last_became_peered":"2023-11-28T13:03:22.592588+0000","last_unstale":"2023-11-28T13:03:22.593959+0000","last_undegraded":"2023-11-28T13:03:22.593959+0000","last_fullsized":"2023-11-28T13:03:22.593959+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:14:13.736222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583552+0000","last_change":"2023-11-28T13:03:22.593246+0000","last_active":"2023-11-28T13:03:23.583552+0000","last_peered":"2023-11-28T13:03:23.583552+0000","last_clean":"2023-11-28T13:03:23.583552+0000","last_became_active":"2023-11-28T13:03:22.590495+0000","last_became_peered":"2023-11-28T13:03:22.590495+0000","last_unstale":"2023-11-28T13:03:23.583552+0000","last_undegraded":"2023-11-28T13:03:23.583552+0000","last_fullsized":"2023-11-28T13:03:23.583552+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:03.750408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.582286+0000","last_change":"2023-11-28T13:03:22.588889+0000","last_active":"2023-11-28T13:03:23.582286+0000","last_peered":"2023-11-28T13:03:23.582286+0000","last_clean":"2023-11-28T13:03:23.582286+0000","last_became_active":"2023-11-28T13:03:22.588508+0000","last_became_peered":"2023-11-28T13:03:22.588508+0000","last_unstale":"2023-11-28T13:03:23.582286+0000","last_undegraded":"2023-11-28T13:03:23.582286+0000","last_fullsized":"2023-11-28T13:03:23.582286+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:07.686565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.602384+0000","last_change":"2023-11-28T13:03:22.600382+0000","last_active":"2023-11-28T13:03:22.602384+0000","last_peered":"2023-11-28T13:03:22.602384+0000","last_clean":"2023-11-28T13:03:22.602384+0000","last_became_active":"2023-11-28T13:03:22.600121+0000","last_became_peered":"2023-11-28T13:03:22.600121+0000","last_unstale":"2023-11-28T13:03:22.602384+0000","last_undegraded":"2023-11-28T13:03:22.602384+0000","last_fullsized":"2023-11-28T13:03:22.602384+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:28.476098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.579911+0000","last_change":"2023-11-28T13:03:22.591388+0000","last_active":"2023-11-28T13:03:23.579911+0000","last_peered":"2023-11-28T13:03:23.579911+0000","last_clean":"2023-11-28T13:03:23.579911+0000","last_became_active":"2023-11-28T13:03:22.590991+0000","last_became_peered":"2023-11-28T13:03:22.590991+0000","last_unstale":"2023-11-28T13:03:23.579911+0000","last_undegraded":"2023-11-28T13:03:23.579911+0000","last_fullsized":"2023-11-28T13:03:23.579911+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:56:01.463549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.593807+0000","last_change":"2023-11-28T13:03:22.590973+0000","last_active":"2023-11-28T13:03:22.593807+0000","last_peered":"2023-11-28T13:03:22.593807+0000","last_clean":"2023-11-28T13:03:22.593807+0000","last_became_active":"2023-11-28T13:03:22.590656+0000","last_became_peered":"2023-11-28T13:03:22.590656+0000","last_unstale":"2023-11-28T13:03:22.593807+0000","last_undegraded":"2023-11-28T13:03:22.593807+0000","last_fullsized":"2023-11-28T13:03:22.593807+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:58:38.332925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.602677+0000","last_change":"2023-11-28T13:03:22.600614+0000","last_active":"2023-11-28T13:03:22.602677+0000","last_peered":"2023-11-28T13:03:22.602677+0000","last_clean":"2023-11-28T13:03:22.602677+0000","last_became_active":"2023-11-28T13:03:22.600349+0000","last_became_peered":"2023-11-28T13:03:22.600349+0000","last_unstale":"2023-11-28T13:03:22.602677+0000","last_undegraded":"2023-11-28T13:03:22.602677+0000","last_fullsized":"2023-11-28T13:03:22.602677+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:08.354045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.584006+0000","last_change":"2023-11-28T13:03:22.593144+0000","last_active":"2023-11-28T13:03:23.584006+0000","last_peered":"2023-11-28T13:03:23.584006+0000","last_clean":"2023-11-28T13:03:23.584006+0000","last_became_active":"2023-11-28T13:03:22.590281+0000","last_became_peered":"2023-11-28T13:03:22.590281+0000","last_unstale":"2023-11-28T13:03:23.584006+0000","last_undegraded":"2023-11-28T13:03:23.584006+0000","last_fullsized":"2023-11-28T13:03:23.584006+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:07:36.130795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583796+0000","last_change":"2023-11-28T13:03:22.593551+0000","last_active":"2023-11-28T13:03:23.583796+0000","last_peered":"2023-11-28T13:03:23.583796+0000","last_clean":"2023-11-28T13:03:23.583796+0000","last_became_active":"2023-11-28T13:03:22.593262+0000","last_became_peered":"2023-11-28T13:03:22.593262+0000","last_unstale":"2023-11-28T13:03:23.583796+0000","last_undegraded":"2023-11-28T13:03:23.583796+0000","last_fullsized":"2023-11-28T13:03:23.583796+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:27:39.383767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.582302+0000","last_change":"2023-11-28T13:03:22.586158+0000","last_active":"2023-11-28T13:03:23.582302+0000","last_peered":"2023-11-28T13:03:23.582302+0000","last_clean":"2023-11-28T13:03:23.582302+0000","last_became_active":"2023-11-28T13:03:22.585874+0000","last_became_peered":"2023-11-28T13:03:22.585874+0000","last_unstale":"2023-11-28T13:03:23.582302+0000","last_undegraded":"2023-11-28T13:03:23.582302+0000","last_fullsized":"2023-11-28T13:03:23.582302+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:39:04.918336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.602661+0000","last_change":"2023-11-28T13:03:22.600590+0000","last_active":"2023-11-28T13:03:22.602661+0000","last_peered":"2023-11-28T13:03:22.602661+0000","last_clean":"2023-11-28T13:03:22.602661+0000","last_became_active":"2023-11-28T13:03:22.600069+0000","last_became_peered":"2023-11-28T13:03:22.600069+0000","last_unstale":"2023-11-28T13:03:22.602661+0000","last_undegraded":"2023-11-28T13:03:22.602661+0000","last_fullsized":"2023-11-28T13:03:22.602661+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:25.321574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.602767+0000","last_change":"2023-11-28T13:03:22.601334+0000","last_active":"2023-11-28T13:03:22.602767+0000","last_peered":"2023-11-28T13:03:22.602767+0000","last_clean":"2023-11-28T13:03:22.602767+0000","last_became_active":"2023-11-28T13:03:22.600196+0000","last_became_peered":"2023-11-28T13:03:22.600196+0000","last_unstale":"2023-11-28T13:03:22.602767+0000","last_undegraded":"2023-11-28T13:03:22.602767+0000","last_fullsized":"2023-11-28T13:03:22.602767+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:39:04.918336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583286+0000","last_change":"2023-11-28T13:03:22.590003+0000","last_active":"2023-11-28T13:03:23.583286+0000","last_peered":"2023-11-28T13:03:23.583286+0000","last_clean":"2023-11-28T13:03:23.583286+0000","last_became_active":"2023-11-28T13:03:22.589486+0000","last_became_peered":"2023-11-28T13:03:22.589486+0000","last_unstale":"2023-11-28T13:03:23.583286+0000","last_undegraded":"2023-11-28T13:03:23.583286+0000","last_fullsized":"2023-11-28T13:03:23.583286+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:19.482655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583287+0000","last_change":"2023-11-28T13:03:22.590275+0000","last_active":"2023-11-28T13:03:23.583287+0000","last_peered":"2023-11-28T13:03:23.583287+0000","last_clean":"2023-11-28T13:03:23.583287+0000","last_became_active":"2023-11-28T13:03:22.589610+0000","last_became_peered":"2023-11-28T13:03:22.589610+0000","last_unstale":"2023-11-28T13:03:23.583287+0000","last_undegraded":"2023-11-28T13:03:23.583287+0000","last_fullsized":"2023-11-28T13:03:23.583287+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:57.330263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.605842+0000","last_change":"2023-11-28T13:03:22.600952+0000","last_active":"2023-11-28T13:03:22.605842+0000","last_peered":"2023-11-28T13:03:22.605842+0000","last_clean":"2023-11-28T13:03:22.605842+0000","last_became_active":"2023-11-28T13:03:22.600751+0000","last_became_peered":"2023-11-28T13:03:22.600751+0000","last_unstale":"2023-11-28T13:03:22.605842+0000","last_undegraded":"2023-11-28T13:03:22.605842+0000","last_fullsized":"2023-11-28T13:03:22.605842+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:48.846102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.592465+0000","last_change":"2023-11-28T13:03:22.588027+0000","last_active":"2023-11-28T13:03:22.592465+0000","last_peered":"2023-11-28T13:03:22.592465+0000","last_clean":"2023-11-28T13:03:22.592465+0000","last_became_active":"2023-11-28T13:03:22.587788+0000","last_became_peered":"2023-11-28T13:03:22.587788+0000","last_unstale":"2023-11-28T13:03:22.592465+0000","last_undegraded":"2023-11-28T13:03:22.592465+0000","last_fullsized":"2023-11-28T13:03:22.592465+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:11.497698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.582474+0000","last_change":"2023-11-28T13:03:22.588361+0000","last_active":"2023-11-28T13:03:23.582474+0000","last_peered":"2023-11-28T13:03:23.582474+0000","last_clean":"2023-11-28T13:03:23.582474+0000","last_became_active":"2023-11-28T13:03:22.588012+0000","last_became_peered":"2023-11-28T13:03:22.588012+0000","last_unstale":"2023-11-28T13:03:23.582474+0000","last_undegraded":"2023-11-28T13:03:23.582474+0000","last_fullsized":"2023-11-28T13:03:23.582474+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:25.321574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.595418+0000","last_change":"2023-11-28T13:03:22.592356+0000","last_active":"2023-11-28T13:03:22.595418+0000","last_peered":"2023-11-28T13:03:22.595418+0000","last_clean":"2023-11-28T13:03:22.595418+0000","last_became_active":"2023-11-28T13:03:22.592107+0000","last_became_peered":"2023-11-28T13:03:22.592107+0000","last_unstale":"2023-11-28T13:03:22.595418+0000","last_undegraded":"2023-11-28T13:03:22.595418+0000","last_fullsized":"2023-11-28T13:03:22.595418+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:42:28.513490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.593203+0000","last_change":"2023-11-28T13:03:22.587139+0000","last_active":"2023-11-28T13:03:22.593203+0000","last_peered":"2023-11-28T13:03:22.593203+0000","last_clean":"2023-11-28T13:03:22.593203+0000","last_became_active":"2023-11-28T13:03:22.586858+0000","last_became_peered":"2023-11-28T13:03:22.586858+0000","last_unstale":"2023-11-28T13:03:22.593203+0000","last_undegraded":"2023-11-28T13:03:22.593203+0000","last_fullsized":"2023-11-28T13:03:22.593203+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:10.992345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.599080+0000","last_change":"2023-11-28T13:03:22.592952+0000","last_active":"2023-11-28T13:03:22.599080+0000","last_peered":"2023-11-28T13:03:22.599080+0000","last_clean":"2023-11-28T13:03:22.599080+0000","last_became_active":"2023-11-28T13:03:22.592688+0000","last_became_peered":"2023-11-28T13:03:22.592688+0000","last_unstale":"2023-11-28T13:03:22.599080+0000","last_undegraded":"2023-11-28T13:03:22.599080+0000","last_fullsized":"2023-11-28T13:03:22.599080+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:35:54.250623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.594371+0000","last_change":"2023-11-28T13:03:22.590374+0000","last_active":"2023-11-28T13:03:22.594371+0000","last_peered":"2023-11-28T13:03:22.594371+0000","last_clean":"2023-11-28T13:03:22.594371+0000","last_became_active":"2023-11-28T13:03:22.589955+0000","last_became_peered":"2023-11-28T13:03:22.589955+0000","last_unstale":"2023-11-28T13:03:22.594371+0000","last_undegraded":"2023-11-28T13:03:22.594371+0000","last_fullsized":"2023-11-28T13:03:22.594371+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:09.527183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.582213+0000","last_change":"2023-11-28T13:03:22.578789+0000","last_active":"2023-11-28T13:03:22.582213+0000","last_peered":"2023-11-28T13:03:22.582213+0000","last_clean":"2023-11-28T13:03:22.582213+0000","last_became_active":"2023-11-28T13:03:22.578572+0000","last_became_peered":"2023-11-28T13:03:22.578572+0000","last_unstale":"2023-11-28T13:03:22.582213+0000","last_undegraded":"2023-11-28T13:03:22.582213+0000","last_fullsized":"2023-11-28T13:03:22.582213+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:56:01.463549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.582823+0000","last_change":"2023-11-28T13:03:22.590471+0000","last_active":"2023-11-28T13:03:23.582823+0000","last_peered":"2023-11-28T13:03:23.582823+0000","last_clean":"2023-11-28T13:03:23.582823+0000","last_became_active":"2023-11-28T13:03:22.589589+0000","last_became_peered":"2023-11-28T13:03:22.589589+0000","last_unstale":"2023-11-28T13:03:23.582823+0000","last_undegraded":"2023-11-28T13:03:23.582823+0000","last_fullsized":"2023-11-28T13:03:23.582823+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:44.960111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.601558+0000","last_change":"2023-11-28T13:03:22.599082+0000","last_active":"2023-11-28T13:03:22.601558+0000","last_peered":"2023-11-28T13:03:22.601558+0000","last_clean":"2023-11-28T13:03:22.601558+0000","last_became_active":"2023-11-28T13:03:22.598797+0000","last_became_peered":"2023-11-28T13:03:22.598797+0000","last_unstale":"2023-11-28T13:03:22.601558+0000","last_undegraded":"2023-11-28T13:03:22.601558+0000","last_fullsized":"2023-11-28T13:03:22.601558+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:07.686565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.598209+0000","last_change":"2023-11-28T13:03:22.591217+0000","last_active":"2023-11-28T13:03:22.598209+0000","last_peered":"2023-11-28T13:03:22.598209+0000","last_clean":"2023-11-28T13:03:22.598209+0000","last_became_active":"2023-11-28T13:03:22.590743+0000","last_became_peered":"2023-11-28T13:03:22.590743+0000","last_unstale":"2023-11-28T13:03:22.598209+0000","last_undegraded":"2023-11-28T13:03:22.598209+0000","last_fullsized":"2023-11-28T13:03:22.598209+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:07:36.130795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.582426+0000","last_change":"2023-11-28T13:03:22.591684+0000","last_active":"2023-11-28T13:03:23.582426+0000","last_peered":"2023-11-28T13:03:23.582426+0000","last_clean":"2023-11-28T13:03:23.582426+0000","last_became_active":"2023-11-28T13:03:22.590910+0000","last_became_peered":"2023-11-28T13:03:22.590910+0000","last_unstale":"2023-11-28T13:03:23.582426+0000","last_undegraded":"2023-11-28T13:03:23.582426+0000","last_fullsized":"2023-11-28T13:03:23.582426+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:53:03.697888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.592119+0000","last_change":"2023-11-28T13:03:22.587975+0000","last_active":"2023-11-28T13:03:22.592119+0000","last_peered":"2023-11-28T13:03:22.592119+0000","last_clean":"2023-11-28T13:03:22.592119+0000","last_became_active":"2023-11-28T13:03:22.587411+0000","last_became_peered":"2023-11-28T13:03:22.587411+0000","last_unstale":"2023-11-28T13:03:22.592119+0000","last_undegraded":"2023-11-28T13:03:22.592119+0000","last_fullsized":"2023-11-28T13:03:22.592119+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:33:42.883651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583570+0000","last_change":"2023-11-28T13:03:22.590129+0000","last_active":"2023-11-28T13:03:23.583570+0000","last_peered":"2023-11-28T13:03:23.583570+0000","last_clean":"2023-11-28T13:03:23.583570+0000","last_became_active":"2023-11-28T13:03:22.589704+0000","last_became_peered":"2023-11-28T13:03:22.589704+0000","last_unstale":"2023-11-28T13:03:23.583570+0000","last_undegraded":"2023-11-28T13:03:23.583570+0000","last_fullsized":"2023-11-28T13:03:23.583570+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:25.321574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.601759+0000","last_change":"2023-11-28T13:03:22.599704+0000","last_active":"2023-11-28T13:03:22.601759+0000","last_peered":"2023-11-28T13:03:22.601759+0000","last_clean":"2023-11-28T13:03:22.601759+0000","last_became_active":"2023-11-28T13:03:22.599426+0000","last_became_peered":"2023-11-28T13:03:22.599426+0000","last_unstale":"2023-11-28T13:03:22.601759+0000","last_undegraded":"2023-11-28T13:03:22.601759+0000","last_fullsized":"2023-11-28T13:03:22.601759+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:19.482655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.581604+0000","last_change":"2023-11-28T13:03:22.583866+0000","last_active":"2023-11-28T13:03:23.581604+0000","last_peered":"2023-11-28T13:03:23.581604+0000","last_clean":"2023-11-28T13:03:23.581604+0000","last_became_active":"2023-11-28T13:03:22.583538+0000","last_became_peered":"2023-11-28T13:03:22.583538+0000","last_unstale":"2023-11-28T13:03:23.581604+0000","last_undegraded":"2023-11-28T13:03:23.581604+0000","last_fullsized":"2023-11-28T13:03:23.581604+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:11:17.241400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.579306+0000","last_change":"2023-11-28T13:03:22.586489+0000","last_active":"2023-11-28T13:03:23.579306+0000","last_peered":"2023-11-28T13:03:23.579306+0000","last_clean":"2023-11-28T13:03:23.579306+0000","last_became_active":"2023-11-28T13:03:22.585975+0000","last_became_peered":"2023-11-28T13:03:22.585975+0000","last_unstale":"2023-11-28T13:03:23.579306+0000","last_undegraded":"2023-11-28T13:03:23.579306+0000","last_fullsized":"2023-11-28T13:03:23.579306+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:50.289538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.598516+0000","last_change":"2023-11-28T13:03:22.593625+0000","last_active":"2023-11-28T13:03:22.598516+0000","last_peered":"2023-11-28T13:03:22.598516+0000","last_clean":"2023-11-28T13:03:22.598516+0000","last_became_active":"2023-11-28T13:03:22.593347+0000","last_became_peered":"2023-11-28T13:03:22.593347+0000","last_unstale":"2023-11-28T13:03:22.598516+0000","last_undegraded":"2023-11-28T13:03:22.598516+0000","last_fullsized":"2023-11-28T13:03:22.598516+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:31:42.081976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"64'4","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.599185+0000","last_change":"2023-11-28T13:03:22.217911+0000","last_active":"2023-11-28T13:03:22.599185+0000","last_peered":"2023-11-28T13:03:22.599185+0000","last_clean":"2023-11-28T13:03:22.599185+0000","last_became_active":"2023-11-28T13:03:22.217281+0000","last_became_peered":"2023-11-28T13:03:22.217281+0000","last_unstale":"2023-11-28T13:03:22.599185+0000","last_undegraded":"2023-11-28T13:03:22.599185+0000","last_fullsized":"2023-11-28T13:03:22.599185+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:26:14.756184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.582540+0000","last_change":"2023-11-28T13:03:22.594715+0000","last_active":"2023-11-28T13:03:23.582540+0000","last_peered":"2023-11-28T13:03:23.582540+0000","last_clean":"2023-11-28T13:03:23.582540+0000","last_became_active":"2023-11-28T13:03:22.594193+0000","last_became_peered":"2023-11-28T13:03:22.594193+0000","last_unstale":"2023-11-28T13:03:23.582540+0000","last_undegraded":"2023-11-28T13:03:23.582540+0000","last_fullsized":"2023-11-28T13:03:23.582540+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:35:54.250623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"64'1","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.579967+0000","last_change":"2023-11-28T13:03:22.216924+0000","last_active":"2023-11-28T13:03:23.579967+0000","last_peered":"2023-11-28T13:03:23.579967+0000","last_clean":"2023-11-28T13:03:23.579967+0000","last_became_active":"2023-11-28T13:03:22.216620+0000","last_became_peered":"2023-11-28T13:03:22.216620+0000","last_unstale":"2023-11-28T13:03:23.579967+0000","last_undegraded":"2023-11-28T13:03:23.579967+0000","last_fullsized":"2023-11-28T13:03:23.579967+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:13.038263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.579908+0000","last_change":"2023-11-28T13:03:22.586436+0000","last_active":"2023-11-28T13:03:23.579908+0000","last_peered":"2023-11-28T13:03:23.579908+0000","last_clean":"2023-11-28T13:03:23.579908+0000","last_became_active":"2023-11-28T13:03:22.586158+0000","last_became_peered":"2023-11-28T13:03:22.586158+0000","last_unstale":"2023-11-28T13:03:23.579908+0000","last_undegraded":"2023-11-28T13:03:23.579908+0000","last_fullsized":"2023-11-28T13:03:23.579908+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:09.527183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.579893+0000","last_change":"2023-11-28T13:03:22.218179+0000","last_active":"2023-11-28T13:03:23.579893+0000","last_peered":"2023-11-28T13:03:23.579893+0000","last_clean":"2023-11-28T13:03:23.579893+0000","last_became_active":"2023-11-28T13:03:22.217858+0000","last_became_peered":"2023-11-28T13:03:22.217858+0000","last_unstale":"2023-11-28T13:03:23.579893+0000","last_undegraded":"2023-11-28T13:03:23.579893+0000","last_fullsized":"2023-11-28T13:03:23.579893+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:41:57.907090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583908+0000","last_change":"2023-11-28T13:03:22.590260+0000","last_active":"2023-11-28T13:03:23.583908+0000","last_peered":"2023-11-28T13:03:23.583908+0000","last_clean":"2023-11-28T13:03:23.583908+0000","last_became_active":"2023-11-28T13:03:22.589920+0000","last_became_peered":"2023-11-28T13:03:22.589920+0000","last_unstale":"2023-11-28T13:03:23.583908+0000","last_undegraded":"2023-11-28T13:03:23.583908+0000","last_fullsized":"2023-11-28T13:03:23.583908+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:14.042779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.580021+0000","last_change":"2023-11-28T13:03:22.220912+0000","last_active":"2023-11-28T13:03:23.580021+0000","last_peered":"2023-11-28T13:03:23.580021+0000","last_clean":"2023-11-28T13:03:23.580021+0000","last_became_active":"2023-11-28T13:03:22.220603+0000","last_became_peered":"2023-11-28T13:03:22.220603+0000","last_unstale":"2023-11-28T13:03:23.580021+0000","last_undegraded":"2023-11-28T13:03:23.580021+0000","last_fullsized":"2023-11-28T13:03:23.580021+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:27:38.379252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.587592+0000","last_change":"2023-11-28T13:03:22.581285+0000","last_active":"2023-11-28T13:03:22.587592+0000","last_peered":"2023-11-28T13:03:22.587592+0000","last_clean":"2023-11-28T13:03:22.587592+0000","last_became_active":"2023-11-28T13:03:22.580830+0000","last_became_peered":"2023-11-28T13:03:22.580830+0000","last_unstale":"2023-11-28T13:03:22.587592+0000","last_undegraded":"2023-11-28T13:03:22.587592+0000","last_fullsized":"2023-11-28T13:03:22.587592+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:11:08.383772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.592182+0000","last_change":"2023-11-28T13:03:22.213936+0000","last_active":"2023-11-28T13:03:22.592182+0000","last_peered":"2023-11-28T13:03:22.592182+0000","last_clean":"2023-11-28T13:03:22.592182+0000","last_became_active":"2023-11-28T13:03:22.213398+0000","last_became_peered":"2023-11-28T13:03:22.213398+0000","last_unstale":"2023-11-28T13:03:22.592182+0000","last_undegraded":"2023-11-28T13:03:22.592182+0000","last_fullsized":"2023-11-28T13:03:22.592182+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:13.038263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.593330+0000","last_change":"2023-11-28T13:03:22.590765+0000","last_active":"2023-11-28T13:03:22.593330+0000","last_peered":"2023-11-28T13:03:22.593330+0000","last_clean":"2023-11-28T13:03:22.593330+0000","last_became_active":"2023-11-28T13:03:22.590398+0000","last_became_peered":"2023-11-28T13:03:22.590398+0000","last_unstale":"2023-11-28T13:03:22.593330+0000","last_undegraded":"2023-11-28T13:03:22.593330+0000","last_fullsized":"2023-11-28T13:03:22.593330+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:42.379047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.589109+0000","last_change":"2023-11-28T13:03:22.209057+0000","last_active":"2023-11-28T13:03:22.589109+0000","last_peered":"2023-11-28T13:03:22.589109+0000","last_clean":"2023-11-28T13:03:22.589109+0000","last_became_active":"2023-11-28T13:03:22.208757+0000","last_became_peered":"2023-11-28T13:03:22.208757+0000","last_unstale":"2023-11-28T13:03:22.589109+0000","last_undegraded":"2023-11-28T13:03:22.589109+0000","last_fullsized":"2023-11-28T13:03:22.589109+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:28:31.792152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.599859+0000","last_change":"2023-11-28T13:03:22.596917+0000","last_active":"2023-11-28T13:03:22.599859+0000","last_peered":"2023-11-28T13:03:22.599859+0000","last_clean":"2023-11-28T13:03:22.599859+0000","last_became_active":"2023-11-28T13:03:22.596638+0000","last_became_peered":"2023-11-28T13:03:22.596638+0000","last_unstale":"2023-11-28T13:03:22.599859+0000","last_undegraded":"2023-11-28T13:03:22.599859+0000","last_fullsized":"2023-11-28T13:03:22.599859+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:17:53.618520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.572139+0000","last_change":"2023-11-28T13:03:22.215095+0000","last_active":"2023-11-28T13:03:22.572139+0000","last_peered":"2023-11-28T13:03:22.572139+0000","last_clean":"2023-11-28T13:03:22.572139+0000","last_became_active":"2023-11-28T13:03:22.214252+0000","last_became_peered":"2023-11-28T13:03:22.214252+0000","last_unstale":"2023-11-28T13:03:22.572139+0000","last_undegraded":"2023-11-28T13:03:22.572139+0000","last_fullsized":"2023-11-28T13:03:22.572139+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:27:38.379252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.593275+0000","last_change":"2023-11-28T13:03:22.587443+0000","last_active":"2023-11-28T13:03:22.593275+0000","last_peered":"2023-11-28T13:03:22.593275+0000","last_clean":"2023-11-28T13:03:22.593275+0000","last_became_active":"2023-11-28T13:03:22.587175+0000","last_became_peered":"2023-11-28T13:03:22.587175+0000","last_unstale":"2023-11-28T13:03:22.593275+0000","last_undegraded":"2023-11-28T13:03:22.593275+0000","last_fullsized":"2023-11-28T13:03:22.593275+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:50.289538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.581617+0000","last_change":"2023-11-28T13:03:22.214526+0000","last_active":"2023-11-28T13:03:22.581617+0000","last_peered":"2023-11-28T13:03:22.581617+0000","last_clean":"2023-11-28T13:03:22.581617+0000","last_became_active":"2023-11-28T13:03:22.214097+0000","last_became_peered":"2023-11-28T13:03:22.214097+0000","last_unstale":"2023-11-28T13:03:22.581617+0000","last_undegraded":"2023-11-28T13:03:22.581617+0000","last_fullsized":"2023-11-28T13:03:22.581617+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:02:30.896691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.592136+0000","last_change":"2023-11-28T13:03:22.588140+0000","last_active":"2023-11-28T13:03:22.592136+0000","last_peered":"2023-11-28T13:03:22.592136+0000","last_clean":"2023-11-28T13:03:22.592136+0000","last_became_active":"2023-11-28T13:03:22.587732+0000","last_became_peered":"2023-11-28T13:03:22.587732+0000","last_unstale":"2023-11-28T13:03:22.592136+0000","last_undegraded":"2023-11-28T13:03:22.592136+0000","last_fullsized":"2023-11-28T13:03:22.592136+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:23:40.308635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.584055+0000","last_change":"2023-11-28T13:03:22.220685+0000","last_active":"2023-11-28T13:03:23.584055+0000","last_peered":"2023-11-28T13:03:23.584055+0000","last_clean":"2023-11-28T13:03:23.584055+0000","last_became_active":"2023-11-28T13:03:22.220370+0000","last_became_peered":"2023-11-28T13:03:22.220370+0000","last_unstale":"2023-11-28T13:03:23.584055+0000","last_undegraded":"2023-11-28T13:03:23.584055+0000","last_fullsized":"2023-11-28T13:03:23.584055+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:24:29.583757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.600373+0000","last_change":"2023-11-28T13:03:22.599387+0000","last_active":"2023-11-28T13:03:22.600373+0000","last_peered":"2023-11-28T13:03:22.600373+0000","last_clean":"2023-11-28T13:03:22.600373+0000","last_became_active":"2023-11-28T13:03:22.599078+0000","last_became_peered":"2023-11-28T13:03:22.599078+0000","last_unstale":"2023-11-28T13:03:22.600373+0000","last_undegraded":"2023-11-28T13:03:22.600373+0000","last_fullsized":"2023-11-28T13:03:22.600373+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:28:28.010139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.582847+0000","last_change":"2023-11-28T13:03:22.215131+0000","last_active":"2023-11-28T13:03:23.582847+0000","last_peered":"2023-11-28T13:03:23.582847+0000","last_clean":"2023-11-28T13:03:23.582847+0000","last_became_active":"2023-11-28T13:03:22.212703+0000","last_became_peered":"2023-11-28T13:03:22.212703+0000","last_unstale":"2023-11-28T13:03:23.582847+0000","last_undegraded":"2023-11-28T13:03:23.582847+0000","last_fullsized":"2023-11-28T13:03:23.582847+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:50.259016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.601198+0000","last_change":"2023-11-28T13:03:22.598974+0000","last_active":"2023-11-28T13:03:22.601198+0000","last_peered":"2023-11-28T13:03:22.601198+0000","last_clean":"2023-11-28T13:03:22.601198+0000","last_became_active":"2023-11-28T13:03:22.598603+0000","last_became_peered":"2023-11-28T13:03:22.598603+0000","last_unstale":"2023-11-28T13:03:22.601198+0000","last_undegraded":"2023-11-28T13:03:22.601198+0000","last_fullsized":"2023-11-28T13:03:22.601198+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:18:53.538019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"64'3","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583600+0000","last_change":"2023-11-28T13:03:22.217758+0000","last_active":"2023-11-28T13:03:23.583600+0000","last_peered":"2023-11-28T13:03:23.583600+0000","last_clean":"2023-11-28T13:03:23.583600+0000","last_became_active":"2023-11-28T13:03:22.217159+0000","last_became_peered":"2023-11-28T13:03:22.217159+0000","last_unstale":"2023-11-28T13:03:23.583600+0000","last_undegraded":"2023-11-28T13:03:23.583600+0000","last_fullsized":"2023-11-28T13:03:23.583600+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:48.420418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.582930+0000","last_change":"2023-11-28T13:03:22.583841+0000","last_active":"2023-11-28T13:03:23.582930+0000","last_peered":"2023-11-28T13:03:23.582930+0000","last_clean":"2023-11-28T13:03:23.582930+0000","last_became_active":"2023-11-28T13:03:22.583525+0000","last_became_peered":"2023-11-28T13:03:22.583525+0000","last_unstale":"2023-11-28T13:03:23.582930+0000","last_undegraded":"2023-11-28T13:03:23.582930+0000","last_fullsized":"2023-11-28T13:03:23.582930+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:14:13.736222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"64'6","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.605768+0000","last_change":"2023-11-28T13:03:22.219886+0000","last_active":"2023-11-28T13:03:22.605768+0000","last_peered":"2023-11-28T13:03:22.605768+0000","last_clean":"2023-11-28T13:03:22.605768+0000","last_became_active":"2023-11-28T13:03:22.219554+0000","last_became_peered":"2023-11-28T13:03:22.219554+0000","last_unstale":"2023-11-28T13:03:22.605768+0000","last_undegraded":"2023-11-28T13:03:22.605768+0000","last_fullsized":"2023-11-28T13:03:22.605768+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:31:41.077461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.581566+0000","last_change":"2023-11-28T13:03:22.595308+0000","last_active":"2023-11-28T13:03:23.581566+0000","last_peered":"2023-11-28T13:03:23.581566+0000","last_clean":"2023-11-28T13:03:23.581566+0000","last_became_active":"2023-11-28T13:03:22.594788+0000","last_became_peered":"2023-11-28T13:03:22.594788+0000","last_unstale":"2023-11-28T13:03:23.581566+0000","last_undegraded":"2023-11-28T13:03:23.581566+0000","last_fullsized":"2023-11-28T13:03:23.581566+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:11.497698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583597+0000","last_change":"2023-11-28T13:03:22.214081+0000","last_active":"2023-11-28T13:03:23.583597+0000","last_peered":"2023-11-28T13:03:23.583597+0000","last_clean":"2023-11-28T13:03:23.583597+0000","last_became_active":"2023-11-28T13:03:22.213791+0000","last_became_peered":"2023-11-28T13:03:22.213791+0000","last_unstale":"2023-11-28T13:03:23.583597+0000","last_undegraded":"2023-11-28T13:03:23.583597+0000","last_fullsized":"2023-11-28T13:03:23.583597+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:59.926362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.601560+0000","last_change":"2023-11-28T13:03:22.598949+0000","last_active":"2023-11-28T13:03:22.601560+0000","last_peered":"2023-11-28T13:03:22.601560+0000","last_clean":"2023-11-28T13:03:22.601560+0000","last_became_active":"2023-11-28T13:03:22.598680+0000","last_became_peered":"2023-11-28T13:03:22.598680+0000","last_unstale":"2023-11-28T13:03:22.601560+0000","last_undegraded":"2023-11-28T13:03:22.601560+0000","last_fullsized":"2023-11-28T13:03:22.601560+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:44.960111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.582012+0000","last_change":"2023-11-28T13:03:22.217602+0000","last_active":"2023-11-28T13:03:22.582012+0000","last_peered":"2023-11-28T13:03:22.582012+0000","last_clean":"2023-11-28T13:03:22.582012+0000","last_became_active":"2023-11-28T13:03:22.217333+0000","last_became_peered":"2023-11-28T13:03:22.217333+0000","last_unstale":"2023-11-28T13:03:22.582012+0000","last_undegraded":"2023-11-28T13:03:22.582012+0000","last_fullsized":"2023-11-28T13:03:22.582012+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:27.471582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.598554+0000","last_change":"2023-11-28T13:03:22.594213+0000","last_active":"2023-11-28T13:03:22.598554+0000","last_peered":"2023-11-28T13:03:22.598554+0000","last_clean":"2023-11-28T13:03:22.598554+0000","last_became_active":"2023-11-28T13:03:22.593526+0000","last_became_peered":"2023-11-28T13:03:22.593526+0000","last_unstale":"2023-11-28T13:03:22.598554+0000","last_undegraded":"2023-11-28T13:03:22.598554+0000","last_fullsized":"2023-11-28T13:03:22.598554+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:27:16.341905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583417+0000","last_change":"2023-11-28T13:03:22.213474+0000","last_active":"2023-11-28T13:03:23.583417+0000","last_peered":"2023-11-28T13:03:23.583417+0000","last_clean":"2023-11-28T13:03:23.583417+0000","last_became_active":"2023-11-28T13:03:22.213133+0000","last_became_peered":"2023-11-28T13:03:22.213133+0000","last_unstale":"2023-11-28T13:03:23.583417+0000","last_undegraded":"2023-11-28T13:03:23.583417+0000","last_fullsized":"2023-11-28T13:03:23.583417+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:23:39.304120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.603095+0000","last_change":"2023-11-28T13:03:22.599257+0000","last_active":"2023-11-28T13:03:22.603095+0000","last_peered":"2023-11-28T13:03:22.603095+0000","last_clean":"2023-11-28T13:03:22.603095+0000","last_became_active":"2023-11-28T13:03:22.598934+0000","last_became_peered":"2023-11-28T13:03:22.598934+0000","last_unstale":"2023-11-28T13:03:22.603095+0000","last_undegraded":"2023-11-28T13:03:22.603095+0000","last_fullsized":"2023-11-28T13:03:22.603095+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:00:15.442831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"64'8","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.581466+0000","last_change":"2023-11-28T13:03:22.211956+0000","last_active":"2023-11-28T13:03:23.581466+0000","last_peered":"2023-11-28T13:03:23.581466+0000","last_clean":"2023-11-28T13:03:23.581466+0000","last_became_active":"2023-11-28T13:03:22.210914+0000","last_became_peered":"2023-11-28T13:03:22.210914+0000","last_unstale":"2023-11-28T13:03:23.581466+0000","last_undegraded":"2023-11-28T13:03:23.581466+0000","last_fullsized":"2023-11-28T13:03:23.581466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:17:40.704187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.579803+0000","last_change":"2023-11-28T13:03:22.585767+0000","last_active":"2023-11-28T13:03:23.579803+0000","last_peered":"2023-11-28T13:03:23.579803+0000","last_clean":"2023-11-28T13:03:23.579803+0000","last_became_active":"2023-11-28T13:03:22.585370+0000","last_became_peered":"2023-11-28T13:03:22.585370+0000","last_unstale":"2023-11-28T13:03:23.579803+0000","last_undegraded":"2023-11-28T13:03:23.579803+0000","last_fullsized":"2023-11-28T13:03:23.579803+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:10.992345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.600051+0000","last_change":"2023-11-28T13:03:22.216467+0000","last_active":"2023-11-28T13:03:22.600051+0000","last_peered":"2023-11-28T13:03:22.600051+0000","last_clean":"2023-11-28T13:03:22.600051+0000","last_became_active":"2023-11-28T13:03:22.216118+0000","last_became_peered":"2023-11-28T13:03:22.216118+0000","last_unstale":"2023-11-28T13:03:22.600051+0000","last_undegraded":"2023-11-28T13:03:22.600051+0000","last_fullsized":"2023-11-28T13:03:22.600051+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:17:52.614005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.591852+0000","last_change":"2023-11-28T13:03:22.587818+0000","last_active":"2023-11-28T13:03:22.591852+0000","last_peered":"2023-11-28T13:03:22.591852+0000","last_clean":"2023-11-28T13:03:22.591852+0000","last_became_active":"2023-11-28T13:03:22.586011+0000","last_became_peered":"2023-11-28T13:03:22.586011+0000","last_unstale":"2023-11-28T13:03:22.591852+0000","last_undegraded":"2023-11-28T13:03:22.591852+0000","last_fullsized":"2023-11-28T13:03:22.591852+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:22.218257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.586241+0000","last_change":"2023-11-28T13:03:22.210468+0000","last_active":"2023-11-28T13:03:22.586241+0000","last_peered":"2023-11-28T13:03:22.586241+0000","last_clean":"2023-11-28T13:03:22.586241+0000","last_became_active":"2023-11-28T13:03:22.210153+0000","last_became_peered":"2023-11-28T13:03:22.210153+0000","last_unstale":"2023-11-28T13:03:22.586241+0000","last_undegraded":"2023-11-28T13:03:22.586241+0000","last_fullsized":"2023-11-28T13:03:22.586241+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:42:27.508975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.599944+0000","last_change":"2023-11-28T13:03:22.597049+0000","last_active":"2023-11-28T13:03:22.599944+0000","last_peered":"2023-11-28T13:03:22.599944+0000","last_clean":"2023-11-28T13:03:22.599944+0000","last_became_active":"2023-11-28T13:03:22.596605+0000","last_became_peered":"2023-11-28T13:03:22.596605+0000","last_unstale":"2023-11-28T13:03:22.599944+0000","last_undegraded":"2023-11-28T13:03:22.599944+0000","last_fullsized":"2023-11-28T13:03:22.599944+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:03.750408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.579799+0000","last_change":"2023-11-28T13:03:22.219417+0000","last_active":"2023-11-28T13:03:23.579799+0000","last_peered":"2023-11-28T13:03:23.579799+0000","last_clean":"2023-11-28T13:03:23.579799+0000","last_became_active":"2023-11-28T13:03:22.219071+0000","last_became_peered":"2023-11-28T13:03:22.219071+0000","last_unstale":"2023-11-28T13:03:23.579799+0000","last_undegraded":"2023-11-28T13:03:23.579799+0000","last_fullsized":"2023-11-28T13:03:23.579799+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:28:31.792152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.595356+0000","last_change":"2023-11-28T13:03:22.589754+0000","last_active":"2023-11-28T13:03:22.595356+0000","last_peered":"2023-11-28T13:03:22.595356+0000","last_clean":"2023-11-28T13:03:22.595356+0000","last_became_active":"2023-11-28T13:03:22.589355+0000","last_became_peered":"2023-11-28T13:03:22.589355+0000","last_unstale":"2023-11-28T13:03:22.595356+0000","last_undegraded":"2023-11-28T13:03:22.595356+0000","last_fullsized":"2023-11-28T13:03:22.595356+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:17:41.708703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.579384+0000","last_change":"2023-11-28T13:03:22.218122+0000","last_active":"2023-11-28T13:03:22.579384+0000","last_peered":"2023-11-28T13:03:22.579384+0000","last_clean":"2023-11-28T13:03:22.579384+0000","last_became_active":"2023-11-28T13:03:22.217893+0000","last_became_peered":"2023-11-28T13:03:22.217893+0000","last_unstale":"2023-11-28T13:03:22.579384+0000","last_undegraded":"2023-11-28T13:03:22.579384+0000","last_fullsized":"2023-11-28T13:03:22.579384+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:57.782415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.595375+0000","last_change":"2023-11-28T13:03:22.591773+0000","last_active":"2023-11-28T13:03:22.595375+0000","last_peered":"2023-11-28T13:03:22.595375+0000","last_clean":"2023-11-28T13:03:22.595375+0000","last_became_active":"2023-11-28T13:03:22.591456+0000","last_became_peered":"2023-11-28T13:03:22.591456+0000","last_unstale":"2023-11-28T13:03:22.595375+0000","last_undegraded":"2023-11-28T13:03:22.595375+0000","last_fullsized":"2023-11-28T13:03:22.595375+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:55:57.647268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583802+0000","last_change":"2023-11-28T13:03:22.213530+0000","last_active":"2023-11-28T13:03:23.583802+0000","last_peered":"2023-11-28T13:03:23.583802+0000","last_clean":"2023-11-28T13:03:23.583802+0000","last_became_active":"2023-11-28T13:03:22.213203+0000","last_became_peered":"2023-11-28T13:03:22.213203+0000","last_unstale":"2023-11-28T13:03:23.583802+0000","last_undegraded":"2023-11-28T13:03:23.583802+0000","last_fullsized":"2023-11-28T13:03:23.583802+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:53:02.693373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.581761+0000","last_change":"2023-11-28T13:03:22.591995+0000","last_active":"2023-11-28T13:03:23.581761+0000","last_peered":"2023-11-28T13:03:23.581761+0000","last_clean":"2023-11-28T13:03:23.581761+0000","last_became_active":"2023-11-28T13:03:22.591570+0000","last_became_peered":"2023-11-28T13:03:22.591570+0000","last_unstale":"2023-11-28T13:03:23.581761+0000","last_undegraded":"2023-11-28T13:03:23.581761+0000","last_fullsized":"2023-11-28T13:03:23.581761+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:43.680069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.572099+0000","last_change":"2023-11-28T13:03:22.217841+0000","last_active":"2023-11-28T13:03:22.572099+0000","last_peered":"2023-11-28T13:03:22.572099+0000","last_clean":"2023-11-28T13:03:22.572099+0000","last_became_active":"2023-11-28T13:03:22.217446+0000","last_became_peered":"2023-11-28T13:03:22.217446+0000","last_unstale":"2023-11-28T13:03:22.572099+0000","last_undegraded":"2023-11-28T13:03:22.572099+0000","last_fullsized":"2023-11-28T13:03:22.572099+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:02.745893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.591995+0000","last_change":"2023-11-28T13:03:22.587245+0000","last_active":"2023-11-28T13:03:22.591995+0000","last_peered":"2023-11-28T13:03:22.591995+0000","last_clean":"2023-11-28T13:03:22.591995+0000","last_became_active":"2023-11-28T13:03:22.586988+0000","last_became_peered":"2023-11-28T13:03:22.586988+0000","last_unstale":"2023-11-28T13:03:22.591995+0000","last_undegraded":"2023-11-28T13:03:22.591995+0000","last_fullsized":"2023-11-28T13:03:22.591995+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:43.680069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.571953+0000","last_change":"2023-11-28T13:03:22.215264+0000","last_active":"2023-11-28T13:03:22.571953+0000","last_peered":"2023-11-28T13:03:22.571953+0000","last_clean":"2023-11-28T13:03:22.571953+0000","last_became_active":"2023-11-28T13:03:22.214606+0000","last_became_peered":"2023-11-28T13:03:22.214606+0000","last_unstale":"2023-11-28T13:03:22.571953+0000","last_undegraded":"2023-11-28T13:03:22.571953+0000","last_fullsized":"2023-11-28T13:03:22.571953+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:56.325748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.605805+0000","last_change":"2023-11-28T13:03:22.600967+0000","last_active":"2023-11-28T13:03:22.605805+0000","last_peered":"2023-11-28T13:03:22.605805+0000","last_clean":"2023-11-28T13:03:22.605805+0000","last_became_active":"2023-11-28T13:03:22.600701+0000","last_became_peered":"2023-11-28T13:03:22.600701+0000","last_unstale":"2023-11-28T13:03:22.605805+0000","last_undegraded":"2023-11-28T13:03:22.605805+0000","last_fullsized":"2023-11-28T13:03:22.605805+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:58:08.948259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.578863+0000","last_change":"2023-11-28T13:03:22.213369+0000","last_active":"2023-11-28T13:03:22.578863+0000","last_peered":"2023-11-28T13:03:22.578863+0000","last_clean":"2023-11-28T13:03:22.578863+0000","last_became_active":"2023-11-28T13:03:22.212455+0000","last_became_peered":"2023-11-28T13:03:22.212455+0000","last_unstale":"2023-11-28T13:03:22.578863+0000","last_undegraded":"2023-11-28T13:03:22.578863+0000","last_fullsized":"2023-11-28T13:03:22.578863+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:50.259016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.598581+0000","last_change":"2023-11-28T13:03:22.593684+0000","last_active":"2023-11-28T13:03:22.598581+0000","last_peered":"2023-11-28T13:03:22.598581+0000","last_clean":"2023-11-28T13:03:22.598581+0000","last_became_active":"2023-11-28T13:03:22.593384+0000","last_became_peered":"2023-11-28T13:03:22.593384+0000","last_unstale":"2023-11-28T13:03:22.598581+0000","last_undegraded":"2023-11-28T13:03:22.598581+0000","last_fullsized":"2023-11-28T13:03:22.598581+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:51.263531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.571551+0000","last_change":"2023-11-28T13:03:22.219320+0000","last_active":"2023-11-28T13:03:22.571551+0000","last_peered":"2023-11-28T13:03:22.571551+0000","last_clean":"2023-11-28T13:03:22.571551+0000","last_became_active":"2023-11-28T13:03:22.218826+0000","last_became_peered":"2023-11-28T13:03:22.218826+0000","last_unstale":"2023-11-28T13:03:22.571551+0000","last_undegraded":"2023-11-28T13:03:22.571551+0000","last_fullsized":"2023-11-28T13:03:22.571551+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:41:57.907090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":209,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.573944+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:03:22.573944+0000","last_peered":"2023-11-28T13:03:22.573944+0000","last_clean":"2023-11-28T13:03:22.573944+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:03:22.573944+0000","last_undegraded":"2023-11-28T13:03:22.573944+0000","last_fullsized":"2023-11-28T13:03:22.573944+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.210032+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:03:22.210032+0000","last_peered":"2023-11-28T13:03:22.210032+0000","last_clean":"2023-11-28T13:03:22.210032+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:03:22.210032+0000","last_undegraded":"2023-11-28T13:03:22.210032+0000","last_fullsized":"2023-11-28T13:03:22.210032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.579350+0000","last_change":"2023-11-28T13:03:22.586703+0000","last_active":"2023-11-28T13:03:23.579350+0000","last_peered":"2023-11-28T13:03:23.579350+0000","last_clean":"2023-11-28T13:03:23.579350+0000","last_became_active":"2023-11-28T13:03:22.586293+0000","last_became_peered":"2023-11-28T13:03:22.586293+0000","last_unstale":"2023-11-28T13:03:23.579350+0000","last_undegraded":"2023-11-28T13:03:23.579350+0000","last_fullsized":"2023-11-28T13:03:23.579350+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:28:28.010139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.579667+0000","last_change":"2023-11-28T13:03:22.214555+0000","last_active":"2023-11-28T13:03:23.579667+0000","last_peered":"2023-11-28T13:03:23.579667+0000","last_clean":"2023-11-28T13:03:23.579667+0000","last_became_active":"2023-11-28T13:03:22.214225+0000","last_became_peered":"2023-11-28T13:03:22.214225+0000","last_unstale":"2023-11-28T13:03:23.579667+0000","last_undegraded":"2023-11-28T13:03:23.579667+0000","last_fullsized":"2023-11-28T13:03:23.579667+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:02.745893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.573719+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:03:22.573719+0000","last_peered":"2023-11-28T13:03:22.573719+0000","last_clean":"2023-11-28T13:03:22.573719+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:03:22.573719+0000","last_undegraded":"2023-11-28T13:03:22.573719+0000","last_fullsized":"2023-11-28T13:03:22.573719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.601539+0000","last_change":"2023-11-28T13:03:22.598459+0000","last_active":"2023-11-28T13:03:22.601539+0000","last_peered":"2023-11-28T13:03:22.601539+0000","last_clean":"2023-11-28T13:03:22.601539+0000","last_became_active":"2023-11-28T13:03:22.598188+0000","last_became_peered":"2023-11-28T13:03:22.598188+0000","last_unstale":"2023-11-28T13:03:22.601539+0000","last_undegraded":"2023-11-28T13:03:22.601539+0000","last_fullsized":"2023-11-28T13:03:22.601539+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:11:17.241400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.586338+0000","last_change":"2023-11-28T13:03:22.216225+0000","last_active":"2023-11-28T13:03:22.586338+0000","last_peered":"2023-11-28T13:03:22.586338+0000","last_clean":"2023-11-28T13:03:22.586338+0000","last_became_active":"2023-11-28T13:03:22.215868+0000","last_became_peered":"2023-11-28T13:03:22.215868+0000","last_unstale":"2023-11-28T13:03:22.586338+0000","last_undegraded":"2023-11-28T13:03:22.586338+0000","last_fullsized":"2023-11-28T13:03:22.586338+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:22:36.461924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.195318+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:03:22.195318+0000","last_peered":"2023-11-28T13:03:22.195318+0000","last_clean":"2023-11-28T13:03:22.195318+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:03:22.195318+0000","last_undegraded":"2023-11-28T13:03:22.195318+0000","last_fullsized":"2023-11-28T13:03:22.195318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.599880+0000","last_change":"2023-11-28T13:03:22.596959+0000","last_active":"2023-11-28T13:03:22.599880+0000","last_peered":"2023-11-28T13:03:22.599880+0000","last_clean":"2023-11-28T13:03:22.599880+0000","last_became_active":"2023-11-28T13:03:22.596653+0000","last_became_peered":"2023-11-28T13:03:22.596653+0000","last_unstale":"2023-11-28T13:03:22.599880+0000","last_undegraded":"2023-11-28T13:03:22.599880+0000","last_fullsized":"2023-11-28T13:03:22.599880+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:22:37.466439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.579609+0000","last_change":"2023-11-28T13:03:22.216999+0000","last_active":"2023-11-28T13:03:23.579609+0000","last_peered":"2023-11-28T13:03:23.579609+0000","last_clean":"2023-11-28T13:03:23.579609+0000","last_became_active":"2023-11-28T13:03:22.216697+0000","last_became_peered":"2023-11-28T13:03:22.216697+0000","last_unstale":"2023-11-28T13:03:23.579609+0000","last_undegraded":"2023-11-28T13:03:23.579609+0000","last_fullsized":"2023-11-28T13:03:23.579609+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:56.325748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.209962+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:03:22.209962+0000","last_peered":"2023-11-28T13:03:22.209962+0000","last_clean":"2023-11-28T13:03:22.209962+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:03:22.209962+0000","last_undegraded":"2023-11-28T13:03:22.209962+0000","last_fullsized":"2023-11-28T13:03:22.209962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583649+0000","last_change":"2023-11-28T13:03:22.592805+0000","last_active":"2023-11-28T13:03:23.583649+0000","last_peered":"2023-11-28T13:03:23.583649+0000","last_clean":"2023-11-28T13:03:23.583649+0000","last_became_active":"2023-11-28T13:03:22.590442+0000","last_became_peered":"2023-11-28T13:03:22.590442+0000","last_unstale":"2023-11-28T13:03:23.583649+0000","last_undegraded":"2023-11-28T13:03:23.583649+0000","last_fullsized":"2023-11-28T13:03:23.583649+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:08.354045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.599227+0000","last_change":"2023-11-28T13:03:22.215828+0000","last_active":"2023-11-28T13:03:22.599227+0000","last_peered":"2023-11-28T13:03:22.599227+0000","last_clean":"2023-11-28T13:03:22.599227+0000","last_became_active":"2023-11-28T13:03:22.215516+0000","last_became_peered":"2023-11-28T13:03:22.215516+0000","last_unstale":"2023-11-28T13:03:22.599227+0000","last_undegraded":"2023-11-28T13:03:22.599227+0000","last_fullsized":"2023-11-28T13:03:22.599227+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:49:23.308010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.209507+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:03:22.209507+0000","last_peered":"2023-11-28T13:03:22.209507+0000","last_clean":"2023-11-28T13:03:22.209507+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:03:22.209507+0000","last_undegraded":"2023-11-28T13:03:22.209507+0000","last_fullsized":"2023-11-28T13:03:22.209507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.602359+0000","last_change":"2023-11-28T13:03:22.600318+0000","last_active":"2023-11-28T13:03:22.602359+0000","last_peered":"2023-11-28T13:03:22.602359+0000","last_clean":"2023-11-28T13:03:22.602359+0000","last_became_active":"2023-11-28T13:03:22.600003+0000","last_became_peered":"2023-11-28T13:03:22.600003+0000","last_unstale":"2023-11-28T13:03:22.602359+0000","last_undegraded":"2023-11-28T13:03:22.602359+0000","last_fullsized":"2023-11-28T13:03:22.602359+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:49:24.312526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583921+0000","last_change":"2023-11-28T13:03:22.213888+0000","last_active":"2023-11-28T13:03:23.583921+0000","last_peered":"2023-11-28T13:03:23.583921+0000","last_clean":"2023-11-28T13:03:23.583921+0000","last_became_active":"2023-11-28T13:03:22.213601+0000","last_became_peered":"2023-11-28T13:03:22.213601+0000","last_unstale":"2023-11-28T13:03:23.583921+0000","last_undegraded":"2023-11-28T13:03:23.583921+0000","last_fullsized":"2023-11-28T13:03:23.583921+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:17:52.614005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.575251+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:03:22.575251+0000","last_peered":"2023-11-28T13:03:22.575251+0000","last_clean":"2023-11-28T13:03:22.575251+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:03:22.575251+0000","last_undegraded":"2023-11-28T13:03:22.575251+0000","last_fullsized":"2023-11-28T13:03:22.575251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.582758+0000","last_change":"2023-11-28T13:03:22.592001+0000","last_active":"2023-11-28T13:03:23.582758+0000","last_peered":"2023-11-28T13:03:23.582758+0000","last_clean":"2023-11-28T13:03:23.582758+0000","last_became_active":"2023-11-28T13:03:22.591304+0000","last_became_peered":"2023-11-28T13:03:22.591304+0000","last_unstale":"2023-11-28T13:03:23.582758+0000","last_undegraded":"2023-11-28T13:03:23.582758+0000","last_fullsized":"2023-11-28T13:03:23.582758+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:42.379047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"64'1","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583620+0000","last_change":"2023-11-28T13:03:22.217931+0000","last_active":"2023-11-28T13:03:23.583620+0000","last_peered":"2023-11-28T13:03:23.583620+0000","last_clean":"2023-11-28T13:03:23.583620+0000","last_became_active":"2023-11-28T13:03:22.217507+0000","last_became_peered":"2023-11-28T13:03:22.217507+0000","last_unstale":"2023-11-28T13:03:23.583620+0000","last_undegraded":"2023-11-28T13:03:23.583620+0000","last_fullsized":"2023-11-28T13:03:23.583620+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:42:27.508975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.207033+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:03:22.207033+0000","last_peered":"2023-11-28T13:03:22.207033+0000","last_clean":"2023-11-28T13:03:22.207033+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:03:22.207033+0000","last_undegraded":"2023-11-28T13:03:22.207033+0000","last_fullsized":"2023-11-28T13:03:22.207033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.595336+0000","last_change":"2023-11-28T13:03:22.589592+0000","last_active":"2023-11-28T13:03:22.595336+0000","last_peered":"2023-11-28T13:03:22.595336+0000","last_clean":"2023-11-28T13:03:22.595336+0000","last_became_active":"2023-11-28T13:03:22.588998+0000","last_became_peered":"2023-11-28T13:03:22.588998+0000","last_unstale":"2023-11-28T13:03:22.595336+0000","last_undegraded":"2023-11-28T13:03:22.595336+0000","last_fullsized":"2023-11-28T13:03:22.595336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:26:15.760699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.574110+0000","last_change":"2023-11-28T13:03:22.210321+0000","last_active":"2023-11-28T13:03:22.574110+0000","last_peered":"2023-11-28T13:03:22.574110+0000","last_clean":"2023-11-28T13:03:22.574110+0000","last_became_active":"2023-11-28T13:03:22.210040+0000","last_became_peered":"2023-11-28T13:03:22.210040+0000","last_unstale":"2023-11-28T13:03:22.574110+0000","last_undegraded":"2023-11-28T13:03:22.574110+0000","last_fullsized":"2023-11-28T13:03:22.574110+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:43.955596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.207103+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:03:22.207103+0000","last_peered":"2023-11-28T13:03:22.207103+0000","last_clean":"2023-11-28T13:03:22.207103+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:03:22.207103+0000","last_undegraded":"2023-11-28T13:03:22.207103+0000","last_fullsized":"2023-11-28T13:03:22.207103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15000,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":13632,"kb_avail":94356840,"statfs":{"total":96636764160,"available":96621404160,"internally_reserved":0,"allocated":1392640,"data_stored":936180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13959168},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83199999999999996,"15min":0.81699999999999995},"min":{"1min":0.60199999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1479999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.877,"15min":0.90300000000000002},"min":{"1min":0.51200000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.2110000000000001,"5min":1.377,"15min":1.377},"last":0.59499999999999997}]},{"osd":1,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.90200000000000002,"15min":0.91600000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2410000000000001,"5min":1.599,"15min":1.599},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.91800000000000004,"15min":0.94099999999999995},"min":{"1min":0.69499999999999995,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.103,"5min":1.375,"15min":1.375},"last":0.69499999999999995}]},{"osd":2,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.91000000000000003,"15min":0.93600000000000005},"min":{"1min":0.56000000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.198,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3109999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.96499999999999997}]},{"osd":3,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.92700000000000005,"15min":0.94699999999999995},"min":{"1min":0.67800000000000005,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.1779999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.92700000000000005,"15min":0.92200000000000004},"min":{"1min":0.752,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.212,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.88200000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.97999999999999998,"15min":1.0009999999999999},"min":{"1min":0.63700000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.121,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.96199999999999997,"15min":0.96499999999999997},"min":{"1min":0.71899999999999997,"5min":0.621,"15min":0.621},"max":{"1min":1.1539999999999999,"5min":1.409,"15min":1.409},"last":0.99299999999999999}]},{"osd":5,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1599999999999999,"5min":1.466,"15min":1.466},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.022,"5min":1.085,"15min":1.101},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.1890000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.76700000000000002}]},{"osd":6,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.1579999999999999,"15min":1.1799999999999999},"min":{"1min":0.90400000000000003,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.28,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1459999999999999,"15min":1.167},"min":{"1min":0.86499999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.238,"5min":1.794,"15min":1.794},"last":0.92400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9340,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362500,"statfs":{"total":96636764160,"available":96627200000,"internally_reserved":0,"allocated":774144,"data_stored":338433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.82899999999999996,"15min":0.83499999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1220000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.86399999999999999,"15min":0.84599999999999997},"min":{"1min":0.65300000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.23,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.72699999999999998}]},{"osd":1,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.87,"15min":0.86199999999999999},"min":{"1min":0.59199999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1619999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.67000000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.121,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.0329999999999999}]},{"osd":2,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.84299999999999997,"15min":0.873},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.88,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.90300000000000002,"15min":0.89600000000000002},"min":{"1min":0.68899999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3240000000000001,"5min":1.639,"15min":1.639},"last":0.85799999999999998}]},{"osd":3,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.89300000000000002,"15min":0.88300000000000001},"min":{"1min":0.67400000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":1.125},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.96499999999999997,"15min":0.97299999999999998},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1459999999999999,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.94399999999999995}]},{"osd":4,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.95499999999999996,"15min":0.94999999999999996},"min":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.278,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.3280000000000001,"15min":1.4690000000000001},"min":{"1min":0.63500000000000001,"5min":0.629,"15min":0.629},"max":{"1min":1.2969999999999999,"5min":10.566000000000001,"15min":10.566000000000001},"last":1.198}]},{"osd":5,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0680000000000001,"15min":1.083},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.1259999999999999,"15min":1.095},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.9729999999999999,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":0.76700000000000002}]},{"osd":7,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.204,"15min":1.24},"min":{"1min":0.875,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.27,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":1.27},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.2569999999999999,"15min":1.3149999999999999},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.252,"5min":3.593,"15min":3.593},"last":1.006}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9532,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362308,"statfs":{"total":96636764160,"available":96627003392,"internally_reserved":0,"allocated":774144,"data_stored":338421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.53700000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.82299999999999995,"15min":0.81899999999999995},"min":{"1min":0.55400000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.22,"5min":1.248,"15min":1.248},"last":0.68999999999999995}]},{"osd":1,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82199999999999995},"min":{"1min":0.48999999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1859999999999999,"5min":1.274,"15min":1.274},"last":1.089},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80000000000000004,"15min":0.79800000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1439999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.83299999999999996}]},{"osd":2,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.83099999999999996,"15min":0.81599999999999995},"min":{"1min":0.59599999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.871},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.92700000000000005,"15min":0.93899999999999995},"min":{"1min":0.65300000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.26,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.90700000000000003}]},{"osd":3,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.89500000000000002,"15min":0.874},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.194,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.997},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0109999999999999,"15min":1.0229999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.365,"5min":1.403,"15min":1.403},"last":1.238}]},{"osd":4,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.89100000000000001,"15min":0.89300000000000002},"min":{"1min":0.60399999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98999999999999999,"15min":0.95699999999999996},"min":{"1min":0.65200000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5189999999999999,"5min":4.3300000000000001,"15min":4.3300000000000001},"last":0.95199999999999996}]},{"osd":6,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.0089999999999999,"15min":1.0249999999999999},"min":{"1min":0.73599999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0389999999999999,"15min":1.0329999999999999},"min":{"1min":0.85299999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.419,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.014}]},{"osd":7,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0740000000000001,"15min":1.042},"min":{"1min":0.91000000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3380000000000001,"5min":4.234,"15min":4.234},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.1299999999999999,"15min":1.139},"min":{"1min":0.79800000000000004,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.3100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9668,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362172,"statfs":{"total":96636764160,"available":96626864128,"internally_reserved":0,"allocated":782336,"data_stored":339947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.81899999999999995,"15min":0.81499999999999995},"min":{"1min":0.58799999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1200000000000001,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81799999999999995,"15min":0.81200000000000006},"min":{"1min":0.67400000000000004,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.159,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":1.0249999999999999}]},{"osd":1,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.81599999999999995,"15min":0.81699999999999995},"min":{"1min":0.61399999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1000000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.88100000000000001,"15min":0.871},"min":{"1min":0.58299999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1830000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.80700000000000005}]},{"osd":2,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.82999999999999996,"15min":0.83599999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1279999999999999,"5min":1.357,"15min":1.357},"last":1.296},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2270000000000001,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.83299999999999996}]},{"osd":3,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.89900000000000002,"15min":0.877},"min":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.085},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99299999999999999,"15min":0.99099999999999999},"min":{"1min":0.84099999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.222,"5min":1.474,"15min":1.474},"last":1.159}]},{"osd":5,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.90500000000000003,"15min":0.90400000000000003},"min":{"1min":0.68600000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.103,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":0.99199999999999999,"15min":0.998},"min":{"1min":0.624,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.1870000000000001}]},{"osd":6,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.014,"15min":1.03},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3400000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.079,"15min":1.079},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.252,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.212}]},{"osd":7,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.089,"15min":1.093},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.367,"5min":1.526,"15min":1.526},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1479999999999999,"15min":1.151},"min":{"1min":0.91500000000000004,"5min":0.871,"15min":0.871},"max":{"1min":1.431,"5min":1.655,"15min":1.655},"last":1.3600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9720,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362120,"statfs":{"total":96636764160,"available":96626810880,"internally_reserved":0,"allocated":770048,"data_stored":338399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61299999999999999,"15min":0.60199999999999998},"min":{"1min":0.46899999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90400000000000003,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66600000000000004,"15min":0.68600000000000005},"min":{"1min":0.504,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78900000000000003,"5min":0.998,"15min":0.998},"last":0.58399999999999996}]},{"osd":1,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67300000000000004,"15min":0.68899999999999995},"min":{"1min":0.45500000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.008,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.502},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.76000000000000001,"15min":0.76100000000000001},"min":{"1min":0.497,"5min":0.441,"15min":0.441},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.68700000000000006}]},{"osd":2,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92200000000000004,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82799999999999996,"15min":0.82999999999999996},"min":{"1min":0.52400000000000002,"5min":0.438,"15min":0.438},"max":{"1min":1.034,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.94999999999999996,"15min":0.99099999999999999},"min":{"1min":0.66300000000000003,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.2769999999999999,"5min":1.405,"15min":1.405},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":1.0109999999999999,"15min":1.0409999999999999},"min":{"1min":0.72399999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.149,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.087}]},{"osd":5,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.02,"15min":1.056},"min":{"1min":0.64400000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2689999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0680000000000001,"15min":1.0880000000000001},"min":{"1min":0.76400000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5449999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0469999999999999,"15min":1.093},"min":{"1min":0.72699999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3400000000000001,"5min":1.446,"15min":1.446},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.087,"15min":1.109},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.222,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.1559999999999999}]},{"osd":7,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1559999999999999},"min":{"1min":0.92600000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.488,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1259999999999999,"15min":1.173},"min":{"1min":0.77200000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3979999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.90400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9464,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362376,"statfs":{"total":96636764160,"available":96627073024,"internally_reserved":0,"allocated":770048,"data_stored":338399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58099999999999996,"15min":0.56799999999999995},"min":{"1min":0.45100000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94999999999999996,"5min":0.997,"15min":0.997},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.64500000000000002,"15min":0.622},"min":{"1min":0.54300000000000004,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.59799999999999998}]},{"osd":1,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.502,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91500000000000004,"5min":1.123,"15min":1.123},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.69199999999999995,"15min":0.68000000000000005},"min":{"1min":0.54800000000000004,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98399999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.72899999999999998}]},{"osd":3,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.75600000000000001,"15min":0.72399999999999998},"min":{"1min":0.65800000000000003,"5min":0.317,"15min":0.317},"max":{"1min":1.02,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.755,"15min":0.745},"min":{"1min":0.56899999999999995,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.84099999999999997}]},{"osd":4,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.93000000000000005,"15min":0.92200000000000004},"min":{"1min":0.81899999999999995,"5min":0.498,"15min":0.498},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.042},{"interface":"front","average":{"1min":1.02,"5min":1.004,"15min":1.006},"min":{"1min":0.80800000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.1930000000000001}]},{"osd":5,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.76200000000000001,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.343,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.014,"15min":0.98699999999999999},"min":{"1min":0.72099999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.423,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.0109999999999999}]},{"osd":6,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0600000000000001,"15min":1.032},"min":{"1min":0.751,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.47,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.014,"15min":1.006},"min":{"1min":0.83799999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.1180000000000001}]},{"osd":7,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.071,"15min":1.0649999999999999},"min":{"1min":0.85299999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5069999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.1220000000000001,"15min":1.0980000000000001},"min":{"1min":0.86499999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.474,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.244}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9556,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362284,"statfs":{"total":96636764160,"available":96626978816,"internally_reserved":0,"allocated":798720,"data_stored":340695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.63300000000000001,"15min":0.64300000000000002},"min":{"1min":0.437,"5min":0.314,"15min":0.314},"max":{"1min":0.89500000000000002,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.752},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66400000000000003,"15min":0.68000000000000005},"min":{"1min":0.39500000000000002,"5min":0.318,"15min":0.318},"max":{"1min":1.1040000000000001,"5min":1.181,"15min":1.181},"last":0.66300000000000003}]},{"osd":2,"last update":"Tue Nov 28 13:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.69699999999999995},"min":{"1min":0.47699999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0720000000000001,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.624},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.48799999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.131,"5min":1.409,"15min":1.409},"last":0.57499999999999996}]},{"osd":3,"last update":"Tue Nov 28 13:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81200000000000006,"15min":0.82599999999999996},"min":{"1min":0.51900000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.03,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73999999999999999,"15min":0.74299999999999999},"min":{"1min":0.53800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.996,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.71899999999999997}]},{"osd":4,"last update":"Tue Nov 28 13:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.97399999999999998,"15min":0.98999999999999999},"min":{"1min":0.66600000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.284,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.94099999999999995},"min":{"1min":0.69899999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3049999999999999,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":0.81899999999999995}]},{"osd":5,"last update":"Tue Nov 28 13:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.96999999999999997,"15min":0.97699999999999998},"min":{"1min":0.68700000000000006,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.876},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.014,"15min":1.044},"min":{"1min":0.63100000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.306,"5min":2.004,"15min":2.004},"last":0.84199999999999997}]},{"osd":6,"last update":"Tue Nov 28 13:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.97899999999999998,"15min":1.004},"min":{"1min":0.68500000000000005,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2070000000000001,"5min":1.889,"15min":1.889},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.085,"15min":1.1060000000000001},"min":{"1min":0.80800000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.534,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.93899999999999995}]},{"osd":7,"last update":"Tue Nov 28 13:03:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0760000000000001,"15min":1.091},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.6200000000000001,"5min":1.766,"15min":1.766},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0840000000000001,"15min":1.1160000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2030000000000001,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.012}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14792,"kb_used_data":1344,"kb_used_omap":0,"kb_used_meta":13440,"kb_avail":94357048,"statfs":{"total":96636764160,"available":96621617152,"internally_reserved":0,"allocated":1376256,"data_stored":935420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13762560},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.46899999999999997,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.878,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.48999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.90800000000000003,"5min":1.198,"15min":1.198},"last":0.504}]},{"osd":2,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71399999999999997,"15min":0.70899999999999996},"min":{"1min":0.52800000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.92500000000000004,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.63},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.434,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.91300000000000003,"5min":1.143,"15min":1.143},"last":0.434}]},{"osd":3,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67400000000000004,"15min":0.67900000000000005},"min":{"1min":0.41299999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92600000000000005,"5min":1.298,"15min":1.298},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.83799999999999997,"15min":0.84599999999999997},"min":{"1min":0.54700000000000004,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.4379999999999999,"5min":1.629,"15min":1.629},"last":0.78800000000000003}]},{"osd":4,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.88900000000000001,"15min":0.89300000000000002},"min":{"1min":0.72099999999999997,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.96299999999999997,"15min":0.95699999999999996},"min":{"1min":0.73599999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.89700000000000002}]},{"osd":5,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.98799999999999999,"15min":0.98999999999999999},"min":{"1min":0.71699999999999997,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.2430000000000001,"5min":1.895,"15min":1.895},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93700000000000006,"15min":0.93899999999999995},"min":{"1min":0.76200000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.155,"5min":1.319,"15min":1.319},"last":0.92700000000000005}]},{"osd":6,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.036,"15min":1.046},"min":{"1min":0.749,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.321,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0760000000000001,"15min":1.0820000000000001},"min":{"1min":0.77300000000000002,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.4950000000000001,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.77300000000000002}]},{"osd":7,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.093,"15min":1.109},"min":{"1min":0.755,"5min":0.746,"15min":0.746},"max":{"1min":1.3999999999999999,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0109999999999999,"15min":1.014},"min":{"1min":0.748,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.86599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:03:26.612 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:03:26.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d3fff700 1 Processor -- start 2023-11-28T13:03:26.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d3fff700 1 -- start start 2023-11-28T13:03:26.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d3fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f53d40d26a0 0x7f53d40b8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:26.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d3fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f53d40cd530 0x7f53d40cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:26.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d3fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d415fa40 con 0x7f53d40b6190 2023-11-28T13:03:26.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d3fff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d40b88c0 con 0x7f53d40cd530 2023-11-28T13:03:26.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d3fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d40cf270 con 0x7f53d40d26a0 2023-11-28T13:03:26.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d37fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f53d40cd530 0x7f53d40cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:26.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d37fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f53d40cd530 0x7f53d40cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58066/0 (socket says 172.21.15.82:58066) 2023-11-28T13:03:26.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d37fe700 1 -- 172.21.15.82:0/2607160265 learned_addr learned my addr 172.21.15.82:0/2607160265 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:26.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d2ffd700 1 --2- 172.21.15.82:0/2607160265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f53d40d26a0 0x7f53d40b8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:26.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d37fe700 1 -- 172.21.15.82:0/2607160265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f53d40d26a0 msgr2=0x7f53d40b8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:26.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d37fe700 1 --2- 172.21.15.82:0/2607160265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f53d40d26a0 0x7f53d40b8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d37fe700 1 -- 172.21.15.82:0/2607160265 >> v1:172.21.15.114:6789/0 conn(0x7f53d40b6190 legacy=0x7f53d40d2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:26.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d37fe700 1 -- 172.21.15.82:0/2607160265 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d40cf550 con 0x7f53d40cd530 2023-11-28T13:03:26.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d37fe700 1 --2- 172.21.15.82:0/2607160265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d40cd530 0x7f53d40cd9b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009910 tx=0x7f53cc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf5d4d400fabedc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:26.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d1ffb700 1 -- 172.21.15.82:0/2607160265 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc00ba60 con 0x7f53d40cd530 2023-11-28T13:03:26.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d1ffb700 1 -- 172.21.15.82:0/2607160265 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc00bbc0 con 0x7f53d40cd530 2023-11-28T13:03:26.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d1ffb700 1 -- 172.21.15.82:0/2607160265 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc009e60 con 0x7f53d40cd530 2023-11-28T13:03:26.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d3fff700 1 -- 172.21.15.82:0/2607160265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d40cd530 msgr2=0x7f53d40cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:26.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d3fff700 1 --2- 172.21.15.82:0/2607160265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d40cd530 0x7f53d40cd9b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009910 tx=0x7f53cc009c20 comp rx=0 tx=0).stop 2023-11-28T13:03:26.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d3fff700 1 -- 172.21.15.82:0/2607160265 shutdown_connections 2023-11-28T13:03:26.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d3fff700 1 --2- 172.21.15.82:0/2607160265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d40cd530 0x7f53d40cd9b0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d3fff700 1 --2- 172.21.15.82:0/2607160265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f53d40d26a0 0x7f53d40b8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.716+0000 7f53d3fff700 1 -- 172.21.15.82:0/2607160265 >> 172.21.15.82:0/2607160265 conn(0x7f53d409bc60 msgr2=0x7f53d40b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:26.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.720+0000 7f53d3fff700 1 -- 172.21.15.82:0/2607160265 shutdown_connections 2023-11-28T13:03:26.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.720+0000 7f53d3fff700 1 -- 172.21.15.82:0/2607160265 wait complete. 2023-11-28T13:03:26.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.720+0000 7f53d3fff700 1 Processor -- start 2023-11-28T13:03:26.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.720+0000 7f53d3fff700 1 -- start start 2023-11-28T13:03:26.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.720+0000 7f53d3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d40b6190 0x7f53d415c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:26.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.720+0000 7f53d3fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f53d40cd530 0x7f53d41f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:26.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.720+0000 7f53d3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53d40d26a0 0x7f53d41f1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:26.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.720+0000 7f53d3fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d41f29f0 con 0x7f53d40b6190 2023-11-28T13:03:26.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.720+0000 7f53d3fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d40cb160 con 0x7f53d40d26a0 2023-11-28T13:03:26.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.720+0000 7f53d3fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d40cb400 con 0x7f53d40cd530 2023-11-28T13:03:26.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.720+0000 7f53d2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d40b6190 0x7f53d415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:26.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.720+0000 7f53d2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d40b6190 0x7f53d415c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58074/0 (socket says 172.21.15.82:58074) 2023-11-28T13:03:26.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.720+0000 7f53d37fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53d40d26a0 0x7f53d41f1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:26.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.720+0000 7f53d2ffd700 1 -- 172.21.15.82:0/1059482522 learned_addr learned my addr 172.21.15.82:0/1059482522 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:26.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.720+0000 7f53d27fc700 1 --2- 172.21.15.82:0/1059482522 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f53d40cd530 0x7f53d41f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:26.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.724+0000 7f53d2ffd700 1 -- 172.21.15.82:0/1059482522 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f53d40cd530 msgr2=0x7f53d41f2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:26.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.724+0000 7f53d2ffd700 1 --2- 172.21.15.82:0/1059482522 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f53d40cd530 0x7f53d41f2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.724+0000 7f53d2ffd700 1 -- 172.21.15.82:0/1059482522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53d40d26a0 msgr2=0x7f53d41f1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:26.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.724+0000 7f53d2ffd700 1 --2- 172.21.15.82:0/1059482522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53d40d26a0 0x7f53d41f1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.724+0000 7f53d2ffd700 1 -- 172.21.15.82:0/1059482522 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc009570 con 0x7f53d40b6190 2023-11-28T13:03:26.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.724+0000 7f53d2ffd700 1 --2- 172.21.15.82:0/1059482522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d40b6190 0x7f53d415c070 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00d800 tx=0x7f53bc00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:26.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.724+0000 7f53cbfff700 1 -- 172.21.15.82:0/1059482522 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc0125f0 con 0x7f53d40b6190 2023-11-28T13:03:26.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.724+0000 7f53cbfff700 1 -- 172.21.15.82:0/1059482522 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53bc012750 con 0x7f53d40b6190 2023-11-28T13:03:26.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.724+0000 7f53d3fff700 1 -- 172.21.15.82:0/1059482522 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d40cfb10 con 0x7f53d40b6190 2023-11-28T13:03:26.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.724+0000 7f53cbfff700 1 -- 172.21.15.82:0/1059482522 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc012ac0 con 0x7f53d40b6190 2023-11-28T13:03:26.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.724+0000 7f53d3fff700 1 -- 172.21.15.82:0/1059482522 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d40cf830 con 0x7f53d40b6190 2023-11-28T13:03:26.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.724+0000 7f53d3fff700 1 -- 172.21.15.82:0/1059482522 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d40cfdf0 con 0x7f53d40b6190 2023-11-28T13:03:26.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.724+0000 7f53cbfff700 1 -- 172.21.15.82:0/1059482522 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f53bc012c20 con 0x7f53d40b6190 2023-11-28T13:03:26.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.724+0000 7f53cbfff700 1 --2- 172.21.15.82:0/1059482522 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f53b4064ee0 0x7f53b4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:26.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.724+0000 7f53cbfff700 1 -- 172.21.15.82:0/1059482522 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53bc0820a0 con 0x7f53d40b6190 2023-11-28T13:03:26.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.724+0000 7f53d27fc700 1 --2- 172.21.15.82:0/1059482522 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f53b4064ee0 0x7f53b4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:26.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.728+0000 7f53d27fc700 1 --2- 172.21.15.82:0/1059482522 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f53b4064ee0 0x7f53b4067390 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f53d40b0110 tx=0x7f53c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:26.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.732+0000 7f53cbfff700 1 -- 172.21.15.82:0/1059482522 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f53bc050240 con 0x7f53d40b6190 2023-11-28T13:03:26.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.892+0000 7f53d3fff700 1 -- 172.21.15.82:0/1059482522 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f53d4065fc0 con 0x7f53b4064ee0 2023-11-28T13:03:26.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.900+0000 7f53cbfff700 1 -- 172.21.15.82:0/1059482522 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309906 (secure 0 0 0) 0x7f53d4065fc0 con 0x7f53b4064ee0 2023-11-28T13:03:26.910 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:26.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.908+0000 7f53d3fff700 1 -- 172.21.15.82:0/1059482522 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f53b4064ee0 msgr2=0x7f53b4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:26.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.908+0000 7f53d3fff700 1 --2- 172.21.15.82:0/1059482522 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f53b4064ee0 0x7f53b4067390 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f53d40b0110 tx=0x7f53c4009040 comp rx=0 tx=0).stop 2023-11-28T13:03:26.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.908+0000 7f53d3fff700 1 -- 172.21.15.82:0/1059482522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d40b6190 msgr2=0x7f53d415c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:26.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.908+0000 7f53d3fff700 1 --2- 172.21.15.82:0/1059482522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d40b6190 0x7f53d415c070 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00d800 tx=0x7f53bc00db10 comp rx=0 tx=0).stop 2023-11-28T13:03:26.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.908+0000 7f53d3fff700 1 -- 172.21.15.82:0/1059482522 shutdown_connections 2023-11-28T13:03:26.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.908+0000 7f53d3fff700 1 --2- 172.21.15.82:0/1059482522 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f53b4064ee0 0x7f53b4067390 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.908+0000 7f53d3fff700 1 --2- 172.21.15.82:0/1059482522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53d40d26a0 0x7f53d41f1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.908+0000 7f53d3fff700 1 --2- 172.21.15.82:0/1059482522 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f53d40cd530 0x7f53d41f2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.908+0000 7f53d3fff700 1 --2- 172.21.15.82:0/1059482522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d40b6190 0x7f53d415c070 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:26.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.908+0000 7f53d3fff700 1 -- 172.21.15.82:0/1059482522 >> 172.21.15.82:0/1059482522 conn(0x7f53d409bc60 msgr2=0x7f53d40b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:26.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.908+0000 7f53d3fff700 1 -- 172.21.15.82:0/1059482522 shutdown_connections 2023-11-28T13:03:26.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:26.908+0000 7f53d3fff700 1 -- 172.21.15.82:0/1059482522 wait complete. 2023-11-28T13:03:26.914 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:03:26.925 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2023-11-28T13:03:25.217179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":87072,"kb_used_data":7264,"kb_used_omap":0,"kb_used_meta":79744,"kb_avail":754887648,"statfs":{"total":773094113280,"available":773004951552,"internally_reserved":0,"allocated":7438336,"data_stored":3905894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81657856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.035813"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.603161+0000","last_change":"2023-11-28T13:03:22.599636+0000","last_active":"2023-11-28T13:03:22.603161+0000","last_peered":"2023-11-28T13:03:22.603161+0000","last_clean":"2023-11-28T13:03:22.603161+0000","last_became_active":"2023-11-28T13:03:22.599429+0000","last_became_peered":"2023-11-28T13:03:22.599429+0000","last_unstale":"2023-11-28T13:03:22.603161+0000","last_undegraded":"2023-11-28T13:03:22.603161+0000","last_fullsized":"2023-11-28T13:03:22.603161+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:53:03.697888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.593959+0000","last_change":"2023-11-28T13:03:22.592842+0000","last_active":"2023-11-28T13:03:22.593959+0000","last_peered":"2023-11-28T13:03:22.593959+0000","last_clean":"2023-11-28T13:03:22.593959+0000","last_became_active":"2023-11-28T13:03:22.592588+0000","last_became_peered":"2023-11-28T13:03:22.592588+0000","last_unstale":"2023-11-28T13:03:22.593959+0000","last_undegraded":"2023-11-28T13:03:22.593959+0000","last_fullsized":"2023-11-28T13:03:22.593959+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:14:13.736222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583552+0000","last_change":"2023-11-28T13:03:22.593246+0000","last_active":"2023-11-28T13:03:23.583552+0000","last_peered":"2023-11-28T13:03:23.583552+0000","last_clean":"2023-11-28T13:03:23.583552+0000","last_became_active":"2023-11-28T13:03:22.590495+0000","last_became_peered":"2023-11-28T13:03:22.590495+0000","last_unstale":"2023-11-28T13:03:23.583552+0000","last_undegraded":"2023-11-28T13:03:23.583552+0000","last_fullsized":"2023-11-28T13:03:23.583552+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:03.750408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.582286+0000","last_change":"2023-11-28T13:03:22.588889+0000","last_active":"2023-11-28T13:03:23.582286+0000","last_peered":"2023-11-28T13:03:23.582286+0000","last_clean":"2023-11-28T13:03:23.582286+0000","last_became_active":"2023-11-28T13:03:22.588508+0000","last_became_peered":"2023-11-28T13:03:22.588508+0000","last_unstale":"2023-11-28T13:03:23.582286+0000","last_undegraded":"2023-11-28T13:03:23.582286+0000","last_fullsized":"2023-11-28T13:03:23.582286+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:07.686565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.602384+0000","last_change":"2023-11-28T13:03:22.600382+0000","last_active":"2023-11-28T13:03:22.602384+0000","last_peered":"2023-11-28T13:03:22.602384+0000","last_clean":"2023-11-28T13:03:22.602384+0000","last_became_active":"2023-11-28T13:03:22.600121+0000","last_became_peered":"2023-11-28T13:03:22.600121+0000","last_unstale":"2023-11-28T13:03:22.602384+0000","last_undegraded":"2023-11-28T13:03:22.602384+0000","last_fullsized":"2023-11-28T13:03:22.602384+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:28.476098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.579911+0000","last_change":"2023-11-28T13:03:22.591388+0000","last_active":"2023-11-28T13:03:23.579911+0000","last_peered":"2023-11-28T13:03:23.579911+0000","last_clean":"2023-11-28T13:03:23.579911+0000","last_became_active":"2023-11-28T13:03:22.590991+0000","last_became_peered":"2023-11-28T13:03:22.590991+0000","last_unstale":"2023-11-28T13:03:23.579911+0000","last_undegraded":"2023-11-28T13:03:23.579911+0000","last_fullsized":"2023-11-28T13:03:23.579911+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:56:01.463549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.593807+0000","last_change":"2023-11-28T13:03:22.590973+0000","last_active":"2023-11-28T13:03:22.593807+0000","last_peered":"2023-11-28T13:03:22.593807+0000","last_clean":"2023-11-28T13:03:22.593807+0000","last_became_active":"2023-11-28T13:03:22.590656+0000","last_became_peered":"2023-11-28T13:03:22.590656+0000","last_unstale":"2023-11-28T13:03:22.593807+0000","last_undegraded":"2023-11-28T13:03:22.593807+0000","last_fullsized":"2023-11-28T13:03:22.593807+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:58:38.332925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.602677+0000","last_change":"2023-11-28T13:03:22.600614+0000","last_active":"2023-11-28T13:03:22.602677+0000","last_peered":"2023-11-28T13:03:22.602677+0000","last_clean":"2023-11-28T13:03:22.602677+0000","last_became_active":"2023-11-28T13:03:22.600349+0000","last_became_peered":"2023-11-28T13:03:22.600349+0000","last_unstale":"2023-11-28T13:03:22.602677+0000","last_undegraded":"2023-11-28T13:03:22.602677+0000","last_fullsized":"2023-11-28T13:03:22.602677+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:08.354045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.584006+0000","last_change":"2023-11-28T13:03:22.593144+0000","last_active":"2023-11-28T13:03:23.584006+0000","last_peered":"2023-11-28T13:03:23.584006+0000","last_clean":"2023-11-28T13:03:23.584006+0000","last_became_active":"2023-11-28T13:03:22.590281+0000","last_became_peered":"2023-11-28T13:03:22.590281+0000","last_unstale":"2023-11-28T13:03:23.584006+0000","last_undegraded":"2023-11-28T13:03:23.584006+0000","last_fullsized":"2023-11-28T13:03:23.584006+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:07:36.130795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583796+0000","last_change":"2023-11-28T13:03:22.593551+0000","last_active":"2023-11-28T13:03:23.583796+0000","last_peered":"2023-11-28T13:03:23.583796+0000","last_clean":"2023-11-28T13:03:23.583796+0000","last_became_active":"2023-11-28T13:03:22.593262+0000","last_became_peered":"2023-11-28T13:03:22.593262+0000","last_unstale":"2023-11-28T13:03:23.583796+0000","last_undegraded":"2023-11-28T13:03:23.583796+0000","last_fullsized":"2023-11-28T13:03:23.583796+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:27:39.383767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.582302+0000","last_change":"2023-11-28T13:03:22.586158+0000","last_active":"2023-11-28T13:03:23.582302+0000","last_peered":"2023-11-28T13:03:23.582302+0000","last_clean":"2023-11-28T13:03:23.582302+0000","last_became_active":"2023-11-28T13:03:22.585874+0000","last_became_peered":"2023-11-28T13:03:22.585874+0000","last_unstale":"2023-11-28T13:03:23.582302+0000","last_undegraded":"2023-11-28T13:03:23.582302+0000","last_fullsized":"2023-11-28T13:03:23.582302+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:39:04.918336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.602661+0000","last_change":"2023-11-28T13:03:22.600590+0000","last_active":"2023-11-28T13:03:22.602661+0000","last_peered":"2023-11-28T13:03:22.602661+0000","last_clean":"2023-11-28T13:03:22.602661+0000","last_became_active":"2023-11-28T13:03:22.600069+0000","last_became_peered":"2023-11-28T13:03:22.600069+0000","last_unstale":"2023-11-28T13:03:22.602661+0000","last_undegraded":"2023-11-28T13:03:22.602661+0000","last_fullsized":"2023-11-28T13:03:22.602661+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:25.321574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.602767+0000","last_change":"2023-11-28T13:03:22.601334+0000","last_active":"2023-11-28T13:03:22.602767+0000","last_peered":"2023-11-28T13:03:22.602767+0000","last_clean":"2023-11-28T13:03:22.602767+0000","last_became_active":"2023-11-28T13:03:22.600196+0000","last_became_peered":"2023-11-28T13:03:22.600196+0000","last_unstale":"2023-11-28T13:03:22.602767+0000","last_undegraded":"2023-11-28T13:03:22.602767+0000","last_fullsized":"2023-11-28T13:03:22.602767+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:39:04.918336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583286+0000","last_change":"2023-11-28T13:03:22.590003+0000","last_active":"2023-11-28T13:03:23.583286+0000","last_peered":"2023-11-28T13:03:23.583286+0000","last_clean":"2023-11-28T13:03:23.583286+0000","last_became_active":"2023-11-28T13:03:22.589486+0000","last_became_peered":"2023-11-28T13:03:22.589486+0000","last_unstale":"2023-11-28T13:03:23.583286+0000","last_undegraded":"2023-11-28T13:03:23.583286+0000","last_fullsized":"2023-11-28T13:03:23.583286+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:19.482655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583287+0000","last_change":"2023-11-28T13:03:22.590275+0000","last_active":"2023-11-28T13:03:23.583287+0000","last_peered":"2023-11-28T13:03:23.583287+0000","last_clean":"2023-11-28T13:03:23.583287+0000","last_became_active":"2023-11-28T13:03:22.589610+0000","last_became_peered":"2023-11-28T13:03:22.589610+0000","last_unstale":"2023-11-28T13:03:23.583287+0000","last_undegraded":"2023-11-28T13:03:23.583287+0000","last_fullsized":"2023-11-28T13:03:23.583287+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:57.330263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.605842+0000","last_change":"2023-11-28T13:03:22.600952+0000","last_active":"2023-11-28T13:03:22.605842+0000","last_peered":"2023-11-28T13:03:22.605842+0000","last_clean":"2023-11-28T13:03:22.605842+0000","last_became_active":"2023-11-28T13:03:22.600751+0000","last_became_peered":"2023-11-28T13:03:22.600751+0000","last_unstale":"2023-11-28T13:03:22.605842+0000","last_undegraded":"2023-11-28T13:03:22.605842+0000","last_fullsized":"2023-11-28T13:03:22.605842+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:48.846102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.592465+0000","last_change":"2023-11-28T13:03:22.588027+0000","last_active":"2023-11-28T13:03:22.592465+0000","last_peered":"2023-11-28T13:03:22.592465+0000","last_clean":"2023-11-28T13:03:22.592465+0000","last_became_active":"2023-11-28T13:03:22.587788+0000","last_became_peered":"2023-11-28T13:03:22.587788+0000","last_unstale":"2023-11-28T13:03:22.592465+0000","last_undegraded":"2023-11-28T13:03:22.592465+0000","last_fullsized":"2023-11-28T13:03:22.592465+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:11.497698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.582474+0000","last_change":"2023-11-28T13:03:22.588361+0000","last_active":"2023-11-28T13:03:23.582474+0000","last_peered":"2023-11-28T13:03:23.582474+0000","last_clean":"2023-11-28T13:03:23.582474+0000","last_became_active":"2023-11-28T13:03:22.588012+0000","last_became_peered":"2023-11-28T13:03:22.588012+0000","last_unstale":"2023-11-28T13:03:23.582474+0000","last_undegraded":"2023-11-28T13:03:23.582474+0000","last_fullsized":"2023-11-28T13:03:23.582474+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:25.321574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.595418+0000","last_change":"2023-11-28T13:03:22.592356+0000","last_active":"2023-11-28T13:03:22.595418+0000","last_peered":"2023-11-28T13:03:22.595418+0000","last_clean":"2023-11-28T13:03:22.595418+0000","last_became_active":"2023-11-28T13:03:22.592107+0000","last_became_peered":"2023-11-28T13:03:22.592107+0000","last_unstale":"2023-11-28T13:03:22.595418+0000","last_undegraded":"2023-11-28T13:03:22.595418+0000","last_fullsized":"2023-11-28T13:03:22.595418+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:42:28.513490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.593203+0000","last_change":"2023-11-28T13:03:22.587139+0000","last_active":"2023-11-28T13:03:22.593203+0000","last_peered":"2023-11-28T13:03:22.593203+0000","last_clean":"2023-11-28T13:03:22.593203+0000","last_became_active":"2023-11-28T13:03:22.586858+0000","last_became_peered":"2023-11-28T13:03:22.586858+0000","last_unstale":"2023-11-28T13:03:22.593203+0000","last_undegraded":"2023-11-28T13:03:22.593203+0000","last_fullsized":"2023-11-28T13:03:22.593203+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:10.992345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.599080+0000","last_change":"2023-11-28T13:03:22.592952+0000","last_active":"2023-11-28T13:03:22.599080+0000","last_peered":"2023-11-28T13:03:22.599080+0000","last_clean":"2023-11-28T13:03:22.599080+0000","last_became_active":"2023-11-28T13:03:22.592688+0000","last_became_peered":"2023-11-28T13:03:22.592688+0000","last_unstale":"2023-11-28T13:03:22.599080+0000","last_undegraded":"2023-11-28T13:03:22.599080+0000","last_fullsized":"2023-11-28T13:03:22.599080+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:35:54.250623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.594371+0000","last_change":"2023-11-28T13:03:22.590374+0000","last_active":"2023-11-28T13:03:22.594371+0000","last_peered":"2023-11-28T13:03:22.594371+0000","last_clean":"2023-11-28T13:03:22.594371+0000","last_became_active":"2023-11-28T13:03:22.589955+0000","last_became_peered":"2023-11-28T13:03:22.589955+0000","last_unstale":"2023-11-28T13:03:22.594371+0000","last_undegraded":"2023-11-28T13:03:22.594371+0000","last_fullsized":"2023-11-28T13:03:22.594371+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:09.527183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.582213+0000","last_change":"2023-11-28T13:03:22.578789+0000","last_active":"2023-11-28T13:03:22.582213+0000","last_peered":"2023-11-28T13:03:22.582213+0000","last_clean":"2023-11-28T13:03:22.582213+0000","last_became_active":"2023-11-28T13:03:22.578572+0000","last_became_peered":"2023-11-28T13:03:22.578572+0000","last_unstale":"2023-11-28T13:03:22.582213+0000","last_undegraded":"2023-11-28T13:03:22.582213+0000","last_fullsized":"2023-11-28T13:03:22.582213+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:56:01.463549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.582823+0000","last_change":"2023-11-28T13:03:22.590471+0000","last_active":"2023-11-28T13:03:23.582823+0000","last_peered":"2023-11-28T13:03:23.582823+0000","last_clean":"2023-11-28T13:03:23.582823+0000","last_became_active":"2023-11-28T13:03:22.589589+0000","last_became_peered":"2023-11-28T13:03:22.589589+0000","last_unstale":"2023-11-28T13:03:23.582823+0000","last_undegraded":"2023-11-28T13:03:23.582823+0000","last_fullsized":"2023-11-28T13:03:23.582823+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:44.960111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.601558+0000","last_change":"2023-11-28T13:03:22.599082+0000","last_active":"2023-11-28T13:03:22.601558+0000","last_peered":"2023-11-28T13:03:22.601558+0000","last_clean":"2023-11-28T13:03:22.601558+0000","last_became_active":"2023-11-28T13:03:22.598797+0000","last_became_peered":"2023-11-28T13:03:22.598797+0000","last_unstale":"2023-11-28T13:03:22.601558+0000","last_undegraded":"2023-11-28T13:03:22.601558+0000","last_fullsized":"2023-11-28T13:03:22.601558+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:07.686565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.598209+0000","last_change":"2023-11-28T13:03:22.591217+0000","last_active":"2023-11-28T13:03:22.598209+0000","last_peered":"2023-11-28T13:03:22.598209+0000","last_clean":"2023-11-28T13:03:22.598209+0000","last_became_active":"2023-11-28T13:03:22.590743+0000","last_became_peered":"2023-11-28T13:03:22.590743+0000","last_unstale":"2023-11-28T13:03:22.598209+0000","last_undegraded":"2023-11-28T13:03:22.598209+0000","last_fullsized":"2023-11-28T13:03:22.598209+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:07:36.130795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.582426+0000","last_change":"2023-11-28T13:03:22.591684+0000","last_active":"2023-11-28T13:03:23.582426+0000","last_peered":"2023-11-28T13:03:23.582426+0000","last_clean":"2023-11-28T13:03:23.582426+0000","last_became_active":"2023-11-28T13:03:22.590910+0000","last_became_peered":"2023-11-28T13:03:22.590910+0000","last_unstale":"2023-11-28T13:03:23.582426+0000","last_undegraded":"2023-11-28T13:03:23.582426+0000","last_fullsized":"2023-11-28T13:03:23.582426+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:53:03.697888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.592119+0000","last_change":"2023-11-28T13:03:22.587975+0000","last_active":"2023-11-28T13:03:22.592119+0000","last_peered":"2023-11-28T13:03:22.592119+0000","last_clean":"2023-11-28T13:03:22.592119+0000","last_became_active":"2023-11-28T13:03:22.587411+0000","last_became_peered":"2023-11-28T13:03:22.587411+0000","last_unstale":"2023-11-28T13:03:22.592119+0000","last_undegraded":"2023-11-28T13:03:22.592119+0000","last_fullsized":"2023-11-28T13:03:22.592119+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:33:42.883651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583570+0000","last_change":"2023-11-28T13:03:22.590129+0000","last_active":"2023-11-28T13:03:23.583570+0000","last_peered":"2023-11-28T13:03:23.583570+0000","last_clean":"2023-11-28T13:03:23.583570+0000","last_became_active":"2023-11-28T13:03:22.589704+0000","last_became_peered":"2023-11-28T13:03:22.589704+0000","last_unstale":"2023-11-28T13:03:23.583570+0000","last_undegraded":"2023-11-28T13:03:23.583570+0000","last_fullsized":"2023-11-28T13:03:23.583570+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:25.321574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.601759+0000","last_change":"2023-11-28T13:03:22.599704+0000","last_active":"2023-11-28T13:03:22.601759+0000","last_peered":"2023-11-28T13:03:22.601759+0000","last_clean":"2023-11-28T13:03:22.601759+0000","last_became_active":"2023-11-28T13:03:22.599426+0000","last_became_peered":"2023-11-28T13:03:22.599426+0000","last_unstale":"2023-11-28T13:03:22.601759+0000","last_undegraded":"2023-11-28T13:03:22.601759+0000","last_fullsized":"2023-11-28T13:03:22.601759+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:19.482655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.581604+0000","last_change":"2023-11-28T13:03:22.583866+0000","last_active":"2023-11-28T13:03:23.581604+0000","last_peered":"2023-11-28T13:03:23.581604+0000","last_clean":"2023-11-28T13:03:23.581604+0000","last_became_active":"2023-11-28T13:03:22.583538+0000","last_became_peered":"2023-11-28T13:03:22.583538+0000","last_unstale":"2023-11-28T13:03:23.581604+0000","last_undegraded":"2023-11-28T13:03:23.581604+0000","last_fullsized":"2023-11-28T13:03:23.581604+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:11:17.241400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.579306+0000","last_change":"2023-11-28T13:03:22.586489+0000","last_active":"2023-11-28T13:03:23.579306+0000","last_peered":"2023-11-28T13:03:23.579306+0000","last_clean":"2023-11-28T13:03:23.579306+0000","last_became_active":"2023-11-28T13:03:22.585975+0000","last_became_peered":"2023-11-28T13:03:22.585975+0000","last_unstale":"2023-11-28T13:03:23.579306+0000","last_undegraded":"2023-11-28T13:03:23.579306+0000","last_fullsized":"2023-11-28T13:03:23.579306+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:50.289538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.598516+0000","last_change":"2023-11-28T13:03:22.593625+0000","last_active":"2023-11-28T13:03:22.598516+0000","last_peered":"2023-11-28T13:03:22.598516+0000","last_clean":"2023-11-28T13:03:22.598516+0000","last_became_active":"2023-11-28T13:03:22.593347+0000","last_became_peered":"2023-11-28T13:03:22.593347+0000","last_unstale":"2023-11-28T13:03:22.598516+0000","last_undegraded":"2023-11-28T13:03:22.598516+0000","last_fullsized":"2023-11-28T13:03:22.598516+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:31:42.081976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"64'4","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.599185+0000","last_change":"2023-11-28T13:03:22.217911+0000","last_active":"2023-11-28T13:03:22.599185+0000","last_peered":"2023-11-28T13:03:22.599185+0000","last_clean":"2023-11-28T13:03:22.599185+0000","last_became_active":"2023-11-28T13:03:22.217281+0000","last_became_peered":"2023-11-28T13:03:22.217281+0000","last_unstale":"2023-11-28T13:03:22.599185+0000","last_undegraded":"2023-11-28T13:03:22.599185+0000","last_fullsized":"2023-11-28T13:03:22.599185+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:26:14.756184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.582540+0000","last_change":"2023-11-28T13:03:22.594715+0000","last_active":"2023-11-28T13:03:23.582540+0000","last_peered":"2023-11-28T13:03:23.582540+0000","last_clean":"2023-11-28T13:03:23.582540+0000","last_became_active":"2023-11-28T13:03:22.594193+0000","last_became_peered":"2023-11-28T13:03:22.594193+0000","last_unstale":"2023-11-28T13:03:23.582540+0000","last_undegraded":"2023-11-28T13:03:23.582540+0000","last_fullsized":"2023-11-28T13:03:23.582540+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:35:54.250623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"64'1","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.579967+0000","last_change":"2023-11-28T13:03:22.216924+0000","last_active":"2023-11-28T13:03:23.579967+0000","last_peered":"2023-11-28T13:03:23.579967+0000","last_clean":"2023-11-28T13:03:23.579967+0000","last_became_active":"2023-11-28T13:03:22.216620+0000","last_became_peered":"2023-11-28T13:03:22.216620+0000","last_unstale":"2023-11-28T13:03:23.579967+0000","last_undegraded":"2023-11-28T13:03:23.579967+0000","last_fullsized":"2023-11-28T13:03:23.579967+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:13.038263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.579908+0000","last_change":"2023-11-28T13:03:22.586436+0000","last_active":"2023-11-28T13:03:23.579908+0000","last_peered":"2023-11-28T13:03:23.579908+0000","last_clean":"2023-11-28T13:03:23.579908+0000","last_became_active":"2023-11-28T13:03:22.586158+0000","last_became_peered":"2023-11-28T13:03:22.586158+0000","last_unstale":"2023-11-28T13:03:23.579908+0000","last_undegraded":"2023-11-28T13:03:23.579908+0000","last_fullsized":"2023-11-28T13:03:23.579908+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:09.527183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.579893+0000","last_change":"2023-11-28T13:03:22.218179+0000","last_active":"2023-11-28T13:03:23.579893+0000","last_peered":"2023-11-28T13:03:23.579893+0000","last_clean":"2023-11-28T13:03:23.579893+0000","last_became_active":"2023-11-28T13:03:22.217858+0000","last_became_peered":"2023-11-28T13:03:22.217858+0000","last_unstale":"2023-11-28T13:03:23.579893+0000","last_undegraded":"2023-11-28T13:03:23.579893+0000","last_fullsized":"2023-11-28T13:03:23.579893+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:41:57.907090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583908+0000","last_change":"2023-11-28T13:03:22.590260+0000","last_active":"2023-11-28T13:03:23.583908+0000","last_peered":"2023-11-28T13:03:23.583908+0000","last_clean":"2023-11-28T13:03:23.583908+0000","last_became_active":"2023-11-28T13:03:22.589920+0000","last_became_peered":"2023-11-28T13:03:22.589920+0000","last_unstale":"2023-11-28T13:03:23.583908+0000","last_undegraded":"2023-11-28T13:03:23.583908+0000","last_fullsized":"2023-11-28T13:03:23.583908+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:14.042779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.580021+0000","last_change":"2023-11-28T13:03:22.220912+0000","last_active":"2023-11-28T13:03:23.580021+0000","last_peered":"2023-11-28T13:03:23.580021+0000","last_clean":"2023-11-28T13:03:23.580021+0000","last_became_active":"2023-11-28T13:03:22.220603+0000","last_became_peered":"2023-11-28T13:03:22.220603+0000","last_unstale":"2023-11-28T13:03:23.580021+0000","last_undegraded":"2023-11-28T13:03:23.580021+0000","last_fullsized":"2023-11-28T13:03:23.580021+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:27:38.379252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.587592+0000","last_change":"2023-11-28T13:03:22.581285+0000","last_active":"2023-11-28T13:03:22.587592+0000","last_peered":"2023-11-28T13:03:22.587592+0000","last_clean":"2023-11-28T13:03:22.587592+0000","last_became_active":"2023-11-28T13:03:22.580830+0000","last_became_peered":"2023-11-28T13:03:22.580830+0000","last_unstale":"2023-11-28T13:03:22.587592+0000","last_undegraded":"2023-11-28T13:03:22.587592+0000","last_fullsized":"2023-11-28T13:03:22.587592+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:11:08.383772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.592182+0000","last_change":"2023-11-28T13:03:22.213936+0000","last_active":"2023-11-28T13:03:22.592182+0000","last_peered":"2023-11-28T13:03:22.592182+0000","last_clean":"2023-11-28T13:03:22.592182+0000","last_became_active":"2023-11-28T13:03:22.213398+0000","last_became_peered":"2023-11-28T13:03:22.213398+0000","last_unstale":"2023-11-28T13:03:22.592182+0000","last_undegraded":"2023-11-28T13:03:22.592182+0000","last_fullsized":"2023-11-28T13:03:22.592182+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:13.038263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.593330+0000","last_change":"2023-11-28T13:03:22.590765+0000","last_active":"2023-11-28T13:03:22.593330+0000","last_peered":"2023-11-28T13:03:22.593330+0000","last_clean":"2023-11-28T13:03:22.593330+0000","last_became_active":"2023-11-28T13:03:22.590398+0000","last_became_peered":"2023-11-28T13:03:22.590398+0000","last_unstale":"2023-11-28T13:03:22.593330+0000","last_undegraded":"2023-11-28T13:03:22.593330+0000","last_fullsized":"2023-11-28T13:03:22.593330+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:42.379047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.589109+0000","last_change":"2023-11-28T13:03:22.209057+0000","last_active":"2023-11-28T13:03:22.589109+0000","last_peered":"2023-11-28T13:03:22.589109+0000","last_clean":"2023-11-28T13:03:22.589109+0000","last_became_active":"2023-11-28T13:03:22.208757+0000","last_became_peered":"2023-11-28T13:03:22.208757+0000","last_unstale":"2023-11-28T13:03:22.589109+0000","last_undegraded":"2023-11-28T13:03:22.589109+0000","last_fullsized":"2023-11-28T13:03:22.589109+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:28:31.792152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.599859+0000","last_change":"2023-11-28T13:03:22.596917+0000","last_active":"2023-11-28T13:03:22.599859+0000","last_peered":"2023-11-28T13:03:22.599859+0000","last_clean":"2023-11-28T13:03:22.599859+0000","last_became_active":"2023-11-28T13:03:22.596638+0000","last_became_peered":"2023-11-28T13:03:22.596638+0000","last_unstale":"2023-11-28T13:03:22.599859+0000","last_undegraded":"2023-11-28T13:03:22.599859+0000","last_fullsized":"2023-11-28T13:03:22.599859+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:17:53.618520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.572139+0000","last_change":"2023-11-28T13:03:22.215095+0000","last_active":"2023-11-28T13:03:22.572139+0000","last_peered":"2023-11-28T13:03:22.572139+0000","last_clean":"2023-11-28T13:03:22.572139+0000","last_became_active":"2023-11-28T13:03:22.214252+0000","last_became_peered":"2023-11-28T13:03:22.214252+0000","last_unstale":"2023-11-28T13:03:22.572139+0000","last_undegraded":"2023-11-28T13:03:22.572139+0000","last_fullsized":"2023-11-28T13:03:22.572139+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:27:38.379252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.593275+0000","last_change":"2023-11-28T13:03:22.587443+0000","last_active":"2023-11-28T13:03:22.593275+0000","last_peered":"2023-11-28T13:03:22.593275+0000","last_clean":"2023-11-28T13:03:22.593275+0000","last_became_active":"2023-11-28T13:03:22.587175+0000","last_became_peered":"2023-11-28T13:03:22.587175+0000","last_unstale":"2023-11-28T13:03:22.593275+0000","last_undegraded":"2023-11-28T13:03:22.593275+0000","last_fullsized":"2023-11-28T13:03:22.593275+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:50.289538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.581617+0000","last_change":"2023-11-28T13:03:22.214526+0000","last_active":"2023-11-28T13:03:22.581617+0000","last_peered":"2023-11-28T13:03:22.581617+0000","last_clean":"2023-11-28T13:03:22.581617+0000","last_became_active":"2023-11-28T13:03:22.214097+0000","last_became_peered":"2023-11-28T13:03:22.214097+0000","last_unstale":"2023-11-28T13:03:22.581617+0000","last_undegraded":"2023-11-28T13:03:22.581617+0000","last_fullsized":"2023-11-28T13:03:22.581617+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:02:30.896691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.592136+0000","last_change":"2023-11-28T13:03:22.588140+0000","last_active":"2023-11-28T13:03:22.592136+0000","last_peered":"2023-11-28T13:03:22.592136+0000","last_clean":"2023-11-28T13:03:22.592136+0000","last_became_active":"2023-11-28T13:03:22.587732+0000","last_became_peered":"2023-11-28T13:03:22.587732+0000","last_unstale":"2023-11-28T13:03:22.592136+0000","last_undegraded":"2023-11-28T13:03:22.592136+0000","last_fullsized":"2023-11-28T13:03:22.592136+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:23:40.308635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.584055+0000","last_change":"2023-11-28T13:03:22.220685+0000","last_active":"2023-11-28T13:03:23.584055+0000","last_peered":"2023-11-28T13:03:23.584055+0000","last_clean":"2023-11-28T13:03:23.584055+0000","last_became_active":"2023-11-28T13:03:22.220370+0000","last_became_peered":"2023-11-28T13:03:22.220370+0000","last_unstale":"2023-11-28T13:03:23.584055+0000","last_undegraded":"2023-11-28T13:03:23.584055+0000","last_fullsized":"2023-11-28T13:03:23.584055+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:24:29.583757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.600373+0000","last_change":"2023-11-28T13:03:22.599387+0000","last_active":"2023-11-28T13:03:22.600373+0000","last_peered":"2023-11-28T13:03:22.600373+0000","last_clean":"2023-11-28T13:03:22.600373+0000","last_became_active":"2023-11-28T13:03:22.599078+0000","last_became_peered":"2023-11-28T13:03:22.599078+0000","last_unstale":"2023-11-28T13:03:22.600373+0000","last_undegraded":"2023-11-28T13:03:22.600373+0000","last_fullsized":"2023-11-28T13:03:22.600373+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:28:28.010139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.582847+0000","last_change":"2023-11-28T13:03:22.215131+0000","last_active":"2023-11-28T13:03:23.582847+0000","last_peered":"2023-11-28T13:03:23.582847+0000","last_clean":"2023-11-28T13:03:23.582847+0000","last_became_active":"2023-11-28T13:03:22.212703+0000","last_became_peered":"2023-11-28T13:03:22.212703+0000","last_unstale":"2023-11-28T13:03:23.582847+0000","last_undegraded":"2023-11-28T13:03:23.582847+0000","last_fullsized":"2023-11-28T13:03:23.582847+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:50.259016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.601198+0000","last_change":"2023-11-28T13:03:22.598974+0000","last_active":"2023-11-28T13:03:22.601198+0000","last_peered":"2023-11-28T13:03:22.601198+0000","last_clean":"2023-11-28T13:03:22.601198+0000","last_became_active":"2023-11-28T13:03:22.598603+0000","last_became_peered":"2023-11-28T13:03:22.598603+0000","last_unstale":"2023-11-28T13:03:22.601198+0000","last_undegraded":"2023-11-28T13:03:22.601198+0000","last_fullsized":"2023-11-28T13:03:22.601198+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:18:53.538019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"64'3","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583600+0000","last_change":"2023-11-28T13:03:22.217758+0000","last_active":"2023-11-28T13:03:23.583600+0000","last_peered":"2023-11-28T13:03:23.583600+0000","last_clean":"2023-11-28T13:03:23.583600+0000","last_became_active":"2023-11-28T13:03:22.217159+0000","last_became_peered":"2023-11-28T13:03:22.217159+0000","last_unstale":"2023-11-28T13:03:23.583600+0000","last_undegraded":"2023-11-28T13:03:23.583600+0000","last_fullsized":"2023-11-28T13:03:23.583600+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:48.420418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.582930+0000","last_change":"2023-11-28T13:03:22.583841+0000","last_active":"2023-11-28T13:03:23.582930+0000","last_peered":"2023-11-28T13:03:23.582930+0000","last_clean":"2023-11-28T13:03:23.582930+0000","last_became_active":"2023-11-28T13:03:22.583525+0000","last_became_peered":"2023-11-28T13:03:22.583525+0000","last_unstale":"2023-11-28T13:03:23.582930+0000","last_undegraded":"2023-11-28T13:03:23.582930+0000","last_fullsized":"2023-11-28T13:03:23.582930+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:14:13.736222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"64'6","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.605768+0000","last_change":"2023-11-28T13:03:22.219886+0000","last_active":"2023-11-28T13:03:22.605768+0000","last_peered":"2023-11-28T13:03:22.605768+0000","last_clean":"2023-11-28T13:03:22.605768+0000","last_became_active":"2023-11-28T13:03:22.219554+0000","last_became_peered":"2023-11-28T13:03:22.219554+0000","last_unstale":"2023-11-28T13:03:22.605768+0000","last_undegraded":"2023-11-28T13:03:22.605768+0000","last_fullsized":"2023-11-28T13:03:22.605768+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:31:41.077461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.581566+0000","last_change":"2023-11-28T13:03:22.595308+0000","last_active":"2023-11-28T13:03:23.581566+0000","last_peered":"2023-11-28T13:03:23.581566+0000","last_clean":"2023-11-28T13:03:23.581566+0000","last_became_active":"2023-11-28T13:03:22.594788+0000","last_became_peered":"2023-11-28T13:03:22.594788+0000","last_unstale":"2023-11-28T13:03:23.581566+0000","last_undegraded":"2023-11-28T13:03:23.581566+0000","last_fullsized":"2023-11-28T13:03:23.581566+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:11.497698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583597+0000","last_change":"2023-11-28T13:03:22.214081+0000","last_active":"2023-11-28T13:03:23.583597+0000","last_peered":"2023-11-28T13:03:23.583597+0000","last_clean":"2023-11-28T13:03:23.583597+0000","last_became_active":"2023-11-28T13:03:22.213791+0000","last_became_peered":"2023-11-28T13:03:22.213791+0000","last_unstale":"2023-11-28T13:03:23.583597+0000","last_undegraded":"2023-11-28T13:03:23.583597+0000","last_fullsized":"2023-11-28T13:03:23.583597+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:59.926362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.601560+0000","last_change":"2023-11-28T13:03:22.598949+0000","last_active":"2023-11-28T13:03:22.601560+0000","last_peered":"2023-11-28T13:03:22.601560+0000","last_clean":"2023-11-28T13:03:22.601560+0000","last_became_active":"2023-11-28T13:03:22.598680+0000","last_became_peered":"2023-11-28T13:03:22.598680+0000","last_unstale":"2023-11-28T13:03:22.601560+0000","last_undegraded":"2023-11-28T13:03:22.601560+0000","last_fullsized":"2023-11-28T13:03:22.601560+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:44.960111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.582012+0000","last_change":"2023-11-28T13:03:22.217602+0000","last_active":"2023-11-28T13:03:22.582012+0000","last_peered":"2023-11-28T13:03:22.582012+0000","last_clean":"2023-11-28T13:03:22.582012+0000","last_became_active":"2023-11-28T13:03:22.217333+0000","last_became_peered":"2023-11-28T13:03:22.217333+0000","last_unstale":"2023-11-28T13:03:22.582012+0000","last_undegraded":"2023-11-28T13:03:22.582012+0000","last_fullsized":"2023-11-28T13:03:22.582012+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:27.471582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.598554+0000","last_change":"2023-11-28T13:03:22.594213+0000","last_active":"2023-11-28T13:03:22.598554+0000","last_peered":"2023-11-28T13:03:22.598554+0000","last_clean":"2023-11-28T13:03:22.598554+0000","last_became_active":"2023-11-28T13:03:22.593526+0000","last_became_peered":"2023-11-28T13:03:22.593526+0000","last_unstale":"2023-11-28T13:03:22.598554+0000","last_undegraded":"2023-11-28T13:03:22.598554+0000","last_fullsized":"2023-11-28T13:03:22.598554+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:27:16.341905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583417+0000","last_change":"2023-11-28T13:03:22.213474+0000","last_active":"2023-11-28T13:03:23.583417+0000","last_peered":"2023-11-28T13:03:23.583417+0000","last_clean":"2023-11-28T13:03:23.583417+0000","last_became_active":"2023-11-28T13:03:22.213133+0000","last_became_peered":"2023-11-28T13:03:22.213133+0000","last_unstale":"2023-11-28T13:03:23.583417+0000","last_undegraded":"2023-11-28T13:03:23.583417+0000","last_fullsized":"2023-11-28T13:03:23.583417+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:23:39.304120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.603095+0000","last_change":"2023-11-28T13:03:22.599257+0000","last_active":"2023-11-28T13:03:22.603095+0000","last_peered":"2023-11-28T13:03:22.603095+0000","last_clean":"2023-11-28T13:03:22.603095+0000","last_became_active":"2023-11-28T13:03:22.598934+0000","last_became_peered":"2023-11-28T13:03:22.598934+0000","last_unstale":"2023-11-28T13:03:22.603095+0000","last_undegraded":"2023-11-28T13:03:22.603095+0000","last_fullsized":"2023-11-28T13:03:22.603095+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:00:15.442831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"64'8","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.581466+0000","last_change":"2023-11-28T13:03:22.211956+0000","last_active":"2023-11-28T13:03:23.581466+0000","last_peered":"2023-11-28T13:03:23.581466+0000","last_clean":"2023-11-28T13:03:23.581466+0000","last_became_active":"2023-11-28T13:03:22.210914+0000","last_became_peered":"2023-11-28T13:03:22.210914+0000","last_unstale":"2023-11-28T13:03:23.581466+0000","last_undegraded":"2023-11-28T13:03:23.581466+0000","last_fullsized":"2023-11-28T13:03:23.581466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:17:40.704187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.579803+0000","last_change":"2023-11-28T13:03:22.585767+0000","last_active":"2023-11-28T13:03:23.579803+0000","last_peered":"2023-11-28T13:03:23.579803+0000","last_clean":"2023-11-28T13:03:23.579803+0000","last_became_active":"2023-11-28T13:03:22.585370+0000","last_became_peered":"2023-11-28T13:03:22.585370+0000","last_unstale":"2023-11-28T13:03:23.579803+0000","last_undegraded":"2023-11-28T13:03:23.579803+0000","last_fullsized":"2023-11-28T13:03:23.579803+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:10.992345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"64'2","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.600051+0000","last_change":"2023-11-28T13:03:22.216467+0000","last_active":"2023-11-28T13:03:22.600051+0000","last_peered":"2023-11-28T13:03:22.600051+0000","last_clean":"2023-11-28T13:03:22.600051+0000","last_became_active":"2023-11-28T13:03:22.216118+0000","last_became_peered":"2023-11-28T13:03:22.216118+0000","last_unstale":"2023-11-28T13:03:22.600051+0000","last_undegraded":"2023-11-28T13:03:22.600051+0000","last_fullsized":"2023-11-28T13:03:22.600051+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:17:52.614005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.591852+0000","last_change":"2023-11-28T13:03:22.587818+0000","last_active":"2023-11-28T13:03:22.591852+0000","last_peered":"2023-11-28T13:03:22.591852+0000","last_clean":"2023-11-28T13:03:22.591852+0000","last_became_active":"2023-11-28T13:03:22.586011+0000","last_became_peered":"2023-11-28T13:03:22.586011+0000","last_unstale":"2023-11-28T13:03:22.591852+0000","last_undegraded":"2023-11-28T13:03:22.591852+0000","last_fullsized":"2023-11-28T13:03:22.591852+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:22.218257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.586241+0000","last_change":"2023-11-28T13:03:22.210468+0000","last_active":"2023-11-28T13:03:22.586241+0000","last_peered":"2023-11-28T13:03:22.586241+0000","last_clean":"2023-11-28T13:03:22.586241+0000","last_became_active":"2023-11-28T13:03:22.210153+0000","last_became_peered":"2023-11-28T13:03:22.210153+0000","last_unstale":"2023-11-28T13:03:22.586241+0000","last_undegraded":"2023-11-28T13:03:22.586241+0000","last_fullsized":"2023-11-28T13:03:22.586241+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:42:27.508975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.599944+0000","last_change":"2023-11-28T13:03:22.597049+0000","last_active":"2023-11-28T13:03:22.599944+0000","last_peered":"2023-11-28T13:03:22.599944+0000","last_clean":"2023-11-28T13:03:22.599944+0000","last_became_active":"2023-11-28T13:03:22.596605+0000","last_became_peered":"2023-11-28T13:03:22.596605+0000","last_unstale":"2023-11-28T13:03:22.599944+0000","last_undegraded":"2023-11-28T13:03:22.599944+0000","last_fullsized":"2023-11-28T13:03:22.599944+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:03.750408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.579799+0000","last_change":"2023-11-28T13:03:22.219417+0000","last_active":"2023-11-28T13:03:23.579799+0000","last_peered":"2023-11-28T13:03:23.579799+0000","last_clean":"2023-11-28T13:03:23.579799+0000","last_became_active":"2023-11-28T13:03:22.219071+0000","last_became_peered":"2023-11-28T13:03:22.219071+0000","last_unstale":"2023-11-28T13:03:23.579799+0000","last_undegraded":"2023-11-28T13:03:23.579799+0000","last_fullsized":"2023-11-28T13:03:23.579799+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:28:31.792152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.595356+0000","last_change":"2023-11-28T13:03:22.589754+0000","last_active":"2023-11-28T13:03:22.595356+0000","last_peered":"2023-11-28T13:03:22.595356+0000","last_clean":"2023-11-28T13:03:22.595356+0000","last_became_active":"2023-11-28T13:03:22.589355+0000","last_became_peered":"2023-11-28T13:03:22.589355+0000","last_unstale":"2023-11-28T13:03:22.595356+0000","last_undegraded":"2023-11-28T13:03:22.595356+0000","last_fullsized":"2023-11-28T13:03:22.595356+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:17:41.708703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.579384+0000","last_change":"2023-11-28T13:03:22.218122+0000","last_active":"2023-11-28T13:03:22.579384+0000","last_peered":"2023-11-28T13:03:22.579384+0000","last_clean":"2023-11-28T13:03:22.579384+0000","last_became_active":"2023-11-28T13:03:22.217893+0000","last_became_peered":"2023-11-28T13:03:22.217893+0000","last_unstale":"2023-11-28T13:03:22.579384+0000","last_undegraded":"2023-11-28T13:03:22.579384+0000","last_fullsized":"2023-11-28T13:03:22.579384+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:57.782415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.595375+0000","last_change":"2023-11-28T13:03:22.591773+0000","last_active":"2023-11-28T13:03:22.595375+0000","last_peered":"2023-11-28T13:03:22.595375+0000","last_clean":"2023-11-28T13:03:22.595375+0000","last_became_active":"2023-11-28T13:03:22.591456+0000","last_became_peered":"2023-11-28T13:03:22.591456+0000","last_unstale":"2023-11-28T13:03:22.595375+0000","last_undegraded":"2023-11-28T13:03:22.595375+0000","last_fullsized":"2023-11-28T13:03:22.595375+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:55:57.647268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583802+0000","last_change":"2023-11-28T13:03:22.213530+0000","last_active":"2023-11-28T13:03:23.583802+0000","last_peered":"2023-11-28T13:03:23.583802+0000","last_clean":"2023-11-28T13:03:23.583802+0000","last_became_active":"2023-11-28T13:03:22.213203+0000","last_became_peered":"2023-11-28T13:03:22.213203+0000","last_unstale":"2023-11-28T13:03:23.583802+0000","last_undegraded":"2023-11-28T13:03:23.583802+0000","last_fullsized":"2023-11-28T13:03:23.583802+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:53:02.693373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.581761+0000","last_change":"2023-11-28T13:03:22.591995+0000","last_active":"2023-11-28T13:03:23.581761+0000","last_peered":"2023-11-28T13:03:23.581761+0000","last_clean":"2023-11-28T13:03:23.581761+0000","last_became_active":"2023-11-28T13:03:22.591570+0000","last_became_peered":"2023-11-28T13:03:22.591570+0000","last_unstale":"2023-11-28T13:03:23.581761+0000","last_undegraded":"2023-11-28T13:03:23.581761+0000","last_fullsized":"2023-11-28T13:03:23.581761+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:43.680069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.572099+0000","last_change":"2023-11-28T13:03:22.217841+0000","last_active":"2023-11-28T13:03:22.572099+0000","last_peered":"2023-11-28T13:03:22.572099+0000","last_clean":"2023-11-28T13:03:22.572099+0000","last_became_active":"2023-11-28T13:03:22.217446+0000","last_became_peered":"2023-11-28T13:03:22.217446+0000","last_unstale":"2023-11-28T13:03:22.572099+0000","last_undegraded":"2023-11-28T13:03:22.572099+0000","last_fullsized":"2023-11-28T13:03:22.572099+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:02.745893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.591995+0000","last_change":"2023-11-28T13:03:22.587245+0000","last_active":"2023-11-28T13:03:22.591995+0000","last_peered":"2023-11-28T13:03:22.591995+0000","last_clean":"2023-11-28T13:03:22.591995+0000","last_became_active":"2023-11-28T13:03:22.586988+0000","last_became_peered":"2023-11-28T13:03:22.586988+0000","last_unstale":"2023-11-28T13:03:22.591995+0000","last_undegraded":"2023-11-28T13:03:22.591995+0000","last_fullsized":"2023-11-28T13:03:22.591995+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:43.680069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.571953+0000","last_change":"2023-11-28T13:03:22.215264+0000","last_active":"2023-11-28T13:03:22.571953+0000","last_peered":"2023-11-28T13:03:22.571953+0000","last_clean":"2023-11-28T13:03:22.571953+0000","last_became_active":"2023-11-28T13:03:22.214606+0000","last_became_peered":"2023-11-28T13:03:22.214606+0000","last_unstale":"2023-11-28T13:03:22.571953+0000","last_undegraded":"2023-11-28T13:03:22.571953+0000","last_fullsized":"2023-11-28T13:03:22.571953+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:56.325748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.605805+0000","last_change":"2023-11-28T13:03:22.600967+0000","last_active":"2023-11-28T13:03:22.605805+0000","last_peered":"2023-11-28T13:03:22.605805+0000","last_clean":"2023-11-28T13:03:22.605805+0000","last_became_active":"2023-11-28T13:03:22.600701+0000","last_became_peered":"2023-11-28T13:03:22.600701+0000","last_unstale":"2023-11-28T13:03:22.605805+0000","last_undegraded":"2023-11-28T13:03:22.605805+0000","last_fullsized":"2023-11-28T13:03:22.605805+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:58:08.948259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.578863+0000","last_change":"2023-11-28T13:03:22.213369+0000","last_active":"2023-11-28T13:03:22.578863+0000","last_peered":"2023-11-28T13:03:22.578863+0000","last_clean":"2023-11-28T13:03:22.578863+0000","last_became_active":"2023-11-28T13:03:22.212455+0000","last_became_peered":"2023-11-28T13:03:22.212455+0000","last_unstale":"2023-11-28T13:03:22.578863+0000","last_undegraded":"2023-11-28T13:03:22.578863+0000","last_fullsized":"2023-11-28T13:03:22.578863+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:50.259016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.598581+0000","last_change":"2023-11-28T13:03:22.593684+0000","last_active":"2023-11-28T13:03:22.598581+0000","last_peered":"2023-11-28T13:03:22.598581+0000","last_clean":"2023-11-28T13:03:22.598581+0000","last_became_active":"2023-11-28T13:03:22.593384+0000","last_became_peered":"2023-11-28T13:03:22.593384+0000","last_unstale":"2023-11-28T13:03:22.598581+0000","last_undegraded":"2023-11-28T13:03:22.598581+0000","last_fullsized":"2023-11-28T13:03:22.598581+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:51.263531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.571551+0000","last_change":"2023-11-28T13:03:22.219320+0000","last_active":"2023-11-28T13:03:22.571551+0000","last_peered":"2023-11-28T13:03:22.571551+0000","last_clean":"2023-11-28T13:03:22.571551+0000","last_became_active":"2023-11-28T13:03:22.218826+0000","last_became_peered":"2023-11-28T13:03:22.218826+0000","last_unstale":"2023-11-28T13:03:22.571551+0000","last_undegraded":"2023-11-28T13:03:22.571551+0000","last_fullsized":"2023-11-28T13:03:22.571551+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:41:57.907090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":209,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.573944+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:03:22.573944+0000","last_peered":"2023-11-28T13:03:22.573944+0000","last_clean":"2023-11-28T13:03:22.573944+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:03:22.573944+0000","last_undegraded":"2023-11-28T13:03:22.573944+0000","last_fullsized":"2023-11-28T13:03:22.573944+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.210032+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:03:22.210032+0000","last_peered":"2023-11-28T13:03:22.210032+0000","last_clean":"2023-11-28T13:03:22.210032+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:03:22.210032+0000","last_undegraded":"2023-11-28T13:03:22.210032+0000","last_fullsized":"2023-11-28T13:03:22.210032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.579350+0000","last_change":"2023-11-28T13:03:22.586703+0000","last_active":"2023-11-28T13:03:23.579350+0000","last_peered":"2023-11-28T13:03:23.579350+0000","last_clean":"2023-11-28T13:03:23.579350+0000","last_became_active":"2023-11-28T13:03:22.586293+0000","last_became_peered":"2023-11-28T13:03:22.586293+0000","last_unstale":"2023-11-28T13:03:23.579350+0000","last_undegraded":"2023-11-28T13:03:23.579350+0000","last_fullsized":"2023-11-28T13:03:23.579350+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:28:28.010139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.579667+0000","last_change":"2023-11-28T13:03:22.214555+0000","last_active":"2023-11-28T13:03:23.579667+0000","last_peered":"2023-11-28T13:03:23.579667+0000","last_clean":"2023-11-28T13:03:23.579667+0000","last_became_active":"2023-11-28T13:03:22.214225+0000","last_became_peered":"2023-11-28T13:03:22.214225+0000","last_unstale":"2023-11-28T13:03:23.579667+0000","last_undegraded":"2023-11-28T13:03:23.579667+0000","last_fullsized":"2023-11-28T13:03:23.579667+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:02.745893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.573719+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:03:22.573719+0000","last_peered":"2023-11-28T13:03:22.573719+0000","last_clean":"2023-11-28T13:03:22.573719+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:03:22.573719+0000","last_undegraded":"2023-11-28T13:03:22.573719+0000","last_fullsized":"2023-11-28T13:03:22.573719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.601539+0000","last_change":"2023-11-28T13:03:22.598459+0000","last_active":"2023-11-28T13:03:22.601539+0000","last_peered":"2023-11-28T13:03:22.601539+0000","last_clean":"2023-11-28T13:03:22.601539+0000","last_became_active":"2023-11-28T13:03:22.598188+0000","last_became_peered":"2023-11-28T13:03:22.598188+0000","last_unstale":"2023-11-28T13:03:22.601539+0000","last_undegraded":"2023-11-28T13:03:22.601539+0000","last_fullsized":"2023-11-28T13:03:22.601539+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:11:17.241400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.586338+0000","last_change":"2023-11-28T13:03:22.216225+0000","last_active":"2023-11-28T13:03:22.586338+0000","last_peered":"2023-11-28T13:03:22.586338+0000","last_clean":"2023-11-28T13:03:22.586338+0000","last_became_active":"2023-11-28T13:03:22.215868+0000","last_became_peered":"2023-11-28T13:03:22.215868+0000","last_unstale":"2023-11-28T13:03:22.586338+0000","last_undegraded":"2023-11-28T13:03:22.586338+0000","last_fullsized":"2023-11-28T13:03:22.586338+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:22:36.461924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.195318+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:03:22.195318+0000","last_peered":"2023-11-28T13:03:22.195318+0000","last_clean":"2023-11-28T13:03:22.195318+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:03:22.195318+0000","last_undegraded":"2023-11-28T13:03:22.195318+0000","last_fullsized":"2023-11-28T13:03:22.195318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.599880+0000","last_change":"2023-11-28T13:03:22.596959+0000","last_active":"2023-11-28T13:03:22.599880+0000","last_peered":"2023-11-28T13:03:22.599880+0000","last_clean":"2023-11-28T13:03:22.599880+0000","last_became_active":"2023-11-28T13:03:22.596653+0000","last_became_peered":"2023-11-28T13:03:22.596653+0000","last_unstale":"2023-11-28T13:03:22.599880+0000","last_undegraded":"2023-11-28T13:03:22.599880+0000","last_fullsized":"2023-11-28T13:03:22.599880+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:22:37.466439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.579609+0000","last_change":"2023-11-28T13:03:22.216999+0000","last_active":"2023-11-28T13:03:23.579609+0000","last_peered":"2023-11-28T13:03:23.579609+0000","last_clean":"2023-11-28T13:03:23.579609+0000","last_became_active":"2023-11-28T13:03:22.216697+0000","last_became_peered":"2023-11-28T13:03:22.216697+0000","last_unstale":"2023-11-28T13:03:23.579609+0000","last_undegraded":"2023-11-28T13:03:23.579609+0000","last_fullsized":"2023-11-28T13:03:23.579609+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:56.325748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.209962+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:03:22.209962+0000","last_peered":"2023-11-28T13:03:22.209962+0000","last_clean":"2023-11-28T13:03:22.209962+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:03:22.209962+0000","last_undegraded":"2023-11-28T13:03:22.209962+0000","last_fullsized":"2023-11-28T13:03:22.209962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583649+0000","last_change":"2023-11-28T13:03:22.592805+0000","last_active":"2023-11-28T13:03:23.583649+0000","last_peered":"2023-11-28T13:03:23.583649+0000","last_clean":"2023-11-28T13:03:23.583649+0000","last_became_active":"2023-11-28T13:03:22.590442+0000","last_became_peered":"2023-11-28T13:03:22.590442+0000","last_unstale":"2023-11-28T13:03:23.583649+0000","last_undegraded":"2023-11-28T13:03:23.583649+0000","last_fullsized":"2023-11-28T13:03:23.583649+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:08.354045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"64'1","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.599227+0000","last_change":"2023-11-28T13:03:22.215828+0000","last_active":"2023-11-28T13:03:22.599227+0000","last_peered":"2023-11-28T13:03:22.599227+0000","last_clean":"2023-11-28T13:03:22.599227+0000","last_became_active":"2023-11-28T13:03:22.215516+0000","last_became_peered":"2023-11-28T13:03:22.215516+0000","last_unstale":"2023-11-28T13:03:22.599227+0000","last_undegraded":"2023-11-28T13:03:22.599227+0000","last_fullsized":"2023-11-28T13:03:22.599227+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:49:23.308010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.209507+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:03:22.209507+0000","last_peered":"2023-11-28T13:03:22.209507+0000","last_clean":"2023-11-28T13:03:22.209507+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:03:22.209507+0000","last_undegraded":"2023-11-28T13:03:22.209507+0000","last_fullsized":"2023-11-28T13:03:22.209507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.602359+0000","last_change":"2023-11-28T13:03:22.600318+0000","last_active":"2023-11-28T13:03:22.602359+0000","last_peered":"2023-11-28T13:03:22.602359+0000","last_clean":"2023-11-28T13:03:22.602359+0000","last_became_active":"2023-11-28T13:03:22.600003+0000","last_became_peered":"2023-11-28T13:03:22.600003+0000","last_unstale":"2023-11-28T13:03:22.602359+0000","last_undegraded":"2023-11-28T13:03:22.602359+0000","last_fullsized":"2023-11-28T13:03:22.602359+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:49:24.312526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583921+0000","last_change":"2023-11-28T13:03:22.213888+0000","last_active":"2023-11-28T13:03:23.583921+0000","last_peered":"2023-11-28T13:03:23.583921+0000","last_clean":"2023-11-28T13:03:23.583921+0000","last_became_active":"2023-11-28T13:03:22.213601+0000","last_became_peered":"2023-11-28T13:03:22.213601+0000","last_unstale":"2023-11-28T13:03:23.583921+0000","last_undegraded":"2023-11-28T13:03:23.583921+0000","last_fullsized":"2023-11-28T13:03:23.583921+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:17:52.614005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.575251+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:03:22.575251+0000","last_peered":"2023-11-28T13:03:22.575251+0000","last_clean":"2023-11-28T13:03:22.575251+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:03:22.575251+0000","last_undegraded":"2023-11-28T13:03:22.575251+0000","last_fullsized":"2023-11-28T13:03:22.575251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.582758+0000","last_change":"2023-11-28T13:03:22.592001+0000","last_active":"2023-11-28T13:03:23.582758+0000","last_peered":"2023-11-28T13:03:23.582758+0000","last_clean":"2023-11-28T13:03:23.582758+0000","last_became_active":"2023-11-28T13:03:22.591304+0000","last_became_peered":"2023-11-28T13:03:22.591304+0000","last_unstale":"2023-11-28T13:03:23.582758+0000","last_undegraded":"2023-11-28T13:03:23.582758+0000","last_fullsized":"2023-11-28T13:03:23.582758+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:42.379047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"64'1","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T13:03:23.583620+0000","last_change":"2023-11-28T13:03:22.217931+0000","last_active":"2023-11-28T13:03:23.583620+0000","last_peered":"2023-11-28T13:03:23.583620+0000","last_clean":"2023-11-28T13:03:23.583620+0000","last_became_active":"2023-11-28T13:03:22.217507+0000","last_became_peered":"2023-11-28T13:03:22.217507+0000","last_unstale":"2023-11-28T13:03:23.583620+0000","last_undegraded":"2023-11-28T13:03:23.583620+0000","last_fullsized":"2023-11-28T13:03:23.583620+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:42:27.508975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.207033+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:03:22.207033+0000","last_peered":"2023-11-28T13:03:22.207033+0000","last_clean":"2023-11-28T13:03:22.207033+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:03:22.207033+0000","last_undegraded":"2023-11-28T13:03:22.207033+0000","last_fullsized":"2023-11-28T13:03:22.207033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.595336+0000","last_change":"2023-11-28T13:03:22.589592+0000","last_active":"2023-11-28T13:03:22.595336+0000","last_peered":"2023-11-28T13:03:22.595336+0000","last_clean":"2023-11-28T13:03:22.595336+0000","last_became_active":"2023-11-28T13:03:22.588998+0000","last_became_peered":"2023-11-28T13:03:22.588998+0000","last_unstale":"2023-11-28T13:03:22.595336+0000","last_undegraded":"2023-11-28T13:03:22.595336+0000","last_fullsized":"2023-11-28T13:03:22.595336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:22.180844+0000","last_clean_scrub_stamp":"2023-11-28T13:03:22.180844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:26:15.760699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.574110+0000","last_change":"2023-11-28T13:03:22.210321+0000","last_active":"2023-11-28T13:03:22.574110+0000","last_peered":"2023-11-28T13:03:22.574110+0000","last_clean":"2023-11-28T13:03:22.574110+0000","last_became_active":"2023-11-28T13:03:22.210040+0000","last_became_peered":"2023-11-28T13:03:22.210040+0000","last_unstale":"2023-11-28T13:03:22.574110+0000","last_undegraded":"2023-11-28T13:03:22.574110+0000","last_fullsized":"2023-11-28T13:03:22.574110+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:03:21.176329+0000","last_clean_scrub_stamp":"2023-11-28T13:03:21.176329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:43.955596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T13:03:22.207103+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:03:22.207103+0000","last_peered":"2023-11-28T13:03:22.207103+0000","last_clean":"2023-11-28T13:03:22.207103+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:03:22.207103+0000","last_undegraded":"2023-11-28T13:03:22.207103+0000","last_fullsized":"2023-11-28T13:03:22.207103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15000,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":13632,"kb_avail":94356840,"statfs":{"total":96636764160,"available":96621404160,"internally_reserved":0,"allocated":1392640,"data_stored":936180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13959168},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83199999999999996,"15min":0.81699999999999995},"min":{"1min":0.60199999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1479999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.877,"15min":0.90300000000000002},"min":{"1min":0.51200000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.2110000000000001,"5min":1.377,"15min":1.377},"last":0.59499999999999997}]},{"osd":1,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.90200000000000002,"15min":0.91600000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2410000000000001,"5min":1.599,"15min":1.599},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.91800000000000004,"15min":0.94099999999999995},"min":{"1min":0.69499999999999995,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.103,"5min":1.375,"15min":1.375},"last":0.69499999999999995}]},{"osd":2,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.91000000000000003,"15min":0.93600000000000005},"min":{"1min":0.56000000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.198,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3109999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.96499999999999997}]},{"osd":3,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.92700000000000005,"15min":0.94699999999999995},"min":{"1min":0.67800000000000005,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.1779999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.92700000000000005,"15min":0.92200000000000004},"min":{"1min":0.752,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.212,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.88200000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.97999999999999998,"15min":1.0009999999999999},"min":{"1min":0.63700000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.121,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.96199999999999997,"15min":0.96499999999999997},"min":{"1min":0.71899999999999997,"5min":0.621,"15min":0.621},"max":{"1min":1.1539999999999999,"5min":1.409,"15min":1.409},"last":0.99299999999999999}]},{"osd":5,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1599999999999999,"5min":1.466,"15min":1.466},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.022,"5min":1.085,"15min":1.101},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.1890000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.76700000000000002}]},{"osd":6,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.1579999999999999,"15min":1.1799999999999999},"min":{"1min":0.90400000000000003,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.28,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1459999999999999,"15min":1.167},"min":{"1min":0.86499999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.238,"5min":1.794,"15min":1.794},"last":0.92400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9340,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362500,"statfs":{"total":96636764160,"available":96627200000,"internally_reserved":0,"allocated":774144,"data_stored":338433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.82899999999999996,"15min":0.83499999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1220000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.86399999999999999,"15min":0.84599999999999997},"min":{"1min":0.65300000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.23,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.72699999999999998}]},{"osd":1,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.87,"15min":0.86199999999999999},"min":{"1min":0.59199999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1619999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.67000000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.121,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.0329999999999999}]},{"osd":2,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.84299999999999997,"15min":0.873},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.88,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.90300000000000002,"15min":0.89600000000000002},"min":{"1min":0.68899999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3240000000000001,"5min":1.639,"15min":1.639},"last":0.85799999999999998}]},{"osd":3,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.89300000000000002,"15min":0.88300000000000001},"min":{"1min":0.67400000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":1.125},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.96499999999999997,"15min":0.97299999999999998},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1459999999999999,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.94399999999999995}]},{"osd":4,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.95499999999999996,"15min":0.94999999999999996},"min":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.278,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.3280000000000001,"15min":1.4690000000000001},"min":{"1min":0.63500000000000001,"5min":0.629,"15min":0.629},"max":{"1min":1.2969999999999999,"5min":10.566000000000001,"15min":10.566000000000001},"last":1.198}]},{"osd":5,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0680000000000001,"15min":1.083},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.1259999999999999,"15min":1.095},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.9729999999999999,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":0.76700000000000002}]},{"osd":7,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.204,"15min":1.24},"min":{"1min":0.875,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.27,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":1.27},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.2569999999999999,"15min":1.3149999999999999},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.252,"5min":3.593,"15min":3.593},"last":1.006}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9532,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362308,"statfs":{"total":96636764160,"available":96627003392,"internally_reserved":0,"allocated":774144,"data_stored":338421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.53700000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.82299999999999995,"15min":0.81899999999999995},"min":{"1min":0.55400000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.22,"5min":1.248,"15min":1.248},"last":0.68999999999999995}]},{"osd":1,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82199999999999995},"min":{"1min":0.48999999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1859999999999999,"5min":1.274,"15min":1.274},"last":1.089},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80000000000000004,"15min":0.79800000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1439999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.83299999999999996}]},{"osd":2,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.83099999999999996,"15min":0.81599999999999995},"min":{"1min":0.59599999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.871},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.92700000000000005,"15min":0.93899999999999995},"min":{"1min":0.65300000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.26,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.90700000000000003}]},{"osd":3,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.89500000000000002,"15min":0.874},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.194,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.997},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0109999999999999,"15min":1.0229999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.365,"5min":1.403,"15min":1.403},"last":1.238}]},{"osd":4,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.89100000000000001,"15min":0.89300000000000002},"min":{"1min":0.60399999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98999999999999999,"15min":0.95699999999999996},"min":{"1min":0.65200000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5189999999999999,"5min":4.3300000000000001,"15min":4.3300000000000001},"last":0.95199999999999996}]},{"osd":6,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.0089999999999999,"15min":1.0249999999999999},"min":{"1min":0.73599999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0389999999999999,"15min":1.0329999999999999},"min":{"1min":0.85299999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.419,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.014}]},{"osd":7,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0740000000000001,"15min":1.042},"min":{"1min":0.91000000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3380000000000001,"5min":4.234,"15min":4.234},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.1299999999999999,"15min":1.139},"min":{"1min":0.79800000000000004,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.3100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9668,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362172,"statfs":{"total":96636764160,"available":96626864128,"internally_reserved":0,"allocated":782336,"data_stored":339947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.81899999999999995,"15min":0.81499999999999995},"min":{"1min":0.58799999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1200000000000001,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81799999999999995,"15min":0.81200000000000006},"min":{"1min":0.67400000000000004,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.159,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":1.0249999999999999}]},{"osd":1,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.81599999999999995,"15min":0.81699999999999995},"min":{"1min":0.61399999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1000000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.88100000000000001,"15min":0.871},"min":{"1min":0.58299999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1830000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.80700000000000005}]},{"osd":2,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.82999999999999996,"15min":0.83599999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1279999999999999,"5min":1.357,"15min":1.357},"last":1.296},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2270000000000001,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.83299999999999996}]},{"osd":3,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.89900000000000002,"15min":0.877},"min":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.085},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99299999999999999,"15min":0.99099999999999999},"min":{"1min":0.84099999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.222,"5min":1.474,"15min":1.474},"last":1.159}]},{"osd":5,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.90500000000000003,"15min":0.90400000000000003},"min":{"1min":0.68600000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.103,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":0.99199999999999999,"15min":0.998},"min":{"1min":0.624,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.1870000000000001}]},{"osd":6,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.014,"15min":1.03},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3400000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.079,"15min":1.079},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.252,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.212}]},{"osd":7,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.089,"15min":1.093},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.367,"5min":1.526,"15min":1.526},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1479999999999999,"15min":1.151},"min":{"1min":0.91500000000000004,"5min":0.871,"15min":0.871},"max":{"1min":1.431,"5min":1.655,"15min":1.655},"last":1.3600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9720,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362120,"statfs":{"total":96636764160,"available":96626810880,"internally_reserved":0,"allocated":770048,"data_stored":338399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61299999999999999,"15min":0.60199999999999998},"min":{"1min":0.46899999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90400000000000003,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66600000000000004,"15min":0.68600000000000005},"min":{"1min":0.504,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.78900000000000003,"5min":0.998,"15min":0.998},"last":0.58399999999999996}]},{"osd":1,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67300000000000004,"15min":0.68899999999999995},"min":{"1min":0.45500000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.008,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.502},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.76000000000000001,"15min":0.76100000000000001},"min":{"1min":0.497,"5min":0.441,"15min":0.441},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.68700000000000006}]},{"osd":2,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92200000000000004,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82799999999999996,"15min":0.82999999999999996},"min":{"1min":0.52400000000000002,"5min":0.438,"15min":0.438},"max":{"1min":1.034,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.94999999999999996,"15min":0.99099999999999999},"min":{"1min":0.66300000000000003,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.2769999999999999,"5min":1.405,"15min":1.405},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":1.0109999999999999,"15min":1.0409999999999999},"min":{"1min":0.72399999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.149,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.087}]},{"osd":5,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.02,"15min":1.056},"min":{"1min":0.64400000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2689999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0680000000000001,"15min":1.0880000000000001},"min":{"1min":0.76400000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5449999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0469999999999999,"15min":1.093},"min":{"1min":0.72699999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3400000000000001,"5min":1.446,"15min":1.446},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.087,"15min":1.109},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.222,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.1559999999999999}]},{"osd":7,"last update":"Tue Nov 28 13:03:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1559999999999999},"min":{"1min":0.92600000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.488,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1259999999999999,"15min":1.173},"min":{"1min":0.77200000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3979999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.90400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9464,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362376,"statfs":{"total":96636764160,"available":96627073024,"internally_reserved":0,"allocated":770048,"data_stored":338399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58099999999999996,"15min":0.56799999999999995},"min":{"1min":0.45100000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94999999999999996,"5min":0.997,"15min":0.997},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.64500000000000002,"15min":0.622},"min":{"1min":0.54300000000000004,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.59799999999999998}]},{"osd":1,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.502,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91500000000000004,"5min":1.123,"15min":1.123},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.69199999999999995,"15min":0.68000000000000005},"min":{"1min":0.54800000000000004,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98399999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.72899999999999998}]},{"osd":3,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.75600000000000001,"15min":0.72399999999999998},"min":{"1min":0.65800000000000003,"5min":0.317,"15min":0.317},"max":{"1min":1.02,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.755,"15min":0.745},"min":{"1min":0.56899999999999995,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.84099999999999997}]},{"osd":4,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.93000000000000005,"15min":0.92200000000000004},"min":{"1min":0.81899999999999995,"5min":0.498,"15min":0.498},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.042},{"interface":"front","average":{"1min":1.02,"5min":1.004,"15min":1.006},"min":{"1min":0.80800000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.1930000000000001}]},{"osd":5,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.76200000000000001,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.343,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.014,"15min":0.98699999999999999},"min":{"1min":0.72099999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.423,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.0109999999999999}]},{"osd":6,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0600000000000001,"15min":1.032},"min":{"1min":0.751,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.47,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.014,"15min":1.006},"min":{"1min":0.83799999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.1180000000000001}]},{"osd":7,"last update":"Tue Nov 28 13:03:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.071,"15min":1.0649999999999999},"min":{"1min":0.85299999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5069999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.1220000000000001,"15min":1.0980000000000001},"min":{"1min":0.86499999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.474,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.244}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9556,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362284,"statfs":{"total":96636764160,"available":96626978816,"internally_reserved":0,"allocated":798720,"data_stored":340695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.63300000000000001,"15min":0.64300000000000002},"min":{"1min":0.437,"5min":0.314,"15min":0.314},"max":{"1min":0.89500000000000002,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.752},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66400000000000003,"15min":0.68000000000000005},"min":{"1min":0.39500000000000002,"5min":0.318,"15min":0.318},"max":{"1min":1.1040000000000001,"5min":1.181,"15min":1.181},"last":0.66300000000000003}]},{"osd":2,"last update":"Tue Nov 28 13:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.69699999999999995},"min":{"1min":0.47699999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0720000000000001,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.624},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.48799999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.131,"5min":1.409,"15min":1.409},"last":0.57499999999999996}]},{"osd":3,"last update":"Tue Nov 28 13:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81200000000000006,"15min":0.82599999999999996},"min":{"1min":0.51900000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.03,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73999999999999999,"15min":0.74299999999999999},"min":{"1min":0.53800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.996,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.71899999999999997}]},{"osd":4,"last update":"Tue Nov 28 13:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.97399999999999998,"15min":0.98999999999999999},"min":{"1min":0.66600000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.284,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.94099999999999995},"min":{"1min":0.69899999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3049999999999999,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":0.81899999999999995}]},{"osd":5,"last update":"Tue Nov 28 13:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.96999999999999997,"15min":0.97699999999999998},"min":{"1min":0.68700000000000006,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.876},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.014,"15min":1.044},"min":{"1min":0.63100000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.306,"5min":2.004,"15min":2.004},"last":0.84199999999999997}]},{"osd":6,"last update":"Tue Nov 28 13:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.97899999999999998,"15min":1.004},"min":{"1min":0.68500000000000005,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2070000000000001,"5min":1.889,"15min":1.889},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.085,"15min":1.1060000000000001},"min":{"1min":0.80800000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.534,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.93899999999999995}]},{"osd":7,"last update":"Tue Nov 28 13:03:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0760000000000001,"15min":1.091},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.6200000000000001,"5min":1.766,"15min":1.766},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0840000000000001,"15min":1.1160000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2030000000000001,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.012}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14792,"kb_used_data":1344,"kb_used_omap":0,"kb_used_meta":13440,"kb_avail":94357048,"statfs":{"total":96636764160,"available":96621617152,"internally_reserved":0,"allocated":1376256,"data_stored":935420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13762560},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.46899999999999997,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.878,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.48999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.90800000000000003,"5min":1.198,"15min":1.198},"last":0.504}]},{"osd":2,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71399999999999997,"15min":0.70899999999999996},"min":{"1min":0.52800000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.92500000000000004,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.63},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.434,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.91300000000000003,"5min":1.143,"15min":1.143},"last":0.434}]},{"osd":3,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67400000000000004,"15min":0.67900000000000005},"min":{"1min":0.41299999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92600000000000005,"5min":1.298,"15min":1.298},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.83799999999999997,"15min":0.84599999999999997},"min":{"1min":0.54700000000000004,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.4379999999999999,"5min":1.629,"15min":1.629},"last":0.78800000000000003}]},{"osd":4,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.88900000000000001,"15min":0.89300000000000002},"min":{"1min":0.72099999999999997,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.96299999999999997,"15min":0.95699999999999996},"min":{"1min":0.73599999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.89700000000000002}]},{"osd":5,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.98799999999999999,"15min":0.98999999999999999},"min":{"1min":0.71699999999999997,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.2430000000000001,"5min":1.895,"15min":1.895},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93700000000000006,"15min":0.93899999999999995},"min":{"1min":0.76200000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.155,"5min":1.319,"15min":1.319},"last":0.92700000000000005}]},{"osd":6,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.036,"15min":1.046},"min":{"1min":0.749,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.321,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0760000000000001,"15min":1.0820000000000001},"min":{"1min":0.77300000000000002,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.4950000000000001,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.77300000000000002}]},{"osd":7,"last update":"Tue Nov 28 13:03:22 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.093,"15min":1.109},"min":{"1min":0.755,"5min":0.746,"15min":0.746},"max":{"1min":1.3999999999999999,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0109999999999999,"15min":1.014},"min":{"1min":0.748,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.86599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:03:26.930 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T13:03:26.931 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-28T13:03:27.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.044+0000 7fda1348e700 1 Processor -- start 2023-11-28T13:03:27.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.044+0000 7fda1348e700 1 -- start start 2023-11-28T13:03:27.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda1348e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fda0c0b1f30 0x7fda0c0d2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:27.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda1348e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda0c0b6c30 0x7fda0c06be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:27.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda1348e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0c0d1050 con 0x7fda0c06ba30 2023-11-28T13:03:27.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda1348e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda0c0b2300 con 0x7fda0c0b1f30 2023-11-28T13:03:27.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda1348e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c06c3a0 con 0x7fda0c0b6c30 2023-11-28T13:03:27.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda12c8d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda0c0b6c30 0x7fda0c06be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:27.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda12c8d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda0c0b6c30 0x7fda0c06be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:33406/0 (socket says 172.21.15.82:33406) 2023-11-28T13:03:27.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda12c8d700 1 -- 172.21.15.82:0/1481693349 learned_addr learned my addr 172.21.15.82:0/1481693349 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:27.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda1248c700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fda0c0b1f30 0x7fda0c0d2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:27.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda12c8d700 1 -- 172.21.15.82:0/1481693349 >> v2:172.21.15.114:3300/0 conn(0x7fda0c0b1f30 msgr2=0x7fda0c0d2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:27.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda12c8d700 1 --2- 172.21.15.82:0/1481693349 >> v2:172.21.15.114:3300/0 conn(0x7fda0c0b1f30 0x7fda0c0d2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:27.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda12c8d700 1 -- 172.21.15.82:0/1481693349 >> v1:172.21.15.114:6789/0 conn(0x7fda0c06ba30 legacy=0x7fda0c069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:27.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda12c8d700 1 -- 172.21.15.82:0/1481693349 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c0cd0c0 con 0x7fda0c0b6c30 2023-11-28T13:03:27.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda1148a700 1 -- 172.21.15.82:0/1481693349 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359242438 0 0) 0x7fda0c0d1050 con 0x7fda0c06ba30 2023-11-28T13:03:27.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda12c8d700 1 --2- 172.21.15.82:0/1481693349 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda0c0b6c30 0x7fda0c06be60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda04009e50 tx=0x7fda0400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67b09f095a714634 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:27.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda1148a700 1 -- 172.21.15.82:0/1481693349 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0400e070 con 0x7fda0c0b6c30 2023-11-28T13:03:27.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda1148a700 1 -- 172.21.15.82:0/1481693349 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0400b910 con 0x7fda0c0b6c30 2023-11-28T13:03:27.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda1148a700 1 -- 172.21.15.82:0/1481693349 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0400bcc0 con 0x7fda0c0b6c30 2023-11-28T13:03:27.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda1348e700 1 -- 172.21.15.82:0/1481693349 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda0c0b6c30 msgr2=0x7fda0c06be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:27.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda1348e700 1 --2- 172.21.15.82:0/1481693349 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda0c0b6c30 0x7fda0c06be60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda04009e50 tx=0x7fda0400b330 comp rx=0 tx=0).stop 2023-11-28T13:03:27.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda1348e700 1 -- 172.21.15.82:0/1481693349 shutdown_connections 2023-11-28T13:03:27.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda1348e700 1 --2- 172.21.15.82:0/1481693349 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda0c0b6c30 0x7fda0c06be60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:27.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda1348e700 1 --2- 172.21.15.82:0/1481693349 >> v2:172.21.15.114:3300/0 conn(0x7fda0c0b1f30 0x7fda0c0d2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:27.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda1348e700 1 -- 172.21.15.82:0/1481693349 >> 172.21.15.82:0/1481693349 conn(0x7fda0c0b52d0 msgr2=0x7fda0c0d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:27.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda1348e700 1 -- 172.21.15.82:0/1481693349 shutdown_connections 2023-11-28T13:03:27.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.048+0000 7fda1348e700 1 -- 172.21.15.82:0/1481693349 wait complete. 2023-11-28T13:03:27.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.052+0000 7fda1348e700 1 Processor -- start 2023-11-28T13:03:27.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.052+0000 7fda1348e700 1 -- start start 2023-11-28T13:03:27.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.052+0000 7fda1348e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda0c06ba30 0x7fda0c1556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:27.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.052+0000 7fda1348e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda0c0b1f30 0x7fda0c158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:27.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.052+0000 7fda1348e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda0c0b6c30 0x7fda0c15c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:27.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.052+0000 7fda1348e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c155be0 con 0x7fda0c0b1f30 2023-11-28T13:03:27.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.052+0000 7fda1348e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c156270 con 0x7fda0c0b6c30 2023-11-28T13:03:27.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.052+0000 7fda1348e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c157b70 con 0x7fda0c06ba30 2023-11-28T13:03:27.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.052+0000 7fda11c8b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda0c0b1f30 0x7fda0c158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:27.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.052+0000 7fda11c8b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda0c0b1f30 0x7fda0c158c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58076/0 (socket says 172.21.15.82:58076) 2023-11-28T13:03:27.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.052+0000 7fda11c8b700 1 -- 172.21.15.82:0/1738022073 learned_addr learned my addr 172.21.15.82:0/1738022073 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:27.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.052+0000 7fda12c8d700 1 --2- 172.21.15.82:0/1738022073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda0c0b6c30 0x7fda0c15c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:27.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.052+0000 7fda1248c700 1 --2- 172.21.15.82:0/1738022073 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda0c06ba30 0x7fda0c1556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.052+0000 7fda11c8b700 1 -- 172.21.15.82:0/1738022073 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda0c06ba30 msgr2=0x7fda0c1556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.052+0000 7fda11c8b700 1 --2- 172.21.15.82:0/1738022073 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda0c06ba30 0x7fda0c1556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.052+0000 7fda11c8b700 1 -- 172.21.15.82:0/1738022073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda0c0b6c30 msgr2=0x7fda0c15c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.052+0000 7fda11c8b700 1 --2- 172.21.15.82:0/1738022073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda0c0b6c30 0x7fda0c15c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.052+0000 7fda11c8b700 1 -- 172.21.15.82:0/1738022073 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda04009b30 con 0x7fda0c0b1f30 2023-11-28T13:03:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.056+0000 7fda11c8b700 1 --2- 172.21.15.82:0/1738022073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda0c0b1f30 0x7fda0c158c10 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fda0800c550 tx=0x7fda0800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.056+0000 7fd9feffd700 1 -- 172.21.15.82:0/1738022073 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda080054e0 con 0x7fda0c0b1f30 2023-11-28T13:03:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.056+0000 7fd9feffd700 1 -- 172.21.15.82:0/1738022073 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0800ce60 con 0x7fda0c0b1f30 2023-11-28T13:03:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.056+0000 7fd9feffd700 1 -- 172.21.15.82:0/1738022073 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda080038e0 con 0x7fda0c0b1f30 2023-11-28T13:03:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.056+0000 7fda1348e700 1 -- 172.21.15.82:0/1738022073 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0c0d1580 con 0x7fda0c0b1f30 2023-11-28T13:03:27.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.056+0000 7fda1348e700 1 -- 172.21.15.82:0/1738022073 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0c0d12a0 con 0x7fda0c0b1f30 2023-11-28T13:03:27.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.056+0000 7fda1348e700 1 -- 172.21.15.82:0/1738022073 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda0c0cd380 con 0x7fda0c0b1f30 2023-11-28T13:03:27.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.056+0000 7fd9feffd700 1 -- 172.21.15.82:0/1738022073 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fda08019030 con 0x7fda0c0b1f30 2023-11-28T13:03:27.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.056+0000 7fd9feffd700 1 --2- 172.21.15.82:0/1738022073 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9f0064ee0 0x7fd9f0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:27.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.056+0000 7fda1248c700 1 --2- 172.21.15.82:0/1738022073 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9f0064ee0 0x7fd9f0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:27.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.060+0000 7fd9feffd700 1 -- 172.21.15.82:0/1738022073 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fda080811b0 con 0x7fda0c0b1f30 2023-11-28T13:03:27.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.060+0000 7fda1248c700 1 --2- 172.21.15.82:0/1738022073 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9f0064ee0 0x7fd9f0067390 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fda0c15d610 tx=0x7fda00009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:27.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.068+0000 7fd9feffd700 1 -- 172.21.15.82:0/1738022073 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fda0804f260 con 0x7fda0c0b1f30 2023-11-28T13:03:27.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.284+0000 7fda1348e700 1 -- 172.21.15.82:0/1738022073 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7fda0c065fc0 con 0x7fda0c0b1f30 2023-11-28T13:03:27.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.292+0000 7fd9feffd700 1 -- 172.21.15.82:0/1738022073 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 184+0+0 (secure 0 0 0) 0x7fda08052880 con 0x7fda0c0b1f30 2023-11-28T13:03:27.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.296+0000 7fda1348e700 1 -- 172.21.15.82:0/1738022073 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9f0064ee0 msgr2=0x7fd9f0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:27.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.296+0000 7fda1348e700 1 --2- 172.21.15.82:0/1738022073 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9f0064ee0 0x7fd9f0067390 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fda0c15d610 tx=0x7fda00009240 comp rx=0 tx=0).stop 2023-11-28T13:03:27.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.296+0000 7fda1348e700 1 -- 172.21.15.82:0/1738022073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda0c0b1f30 msgr2=0x7fda0c158c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:27.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.296+0000 7fda1348e700 1 --2- 172.21.15.82:0/1738022073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda0c0b1f30 0x7fda0c158c10 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fda0800c550 tx=0x7fda0800c860 comp rx=0 tx=0).stop 2023-11-28T13:03:27.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.296+0000 7fda1348e700 1 -- 172.21.15.82:0/1738022073 shutdown_connections 2023-11-28T13:03:27.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.296+0000 7fda1348e700 1 --2- 172.21.15.82:0/1738022073 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9f0064ee0 0x7fd9f0067390 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:27.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.296+0000 7fda1348e700 1 --2- 172.21.15.82:0/1738022073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda0c0b6c30 0x7fda0c15c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:27.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.296+0000 7fda1348e700 1 --2- 172.21.15.82:0/1738022073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda0c0b1f30 0x7fda0c158c10 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:27.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.296+0000 7fda1348e700 1 --2- 172.21.15.82:0/1738022073 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda0c06ba30 0x7fda0c1556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:27.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.296+0000 7fda1348e700 1 -- 172.21.15.82:0/1738022073 >> 172.21.15.82:0/1738022073 conn(0x7fda0c0b52d0 msgr2=0x7fda0c0b62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:27.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.296+0000 7fda1348e700 1 -- 172.21.15.82:0/1738022073 shutdown_connections 2023-11-28T13:03:27.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.296+0000 7fda1348e700 1 -- 172.21.15.82:0/1738022073 wait complete. 2023-11-28T13:03:27.302 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2023-11-28T13:03:27.318 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:03:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.428+0000 7f8d47fff700 1 Processor -- start 2023-11-28T13:03:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.428+0000 7f8d47fff700 1 -- start start 2023-11-28T13:03:27.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.428+0000 7f8d47fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8d4806b910 0x7f8d48160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:27.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.428+0000 7f8d47fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8d480d06f0 0x7f8d480d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:27.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.428+0000 7f8d47fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d480d28e0 con 0x7f8d480ced70 2023-11-28T13:03:27.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.428+0000 7f8d47fff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d480cdfe0 con 0x7f8d480d06f0 2023-11-28T13:03:27.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.428+0000 7f8d47fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d48160cc0 con 0x7f8d4806b910 2023-11-28T13:03:27.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.428+0000 7f8d46ffd700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8d4806b910 0x7f8d48160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:27.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.428+0000 7f8d477fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8d480d06f0 0x7f8d480d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:27.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.428+0000 7f8d467fc700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8d480ced70 0x7f8d4806bce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:59088/0 (socket says 172.21.15.82:59088) 2023-11-28T13:03:27.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.428+0000 7f8d467fc700 1 -- 172.21.15.82:0/3429401726 learned_addr learned my addr 172.21.15.82:0/3429401726 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:03:27.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.428+0000 7f8d477fe700 1 -- 172.21.15.82:0/3429401726 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8d4806b910 msgr2=0x7f8d48160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:27.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.428+0000 7f8d477fe700 1 --2- 172.21.15.82:0/3429401726 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8d4806b910 0x7f8d48160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:27.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.428+0000 7f8d477fe700 1 -- 172.21.15.82:0/3429401726 >> v1:172.21.15.114:6789/0 conn(0x7f8d480ced70 legacy=0x7f8d4806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:27.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.428+0000 7f8d477fe700 1 -- 172.21.15.82:0/3429401726 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d480b2040 con 0x7f8d480d06f0 2023-11-28T13:03:27.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.432+0000 7f8d477fe700 1 --2- 172.21.15.82:0/3429401726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d480d06f0 0x7f8d480d0b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8d40009d90 tx=0x7f8d4000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=890ce24935871c39 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:27.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.432+0000 7f8d45ffb700 1 -- 172.21.15.82:0/3429401726 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4000e070 con 0x7f8d480d06f0 2023-11-28T13:03:27.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.432+0000 7f8d45ffb700 1 -- 172.21.15.82:0/3429401726 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4000bb20 con 0x7f8d480d06f0 2023-11-28T13:03:27.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.432+0000 7f8d45ffb700 1 -- 172.21.15.82:0/3429401726 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40012430 con 0x7f8d480d06f0 2023-11-28T13:03:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.432+0000 7f8d47fff700 1 -- 172.21.15.82:0/3429401726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d480d06f0 msgr2=0x7f8d480d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.432+0000 7f8d47fff700 1 --2- 172.21.15.82:0/3429401726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d480d06f0 0x7f8d480d0b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8d40009d90 tx=0x7f8d4000b330 comp rx=0 tx=0).stop 2023-11-28T13:03:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.432+0000 7f8d47fff700 1 -- 172.21.15.82:0/3429401726 shutdown_connections 2023-11-28T13:03:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.432+0000 7f8d47fff700 1 --2- 172.21.15.82:0/3429401726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d480d06f0 0x7f8d480d0b10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.432+0000 7f8d47fff700 1 --2- 172.21.15.82:0/3429401726 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8d4806b910 0x7f8d48160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.432+0000 7f8d47fff700 1 -- 172.21.15.82:0/3429401726 >> 172.21.15.82:0/3429401726 conn(0x7f8d480d2b20 msgr2=0x7f8d480d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.432+0000 7f8d47fff700 1 -- 172.21.15.82:0/3429401726 shutdown_connections 2023-11-28T13:03:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.432+0000 7f8d47fff700 1 -- 172.21.15.82:0/3429401726 wait complete. 2023-11-28T13:03:27.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.432+0000 7f8d47fff700 1 Processor -- start 2023-11-28T13:03:27.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.432+0000 7f8d47fff700 1 -- start start 2023-11-28T13:03:27.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d47fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d4806b910 0x7f8d480ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d47fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8d480ced70 0x7f8d4815b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d47fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d480d06f0 0x7f8d481f1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d47fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d480b2640 con 0x7f8d480d06f0 2023-11-28T13:03:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d47fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d480cab40 con 0x7f8d4806b910 2023-11-28T13:03:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d47fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d480cb660 con 0x7f8d480ced70 2023-11-28T13:03:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d477fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d480d06f0 0x7f8d481f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d46ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d4806b910 0x7f8d480ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d477fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d480d06f0 0x7f8d481f1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58086/0 (socket says 172.21.15.82:58086) 2023-11-28T13:03:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d477fe700 1 -- 172.21.15.82:0/2192039432 learned_addr learned my addr 172.21.15.82:0/2192039432 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d467fc700 1 --2- 172.21.15.82:0/2192039432 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8d480ced70 0x7f8d4815b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:27.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d477fe700 1 -- 172.21.15.82:0/2192039432 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8d480ced70 msgr2=0x7f8d4815b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:27.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d477fe700 1 --2- 172.21.15.82:0/2192039432 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8d480ced70 0x7f8d4815b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:27.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d477fe700 1 -- 172.21.15.82:0/2192039432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d4806b910 msgr2=0x7f8d480ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:27.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d477fe700 1 --2- 172.21.15.82:0/2192039432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d4806b910 0x7f8d480ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:27.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d477fe700 1 -- 172.21.15.82:0/2192039432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d40009a70 con 0x7f8d480d06f0 2023-11-28T13:03:27.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d477fe700 1 --2- 172.21.15.82:0/2192039432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d480d06f0 0x7f8d481f1970 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f8d40014040 tx=0x7f8d40004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:27.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d3ffff700 1 -- 172.21.15.82:0/2192039432 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40012430 con 0x7f8d480d06f0 2023-11-28T13:03:27.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d3ffff700 1 -- 172.21.15.82:0/2192039432 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d40020070 con 0x7f8d480d06f0 2023-11-28T13:03:27.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d3ffff700 1 -- 172.21.15.82:0/2192039432 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d400098f0 con 0x7f8d480d06f0 2023-11-28T13:03:27.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d47fff700 1 -- 172.21.15.82:0/2192039432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d480d2320 con 0x7f8d480d06f0 2023-11-28T13:03:27.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d47fff700 1 -- 172.21.15.82:0/2192039432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d480cf2c0 con 0x7f8d480d06f0 2023-11-28T13:03:27.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.436+0000 7f8d47fff700 1 -- 172.21.15.82:0/2192039432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d480d2600 con 0x7f8d480d06f0 2023-11-28T13:03:27.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.440+0000 7f8d3ffff700 1 -- 172.21.15.82:0/2192039432 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8d4002e070 con 0x7f8d480d06f0 2023-11-28T13:03:27.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.440+0000 7f8d3ffff700 1 --2- 172.21.15.82:0/2192039432 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8d2c064f10 0x7f8d2c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:27.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.440+0000 7f8d3ffff700 1 -- 172.21.15.82:0/2192039432 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8d40022070 con 0x7f8d480d06f0 2023-11-28T13:03:27.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.440+0000 7f8d46ffd700 1 --2- 172.21.15.82:0/2192039432 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8d2c064f10 0x7f8d2c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:27.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.440+0000 7f8d46ffd700 1 --2- 172.21.15.82:0/2192039432 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8d2c064f10 0x7f8d2c0673c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8d38009b50 tx=0x7f8d38009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:27.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.448+0000 7f8d3ffff700 1 -- 172.21.15.82:0/2192039432 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8d40051c00 con 0x7f8d480d06f0 2023-11-28T13:03:27.490 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:03:27.493 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:03:27.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.644+0000 7f8d47fff700 1 -- 172.21.15.82:0/2192039432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d480b2780 con 0x7f8d480d06f0 2023-11-28T13:03:27.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.644+0000 7f8d3ffff700 1 -- 172.21.15.82:0/2192039432 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4655 (secure 0 0 0) 0x7f8d4002c090 con 0x7f8d480d06f0 2023-11-28T13:03:27.650 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:27.650 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/3176308867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3176308867},{"type":"v1","addr":"172.21.15.114:6833","nonce":3176308867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6184,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1779270694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1779270694},{"type":"v1","addr":"172.21.15.114:6835","nonce":1779270694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1570999968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1570999968},{"type":"v1","addr":"172.21.15.82:6835","nonce":1570999968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:03:22.559646+0000","modified":"2023-11-28T13:03:25.579582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2902091405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2902091405},{"type":"v1","addr":"172.21.15.82:6837","nonce":2902091405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T13:03:27.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.648+0000 7f8d47fff700 1 -- 172.21.15.82:0/2192039432 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8d2c064f10 msgr2=0x7f8d2c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:27.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.648+0000 7f8d47fff700 1 --2- 172.21.15.82:0/2192039432 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8d2c064f10 0x7f8d2c0673c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8d38009b50 tx=0x7f8d38009240 comp rx=0 tx=0).stop 2023-11-28T13:03:27.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.648+0000 7f8d47fff700 1 -- 172.21.15.82:0/2192039432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d480d06f0 msgr2=0x7f8d481f1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:27.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.648+0000 7f8d47fff700 1 --2- 172.21.15.82:0/2192039432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d480d06f0 0x7f8d481f1970 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f8d40014040 tx=0x7f8d40004af0 comp rx=0 tx=0).stop 2023-11-28T13:03:27.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.648+0000 7f8d47fff700 1 -- 172.21.15.82:0/2192039432 shutdown_connections 2023-11-28T13:03:27.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.648+0000 7f8d47fff700 1 --2- 172.21.15.82:0/2192039432 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8d2c064f10 0x7f8d2c0673c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:27.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.648+0000 7f8d47fff700 1 --2- 172.21.15.82:0/2192039432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d480d06f0 0x7f8d481f1970 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:27.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.648+0000 7f8d47fff700 1 --2- 172.21.15.82:0/2192039432 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8d480ced70 0x7f8d4815b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:27.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.648+0000 7f8d47fff700 1 --2- 172.21.15.82:0/2192039432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d4806b910 0x7f8d480ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:27.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.648+0000 7f8d47fff700 1 -- 172.21.15.82:0/2192039432 >> 172.21.15.82:0/2192039432 conn(0x7f8d480d2b20 msgr2=0x7f8d480d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:27.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.648+0000 7f8d47fff700 1 -- 172.21.15.82:0/2192039432 shutdown_connections 2023-11-28T13:03:27.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:27.648+0000 7f8d47fff700 1 -- 172.21.15.82:0/2192039432 wait complete. 2023-11-28T13:03:27.654 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 30 2023-11-28T13:03:28.067 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T13:03:22.559646+0000', 'modified': '2023-11-28T13:03:25.579582+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6309}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6309': {'gid': 6309, 'name': 'a', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6837/2902091405', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6836', 'nonce': 2902091405}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 2902091405}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T13:03:28.067 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T13:03:28.068 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-28T13:03:28.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.184+0000 7f46fdca0700 1 Processor -- start 2023-11-28T13:03:28.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.184+0000 7f46fdca0700 1 -- start start 2023-11-28T13:03:28.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46fdca0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f46f80703e0 0x7f46f80707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46fdca0700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f46f80ade20 0x7f46f80ca010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46fdca0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f8070cf0 con 0x7f46f8160b20 2023-11-28T13:03:28.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46fdca0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f80ce680 con 0x7f46f80703e0 2023-11-28T13:03:28.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46fdca0700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f8069c60 con 0x7f46f80ade20 2023-11-28T13:03:28.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46f77fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f46f80703e0 0x7f46f80707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46f77fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f46f80703e0 0x7f46f80707b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58090/0 (socket says 172.21.15.82:58090) 2023-11-28T13:03:28.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46eeffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f46f8160b20 0x7f46f80ad710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54102/0 (socket says 172.21.15.82:54102) 2023-11-28T13:03:28.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46f77fe700 1 -- 172.21.15.82:0/3001229889 learned_addr learned my addr 172.21.15.82:0/3001229889 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:28.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46f7fff700 1 --2- 172.21.15.82:0/3001229889 >> v2:172.21.15.114:3300/0 conn(0x7f46f80ade20 0x7f46f80ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46f77fe700 1 -- 172.21.15.82:0/3001229889 >> v2:172.21.15.114:3300/0 conn(0x7f46f80ade20 msgr2=0x7f46f80ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:28.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46f77fe700 1 --2- 172.21.15.82:0/3001229889 >> v2:172.21.15.114:3300/0 conn(0x7f46f80ade20 0x7f46f80ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46f77fe700 1 -- 172.21.15.82:0/3001229889 >> v1:172.21.15.82:6789/0 conn(0x7f46f8160b20 legacy=0x7f46f80ad710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:28.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46f77fe700 1 -- 172.21.15.82:0/3001229889 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f8069f40 con 0x7f46f80703e0 2023-11-28T13:03:28.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46f77fe700 1 --2- 172.21.15.82:0/3001229889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f80703e0 0x7f46f80707b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f46f80c5a10 tx=0x7f46e8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19777ec8826b9b3b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:28.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46f6ffd700 1 -- 172.21.15.82:0/3001229889 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e800b8a0 con 0x7f46f80703e0 2023-11-28T13:03:28.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46f6ffd700 1 -- 172.21.15.82:0/3001229889 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e800ba00 con 0x7f46f80703e0 2023-11-28T13:03:28.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46f6ffd700 1 -- 172.21.15.82:0/3001229889 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e800bd90 con 0x7f46f80703e0 2023-11-28T13:03:28.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46fdca0700 1 -- 172.21.15.82:0/3001229889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f80703e0 msgr2=0x7f46f80707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:28.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46fdca0700 1 --2- 172.21.15.82:0/3001229889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f80703e0 0x7f46f80707b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f46f80c5a10 tx=0x7f46e8009bf0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46fdca0700 1 -- 172.21.15.82:0/3001229889 shutdown_connections 2023-11-28T13:03:28.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46fdca0700 1 --2- 172.21.15.82:0/3001229889 >> v2:172.21.15.114:3300/0 conn(0x7f46f80ade20 0x7f46f80ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46fdca0700 1 --2- 172.21.15.82:0/3001229889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f80703e0 0x7f46f80707b0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46fdca0700 1 -- 172.21.15.82:0/3001229889 >> 172.21.15.82:0/3001229889 conn(0x7f46f80ce9b0 msgr2=0x7f46f80ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:28.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46fdca0700 1 -- 172.21.15.82:0/3001229889 shutdown_connections 2023-11-28T13:03:28.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.188+0000 7f46fdca0700 1 -- 172.21.15.82:0/3001229889 wait complete. 2023-11-28T13:03:28.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.192+0000 7f46fdca0700 1 Processor -- start 2023-11-28T13:03:28.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.192+0000 7f46fdca0700 1 -- start start 2023-11-28T13:03:28.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.192+0000 7f46fdca0700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46f80703e0 0x7f46f814cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.192+0000 7f46fdca0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f80ade20 0x7f46f80bd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.192+0000 7f46fdca0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46f8160b20 0x7f46f80bdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.192+0000 7f46fdca0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f80c0520 con 0x7f46f80ade20 2023-11-28T13:03:28.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.192+0000 7f46fdca0700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f80c0800 con 0x7f46f8160b20 2023-11-28T13:03:28.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.192+0000 7f46fdca0700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f80c0ae0 con 0x7f46f80703e0 2023-11-28T13:03:28.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.192+0000 7f46eeffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f80ade20 0x7f46f80bd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.192+0000 7f46eeffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f80ade20 0x7f46f80bd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58092/0 (socket says 172.21.15.82:58092) 2023-11-28T13:03:28.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.192+0000 7f46eeffd700 1 -- 172.21.15.82:0/1986699353 learned_addr learned my addr 172.21.15.82:0/1986699353 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:28.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.192+0000 7f46f7fff700 1 --2- 172.21.15.82:0/1986699353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46f8160b20 0x7f46f80bdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.192+0000 7f46f77fe700 1 --2- 172.21.15.82:0/1986699353 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46f80703e0 0x7f46f814cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.192+0000 7f46eeffd700 1 -- 172.21.15.82:0/1986699353 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46f80703e0 msgr2=0x7f46f814cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:28.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.192+0000 7f46eeffd700 1 --2- 172.21.15.82:0/1986699353 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46f80703e0 0x7f46f814cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.192+0000 7f46eeffd700 1 -- 172.21.15.82:0/1986699353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46f8160b20 msgr2=0x7f46f80bdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:28.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.192+0000 7f46eeffd700 1 --2- 172.21.15.82:0/1986699353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46f8160b20 0x7f46f80bdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.192+0000 7f46eeffd700 1 -- 172.21.15.82:0/1986699353 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e8009570 con 0x7f46f80ade20 2023-11-28T13:03:28.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.192+0000 7f46eeffd700 1 --2- 172.21.15.82:0/1986699353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f80ade20 0x7f46f80bd570 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f46e000c480 tx=0x7f46e000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:28.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.192+0000 7f46f4ff9700 1 -- 172.21.15.82:0/1986699353 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e0005cd0 con 0x7f46f80ade20 2023-11-28T13:03:28.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.196+0000 7f46f4ff9700 1 -- 172.21.15.82:0/1986699353 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e0005e30 con 0x7f46f80ade20 2023-11-28T13:03:28.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.196+0000 7f46f4ff9700 1 -- 172.21.15.82:0/1986699353 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e00072f0 con 0x7f46f80ade20 2023-11-28T13:03:28.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.196+0000 7f46fdca0700 1 -- 172.21.15.82:0/1986699353 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f806a500 con 0x7f46f80ade20 2023-11-28T13:03:28.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.196+0000 7f46fdca0700 1 -- 172.21.15.82:0/1986699353 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f806a220 con 0x7f46f80ade20 2023-11-28T13:03:28.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.196+0000 7f46f4ff9700 1 -- 172.21.15.82:0/1986699353 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f46e0019030 con 0x7f46f80ade20 2023-11-28T13:03:28.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.196+0000 7f46f4ff9700 1 --2- 172.21.15.82:0/1986699353 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f46d8064ee0 0x7f46d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.196+0000 7f46f4ff9700 1 -- 172.21.15.82:0/1986699353 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f46e0081370 con 0x7f46f80ade20 2023-11-28T13:03:28.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.196+0000 7f46f77fe700 1 --2- 172.21.15.82:0/1986699353 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f46d8064ee0 0x7f46d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.200+0000 7f46f77fe700 1 --2- 172.21.15.82:0/1986699353 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f46d8064ee0 0x7f46d8067390 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f46e8000c00 tx=0x7f46e8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:28.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.200+0000 7f4700f20740 1 Processor -- start 2023-11-28T13:03:28.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.200+0000 7f4700f20740 1 -- start start 2023-11-28T13:03:28.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f4700f20740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da7ae0 0x2057e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f4700f20740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1da7710 0x2058340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f4700f20740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1df2790 0x2058880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f4700f20740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f16ae0 con 0x1df2790 2023-11-28T13:03:28.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f4700f20740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f86bd0 con 0x1da7ae0 2023-11-28T13:03:28.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f4700f20740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f7fed0 con 0x1da7710 2023-11-28T13:03:28.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f46f7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1df2790 0x2058880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f46f7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1df2790 0x2058880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58104/0 (socket says 172.21.15.82:58104) 2023-11-28T13:03:28.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f46f7fff700 1 -- 172.21.15.82:0/3312159047 learned_addr learned my addr 172.21.15.82:0/3312159047 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:28.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f46f77fe700 1 --2- 172.21.15.82:0/3312159047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da7ae0 0x2057e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f46eeffd700 1 --2- 172.21.15.82:0/3312159047 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1da7710 0x2058340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f46f7fff700 1 -- 172.21.15.82:0/3312159047 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1da7710 msgr2=0x2058340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:28.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f46f7fff700 1 --2- 172.21.15.82:0/3312159047 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1da7710 0x2058340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f46f7fff700 1 -- 172.21.15.82:0/3312159047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da7ae0 msgr2=0x2057e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:28.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f46f7fff700 1 --2- 172.21.15.82:0/3312159047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da7ae0 0x2057e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f46f7fff700 1 -- 172.21.15.82:0/3312159047 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1fa5cc0 con 0x1df2790 2023-11-28T13:03:28.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f46f77fe700 1 --2- 172.21.15.82:0/3312159047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da7ae0 0x2057e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:28.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f46f7fff700 1 --2- 172.21.15.82:0/3312159047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1df2790 0x2058880 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f46f0007390 tx=0x7f46f00076a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c70ef3fe31d78e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:28.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f46ed7fa700 1 -- 172.21.15.82:0/3312159047 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f0015670 con 0x1df2790 2023-11-28T13:03:28.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f46ed7fa700 1 -- 172.21.15.82:0/3312159047 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f000f050 con 0x1df2790 2023-11-28T13:03:28.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f46ed7fa700 1 -- 172.21.15.82:0/3312159047 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f00159f0 con 0x1df2790 2023-11-28T13:03:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f4700f20740 1 -- 172.21.15.82:0/3312159047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1df2790 msgr2=0x2058880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f4700f20740 1 --2- 172.21.15.82:0/3312159047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1df2790 0x2058880 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f46f0007390 tx=0x7f46f00076a0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f4700f20740 1 -- 172.21.15.82:0/3312159047 shutdown_connections 2023-11-28T13:03:28.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f4700f20740 1 --2- 172.21.15.82:0/3312159047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1df2790 0x2058880 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f4700f20740 1 --2- 172.21.15.82:0/3312159047 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1da7710 0x2058340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f4700f20740 1 --2- 172.21.15.82:0/3312159047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da7ae0 0x2057e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f4700f20740 1 -- 172.21.15.82:0/3312159047 >> 172.21.15.82:0/3312159047 conn(0x1da7eb0 msgr2=0x2040700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:28.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f4700f20740 1 -- 172.21.15.82:0/3312159047 shutdown_connections 2023-11-28T13:03:28.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f4700f20740 1 -- 172.21.15.82:0/3312159047 wait complete. 2023-11-28T13:03:28.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f4700f20740 1 -- start start 2023-11-28T13:03:28.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.204+0000 7f4700f20740 1 Processor -- start 2023-11-28T13:03:28.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f4700f20740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da7710 0x20160c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f4700f20740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1da7ae0 0x2016c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f4700f20740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1df2790 0x203e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f4700f20740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e2cb20 con 0x1da7ae0 2023-11-28T13:03:28.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f4700f20740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x2016600 con 0x1da7710 2023-11-28T13:03:28.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f4700f20740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x2013400 con 0x1df2790 2023-11-28T13:03:28.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f4700f20740 10 client.0 _ll_register_callbacks cb 0x1fdc0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:03:28.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f46eeffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1da7ae0 0x2016c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f46eeffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1da7ae0 0x2016c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58120/0 (socket says 172.21.15.82:58120) 2023-11-28T13:03:28.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f46eeffd700 1 -- 172.21.15.82:0/1150083523 learned_addr learned my addr 172.21.15.82:0/1150083523 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:28.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f46f77fe700 1 --2- 172.21.15.82:0/1150083523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da7710 0x20160c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f46f7fff700 1 --2- 172.21.15.82:0/1150083523 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1df2790 0x203e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f46eeffd700 1 -- 172.21.15.82:0/1150083523 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1df2790 msgr2=0x203e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:28.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f46eeffd700 1 --2- 172.21.15.82:0/1150083523 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1df2790 0x203e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f46eeffd700 1 -- 172.21.15.82:0/1150083523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da7710 msgr2=0x20160c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:28.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f46eeffd700 1 --2- 172.21.15.82:0/1150083523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da7710 0x20160c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f46eeffd700 1 -- 172.21.15.82:0/1150083523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f0009c30 con 0x1da7ae0 2023-11-28T13:03:28.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f46eeffd700 1 --2- 172.21.15.82:0/1150083523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1da7ae0 0x2016c60 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f46e0053070 tx=0x7f46e0052910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6caed20f60085eb5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:28.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f46d67fc700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-11-28T13:03:28.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f46d67fc700 1 -- 172.21.15.82:0/1150083523 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e007fb60 con 0x1da7ae0 2023-11-28T13:03:28.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f46d67fc700 1 -- 172.21.15.82:0/1150083523 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f46e007fcc0 con 0x1da7ae0 2023-11-28T13:03:28.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f4700f20740 1 -- 172.21.15.82:0/1150083523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1f78f50 con 0x1da7ae0 2023-11-28T13:03:28.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f46d67fc700 1 -- 172.21.15.82:0/1150083523 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46e007fe80 con 0x1da7ae0 2023-11-28T13:03:28.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f4700f20740 10 client.6453 fetch_fsmap learned FSMap version 30 2023-11-28T13:03:28.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f4700f20740 1 -- 172.21.15.82:0/1150083523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x1df39e0 con 0x1da7ae0 2023-11-28T13:03:28.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f46d67fc700 1 -- 172.21.15.82:0/1150083523 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1f78f50 con 0x1da7ae0 2023-11-28T13:03:28.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f46d67fc700 1 -- 172.21.15.82:0/1150083523 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f46e004ef30 con 0x1da7ae0 2023-11-28T13:03:28.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f4700f20740 10 client.6453 fetch_fsmap finished waiting for FSMap version 30 2023-11-28T13:03:28.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f4700f20740 10 client.6453 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T13:03:28.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f4700f20740 20 client.6453 populate_metadata read hostname 'smithi082' 2023-11-28T13:03:28.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f4700f20740 1 --2- 172.21.15.82:0/1150083523 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x2019090 0x2071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f4700f20740 4 client.6453 mds_command: new command op to 6309 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T13:03:28.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f4700f20740 1 -- 172.21.15.82:0/1150083523 --> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1f78c70 con 0x2019090 2023-11-28T13:03:28.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f46f77fe700 1 --2- 172.21.15.82:0/1150083523 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x2019090 0x2071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f46d67fc700 10 client.6453 ms_handle_connect on v2:172.21.15.82:6836/2902091405 2023-11-28T13:03:28.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.208+0000 7f46f77fe700 1 --2- 172.21.15.82:0/1150083523 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x2019090 0x2071fa0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=619bb7e2661d79b1 server_cookie=b669163380bf8daf in_seq=0 out_seq=0 2023-11-28T13:03:28.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.212+0000 7f46d67fc700 1 -- 172.21.15.82:0/1150083523 <== mds.0 v2:172.21.15.82:6836/2902091405 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1f78c70 con 0x2019090 2023-11-28T13:03:28.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.212+0000 7f46d67fc700 10 client.6453 handle_command_reply: tid=0 2023-11-28T13:03:28.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.212+0000 7f4700f20740 1 client.6453 shutdown 2023-11-28T13:03:28.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.212+0000 7f4700f20740 1 -- 172.21.15.82:0/1150083523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1da7ae0 msgr2=0x2016c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:28.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.212+0000 7f4700f20740 1 --2- 172.21.15.82:0/1150083523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1da7ae0 0x2016c60 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f46e0053070 tx=0x7f46e0052910 comp rx=0 tx=0).stop 2023-11-28T13:03:28.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.212+0000 7f4700f20740 1 -- 172.21.15.82:0/1150083523 shutdown_connections 2023-11-28T13:03:28.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.212+0000 7f4700f20740 1 --2- 172.21.15.82:0/1150083523 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x2019090 0x2071fa0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.212+0000 7f4700f20740 1 --2- 172.21.15.82:0/1150083523 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1df2790 0x203e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.212+0000 7f4700f20740 1 --2- 172.21.15.82:0/1150083523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1da7ae0 0x2016c60 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.212+0000 7f46d67fc700 0 client.6453 ms_handle_reset on v2:172.21.15.82:6836/2902091405 2023-11-28T13:03:28.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.212+0000 7f4700f20740 1 --2- 172.21.15.82:0/1150083523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da7710 0x20160c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.212+0000 7f4700f20740 1 -- 172.21.15.82:0/1150083523 >> 172.21.15.82:0/1150083523 conn(0x1da7eb0 msgr2=0x2040780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:28.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.212+0000 7f4700f20740 1 -- 172.21.15.82:0/1150083523 shutdown_connections 2023-11-28T13:03:28.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.212+0000 7f4700f20740 1 -- 172.21.15.82:0/1150083523 wait complete. 2023-11-28T13:03:28.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.212+0000 7f4700f20740 20 client.6453 trim_cache size 0 max 16384 2023-11-28T13:03:28.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f4700f20740 1 Processor -- start 2023-11-28T13:03:28.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f4700f20740 1 -- start start 2023-11-28T13:03:28.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f4700f20740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1da7710 0x2019650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f4700f20740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1da7ae0 0x206df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f4700f20740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1df2790 0x206e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f4700f20740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f7d6e0 con 0x1da7ae0 2023-11-28T13:03:28.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f4700f20740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x2018950 con 0x1df2790 2023-11-28T13:03:28.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f4700f20740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f7d2d0 con 0x1da7710 2023-11-28T13:03:28.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f46eeffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1da7ae0 0x206df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f46eeffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1da7ae0 0x206df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58124/0 (socket says 172.21.15.82:58124) 2023-11-28T13:03:28.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f46eeffd700 1 -- 172.21.15.82:0/1365703752 learned_addr learned my addr 172.21.15.82:0/1365703752 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:28.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f46f7fff700 1 --2- 172.21.15.82:0/1365703752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1df2790 0x206e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f46f77fe700 1 --2- 172.21.15.82:0/1365703752 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1da7710 0x2019650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f46eeffd700 1 -- 172.21.15.82:0/1365703752 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1da7710 msgr2=0x2019650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:28.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f46eeffd700 1 --2- 172.21.15.82:0/1365703752 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1da7710 0x2019650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f46eeffd700 1 -- 172.21.15.82:0/1365703752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1df2790 msgr2=0x206e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:28.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f46eeffd700 1 --2- 172.21.15.82:0/1365703752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1df2790 0x206e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f46eeffd700 1 -- 172.21.15.82:0/1365703752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f806c4c0 con 0x1da7ae0 2023-11-28T13:03:28.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f46f77fe700 1 --2- 172.21.15.82:0/1365703752 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1da7710 0x2019650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:03:28.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f46eeffd700 1 --2- 172.21.15.82:0/1365703752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1da7ae0 0x206df60 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f46e0052df0 tx=0x7f46e0067000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb425b6f960403 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:28.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f46edffb700 1 -- 172.21.15.82:0/1365703752 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e005b2f0 con 0x1da7ae0 2023-11-28T13:03:28.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f46edffb700 1 -- 172.21.15.82:0/1365703752 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e0052aa0 con 0x1da7ae0 2023-11-28T13:03:28.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f46edffb700 1 -- 172.21.15.82:0/1365703752 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e004f2b0 con 0x1da7ae0 2023-11-28T13:03:28.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f4700f20740 1 -- 172.21.15.82:0/1365703752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1da7ae0 msgr2=0x206df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:28.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.232+0000 7f4700f20740 1 --2- 172.21.15.82:0/1365703752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1da7ae0 0x206df60 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f46e0052df0 tx=0x7f46e0067000 comp rx=0 tx=0).stop 2023-11-28T13:03:28.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 1 -- 172.21.15.82:0/1365703752 shutdown_connections 2023-11-28T13:03:28.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 1 --2- 172.21.15.82:0/1365703752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1df2790 0x206e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 1 --2- 172.21.15.82:0/1365703752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1da7ae0 0x206df60 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 1 --2- 172.21.15.82:0/1365703752 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1da7710 0x2019650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 1 -- 172.21.15.82:0/1365703752 >> 172.21.15.82:0/1365703752 conn(0x1da7eb0 msgr2=0x2015ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:28.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 1 -- 172.21.15.82:0/1365703752 shutdown_connections 2023-11-28T13:03:28.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 1 -- 172.21.15.82:0/1365703752 wait complete. 2023-11-28T13:03:28.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 1 -- start start 2023-11-28T13:03:28.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 1 Processor -- start 2023-11-28T13:03:28.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1da7710 0x2070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1da7ae0 0x20b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1df2790 0x20b3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f7ed60 con 0x1da7710 2023-11-28T13:03:28.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f87e60 con 0x1df2790 2023-11-28T13:03:28.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x2071f10 con 0x1da7ae0 2023-11-28T13:03:28.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 10 client.0 _ll_register_callbacks cb 0x1f2c2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:03:28.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f46f77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1da7710 0x2070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f46f77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1da7710 0x2070390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58132/0 (socket says 172.21.15.82:58132) 2023-11-28T13:03:28.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f46f77fe700 1 -- 172.21.15.82:0/869897474 learned_addr learned my addr 172.21.15.82:0/869897474 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:28.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f46f7fff700 1 --2- 172.21.15.82:0/869897474 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1df2790 0x20b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f46f77fe700 1 -- 172.21.15.82:0/869897474 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1da7ae0 msgr2=0x20b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:28.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f46eeffd700 1 --2- 172.21.15.82:0/869897474 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1da7ae0 0x20b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f46f77fe700 1 --2- 172.21.15.82:0/869897474 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1da7ae0 0x20b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f46f77fe700 1 -- 172.21.15.82:0/869897474 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1df2790 msgr2=0x20b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:28.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f46f77fe700 1 --2- 172.21.15.82:0/869897474 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1df2790 0x20b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f46f77fe700 1 -- 172.21.15.82:0/869897474 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1df39e0 con 0x1da7710 2023-11-28T13:03:28.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f46f7fff700 1 --2- 172.21.15.82:0/869897474 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1df2790 0x20b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:03:28.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f46eeffd700 1 --2- 172.21.15.82:0/869897474 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1da7ae0 0x20b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:03:28.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f46f77fe700 1 --2- 172.21.15.82:0/869897474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1da7710 0x2070390 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f46e800b0e0 tx=0x7f46e800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a144f410ea372d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:28.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f46d67fc700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-11-28T13:03:28.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f46d67fc700 1 -- 172.21.15.82:0/869897474 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e802d070 con 0x1da7710 2023-11-28T13:03:28.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f46d67fc700 1 -- 172.21.15.82:0/869897474 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f46e8028920 con 0x1da7710 2023-11-28T13:03:28.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 1 -- 172.21.15.82:0/869897474 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f46f000f050 con 0x1da7710 2023-11-28T13:03:28.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f46d67fc700 1 -- 172.21.15.82:0/869897474 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46e8028ae0 con 0x1da7710 2023-11-28T13:03:28.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 10 client.6459 fetch_fsmap learned FSMap version 30 2023-11-28T13:03:28.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 1 -- 172.21.15.82:0/869897474 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x1f2ca20 con 0x1da7710 2023-11-28T13:03:28.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f46d67fc700 1 -- 172.21.15.82:0/869897474 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f000f050 con 0x1da7710 2023-11-28T13:03:28.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f46d67fc700 1 -- 172.21.15.82:0/869897474 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f46e802f660 con 0x1da7710 2023-11-28T13:03:28.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 10 client.6459 fetch_fsmap finished waiting for FSMap version 30 2023-11-28T13:03:28.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 10 client.6459 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T13:03:28.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 20 client.6459 populate_metadata read hostname 'smithi082' 2023-11-28T13:03:28.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 1 --2- 172.21.15.82:0/869897474 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x2072a10 0x2072de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 4 client.6459 mds_command: new command op to 6309 tid=0[{"prefix": "status"}] 2023-11-28T13:03:28.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f4700f20740 1 -- 172.21.15.82:0/869897474 --> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1e24260 con 0x2072a10 2023-11-28T13:03:28.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.236+0000 7f46eeffd700 1 --2- 172.21.15.82:0/869897474 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x2072a10 0x2072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f46d67fc700 10 client.6459 ms_handle_connect on v2:172.21.15.82:6836/2902091405 2023-11-28T13:03:28.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f46eeffd700 1 --2- 172.21.15.82:0/869897474 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x2072a10 0x2072de0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d939f28cf1e1b311 server_cookie=f582303f1655fd2d in_seq=0 out_seq=0 2023-11-28T13:03:28.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f46d67fc700 1 -- 172.21.15.82:0/869897474 <== mds.0 v2:172.21.15.82:6836/2902091405 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x1e24260 con 0x2072a10 2023-11-28T13:03:28.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f46d67fc700 10 client.6459 handle_command_reply: tid=0 2023-11-28T13:03:28.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f4700f20740 1 client.6459 shutdown 2023-11-28T13:03:28.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f4700f20740 1 -- 172.21.15.82:0/869897474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1da7710 msgr2=0x2070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:28.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f4700f20740 1 --2- 172.21.15.82:0/869897474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1da7710 0x2070390 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f46e800b0e0 tx=0x7f46e800e000 comp rx=0 tx=0).stop 2023-11-28T13:03:28.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f4700f20740 1 -- 172.21.15.82:0/869897474 shutdown_connections 2023-11-28T13:03:28.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f4700f20740 1 --2- 172.21.15.82:0/869897474 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1df2790 0x20b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f4700f20740 1 --2- 172.21.15.82:0/869897474 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x2072a10 0x2072de0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f4700f20740 1 --2- 172.21.15.82:0/869897474 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x1da7ae0 0x20b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f4700f20740 1 --2- 172.21.15.82:0/869897474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x1da7710 0x2070390 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f4700f20740 1 -- 172.21.15.82:0/869897474 >> 172.21.15.82:0/869897474 conn(0x1da7eb0 msgr2=0x20559d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:28.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f46d67fc700 0 client.6459 ms_handle_reset on v2:172.21.15.82:6836/2902091405 2023-11-28T13:03:28.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f4700f20740 1 -- 172.21.15.82:0/869897474 shutdown_connections 2023-11-28T13:03:28.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f4700f20740 1 -- 172.21.15.82:0/869897474 wait complete. 2023-11-28T13:03:28.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f4700f20740 20 client.6459 trim_cache size 0 max 16384 2023-11-28T13:03:28.303 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:03:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "aef8a97f-1d6c-4a2b-9410-16861b3e9e35", 2023-11-28T13:03:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-11-28T13:03:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 6309, 2023-11-28T13:03:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-11-28T13:03:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-11-28T13:03:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-11-28T13:03:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 5.6781825709999998, 2023-11-28T13:03:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 30, 2023-11-28T13:03:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 65, 2023-11-28T13:03:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 65, 2023-11-28T13:03:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 10.227019154000001 2023-11-28T13:03:28.307 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:03:28.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f46fdca0700 1 -- 172.21.15.82:0/1986699353 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f46d8064ee0 msgr2=0x7f46d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:28.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f46fdca0700 1 --2- 172.21.15.82:0/1986699353 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f46d8064ee0 0x7f46d8067390 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f46e8000c00 tx=0x7f46e8008030 comp rx=0 tx=0).stop 2023-11-28T13:03:28.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f46fdca0700 1 -- 172.21.15.82:0/1986699353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f80ade20 msgr2=0x7f46f80bd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:28.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f46fdca0700 1 --2- 172.21.15.82:0/1986699353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f80ade20 0x7f46f80bd570 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f46e000c480 tx=0x7f46e000c840 comp rx=0 tx=0).stop 2023-11-28T13:03:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f46fdca0700 1 -- 172.21.15.82:0/1986699353 shutdown_connections 2023-11-28T13:03:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f46fdca0700 1 --2- 172.21.15.82:0/1986699353 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f46d8064ee0 0x7f46d8067390 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f46fdca0700 1 --2- 172.21.15.82:0/1986699353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46f8160b20 0x7f46f80bdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f46fdca0700 1 --2- 172.21.15.82:0/1986699353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f80ade20 0x7f46f80bd570 secure :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f46e000c480 tx=0x7f46e000c840 comp rx=0 tx=0).stop 2023-11-28T13:03:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f46fdca0700 1 --2- 172.21.15.82:0/1986699353 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46f80703e0 0x7f46f814cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f46fdca0700 1 -- 172.21.15.82:0/1986699353 >> 172.21.15.82:0/1986699353 conn(0x7f46f80ce9b0 msgr2=0x7f46f81632d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f46fdca0700 1 -- 172.21.15.82:0/1986699353 shutdown_connections 2023-11-28T13:03:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.240+0000 7f46fdca0700 1 -- 172.21.15.82:0/1986699353 wait complete. 2023-11-28T13:03:28.311 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T13:03:28.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.428+0000 7f232b59e700 1 Processor -- start 2023-11-28T13:03:28.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.428+0000 7f232b59e700 1 -- start start 2023-11-28T13:03:28.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.432+0000 7f232b59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f232c15c1c0 0x7f232c0c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.432+0000 7f232b59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f232c0ca4b0 0x7f232c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.432+0000 7f232b59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f232c06d910 0x7f232c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.432+0000 7f232b59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232c06dd90 con 0x7f232c0ca4b0 2023-11-28T13:03:28.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.432+0000 7f232b59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232c0cd2e0 con 0x7f232c15c1c0 2023-11-28T13:03:28.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.432+0000 7f232b59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232c0ca9c0 con 0x7f232c06d910 2023-11-28T13:03:28.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.432+0000 7f2321d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f232c0ca4b0 0x7f232c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.432+0000 7f2321d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f232c0ca4b0 0x7f232c06d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58140/0 (socket says 172.21.15.82:58140) 2023-11-28T13:03:28.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.432+0000 7f2321d9b700 1 -- 172.21.15.82:0/3981631662 learned_addr learned my addr 172.21.15.82:0/3981631662 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:28.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.432+0000 7f232ad9d700 1 --2- 172.21.15.82:0/3981631662 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f232c06d910 0x7f232c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.432+0000 7f232a59c700 1 --2- 172.21.15.82:0/3981631662 >> v2:172.21.15.114:3300/0 conn(0x7f232c15c1c0 0x7f232c0c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.432+0000 7f2321d9b700 1 -- 172.21.15.82:0/3981631662 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f232c06d910 msgr2=0x7f232c0710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:28.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.432+0000 7f2321d9b700 1 --2- 172.21.15.82:0/3981631662 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f232c06d910 0x7f232c0710b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.432+0000 7f2321d9b700 1 -- 172.21.15.82:0/3981631662 >> v2:172.21.15.114:3300/0 conn(0x7f232c15c1c0 msgr2=0x7f232c0c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:28.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.432+0000 7f2321d9b700 1 --2- 172.21.15.82:0/3981631662 >> v2:172.21.15.114:3300/0 conn(0x7f232c15c1c0 0x7f232c0c9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.432+0000 7f2321d9b700 1 -- 172.21.15.82:0/3981631662 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c0cd530 con 0x7f232c0ca4b0 2023-11-28T13:03:28.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.432+0000 7f232a59c700 1 --2- 172.21.15.82:0/3981631662 >> v2:172.21.15.114:3300/0 conn(0x7f232c15c1c0 0x7f232c0c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:03:28.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.432+0000 7f2321d9b700 1 --2- 172.21.15.82:0/3981631662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232c0ca4b0 0x7f232c06d3d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f232c06e100 tx=0x7f2314009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e47f3f7f2a6cb2d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:28.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.432+0000 7f2329d9b700 1 -- 172.21.15.82:0/3981631662 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314011830 con 0x7f232c0ca4b0 2023-11-28T13:03:28.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.432+0000 7f2329d9b700 1 -- 172.21.15.82:0/3981631662 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2314011990 con 0x7f232c0ca4b0 2023-11-28T13:03:28.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.432+0000 7f2329d9b700 1 -- 172.21.15.82:0/3981631662 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314011d20 con 0x7f232c0ca4b0 2023-11-28T13:03:28.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.436+0000 7f232b59e700 1 -- 172.21.15.82:0/3981631662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232c0ca4b0 msgr2=0x7f232c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:28.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.436+0000 7f232b59e700 1 --2- 172.21.15.82:0/3981631662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232c0ca4b0 0x7f232c06d3d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f232c06e100 tx=0x7f2314009bf0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.436+0000 7f232b59e700 1 -- 172.21.15.82:0/3981631662 shutdown_connections 2023-11-28T13:03:28.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.436+0000 7f232b59e700 1 --2- 172.21.15.82:0/3981631662 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f232c06d910 0x7f232c0710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.436+0000 7f232b59e700 1 --2- 172.21.15.82:0/3981631662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232c0ca4b0 0x7f232c06d3d0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.436+0000 7f232b59e700 1 --2- 172.21.15.82:0/3981631662 >> v2:172.21.15.114:3300/0 conn(0x7f232c15c1c0 0x7f232c0c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.436+0000 7f232b59e700 1 -- 172.21.15.82:0/3981631662 >> 172.21.15.82:0/3981631662 conn(0x7f232c0cf710 msgr2=0x7f232c0cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:28.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.436+0000 7f232b59e700 1 -- 172.21.15.82:0/3981631662 shutdown_connections 2023-11-28T13:03:28.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.436+0000 7f232b59e700 1 -- 172.21.15.82:0/3981631662 wait complete. 2023-11-28T13:03:28.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.436+0000 7f232b59e700 1 Processor -- start 2023-11-28T13:03:28.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.436+0000 7f232b59e700 1 -- start start 2023-11-28T13:03:28.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f232b59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f232c06d910 0x7f232c149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f232b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232c0ca4b0 0x7f232c15d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f232b59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f232c15c1c0 0x7f232c1f5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f232b59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c15d5a0 con 0x7f232c0ca4b0 2023-11-28T13:03:28.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f232b59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c1f6010 con 0x7f232c15c1c0 2023-11-28T13:03:28.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f232b59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232c0b0320 con 0x7f232c06d910 2023-11-28T13:03:28.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f2321d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232c0ca4b0 0x7f232c15d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f2321d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232c0ca4b0 0x7f232c15d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58152/0 (socket says 172.21.15.82:58152) 2023-11-28T13:03:28.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f2321d9b700 1 -- 172.21.15.82:0/3351448177 learned_addr learned my addr 172.21.15.82:0/3351448177 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:28.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f232a59c700 1 --2- 172.21.15.82:0/3351448177 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f232c06d910 0x7f232c149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f232ad9d700 1 --2- 172.21.15.82:0/3351448177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f232c15c1c0 0x7f232c1f5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f2321d9b700 1 -- 172.21.15.82:0/3351448177 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f232c06d910 msgr2=0x7f232c149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:28.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f2321d9b700 1 --2- 172.21.15.82:0/3351448177 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f232c06d910 0x7f232c149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f2321d9b700 1 -- 172.21.15.82:0/3351448177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f232c15c1c0 msgr2=0x7f232c1f5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:28.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f2321d9b700 1 --2- 172.21.15.82:0/3351448177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f232c15c1c0 0x7f232c1f5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f2321d9b700 1 -- 172.21.15.82:0/3351448177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c0094b0 con 0x7f232c0ca4b0 2023-11-28T13:03:28.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f2321d9b700 1 --2- 172.21.15.82:0/3351448177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232c0ca4b0 0x7f232c15d060 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2314014040 tx=0x7f2314004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:28.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f23237fe700 1 -- 172.21.15.82:0/3351448177 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314004450 con 0x7f232c0ca4b0 2023-11-28T13:03:28.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f23237fe700 1 -- 172.21.15.82:0/3351448177 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231401e070 con 0x7f232c0ca4b0 2023-11-28T13:03:28.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f232b59e700 1 -- 172.21.15.82:0/3351448177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2314009570 con 0x7f232c0ca4b0 2023-11-28T13:03:28.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f23237fe700 1 -- 172.21.15.82:0/3351448177 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314003900 con 0x7f232c0ca4b0 2023-11-28T13:03:28.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.440+0000 7f232b59e700 1 -- 172.21.15.82:0/3351448177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c0cdaf0 con 0x7f232c0ca4b0 2023-11-28T13:03:28.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.444+0000 7f232b59e700 1 -- 172.21.15.82:0/3351448177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232c0cd810 con 0x7f232c0ca4b0 2023-11-28T13:03:28.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.444+0000 7f23237fe700 1 -- 172.21.15.82:0/3351448177 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f231400f050 con 0x7f232c0ca4b0 2023-11-28T13:03:28.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.444+0000 7f23237fe700 1 --2- 172.21.15.82:0/3351448177 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f230c064ee0 0x7f230c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:28.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.444+0000 7f23237fe700 1 -- 172.21.15.82:0/3351448177 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2314020070 con 0x7f232c0ca4b0 2023-11-28T13:03:28.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.444+0000 7f232a59c700 1 --2- 172.21.15.82:0/3351448177 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f230c064ee0 0x7f230c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:28.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.444+0000 7f232a59c700 1 --2- 172.21.15.82:0/3351448177 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f230c064ee0 0x7f230c067390 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f231c009c60 tx=0x7f231c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:28.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.452+0000 7f23237fe700 1 -- 172.21.15.82:0/3351448177 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f23140512e0 con 0x7f232c0ca4b0 2023-11-28T13:03:28.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.652+0000 7f232b59e700 1 -- 172.21.15.82:0/3351448177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f232c15c590 con 0x7f232c0ca4b0 2023-11-28T13:03:28.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.652+0000 7f23237fe700 1 -- 172.21.15.82:0/3351448177 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2314054900 con 0x7f232c0ca4b0 2023-11-28T13:03:28.656 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T13:03:28.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.652+0000 7f232b59e700 1 -- 172.21.15.82:0/3351448177 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f230c064ee0 msgr2=0x7f230c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:28.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.652+0000 7f232b59e700 1 --2- 172.21.15.82:0/3351448177 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f230c064ee0 0x7f230c067390 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f231c009c60 tx=0x7f231c009240 comp rx=0 tx=0).stop 2023-11-28T13:03:28.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.652+0000 7f232b59e700 1 -- 172.21.15.82:0/3351448177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232c0ca4b0 msgr2=0x7f232c15d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:28.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.652+0000 7f232b59e700 1 --2- 172.21.15.82:0/3351448177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232c0ca4b0 0x7f232c15d060 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2314014040 tx=0x7f2314004770 comp rx=0 tx=0).stop 2023-11-28T13:03:28.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.652+0000 7f232b59e700 1 -- 172.21.15.82:0/3351448177 shutdown_connections 2023-11-28T13:03:28.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.652+0000 7f232b59e700 1 --2- 172.21.15.82:0/3351448177 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f230c064ee0 0x7f230c067390 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.652+0000 7f232b59e700 1 --2- 172.21.15.82:0/3351448177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f232c15c1c0 0x7f232c1f5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.652+0000 7f232b59e700 1 --2- 172.21.15.82:0/3351448177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232c0ca4b0 0x7f232c15d060 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.652+0000 7f232b59e700 1 --2- 172.21.15.82:0/3351448177 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f232c06d910 0x7f232c149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:28.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.656+0000 7f232b59e700 1 -- 172.21.15.82:0/3351448177 >> 172.21.15.82:0/3351448177 conn(0x7f232c0cf710 msgr2=0x7f232c157100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:28.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.656+0000 7f232b59e700 1 -- 172.21.15.82:0/3351448177 shutdown_connections 2023-11-28T13:03:28.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:28.656+0000 7f232b59e700 1 -- 172.21.15.82:0/3351448177 wait complete. 2023-11-28T13:03:28.671 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T13:03:28.671 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T13:03:28.672 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-11-28T13:03:28.672 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T13:03:28.672 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T13:03:28.672 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T13:03:28.672 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T13:03:28.672 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T13:03:28.672 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T13:03:28.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:03:28.673 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-11-28T13:03:28.681 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T13:03:28.681 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T13:03:28.681 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T13:03:28.681 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:03:28.681 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-11-28T13:03:28.682 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:03:28.682 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T13:03:28.682 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:03:28.682 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T13:03:28.682 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:03:28.682 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T13:03:28.682 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-11-28T13:03:28.683 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T13:03:28.683 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-11-28T13:03:28.683 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T13:03:28.683 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42373sec preferred_lft 42373sec 2023-11-28T13:03:28.683 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-11-28T13:03:28.683 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:03:28.683 INFO:teuthology.orchestra.run.smithi082.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T13:03:28.683 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:42:02:22:90:39 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:03:28.683 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T13:03:28.684 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:03:28.684 INFO:teuthology.orchestra.run.smithi082.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T13:03:28.684 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether ba:e2:2a:24:1a:10 brd ff:ff:ff:ff:ff:ff 2023-11-28T13:03:28.684 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T13:03:28.684 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:03:28.684 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::78c5:d7ff:fe17:75c8/64 scope link 2023-11-28T13:03:28.684 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:03:28.685 INFO:teuthology.orchestra.run.smithi082.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T13:03:28.685 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether f2:23:62:63:4a:4e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T13:03:28.685 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::f023:62ff:fe63:4a4e/64 scope link 2023-11-28T13:03:28.685 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:03:28.685 INFO:teuthology.orchestra.run.smithi082.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T13:03:28.685 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether ba:e2:2a:24:1a:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T13:03:28.685 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::b8e2:2aff:fe24:1a10/64 scope link 2023-11-28T13:03:28.685 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-11-28T13:03:28.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:03:28.686 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T13:03:28.700 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-11-28T13:03:28.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:03:28.702 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-11-28T13:03:28.710 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-11-28T13:03:28.710 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T13:03:28.710 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T13:03:28.710 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T13:03:28.710 INFO:teuthology.orchestra.run.smithi082.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T13:03:28.710 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-28T13:03:28.711 INFO:teuthology.orchestra.run.smithi082.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T13:03:28.711 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T13:03:28.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:03:28.711 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-11-28T13:03:28.711 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-11-28T13:03:28.711 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T13:03:28.711 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T13:03:28.711 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T13:03:28.711 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-11-28T13:03:28.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:03:28.790 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-11-28T13:03:28.797 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T13:03:28.797 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T13:03:28.798 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T13:03:28.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:03:28.798 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-11-28T13:03:28.811 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T13:03:28.811 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T13:03:28.811 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T13:03:28.861 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T13:03:28.861 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T13:03:28.861 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T13:03:28.867 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2023-11-28T13:03:28.885 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T13:03:28.885 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T13:03:28.901 INFO:teuthology.orchestra.run.smithi082.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T13:03:28.902 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T13:03:28.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:03:28.903 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2023-11-28T13:03:28.907 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T13:03:28.908 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-28T13:03:28.909 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2023-11-28T13:03:28.921 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T13:03:28.921 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T13:03:28.975 INFO:teuthology.orchestra.run.smithi082.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T13:03:28.976 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T13:03:28.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:03:28.977 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2023-11-28T13:03:28.997 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:2023-11-28T13:03:28.992+0000 7f0476083640 -1 init, newargv = 0x55e1482e5c80 newargc=15 2023-11-28T13:03:28.997 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[51754]: starting ceph client 2023-11-28T13:03:29.006 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[51754]: starting fuse 2023-11-28T13:03:30.083 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2023-11-28T13:03:30.102 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T13:03:30.102 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T13:03:30.162 INFO:teuthology.orchestra.run.smithi082.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T13:03:30.163 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T13:03:30.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:03:30.163 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2023-11-28T13:03:30.171 INFO:teuthology.orchestra.run.smithi082.stdout:52 2023-11-28T13:03:30.171 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-28T13:03:30.171 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T13:03:30.171 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2023-11-28T13:03:30.171 DEBUG:teuthology.orchestra.run.smithi082:> import re 2023-11-28T13:03:30.172 DEBUG:teuthology.orchestra.run.smithi082:> import os 2023-11-28T13:03:30.172 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2023-11-28T13:03:30.172 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:03:30.172 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2023-11-28T13:03:30.172 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T13:03:30.172 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2023-11-28T13:03:30.172 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T13:03:30.172 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:03:30.172 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2023-11-28T13:03:30.172 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2023-11-28T13:03:30.172 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2023-11-28T13:03:30.173 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2023-11-28T13:03:30.173 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:03:30.173 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2023-11-28T13:03:30.173 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T13:03:30.173 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T13:03:30.173 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T13:03:30.173 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2023-11-28T13:03:30.173 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2023-11-28T13:03:30.173 DEBUG:teuthology.orchestra.run.smithi082:> return f 2023-11-28T13:03:30.173 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T13:03:30.173 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:03:30.173 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.0")) 2023-11-28T13:03:30.173 DEBUG:teuthology.orchestra.run.smithi082:> ' 2023-11-28T13:03:30.252 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.0.51754.asok 2023-11-28T13:03:30.437 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.51754.asok 2023-11-28T13:03:30.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:03:30.438 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.51754.asok status 2023-11-28T13:03:30.584 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:03:30.584 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2023-11-28T13:03:30.584 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T13:03:30.584 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T13:03:30.584 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "0", 2023-11-28T13:03:30.584 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2023-11-28T13:03:30.584 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T13:03:30.584 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "51754", 2023-11-28T13:03:30.585 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/" 2023-11-28T13:03:30.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:30.585 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2023-11-28T13:03:30.585 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2023-11-28T13:03:30.585 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 6474, 2023-11-28T13:03:30.585 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2023-11-28T13:03:30.585 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2023-11-28T13:03:30.585 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2023-11-28T13:03:30.585 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 6474 2023-11-28T13:03:30.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:30.586 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2023-11-28T13:03:30.586 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2023-11-28T13:03:30.586 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2023-11-28T13:03:30.586 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 511819993 2023-11-28T13:03:30.586 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:30.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:30.586 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2023-11-28T13:03:30.586 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2023-11-28T13:03:30.586 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2023-11-28T13:03:30.586 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 511819993 2023-11-28T13:03:30.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:30.586 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.6474 192.168.0.1:0/511819993", 2023-11-28T13:03:30.586 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "192.168.0.1:0/511819993", 2023-11-28T13:03:30.587 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 1, 2023-11-28T13:03:30.587 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 30, 2023-11-28T13:03:30.587 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 65, 2023-11-28T13:03:30.587 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2023-11-28T13:03:30.587 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2023-11-28T13:03:30.587 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2023-11-28T13:03:30.587 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:03:30.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:03:30.594 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2023-11-28T13:03:30.595 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T13:03:30.601 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2023-11-28T13:03:30.601 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T13:03:30.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:03:30.602 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T13:03:30.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:03:30.612 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_test) 2023-11-28T13:03:30.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:03:30.673 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir_test/file) 2023-11-28T13:03:30.686 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T13:03:30.686 DEBUG:teuthology.orchestra.run.smithi082:> import os 2023-11-28T13:03:30.686 DEBUG:teuthology.orchestra.run.smithi082:> import stat 2023-11-28T13:03:30.686 DEBUG:teuthology.orchestra.run.smithi082:> 2023-11-28T13:03:30.686 DEBUG:teuthology.orchestra.run.smithi082:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_test/file").st_ino) 2023-11-28T13:03:30.687 DEBUG:teuthology.orchestra.run.smithi082:> ' 2023-11-28T13:03:30.756 INFO:teuthology.orchestra.run.smithi082.stdout:1099511627777 2023-11-28T13:03:30.944 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:03:31.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f2e90700 1 Processor -- start 2023-11-28T13:03:31.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f2e90700 1 -- start start 2023-11-28T13:03:31.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f2e90700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc4ec06d3d0 0x7fc4ec06d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f2e90700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc4ec0ce010 0x7fc4ec0ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f2e90700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ec06dd60 con 0x7fc4ec15c1c0 2023-11-28T13:03:31.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f2e90700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ec0cd2e0 con 0x7fc4ec0ce010 2023-11-28T13:03:31.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f2e90700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ec0ca9c0 con 0x7fc4ec06d3d0 2023-11-28T13:03:31.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f268f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc4ec0ce010 0x7fc4ec0ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f268f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc4ec0ce010 0x7fc4ec0ce410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58164/0 (socket says 172.21.15.82:58164) 2023-11-28T13:03:31.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f268f700 1 -- 172.21.15.82:0/2371859019 learned_addr learned my addr 172.21.15.82:0/2371859019 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:31.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f168d700 1 --2- 172.21.15.82:0/2371859019 >> v2:172.21.15.114:3300/0 conn(0x7fc4ec06d3d0 0x7fc4ec06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f268f700 1 -- 172.21.15.82:0/2371859019 >> v2:172.21.15.114:3300/0 conn(0x7fc4ec06d3d0 msgr2=0x7fc4ec06d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f268f700 1 --2- 172.21.15.82:0/2371859019 >> v2:172.21.15.114:3300/0 conn(0x7fc4ec06d3d0 0x7fc4ec06d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f268f700 1 -- 172.21.15.82:0/2371859019 >> v1:172.21.15.114:6789/0 conn(0x7fc4ec15c1c0 legacy=0x7fc4ec0c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f268f700 1 -- 172.21.15.82:0/2371859019 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec0cd530 con 0x7fc4ec0ce010 2023-11-28T13:03:31.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f268f700 1 --2- 172.21.15.82:0/2371859019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4ec0ce010 0x7fc4ec0ce410 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec06e6b0 tx=0x7fc4e4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f279ebfa7b139a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f0e8c700 1 -- 172.21.15.82:0/2371859019 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4004230 con 0x7fc4ec0ce010 2023-11-28T13:03:31.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f0e8c700 1 -- 172.21.15.82:0/2371859019 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e4004390 con 0x7fc4ec0ce010 2023-11-28T13:03:31.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f0e8c700 1 -- 172.21.15.82:0/2371859019 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e40036c0 con 0x7fc4ec0ce010 2023-11-28T13:03:31.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f2e90700 1 -- 172.21.15.82:0/2371859019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4ec0ce010 msgr2=0x7fc4ec0ce410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f2e90700 1 --2- 172.21.15.82:0/2371859019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4ec0ce010 0x7fc4ec0ce410 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec06e6b0 tx=0x7fc4e4009bf0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f2e90700 1 -- 172.21.15.82:0/2371859019 shutdown_connections 2023-11-28T13:03:31.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f2e90700 1 --2- 172.21.15.82:0/2371859019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4ec0ce010 0x7fc4ec0ce410 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f2e90700 1 --2- 172.21.15.82:0/2371859019 >> v2:172.21.15.114:3300/0 conn(0x7fc4ec06d3d0 0x7fc4ec06d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f2e90700 1 -- 172.21.15.82:0/2371859019 >> 172.21.15.82:0/2371859019 conn(0x7fc4ec0cf710 msgr2=0x7fc4ec0cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:31.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f2e90700 1 -- 172.21.15.82:0/2371859019 shutdown_connections 2023-11-28T13:03:31.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.064+0000 7fc4f2e90700 1 -- 172.21.15.82:0/2371859019 wait complete. 2023-11-28T13:03:31.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4f2e90700 1 Processor -- start 2023-11-28T13:03:31.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4f2e90700 1 -- start start 2023-11-28T13:03:31.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4f2e90700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4ec06d3d0 0x7fc4ec0acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4f2e90700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4ec0ce010 0x7fc4ec0b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4f2e90700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4ec15c1c0 0x7fc4ec0adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4f2e90700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec0aca30 con 0x7fc4ec15c1c0 2023-11-28T13:03:31.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4f2e90700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec0abe20 con 0x7fc4ec06d3d0 2023-11-28T13:03:31.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4f2e90700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec0ac100 con 0x7fc4ec0ce010 2023-11-28T13:03:31.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4f268f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4ec15c1c0 0x7fc4ec0adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4f268f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4ec15c1c0 0x7fc4ec0adde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58178/0 (socket says 172.21.15.82:58178) 2023-11-28T13:03:31.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4f268f700 1 -- 172.21.15.82:0/1496017038 learned_addr learned my addr 172.21.15.82:0/1496017038 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:31.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4f168d700 1 --2- 172.21.15.82:0/1496017038 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4ec0ce010 0x7fc4ec0b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4f1e8e700 1 --2- 172.21.15.82:0/1496017038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4ec06d3d0 0x7fc4ec0acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4f268f700 1 -- 172.21.15.82:0/1496017038 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4ec0ce010 msgr2=0x7fc4ec0b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4f268f700 1 --2- 172.21.15.82:0/1496017038 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4ec0ce010 0x7fc4ec0b17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4f268f700 1 -- 172.21.15.82:0/1496017038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4ec06d3d0 msgr2=0x7fc4ec0acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4f268f700 1 --2- 172.21.15.82:0/1496017038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4ec06d3d0 0x7fc4ec0acec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4f268f700 1 -- 172.21.15.82:0/1496017038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e4009570 con 0x7fc4ec15c1c0 2023-11-28T13:03:31.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4f268f700 1 --2- 172.21.15.82:0/1496017038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4ec15c1c0 0x7fc4ec0adde0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009c30 tx=0x7fc4e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4e27fc700 1 -- 172.21.15.82:0/1496017038 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e40036e0 con 0x7fc4ec15c1c0 2023-11-28T13:03:31.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4e27fc700 1 -- 172.21.15.82:0/1496017038 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e400b660 con 0x7fc4ec15c1c0 2023-11-28T13:03:31.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4f2e90700 1 -- 172.21.15.82:0/1496017038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ec0cdaf0 con 0x7fc4ec15c1c0 2023-11-28T13:03:31.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4e27fc700 1 -- 172.21.15.82:0/1496017038 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e400b9f0 con 0x7fc4ec15c1c0 2023-11-28T13:03:31.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.068+0000 7fc4f2e90700 1 -- 172.21.15.82:0/1496017038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ec0cd810 con 0x7fc4ec15c1c0 2023-11-28T13:03:31.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.072+0000 7fc4f2e90700 1 -- 172.21.15.82:0/1496017038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4ec15c590 con 0x7fc4ec15c1c0 2023-11-28T13:03:31.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.072+0000 7fc4e27fc700 1 -- 172.21.15.82:0/1496017038 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc4e4017020 con 0x7fc4ec15c1c0 2023-11-28T13:03:31.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.072+0000 7fc4e27fc700 1 --2- 172.21.15.82:0/1496017038 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc4d8064ee0 0x7fc4d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.072+0000 7fc4e27fc700 1 -- 172.21.15.82:0/1496017038 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc4e4083300 con 0x7fc4ec15c1c0 2023-11-28T13:03:31.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.072+0000 7fc4f1e8e700 1 --2- 172.21.15.82:0/1496017038 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc4d8064ee0 0x7fc4d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.072+0000 7fc4f1e8e700 1 --2- 172.21.15.82:0/1496017038 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc4d8064ee0 0x7fc4d8067390 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec158030 tx=0x7fc4dc007ee0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.080+0000 7fc4e27fc700 1 -- 172.21.15.82:0/1496017038 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc4e4051420 con 0x7fc4ec15c1c0 2023-11-28T13:03:31.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.280+0000 7fc4f2e90700 1 -- 172.21.15.82:0/1496017038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4ec06dd60 con 0x7fc4ec15c1c0 2023-11-28T13:03:31.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.280+0000 7fc4e27fc700 1 -- 172.21.15.82:0/1496017038 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4655 (secure 0 0 0) 0x7fc4ec06dd60 con 0x7fc4ec15c1c0 2023-11-28T13:03:31.286 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:31.286 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/3176308867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3176308867},{"type":"v1","addr":"172.21.15.114:6833","nonce":3176308867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6184,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1779270694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1779270694},{"type":"v1","addr":"172.21.15.114:6835","nonce":1779270694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1570999968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1570999968},{"type":"v1","addr":"172.21.15.82:6835","nonce":1570999968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:03:22.559646+0000","modified":"2023-11-28T13:03:25.579582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2902091405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2902091405},{"type":"v1","addr":"172.21.15.82:6837","nonce":2902091405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T13:03:31.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.284+0000 7fc4f2e90700 1 -- 172.21.15.82:0/1496017038 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc4d8064ee0 msgr2=0x7fc4d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.284+0000 7fc4f2e90700 1 --2- 172.21.15.82:0/1496017038 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc4d8064ee0 0x7fc4d8067390 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec158030 tx=0x7fc4dc007ee0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.284+0000 7fc4f2e90700 1 -- 172.21.15.82:0/1496017038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4ec15c1c0 msgr2=0x7fc4ec0adde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.284+0000 7fc4f2e90700 1 --2- 172.21.15.82:0/1496017038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4ec15c1c0 0x7fc4ec0adde0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009c30 tx=0x7fc4e4004770 comp rx=0 tx=0).stop 2023-11-28T13:03:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.284+0000 7fc4f2e90700 1 -- 172.21.15.82:0/1496017038 shutdown_connections 2023-11-28T13:03:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.284+0000 7fc4f2e90700 1 --2- 172.21.15.82:0/1496017038 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc4d8064ee0 0x7fc4d8067390 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.284+0000 7fc4f2e90700 1 --2- 172.21.15.82:0/1496017038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4ec15c1c0 0x7fc4ec0adde0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.284+0000 7fc4f2e90700 1 --2- 172.21.15.82:0/1496017038 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4ec0ce010 0x7fc4ec0b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.284+0000 7fc4f2e90700 1 --2- 172.21.15.82:0/1496017038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4ec06d3d0 0x7fc4ec0acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.284+0000 7fc4f2e90700 1 -- 172.21.15.82:0/1496017038 >> 172.21.15.82:0/1496017038 conn(0x7fc4ec0cf710 msgr2=0x7fc4ec06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.284+0000 7fc4f2e90700 1 -- 172.21.15.82:0/1496017038 shutdown_connections 2023-11-28T13:03:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.284+0000 7fc4f2e90700 1 -- 172.21.15.82:0/1496017038 wait complete. 2023-11-28T13:03:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 30 2023-11-28T13:03:31.299 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-11-28T13:03:31.429 INFO:teuthology.orchestra.run.smithi082.stdout:{"message":"","return_code":0} 2023-11-28T13:03:31.430 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-28T13:03:31.430 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-11-28T13:03:31.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f69579db140 1 Processor -- start 2023-11-28T13:03:31.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f69579db140 1 -- start start 2023-11-28T13:03:31.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f69579db140 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630951fed30 0x5630953651b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f69579db140 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5630952d15b0 0x5630953656f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f69579db140 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5630952d4b30 0x563095245b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f69579db140 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563095123240 con 0x5630951fed30 2023-11-28T13:03:31.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f69579db140 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x563095244c60 con 0x5630952d4b30 2023-11-28T13:03:31.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f69579db140 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x563095244f00 con 0x5630952d15b0 2023-11-28T13:03:31.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f6955510700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630951fed30 0x5630953651b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f6955510700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630951fed30 0x5630953651b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58210/0 (socket says 172.21.15.82:58210) 2023-11-28T13:03:31.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f6955510700 1 -- 172.21.15.82:0/2672924496 learned_addr learned my addr 172.21.15.82:0/2672924496 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:31.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f6954d0f700 1 --2- 172.21.15.82:0/2672924496 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5630952d15b0 0x5630953656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f6955d11700 1 --2- 172.21.15.82:0/2672924496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5630952d4b30 0x563095245b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f6955510700 1 -- 172.21.15.82:0/2672924496 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5630952d15b0 msgr2=0x5630953656f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f6955510700 1 --2- 172.21.15.82:0/2672924496 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5630952d15b0 0x5630953656f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f6955510700 1 -- 172.21.15.82:0/2672924496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5630952d4b30 msgr2=0x563095245b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f6955510700 1 --2- 172.21.15.82:0/2672924496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5630952d4b30 0x563095245b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f6955510700 1 -- 172.21.15.82:0/2672924496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6950005de0 con 0x5630951fed30 2023-11-28T13:03:31.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f6955510700 1 --2- 172.21.15.82:0/2672924496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630951fed30 0x5630953651b0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f694800b2c0 tx=0x7f694800b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7793b82fa7f590c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f694f7fe700 1 -- 172.21.15.82:0/2672924496 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6948014070 con 0x5630951fed30 2023-11-28T13:03:31.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f694f7fe700 1 -- 172.21.15.82:0/2672924496 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694800f3f0 con 0x5630951fed30 2023-11-28T13:03:31.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f694f7fe700 1 -- 172.21.15.82:0/2672924496 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694800f7a0 con 0x5630951fed30 2023-11-28T13:03:31.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f69579db140 1 -- 172.21.15.82:0/2672924496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630951fed30 msgr2=0x5630953651b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f69579db140 1 --2- 172.21.15.82:0/2672924496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630951fed30 0x5630953651b0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f694800b2c0 tx=0x7f694800b5d0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f69579db140 1 -- 172.21.15.82:0/2672924496 shutdown_connections 2023-11-28T13:03:31.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f69579db140 1 --2- 172.21.15.82:0/2672924496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5630952d4b30 0x563095245b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f69579db140 1 --2- 172.21.15.82:0/2672924496 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5630952d15b0 0x5630953656f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f69579db140 1 --2- 172.21.15.82:0/2672924496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630951fed30 0x5630953651b0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f69579db140 1 -- 172.21.15.82:0/2672924496 >> 172.21.15.82:0/2672924496 conn(0x563095228770 msgr2=0x56309522c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:31.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f69579db140 1 -- 172.21.15.82:0/2672924496 shutdown_connections 2023-11-28T13:03:31.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.468+0000 7f69579db140 1 -- 172.21.15.82:0/2672924496 wait complete. 2023-11-28T13:03:31.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.472+0000 7f69579db140 1 Processor -- start 2023-11-28T13:03:31.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.472+0000 7f69579db140 1 -- start start 2023-11-28T13:03:31.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.472+0000 7f69579db140 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5630951fed30 0x5630952b2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.472+0000 7f69579db140 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5630952d15b0 0x5630952b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.472+0000 7f69579db140 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630952d4b30 0x5630952b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.472+0000 7f69579db140 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630952b3ad0 con 0x5630952d4b30 2023-11-28T13:03:31.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.472+0000 7f69579db140 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630952b3d10 con 0x5630951fed30 2023-11-28T13:03:31.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.472+0000 7f69579db140 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x5630952b3fb0 con 0x5630952d15b0 2023-11-28T13:03:31.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.472+0000 7f6955d11700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630952d4b30 0x5630952b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.472+0000 7f6955d11700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630952d4b30 0x5630952b4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58218/0 (socket says 172.21.15.82:58218) 2023-11-28T13:03:31.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.472+0000 7f6955d11700 1 -- 172.21.15.82:0/3680442409 learned_addr learned my addr 172.21.15.82:0/3680442409 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:31.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.472+0000 7f6955510700 1 --2- 172.21.15.82:0/3680442409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5630951fed30 0x5630952b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.472+0000 7f6954d0f700 1 --2- 172.21.15.82:0/3680442409 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5630952d15b0 0x5630952b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.472+0000 7f6955d11700 1 -- 172.21.15.82:0/3680442409 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5630952d15b0 msgr2=0x5630952b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.472+0000 7f6955d11700 1 --2- 172.21.15.82:0/3680442409 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5630952d15b0 0x5630952b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.472+0000 7f6955d11700 1 -- 172.21.15.82:0/3680442409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5630951fed30 msgr2=0x5630952b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.472+0000 7f6955d11700 1 --2- 172.21.15.82:0/3680442409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5630951fed30 0x5630952b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.472+0000 7f6955d11700 1 -- 172.21.15.82:0/3680442409 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6948001ba0 con 0x5630952d4b30 2023-11-28T13:03:31.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.472+0000 7f6955510700 1 --2- 172.21.15.82:0/3680442409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5630951fed30 0x5630952b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:03:31.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.472+0000 7f6955d11700 1 --2- 172.21.15.82:0/3680442409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630952d4b30 0x5630952b4c30 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f695000a8c0 tx=0x7f6950002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.476+0000 7f694e7fc700 1 -- 172.21.15.82:0/3680442409 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6950008e20 con 0x5630952d4b30 2023-11-28T13:03:31.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.476+0000 7f694e7fc700 1 -- 172.21.15.82:0/3680442409 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695001d420 con 0x5630952d4b30 2023-11-28T13:03:31.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.476+0000 7f69579db140 1 -- 172.21.15.82:0/3680442409 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56309513b390 con 0x5630952d4b30 2023-11-28T13:03:31.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.476+0000 7f694e7fc700 1 -- 172.21.15.82:0/3680442409 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695001d7d0 con 0x5630952d4b30 2023-11-28T13:03:31.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.476+0000 7f69579db140 1 -- 172.21.15.82:0/3680442409 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56309512e8b0 con 0x5630952d4b30 2023-11-28T13:03:31.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.476+0000 7f694e7fc700 1 -- 172.21.15.82:0/3680442409 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f695001d930 con 0x5630952d4b30 2023-11-28T13:03:31.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.476+0000 7f694e7fc700 1 --2- 172.21.15.82:0/3680442409 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6938063840 0x7f6938065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.476+0000 7f694e7fc700 1 -- 172.21.15.82:0/3680442409 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6950081d30 con 0x5630952d4b30 2023-11-28T13:03:31.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.476+0000 7f6955510700 1 --2- 172.21.15.82:0/3680442409 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6938063840 0x7f6938065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.476+0000 7f69579db140 1 --2- 172.21.15.82:0/3680442409 >> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] conn(0x5630952d0050 0x5630952b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.476+0000 7f69579db140 1 -- 172.21.15.82:0/3680442409 --> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] -- osd_op(unknown.0.0:1 10.7 10:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65) v8 -- 0x56309536c470 con 0x5630952d0050 2023-11-28T13:03:31.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.480+0000 7f6955510700 1 --2- 172.21.15.82:0/3680442409 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6938063840 0x7f6938065cf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6948000c00 tx=0x7f6948009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.480+0000 7f6954d0f700 1 --2- 172.21.15.82:0/3680442409 >> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] conn(0x5630952d0050 0x5630952b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.480+0000 7f6954d0f700 1 --2- 172.21.15.82:0/3680442409 >> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] conn(0x5630952d0050 0x5630952b60d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.480+0000 7f6954d0f700 1 -- 172.21.15.82:0/3680442409 <== osd.6 v2:172.21.15.114:6824/36805 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (94) out=94b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+94 (crc 0 0 0) 0x7f6940002a90 con 0x5630952d0050 2023-11-28T13:03:31.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.480+0000 7f69579db140 1 -- 172.21.15.82:0/3680442409 >> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] conn(0x5630952d0050 msgr2=0x5630952b60d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.480+0000 7f69579db140 1 --2- 172.21.15.82:0/3680442409 >> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] conn(0x5630952d0050 0x5630952b60d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.480+0000 7f69579db140 1 -- 172.21.15.82:0/3680442409 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6938063840 msgr2=0x7f6938065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.480+0000 7f69579db140 1 --2- 172.21.15.82:0/3680442409 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f6938063840 0x7f6938065cf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6948000c00 tx=0x7f6948009000 comp rx=0 tx=0).stop 2023-11-28T13:03:31.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.480+0000 7f69579db140 1 -- 172.21.15.82:0/3680442409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630952d4b30 msgr2=0x5630952b4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.480+0000 7f69579db140 1 --2- 172.21.15.82:0/3680442409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630952d4b30 0x5630952b4c30 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f695000a8c0 tx=0x7f6950002fb0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.480+0000 7f6955d11700 1 -- 172.21.15.82:0/3680442409 reap_dead start 2023-11-28T13:03:31.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.480+0000 7f69579db140 1 -- 172.21.15.82:0/3680442409 shutdown_connections 2023-11-28T13:03:31.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.480+0000 7f69579db140 1 -- 172.21.15.82:0/3680442409 >> 172.21.15.82:0/3680442409 conn(0x563095228770 msgr2=0x563095245100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:31.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.480+0000 7f69579db140 1 -- 172.21.15.82:0/3680442409 shutdown_connections 2023-11-28T13:03:31.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.480+0000 7f69579db140 1 -- 172.21.15.82:0/3680442409 wait complete. 2023-11-28T13:03:31.488 INFO:teuthology.orchestra.run.smithi082.stdout:Xfiledir_test 2023-11-28T13:03:31.488 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:31.489 DEBUG:teuthology.orchestra.run.smithi082:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-11-28T13:03:31.591 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:03:31.591 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511627777, 2023-11-28T13:03:31.591 INFO:teuthology.orchestra.run.smithi082.stdout: "ancestors": [ 2023-11-28T13:03:31.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:31.591 INFO:teuthology.orchestra.run.smithi082.stdout: "dirino": 1099511627776, 2023-11-28T13:03:31.591 INFO:teuthology.orchestra.run.smithi082.stdout: "dname": "file", 2023-11-28T13:03:31.591 INFO:teuthology.orchestra.run.smithi082.stdout: "version": 2 2023-11-28T13:03:31.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-11-28T13:03:31.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:03:31.592 INFO:teuthology.orchestra.run.smithi082.stdout: "dirino": 1, 2023-11-28T13:03:31.592 INFO:teuthology.orchestra.run.smithi082.stdout: "dname": "dir_test", 2023-11-28T13:03:31.592 INFO:teuthology.orchestra.run.smithi082.stdout: "version": 4 2023-11-28T13:03:31.592 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:31.592 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2023-11-28T13:03:31.592 INFO:teuthology.orchestra.run.smithi082.stdout: "pool": 10, 2023-11-28T13:03:31.592 INFO:teuthology.orchestra.run.smithi082.stdout: "old_pools": [] 2023-11-28T13:03:31.592 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:03:31.592 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:03:31.594 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'The backtrace is corrupted' 2023-11-28T13:03:31.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.624+0000 7f51a6af1140 1 Processor -- start 2023-11-28T13:03:31.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.624+0000 7f51a6af1140 1 -- start start 2023-11-28T13:03:31.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.624+0000 7f51a6af1140 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55894297af60 0x558942a49890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.624+0000 7f51a6af1140 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589429bf1d0 0x5589429b8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.624+0000 7f51a6af1140 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x558942a4c260 0x558942a4b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.624+0000 7f51a6af1140 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55894289e240 con 0x5589429bf1d0 2023-11-28T13:03:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.624+0000 7f51a6af1140 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558942a48620 con 0x55894297af60 2023-11-28T13:03:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.624+0000 7f51a6af1140 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x558942a4bb00 con 0x558942a4c260 2023-11-28T13:03:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.624+0000 7f51a3e25700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589429bf1d0 0x5589429b8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.624+0000 7f51a3e25700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589429bf1d0 0x5589429b8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58248/0 (socket says 172.21.15.82:58248) 2023-11-28T13:03:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.624+0000 7f51a3e25700 1 -- 172.21.15.82:0/1068131400 learned_addr learned my addr 172.21.15.82:0/1068131400 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.624+0000 7f51a4626700 1 --2- 172.21.15.82:0/1068131400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55894297af60 0x558942a49890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.624+0000 7f51a4e27700 1 --2- 172.21.15.82:0/1068131400 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x558942a4c260 0x558942a4b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.624+0000 7f51a3e25700 1 -- 172.21.15.82:0/1068131400 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x558942a4c260 msgr2=0x558942a4b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.624+0000 7f51a3e25700 1 --2- 172.21.15.82:0/1068131400 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x558942a4c260 0x558942a4b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.624+0000 7f51a3e25700 1 -- 172.21.15.82:0/1068131400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55894297af60 msgr2=0x558942a49890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.624+0000 7f51a3e25700 1 --2- 172.21.15.82:0/1068131400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55894297af60 0x558942a49890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.624+0000 7f51a3e25700 1 -- 172.21.15.82:0/1068131400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519400a1c0 con 0x5589429bf1d0 2023-11-28T13:03:31.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.624+0000 7f51a3e25700 1 --2- 172.21.15.82:0/1068131400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589429bf1d0 0x5589429b8340 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f518c001dd0 tx=0x7f518c00b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95cc667be589790b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.624+0000 7f51a2e23700 1 -- 172.21.15.82:0/1068131400 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c014070 con 0x5589429bf1d0 2023-11-28T13:03:31.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a2e23700 1 -- 172.21.15.82:0/1068131400 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518c008030 con 0x5589429bf1d0 2023-11-28T13:03:31.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a2e23700 1 -- 172.21.15.82:0/1068131400 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c00bda0 con 0x5589429bf1d0 2023-11-28T13:03:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a6af1140 1 -- 172.21.15.82:0/1068131400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589429bf1d0 msgr2=0x5589429b8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a6af1140 1 --2- 172.21.15.82:0/1068131400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589429bf1d0 0x5589429b8340 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f518c001dd0 tx=0x7f518c00b4c0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a6af1140 1 -- 172.21.15.82:0/1068131400 shutdown_connections 2023-11-28T13:03:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a6af1140 1 --2- 172.21.15.82:0/1068131400 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x558942a4c260 0x558942a4b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a6af1140 1 --2- 172.21.15.82:0/1068131400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5589429bf1d0 0x5589429b8340 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a6af1140 1 --2- 172.21.15.82:0/1068131400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55894297af60 0x558942a49890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a6af1140 1 -- 172.21.15.82:0/1068131400 >> 172.21.15.82:0/1068131400 conn(0x5589429a5d60 msgr2=0x558942a48e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a6af1140 1 -- 172.21.15.82:0/1068131400 shutdown_connections 2023-11-28T13:03:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a6af1140 1 -- 172.21.15.82:0/1068131400 wait complete. 2023-11-28T13:03:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a6af1140 1 Processor -- start 2023-11-28T13:03:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a6af1140 1 -- start start 2023-11-28T13:03:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a6af1140 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55894297af60 0x558942978bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a6af1140 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5589429bf1d0 0x55894299a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a6af1140 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558942a4c260 0x558942a47830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a6af1140 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55894299af80 con 0x55894297af60 2023-11-28T13:03:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a6af1140 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589429bd7a0 con 0x558942a4c260 2023-11-28T13:03:31.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a6af1140 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x5589429bd9d0 con 0x5589429bf1d0 2023-11-28T13:03:31.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a4626700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55894297af60 0x558942978bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a3e25700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5589429bf1d0 0x55894299a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a4626700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55894297af60 0x558942978bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58262/0 (socket says 172.21.15.82:58262) 2023-11-28T13:03:31.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a4626700 1 -- 172.21.15.82:0/284372525 learned_addr learned my addr 172.21.15.82:0/284372525 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:31.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a4e27700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558942a4c260 0x558942a47830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a4626700 1 -- 172.21.15.82:0/284372525 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5589429bf1d0 msgr2=0x55894299a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a4626700 1 --2- 172.21.15.82:0/284372525 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x5589429bf1d0 0x55894299a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a4626700 1 -- 172.21.15.82:0/284372525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558942a4c260 msgr2=0x558942a47830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a4626700 1 --2- 172.21.15.82:0/284372525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558942a4c260 0x558942a47830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a4626700 1 -- 172.21.15.82:0/284372525 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518c00a040 con 0x55894297af60 2023-11-28T13:03:31.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a4626700 1 --2- 172.21.15.82:0/284372525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55894297af60 0x558942978bc0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f519c0086e0 tx=0x7f519c0089f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a1e21700 1 -- 172.21.15.82:0/284372525 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c00f040 con 0x55894297af60 2023-11-28T13:03:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a6af1140 1 -- 172.21.15.82:0/284372525 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5589428b6390 con 0x55894297af60 2023-11-28T13:03:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a1e21700 1 -- 172.21.15.82:0/284372525 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c015880 con 0x55894297af60 2023-11-28T13:03:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a1e21700 1 -- 172.21.15.82:0/284372525 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c015bf0 con 0x55894297af60 2023-11-28T13:03:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.628+0000 7f51a6af1140 1 -- 172.21.15.82:0/284372525 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5589428a98b0 con 0x55894297af60 2023-11-28T13:03:31.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.632+0000 7f51a1e21700 1 -- 172.21.15.82:0/284372525 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f519c025070 con 0x55894297af60 2023-11-28T13:03:31.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.632+0000 7f51a1e21700 1 --2- 172.21.15.82:0/284372525 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5184063810 0x7f5184065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.632+0000 7f51a1e21700 1 -- 172.21.15.82:0/284372525 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f519c081700 con 0x55894297af60 2023-11-28T13:03:31.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.632+0000 7f51a3e25700 1 --2- 172.21.15.82:0/284372525 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5184063810 0x7f5184065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.632+0000 7f51a6af1140 1 --2- 172.21.15.82:0/284372525 >> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] conn(0x558942ae5d50 0x558942af0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.632+0000 7f51a6af1140 1 -- 172.21.15.82:0/284372525 --> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] -- osd_op(unknown.0.0:1 10.7 10:e2e07930:::10000000001.00000000:head [setxattr parent (26) in=32b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65) v8 -- 0x558942af07a0 con 0x558942ae5d50 2023-11-28T13:03:31.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.632+0000 7f51a4e27700 1 --2- 172.21.15.82:0/284372525 >> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] conn(0x558942ae5d50 0x558942af0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.636+0000 7f51a3e25700 1 --2- 172.21.15.82:0/284372525 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5184063810 0x7f5184065cc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f518c001350 tx=0x7f518c009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.636+0000 7f51a4e27700 1 --2- 172.21.15.82:0/284372525 >> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] conn(0x558942ae5d50 0x558942af0260 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.636+0000 7f51a4e27700 1 -- 172.21.15.82:0/284372525 <== osd.6 v2:172.21.15.114:6824/36805 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (26)] v65'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5194017040 con 0x558942ae5d50 2023-11-28T13:03:31.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.636+0000 7f51a6af1140 1 -- 172.21.15.82:0/284372525 >> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] conn(0x558942ae5d50 msgr2=0x558942af0260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.636+0000 7f51a6af1140 1 --2- 172.21.15.82:0/284372525 >> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] conn(0x558942ae5d50 0x558942af0260 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.636+0000 7f51a6af1140 1 -- 172.21.15.82:0/284372525 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5184063810 msgr2=0x7f5184065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.636+0000 7f51a6af1140 1 --2- 172.21.15.82:0/284372525 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5184063810 0x7f5184065cc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f518c001350 tx=0x7f518c009000 comp rx=0 tx=0).stop 2023-11-28T13:03:31.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.636+0000 7f51a6af1140 1 -- 172.21.15.82:0/284372525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55894297af60 msgr2=0x558942978bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.636+0000 7f51a6af1140 1 --2- 172.21.15.82:0/284372525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55894297af60 0x558942978bc0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f519c0086e0 tx=0x7f519c0089f0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.636+0000 7f51a4e27700 1 -- 172.21.15.82:0/284372525 reap_dead start 2023-11-28T13:03:31.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.636+0000 7f51a6af1140 1 -- 172.21.15.82:0/284372525 shutdown_connections 2023-11-28T13:03:31.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.636+0000 7f51a6af1140 1 -- 172.21.15.82:0/284372525 >> 172.21.15.82:0/284372525 conn(0x5589429a5d60 msgr2=0x558942a48a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:31.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.636+0000 7f51a6af1140 1 -- 172.21.15.82:0/284372525 shutdown_connections 2023-11-28T13:03:31.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.636+0000 7f51a6af1140 1 -- 172.21.15.82:0/284372525 wait complete. 2023-11-28T13:03:31.645 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start / recursive 2023-11-28T13:03:31.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.764+0000 7f93f92de700 1 Processor -- start 2023-11-28T13:03:31.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.764+0000 7f93f92de700 1 -- start start 2023-11-28T13:03:31.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f92de700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93ec0defd0 0x7f93ec04f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f92de700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f93ec0338c0 0x7f93ec04faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f92de700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f93ec033e10 0x7f93ec036840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f92de700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ec007230 con 0x7f93ec0338c0 2023-11-28T13:03:31.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f92de700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ec052e70 con 0x7f93ec033e10 2023-11-28T13:03:31.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f92de700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec053cd0 con 0x7f93ec0defd0 2023-11-28T13:03:31.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f37fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f93ec0338c0 0x7f93ec04faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f37fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f93ec0338c0 0x7f93ec04faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58276/0 (socket says 172.21.15.82:58276) 2023-11-28T13:03:31.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f37fe700 1 -- 172.21.15.82:0/3221816575 learned_addr learned my addr 172.21.15.82:0/3221816575 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:31.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f8add700 1 --2- 172.21.15.82:0/3221816575 >> v2:172.21.15.114:3300/0 conn(0x7f93ec033e10 0x7f93ec036840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f3fff700 1 --2- 172.21.15.82:0/3221816575 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93ec0defd0 0x7f93ec04f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f37fe700 1 -- 172.21.15.82:0/3221816575 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93ec0defd0 msgr2=0x7f93ec04f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f37fe700 1 --2- 172.21.15.82:0/3221816575 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93ec0defd0 0x7f93ec04f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f37fe700 1 -- 172.21.15.82:0/3221816575 >> v2:172.21.15.114:3300/0 conn(0x7f93ec033e10 msgr2=0x7f93ec036840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f37fe700 1 --2- 172.21.15.82:0/3221816575 >> v2:172.21.15.114:3300/0 conn(0x7f93ec033e10 0x7f93ec036840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f37fe700 1 -- 172.21.15.82:0/3221816575 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ec0530c0 con 0x7f93ec0338c0 2023-11-28T13:03:31.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f3fff700 1 --2- 172.21.15.82:0/3221816575 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93ec0defd0 0x7f93ec04f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:31.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f37fe700 1 --2- 172.21.15.82:0/3221816575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93ec0338c0 0x7f93ec04faf0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f93ec007d10 tx=0x7f93e400be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37145b9d56c4cfd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f2ffd700 1 -- 172.21.15.82:0/3221816575 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e400dd30 con 0x7f93ec0338c0 2023-11-28T13:03:31.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f2ffd700 1 -- 172.21.15.82:0/3221816575 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e400de90 con 0x7f93ec0338c0 2023-11-28T13:03:31.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f2ffd700 1 -- 172.21.15.82:0/3221816575 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e4010690 con 0x7f93ec0338c0 2023-11-28T13:03:31.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f92de700 1 -- 172.21.15.82:0/3221816575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93ec0338c0 msgr2=0x7f93ec04faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f92de700 1 --2- 172.21.15.82:0/3221816575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93ec0338c0 0x7f93ec04faf0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f93ec007d10 tx=0x7f93e400be90 comp rx=0 tx=0).stop 2023-11-28T13:03:31.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f92de700 1 -- 172.21.15.82:0/3221816575 shutdown_connections 2023-11-28T13:03:31.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f92de700 1 --2- 172.21.15.82:0/3221816575 >> v2:172.21.15.114:3300/0 conn(0x7f93ec033e10 0x7f93ec036840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f92de700 1 --2- 172.21.15.82:0/3221816575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93ec0338c0 0x7f93ec04faf0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f92de700 1 --2- 172.21.15.82:0/3221816575 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93ec0defd0 0x7f93ec04f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f92de700 1 -- 172.21.15.82:0/3221816575 >> 172.21.15.82:0/3221816575 conn(0x7f93ec0517d0 msgr2=0x7f93ec051ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:31.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f92de700 1 -- 172.21.15.82:0/3221816575 shutdown_connections 2023-11-28T13:03:31.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.768+0000 7f93f92de700 1 -- 172.21.15.82:0/3221816575 wait complete. 2023-11-28T13:03:31.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f92de700 1 Processor -- start 2023-11-28T13:03:31.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f92de700 1 -- start start 2023-11-28T13:03:31.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f92de700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93ec0338c0 0x7f93ec04b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f92de700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93ec033e10 0x7f93ec0d52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f92de700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93ec0d5820 0x7f93ec0d5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f92de700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec0df770 con 0x7f93ec033e10 2023-11-28T13:03:31.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f92de700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec038930 con 0x7f93ec0338c0 2023-11-28T13:03:31.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f92de700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec038c10 con 0x7f93ec0d5820 2023-11-28T13:03:31.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93ec0338c0 0x7f93ec04b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93ec033e10 0x7f93ec0d52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93ec0338c0 0x7f93ec04b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:39424/0 (socket says 172.21.15.82:39424) 2023-11-28T13:03:31.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f3fff700 1 -- 172.21.15.82:0/4116589112 learned_addr learned my addr 172.21.15.82:0/4116589112 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:31.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93ec033e10 0x7f93ec0d52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58286/0 (socket says 172.21.15.82:58286) 2023-11-28T13:03:31.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f8add700 1 --2- 172.21.15.82:0/4116589112 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93ec0d5820 0x7f93ec0d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f37fe700 1 -- 172.21.15.82:0/4116589112 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93ec0d5820 msgr2=0x7f93ec0d5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f37fe700 1 --2- 172.21.15.82:0/4116589112 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93ec0d5820 0x7f93ec0d5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f37fe700 1 -- 172.21.15.82:0/4116589112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93ec0338c0 msgr2=0x7f93ec04b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f37fe700 1 --2- 172.21.15.82:0/4116589112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93ec0338c0 0x7f93ec04b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f37fe700 1 -- 172.21.15.82:0/4116589112 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e400b810 con 0x7f93ec033e10 2023-11-28T13:03:31.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f3fff700 1 --2- 172.21.15.82:0/4116589112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93ec0338c0 0x7f93ec04b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:03:31.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f37fe700 1 --2- 172.21.15.82:0/4116589112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93ec033e10 0x7f93ec0d52e0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f93e4018000 tx=0x7f93e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f0ff9700 1 -- 172.21.15.82:0/4116589112 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e401f070 con 0x7f93ec033e10 2023-11-28T13:03:31.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f0ff9700 1 -- 172.21.15.82:0/4116589112 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e40038d0 con 0x7f93ec033e10 2023-11-28T13:03:31.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f92de700 1 -- 172.21.15.82:0/4116589112 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ec053680 con 0x7f93ec033e10 2023-11-28T13:03:31.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f0ff9700 1 -- 172.21.15.82:0/4116589112 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e4003c60 con 0x7f93ec033e10 2023-11-28T13:03:31.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.772+0000 7f93f92de700 1 -- 172.21.15.82:0/4116589112 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ec0533a0 con 0x7f93ec033e10 2023-11-28T13:03:31.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.776+0000 7f93f0ff9700 1 -- 172.21.15.82:0/4116589112 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f93e4019400 con 0x7f93ec033e10 2023-11-28T13:03:31.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.776+0000 7f93f0ff9700 1 --2- 172.21.15.82:0/4116589112 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93e0064f10 0x7f93e00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.780+0000 7f93f0ff9700 1 -- 172.21.15.82:0/4116589112 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f93e4085110 con 0x7f93ec033e10 2023-11-28T13:03:31.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.780+0000 7f93f3fff700 1 --2- 172.21.15.82:0/4116589112 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93e0064f10 0x7f93e00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.780+0000 7f93f3fff700 1 --2- 172.21.15.82:0/4116589112 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93e0064f10 0x7f93e00673c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009ee0 tx=0x7f93e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.780+0000 7f93fd7c0740 1 Processor -- start 2023-11-28T13:03:31.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.780+0000 7f93fd7c0740 1 -- start start 2023-11-28T13:03:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.780+0000 7f93fd7c0740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xe72d10 0x1108700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.780+0000 7f93fd7c0740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xe72940 0x1123030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.780+0000 7f93fd7c0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xebd9c0 0x1123570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.780+0000 7f93fd7c0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0xfe1c00 con 0xebd9c0 2023-11-28T13:03:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.780+0000 7f93fd7c0740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1051cf0 con 0xe72d10 2023-11-28T13:03:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.780+0000 7f93fd7c0740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x104aff0 con 0xe72940 2023-11-28T13:03:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.780+0000 7f93f8add700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xebd9c0 0x1123570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.780+0000 7f93f8add700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xebd9c0 0x1123570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58294/0 (socket says 172.21.15.82:58294) 2023-11-28T13:03:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.780+0000 7f93f8add700 1 -- 172.21.15.82:0/4008940723 learned_addr learned my addr 172.21.15.82:0/4008940723 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.780+0000 7f93f3fff700 1 --2- 172.21.15.82:0/4008940723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xe72d10 0x1108700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.780+0000 7f93f37fe700 1 --2- 172.21.15.82:0/4008940723 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xe72940 0x1123030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93f8add700 1 -- 172.21.15.82:0/4008940723 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xe72940 msgr2=0x1123030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93f8add700 1 --2- 172.21.15.82:0/4008940723 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xe72940 0x1123030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93f8add700 1 -- 172.21.15.82:0/4008940723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xe72d10 msgr2=0x1108700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93f8add700 1 --2- 172.21.15.82:0/4008940723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xe72d10 0x1108700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93f8add700 1 -- 172.21.15.82:0/4008940723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1070ec0 con 0xebd9c0 2023-11-28T13:03:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93f8add700 1 --2- 172.21.15.82:0/4008940723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xebd9c0 0x1123570 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f93f4069740 tx=0x7f93f4066910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a289c2b97ba5b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93d9ffb700 1 -- 172.21.15.82:0/4008940723 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4097070 con 0xebd9c0 2023-11-28T13:03:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93d9ffb700 1 -- 172.21.15.82:0/4008940723 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f408f040 con 0xebd9c0 2023-11-28T13:03:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93d9ffb700 1 -- 172.21.15.82:0/4008940723 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f408e050 con 0xebd9c0 2023-11-28T13:03:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93fd7c0740 1 -- 172.21.15.82:0/4008940723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xebd9c0 msgr2=0x1123570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93fd7c0740 1 --2- 172.21.15.82:0/4008940723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xebd9c0 0x1123570 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f93f4069740 tx=0x7f93f4066910 comp rx=0 tx=0).stop 2023-11-28T13:03:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93fd7c0740 1 -- 172.21.15.82:0/4008940723 shutdown_connections 2023-11-28T13:03:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93fd7c0740 1 --2- 172.21.15.82:0/4008940723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xebd9c0 0x1123570 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93fd7c0740 1 --2- 172.21.15.82:0/4008940723 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xe72940 0x1123030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93fd7c0740 1 --2- 172.21.15.82:0/4008940723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xe72d10 0x1108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93fd7c0740 1 -- 172.21.15.82:0/4008940723 >> 172.21.15.82:0/4008940723 conn(0xe730e0 msgr2=0x110b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93fd7c0740 1 -- 172.21.15.82:0/4008940723 shutdown_connections 2023-11-28T13:03:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93fd7c0740 1 -- 172.21.15.82:0/4008940723 wait complete. 2023-11-28T13:03:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93fd7c0740 1 -- start start 2023-11-28T13:03:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93fd7c0740 1 Processor -- start 2023-11-28T13:03:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93fd7c0740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xe72940 0x1136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93fd7c0740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xe72d10 0x11117a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93fd7c0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xebd9c0 0x1133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93fd7c0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0xef7d50 con 0xebd9c0 2023-11-28T13:03:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93fd7c0740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1107500 con 0xe72940 2023-11-28T13:03:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93fd7c0740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x10e4b00 con 0xe72d10 2023-11-28T13:03:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93fd7c0740 10 client.0 _ll_register_callbacks cb 0x10a78f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:03:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93f8add700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xebd9c0 0x1133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93f3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xe72940 0x1136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93f8add700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xebd9c0 0x1133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58304/0 (socket says 172.21.15.82:58304) 2023-11-28T13:03:31.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93f37fe700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xe72d10 0x11117a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93f8add700 1 -- 172.21.15.82:0/2998721446 learned_addr learned my addr 172.21.15.82:0/2998721446 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:31.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.784+0000 7f93f8add700 1 -- 172.21.15.82:0/2998721446 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xe72d10 msgr2=0x11117a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93f8add700 1 --2- 172.21.15.82:0/2998721446 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xe72d10 0x11117a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93f8add700 1 -- 172.21.15.82:0/2998721446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xe72940 msgr2=0x1136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93f8add700 1 --2- 172.21.15.82:0/2998721446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xe72940 0x1136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93f8add700 1 -- 172.21.15.82:0/2998721446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f4065fc0 con 0xebd9c0 2023-11-28T13:03:31.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93f3fff700 1 --2- 172.21.15.82:0/2998721446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xe72940 0x1136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:03:31.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93f8add700 1 --2- 172.21.15.82:0/2998721446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xebd9c0 0x1133dd0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f93f4069740 tx=0x7f93f4067f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fcd541783635baf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-11-28T13:03:31.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93d2ffd700 1 -- 172.21.15.82:0/2998721446 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f40a2070 con 0xebd9c0 2023-11-28T13:03:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93fd7c0740 1 -- 172.21.15.82:0/2998721446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1078e30 con 0xebd9c0 2023-11-28T13:03:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93d2ffd700 1 -- 172.21.15.82:0/2998721446 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f93f4066440 con 0xebd9c0 2023-11-28T13:03:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93d2ffd700 1 -- 172.21.15.82:0/2998721446 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93f4097040 con 0xebd9c0 2023-11-28T13:03:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93fd7c0740 10 client.6513 fetch_fsmap learned FSMap version 30 2023-11-28T13:03:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93fd7c0740 1 -- 172.21.15.82:0/2998721446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0xebec10 con 0xebd9c0 2023-11-28T13:03:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93d2ffd700 1 -- 172.21.15.82:0/2998721446 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1078e30 con 0xebd9c0 2023-11-28T13:03:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93d2ffd700 1 -- 172.21.15.82:0/2998721446 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f93f40a5020 con 0xebd9c0 2023-11-28T13:03:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93fd7c0740 10 client.6513 fetch_fsmap finished waiting for FSMap version 30 2023-11-28T13:03:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93fd7c0740 10 client.6513 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-28T13:03:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93fd7c0740 20 client.6513 populate_metadata read hostname 'smithi082' 2023-11-28T13:03:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93fd7c0740 1 --2- 172.21.15.82:0/2998721446 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x10e3600 0x10e3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93fd7c0740 4 client.6513 mds_command: new command op to 6309 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T13:03:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93fd7c0740 1 -- 172.21.15.82:0/2998721446 --> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1044070 con 0x10e3600 2023-11-28T13:03:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93f3fff700 1 --2- 172.21.15.82:0/2998721446 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x10e3600 0x10e3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93d2ffd700 10 client.6513 ms_handle_connect on v2:172.21.15.82:6836/2902091405 2023-11-28T13:03:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93f3fff700 1 --2- 172.21.15.82:0/2998721446 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x10e3600 0x10e3a00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77ebfd196cbcf920 server_cookie=42fcb03fab3cbc2a in_seq=0 out_seq=0 2023-11-28T13:03:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93d2ffd700 1 -- 172.21.15.82:0/2998721446 <== mds.0 v2:172.21.15.82:6836/2902091405 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1044070 con 0x10e3600 2023-11-28T13:03:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93d2ffd700 10 client.6513 handle_command_reply: tid=0 2023-11-28T13:03:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93fd7c0740 1 client.6513 shutdown 2023-11-28T13:03:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93fd7c0740 1 -- 172.21.15.82:0/2998721446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xebd9c0 msgr2=0x1133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93fd7c0740 1 --2- 172.21.15.82:0/2998721446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xebd9c0 0x1133dd0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f93f4069740 tx=0x7f93f4067f60 comp rx=0 tx=0).stop 2023-11-28T13:03:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93fd7c0740 1 -- 172.21.15.82:0/2998721446 shutdown_connections 2023-11-28T13:03:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93fd7c0740 1 --2- 172.21.15.82:0/2998721446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xebd9c0 0x1133dd0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93fd7c0740 1 --2- 172.21.15.82:0/2998721446 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x10e3600 0x10e3a00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93fd7c0740 1 --2- 172.21.15.82:0/2998721446 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xe72d10 0x11117a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93fd7c0740 1 --2- 172.21.15.82:0/2998721446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xe72940 0x1136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93fd7c0740 1 -- 172.21.15.82:0/2998721446 >> 172.21.15.82:0/2998721446 conn(0xe730e0 msgr2=0x10de540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:31.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93d2ffd700 0 client.6513 ms_handle_reset on v2:172.21.15.82:6836/2902091405 2023-11-28T13:03:31.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93fd7c0740 1 -- 172.21.15.82:0/2998721446 shutdown_connections 2023-11-28T13:03:31.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.788+0000 7f93fd7c0740 1 -- 172.21.15.82:0/2998721446 wait complete. 2023-11-28T13:03:31.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.792+0000 7f93fd7c0740 20 client.6513 trim_cache size 0 max 16384 2023-11-28T13:03:31.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93fd7c0740 1 Processor -- start 2023-11-28T13:03:31.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93fd7c0740 1 -- start start 2023-11-28T13:03:31.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93fd7c0740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xe72940 0x11332c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93fd7c0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xe72d10 0x110b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93fd7c0740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xebd9c0 0x110b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93fd7c0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x10483f0 con 0xe72d10 2023-11-28T13:03:31.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93fd7c0740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1052f80 con 0xebd9c0 2023-11-28T13:03:31.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93fd7c0740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x1048800 con 0xe72940 2023-11-28T13:03:31.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93f37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xe72d10 0x110b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93f37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xe72d10 0x110b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58308/0 (socket says 172.21.15.82:58308) 2023-11-28T13:03:31.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93f37fe700 1 -- 172.21.15.82:0/1770975481 learned_addr learned my addr 172.21.15.82:0/1770975481 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:31.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93f8add700 1 --2- 172.21.15.82:0/1770975481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xebd9c0 0x110b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93f3fff700 1 --2- 172.21.15.82:0/1770975481 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xe72940 0x11332c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93f37fe700 1 -- 172.21.15.82:0/1770975481 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xe72940 msgr2=0x11332c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93f37fe700 1 --2- 172.21.15.82:0/1770975481 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xe72940 0x11332c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93f37fe700 1 -- 172.21.15.82:0/1770975481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xebd9c0 msgr2=0x110b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93f37fe700 1 --2- 172.21.15.82:0/1770975481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xebd9c0 0x110b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93f37fe700 1 -- 172.21.15.82:0/1770975481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ec0df330 con 0xe72d10 2023-11-28T13:03:31.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93f37fe700 1 --2- 172.21.15.82:0/1770975481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xe72d10 0x110b370 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f93e405ead0 tx=0x7f93e4085040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e41eddd9bc7cd46 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93da7fc700 1 -- 172.21.15.82:0/1770975481 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e4055110 con 0xe72d10 2023-11-28T13:03:31.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93da7fc700 1 -- 172.21.15.82:0/1770975481 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e406e080 con 0xe72d10 2023-11-28T13:03:31.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93da7fc700 1 -- 172.21.15.82:0/1770975481 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e4056400 con 0xe72d10 2023-11-28T13:03:31.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93fd7c0740 1 -- 172.21.15.82:0/1770975481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xe72d10 msgr2=0x110b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93fd7c0740 1 --2- 172.21.15.82:0/1770975481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xe72d10 0x110b370 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f93e405ead0 tx=0x7f93e4085040 comp rx=0 tx=0).stop 2023-11-28T13:03:31.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93fd7c0740 1 -- 172.21.15.82:0/1770975481 shutdown_connections 2023-11-28T13:03:31.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93fd7c0740 1 --2- 172.21.15.82:0/1770975481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xebd9c0 0x110b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93fd7c0740 1 --2- 172.21.15.82:0/1770975481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xe72d10 0x110b370 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93fd7c0740 1 --2- 172.21.15.82:0/1770975481 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xe72940 0x11332c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93fd7c0740 1 -- 172.21.15.82:0/1770975481 >> 172.21.15.82:0/1770975481 conn(0xe730e0 msgr2=0x10e3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:31.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93fd7c0740 1 -- 172.21.15.82:0/1770975481 shutdown_connections 2023-11-28T13:03:31.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.812+0000 7f93fd7c0740 1 -- 172.21.15.82:0/1770975481 wait complete. 2023-11-28T13:03:31.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.816+0000 7f93fd7c0740 1 -- start start 2023-11-28T13:03:31.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.816+0000 7f93fd7c0740 1 Processor -- start 2023-11-28T13:03:31.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.816+0000 7f93fd7c0740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xe72940 0x10e0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.816+0000 7f93fd7c0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xe72d10 0x1189050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.816+0000 7f93fd7c0740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xebd9c0 0x1189590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.816+0000 7f93fd7c0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1046960 con 0xe72d10 2023-11-28T13:03:31.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.816+0000 7f93fd7c0740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1141500 con 0xebd9c0 2023-11-28T13:03:31.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.816+0000 7f93fd7c0740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x113df00 con 0xe72940 2023-11-28T13:03:31.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.816+0000 7f93fd7c0740 10 client.0 _ll_register_callbacks cb 0x1015a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:03:31.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.816+0000 7f93f37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xe72d10 0x1189050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.816+0000 7f93f37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xe72d10 0x1189050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58312/0 (socket says 172.21.15.82:58312) 2023-11-28T13:03:31.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.816+0000 7f93f37fe700 1 -- 172.21.15.82:0/1403794996 learned_addr learned my addr 172.21.15.82:0/1403794996 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:31.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.816+0000 7f93f8add700 1 --2- 172.21.15.82:0/1403794996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xebd9c0 0x1189590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.816+0000 7f93f3fff700 1 --2- 172.21.15.82:0/1403794996 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xe72940 0x10e0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93f37fe700 1 -- 172.21.15.82:0/1403794996 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xe72940 msgr2=0x10e0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93f37fe700 1 --2- 172.21.15.82:0/1403794996 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xe72940 0x10e0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93f37fe700 1 -- 172.21.15.82:0/1403794996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xebd9c0 msgr2=0x1189590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93f37fe700 1 --2- 172.21.15.82:0/1403794996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xebd9c0 0x1189590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93f37fe700 1 -- 172.21.15.82:0/1403794996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ec0533a0 con 0xe72d10 2023-11-28T13:03:31.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93f37fe700 1 --2- 172.21.15.82:0/1403794996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xe72d10 0x1189050 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f93e4053410 tx=0x7f93e400d5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b693501028a9c1f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-11-28T13:03:31.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93d2ffd700 1 -- 172.21.15.82:0/1403794996 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e405ed70 con 0xe72d10 2023-11-28T13:03:31.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93d2ffd700 1 -- 172.21.15.82:0/1403794996 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f93e4063c00 con 0xe72d10 2023-11-28T13:03:31.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93fd7c0740 1 -- 172.21.15.82:0/1403794996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f93f408f040 con 0xe72d10 2023-11-28T13:03:31.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93d2ffd700 1 -- 172.21.15.82:0/1403794996 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93e4055110 con 0xe72d10 2023-11-28T13:03:31.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93fd7c0740 10 client.6519 fetch_fsmap learned FSMap version 30 2023-11-28T13:03:31.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93fd7c0740 1 -- 172.21.15.82:0/1403794996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0xff7b70 con 0xe72d10 2023-11-28T13:03:31.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93d2ffd700 1 -- 172.21.15.82:0/1403794996 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f408f040 con 0xe72d10 2023-11-28T13:03:31.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93d2ffd700 1 -- 172.21.15.82:0/1403794996 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f93e40831f0 con 0xe72d10 2023-11-28T13:03:31.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93fd7c0740 10 client.6519 fetch_fsmap finished waiting for FSMap version 30 2023-11-28T13:03:31.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93fd7c0740 10 client.6519 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-28T13:03:31.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93fd7c0740 20 client.6519 populate_metadata read hostname 'smithi082' 2023-11-28T13:03:31.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93fd7c0740 1 --2- 172.21.15.82:0/1403794996 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x10e1ee0 0x1134a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93fd7c0740 4 client.6519 mds_command: new command op to 6309 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2023-11-28T13:03:31.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93fd7c0740 1 -- 172.21.15.82:0/1403794996 --> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) v1 -- 0x1043d90 con 0x10e1ee0 2023-11-28T13:03:31.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93f3fff700 1 --2- 172.21.15.82:0/1403794996 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x10e1ee0 0x1134a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93f3fff700 1 --2- 172.21.15.82:0/1403794996 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x10e1ee0 0x1134a50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbf6a119c9be51a2 server_cookie=100d8d6f934b42d9 in_seq=0 out_seq=0 2023-11-28T13:03:31.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93d2ffd700 10 client.6519 ms_handle_connect on v2:172.21.15.82:6836/2902091405 2023-11-28T13:03:31.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93d2ffd700 1 -- 172.21.15.82:0/1403794996 <== mds.0 v2:172.21.15.82:6836/2902091405 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x1043d90 con 0x10e1ee0 2023-11-28T13:03:31.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93d2ffd700 10 client.6519 handle_command_reply: tid=0 2023-11-28T13:03:31.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.820+0000 7f93fd7c0740 1 client.6519 shutdown 2023-11-28T13:03:31.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93fd7c0740 1 -- 172.21.15.82:0/1403794996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xe72d10 msgr2=0x1189050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93fd7c0740 1 --2- 172.21.15.82:0/1403794996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xe72d10 0x1189050 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f93e4053410 tx=0x7f93e400d5d0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93fd7c0740 1 -- 172.21.15.82:0/1403794996 shutdown_connections 2023-11-28T13:03:31.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93fd7c0740 1 --2- 172.21.15.82:0/1403794996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0xebd9c0 0x1189590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93fd7c0740 1 --2- 172.21.15.82:0/1403794996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0xe72d10 0x1189050 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93fd7c0740 1 --2- 172.21.15.82:0/1403794996 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x10e1ee0 0x1134a50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93fd7c0740 1 --2- 172.21.15.82:0/1403794996 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0xe72940 0x10e0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93fd7c0740 1 -- 172.21.15.82:0/1403794996 >> 172.21.15.82:0/1403794996 conn(0xe730e0 msgr2=0x10e3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:31.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93d2ffd700 0 client.6519 ms_handle_reset on v2:172.21.15.82:6836/2902091405 2023-11-28T13:03:31.830 INFO:tasks.ceph.mds.a.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f0c6d0b0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6474=0-4194304@1} caps={6474=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6474 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x5622c041d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-28T13:03:31.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93fd7c0740 1 -- 172.21.15.82:0/1403794996 shutdown_connections 2023-11-28T13:03:31.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93fd7c0740 1 -- 172.21.15.82:0/1403794996 wait complete. 2023-11-28T13:03:31.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93fd7c0740 20 client.6519 trim_cache size 0 max 16384 2023-11-28T13:03:31.831 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:03:31.831 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2023-11-28T13:03:31.831 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "acf96507-60de-4527-806e-dffd2a5ef253", 2023-11-28T13:03:31.831 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2023-11-28T13:03:31.832 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:03:31.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93f92de700 1 -- 172.21.15.82:0/4116589112 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93e0064f10 msgr2=0x7f93e00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93f92de700 1 --2- 172.21.15.82:0/4116589112 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93e0064f10 0x7f93e00673c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009ee0 tx=0x7f93e8008040 comp rx=0 tx=0).stop 2023-11-28T13:03:31.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93f92de700 1 -- 172.21.15.82:0/4116589112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93ec033e10 msgr2=0x7f93ec0d52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93f92de700 1 --2- 172.21.15.82:0/4116589112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93ec033e10 0x7f93ec0d52e0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f93e4018000 tx=0x7f93e4004770 comp rx=0 tx=0).stop 2023-11-28T13:03:31.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93f92de700 1 -- 172.21.15.82:0/4116589112 shutdown_connections 2023-11-28T13:03:31.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93f92de700 1 --2- 172.21.15.82:0/4116589112 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93e0064f10 0x7f93e00673c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93f92de700 1 --2- 172.21.15.82:0/4116589112 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93ec0d5820 0x7f93ec0d5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93f92de700 1 --2- 172.21.15.82:0/4116589112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93ec033e10 0x7f93ec0d52e0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93f92de700 1 --2- 172.21.15.82:0/4116589112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93ec0338c0 0x7f93ec04b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93f92de700 1 -- 172.21.15.82:0/4116589112 >> 172.21.15.82:0/4116589112 conn(0x7f93ec0517d0 msgr2=0x7f93ec04f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:31.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93f92de700 1 -- 172.21.15.82:0/4116589112 shutdown_connections 2023-11-28T13:03:31.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.824+0000 7f93f92de700 1 -- 172.21.15.82:0/4116589112 wait complete. 2023-11-28T13:03:31.843 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-11-28T13:03:31.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e23285700 1 Processor -- start 2023-11-28T13:03:31.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e23285700 1 -- start start 2023-11-28T13:03:31.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e23285700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7e1c070670 0x7f7e1c0c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e23285700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7e1c0ca0e0 0x7f7e1c0cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e23285700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e1c15ce30 0x7f7e1c0ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e23285700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1c0ca5a0 con 0x7f7e1c070670 2023-11-28T13:03:31.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e23285700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1c0ca880 con 0x7f7e1c0ca0e0 2023-11-28T13:03:31.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e23285700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c0cab60 con 0x7f7e1c15ce30 2023-11-28T13:03:31.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e21021700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7e1c070670 0x7f7e1c0c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e21021700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7e1c070670 0x7f7e1c0c9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58328/0 (socket says 172.21.15.82:58328) 2023-11-28T13:03:31.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e21021700 1 -- 172.21.15.82:0/1106402783 learned_addr learned my addr 172.21.15.82:0/1106402783 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:31.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e20820700 1 --2- 172.21.15.82:0/1106402783 >> v2:172.21.15.114:3300/0 conn(0x7f7e1c0ca0e0 0x7f7e1c0cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e21822700 1 --2- 172.21.15.82:0/1106402783 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e1c15ce30 0x7f7e1c0ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e21021700 1 -- 172.21.15.82:0/1106402783 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e1c15ce30 msgr2=0x7f7e1c0ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e21021700 1 --2- 172.21.15.82:0/1106402783 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e1c15ce30 0x7f7e1c0ccd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e21021700 1 -- 172.21.15.82:0/1106402783 >> v2:172.21.15.114:3300/0 conn(0x7f7e1c0ca0e0 msgr2=0x7f7e1c0cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e21021700 1 --2- 172.21.15.82:0/1106402783 >> v2:172.21.15.114:3300/0 conn(0x7f7e1c0ca0e0 0x7f7e1c0cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e21021700 1 -- 172.21.15.82:0/1106402783 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c0cae40 con 0x7f7e1c070670 2023-11-28T13:03:31.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e20820700 1 --2- 172.21.15.82:0/1106402783 >> v2:172.21.15.114:3300/0 conn(0x7f7e1c0ca0e0 0x7f7e1c0cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:31.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e21021700 1 --2- 172.21.15.82:0/1106402783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e1c070670 0x7f7e1c0c9ba0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0717c0 tx=0x7f7e18009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6daaa44d8568dfa3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e13fff700 1 -- 172.21.15.82:0/1106402783 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1800b8a0 con 0x7f7e1c070670 2023-11-28T13:03:31.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e13fff700 1 -- 172.21.15.82:0/1106402783 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1800ba00 con 0x7f7e1c070670 2023-11-28T13:03:31.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.964+0000 7f7e13fff700 1 -- 172.21.15.82:0/1106402783 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1800bd90 con 0x7f7e1c070670 2023-11-28T13:03:31.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.968+0000 7f7e23285700 1 -- 172.21.15.82:0/1106402783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e1c070670 msgr2=0x7f7e1c0c9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.968+0000 7f7e23285700 1 --2- 172.21.15.82:0/1106402783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e1c070670 0x7f7e1c0c9ba0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0717c0 tx=0x7f7e18009bf0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.968+0000 7f7e23285700 1 -- 172.21.15.82:0/1106402783 shutdown_connections 2023-11-28T13:03:31.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.968+0000 7f7e23285700 1 --2- 172.21.15.82:0/1106402783 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e1c15ce30 0x7f7e1c0ccd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.968+0000 7f7e23285700 1 --2- 172.21.15.82:0/1106402783 >> v2:172.21.15.114:3300/0 conn(0x7f7e1c0ca0e0 0x7f7e1c0cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.968+0000 7f7e23285700 1 --2- 172.21.15.82:0/1106402783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e1c070670 0x7f7e1c0c9ba0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.968+0000 7f7e23285700 1 -- 172.21.15.82:0/1106402783 >> 172.21.15.82:0/1106402783 conn(0x7f7e1c0ce9d0 msgr2=0x7f7e1c0ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:31.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.968+0000 7f7e23285700 1 -- 172.21.15.82:0/1106402783 shutdown_connections 2023-11-28T13:03:31.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.968+0000 7f7e23285700 1 -- 172.21.15.82:0/1106402783 wait complete. 2023-11-28T13:03:31.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.968+0000 7f7e23285700 1 Processor -- start 2023-11-28T13:03:31.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.968+0000 7f7e23285700 1 -- start start 2023-11-28T13:03:31.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e23285700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e1c070670 0x7f7e1c15b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e23285700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e1c0ca0e0 0x7f7e1c154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e23285700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e1c15ce30 0x7f7e1c155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e23285700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c15b8f0 con 0x7f7e1c15ce30 2023-11-28T13:03:31.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e23285700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c1f2e70 con 0x7f7e1c070670 2023-11-28T13:03:31.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e23285700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c06d4a0 con 0x7f7e1c0ca0e0 2023-11-28T13:03:31.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e21822700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e1c15ce30 0x7f7e1c155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e21021700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e1c070670 0x7f7e1c15b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e21822700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e1c15ce30 0x7f7e1c155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58340/0 (socket says 172.21.15.82:58340) 2023-11-28T13:03:31.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e21822700 1 -- 172.21.15.82:0/1750168660 learned_addr learned my addr 172.21.15.82:0/1750168660 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e20820700 1 --2- 172.21.15.82:0/1750168660 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e1c0ca0e0 0x7f7e1c154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e21822700 1 -- 172.21.15.82:0/1750168660 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e1c0ca0e0 msgr2=0x7f7e1c154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e21822700 1 --2- 172.21.15.82:0/1750168660 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e1c0ca0e0 0x7f7e1c154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e21822700 1 -- 172.21.15.82:0/1750168660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e1c070670 msgr2=0x7f7e1c15b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e21822700 1 --2- 172.21.15.82:0/1750168660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e1c070670 0x7f7e1c15b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e21822700 1 -- 172.21.15.82:0/1750168660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e18009570 con 0x7f7e1c15ce30 2023-11-28T13:03:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e21822700 1 --2- 172.21.15.82:0/1750168660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e1c15ce30 0x7f7e1c155810 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f7e14007e60 tx=0x7f7e1400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e11ffb700 1 -- 172.21.15.82:0/1750168660 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1400ed30 con 0x7f7e1c15ce30 2023-11-28T13:03:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e11ffb700 1 -- 172.21.15.82:0/1750168660 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e14014420 con 0x7f7e1c15ce30 2023-11-28T13:03:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e11ffb700 1 -- 172.21.15.82:0/1750168660 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e140147d0 con 0x7f7e1c15ce30 2023-11-28T13:03:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e23285700 1 -- 172.21.15.82:0/1750168660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1c070a40 con 0x7f7e1c15ce30 2023-11-28T13:03:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.972+0000 7f7e23285700 1 -- 172.21.15.82:0/1750168660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1c0cb120 con 0x7f7e1c15ce30 2023-11-28T13:03:31.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.976+0000 7f7e11ffb700 1 -- 172.21.15.82:0/1750168660 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7e14012050 con 0x7f7e1c15ce30 2023-11-28T13:03:31.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.976+0000 7f7e11ffb700 1 --2- 172.21.15.82:0/1750168660 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7e00064ee0 0x7f7e00067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.976+0000 7f7e11ffb700 1 -- 172.21.15.82:0/1750168660 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e14082410 con 0x7f7e1c15ce30 2023-11-28T13:03:31.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.976+0000 7f7e21021700 1 --2- 172.21.15.82:0/1750168660 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7e00064ee0 0x7f7e00067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7e21021700 1 --2- 172.21.15.82:0/1750168660 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7e00064ee0 0x7f7e00067390 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7e18000c00 tx=0x7f7e18008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7e26505740 1 Processor -- start 2023-11-28T13:03:31.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7e26505740 1 -- start start 2023-11-28T13:03:31.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7e26505740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e5c10 0x1b9cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7e26505740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x18e5840 0x1b9d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7e26505740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x19308c0 0x1b992c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7e26505740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a54d20 con 0x18e5840 2023-11-28T13:03:31.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7e26505740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ac4d60 con 0x18e5c10 2023-11-28T13:03:31.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7e26505740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x1abe060 con 0x19308c0 2023-11-28T13:03:31.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7e20820700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x18e5840 0x1b9d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7e20820700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x18e5840 0x1b9d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58352/0 (socket says 172.21.15.82:58352) 2023-11-28T13:03:31.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7e20820700 1 -- 172.21.15.82:0/4174683324 learned_addr learned my addr 172.21.15.82:0/4174683324 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:31.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7e21021700 1 --2- 172.21.15.82:0/4174683324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e5c10 0x1b9cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7e21822700 1 --2- 172.21.15.82:0/4174683324 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x19308c0 0x1b992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7e20820700 1 -- 172.21.15.82:0/4174683324 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x19308c0 msgr2=0x1b992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7e20820700 1 --2- 172.21.15.82:0/4174683324 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x19308c0 0x1b992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7e20820700 1 -- 172.21.15.82:0/4174683324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e5c10 msgr2=0x1b9cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7e20820700 1 --2- 172.21.15.82:0/4174683324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e5c10 0x1b9cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7e20820700 1 -- 172.21.15.82:0/4174683324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1ae40a0 con 0x18e5840 2023-11-28T13:03:31.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7e20820700 1 --2- 172.21.15.82:0/4174683324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x18e5840 0x1b9d0a0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c004470 tx=0x7f7e0c0039a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e05c0acff49f8e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7dfeffd700 1 -- 172.21.15.82:0/4174683324 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0097b0 con 0x18e5840 2023-11-28T13:03:31.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7dfeffd700 1 -- 172.21.15.82:0/4174683324 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c009910 con 0x18e5840 2023-11-28T13:03:31.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.980+0000 7f7dfeffd700 1 -- 172.21.15.82:0/4174683324 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c009c80 con 0x18e5840 2023-11-28T13:03:31.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e26505740 1 -- 172.21.15.82:0/4174683324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x18e5840 msgr2=0x1b9d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e26505740 1 --2- 172.21.15.82:0/4174683324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x18e5840 0x1b9d0a0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c004470 tx=0x7f7e0c0039a0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e26505740 1 -- 172.21.15.82:0/4174683324 shutdown_connections 2023-11-28T13:03:31.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e26505740 1 --2- 172.21.15.82:0/4174683324 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x19308c0 0x1b992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e26505740 1 --2- 172.21.15.82:0/4174683324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x18e5840 0x1b9d0a0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e26505740 1 --2- 172.21.15.82:0/4174683324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e5c10 0x1b9cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e26505740 1 -- 172.21.15.82:0/4174683324 >> 172.21.15.82:0/4174683324 conn(0x18e5fe0 msgr2=0x1b7eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:31.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e26505740 1 -- 172.21.15.82:0/4174683324 shutdown_connections 2023-11-28T13:03:31.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e26505740 1 -- 172.21.15.82:0/4174683324 wait complete. 2023-11-28T13:03:31.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e26505740 1 -- start start 2023-11-28T13:03:31.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e26505740 1 Processor -- start 2023-11-28T13:03:31.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e26505740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x18e5840 0x1b7e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e26505740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e5c10 0x1b7ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e26505740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x19308c0 0x1b55f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e26505740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x196ac50 con 0x19308c0 2023-11-28T13:03:31.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e26505740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ba44b0 con 0x18e5c10 2023-11-28T13:03:31.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e26505740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ba4750 con 0x18e5840 2023-11-28T13:03:31.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e26505740 10 client.0 _ll_register_callbacks cb 0x1ab79a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:03:31.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e21822700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x19308c0 0x1b55f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e21822700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x19308c0 0x1b55f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58362/0 (socket says 172.21.15.82:58362) 2023-11-28T13:03:31.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e21822700 1 -- 172.21.15.82:0/2251442717 learned_addr learned my addr 172.21.15.82:0/2251442717 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:31.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e21021700 1 --2- 172.21.15.82:0/2251442717 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x18e5840 0x1b7e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.984+0000 7f7e20820700 1 --2- 172.21.15.82:0/2251442717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e5c10 0x1b7ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e21822700 1 -- 172.21.15.82:0/2251442717 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x18e5840 msgr2=0x1b7e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e21822700 1 --2- 172.21.15.82:0/2251442717 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x18e5840 0x1b7e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e21822700 1 -- 172.21.15.82:0/2251442717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e5c10 msgr2=0x1b7ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:31.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e21822700 1 --2- 172.21.15.82:0/2251442717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e5c10 0x1b7ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e21822700 1 -- 172.21.15.82:0/2251442717 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0c00e040 con 0x19308c0 2023-11-28T13:03:31.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e20820700 1 --2- 172.21.15.82:0/2251442717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e5c10 0x1b7ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:03:31.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e21822700 1 --2- 172.21.15.82:0/2251442717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x19308c0 0x1b55f50 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f7e14050680 tx=0x7f7e1405c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95be3a6920e3027e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:31.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7df7fff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-11-28T13:03:31.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7df7fff700 1 -- 172.21.15.82:0/2251442717 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1405bd80 con 0x19308c0 2023-11-28T13:03:31.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7df7fff700 1 -- 172.21.15.82:0/2251442717 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e1405bee0 con 0x19308c0 2023-11-28T13:03:31.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e26505740 1 -- 172.21.15.82:0/2251442717 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1ab70e0 con 0x19308c0 2023-11-28T13:03:31.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7df7fff700 1 -- 172.21.15.82:0/2251442717 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e14080b60 con 0x19308c0 2023-11-28T13:03:31.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e26505740 10 client.6531 fetch_fsmap learned FSMap version 30 2023-11-28T13:03:31.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e26505740 1 -- 172.21.15.82:0/2251442717 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x1931b10 con 0x19308c0 2023-11-28T13:03:31.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7df7fff700 1 -- 172.21.15.82:0/2251442717 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e14060070 con 0x19308c0 2023-11-28T13:03:31.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7df7fff700 1 -- 172.21.15.82:0/2251442717 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f7e14080cc0 con 0x19308c0 2023-11-28T13:03:31.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e26505740 10 client.6531 fetch_fsmap finished waiting for FSMap version 30 2023-11-28T13:03:31.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e26505740 10 client.6531 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-28T13:03:31.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e26505740 20 client.6531 populate_metadata read hostname 'smithi082' 2023-11-28T13:03:31.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e26505740 1 --2- 172.21.15.82:0/2251442717 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x1b78450 0x1b56490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:31.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e26505740 4 client.6531 mds_command: new command op to 6309 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T13:03:31.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e26505740 1 -- 172.21.15.82:0/2251442717 --> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1ab6e00 con 0x1b78450 2023-11-28T13:03:31.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e21021700 1 --2- 172.21.15.82:0/2251442717 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x1b78450 0x1b56490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:31.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7df7fff700 10 client.6531 ms_handle_connect on v2:172.21.15.82:6836/2902091405 2023-11-28T13:03:31.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e21021700 1 --2- 172.21.15.82:0/2251442717 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x1b78450 0x1b56490 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cfbe7790847eb5 server_cookie=ddb5570ae1f93e16 in_seq=0 out_seq=0 2023-11-28T13:03:31.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7df7fff700 1 -- 172.21.15.82:0/2251442717 <== mds.0 v2:172.21.15.82:6836/2902091405 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1ab6e00 con 0x1b78450 2023-11-28T13:03:31.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7df7fff700 10 client.6531 handle_command_reply: tid=0 2023-11-28T13:03:31.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e26505740 1 client.6531 shutdown 2023-11-28T13:03:31.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e26505740 1 -- 172.21.15.82:0/2251442717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x19308c0 msgr2=0x1b55f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:31.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e26505740 1 --2- 172.21.15.82:0/2251442717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x19308c0 0x1b55f50 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f7e14050680 tx=0x7f7e1405c300 comp rx=0 tx=0).stop 2023-11-28T13:03:31.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e26505740 1 -- 172.21.15.82:0/2251442717 shutdown_connections 2023-11-28T13:03:31.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e26505740 1 --2- 172.21.15.82:0/2251442717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x19308c0 0x1b55f50 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e26505740 1 --2- 172.21.15.82:0/2251442717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e5c10 0x1b7ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e26505740 1 --2- 172.21.15.82:0/2251442717 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x1b78450 0x1b56490 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e26505740 1 --2- 172.21.15.82:0/2251442717 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x18e5840 0x1b7e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:31.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e26505740 1 -- 172.21.15.82:0/2251442717 >> 172.21.15.82:0/2251442717 conn(0x18e5fe0 msgr2=0x1b7a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:31.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7df7fff700 0 client.6531 ms_handle_reset on v2:172.21.15.82:6836/2902091405 2023-11-28T13:03:31.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e26505740 1 -- 172.21.15.82:0/2251442717 shutdown_connections 2023-11-28T13:03:31.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.988+0000 7f7e26505740 1 -- 172.21.15.82:0/2251442717 wait complete. 2023-11-28T13:03:31.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:31.992+0000 7f7e26505740 20 client.6531 trim_cache size 0 max 16384 2023-11-28T13:03:32.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.008+0000 7f7e26505740 1 Processor -- start 2023-11-28T13:03:32.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.008+0000 7f7e26505740 1 -- start start 2023-11-28T13:03:32.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.008+0000 7f7e26505740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x18e5840 0x1b7b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:32.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.008+0000 7f7e26505740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e5c10 0x1b53520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:32.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.008+0000 7f7e26505740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x19308c0 0x1b53a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:32.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.008+0000 7f7e26505740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ac0bc0 con 0x18e5840 2023-11-28T13:03:32.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.008+0000 7f7e26505740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b23ab0 con 0x18e5c10 2023-11-28T13:03:32.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.008+0000 7f7e26505740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ac21d0 con 0x19308c0 2023-11-28T13:03:32.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.008+0000 7f7e21021700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x18e5840 0x1b7b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:32.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.008+0000 7f7e21021700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x18e5840 0x1b7b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58374/0 (socket says 172.21.15.82:58374) 2023-11-28T13:03:32.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.008+0000 7f7e21021700 1 -- 172.21.15.82:0/104827452 learned_addr learned my addr 172.21.15.82:0/104827452 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:32.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.008+0000 7f7e20820700 1 --2- 172.21.15.82:0/104827452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e5c10 0x1b53520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:32.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.008+0000 7f7e21822700 1 --2- 172.21.15.82:0/104827452 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x19308c0 0x1b53a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:32.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.008+0000 7f7e21021700 1 -- 172.21.15.82:0/104827452 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x19308c0 msgr2=0x1b53a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:32.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.008+0000 7f7e21021700 1 --2- 172.21.15.82:0/104827452 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x19308c0 0x1b53a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:32.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.008+0000 7f7e21021700 1 -- 172.21.15.82:0/104827452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e5c10 msgr2=0x1b53520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:32.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.008+0000 7f7e21021700 1 --2- 172.21.15.82:0/104827452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e5c10 0x1b53520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:32.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.008+0000 7f7e21021700 1 -- 172.21.15.82:0/104827452 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c06de20 con 0x18e5840 2023-11-28T13:03:32.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.008+0000 7f7e21021700 1 --2- 172.21.15.82:0/104827452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x18e5840 0x1b7b470 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f7e18009150 tx=0x7f7e18010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b04da7e4b374807 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:32.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7dff7fe700 1 -- 172.21.15.82:0/104827452 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18020070 con 0x18e5840 2023-11-28T13:03:32.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7dff7fe700 1 -- 172.21.15.82:0/104827452 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1802f040 con 0x18e5840 2023-11-28T13:03:32.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7dff7fe700 1 -- 172.21.15.82:0/104827452 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18035030 con 0x18e5840 2023-11-28T13:03:32.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e26505740 1 -- 172.21.15.82:0/104827452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x18e5840 msgr2=0x1b7b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:32.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e26505740 1 --2- 172.21.15.82:0/104827452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x18e5840 0x1b7b470 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f7e18009150 tx=0x7f7e18010000 comp rx=0 tx=0).stop 2023-11-28T13:03:32.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e26505740 1 -- 172.21.15.82:0/104827452 shutdown_connections 2023-11-28T13:03:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e26505740 1 --2- 172.21.15.82:0/104827452 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x19308c0 0x1b53a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e26505740 1 --2- 172.21.15.82:0/104827452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e5c10 0x1b53520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e26505740 1 --2- 172.21.15.82:0/104827452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x18e5840 0x1b7b470 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e26505740 1 -- 172.21.15.82:0/104827452 >> 172.21.15.82:0/104827452 conn(0x18e5fe0 msgr2=0x1b7e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e26505740 1 -- 172.21.15.82:0/104827452 shutdown_connections 2023-11-28T13:03:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e26505740 1 -- 172.21.15.82:0/104827452 wait complete. 2023-11-28T13:03:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e26505740 1 -- start start 2023-11-28T13:03:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e26505740 1 Processor -- start 2023-11-28T13:03:32.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e26505740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e5840 0x1b56650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:32.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e26505740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x18e5c10 0x1bfb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:32.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e26505740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x19308c0 0x1bfb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:32.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e26505740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ba4b30 con 0x19308c0 2023-11-28T13:03:32.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e26505740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b73f30 con 0x18e5840 2023-11-28T13:03:32.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e26505740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ba5290 con 0x18e5c10 2023-11-28T13:03:32.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e26505740 10 client.0 _ll_register_callbacks cb 0x7f7e0c004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:03:32.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e21822700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x19308c0 0x1bfb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:32.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e21822700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x19308c0 0x1bfb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58378/0 (socket says 172.21.15.82:58378) 2023-11-28T13:03:32.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e21822700 1 -- 172.21.15.82:0/139306998 learned_addr learned my addr 172.21.15.82:0/139306998 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:03:32.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e21021700 1 --2- 172.21.15.82:0/139306998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e5840 0x1b56650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:32.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e20820700 1 --2- 172.21.15.82:0/139306998 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x18e5c10 0x1bfb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:32.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e21822700 1 -- 172.21.15.82:0/139306998 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x18e5c10 msgr2=0x1bfb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:32.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e21822700 1 --2- 172.21.15.82:0/139306998 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x18e5c10 0x1bfb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:32.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e21822700 1 -- 172.21.15.82:0/139306998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e5840 msgr2=0x1b56650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:03:32.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e21822700 1 --2- 172.21.15.82:0/139306998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e5840 0x1b56650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:32.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e21822700 1 -- 172.21.15.82:0/139306998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1c0cae40 con 0x19308c0 2023-11-28T13:03:32.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e21822700 1 --2- 172.21.15.82:0/139306998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x19308c0 0x1bfb930 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7e14054060 tx=0x7f7e1400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b2ab65c75c1e0a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:03:32.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7df7fff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-11-28T13:03:32.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7df7fff700 1 -- 172.21.15.82:0/139306998 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e14080b60 con 0x19308c0 2023-11-28T13:03:32.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7df7fff700 1 -- 172.21.15.82:0/139306998 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e14080cc0 con 0x19308c0 2023-11-28T13:03:32.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e26505740 1 -- 172.21.15.82:0/139306998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e0c009910 con 0x19308c0 2023-11-28T13:03:32.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7df7fff700 1 -- 172.21.15.82:0/139306998 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e14080e80 con 0x19308c0 2023-11-28T13:03:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e26505740 10 client.6537 fetch_fsmap learned FSMap version 30 2023-11-28T13:03:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.012+0000 7f7e26505740 1 -- 172.21.15.82:0/139306998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x1a6aaf0 con 0x19308c0 2023-11-28T13:03:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7df7fff700 1 -- 172.21.15.82:0/139306998 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c009910 con 0x19308c0 2023-11-28T13:03:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7df7fff700 1 -- 172.21.15.82:0/139306998 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f7e14050180 con 0x19308c0 2023-11-28T13:03:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e26505740 10 client.6537 fetch_fsmap finished waiting for FSMap version 30 2023-11-28T13:03:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e26505740 10 client.6537 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-28T13:03:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e26505740 20 client.6537 populate_metadata read hostname 'smithi082' 2023-11-28T13:03:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e26505740 1 --2- 172.21.15.82:0/139306998 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x1b72000 0x1b72400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:03:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e26505740 4 client.6537 mds_command: new command op to 6309 tid=0[{"prefix": "scrub status"}] 2023-11-28T13:03:32.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e26505740 1 -- 172.21.15.82:0/139306998 --> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1962390 con 0x1b72000 2023-11-28T13:03:32.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e21021700 1 --2- 172.21.15.82:0/139306998 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x1b72000 0x1b72400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:03:32.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7df7fff700 10 client.6537 ms_handle_connect on v2:172.21.15.82:6836/2902091405 2023-11-28T13:03:32.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e21021700 1 --2- 172.21.15.82:0/139306998 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x1b72000 0x1b72400 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ecd10f916f85eef server_cookie=e92bb27c42facd27 in_seq=0 out_seq=0 2023-11-28T13:03:32.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7df7fff700 1 -- 172.21.15.82:0/139306998 <== mds.0 v2:172.21.15.82:6836/2902091405 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+253 (crc 0 0 0) 0x1962390 con 0x1b72000 2023-11-28T13:03:32.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7df7fff700 10 client.6537 handle_command_reply: tid=0 2023-11-28T13:03:32.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e26505740 1 client.6537 shutdown 2023-11-28T13:03:32.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e26505740 1 -- 172.21.15.82:0/139306998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x19308c0 msgr2=0x1bfb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:32.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e26505740 1 --2- 172.21.15.82:0/139306998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x19308c0 0x1bfb930 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7e14054060 tx=0x7f7e1400ef90 comp rx=0 tx=0).stop 2023-11-28T13:03:32.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e26505740 1 -- 172.21.15.82:0/139306998 shutdown_connections 2023-11-28T13:03:32.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e26505740 1 --2- 172.21.15.82:0/139306998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x19308c0 0x1bfb930 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:32.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e26505740 1 --2- 172.21.15.82:0/139306998 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x1b72000 0x1b72400 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:32.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7df7fff700 0 client.6537 ms_handle_reset on v2:172.21.15.82:6836/2902091405 2023-11-28T13:03:32.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e26505740 1 --2- 172.21.15.82:0/139306998 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x18e5c10 0x1bfb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:32.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e26505740 1 --2- 172.21.15.82:0/139306998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x18e5840 0x1b56650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:32.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e26505740 1 -- 172.21.15.82:0/139306998 >> 172.21.15.82:0/139306998 conn(0x18e5fe0 msgr2=0x1b7de40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:32.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e26505740 1 -- 172.21.15.82:0/139306998 shutdown_connections 2023-11-28T13:03:32.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e26505740 1 -- 172.21.15.82:0/139306998 wait complete. 2023-11-28T13:03:32.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e26505740 20 client.6537 trim_cache size 0 max 16384 2023-11-28T13:03:32.027 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:03:32.027 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-28T13:03:32.027 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2023-11-28T13:03:32.028 INFO:teuthology.orchestra.run.smithi082.stdout: "acf96507-60de-4527-806e-dffd2a5ef253": { 2023-11-28T13:03:32.028 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2023-11-28T13:03:32.028 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "acf96507-60de-4527-806e-dffd2a5ef253", 2023-11-28T13:03:32.028 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive" 2023-11-28T13:03:32.028 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:32.028 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:03:32.028 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:03:32.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e23285700 1 -- 172.21.15.82:0/1750168660 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7e00064ee0 msgr2=0x7f7e00067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:32.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e23285700 1 --2- 172.21.15.82:0/1750168660 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7e00064ee0 0x7f7e00067390 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7e18000c00 tx=0x7f7e18008030 comp rx=0 tx=0).stop 2023-11-28T13:03:32.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e23285700 1 -- 172.21.15.82:0/1750168660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e1c15ce30 msgr2=0x7f7e1c155810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:03:32.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e23285700 1 --2- 172.21.15.82:0/1750168660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e1c15ce30 0x7f7e1c155810 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f7e14007e60 tx=0x7f7e1400e3c0 comp rx=0 tx=0).stop 2023-11-28T13:03:32.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e23285700 1 -- 172.21.15.82:0/1750168660 shutdown_connections 2023-11-28T13:03:32.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e23285700 1 --2- 172.21.15.82:0/1750168660 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7e00064ee0 0x7f7e00067390 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:32.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e23285700 1 --2- 172.21.15.82:0/1750168660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e1c15ce30 0x7f7e1c155810 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:32.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e23285700 1 --2- 172.21.15.82:0/1750168660 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e1c0ca0e0 0x7f7e1c154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:32.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e23285700 1 --2- 172.21.15.82:0/1750168660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e1c070670 0x7f7e1c15b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:03:32.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e23285700 1 -- 172.21.15.82:0/1750168660 >> 172.21.15.82:0/1750168660 conn(0x7f7e1c0ce9d0 msgr2=0x7f7e1c0afad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:03:32.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e23285700 1 -- 172.21.15.82:0/1750168660 shutdown_connections 2023-11-28T13:03:32.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:03:32.016+0000 7f7e23285700 1 -- 172.21.15.82:0/1750168660 wait complete. 2023-11-28T13:03:32.038 INFO:tasks.cephfs.filesystem:scrub status for tag:acf96507-60de-4527-806e-dffd2a5ef253 - {'path': '/', 'tag': 'acf96507-60de-4527-806e-dffd2a5ef253', 'options': 'recursive'} 2023-11-28T13:03:34.921 INFO:tasks.ceph.mon.a.smithi082.stderr:2023-11-28T13:03:34.916+0000 7f1907e90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-11-28T13:03:57.547 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:03:57.551 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:04:02.040 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-11-28T13:04:05.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.163+0000 7efc00442700 1 Processor -- start 2023-11-28T13:04:05.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.163+0000 7efc00442700 1 -- start start 2023-11-28T13:04:05.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efc00442700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efbf815ce30 0x7efbf8158f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efc00442700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efbf80cd7f0 0x7efbf8159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efc00442700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf80ca5a0 con 0x7efbf8070670 2023-11-28T13:04:05.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efc00442700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbf80ca880 con 0x7efbf80cd7f0 2023-11-28T13:04:05.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efc00442700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbf80cab60 con 0x7efbf815ce30 2023-11-28T13:04:05.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efbfe9df700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efbf80cd7f0 0x7efbf8159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efbfe9df700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efbf80cd7f0 0x7efbf8159470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43324/0 (socket says 172.21.15.82:43324) 2023-11-28T13:04:05.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efbfe9df700 1 -- 172.21.15.82:0/731148945 learned_addr learned my addr 172.21.15.82:0/731148945 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:05.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efbfd9dd700 1 --2- 172.21.15.82:0/731148945 >> v2:172.21.15.114:3300/0 conn(0x7efbf815ce30 0x7efbf8158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efbfe9df700 1 -- 172.21.15.82:0/731148945 >> v2:172.21.15.114:3300/0 conn(0x7efbf815ce30 msgr2=0x7efbf8158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:05.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efbfe9df700 1 --2- 172.21.15.82:0/731148945 >> v2:172.21.15.114:3300/0 conn(0x7efbf815ce30 0x7efbf8158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efbfe9df700 1 -- 172.21.15.82:0/731148945 >> v1:172.21.15.114:6789/0 conn(0x7efbf8070670 legacy=0x7efbf80c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efbfe9df700 1 -- 172.21.15.82:0/731148945 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf80cae40 con 0x7efbf80cd7f0 2023-11-28T13:04:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efbfe9df700 1 --2- 172.21.15.82:0/731148945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efbf80cd7f0 0x7efbf8159470 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7efbf80ad830 tx=0x7efbf000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40fd3094d90d51af server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efbfd1dc700 1 -- 172.21.15.82:0/731148945 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf000e070 con 0x7efbf80cd7f0 2023-11-28T13:04:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efbfd1dc700 1 -- 172.21.15.82:0/731148945 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf000b9c0 con 0x7efbf80cd7f0 2023-11-28T13:04:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efbfd1dc700 1 -- 172.21.15.82:0/731148945 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf000bd70 con 0x7efbf80cd7f0 2023-11-28T13:04:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efc00442700 1 -- 172.21.15.82:0/731148945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efbf80cd7f0 msgr2=0x7efbf8159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efc00442700 1 --2- 172.21.15.82:0/731148945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efbf80cd7f0 0x7efbf8159470 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7efbf80ad830 tx=0x7efbf000b330 comp rx=0 tx=0).stop 2023-11-28T13:04:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efc00442700 1 -- 172.21.15.82:0/731148945 shutdown_connections 2023-11-28T13:04:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efc00442700 1 --2- 172.21.15.82:0/731148945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efbf80cd7f0 0x7efbf8159470 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efc00442700 1 --2- 172.21.15.82:0/731148945 >> v2:172.21.15.114:3300/0 conn(0x7efbf815ce30 0x7efbf8158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efc00442700 1 -- 172.21.15.82:0/731148945 >> 172.21.15.82:0/731148945 conn(0x7efbf80ce9d0 msgr2=0x7efbf80ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efc00442700 1 -- 172.21.15.82:0/731148945 shutdown_connections 2023-11-28T13:04:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.167+0000 7efc00442700 1 -- 172.21.15.82:0/731148945 wait complete. 2023-11-28T13:04:05.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.171+0000 7efc00442700 1 Processor -- start 2023-11-28T13:04:05.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.171+0000 7efc00442700 1 -- start start 2023-11-28T13:04:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.171+0000 7efc00442700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbf8070670 0x7efbf80addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.171+0000 7efc00442700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efbf80cd7f0 0x7efbf814c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.171+0000 7efc00442700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efbf815ce30 0x7efbf8158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.171+0000 7efc00442700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf814cb60 con 0x7efbf80cd7f0 2023-11-28T13:04:05.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.171+0000 7efc00442700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf8158940 con 0x7efbf8070670 2023-11-28T13:04:05.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.171+0000 7efc00442700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80ae420 con 0x7efbf815ce30 2023-11-28T13:04:05.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.171+0000 7efbfd9dd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efbf80cd7f0 0x7efbf814c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.171+0000 7efbfd9dd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efbf80cd7f0 0x7efbf814c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43334/0 (socket says 172.21.15.82:43334) 2023-11-28T13:04:05.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.171+0000 7efbfd9dd700 1 -- 172.21.15.82:0/818743215 learned_addr learned my addr 172.21.15.82:0/818743215 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:05.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.171+0000 7efbfe1de700 1 --2- 172.21.15.82:0/818743215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbf8070670 0x7efbf80addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.171+0000 7efbfe9df700 1 --2- 172.21.15.82:0/818743215 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efbf815ce30 0x7efbf8158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.171+0000 7efbfd9dd700 1 -- 172.21.15.82:0/818743215 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efbf815ce30 msgr2=0x7efbf8158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.171+0000 7efbfd9dd700 1 --2- 172.21.15.82:0/818743215 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efbf815ce30 0x7efbf8158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.171+0000 7efbfd9dd700 1 -- 172.21.15.82:0/818743215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbf8070670 msgr2=0x7efbf80addf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.171+0000 7efbfd9dd700 1 --2- 172.21.15.82:0/818743215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbf8070670 0x7efbf80addf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.171+0000 7efbfd9dd700 1 -- 172.21.15.82:0/818743215 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf0009b30 con 0x7efbf80cd7f0 2023-11-28T13:04:05.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.171+0000 7efbfd9dd700 1 --2- 172.21.15.82:0/818743215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efbf80cd7f0 0x7efbf814c620 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7efbe800d7d0 tx=0x7efbe800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:05.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.175+0000 7efbf6ffd700 1 -- 172.21.15.82:0/818743215 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe80125f0 con 0x7efbf80cd7f0 2023-11-28T13:04:05.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.175+0000 7efbf6ffd700 1 -- 172.21.15.82:0/818743215 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe8012750 con 0x7efbf80cd7f0 2023-11-28T13:04:05.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.175+0000 7efc00442700 1 -- 172.21.15.82:0/818743215 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf80ca2b0 con 0x7efbf80cd7f0 2023-11-28T13:04:05.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.175+0000 7efbf6ffd700 1 -- 172.21.15.82:0/818743215 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8012ae0 con 0x7efbf80cd7f0 2023-11-28T13:04:05.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.175+0000 7efc00442700 1 -- 172.21.15.82:0/818743215 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf80cb120 con 0x7efbf80cd7f0 2023-11-28T13:04:05.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.175+0000 7efbf6ffd700 1 -- 172.21.15.82:0/818743215 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efbe8012c40 con 0x7efbf80cd7f0 2023-11-28T13:04:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.175+0000 7efbf6ffd700 1 --2- 172.21.15.82:0/818743215 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efbe4064f10 0x7efbe40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efbf6ffd700 1 -- 172.21.15.82:0/818743215 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efbe8082090 con 0x7efbf80cd7f0 2023-11-28T13:04:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efbfe1de700 1 --2- 172.21.15.82:0/818743215 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efbe4064f10 0x7efbe40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efbfe1de700 1 --2- 172.21.15.82:0/818743215 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efbe4064f10 0x7efbe40673c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efbec000f60 tx=0x7efbec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efc036c2740 1 Processor -- start 2023-11-28T13:04:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efc036c2740 1 -- start start 2023-11-28T13:04:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efc036c2740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x2918c10 0x2bcfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efc036c2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2918840 0x2bd00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efc036c2740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x29638c0 0x2bcc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efc036c2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a87d20 con 0x2918840 2023-11-28T13:04:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efc036c2740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x2af7d60 con 0x2918c10 2023-11-28T13:04:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efc036c2740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x2af1060 con 0x29638c0 2023-11-28T13:04:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efbfd9dd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2918840 0x2bd00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efbfd9dd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2918840 0x2bd00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43342/0 (socket says 172.21.15.82:43342) 2023-11-28T13:04:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efbfd9dd700 1 -- 172.21.15.82:0/4131765697 learned_addr learned my addr 172.21.15.82:0/4131765697 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efbfe1de700 1 --2- 172.21.15.82:0/4131765697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x2918c10 0x2bcfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efbfe9df700 1 --2- 172.21.15.82:0/4131765697 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x29638c0 0x2bcc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efbfd9dd700 1 -- 172.21.15.82:0/4131765697 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x29638c0 msgr2=0x2bcc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efbfd9dd700 1 --2- 172.21.15.82:0/4131765697 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x29638c0 0x2bcc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efbfd9dd700 1 -- 172.21.15.82:0/4131765697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x2918c10 msgr2=0x2bcfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efbfd9dd700 1 --2- 172.21.15.82:0/4131765697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x2918c10 0x2bcfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efbfd9dd700 1 -- 172.21.15.82:0/4131765697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2b170a0 con 0x2918840 2023-11-28T13:04:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efbfd9dd700 1 --2- 172.21.15.82:0/4131765697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2918840 0x2bd00a0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7efbe8007470 tx=0x7efbe8012f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604069de48ccdf25 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efbdffff700 1 -- 172.21.15.82:0/4131765697 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8052070 con 0x2918840 2023-11-28T13:04:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efbdffff700 1 -- 172.21.15.82:0/4131765697 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe8070160 con 0x2918840 2023-11-28T13:04:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efbdffff700 1 -- 172.21.15.82:0/4131765697 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe805bc70 con 0x2918840 2023-11-28T13:04:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efc036c2740 1 -- 172.21.15.82:0/4131765697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2918840 msgr2=0x2bd00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efc036c2740 1 --2- 172.21.15.82:0/4131765697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2918840 0x2bd00a0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7efbe8007470 tx=0x7efbe8012f50 comp rx=0 tx=0).stop 2023-11-28T13:04:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efc036c2740 1 -- 172.21.15.82:0/4131765697 shutdown_connections 2023-11-28T13:04:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efc036c2740 1 --2- 172.21.15.82:0/4131765697 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x29638c0 0x2bcc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efc036c2740 1 --2- 172.21.15.82:0/4131765697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2918840 0x2bd00a0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.179+0000 7efc036c2740 1 --2- 172.21.15.82:0/4131765697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x2918c10 0x2bcfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efc036c2740 1 -- 172.21.15.82:0/4131765697 >> 172.21.15.82:0/4131765697 conn(0x2918fe0 msgr2=0x2bb1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:05.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efc036c2740 1 -- 172.21.15.82:0/4131765697 shutdown_connections 2023-11-28T13:04:05.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efc036c2740 1 -- 172.21.15.82:0/4131765697 wait complete. 2023-11-28T13:04:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efc036c2740 1 -- start start 2023-11-28T13:04:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efc036c2740 1 Processor -- start 2023-11-28T13:04:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efc036c2740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x2918840 0x2bb1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efc036c2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2918c10 0x2b87fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efc036c2740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x29638c0 0x2bb2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efc036c2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x299dc50 con 0x2918c10 2023-11-28T13:04:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efc036c2740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b87610 con 0x29638c0 2023-11-28T13:04:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efc036c2740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b8b690 con 0x2918840 2023-11-28T13:04:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efc036c2740 10 client.0 _ll_register_callbacks cb 0x2aea9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:04:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efbfd9dd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2918c10 0x2b87fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efbfe1de700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x2918840 0x2bb1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efbfe9df700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x29638c0 0x2bb2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efbfd9dd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2918c10 0x2b87fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43358/0 (socket says 172.21.15.82:43358) 2023-11-28T13:04:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efbfd9dd700 1 -- 172.21.15.82:0/3222900599 learned_addr learned my addr 172.21.15.82:0/3222900599 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efbfd9dd700 1 -- 172.21.15.82:0/3222900599 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x2918840 msgr2=0x2bb1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efbfd9dd700 1 --2- 172.21.15.82:0/3222900599 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x2918840 0x2bb1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efbfd9dd700 1 -- 172.21.15.82:0/3222900599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x29638c0 msgr2=0x2bb2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efbfd9dd700 1 --2- 172.21.15.82:0/3222900599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x29638c0 0x2bb2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efbfd9dd700 1 -- 172.21.15.82:0/3222900599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf80cb120 con 0x2918c10 2023-11-28T13:04:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efbfd9dd700 1 --2- 172.21.15.82:0/3222900599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2918c10 0x2b87fb0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7efbe800de30 tx=0x7efbe8057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad22314e8b2924b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efbdd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-11-28T13:04:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efbdd7fa700 1 -- 172.21.15.82:0/3222900599 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe80702d0 con 0x2918c10 2023-11-28T13:04:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efbdd7fa700 1 -- 172.21.15.82:0/3222900599 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efbe8080180 con 0x2918c10 2023-11-28T13:04:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efc036c2740 1 -- 172.21.15.82:0/3222900599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2aea0e0 con 0x2918c10 2023-11-28T13:04:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efbdd7fa700 1 -- 172.21.15.82:0/3222900599 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7efbe8080340 con 0x2918c10 2023-11-28T13:04:05.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efc036c2740 10 client.6549 fetch_fsmap learned FSMap version 31 2023-11-28T13:04:05.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efc036c2740 1 -- 172.21.15.82:0/3222900599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x2964b10 con 0x2918c10 2023-11-28T13:04:05.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.183+0000 7efbdd7fa700 1 -- 172.21.15.82:0/3222900599 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2aea0e0 con 0x2918c10 2023-11-28T13:04:05.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efbdd7fa700 1 -- 172.21.15.82:0/3222900599 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7efbe804fc60 con 0x2918c10 2023-11-28T13:04:05.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efc036c2740 10 client.6549 fetch_fsmap finished waiting for FSMap version 31 2023-11-28T13:04:05.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efc036c2740 10 client.6549 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-28T13:04:05.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efc036c2740 20 client.6549 populate_metadata read hostname 'smithi082' 2023-11-28T13:04:05.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efc036c2740 1 --2- 172.21.15.82:0/3222900599 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x2bab170 0x2bb32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efc036c2740 4 client.6549 mds_command: new command op to 6309 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T13:04:05.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efc036c2740 1 -- 172.21.15.82:0/3222900599 --> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2ae9e00 con 0x2bab170 2023-11-28T13:04:05.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efbfe1de700 1 --2- 172.21.15.82:0/3222900599 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x2bab170 0x2bb32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efbdd7fa700 10 client.6549 ms_handle_connect on v2:172.21.15.82:6836/2902091405 2023-11-28T13:04:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efbfe1de700 1 --2- 172.21.15.82:0/3222900599 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x2bab170 0x2bb32f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a85bd294a74f964f server_cookie=5cbb2efc17283035 in_seq=0 out_seq=0 2023-11-28T13:04:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efbdd7fa700 1 -- 172.21.15.82:0/3222900599 <== mds.0 v2:172.21.15.82:6836/2902091405 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x2ae9e00 con 0x2bab170 2023-11-28T13:04:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efbdd7fa700 10 client.6549 handle_command_reply: tid=0 2023-11-28T13:04:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efc036c2740 1 client.6549 shutdown 2023-11-28T13:04:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efc036c2740 1 -- 172.21.15.82:0/3222900599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2918c10 msgr2=0x2b87fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efc036c2740 1 --2- 172.21.15.82:0/3222900599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2918c10 0x2b87fb0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7efbe800de30 tx=0x7efbe8057000 comp rx=0 tx=0).stop 2023-11-28T13:04:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efc036c2740 1 -- 172.21.15.82:0/3222900599 shutdown_connections 2023-11-28T13:04:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efc036c2740 1 --2- 172.21.15.82:0/3222900599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x29638c0 0x2bb2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efc036c2740 1 --2- 172.21.15.82:0/3222900599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2918c10 0x2b87fb0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efc036c2740 1 --2- 172.21.15.82:0/3222900599 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x2bab170 0x2bb32f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efc036c2740 1 --2- 172.21.15.82:0/3222900599 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x2918840 0x2bb1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efbdd7fa700 0 client.6549 ms_handle_reset on v2:172.21.15.82:6836/2902091405 2023-11-28T13:04:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efc036c2740 1 -- 172.21.15.82:0/3222900599 >> 172.21.15.82:0/3222900599 conn(0x2918fe0 msgr2=0x2bad7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efc036c2740 1 -- 172.21.15.82:0/3222900599 shutdown_connections 2023-11-28T13:04:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efc036c2740 1 -- 172.21.15.82:0/3222900599 wait complete. 2023-11-28T13:04:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.187+0000 7efc036c2740 20 client.6549 trim_cache size 0 max 16384 2023-11-28T13:04:05.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efc036c2740 1 Processor -- start 2023-11-28T13:04:05.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efc036c2740 1 -- start start 2023-11-28T13:04:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efc036c2740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x2918840 0x2bcd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efc036c2740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x2918c10 0x2bcde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efc036c2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x29638c0 0x2be6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efc036c2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x2aefef0 con 0x29638c0 2023-11-28T13:04:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efc036c2740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x2af3bc0 con 0x2918840 2023-11-28T13:04:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efc036c2740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x2ac0ba0 con 0x2918c10 2023-11-28T13:04:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efbfe9df700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x29638c0 0x2be6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efbfe1de700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x2918840 0x2bcd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efbfe9df700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x29638c0 0x2be6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43362/0 (socket says 172.21.15.82:43362) 2023-11-28T13:04:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efbfe9df700 1 -- 172.21.15.82:0/425850387 learned_addr learned my addr 172.21.15.82:0/425850387 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efbfd9dd700 1 --2- 172.21.15.82:0/425850387 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x2918c10 0x2bcde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efbfe9df700 1 -- 172.21.15.82:0/425850387 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x2918c10 msgr2=0x2bcde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efbfe9df700 1 --2- 172.21.15.82:0/425850387 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x2918c10 0x2bcde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efbfe9df700 1 -- 172.21.15.82:0/425850387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x2918840 msgr2=0x2bcd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efbfe9df700 1 --2- 172.21.15.82:0/425850387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x2918840 0x2bcd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efbfe9df700 1 -- 172.21.15.82:0/425850387 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2ab7970 con 0x29638c0 2023-11-28T13:04:05.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efbfe1de700 1 --2- 172.21.15.82:0/425850387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x2918840 0x2bcd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:04:05.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efbfe9df700 1 --2- 172.21.15.82:0/425850387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x29638c0 0x2be6710 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7efbf80cf6e0 tx=0x7efbf0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a312ea29514d5f50 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:05.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efbf4db8700 1 -- 172.21.15.82:0/425850387 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf002b070 con 0x29638c0 2023-11-28T13:04:05.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efbf4db8700 1 -- 172.21.15.82:0/425850387 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf0023040 con 0x29638c0 2023-11-28T13:04:05.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efbf4db8700 1 -- 172.21.15.82:0/425850387 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0022070 con 0x29638c0 2023-11-28T13:04:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efc036c2740 1 -- 172.21.15.82:0/425850387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x29638c0 msgr2=0x2be6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efc036c2740 1 --2- 172.21.15.82:0/425850387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x29638c0 0x2be6710 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7efbf80cf6e0 tx=0x7efbf0010000 comp rx=0 tx=0).stop 2023-11-28T13:04:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efc036c2740 1 -- 172.21.15.82:0/425850387 shutdown_connections 2023-11-28T13:04:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efc036c2740 1 --2- 172.21.15.82:0/425850387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x29638c0 0x2be6710 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efc036c2740 1 --2- 172.21.15.82:0/425850387 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x2918c10 0x2bcde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efc036c2740 1 --2- 172.21.15.82:0/425850387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x2918840 0x2bcd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efc036c2740 1 -- 172.21.15.82:0/425850387 >> 172.21.15.82:0/425850387 conn(0x2918fe0 msgr2=0x2bade60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efc036c2740 1 -- 172.21.15.82:0/425850387 shutdown_connections 2023-11-28T13:04:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.211+0000 7efc036c2740 1 -- 172.21.15.82:0/425850387 wait complete. 2023-11-28T13:04:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efc036c2740 1 -- start start 2023-11-28T13:04:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efc036c2740 1 Processor -- start 2023-11-28T13:04:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efc036c2740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x2918840 0x2bed310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efc036c2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2918c10 0x2ba8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efc036c2740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x29638c0 0x2ba8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efc036c2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x2aee460 con 0x2918c10 2023-11-28T13:04:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efc036c2740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a9af10 con 0x29638c0 2023-11-28T13:04:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efc036c2740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a2ae80 con 0x2918840 2023-11-28T13:04:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efc036c2740 10 client.0 _ll_register_callbacks cb 0x7efbe8053be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:04:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efbfd9dd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2918c10 0x2ba8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efbfd9dd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2918c10 0x2ba8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43368/0 (socket says 172.21.15.82:43368) 2023-11-28T13:04:05.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efbfd9dd700 1 -- 172.21.15.82:0/2930894167 learned_addr learned my addr 172.21.15.82:0/2930894167 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:05.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efbfe9df700 1 --2- 172.21.15.82:0/2930894167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x29638c0 0x2ba8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efbfe1de700 1 --2- 172.21.15.82:0/2930894167 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x2918840 0x2bed310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efbfd9dd700 1 -- 172.21.15.82:0/2930894167 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x2918840 msgr2=0x2bed310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:05.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efbfd9dd700 1 --2- 172.21.15.82:0/2930894167 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x2918840 0x2bed310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efbfd9dd700 1 -- 172.21.15.82:0/2930894167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x29638c0 msgr2=0x2ba8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:05.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efbfd9dd700 1 --2- 172.21.15.82:0/2930894167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x29638c0 0x2ba8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efbfd9dd700 1 -- 172.21.15.82:0/2930894167 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf80ca5a0 con 0x2918c10 2023-11-28T13:04:05.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efbfe9df700 1 --2- 172.21.15.82:0/2930894167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x29638c0 0x2ba8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:04:05.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efbfd9dd700 1 --2- 172.21.15.82:0/2930894167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2918c10 0x2ba8790 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7efbe8053b70 tx=0x7efbe8053c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1868c3122a1b358a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:05.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efbdd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-11-28T13:04:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efbdd7fa700 1 -- 172.21.15.82:0/2930894167 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe80501b0 con 0x2918c10 2023-11-28T13:04:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efbdd7fa700 1 -- 172.21.15.82:0/2930894167 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efbe80702d0 con 0x2918c10 2023-11-28T13:04:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efc036c2740 1 -- 172.21.15.82:0/2930894167 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efbe8070160 con 0x2918c10 2023-11-28T13:04:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efbdd7fa700 1 -- 172.21.15.82:0/2930894167 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7efbe80539b0 con 0x2918c10 2023-11-28T13:04:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efc036c2740 10 client.6555 fetch_fsmap learned FSMap version 31 2023-11-28T13:04:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efc036c2740 1 -- 172.21.15.82:0/2930894167 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x7efbf80cae40 con 0x2918c10 2023-11-28T13:04:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efbdd7fa700 1 -- 172.21.15.82:0/2930894167 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe8070160 con 0x2918c10 2023-11-28T13:04:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efbdd7fa700 1 -- 172.21.15.82:0/2930894167 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7efbe804fc60 con 0x2918c10 2023-11-28T13:04:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efc036c2740 10 client.6555 fetch_fsmap finished waiting for FSMap version 31 2023-11-28T13:04:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efc036c2740 10 client.6555 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-28T13:04:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efc036c2740 20 client.6555 populate_metadata read hostname 'smithi082' 2023-11-28T13:04:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efc036c2740 1 --2- 172.21.15.82:0/2930894167 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x2b87030 0x2ba9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efc036c2740 4 client.6555 mds_command: new command op to 6309 tid=0[{"prefix": "scrub status"}] 2023-11-28T13:04:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efc036c2740 1 -- 172.21.15.82:0/2930894167 --> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x2995390 con 0x2b87030 2023-11-28T13:04:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.215+0000 7efbfe1de700 1 --2- 172.21.15.82:0/2930894167 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x2b87030 0x2ba9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efbdd7fa700 10 client.6555 ms_handle_connect on v2:172.21.15.82:6836/2902091405 2023-11-28T13:04:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efbfe1de700 1 --2- 172.21.15.82:0/2930894167 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x2b87030 0x2ba9210 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcae3a78324c65a8 server_cookie=ec3cc7c863d11dea in_seq=0 out_seq=0 2023-11-28T13:04:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efbdd7fa700 1 -- 172.21.15.82:0/2930894167 <== mds.0 v2:172.21.15.82:6836/2902091405 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x2995390 con 0x2b87030 2023-11-28T13:04:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efbdd7fa700 10 client.6555 handle_command_reply: tid=0 2023-11-28T13:04:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc036c2740 1 client.6555 shutdown 2023-11-28T13:04:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc036c2740 1 -- 172.21.15.82:0/2930894167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2918c10 msgr2=0x2ba8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc036c2740 1 --2- 172.21.15.82:0/2930894167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2918c10 0x2ba8790 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7efbe8053b70 tx=0x7efbe8053c90 comp rx=0 tx=0).stop 2023-11-28T13:04:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc036c2740 1 -- 172.21.15.82:0/2930894167 shutdown_connections 2023-11-28T13:04:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc036c2740 1 --2- 172.21.15.82:0/2930894167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x29638c0 0x2ba8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc036c2740 1 --2- 172.21.15.82:0/2930894167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x2918c10 0x2ba8790 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc036c2740 1 --2- 172.21.15.82:0/2930894167 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x2b87030 0x2ba9210 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efbdd7fa700 0 client.6555 ms_handle_reset on v2:172.21.15.82:6836/2902091405 2023-11-28T13:04:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc036c2740 1 --2- 172.21.15.82:0/2930894167 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x2918840 0x2bed310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc036c2740 1 -- 172.21.15.82:0/2930894167 >> 172.21.15.82:0/2930894167 conn(0x2918fe0 msgr2=0x2bcd930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc036c2740 1 -- 172.21.15.82:0/2930894167 shutdown_connections 2023-11-28T13:04:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc036c2740 1 -- 172.21.15.82:0/2930894167 wait complete. 2023-11-28T13:04:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc036c2740 20 client.6555 trim_cache size 0 max 16384 2023-11-28T13:04:05.230 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:04:05.230 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2023-11-28T13:04:05.230 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2023-11-28T13:04:05.230 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:04:05.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc00442700 1 -- 172.21.15.82:0/818743215 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efbe4064f10 msgr2=0x7efbe40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc00442700 1 --2- 172.21.15.82:0/818743215 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efbe4064f10 0x7efbe40673c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efbec000f60 tx=0x7efbec009040 comp rx=0 tx=0).stop 2023-11-28T13:04:05.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc00442700 1 -- 172.21.15.82:0/818743215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efbf80cd7f0 msgr2=0x7efbf814c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc00442700 1 --2- 172.21.15.82:0/818743215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efbf80cd7f0 0x7efbf814c620 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7efbe800d7d0 tx=0x7efbe800dae0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc00442700 1 -- 172.21.15.82:0/818743215 shutdown_connections 2023-11-28T13:04:05.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc00442700 1 --2- 172.21.15.82:0/818743215 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efbe4064f10 0x7efbe40673c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc00442700 1 --2- 172.21.15.82:0/818743215 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efbf815ce30 0x7efbf8158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc00442700 1 --2- 172.21.15.82:0/818743215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efbf80cd7f0 0x7efbf814c620 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc00442700 1 --2- 172.21.15.82:0/818743215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbf8070670 0x7efbf80addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc00442700 1 -- 172.21.15.82:0/818743215 >> 172.21.15.82:0/818743215 conn(0x7efbf80ce9d0 msgr2=0x7efbf815c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc00442700 1 -- 172.21.15.82:0/818743215 shutdown_connections 2023-11-28T13:04:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.219+0000 7efc00442700 1 -- 172.21.15.82:0/818743215 wait complete. 2023-11-28T13:04:05.242 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-28T13:04:05.243 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:04:05.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd45f44700 1 Processor -- start 2023-11-28T13:04:05.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd45f44700 1 -- start start 2023-11-28T13:04:05.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd45f44700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd380de870 0x7fdd38036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd45f44700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd3800c2d0 0x7fdd38036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd45f44700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd380345a0 con 0x7fdd380dec40 2023-11-28T13:04:05.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd45f44700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd380e3440 con 0x7fdd380de870 2023-11-28T13:04:05.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd45f44700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd380df1d0 con 0x7fdd3800c2d0 2023-11-28T13:04:05.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd44f42700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd380de870 0x7fdd38036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd3ffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdd380dec40 0x7fdd3804f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:34250/0 (socket says 172.21.15.82:34250) 2023-11-28T13:04:05.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd3ffff700 1 -- 172.21.15.82:0/2814923673 learned_addr learned my addr 172.21.15.82:0/2814923673 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:04:05.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd45743700 1 --2- 172.21.15.82:0/2814923673 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd3800c2d0 0x7fdd38036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd44f42700 1 -- 172.21.15.82:0/2814923673 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd3800c2d0 msgr2=0x7fdd38036cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:05.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd44f42700 1 --2- 172.21.15.82:0/2814923673 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd3800c2d0 0x7fdd38036cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd44f42700 1 -- 172.21.15.82:0/2814923673 >> v1:172.21.15.82:6789/0 conn(0x7fdd380dec40 legacy=0x7fdd3804f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd3f7fe700 1 -- 172.21.15.82:0/2814923673 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512422461 0 0) 0x7fdd380345a0 con 0x7fdd380dec40 2023-11-28T13:04:05.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd44f42700 1 -- 172.21.15.82:0/2814923673 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd380df4b0 con 0x7fdd380de870 2023-11-28T13:04:05.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd45743700 1 --2- 172.21.15.82:0/2814923673 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd3800c2d0 0x7fdd38036cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:04:05.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd44f42700 1 --2- 172.21.15.82:0/2814923673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd380de870 0x7fdd38036770 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fdd34009850 tx=0x7fdd34009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22d9242730764be server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:05.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd3f7fe700 1 -- 172.21.15.82:0/2814923673 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd34011830 con 0x7fdd380de870 2023-11-28T13:04:05.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd3f7fe700 1 -- 172.21.15.82:0/2814923673 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd34011990 con 0x7fdd380de870 2023-11-28T13:04:05.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd3f7fe700 1 -- 172.21.15.82:0/2814923673 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd34011d20 con 0x7fdd380de870 2023-11-28T13:04:05.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd45f44700 1 -- 172.21.15.82:0/2814923673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd380de870 msgr2=0x7fdd38036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd45f44700 1 --2- 172.21.15.82:0/2814923673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd380de870 0x7fdd38036770 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fdd34009850 tx=0x7fdd34009b60 comp rx=0 tx=0).stop 2023-11-28T13:04:05.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd45f44700 1 -- 172.21.15.82:0/2814923673 shutdown_connections 2023-11-28T13:04:05.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd45f44700 1 --2- 172.21.15.82:0/2814923673 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd3800c2d0 0x7fdd38036cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd45f44700 1 --2- 172.21.15.82:0/2814923673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd380de870 0x7fdd38036770 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd45f44700 1 -- 172.21.15.82:0/2814923673 >> 172.21.15.82:0/2814923673 conn(0x7fdd38051770 msgr2=0x7fdd38051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:05.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd45f44700 1 -- 172.21.15.82:0/2814923673 shutdown_connections 2023-11-28T13:04:05.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.359+0000 7fdd45f44700 1 -- 172.21.15.82:0/2814923673 wait complete. 2023-11-28T13:04:05.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.363+0000 7fdd45f44700 1 Processor -- start 2023-11-28T13:04:05.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.363+0000 7fdd45f44700 1 -- start start 2023-11-28T13:04:05.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.363+0000 7fdd45f44700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd3800c2d0 0x7fdd3803a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.363+0000 7fdd45f44700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd380de870 0x7fdd380d3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.363+0000 7fdd45f44700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd380dec40 0x7fdd380d3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.363+0000 7fdd45f44700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd380dc4e0 con 0x7fdd380de870 2023-11-28T13:04:05.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.363+0000 7fdd45f44700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd380dc780 con 0x7fdd3800c2d0 2023-11-28T13:04:05.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.363+0000 7fdd45f44700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3803aa90 con 0x7fdd380dec40 2023-11-28T13:04:05.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.363+0000 7fdd3ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd380de870 0x7fdd380d3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.363+0000 7fdd3ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd380de870 0x7fdd380d3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43386/0 (socket says 172.21.15.82:43386) 2023-11-28T13:04:05.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.363+0000 7fdd3ffff700 1 -- 172.21.15.82:0/720562666 learned_addr learned my addr 172.21.15.82:0/720562666 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:05.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.363+0000 7fdd45743700 1 --2- 172.21.15.82:0/720562666 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd380dec40 0x7fdd380d3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.363+0000 7fdd44f42700 1 --2- 172.21.15.82:0/720562666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd3800c2d0 0x7fdd3803a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.363+0000 7fdd3ffff700 1 -- 172.21.15.82:0/720562666 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd380dec40 msgr2=0x7fdd380d3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.363+0000 7fdd3ffff700 1 --2- 172.21.15.82:0/720562666 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd380dec40 0x7fdd380d3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.363+0000 7fdd3ffff700 1 -- 172.21.15.82:0/720562666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd3800c2d0 msgr2=0x7fdd3803a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.363+0000 7fdd3ffff700 1 --2- 172.21.15.82:0/720562666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd3800c2d0 0x7fdd3803a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.363+0000 7fdd3ffff700 1 -- 172.21.15.82:0/720562666 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd340094b0 con 0x7fdd380de870 2023-11-28T13:04:05.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.363+0000 7fdd3ffff700 1 --2- 172.21.15.82:0/720562666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd380de870 0x7fdd380d3a10 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00c4e0 tx=0x7fdd2c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:05.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.367+0000 7fdd3d7fa700 1 -- 172.21.15.82:0/720562666 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c004ca0 con 0x7fdd380de870 2023-11-28T13:04:05.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.367+0000 7fdd3d7fa700 1 -- 172.21.15.82:0/720562666 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2c004e20 con 0x7fdd380de870 2023-11-28T13:04:05.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.367+0000 7fdd45f44700 1 -- 172.21.15.82:0/720562666 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd380dfa70 con 0x7fdd380de870 2023-11-28T13:04:05.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.367+0000 7fdd3d7fa700 1 -- 172.21.15.82:0/720562666 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c007310 con 0x7fdd380de870 2023-11-28T13:04:05.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.367+0000 7fdd45f44700 1 -- 172.21.15.82:0/720562666 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd380df790 con 0x7fdd380de870 2023-11-28T13:04:05.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.367+0000 7fdd45f44700 1 -- 172.21.15.82:0/720562666 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd380528c0 con 0x7fdd380de870 2023-11-28T13:04:05.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.371+0000 7fdd3d7fa700 1 -- 172.21.15.82:0/720562666 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdd2c01a020 con 0x7fdd380de870 2023-11-28T13:04:05.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.371+0000 7fdd3d7fa700 1 --2- 172.21.15.82:0/720562666 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdd24064ee0 0x7fdd24067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.371+0000 7fdd3d7fa700 1 -- 172.21.15.82:0/720562666 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdd2c081fd0 con 0x7fdd380de870 2023-11-28T13:04:05.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.371+0000 7fdd44f42700 1 --2- 172.21.15.82:0/720562666 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdd24064ee0 0x7fdd24067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.371+0000 7fdd44f42700 1 --2- 172.21.15.82:0/720562666 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdd24064ee0 0x7fdd24067390 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdd34009fd0 tx=0x7fdd34008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:05.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.379+0000 7fdd3d7fa700 1 -- 172.21.15.82:0/720562666 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdd2c050100 con 0x7fdd380de870 2023-11-28T13:04:05.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.579+0000 7fdd45f44700 1 -- 172.21.15.82:0/720562666 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd38037b20 con 0x7fdd380de870 2023-11-28T13:04:05.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.579+0000 7fdd3d7fa700 1 -- 172.21.15.82:0/720562666 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4655 (secure 0 0 0) 0x7fdd2c053720 con 0x7fdd380de870 2023-11-28T13:04:05.587 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:04:05.587 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/3176308867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3176308867},{"type":"v1","addr":"172.21.15.114:6833","nonce":3176308867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6184,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1779270694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1779270694},{"type":"v1","addr":"172.21.15.114:6835","nonce":1779270694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1570999968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1570999968},{"type":"v1","addr":"172.21.15.82:6835","nonce":1570999968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:03:22.559646+0000","modified":"2023-11-28T13:03:34.920423+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":6,"addr":"172.21.15.82:6837/2902091405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2902091405},{"type":"v1","addr":"172.21.15.82:6837","nonce":2902091405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T13:04:05.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.583+0000 7fdd45f44700 1 -- 172.21.15.82:0/720562666 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdd24064ee0 msgr2=0x7fdd24067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.583+0000 7fdd45f44700 1 --2- 172.21.15.82:0/720562666 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdd24064ee0 0x7fdd24067390 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdd34009fd0 tx=0x7fdd34008030 comp rx=0 tx=0).stop 2023-11-28T13:04:05.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.583+0000 7fdd45f44700 1 -- 172.21.15.82:0/720562666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd380de870 msgr2=0x7fdd380d3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.583+0000 7fdd45f44700 1 --2- 172.21.15.82:0/720562666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd380de870 0x7fdd380d3a10 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00c4e0 tx=0x7fdd2c00c7f0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.583+0000 7fdd45f44700 1 -- 172.21.15.82:0/720562666 shutdown_connections 2023-11-28T13:04:05.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.583+0000 7fdd45f44700 1 --2- 172.21.15.82:0/720562666 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdd24064ee0 0x7fdd24067390 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.583+0000 7fdd45f44700 1 --2- 172.21.15.82:0/720562666 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd380dec40 0x7fdd380d3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.583+0000 7fdd45f44700 1 --2- 172.21.15.82:0/720562666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd380de870 0x7fdd380d3a10 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.583+0000 7fdd45f44700 1 --2- 172.21.15.82:0/720562666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd3800c2d0 0x7fdd3803a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.583+0000 7fdd45f44700 1 -- 172.21.15.82:0/720562666 >> 172.21.15.82:0/720562666 conn(0x7fdd38051770 msgr2=0x7fdd380d6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:05.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.583+0000 7fdd45f44700 1 -- 172.21.15.82:0/720562666 shutdown_connections 2023-11-28T13:04:05.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.583+0000 7fdd45f44700 1 -- 172.21.15.82:0/720562666 wait complete. 2023-11-28T13:04:05.590 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2023-11-28T13:04:05.601 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2023-11-28T13:04:05.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.715+0000 7f941e4e4700 1 Processor -- start 2023-11-28T13:04:05.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.715+0000 7f941e4e4700 1 -- start start 2023-11-28T13:04:05.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.715+0000 7f941e4e4700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9418158ff0 0x7f941815d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.715+0000 7f941e4e4700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94180ce870 con 0x7f941806d3d0 2023-11-28T13:04:05.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.715+0000 7f941e4e4700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94181593c0 con 0x7f941806caa0 2023-11-28T13:04:05.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.715+0000 7f941e4e4700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9418071ed0 con 0x7f9418158ff0 2023-11-28T13:04:05.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.715+0000 7f941cce1700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f941806d3d0 0x7f94180710b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:34262/0 (socket says 172.21.15.82:34262) 2023-11-28T13:04:05.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.715+0000 7f941cce1700 1 -- 172.21.15.82:0/3029481527 learned_addr learned my addr 172.21.15.82:0/3029481527 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:04:05.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.715+0000 7f941d4e2700 1 --2- 172.21.15.82:0/3029481527 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9418158ff0 0x7f941815d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.715+0000 7f940bfff700 1 -- 172.21.15.82:0/3029481527 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902422298 0 0) 0x7f94180ce870 con 0x7f941806d3d0 2023-11-28T13:04:05.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.715+0000 7f940bfff700 1 -- 172.21.15.82:0/3029481527 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94040035d0 con 0x7f941806d3d0 2023-11-28T13:04:05.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.715+0000 7f941d4e2700 1 -- 172.21.15.82:0/3029481527 >> v1:172.21.15.114:6789/0 conn(0x7f941806caa0 legacy=0x7f94180717c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.715+0000 7f941d4e2700 1 -- 172.21.15.82:0/3029481527 >> v1:172.21.15.82:6789/0 conn(0x7f941806d3d0 legacy=0x7f94180710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.715+0000 7f941d4e2700 1 -- 172.21.15.82:0/3029481527 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94180cd9c0 con 0x7f9418158ff0 2023-11-28T13:04:05.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.719+0000 7f941d4e2700 1 --2- 172.21.15.82:0/3029481527 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9418158ff0 0x7f941815d470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9414009dc0 tx=0x7f941400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=750d280f9152572 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:05.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.719+0000 7f940bfff700 1 -- 172.21.15.82:0/3029481527 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941400e070 con 0x7f9418158ff0 2023-11-28T13:04:05.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.719+0000 7f940bfff700 1 -- 172.21.15.82:0/3029481527 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941400bb20 con 0x7f9418158ff0 2023-11-28T13:04:05.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.719+0000 7f940bfff700 1 -- 172.21.15.82:0/3029481527 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414012430 con 0x7f9418158ff0 2023-11-28T13:04:05.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.719+0000 7f941e4e4700 1 -- 172.21.15.82:0/3029481527 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9418158ff0 msgr2=0x7f941815d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.719+0000 7f941e4e4700 1 --2- 172.21.15.82:0/3029481527 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9418158ff0 0x7f941815d470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9414009dc0 tx=0x7f941400b330 comp rx=0 tx=0).stop 2023-11-28T13:04:05.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.719+0000 7f941e4e4700 1 -- 172.21.15.82:0/3029481527 shutdown_connections 2023-11-28T13:04:05.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.719+0000 7f941e4e4700 1 --2- 172.21.15.82:0/3029481527 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9418158ff0 0x7f941815d470 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.719+0000 7f941e4e4700 1 -- 172.21.15.82:0/3029481527 >> 172.21.15.82:0/3029481527 conn(0x7f94180cf710 msgr2=0x7f94180cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:05.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.719+0000 7f941e4e4700 1 -- 172.21.15.82:0/3029481527 shutdown_connections 2023-11-28T13:04:05.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.719+0000 7f941e4e4700 1 -- 172.21.15.82:0/3029481527 wait complete. 2023-11-28T13:04:05.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.719+0000 7f941e4e4700 1 Processor -- start 2023-11-28T13:04:05.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.719+0000 7f941e4e4700 1 -- start start 2023-11-28T13:04:05.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f941e4e4700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f941806caa0 0x7f9418151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f941e4e4700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f941806d3d0 0x7f94180c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f941e4e4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9418158ff0 0x7f9418157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f941e4e4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94181f16a0 con 0x7f9418158ff0 2023-11-28T13:04:05.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f941e4e4700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9418151a90 con 0x7f941806d3d0 2023-11-28T13:04:05.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f941e4e4700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94180c88b0 con 0x7f941806caa0 2023-11-28T13:04:05.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f941dce3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9418158ff0 0x7f9418157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f941dce3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9418158ff0 0x7f9418157920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43392/0 (socket says 172.21.15.82:43392) 2023-11-28T13:04:05.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f941dce3700 1 -- 172.21.15.82:0/2631681921 learned_addr learned my addr 172.21.15.82:0/2631681921 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:05.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f941cce1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f941806d3d0 0x7f94180c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f941d4e2700 1 --2- 172.21.15.82:0/2631681921 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f941806caa0 0x7f9418151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f941dce3700 1 -- 172.21.15.82:0/2631681921 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f941806caa0 msgr2=0x7f9418151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f941dce3700 1 --2- 172.21.15.82:0/2631681921 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f941806caa0 0x7f9418151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f941dce3700 1 -- 172.21.15.82:0/2631681921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f941806d3d0 msgr2=0x7f94180c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f941dce3700 1 --2- 172.21.15.82:0/2631681921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f941806d3d0 0x7f94180c8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f941dce3700 1 -- 172.21.15.82:0/2631681921 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9414009a70 con 0x7f9418158ff0 2023-11-28T13:04:05.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f941cce1700 1 --2- 172.21.15.82:0/2631681921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f941806d3d0 0x7f94180c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:04:05.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f941dce3700 1 --2- 172.21.15.82:0/2631681921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9418158ff0 0x7f9418157920 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f941000c460 tx=0x7f941000c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:05.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f9409ffb700 1 -- 172.21.15.82:0/2631681921 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94100052d0 con 0x7f9418158ff0 2023-11-28T13:04:05.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f9409ffb700 1 -- 172.21.15.82:0/2631681921 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9410005430 con 0x7f9418158ff0 2023-11-28T13:04:05.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f941e4e4700 1 -- 172.21.15.82:0/2631681921 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94180cdc60 con 0x7f9418158ff0 2023-11-28T13:04:05.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f9409ffb700 1 -- 172.21.15.82:0/2631681921 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94100055a0 con 0x7f9418158ff0 2023-11-28T13:04:05.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.723+0000 7f941e4e4700 1 -- 172.21.15.82:0/2631681921 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941815d9b0 con 0x7f9418158ff0 2023-11-28T13:04:05.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.727+0000 7f9409ffb700 1 -- 172.21.15.82:0/2631681921 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9410019030 con 0x7f9418158ff0 2023-11-28T13:04:05.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.727+0000 7f9409ffb700 1 --2- 172.21.15.82:0/2631681921 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93fc064ee0 0x7f93fc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.727+0000 7f941d4e2700 1 --2- 172.21.15.82:0/2631681921 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93fc064ee0 0x7f93fc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.727+0000 7f9409ffb700 1 -- 172.21.15.82:0/2631681921 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f94100810d0 con 0x7f9418158ff0 2023-11-28T13:04:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.727+0000 7f941d4e2700 1 --2- 172.21.15.82:0/2631681921 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93fc064ee0 0x7f93fc067390 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9414014040 tx=0x7f9414011000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:05.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f94229c6740 1 Processor -- start 2023-11-28T13:04:05.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f94229c6740 1 -- start start 2023-11-28T13:04:05.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f94229c6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119cd20 0x1454420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f94229c6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x119c950 0x1456970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f94229c6740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x11e79d0 0x1458ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f94229c6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x130bdc0 con 0x119c950 2023-11-28T13:04:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f94229c6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x137be20 con 0x119cd20 2023-11-28T13:04:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f94229c6740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x1375120 con 0x11e79d0 2023-11-28T13:04:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f941cce1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x119c950 0x1456970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f941cce1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x119c950 0x1456970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43396/0 (socket says 172.21.15.82:43396) 2023-11-28T13:04:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f941cce1700 1 -- 172.21.15.82:0/1016199434 learned_addr learned my addr 172.21.15.82:0/1016199434 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f941d4e2700 1 --2- 172.21.15.82:0/1016199434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119cd20 0x1454420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f941dce3700 1 --2- 172.21.15.82:0/1016199434 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x11e79d0 0x1458ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f941cce1700 1 -- 172.21.15.82:0/1016199434 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x11e79d0 msgr2=0x1458ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f941cce1700 1 --2- 172.21.15.82:0/1016199434 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x11e79d0 0x1458ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f941cce1700 1 -- 172.21.15.82:0/1016199434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119cd20 msgr2=0x1454420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:05.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f941cce1700 1 --2- 172.21.15.82:0/1016199434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119cd20 0x1454420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f941cce1700 1 -- 172.21.15.82:0/1016199434 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x139b9b0 con 0x119c950 2023-11-28T13:04:05.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f941dce3700 1 --2- 172.21.15.82:0/1016199434 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x11e79d0 0x1458ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:04:05.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f941d4e2700 1 --2- 172.21.15.82:0/1016199434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119cd20 0x1454420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:04:05.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f941cce1700 1 --2- 172.21.15.82:0/1016199434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x119c950 0x1456970 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f940c006de0 tx=0x7f940c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd471fa8bbc8122 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:05.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f9402ffd700 1 -- 172.21.15.82:0/1016199434 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c007310 con 0x119c950 2023-11-28T13:04:05.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f9402ffd700 1 -- 172.21.15.82:0/1016199434 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c007470 con 0x119c950 2023-11-28T13:04:05.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f9402ffd700 1 -- 172.21.15.82:0/1016199434 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c0077e0 con 0x119c950 2023-11-28T13:04:05.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f94229c6740 1 -- 172.21.15.82:0/1016199434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x119c950 msgr2=0x1456970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f94229c6740 1 --2- 172.21.15.82:0/1016199434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x119c950 0x1456970 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f940c006de0 tx=0x7f940c001a20 comp rx=0 tx=0).stop 2023-11-28T13:04:05.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f94229c6740 1 -- 172.21.15.82:0/1016199434 shutdown_connections 2023-11-28T13:04:05.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f94229c6740 1 --2- 172.21.15.82:0/1016199434 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x11e79d0 0x1458ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f94229c6740 1 --2- 172.21.15.82:0/1016199434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x119c950 0x1456970 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f94229c6740 1 --2- 172.21.15.82:0/1016199434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119cd20 0x1454420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f94229c6740 1 -- 172.21.15.82:0/1016199434 >> 172.21.15.82:0/1016199434 conn(0x119d0f0 msgr2=0x1435e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:05.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f94229c6740 1 -- 172.21.15.82:0/1016199434 shutdown_connections 2023-11-28T13:04:05.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.731+0000 7f94229c6740 1 -- 172.21.15.82:0/1016199434 wait complete. 2023-11-28T13:04:05.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f94229c6740 1 -- start start 2023-11-28T13:04:05.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f94229c6740 1 Processor -- start 2023-11-28T13:04:05.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f94229c6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119c950 0x144ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f94229c6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x119cd20 0x140e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f94229c6740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x11e79d0 0x1425720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f94229c6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1221d60 con 0x119cd20 2023-11-28T13:04:05.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f94229c6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x140fa40 con 0x119c950 2023-11-28T13:04:05.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f94229c6740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x140f340 con 0x11e79d0 2023-11-28T13:04:05.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f94229c6740 10 client.0 _ll_register_callbacks cb 0x136ea60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:04:05.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f941cce1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x119cd20 0x140e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f941cce1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x119cd20 0x140e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43406/0 (socket says 172.21.15.82:43406) 2023-11-28T13:04:05.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f941cce1700 1 -- 172.21.15.82:0/3071592818 learned_addr learned my addr 172.21.15.82:0/3071592818 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:05.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f941d4e2700 1 --2- 172.21.15.82:0/3071592818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119c950 0x144ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f941dce3700 1 --2- 172.21.15.82:0/3071592818 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x11e79d0 0x1425720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f941cce1700 1 -- 172.21.15.82:0/3071592818 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x11e79d0 msgr2=0x1425720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:05.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f941cce1700 1 --2- 172.21.15.82:0/3071592818 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x11e79d0 0x1425720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f941cce1700 1 -- 172.21.15.82:0/3071592818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119c950 msgr2=0x144ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:05.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f941cce1700 1 --2- 172.21.15.82:0/3071592818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119c950 0x144ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f941cce1700 1 -- 172.21.15.82:0/3071592818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94040035d0 con 0x119cd20 2023-11-28T13:04:05.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f941cce1700 1 --2- 172.21.15.82:0/3071592818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x119cd20 0x140e4d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f940c007010 tx=0x7f940c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553ace403a8bfe2b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:05.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f93f7fff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-11-28T13:04:05.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f93f7fff700 1 -- 172.21.15.82:0/3071592818 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c007310 con 0x119cd20 2023-11-28T13:04:05.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f93f7fff700 1 -- 172.21.15.82:0/3071592818 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f940c0062c0 con 0x119cd20 2023-11-28T13:04:05.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f94229c6740 1 -- 172.21.15.82:0/3071592818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x136e1a0 con 0x119cd20 2023-11-28T13:04:05.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f93f7fff700 1 -- 172.21.15.82:0/3071592818 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f940c006480 con 0x119cd20 2023-11-28T13:04:05.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f94229c6740 10 client.6576 fetch_fsmap learned FSMap version 31 2023-11-28T13:04:05.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f94229c6740 1 -- 172.21.15.82:0/3071592818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x11e8c20 con 0x119cd20 2023-11-28T13:04:05.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f93f7fff700 1 -- 172.21.15.82:0/3071592818 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x136e1a0 con 0x119cd20 2023-11-28T13:04:05.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f93f7fff700 1 -- 172.21.15.82:0/3071592818 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f940c012070 con 0x119cd20 2023-11-28T13:04:05.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f94229c6740 10 client.6576 fetch_fsmap finished waiting for FSMap version 31 2023-11-28T13:04:05.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f94229c6740 10 client.6576 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T13:04:05.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f94229c6740 20 client.6576 populate_metadata read hostname 'smithi082' 2023-11-28T13:04:05.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f94229c6740 1 --2- 172.21.15.82:0/3071592818 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x1404e70 0x140d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f94229c6740 4 client.6576 mds_command: new command op to 6309 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T13:04:05.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f94229c6740 1 -- 172.21.15.82:0/3071592818 --> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x136dec0 con 0x1404e70 2023-11-28T13:04:05.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f941d4e2700 1 --2- 172.21.15.82:0/3071592818 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x1404e70 0x140d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f941d4e2700 1 --2- 172.21.15.82:0/3071592818 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x1404e70 0x140d160 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7b191efb7056d1d server_cookie=dc86595afe92d7ff in_seq=0 out_seq=0 2023-11-28T13:04:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.735+0000 7f93f7fff700 10 client.6576 ms_handle_connect on v2:172.21.15.82:6836/2902091405 2023-11-28T13:04:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.739+0000 7f93f7fff700 1 -- 172.21.15.82:0/3071592818 <== mds.0 v2:172.21.15.82:6836/2902091405 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x136dec0 con 0x1404e70 2023-11-28T13:04:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.739+0000 7f93f7fff700 10 client.6576 handle_command_reply: tid=0 2023-11-28T13:04:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.739+0000 7f94229c6740 1 client.6576 shutdown 2023-11-28T13:04:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.739+0000 7f94229c6740 1 -- 172.21.15.82:0/3071592818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x119cd20 msgr2=0x140e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.739+0000 7f94229c6740 1 --2- 172.21.15.82:0/3071592818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x119cd20 0x140e4d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f940c007010 tx=0x7f940c000ed0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.739+0000 7f94229c6740 1 -- 172.21.15.82:0/3071592818 shutdown_connections 2023-11-28T13:04:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.739+0000 7f94229c6740 1 --2- 172.21.15.82:0/3071592818 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x1404e70 0x140d160 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.739+0000 7f94229c6740 1 --2- 172.21.15.82:0/3071592818 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x11e79d0 0x1425720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.739+0000 7f94229c6740 1 --2- 172.21.15.82:0/3071592818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x119cd20 0x140e4d0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.739+0000 7f93f7fff700 0 client.6576 ms_handle_reset on v2:172.21.15.82:6836/2902091405 2023-11-28T13:04:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.739+0000 7f94229c6740 1 --2- 172.21.15.82:0/3071592818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119c950 0x144ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.739+0000 7f94229c6740 1 -- 172.21.15.82:0/3071592818 >> 172.21.15.82:0/3071592818 conn(0x119d0f0 msgr2=0x1434fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.739+0000 7f94229c6740 1 -- 172.21.15.82:0/3071592818 shutdown_connections 2023-11-28T13:04:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.739+0000 7f94229c6740 1 -- 172.21.15.82:0/3071592818 wait complete. 2023-11-28T13:04:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.739+0000 7f94229c6740 20 client.6576 trim_cache size 0 max 16384 2023-11-28T13:04:05.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.755+0000 7f94229c6740 1 Processor -- start 2023-11-28T13:04:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.755+0000 7f94229c6740 1 -- start start 2023-11-28T13:04:05.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.755+0000 7f94229c6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119c950 0x14341c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.755+0000 7f94229c6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x119cd20 0x1434700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.755+0000 7f94229c6740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x11e79d0 0x144da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.755+0000 7f94229c6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x1434d60 con 0x119cd20 2023-11-28T13:04:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.755+0000 7f94229c6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1372930 con 0x119c950 2023-11-28T13:04:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.755+0000 7f94229c6740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x1379120 con 0x11e79d0 2023-11-28T13:04:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.755+0000 7f941cce1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x119cd20 0x1434700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.755+0000 7f941cce1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x119cd20 0x1434700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43414/0 (socket says 172.21.15.82:43414) 2023-11-28T13:04:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.755+0000 7f941cce1700 1 -- 172.21.15.82:0/1238333749 learned_addr learned my addr 172.21.15.82:0/1238333749 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f941d4e2700 1 --2- 172.21.15.82:0/1238333749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119c950 0x14341c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f941dce3700 1 --2- 172.21.15.82:0/1238333749 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x11e79d0 0x144da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f941cce1700 1 -- 172.21.15.82:0/1238333749 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x11e79d0 msgr2=0x144da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f941cce1700 1 --2- 172.21.15.82:0/1238333749 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x11e79d0 0x144da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f941cce1700 1 -- 172.21.15.82:0/1238333749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119c950 msgr2=0x14341c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f941cce1700 1 --2- 172.21.15.82:0/1238333749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119c950 0x14341c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f941cce1700 1 -- 172.21.15.82:0/1238333749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94181581c0 con 0x119cd20 2023-11-28T13:04:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f941d4e2700 1 --2- 172.21.15.82:0/1238333749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119c950 0x14341c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:04:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f941cce1700 1 --2- 172.21.15.82:0/1238333749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x119cd20 0x1434700 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f940c001200 tx=0x7f940c020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ce327ce572f664 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f94037fe700 1 -- 172.21.15.82:0/1238333749 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c007310 con 0x119cd20 2023-11-28T13:04:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f94037fe700 1 -- 172.21.15.82:0/1238333749 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c022070 con 0x119cd20 2023-11-28T13:04:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f94037fe700 1 -- 172.21.15.82:0/1238333749 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c0067d0 con 0x119cd20 2023-11-28T13:04:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f94229c6740 1 -- 172.21.15.82:0/1238333749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x119cd20 msgr2=0x1434700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f94229c6740 1 --2- 172.21.15.82:0/1238333749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x119cd20 0x1434700 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f940c001200 tx=0x7f940c020070 comp rx=0 tx=0).stop 2023-11-28T13:04:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f94229c6740 1 -- 172.21.15.82:0/1238333749 shutdown_connections 2023-11-28T13:04:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f94229c6740 1 --2- 172.21.15.82:0/1238333749 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x11e79d0 0x144da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f94229c6740 1 --2- 172.21.15.82:0/1238333749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x119cd20 0x1434700 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f94229c6740 1 --2- 172.21.15.82:0/1238333749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119c950 0x14341c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f94229c6740 1 -- 172.21.15.82:0/1238333749 >> 172.21.15.82:0/1238333749 conn(0x119d0f0 msgr2=0x1433ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f94229c6740 1 -- 172.21.15.82:0/1238333749 shutdown_connections 2023-11-28T13:04:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f94229c6740 1 -- 172.21.15.82:0/1238333749 wait complete. 2023-11-28T13:04:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f94229c6740 1 -- start start 2023-11-28T13:04:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.759+0000 7f94229c6740 1 Processor -- start 2023-11-28T13:04:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f94229c6740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x119c950 0x146a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f94229c6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119cd20 0x14b8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f94229c6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x11e79d0 0x1467f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f94229c6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x133ff50 con 0x11e79d0 2023-11-28T13:04:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f94229c6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x146a320 con 0x119cd20 2023-11-28T13:04:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f94229c6740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x1434d20 con 0x119c950 2023-11-28T13:04:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f94229c6740 10 client.0 _ll_register_callbacks cb 0x7f940c006a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T13:04:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f941dce3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x11e79d0 0x1467f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f941dce3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x11e79d0 0x1467f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43416/0 (socket says 172.21.15.82:43416) 2023-11-28T13:04:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f941dce3700 1 -- 172.21.15.82:0/4003975688 learned_addr learned my addr 172.21.15.82:0/4003975688 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f941d4e2700 1 --2- 172.21.15.82:0/4003975688 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x119c950 0x146a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f941cce1700 1 --2- 172.21.15.82:0/4003975688 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119cd20 0x14b8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f941dce3700 1 -- 172.21.15.82:0/4003975688 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x119c950 msgr2=0x146a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f941dce3700 1 --2- 172.21.15.82:0/4003975688 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x119c950 0x146a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f941dce3700 1 -- 172.21.15.82:0/4003975688 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119cd20 msgr2=0x14b8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f941dce3700 1 --2- 172.21.15.82:0/4003975688 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119cd20 0x14b8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f941dce3700 1 -- 172.21.15.82:0/4003975688 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9414023070 con 0x11e79d0 2023-11-28T13:04:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f941dce3700 1 --2- 172.21.15.82:0/4003975688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x11e79d0 0x1467f60 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f941000cac0 tx=0x7f9410005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a12deb6f16cc4c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f93f7fff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-11-28T13:04:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f93f7fff700 1 -- 172.21.15.82:0/4003975688 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941005ac50 con 0x11e79d0 2023-11-28T13:04:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f93f7fff700 1 -- 172.21.15.82:0/4003975688 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f941007f270 con 0x11e79d0 2023-11-28T13:04:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f94229c6740 1 -- 172.21.15.82:0/4003975688 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f940c007470 con 0x11e79d0 2023-11-28T13:04:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f93f7fff700 1 -- 172.21.15.82:0/4003975688 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f941004ec30 con 0x11e79d0 2023-11-28T13:04:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f94229c6740 10 client.6582 fetch_fsmap learned FSMap version 31 2023-11-28T13:04:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f94229c6740 1 -- 172.21.15.82:0/4003975688 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x11e8c20 con 0x11e79d0 2023-11-28T13:04:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f93f7fff700 1 -- 172.21.15.82:0/4003975688 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c007470 con 0x11e79d0 2023-11-28T13:04:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f93f7fff700 1 -- 172.21.15.82:0/4003975688 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f941004ed90 con 0x11e79d0 2023-11-28T13:04:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f94229c6740 10 client.6582 fetch_fsmap finished waiting for FSMap version 31 2023-11-28T13:04:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f94229c6740 10 client.6582 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T13:04:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f94229c6740 20 client.6582 populate_metadata read hostname 'smithi082' 2023-11-28T13:04:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f94229c6740 1 --2- 172.21.15.82:0/4003975688 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x14687a0 0x144dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f94229c6740 4 client.6582 mds_command: new command op to 6309 tid=0[{"prefix": "damage ls", "format": "json-pretty"}] 2023-11-28T13:04:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f94229c6740 1 -- 172.21.15.82:0/4003975688 --> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x12194a0 con 0x14687a0 2023-11-28T13:04:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f941d4e2700 1 --2- 172.21.15.82:0/4003975688 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x14687a0 0x144dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f93f7fff700 10 client.6582 ms_handle_connect on v2:172.21.15.82:6836/2902091405 2023-11-28T13:04:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.763+0000 7f941d4e2700 1 --2- 172.21.15.82:0/4003975688 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x14687a0 0x144dac0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42de2efe0646da9c server_cookie=bc2f7741afc20d4d in_seq=0 out_seq=0 2023-11-28T13:04:05.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f93f7fff700 1 -- 172.21.15.82:0/4003975688 <== mds.0 v2:172.21.15.82:6836/2902091405 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+141 (crc 0 0 0) 0x12194a0 con 0x14687a0 2023-11-28T13:04:05.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f93f7fff700 10 client.6582 handle_command_reply: tid=0 2023-11-28T13:04:05.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f94229c6740 1 client.6582 shutdown 2023-11-28T13:04:05.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f94229c6740 1 -- 172.21.15.82:0/4003975688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x11e79d0 msgr2=0x1467f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f94229c6740 1 --2- 172.21.15.82:0/4003975688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x11e79d0 0x1467f60 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f941000cac0 tx=0x7f9410005040 comp rx=0 tx=0).stop 2023-11-28T13:04:05.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f94229c6740 1 -- 172.21.15.82:0/4003975688 shutdown_connections 2023-11-28T13:04:05.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f94229c6740 1 --2- 172.21.15.82:0/4003975688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x11e79d0 0x1467f60 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f94229c6740 1 --2- 172.21.15.82:0/4003975688 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x119cd20 0x14b8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f94229c6740 1 --2- 172.21.15.82:0/4003975688 >> [v2:172.21.15.82:6836/2902091405,v1:172.21.15.82:6837/2902091405] conn(0x14687a0 0x144dac0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f94229c6740 1 --2- 172.21.15.82:0/4003975688 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x119c950 0x146a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f94229c6740 1 -- 172.21.15.82:0/4003975688 >> 172.21.15.82:0/4003975688 conn(0x119d0f0 msgr2=0x1431240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:05.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f93f7fff700 0 client.6582 ms_handle_reset on v2:172.21.15.82:6836/2902091405 2023-11-28T13:04:05.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f94229c6740 1 -- 172.21.15.82:0/4003975688 shutdown_connections 2023-11-28T13:04:05.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f94229c6740 1 -- 172.21.15.82:0/4003975688 wait complete. 2023-11-28T13:04:05.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f94229c6740 20 client.6582 trim_cache size 0 max 16384 2023-11-28T13:04:05.775 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:04:05.776 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-11-28T13:04:05.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-11-28T13:04:05.776 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2023-11-28T13:04:05.776 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1762765061, 2023-11-28T13:04:05.776 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511627777, 2023-11-28T13:04:05.776 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/dir_test/file" 2023-11-28T13:04:05.776 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-11-28T13:04:05.776 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-11-28T13:04:05.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f941e4e4700 1 -- 172.21.15.82:0/2631681921 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93fc064ee0 msgr2=0x7f93fc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f941e4e4700 1 --2- 172.21.15.82:0/2631681921 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93fc064ee0 0x7f93fc067390 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9414014040 tx=0x7f9414011000 comp rx=0 tx=0).stop 2023-11-28T13:04:05.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f941e4e4700 1 -- 172.21.15.82:0/2631681921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9418158ff0 msgr2=0x7f9418157920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f941e4e4700 1 --2- 172.21.15.82:0/2631681921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9418158ff0 0x7f9418157920 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f941000c460 tx=0x7f941000c770 comp rx=0 tx=0).stop 2023-11-28T13:04:05.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f941e4e4700 1 -- 172.21.15.82:0/2631681921 shutdown_connections 2023-11-28T13:04:05.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f941e4e4700 1 --2- 172.21.15.82:0/2631681921 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93fc064ee0 0x7f93fc067390 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f941e4e4700 1 --2- 172.21.15.82:0/2631681921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9418158ff0 0x7f9418157920 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f941e4e4700 1 --2- 172.21.15.82:0/2631681921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f941806d3d0 0x7f94180c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f941e4e4700 1 --2- 172.21.15.82:0/2631681921 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f941806caa0 0x7f9418151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f941e4e4700 1 -- 172.21.15.82:0/2631681921 >> 172.21.15.82:0/2631681921 conn(0x7f94180cf710 msgr2=0x7f9418071090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:05.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f941e4e4700 1 -- 172.21.15.82:0/2631681921 shutdown_connections 2023-11-28T13:04:05.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.767+0000 7f941e4e4700 1 -- 172.21.15.82:0/2631681921 wait complete. 2023-11-28T13:04:05.785 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:04:05.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.891+0000 7f96137f1700 1 Processor -- start 2023-11-28T13:04:05.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.891+0000 7f96137f1700 1 -- start start 2023-11-28T13:04:05.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.891+0000 7f96137f1700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f960c0703e0 0x7f960c0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.891+0000 7f96137f1700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f960c160b20 0x7f960c0ad710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.891+0000 7f96137f1700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960c070cf0 con 0x7f960c0adc50 2023-11-28T13:04:05.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.891+0000 7f96137f1700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960c0ae0f0 con 0x7f960c0703e0 2023-11-28T13:04:05.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.891+0000 7f96137f1700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0ce680 con 0x7f960c160b20 2023-11-28T13:04:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.891+0000 7f961158d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f960c0703e0 0x7f960c0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.891+0000 7f961158d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f960c0703e0 0x7f960c0707b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43432/0 (socket says 172.21.15.82:43432) 2023-11-28T13:04:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.891+0000 7f9611d8e700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f960c0adc50 0x7f960c0ca010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:60196/0 (socket says 172.21.15.82:60196) 2023-11-28T13:04:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.891+0000 7f961158d700 1 -- 172.21.15.82:0/3749707579 learned_addr learned my addr 172.21.15.82:0/3749707579 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.891+0000 7f9610d8c700 1 --2- 172.21.15.82:0/3749707579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f960c160b20 0x7f960c0ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.891+0000 7f961158d700 1 -- 172.21.15.82:0/3749707579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f960c160b20 msgr2=0x7f960c0ad710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.895+0000 7f961158d700 1 --2- 172.21.15.82:0/3749707579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f960c160b20 0x7f960c0ad710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.895+0000 7f961158d700 1 -- 172.21.15.82:0/3749707579 >> v1:172.21.15.114:6789/0 conn(0x7f960c0adc50 legacy=0x7f960c0ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.895+0000 7f9603fff700 1 -- 172.21.15.82:0/3749707579 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1580630159 0 0) 0x7f960c070cf0 con 0x7f960c0adc50 2023-11-28T13:04:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.895+0000 7f961158d700 1 -- 172.21.15.82:0/3749707579 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c069c60 con 0x7f960c0703e0 2023-11-28T13:04:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.895+0000 7f961158d700 1 --2- 172.21.15.82:0/3749707579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f960c0703e0 0x7f960c0707b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f9608009910 tx=0x7f9608009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1babe194741e9076 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.895+0000 7f9603fff700 1 -- 172.21.15.82:0/3749707579 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608011830 con 0x7f960c0703e0 2023-11-28T13:04:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.895+0000 7f9603fff700 1 -- 172.21.15.82:0/3749707579 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9608011990 con 0x7f960c0703e0 2023-11-28T13:04:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.895+0000 7f9603fff700 1 -- 172.21.15.82:0/3749707579 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608011d40 con 0x7f960c0703e0 2023-11-28T13:04:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.895+0000 7f96137f1700 1 -- 172.21.15.82:0/3749707579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f960c0703e0 msgr2=0x7f960c0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.895+0000 7f96137f1700 1 --2- 172.21.15.82:0/3749707579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f960c0703e0 0x7f960c0707b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f9608009910 tx=0x7f9608009c20 comp rx=0 tx=0).stop 2023-11-28T13:04:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.895+0000 7f96137f1700 1 -- 172.21.15.82:0/3749707579 shutdown_connections 2023-11-28T13:04:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.895+0000 7f96137f1700 1 --2- 172.21.15.82:0/3749707579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f960c160b20 0x7f960c0ad710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.895+0000 7f96137f1700 1 --2- 172.21.15.82:0/3749707579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f960c0703e0 0x7f960c0707b0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.895+0000 7f96137f1700 1 -- 172.21.15.82:0/3749707579 >> 172.21.15.82:0/3749707579 conn(0x7f960c0ce9b0 msgr2=0x7f960c0ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:05.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.895+0000 7f96137f1700 1 -- 172.21.15.82:0/3749707579 shutdown_connections 2023-11-28T13:04:05.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.895+0000 7f96137f1700 1 -- 172.21.15.82:0/3749707579 wait complete. 2023-11-28T13:04:05.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.895+0000 7f96137f1700 1 Processor -- start 2023-11-28T13:04:05.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.895+0000 7f96137f1700 1 -- start start 2023-11-28T13:04:05.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f96137f1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f960c0703e0 0x7f960c0b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f96137f1700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f960c0adc50 0x7f960c1e9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f96137f1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f960c160b20 0x7f960c15f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f96137f1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c1ea030 con 0x7f960c0703e0 2023-11-28T13:04:05.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f96137f1700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c1ea2d0 con 0x7f960c160b20 2023-11-28T13:04:05.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f96137f1700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c1ea810 con 0x7f960c0adc50 2023-11-28T13:04:05.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f961158d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f960c0703e0 0x7f960c0b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f9611d8e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f960c160b20 0x7f960c15f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f961158d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f960c0703e0 0x7f960c0b43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43436/0 (socket says 172.21.15.82:43436) 2023-11-28T13:04:05.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f961158d700 1 -- 172.21.15.82:0/4242986837 learned_addr learned my addr 172.21.15.82:0/4242986837 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:05.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f9610d8c700 1 --2- 172.21.15.82:0/4242986837 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f960c0adc50 0x7f960c1e9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f9611d8e700 1 -- 172.21.15.82:0/4242986837 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f960c0adc50 msgr2=0x7f960c1e9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f9611d8e700 1 --2- 172.21.15.82:0/4242986837 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f960c0adc50 0x7f960c1e9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f9611d8e700 1 -- 172.21.15.82:0/4242986837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f960c0703e0 msgr2=0x7f960c0b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:05.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f9611d8e700 1 --2- 172.21.15.82:0/4242986837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f960c0703e0 0x7f960c0b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:05.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f9611d8e700 1 -- 172.21.15.82:0/4242986837 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9608009570 con 0x7f960c160b20 2023-11-28T13:04:05.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f961158d700 1 --2- 172.21.15.82:0/4242986837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f960c0703e0 0x7f960c0b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:04:05.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f9611d8e700 1 --2- 172.21.15.82:0/4242986837 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f960c160b20 0x7f960c15f8e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f960400cbe0 tx=0x7f960400cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:05.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f9601ffb700 1 -- 172.21.15.82:0/4242986837 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960400aaa0 con 0x7f960c160b20 2023-11-28T13:04:05.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f9601ffb700 1 -- 172.21.15.82:0/4242986837 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960400ac00 con 0x7f960c160b20 2023-11-28T13:04:05.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f96137f1700 1 -- 172.21.15.82:0/4242986837 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960c06a220 con 0x7f960c160b20 2023-11-28T13:04:05.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f9601ffb700 1 -- 172.21.15.82:0/4242986837 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96040070d0 con 0x7f960c160b20 2023-11-28T13:04:05.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f96137f1700 1 -- 172.21.15.82:0/4242986837 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960c069f40 con 0x7f960c160b20 2023-11-28T13:04:05.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.899+0000 7f96137f1700 1 -- 172.21.15.82:0/4242986837 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960c06a500 con 0x7f960c160b20 2023-11-28T13:04:05.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.903+0000 7f9601ffb700 1 -- 172.21.15.82:0/4242986837 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f960401a030 con 0x7f960c160b20 2023-11-28T13:04:05.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.903+0000 7f9601ffb700 1 --2- 172.21.15.82:0/4242986837 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f95f0064ee0 0x7f95f0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:05.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.903+0000 7f9601ffb700 1 -- 172.21.15.82:0/4242986837 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9604081ce0 con 0x7f960c160b20 2023-11-28T13:04:05.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.903+0000 7f961158d700 1 --2- 172.21.15.82:0/4242986837 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f95f0064ee0 0x7f95f0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:05.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.903+0000 7f961158d700 1 --2- 172.21.15.82:0/4242986837 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f95f0064ee0 0x7f95f0067390 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9608009150 tx=0x7f9608008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:05.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:05.911+0000 7f9601ffb700 1 -- 172.21.15.82:0/4242986837 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f960404fec0 con 0x7f960c160b20 2023-11-28T13:04:06.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:06.111+0000 7f96137f1700 1 -- 172.21.15.82:0/4242986837 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f960c0b1fb0 con 0x7f960c160b20 2023-11-28T13:04:06.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:06.111+0000 7f9601ffb700 1 -- 172.21.15.82:0/4242986837 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f96040180c0 con 0x7f960c160b20 2023-11-28T13:04:06.118 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:04:06.118 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:04:06.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:06.115+0000 7f96137f1700 1 -- 172.21.15.82:0/4242986837 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f95f0064ee0 msgr2=0x7f95f0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:06.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:06.115+0000 7f96137f1700 1 --2- 172.21.15.82:0/4242986837 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f95f0064ee0 0x7f95f0067390 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9608009150 tx=0x7f9608008030 comp rx=0 tx=0).stop 2023-11-28T13:04:06.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:06.115+0000 7f96137f1700 1 -- 172.21.15.82:0/4242986837 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f960c160b20 msgr2=0x7f960c15f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:06.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:06.115+0000 7f96137f1700 1 --2- 172.21.15.82:0/4242986837 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f960c160b20 0x7f960c15f8e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f960400cbe0 tx=0x7f960400cef0 comp rx=0 tx=0).stop 2023-11-28T13:04:06.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:06.115+0000 7f96137f1700 1 -- 172.21.15.82:0/4242986837 shutdown_connections 2023-11-28T13:04:06.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:06.115+0000 7f96137f1700 1 --2- 172.21.15.82:0/4242986837 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f95f0064ee0 0x7f95f0067390 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:06.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:06.115+0000 7f96137f1700 1 --2- 172.21.15.82:0/4242986837 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f960c160b20 0x7f960c15f8e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:06.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:06.115+0000 7f96137f1700 1 --2- 172.21.15.82:0/4242986837 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f960c0adc50 0x7f960c1e9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:06.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:06.115+0000 7f96137f1700 1 --2- 172.21.15.82:0/4242986837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f960c0703e0 0x7f960c0b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:06.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:06.115+0000 7f96137f1700 1 -- 172.21.15.82:0/4242986837 >> 172.21.15.82:0/4242986837 conn(0x7f960c0ce9b0 msgr2=0x7f960c06c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:06.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:06.115+0000 7f96137f1700 1 -- 172.21.15.82:0/4242986837 shutdown_connections 2023-11-28T13:04:06.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:06.115+0000 7f96137f1700 1 -- 172.21.15.82:0/4242986837 wait complete. 2023-11-28T13:04:06.132 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:04:11.133 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:04:11.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06b10e7700 1 Processor -- start 2023-11-28T13:04:11.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06b10e7700 1 -- start start 2023-11-28T13:04:11.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06b10e7700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f06ac0ced70 0x7f06ac06bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:11.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06b10e7700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06ac0d06f0 0x7f06ac0d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:11.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06b10e7700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ac0d28e0 con 0x7f06ac06b910 2023-11-28T13:04:11.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06b10e7700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ac0cdfe0 con 0x7f06ac0ced70 2023-11-28T13:04:11.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06b10e7700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac06c220 con 0x7f06ac0d06f0 2023-11-28T13:04:11.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06abfff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f06ac06b910 0x7f06ac160780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39956/0 (socket says 172.21.15.82:39956) 2023-11-28T13:04:11.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06abfff700 1 -- 172.21.15.82:0/2827925762 learned_addr learned my addr 172.21.15.82:0/2827925762 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:04:11.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06b08e6700 1 --2- 172.21.15.82:0/2827925762 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06ac0d06f0 0x7f06ac0d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:11.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06ab7fe700 1 --2- 172.21.15.82:0/2827925762 >> v2:172.21.15.114:3300/0 conn(0x7f06ac0ced70 0x7f06ac06bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:11.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06aaffd700 1 -- 172.21.15.82:0/2827925762 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035747288 0 0) 0x7f069c001490 con 0x7f06ac06b910 2023-11-28T13:04:11.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06aaffd700 1 -- 172.21.15.82:0/2827925762 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06980035d0 con 0x7f06ac06b910 2023-11-28T13:04:11.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06aaffd700 1 -- 172.21.15.82:0/2827925762 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3701422005 0 0) 0x7f06980035d0 con 0x7f06ac06b910 2023-11-28T13:04:11.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06aaffd700 1 -- 172.21.15.82:0/2827925762 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06ac0d06f0 msgr2=0x7f06ac0d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:11.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06aaffd700 1 --2- 172.21.15.82:0/2827925762 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06ac0d06f0 0x7f06ac0d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:11.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06aaffd700 1 -- 172.21.15.82:0/2827925762 >> v2:172.21.15.114:3300/0 conn(0x7f06ac0ced70 msgr2=0x7f06ac06bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:11.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06aaffd700 1 --2- 172.21.15.82:0/2827925762 >> v2:172.21.15.114:3300/0 conn(0x7f06ac0ced70 0x7f06ac06bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:11.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06aaffd700 1 -- 172.21.15.82:0/2827925762 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac0b2040 con 0x7f06ac06b910 2023-11-28T13:04:11.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06aaffd700 1 -- 172.21.15.82:0/2827925762 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f069c001b80 con 0x7f06ac06b910 2023-11-28T13:04:11.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06aaffd700 1 -- 172.21.15.82:0/2827925762 >> v1:172.21.15.82:6789/0 conn(0x7f06ac06b910 legacy=0x7f06ac160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:11.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06aaffd700 1 --2- 172.21.15.82:0/2827925762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0698003a20 0x7f0698003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:11.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06aaffd700 1 --2- 172.21.15.82:0/2827925762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0698004450 0x7f0698004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:11.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06aaffd700 1 --2- 172.21.15.82:0/2827925762 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06ac0d06f0 0x7f0698004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:11.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.247+0000 7f06aaffd700 1 -- 172.21.15.82:0/2827925762 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0cdfe0 con 0x7f0698003a20 2023-11-28T13:04:11.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06aaffd700 1 -- 172.21.15.82:0/2827925762 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac06c220 con 0x7f0698004450 2023-11-28T13:04:11.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06aaffd700 1 -- 172.21.15.82:0/2827925762 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069800ba30 con 0x7f06ac0d06f0 2023-11-28T13:04:11.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06abfff700 1 --2- 172.21.15.82:0/2827925762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0698003a20 0x7f0698003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:11.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06ab7fe700 1 --2- 172.21.15.82:0/2827925762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0698004450 0x7f0698004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:11.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06b08e6700 1 --2- 172.21.15.82:0/2827925762 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06ac0d06f0 0x7f0698004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:11.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06abfff700 1 -- 172.21.15.82:0/2827925762 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06ac0d06f0 msgr2=0x7f0698004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:11.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06abfff700 1 --2- 172.21.15.82:0/2827925762 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06ac0d06f0 0x7f0698004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:11.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06abfff700 1 -- 172.21.15.82:0/2827925762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0698004450 msgr2=0x7f0698004910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:11.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06abfff700 1 --2- 172.21.15.82:0/2827925762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0698004450 0x7f0698004910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:11.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06abfff700 1 -- 172.21.15.82:0/2827925762 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06980035d0 con 0x7f0698003a20 2023-11-28T13:04:11.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06ab7fe700 1 --2- 172.21.15.82:0/2827925762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0698004450 0x7f0698004910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:04:11.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06abfff700 1 --2- 172.21.15.82:0/2827925762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0698003a20 0x7f0698003e30 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f069c00a830 tx=0x7f06980058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f08022d116e4b23 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06aaffd700 1 -- 172.21.15.82:0/2827925762 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c00a4c0 con 0x7f0698003a20 2023-11-28T13:04:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06aaffd700 1 -- 172.21.15.82:0/2827925762 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069c0072d0 con 0x7f0698003a20 2023-11-28T13:04:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06aaffd700 1 -- 172.21.15.82:0/2827925762 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c007680 con 0x7f0698003a20 2023-11-28T13:04:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06b10e7700 1 -- 172.21.15.82:0/2827925762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0698003a20 msgr2=0x7f0698003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06b10e7700 1 --2- 172.21.15.82:0/2827925762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0698003a20 0x7f0698003e30 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f069c00a830 tx=0x7f06980058a0 comp rx=0 tx=0).stop 2023-11-28T13:04:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06b08e6700 1 -- 172.21.15.82:0/2827925762 reap_dead start 2023-11-28T13:04:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06b10e7700 1 -- 172.21.15.82:0/2827925762 shutdown_connections 2023-11-28T13:04:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06b10e7700 1 -- 172.21.15.82:0/2827925762 >> 172.21.15.82:0/2827925762 conn(0x7f06ac0d2b20 msgr2=0x7f06ac0d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06b10e7700 1 -- 172.21.15.82:0/2827925762 shutdown_connections 2023-11-28T13:04:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.251+0000 7f06b10e7700 1 -- 172.21.15.82:0/2827925762 wait complete. 2023-11-28T13:04:11.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.255+0000 7f06b10e7700 1 Processor -- start 2023-11-28T13:04:11.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.255+0000 7f06b10e7700 1 -- start start 2023-11-28T13:04:11.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.255+0000 7f06b10e7700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06ac0b7230 0x7f06ac1e5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:11.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.255+0000 7f06b10e7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06ac0b7600 0x7f06ac1f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:11.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.255+0000 7f06b10e7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06ac1f5a20 0x7f06ac1f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:11.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.255+0000 7f06b10e7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac1e55a0 con 0x7f06ac1f5a20 2023-11-28T13:04:11.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.255+0000 7f06b10e7700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac1e63a0 con 0x7f06ac0b7600 2023-11-28T13:04:11.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.255+0000 7f06b10e7700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac1e5790 con 0x7f06ac0b7230 2023-11-28T13:04:11.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.259+0000 7f06b08e6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06ac1f5a20 0x7f06ac1f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:11.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.259+0000 7f06abfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06ac0b7230 0x7f06ac1e5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:11.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.259+0000 7f06ab7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06ac0b7600 0x7f06ac1f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:11.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.259+0000 7f06b08e6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06ac1f5a20 0x7f06ac1f5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37448/0 (socket says 172.21.15.82:37448) 2023-11-28T13:04:11.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.259+0000 7f06b08e6700 1 -- 172.21.15.82:0/2588931174 learned_addr learned my addr 172.21.15.82:0/2588931174 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:11.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.259+0000 7f06b08e6700 1 -- 172.21.15.82:0/2588931174 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06ac0b7230 msgr2=0x7f06ac1e5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:11.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.259+0000 7f06b08e6700 1 --2- 172.21.15.82:0/2588931174 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06ac0b7230 0x7f06ac1e5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:11.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.259+0000 7f06b08e6700 1 -- 172.21.15.82:0/2588931174 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06ac0b7600 msgr2=0x7f06ac1f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:11.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.259+0000 7f06b08e6700 1 --2- 172.21.15.82:0/2588931174 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06ac0b7600 0x7f06ac1f54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:11.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.259+0000 7f06b08e6700 1 -- 172.21.15.82:0/2588931174 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac0d2320 con 0x7f06ac1f5a20 2023-11-28T13:04:11.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.259+0000 7f06b08e6700 1 --2- 172.21.15.82:0/2588931174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06ac1f5a20 0x7f06ac1f5e90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f06ac08bad0 tx=0x7f06a4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:11.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.259+0000 7f06a8ff9700 1 -- 172.21.15.82:0/2588931174 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a4004300 con 0x7f06ac1f5a20 2023-11-28T13:04:11.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.259+0000 7f06a8ff9700 1 -- 172.21.15.82:0/2588931174 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a4004460 con 0x7f06ac1f5a20 2023-11-28T13:04:11.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.259+0000 7f06b10e7700 1 -- 172.21.15.82:0/2588931174 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ac0cf2c0 con 0x7f06ac1f5a20 2023-11-28T13:04:11.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.259+0000 7f06a8ff9700 1 -- 172.21.15.82:0/2588931174 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a4003900 con 0x7f06ac1f5a20 2023-11-28T13:04:11.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.259+0000 7f06b10e7700 1 -- 172.21.15.82:0/2588931174 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ac0d2600 con 0x7f06ac1f5a20 2023-11-28T13:04:11.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.259+0000 7f06a8ff9700 1 -- 172.21.15.82:0/2588931174 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f06a4003a60 con 0x7f06ac1f5a20 2023-11-28T13:04:11.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.263+0000 7f06b10e7700 1 -- 172.21.15.82:0/2588931174 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ac065fc0 con 0x7f06ac1f5a20 2023-11-28T13:04:11.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.263+0000 7f06a8ff9700 1 --2- 172.21.15.82:0/2588931174 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f068c064f10 0x7f068c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:11.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.263+0000 7f06a8ff9700 1 -- 172.21.15.82:0/2588931174 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f06a4081eb0 con 0x7f06ac1f5a20 2023-11-28T13:04:11.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.263+0000 7f06abfff700 1 --2- 172.21.15.82:0/2588931174 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f068c064f10 0x7f068c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:11.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.263+0000 7f06abfff700 1 --2- 172.21.15.82:0/2588931174 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f068c064f10 0x7f068c0673c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f06ac06aeb0 tx=0x7f069c009070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:11.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.275+0000 7f06a8ff9700 1 -- 172.21.15.82:0/2588931174 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f06a404ffd0 con 0x7f06ac1f5a20 2023-11-28T13:04:11.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.471+0000 7f06b10e7700 1 -- 172.21.15.82:0/2588931174 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f06ac0c9420 con 0x7f06ac1f5a20 2023-11-28T13:04:11.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.471+0000 7f06a8ff9700 1 -- 172.21.15.82:0/2588931174 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f06a40535f0 con 0x7f06ac1f5a20 2023-11-28T13:04:11.475 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:04:11.476 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:04:11.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.471+0000 7f06b10e7700 1 -- 172.21.15.82:0/2588931174 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f068c064f10 msgr2=0x7f068c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:11.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.471+0000 7f06b10e7700 1 --2- 172.21.15.82:0/2588931174 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f068c064f10 0x7f068c0673c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f06ac06aeb0 tx=0x7f069c009070 comp rx=0 tx=0).stop 2023-11-28T13:04:11.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.471+0000 7f06b10e7700 1 -- 172.21.15.82:0/2588931174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06ac1f5a20 msgr2=0x7f06ac1f5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:11.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.471+0000 7f06b10e7700 1 --2- 172.21.15.82:0/2588931174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06ac1f5a20 0x7f06ac1f5e90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f06ac08bad0 tx=0x7f06a4011ad0 comp rx=0 tx=0).stop 2023-11-28T13:04:11.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.471+0000 7f06b10e7700 1 -- 172.21.15.82:0/2588931174 shutdown_connections 2023-11-28T13:04:11.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.471+0000 7f06b10e7700 1 --2- 172.21.15.82:0/2588931174 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f068c064f10 0x7f068c0673c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:11.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.471+0000 7f06b10e7700 1 --2- 172.21.15.82:0/2588931174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06ac1f5a20 0x7f06ac1f5e90 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:11.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.471+0000 7f06b10e7700 1 --2- 172.21.15.82:0/2588931174 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06ac0b7600 0x7f06ac1f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:11.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.471+0000 7f06b10e7700 1 --2- 172.21.15.82:0/2588931174 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06ac0b7230 0x7f06ac1e5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:11.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.471+0000 7f06b10e7700 1 -- 172.21.15.82:0/2588931174 >> 172.21.15.82:0/2588931174 conn(0x7f06ac0d2b20 msgr2=0x7f06ac0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:11.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.471+0000 7f06b10e7700 1 -- 172.21.15.82:0/2588931174 shutdown_connections 2023-11-28T13:04:11.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:11.471+0000 7f06b10e7700 1 -- 172.21.15.82:0/2588931174 wait complete. 2023-11-28T13:04:11.489 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:04:16.490 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:04:16.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.603+0000 7ffb41ebc700 1 Processor -- start 2023-11-28T13:04:16.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.603+0000 7ffb41ebc700 1 -- start start 2023-11-28T13:04:16.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb41ebc700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb3c070070 0x7ffb3c0704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:16.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb41ebc700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb3c06c480 con 0x7ffb3c0b3910 2023-11-28T13:04:16.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb41ebc700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb3c0709f0 con 0x7ffb3c06b0a0 2023-11-28T13:04:16.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb41ebc700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3c06dbe0 con 0x7ffb3c070070 2023-11-28T13:04:16.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb40eba700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ffb3c0b3910 0x7ffb3c06c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:59632/0 (socket says 172.21.15.82:59632) 2023-11-28T13:04:16.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb40eba700 1 -- 172.21.15.82:0/3819081307 learned_addr learned my addr 172.21.15.82:0/3819081307 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:04:16.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb416bb700 1 --2- 172.21.15.82:0/3819081307 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb3c070070 0x7ffb3c0704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:16.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb337fe700 1 -- 172.21.15.82:0/3819081307 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748488319 0 0) 0x7ffb3c06c480 con 0x7ffb3c0b3910 2023-11-28T13:04:16.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb337fe700 1 -- 172.21.15.82:0/3819081307 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb240035d0 con 0x7ffb3c0b3910 2023-11-28T13:04:16.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb337fe700 1 -- 172.21.15.82:0/3819081307 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404736280 0 0) 0x7ffb3c0709f0 con 0x7ffb3c06b0a0 2023-11-28T13:04:16.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb337fe700 1 -- 172.21.15.82:0/3819081307 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb3c06c480 con 0x7ffb3c06b0a0 2023-11-28T13:04:16.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb416bb700 1 -- 172.21.15.82:0/3819081307 >> v1:172.21.15.114:6789/0 conn(0x7ffb3c06b0a0 legacy=0x7ffb3c06d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:16.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb416bb700 1 -- 172.21.15.82:0/3819081307 >> v1:172.21.15.82:6789/0 conn(0x7ffb3c0b3910 legacy=0x7ffb3c06c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:16.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb416bb700 1 -- 172.21.15.82:0/3819081307 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3c06dec0 con 0x7ffb3c070070 2023-11-28T13:04:16.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb416bb700 1 --2- 172.21.15.82:0/3819081307 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb3c070070 0x7ffb3c0704b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffb34009dc0 tx=0x7ffb3400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74965f032617bfb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:16.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb337fe700 1 -- 172.21.15.82:0/3819081307 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3400e070 con 0x7ffb3c070070 2023-11-28T13:04:16.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb337fe700 1 -- 172.21.15.82:0/3819081307 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3400bb20 con 0x7ffb3c070070 2023-11-28T13:04:16.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb337fe700 1 -- 172.21.15.82:0/3819081307 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb34012430 con 0x7ffb3c070070 2023-11-28T13:04:16.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb41ebc700 1 -- 172.21.15.82:0/3819081307 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb3c070070 msgr2=0x7ffb3c0704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:16.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb41ebc700 1 --2- 172.21.15.82:0/3819081307 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb3c070070 0x7ffb3c0704b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffb34009dc0 tx=0x7ffb3400b330 comp rx=0 tx=0).stop 2023-11-28T13:04:16.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb41ebc700 1 -- 172.21.15.82:0/3819081307 shutdown_connections 2023-11-28T13:04:16.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb41ebc700 1 --2- 172.21.15.82:0/3819081307 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb3c070070 0x7ffb3c0704b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:16.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb41ebc700 1 -- 172.21.15.82:0/3819081307 >> 172.21.15.82:0/3819081307 conn(0x7ffb3c0ce600 msgr2=0x7ffb3c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:16.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb41ebc700 1 -- 172.21.15.82:0/3819081307 shutdown_connections 2023-11-28T13:04:16.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.607+0000 7ffb41ebc700 1 -- 172.21.15.82:0/3819081307 wait complete. 2023-11-28T13:04:16.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb41ebc700 1 Processor -- start 2023-11-28T13:04:16.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb41ebc700 1 -- start start 2023-11-28T13:04:16.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb41ebc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb3c06b0a0 0x7ffb3c0c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:16.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb41ebc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb3c070070 0x7ffb3c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:16.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb41ebc700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb3c0b3910 0x7ffb3c0abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:16.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb41ebc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3c0c43d0 con 0x7ffb3c070070 2023-11-28T13:04:16.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb41ebc700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3c0cdc80 con 0x7ffb3c06b0a0 2023-11-28T13:04:16.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb41ebc700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3c0c7a90 con 0x7ffb3c0b3910 2023-11-28T13:04:16.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb33fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb3c070070 0x7ffb3c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:16.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb33fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb3c070070 0x7ffb3c0c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48628/0 (socket says 172.21.15.82:48628) 2023-11-28T13:04:16.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb33fff700 1 -- 172.21.15.82:0/805474845 learned_addr learned my addr 172.21.15.82:0/805474845 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:16.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb416bb700 1 --2- 172.21.15.82:0/805474845 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb3c0b3910 0x7ffb3c0abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:16.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb40eba700 1 --2- 172.21.15.82:0/805474845 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb3c06b0a0 0x7ffb3c0c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:16.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb33fff700 1 -- 172.21.15.82:0/805474845 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb3c0b3910 msgr2=0x7ffb3c0abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:16.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb33fff700 1 --2- 172.21.15.82:0/805474845 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb3c0b3910 0x7ffb3c0abb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:16.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb33fff700 1 -- 172.21.15.82:0/805474845 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb3c06b0a0 msgr2=0x7ffb3c0c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:16.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb33fff700 1 --2- 172.21.15.82:0/805474845 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb3c06b0a0 0x7ffb3c0c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:16.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb33fff700 1 -- 172.21.15.82:0/805474845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb34009a70 con 0x7ffb3c070070 2023-11-28T13:04:16.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb33fff700 1 --2- 172.21.15.82:0/805474845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb3c070070 0x7ffb3c0c7550 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00c760 tx=0x7ffb2c00cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:16.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb317fa700 1 -- 172.21.15.82:0/805474845 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0052d0 con 0x7ffb3c070070 2023-11-28T13:04:16.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb317fa700 1 -- 172.21.15.82:0/805474845 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c005430 con 0x7ffb3c070070 2023-11-28T13:04:16.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb41ebc700 1 -- 172.21.15.82:0/805474845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb3c0c8f80 con 0x7ffb3c070070 2023-11-28T13:04:16.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb317fa700 1 -- 172.21.15.82:0/805474845 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0055a0 con 0x7ffb3c070070 2023-11-28T13:04:16.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.611+0000 7ffb41ebc700 1 -- 172.21.15.82:0/805474845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb3c06c110 con 0x7ffb3c070070 2023-11-28T13:04:16.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.615+0000 7ffb41ebc700 1 -- 172.21.15.82:0/805474845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb3c0b3ce0 con 0x7ffb3c070070 2023-11-28T13:04:16.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.615+0000 7ffb317fa700 1 -- 172.21.15.82:0/805474845 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ffb2c019030 con 0x7ffb3c070070 2023-11-28T13:04:16.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.615+0000 7ffb317fa700 1 --2- 172.21.15.82:0/805474845 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ffb28064ee0 0x7ffb28067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:16.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.615+0000 7ffb40eba700 1 --2- 172.21.15.82:0/805474845 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ffb28064ee0 0x7ffb28067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:16.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.615+0000 7ffb317fa700 1 -- 172.21.15.82:0/805474845 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7ffb2c0812e0 con 0x7ffb3c070070 2023-11-28T13:04:16.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.615+0000 7ffb40eba700 1 --2- 172.21.15.82:0/805474845 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ffb28064ee0 0x7ffb28067390 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ffb380011e0 tx=0x7ffb38009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:16.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.619+0000 7ffb317fa700 1 -- 172.21.15.82:0/805474845 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ffb2c04f400 con 0x7ffb3c070070 2023-11-28T13:04:16.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.819+0000 7ffb41ebc700 1 -- 172.21.15.82:0/805474845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ffb3c0c8ac0 con 0x7ffb3c070070 2023-11-28T13:04:16.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.819+0000 7ffb317fa700 1 -- 172.21.15.82:0/805474845 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7ffb2c052a20 con 0x7ffb3c070070 2023-11-28T13:04:16.825 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:04:16.826 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:04:16.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.823+0000 7ffb41ebc700 1 -- 172.21.15.82:0/805474845 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ffb28064ee0 msgr2=0x7ffb28067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:16.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.823+0000 7ffb41ebc700 1 --2- 172.21.15.82:0/805474845 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ffb28064ee0 0x7ffb28067390 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ffb380011e0 tx=0x7ffb38009040 comp rx=0 tx=0).stop 2023-11-28T13:04:16.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.823+0000 7ffb41ebc700 1 -- 172.21.15.82:0/805474845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb3c070070 msgr2=0x7ffb3c0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:16.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.823+0000 7ffb41ebc700 1 --2- 172.21.15.82:0/805474845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb3c070070 0x7ffb3c0c7550 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00c760 tx=0x7ffb2c00cb20 comp rx=0 tx=0).stop 2023-11-28T13:04:16.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.823+0000 7ffb41ebc700 1 -- 172.21.15.82:0/805474845 shutdown_connections 2023-11-28T13:04:16.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.823+0000 7ffb41ebc700 1 --2- 172.21.15.82:0/805474845 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ffb28064ee0 0x7ffb28067390 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:16.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.823+0000 7ffb41ebc700 1 --2- 172.21.15.82:0/805474845 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb3c0b3910 0x7ffb3c0abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:16.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.823+0000 7ffb41ebc700 1 --2- 172.21.15.82:0/805474845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb3c070070 0x7ffb3c0c7550 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:16.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.823+0000 7ffb41ebc700 1 --2- 172.21.15.82:0/805474845 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb3c06b0a0 0x7ffb3c0c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:16.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.823+0000 7ffb41ebc700 1 -- 172.21.15.82:0/805474845 >> 172.21.15.82:0/805474845 conn(0x7ffb3c0ce600 msgr2=0x7ffb3c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:16.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.823+0000 7ffb41ebc700 1 -- 172.21.15.82:0/805474845 shutdown_connections 2023-11-28T13:04:16.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:16.823+0000 7ffb41ebc700 1 -- 172.21.15.82:0/805474845 wait complete. 2023-11-28T13:04:16.844 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:04:21.845 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:04:21.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.955+0000 7f72a1c5b700 1 Processor -- start 2023-11-28T13:04:21.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.955+0000 7f72a1c5b700 1 -- start start 2023-11-28T13:04:21.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.959+0000 7f72a1c5b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f729c0b2400 0x7f729c0b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:21.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.959+0000 7f72a1c5b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f729c06e320 0x7f729c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:21.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.959+0000 7f72a1c5b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f729c0b3730 con 0x7f729c070c90 2023-11-28T13:04:21.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.959+0000 7f72a1c5b700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729c06df00 con 0x7f729c0b2400 2023-11-28T13:04:21.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.959+0000 7f72a1c5b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729c15cc30 con 0x7f729c06e320 2023-11-28T13:04:21.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.959+0000 7f729b7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f729c070c90 0x7f729c071060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:59640/0 (socket says 172.21.15.82:59640) 2023-11-28T13:04:21.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.959+0000 7f729b7fe700 1 -- 172.21.15.82:0/61804006 learned_addr learned my addr 172.21.15.82:0/61804006 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:04:21.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.959+0000 7f729bfff700 1 --2- 172.21.15.82:0/61804006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f729c06e320 0x7f729c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:21.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.959+0000 7f7292ffd700 1 --2- 172.21.15.82:0/61804006 >> v2:172.21.15.114:3300/0 conn(0x7f729c0b2400 0x7f729c0b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:21.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.959+0000 7f729affd700 1 -- 172.21.15.82:0/61804006 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868229679 0 0) 0x7f729c0b3730 con 0x7f729c070c90 2023-11-28T13:04:21.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.959+0000 7f729affd700 1 -- 172.21.15.82:0/61804006 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72880035d0 con 0x7f729c070c90 2023-11-28T13:04:21.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.959+0000 7f729bfff700 1 -- 172.21.15.82:0/61804006 >> v2:172.21.15.114:3300/0 conn(0x7f729c0b2400 msgr2=0x7f729c0b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:21.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.959+0000 7f729bfff700 1 --2- 172.21.15.82:0/61804006 >> v2:172.21.15.114:3300/0 conn(0x7f729c0b2400 0x7f729c0b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:21.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.959+0000 7f729bfff700 1 -- 172.21.15.82:0/61804006 >> v1:172.21.15.82:6789/0 conn(0x7f729c070c90 legacy=0x7f729c071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:21.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.959+0000 7f729bfff700 1 -- 172.21.15.82:0/61804006 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729c0b3450 con 0x7f729c06e320 2023-11-28T13:04:21.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.959+0000 7f729bfff700 1 --2- 172.21.15.82:0/61804006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f729c06e320 0x7f729c06e7a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7294009d90 tx=0x7f729400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edf857925e9d0e15 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:21.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.959+0000 7f729affd700 1 -- 172.21.15.82:0/61804006 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729400e070 con 0x7f729c06e320 2023-11-28T13:04:21.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.959+0000 7f729affd700 1 -- 172.21.15.82:0/61804006 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729400bb20 con 0x7f729c06e320 2023-11-28T13:04:21.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.959+0000 7f729affd700 1 -- 172.21.15.82:0/61804006 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729400be90 con 0x7f729c06e320 2023-11-28T13:04:21.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f72a1c5b700 1 -- 172.21.15.82:0/61804006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f729c06e320 msgr2=0x7f729c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:21.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f72a1c5b700 1 --2- 172.21.15.82:0/61804006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f729c06e320 0x7f729c06e7a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7294009d90 tx=0x7f729400b330 comp rx=0 tx=0).stop 2023-11-28T13:04:21.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f72a1c5b700 1 -- 172.21.15.82:0/61804006 shutdown_connections 2023-11-28T13:04:21.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f72a1c5b700 1 --2- 172.21.15.82:0/61804006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f729c06e320 0x7f729c06e7a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:21.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f72a1c5b700 1 --2- 172.21.15.82:0/61804006 >> v2:172.21.15.114:3300/0 conn(0x7f729c0b2400 0x7f729c0b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:21.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f72a1c5b700 1 -- 172.21.15.82:0/61804006 >> 172.21.15.82:0/61804006 conn(0x7f729c0cc9b0 msgr2=0x7f729c0cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:21.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f72a1c5b700 1 -- 172.21.15.82:0/61804006 shutdown_connections 2023-11-28T13:04:21.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f72a1c5b700 1 -- 172.21.15.82:0/61804006 wait complete. 2023-11-28T13:04:21.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f72a1c5b700 1 Processor -- start 2023-11-28T13:04:21.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f72a1c5b700 1 -- start start 2023-11-28T13:04:21.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f72a1c5b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f729c06e320 0x7f729c155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:21.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f72a1c5b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f729c070c90 0x7f729c0ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:21.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f72a1c5b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f729c0b2400 0x7f729c0caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:21.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f72a1c5b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c0c45c0 con 0x7f729c070c90 2023-11-28T13:04:21.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f72a1c5b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c0c30d0 con 0x7f729c0b2400 2023-11-28T13:04:21.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f72a1c5b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729c0aded0 con 0x7f729c06e320 2023-11-28T13:04:21.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f7292ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f729c070c90 0x7f729c0ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:21.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f7292ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f729c070c90 0x7f729c0ad990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48634/0 (socket says 172.21.15.82:48634) 2023-11-28T13:04:21.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f7292ffd700 1 -- 172.21.15.82:0/2862470806 learned_addr learned my addr 172.21.15.82:0/2862470806 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:21.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f729b7fe700 1 --2- 172.21.15.82:0/2862470806 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f729c06e320 0x7f729c155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:21.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f729bfff700 1 --2- 172.21.15.82:0/2862470806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f729c0b2400 0x7f729c0caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:21.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f7292ffd700 1 -- 172.21.15.82:0/2862470806 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f729c06e320 msgr2=0x7f729c155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:21.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f7292ffd700 1 --2- 172.21.15.82:0/2862470806 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f729c06e320 0x7f729c155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:21.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f7292ffd700 1 -- 172.21.15.82:0/2862470806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f729c0b2400 msgr2=0x7f729c0caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:21.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f7292ffd700 1 --2- 172.21.15.82:0/2862470806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f729c0b2400 0x7f729c0caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:21.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f7292ffd700 1 -- 172.21.15.82:0/2862470806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7294009a70 con 0x7f729c070c90 2023-11-28T13:04:21.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.963+0000 7f7292ffd700 1 --2- 172.21.15.82:0/2862470806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f729c070c90 0x7f729c0ad990 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f728400e870 tx=0x7f728400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:21.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.967+0000 7f7298ff9700 1 -- 172.21.15.82:0/2862470806 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72840095c0 con 0x7f729c070c90 2023-11-28T13:04:21.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.967+0000 7f7298ff9700 1 -- 172.21.15.82:0/2862470806 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7284013680 con 0x7f729c070c90 2023-11-28T13:04:21.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.967+0000 7f72a1c5b700 1 -- 172.21.15.82:0/2862470806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f729c06db20 con 0x7f729c070c90 2023-11-28T13:04:21.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.967+0000 7f7298ff9700 1 -- 172.21.15.82:0/2862470806 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7284013a10 con 0x7f729c070c90 2023-11-28T13:04:21.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.967+0000 7f72a1c5b700 1 -- 172.21.15.82:0/2862470806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f729c06d840 con 0x7f729c070c90 2023-11-28T13:04:21.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.967+0000 7f72a1c5b700 1 -- 172.21.15.82:0/2862470806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f729c0b3140 con 0x7f729c070c90 2023-11-28T13:04:21.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.967+0000 7f7298ff9700 1 -- 172.21.15.82:0/2862470806 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7284019030 con 0x7f729c070c90 2023-11-28T13:04:21.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.967+0000 7f7298ff9700 1 --2- 172.21.15.82:0/2862470806 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f727c064ee0 0x7f727c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:21.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.967+0000 7f729b7fe700 1 --2- 172.21.15.82:0/2862470806 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f727c064ee0 0x7f727c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:21.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.967+0000 7f7298ff9700 1 -- 172.21.15.82:0/2862470806 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f7284082550 con 0x7f729c070c90 2023-11-28T13:04:21.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.971+0000 7f729b7fe700 1 --2- 172.21.15.82:0/2862470806 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f727c064ee0 0x7f727c067390 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f728c007fd0 tx=0x7f728c007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:21.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:21.971+0000 7f7298ff9700 1 -- 172.21.15.82:0/2862470806 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f72840505a0 con 0x7f729c070c90 2023-11-28T13:04:22.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:22.171+0000 7f72a1c5b700 1 -- 172.21.15.82:0/2862470806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f729c0c4700 con 0x7f729c070c90 2023-11-28T13:04:22.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:22.171+0000 7f7298ff9700 1 -- 172.21.15.82:0/2862470806 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f729c0c4700 con 0x7f729c070c90 2023-11-28T13:04:22.178 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:04:22.178 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:04:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:22.175+0000 7f72a1c5b700 1 -- 172.21.15.82:0/2862470806 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f727c064ee0 msgr2=0x7f727c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:22.175+0000 7f72a1c5b700 1 --2- 172.21.15.82:0/2862470806 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f727c064ee0 0x7f727c067390 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f728c007fd0 tx=0x7f728c007de0 comp rx=0 tx=0).stop 2023-11-28T13:04:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:22.175+0000 7f72a1c5b700 1 -- 172.21.15.82:0/2862470806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f729c070c90 msgr2=0x7f729c0ad990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:22.175+0000 7f72a1c5b700 1 --2- 172.21.15.82:0/2862470806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f729c070c90 0x7f729c0ad990 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f728400e870 tx=0x7f728400eb80 comp rx=0 tx=0).stop 2023-11-28T13:04:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:22.175+0000 7f72a1c5b700 1 -- 172.21.15.82:0/2862470806 shutdown_connections 2023-11-28T13:04:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:22.175+0000 7f72a1c5b700 1 --2- 172.21.15.82:0/2862470806 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f727c064ee0 0x7f727c067390 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:22.175+0000 7f72a1c5b700 1 --2- 172.21.15.82:0/2862470806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f729c0b2400 0x7f729c0caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:22.175+0000 7f72a1c5b700 1 --2- 172.21.15.82:0/2862470806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f729c070c90 0x7f729c0ad990 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:22.175+0000 7f72a1c5b700 1 --2- 172.21.15.82:0/2862470806 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f729c06e320 0x7f729c155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:22.175+0000 7f72a1c5b700 1 -- 172.21.15.82:0/2862470806 >> 172.21.15.82:0/2862470806 conn(0x7f729c0cc9b0 msgr2=0x7f729c06aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:22.175+0000 7f72a1c5b700 1 -- 172.21.15.82:0/2862470806 shutdown_connections 2023-11-28T13:04:22.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:22.175+0000 7f72a1c5b700 1 -- 172.21.15.82:0/2862470806 wait complete. 2023-11-28T13:04:22.192 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:04:27.194 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:04:27.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f921aea2700 1 Processor -- start 2023-11-28T13:04:27.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f921aea2700 1 -- start start 2023-11-28T13:04:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f921aea2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9214160870 0x7f921406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f921aea2700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f92140aed20 0x7f921406d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f921aea2700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f92140cf130 0x7f92140710b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f921aea2700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92140c30d0 con 0x7f9214160870 2023-11-28T13:04:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f921aea2700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9214165160 con 0x7f92140cf130 2023-11-28T13:04:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f921aea2700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92140cabb0 con 0x7f92140aed20 2023-11-28T13:04:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f9219ea0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9214160870 0x7f921406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f9219ea0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9214160870 0x7f921406d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46326/0 (socket says 172.21.15.82:46326) 2023-11-28T13:04:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f9219ea0700 1 -- 172.21.15.82:0/2800660323 learned_addr learned my addr 172.21.15.82:0/2800660323 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f921969f700 1 --2- 172.21.15.82:0/2800660323 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f92140aed20 0x7f921406d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f921a6a1700 1 --2- 172.21.15.82:0/2800660323 >> v2:172.21.15.114:3300/0 conn(0x7f92140cf130 0x7f92140710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f9219ea0700 1 -- 172.21.15.82:0/2800660323 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f92140aed20 msgr2=0x7f921406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:27.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f9219ea0700 1 --2- 172.21.15.82:0/2800660323 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f92140aed20 0x7f921406d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:27.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f9219ea0700 1 -- 172.21.15.82:0/2800660323 >> v2:172.21.15.114:3300/0 conn(0x7f92140cf130 msgr2=0x7f92140710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:27.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f9219ea0700 1 --2- 172.21.15.82:0/2800660323 >> v2:172.21.15.114:3300/0 conn(0x7f92140cf130 0x7f92140710b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:27.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f9219ea0700 1 -- 172.21.15.82:0/2800660323 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92141645e0 con 0x7f9214160870 2023-11-28T13:04:27.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f921a6a1700 1 --2- 172.21.15.82:0/2800660323 >> v2:172.21.15.114:3300/0 conn(0x7f92140cf130 0x7f92140710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:04:27.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f9219ea0700 1 --2- 172.21.15.82:0/2800660323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9214160870 0x7f921406d3d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f921406e0b0 tx=0x7f9208009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7239096b34503756 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:27.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f9218e9e700 1 -- 172.21.15.82:0/2800660323 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9208011830 con 0x7f9214160870 2023-11-28T13:04:27.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f9218e9e700 1 -- 172.21.15.82:0/2800660323 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9208011990 con 0x7f9214160870 2023-11-28T13:04:27.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f9218e9e700 1 -- 172.21.15.82:0/2800660323 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9208011d20 con 0x7f9214160870 2023-11-28T13:04:27.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f921aea2700 1 -- 172.21.15.82:0/2800660323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9214160870 msgr2=0x7f921406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:27.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f921aea2700 1 --2- 172.21.15.82:0/2800660323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9214160870 0x7f921406d3d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f921406e0b0 tx=0x7f9208009bf0 comp rx=0 tx=0).stop 2023-11-28T13:04:27.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f921aea2700 1 -- 172.21.15.82:0/2800660323 shutdown_connections 2023-11-28T13:04:27.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f921aea2700 1 --2- 172.21.15.82:0/2800660323 >> v2:172.21.15.114:3300/0 conn(0x7f92140cf130 0x7f92140710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:27.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f921aea2700 1 --2- 172.21.15.82:0/2800660323 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f92140aed20 0x7f921406d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:27.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f921aea2700 1 --2- 172.21.15.82:0/2800660323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9214160870 0x7f921406d3d0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:27.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f921aea2700 1 -- 172.21.15.82:0/2800660323 >> 172.21.15.82:0/2800660323 conn(0x7f92140cf710 msgr2=0x7f92140cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:27.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f921aea2700 1 -- 172.21.15.82:0/2800660323 shutdown_connections 2023-11-28T13:04:27.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.310+0000 7f921aea2700 1 -- 172.21.15.82:0/2800660323 wait complete. 2023-11-28T13:04:27.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f921aea2700 1 Processor -- start 2023-11-28T13:04:27.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f921aea2700 1 -- start start 2023-11-28T13:04:27.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f921aea2700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f92140aed20 0x7f92141f5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:27.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f921aea2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92140cf130 0x7f921414ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:27.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f921aea2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9214160870 0x7f92140cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:27.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f921aea2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92140c5b80 con 0x7f9214160870 2023-11-28T13:04:27.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f921aea2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92140c4f70 con 0x7f92140cf130 2023-11-28T13:04:27.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f921aea2700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92140c5250 con 0x7f92140aed20 2023-11-28T13:04:27.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f921a6a1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9214160870 0x7f92140cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:27.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f921a6a1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9214160870 0x7f92140cd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46332/0 (socket says 172.21.15.82:46332) 2023-11-28T13:04:27.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f921a6a1700 1 -- 172.21.15.82:0/302336322 learned_addr learned my addr 172.21.15.82:0/302336322 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:27.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f9219ea0700 1 --2- 172.21.15.82:0/302336322 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f92140aed20 0x7f92141f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:27.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f921969f700 1 --2- 172.21.15.82:0/302336322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92140cf130 0x7f921414ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:27.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f921a6a1700 1 -- 172.21.15.82:0/302336322 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f92140aed20 msgr2=0x7f92141f5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:27.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f921a6a1700 1 --2- 172.21.15.82:0/302336322 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f92140aed20 0x7f92141f5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:27.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f921a6a1700 1 -- 172.21.15.82:0/302336322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92140cf130 msgr2=0x7f921414ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:27.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f921a6a1700 1 --2- 172.21.15.82:0/302336322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92140cf130 0x7f921414ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:27.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f921a6a1700 1 -- 172.21.15.82:0/302336322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9208009570 con 0x7f9214160870 2023-11-28T13:04:27.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f921a6a1700 1 --2- 172.21.15.82:0/302336322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9214160870 0x7f92140cd550 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f920c00e810 tx=0x7f920c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:27.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f92127fc700 1 -- 172.21.15.82:0/302336322 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c00c070 con 0x7f9214160870 2023-11-28T13:04:27.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f92127fc700 1 -- 172.21.15.82:0/302336322 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920c004230 con 0x7f9214160870 2023-11-28T13:04:27.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f921aea2700 1 -- 172.21.15.82:0/302336322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9214164ba0 con 0x7f9214160870 2023-11-28T13:04:27.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f92127fc700 1 -- 172.21.15.82:0/302336322 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c0045c0 con 0x7f9214160870 2023-11-28T13:04:27.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.314+0000 7f921aea2700 1 -- 172.21.15.82:0/302336322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92141648c0 con 0x7f9214160870 2023-11-28T13:04:27.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.318+0000 7f921aea2700 1 -- 172.21.15.82:0/302336322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9214164e80 con 0x7f9214160870 2023-11-28T13:04:27.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.318+0000 7f92127fc700 1 -- 172.21.15.82:0/302336322 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f920c019020 con 0x7f9214160870 2023-11-28T13:04:27.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.318+0000 7f92127fc700 1 --2- 172.21.15.82:0/302336322 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9200064ee0 0x7f9200067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:27.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.318+0000 7f92127fc700 1 -- 172.21.15.82:0/302336322 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f920c081b80 con 0x7f9214160870 2023-11-28T13:04:27.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.318+0000 7f9219ea0700 1 --2- 172.21.15.82:0/302336322 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9200064ee0 0x7f9200067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:27.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.318+0000 7f9219ea0700 1 --2- 172.21.15.82:0/302336322 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9200064ee0 0x7f9200067390 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9208000c00 tx=0x7f9208008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:27.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.322+0000 7f92127fc700 1 -- 172.21.15.82:0/302336322 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f920c04fc10 con 0x7f9214160870 2023-11-28T13:04:27.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.522+0000 7f921aea2700 1 -- 172.21.15.82:0/302336322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9214065fc0 con 0x7f9214160870 2023-11-28T13:04:27.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.522+0000 7f92127fc700 1 -- 172.21.15.82:0/302336322 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f920c053230 con 0x7f9214160870 2023-11-28T13:04:27.530 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:04:27.530 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:04:27.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.526+0000 7f921aea2700 1 -- 172.21.15.82:0/302336322 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9200064ee0 msgr2=0x7f9200067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:27.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.526+0000 7f921aea2700 1 --2- 172.21.15.82:0/302336322 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9200064ee0 0x7f9200067390 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9208000c00 tx=0x7f9208008030 comp rx=0 tx=0).stop 2023-11-28T13:04:27.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.526+0000 7f921aea2700 1 -- 172.21.15.82:0/302336322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9214160870 msgr2=0x7f92140cd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:27.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.526+0000 7f921aea2700 1 --2- 172.21.15.82:0/302336322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9214160870 0x7f92140cd550 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f920c00e810 tx=0x7f920c00eb20 comp rx=0 tx=0).stop 2023-11-28T13:04:27.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.526+0000 7f921aea2700 1 -- 172.21.15.82:0/302336322 shutdown_connections 2023-11-28T13:04:27.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.526+0000 7f921aea2700 1 --2- 172.21.15.82:0/302336322 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9200064ee0 0x7f9200067390 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.526+0000 7f921aea2700 1 --2- 172.21.15.82:0/302336322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9214160870 0x7f92140cd550 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.526+0000 7f921aea2700 1 --2- 172.21.15.82:0/302336322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92140cf130 0x7f921414ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.526+0000 7f921aea2700 1 --2- 172.21.15.82:0/302336322 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f92140aed20 0x7f92141f5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.526+0000 7f921aea2700 1 -- 172.21.15.82:0/302336322 >> 172.21.15.82:0/302336322 conn(0x7f92140cf710 msgr2=0x7f921406b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.526+0000 7f921aea2700 1 -- 172.21.15.82:0/302336322 shutdown_connections 2023-11-28T13:04:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:27.526+0000 7f921aea2700 1 -- 172.21.15.82:0/302336322 wait complete. 2023-11-28T13:04:27.543 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:04:27.602 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:04:27.604 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:04:32.544 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:04:32.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.658+0000 7fddc83d4700 1 Processor -- start 2023-11-28T13:04:32.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.658+0000 7fddc83d4700 1 -- start start 2023-11-28T13:04:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.658+0000 7fddc83d4700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fddc00ae080 0x7fddc00703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.658+0000 7fddc83d4700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fddc0070920 0x7fddc006c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.658+0000 7fddc83d4700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddc006c6a0 0x7fddc006cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:32.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.658+0000 7fddc83d4700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc01599d0 con 0x7fddc00ae080 2023-11-28T13:04:32.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.658+0000 7fddc83d4700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc0070d90 con 0x7fddc0070920 2023-11-28T13:04:32.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.658+0000 7fddc83d4700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc00c9b10 con 0x7fddc006c6a0 2023-11-28T13:04:32.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.658+0000 7fddc6170700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fddc00ae080 0x7fddc00703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:32.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc6170700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fddc00ae080 0x7fddc00703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46342/0 (socket says 172.21.15.82:46342) 2023-11-28T13:04:32.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc6170700 1 -- 172.21.15.82:0/982824005 learned_addr learned my addr 172.21.15.82:0/982824005 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:32.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc596f700 1 --2- 172.21.15.82:0/982824005 >> v2:172.21.15.114:3300/0 conn(0x7fddc0070920 0x7fddc006c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:32.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc6971700 1 --2- 172.21.15.82:0/982824005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddc006c6a0 0x7fddc006cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:32.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc6170700 1 -- 172.21.15.82:0/982824005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddc006c6a0 msgr2=0x7fddc006cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:32.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc6170700 1 --2- 172.21.15.82:0/982824005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddc006c6a0 0x7fddc006cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:32.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc6170700 1 -- 172.21.15.82:0/982824005 >> v2:172.21.15.114:3300/0 conn(0x7fddc0070920 msgr2=0x7fddc006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:32.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc6170700 1 --2- 172.21.15.82:0/982824005 >> v2:172.21.15.114:3300/0 conn(0x7fddc0070920 0x7fddc006c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:32.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc6170700 1 -- 172.21.15.82:0/982824005 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc00c9d40 con 0x7fddc00ae080 2023-11-28T13:04:32.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc6971700 1 --2- 172.21.15.82:0/982824005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddc006c6a0 0x7fddc006cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:04:32.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc596f700 1 --2- 172.21.15.82:0/982824005 >> v2:172.21.15.114:3300/0 conn(0x7fddc0070920 0x7fddc006c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:04:32.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc6170700 1 --2- 172.21.15.82:0/982824005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc00ae080 0x7fddc00703e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fddc00ce910 tx=0x7fddbc00bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c837e8367c23830 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:32.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc516e700 1 -- 172.21.15.82:0/982824005 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00dd60 con 0x7fddc00ae080 2023-11-28T13:04:32.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc516e700 1 -- 172.21.15.82:0/982824005 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc010470 con 0x7fddc00ae080 2023-11-28T13:04:32.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc516e700 1 -- 172.21.15.82:0/982824005 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc010800 con 0x7fddc00ae080 2023-11-28T13:04:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc83d4700 1 -- 172.21.15.82:0/982824005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc00ae080 msgr2=0x7fddc00703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc83d4700 1 --2- 172.21.15.82:0/982824005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc00ae080 0x7fddc00703e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fddc00ce910 tx=0x7fddbc00bef0 comp rx=0 tx=0).stop 2023-11-28T13:04:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc83d4700 1 -- 172.21.15.82:0/982824005 shutdown_connections 2023-11-28T13:04:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc83d4700 1 --2- 172.21.15.82:0/982824005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddc006c6a0 0x7fddc006cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc83d4700 1 --2- 172.21.15.82:0/982824005 >> v2:172.21.15.114:3300/0 conn(0x7fddc0070920 0x7fddc006c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc83d4700 1 --2- 172.21.15.82:0/982824005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc00ae080 0x7fddc00703e0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc83d4700 1 -- 172.21.15.82:0/982824005 >> 172.21.15.82:0/982824005 conn(0x7fddc00ce9b0 msgr2=0x7fddc00ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc83d4700 1 -- 172.21.15.82:0/982824005 shutdown_connections 2023-11-28T13:04:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.662+0000 7fddc83d4700 1 -- 172.21.15.82:0/982824005 wait complete. 2023-11-28T13:04:32.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddc83d4700 1 Processor -- start 2023-11-28T13:04:32.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddc83d4700 1 -- start start 2023-11-28T13:04:32.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddc83d4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc006c6a0 0x7fddc015add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddc83d4700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddc0070920 0x7fddc01ec990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddc83d4700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddc00ae080 0x7fddc01eced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddc83d4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc00c8900 con 0x7fddc006c6a0 2023-11-28T13:04:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddc83d4700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc00c8620 con 0x7fddc0070920 2023-11-28T13:04:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddc83d4700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc01442c0 con 0x7fddc00ae080 2023-11-28T13:04:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddc6170700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc006c6a0 0x7fddc015add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddc596f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddc0070920 0x7fddc01ec990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddc6170700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc006c6a0 0x7fddc015add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46346/0 (socket says 172.21.15.82:46346) 2023-11-28T13:04:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddc6170700 1 -- 172.21.15.82:0/3012886761 learned_addr learned my addr 172.21.15.82:0/3012886761 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddc6971700 1 --2- 172.21.15.82:0/3012886761 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddc00ae080 0x7fddc01eced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddc6170700 1 -- 172.21.15.82:0/3012886761 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddc00ae080 msgr2=0x7fddc01eced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddc6170700 1 --2- 172.21.15.82:0/3012886761 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddc00ae080 0x7fddc01eced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddc6170700 1 -- 172.21.15.82:0/3012886761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddc0070920 msgr2=0x7fddc01ec990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddc6170700 1 --2- 172.21.15.82:0/3012886761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddc0070920 0x7fddc01ec990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddc6170700 1 -- 172.21.15.82:0/3012886761 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddbc00b810 con 0x7fddc006c6a0 2023-11-28T13:04:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddc6170700 1 --2- 172.21.15.82:0/3012886761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc006c6a0 0x7fddc015add0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fddbc000c00 tx=0x7fddbc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:32.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddb6ffd700 1 -- 172.21.15.82:0/3012886761 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc01d030 con 0x7fddc006c6a0 2023-11-28T13:04:32.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddb6ffd700 1 -- 172.21.15.82:0/3012886761 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc01e040 con 0x7fddc006c6a0 2023-11-28T13:04:32.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddc83d4700 1 -- 172.21.15.82:0/3012886761 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc00ca2c0 con 0x7fddc006c6a0 2023-11-28T13:04:32.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddb6ffd700 1 -- 172.21.15.82:0/3012886761 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc003cf0 con 0x7fddc006c6a0 2023-11-28T13:04:32.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.666+0000 7fddc83d4700 1 -- 172.21.15.82:0/3012886761 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc00c9fe0 con 0x7fddc006c6a0 2023-11-28T13:04:32.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.670+0000 7fddc83d4700 1 -- 172.21.15.82:0/3012886761 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc00ca5a0 con 0x7fddc006c6a0 2023-11-28T13:04:32.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.670+0000 7fddb6ffd700 1 -- 172.21.15.82:0/3012886761 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fddbc02b410 con 0x7fddc006c6a0 2023-11-28T13:04:32.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.670+0000 7fddb6ffd700 1 --2- 172.21.15.82:0/3012886761 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdda4064ee0 0x7fdda4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:32.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.674+0000 7fddb6ffd700 1 -- 172.21.15.82:0/3012886761 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7fddbc085870 con 0x7fddc006c6a0 2023-11-28T13:04:32.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.674+0000 7fddc596f700 1 --2- 172.21.15.82:0/3012886761 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdda4064ee0 0x7fdda4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:32.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.674+0000 7fddc596f700 1 --2- 172.21.15.82:0/3012886761 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdda4064ee0 0x7fdda4067390 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fddc015b8c0 tx=0x7fddb0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:32.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.678+0000 7fddb6ffd700 1 -- 172.21.15.82:0/3012886761 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fddbc053930 con 0x7fddc006c6a0 2023-11-28T13:04:32.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.874+0000 7fddc83d4700 1 -- 172.21.15.82:0/3012886761 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fddc006e310 con 0x7fddc006c6a0 2023-11-28T13:04:32.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.874+0000 7fddb6ffd700 1 -- 172.21.15.82:0/3012886761 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fddbc056f50 con 0x7fddc006c6a0 2023-11-28T13:04:32.881 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:04:32.881 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:04:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.878+0000 7fddc83d4700 1 -- 172.21.15.82:0/3012886761 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdda4064ee0 msgr2=0x7fdda4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.878+0000 7fddc83d4700 1 --2- 172.21.15.82:0/3012886761 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdda4064ee0 0x7fdda4067390 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fddc015b8c0 tx=0x7fddb0008040 comp rx=0 tx=0).stop 2023-11-28T13:04:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.878+0000 7fddc83d4700 1 -- 172.21.15.82:0/3012886761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc006c6a0 msgr2=0x7fddc015add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.878+0000 7fddc83d4700 1 --2- 172.21.15.82:0/3012886761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc006c6a0 0x7fddc015add0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fddbc000c00 tx=0x7fddbc004770 comp rx=0 tx=0).stop 2023-11-28T13:04:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.878+0000 7fddc83d4700 1 -- 172.21.15.82:0/3012886761 shutdown_connections 2023-11-28T13:04:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.878+0000 7fddc83d4700 1 --2- 172.21.15.82:0/3012886761 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fdda4064ee0 0x7fdda4067390 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.878+0000 7fddc83d4700 1 --2- 172.21.15.82:0/3012886761 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddc00ae080 0x7fddc01eced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.878+0000 7fddc83d4700 1 --2- 172.21.15.82:0/3012886761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddc0070920 0x7fddc01ec990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.878+0000 7fddc83d4700 1 --2- 172.21.15.82:0/3012886761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc006c6a0 0x7fddc015add0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.878+0000 7fddc83d4700 1 -- 172.21.15.82:0/3012886761 >> 172.21.15.82:0/3012886761 conn(0x7fddc00ce9b0 msgr2=0x7fddc0069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.878+0000 7fddc83d4700 1 -- 172.21.15.82:0/3012886761 shutdown_connections 2023-11-28T13:04:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:32.878+0000 7fddc83d4700 1 -- 172.21.15.82:0/3012886761 wait complete. 2023-11-28T13:04:32.894 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:04:37.895 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:04:38.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f35a0bf3700 1 Processor -- start 2023-11-28T13:04:38.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f35a0bf3700 1 -- start start 2023-11-28T13:04:38.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f35a0bf3700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f359c1586f0 0x7f359c15c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:38.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f35a0bf3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f359c0c8c50 0x7f359c06d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f35a0bf3700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f359c070900 0x7f359c070d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f35a0bf3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359c0712c0 con 0x7f359c0c8c50 2023-11-28T13:04:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f35a0bf3700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359c06c3b0 con 0x7f359c1586f0 2023-11-28T13:04:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f35a0bf3700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c15c8b0 con 0x7f359c070900 2023-11-28T13:04:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f359affd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f359c0c8c50 0x7f359c06d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f359affd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f359c0c8c50 0x7f359c06d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35296/0 (socket says 172.21.15.82:35296) 2023-11-28T13:04:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f359affd700 1 -- 172.21.15.82:0/3532931228 learned_addr learned my addr 172.21.15.82:0/3532931228 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f359b7fe700 1 --2- 172.21.15.82:0/3532931228 >> v2:172.21.15.114:3300/0 conn(0x7f359c1586f0 0x7f359c15c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f359bfff700 1 --2- 172.21.15.82:0/3532931228 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f359c070900 0x7f359c070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f359affd700 1 -- 172.21.15.82:0/3532931228 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f359c070900 msgr2=0x7f359c070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f359affd700 1 --2- 172.21.15.82:0/3532931228 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f359c070900 0x7f359c070d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f359affd700 1 -- 172.21.15.82:0/3532931228 >> v2:172.21.15.114:3300/0 conn(0x7f359c1586f0 msgr2=0x7f359c15c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f359affd700 1 --2- 172.21.15.82:0/3532931228 >> v2:172.21.15.114:3300/0 conn(0x7f359c1586f0 0x7f359c15c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f359affd700 1 -- 172.21.15.82:0/3532931228 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c15cb90 con 0x7f359c0c8c50 2023-11-28T13:04:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f359bfff700 1 --2- 172.21.15.82:0/3532931228 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f359c070900 0x7f359c070d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:04:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f359affd700 1 --2- 172.21.15.82:0/3532931228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359c0c8c50 0x7f359c06d880 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f359c0c5680 tx=0x7f358400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7f72277443a1fd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f359a7fc700 1 -- 172.21.15.82:0/3532931228 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358400e070 con 0x7f359c0c8c50 2023-11-28T13:04:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f359a7fc700 1 -- 172.21.15.82:0/3532931228 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358400b910 con 0x7f359c0c8c50 2023-11-28T13:04:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f359a7fc700 1 -- 172.21.15.82:0/3532931228 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358400bcc0 con 0x7f359c0c8c50 2023-11-28T13:04:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f35a0bf3700 1 -- 172.21.15.82:0/3532931228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359c0c8c50 msgr2=0x7f359c06d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:38.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f35a0bf3700 1 --2- 172.21.15.82:0/3532931228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359c0c8c50 0x7f359c06d880 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f359c0c5680 tx=0x7f358400b330 comp rx=0 tx=0).stop 2023-11-28T13:04:38.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f35a0bf3700 1 -- 172.21.15.82:0/3532931228 shutdown_connections 2023-11-28T13:04:38.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f35a0bf3700 1 --2- 172.21.15.82:0/3532931228 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f359c070900 0x7f359c070d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:38.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f35a0bf3700 1 --2- 172.21.15.82:0/3532931228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359c0c8c50 0x7f359c06d880 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:38.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f35a0bf3700 1 --2- 172.21.15.82:0/3532931228 >> v2:172.21.15.114:3300/0 conn(0x7f359c1586f0 0x7f359c15c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:38.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f35a0bf3700 1 -- 172.21.15.82:0/3532931228 >> 172.21.15.82:0/3532931228 conn(0x7f359c0ce600 msgr2=0x7f359c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:38.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f35a0bf3700 1 -- 172.21.15.82:0/3532931228 shutdown_connections 2023-11-28T13:04:38.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.010+0000 7f35a0bf3700 1 -- 172.21.15.82:0/3532931228 wait complete. 2023-11-28T13:04:38.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f35a0bf3700 1 Processor -- start 2023-11-28T13:04:38.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f35a0bf3700 1 -- start start 2023-11-28T13:04:38.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f35a0bf3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359c070900 0x7f359c14aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:38.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f35a0bf3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f359c0c8c50 0x7f359c0c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:38.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f35a0bf3700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f359c1586f0 0x7f359c0af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:38.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f35a0bf3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c155620 con 0x7f359c070900 2023-11-28T13:04:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f35a0bf3700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c154a10 con 0x7f359c0c8c50 2023-11-28T13:04:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f35a0bf3700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c154cf0 con 0x7f359c1586f0 2023-11-28T13:04:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f359b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359c070900 0x7f359c14aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f359b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359c070900 0x7f359c14aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35298/0 (socket says 172.21.15.82:35298) 2023-11-28T13:04:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f359b7fe700 1 -- 172.21.15.82:0/3299817235 learned_addr learned my addr 172.21.15.82:0/3299817235 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f359bfff700 1 --2- 172.21.15.82:0/3299817235 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f359c1586f0 0x7f359c0af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f359affd700 1 --2- 172.21.15.82:0/3299817235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f359c0c8c50 0x7f359c0c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f359b7fe700 1 -- 172.21.15.82:0/3299817235 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f359c1586f0 msgr2=0x7f359c0af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f359b7fe700 1 --2- 172.21.15.82:0/3299817235 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f359c1586f0 0x7f359c0af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f359b7fe700 1 -- 172.21.15.82:0/3299817235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f359c0c8c50 msgr2=0x7f359c0c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f359b7fe700 1 --2- 172.21.15.82:0/3299817235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f359c0c8c50 0x7f359c0c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f359b7fe700 1 -- 172.21.15.82:0/3299817235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3584009b30 con 0x7f359c070900 2023-11-28T13:04:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f359bfff700 1 --2- 172.21.15.82:0/3299817235 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f359c1586f0 0x7f359c0af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:04:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f359affd700 1 --2- 172.21.15.82:0/3299817235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f359c0c8c50 0x7f359c0c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:04:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f359b7fe700 1 --2- 172.21.15.82:0/3299817235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359c070900 0x7f359c14aad0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f358c00e840 tx=0x7f358c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f3593fff700 1 -- 172.21.15.82:0/3299817235 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c0095a0 con 0x7f359c070900 2023-11-28T13:04:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f3593fff700 1 -- 172.21.15.82:0/3299817235 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c00c690 con 0x7f359c070900 2023-11-28T13:04:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f35a0bf3700 1 -- 172.21.15.82:0/3299817235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359c15d150 con 0x7f359c070900 2023-11-28T13:04:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.014+0000 7f3593fff700 1 -- 172.21.15.82:0/3299817235 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c00ca00 con 0x7f359c070900 2023-11-28T13:04:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.018+0000 7f35a0bf3700 1 -- 172.21.15.82:0/3299817235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359c15ce70 con 0x7f359c070900 2023-11-28T13:04:38.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.018+0000 7f35a0bf3700 1 -- 172.21.15.82:0/3299817235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359c06ddc0 con 0x7f359c070900 2023-11-28T13:04:38.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.018+0000 7f3593fff700 1 -- 172.21.15.82:0/3299817235 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f358c019030 con 0x7f359c070900 2023-11-28T13:04:38.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.018+0000 7f3593fff700 1 --2- 172.21.15.82:0/3299817235 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f357c064ee0 0x7f357c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:38.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.018+0000 7f3593fff700 1 -- 172.21.15.82:0/3299817235 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f358c081d70 con 0x7f359c070900 2023-11-28T13:04:38.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.018+0000 7f359affd700 1 --2- 172.21.15.82:0/3299817235 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f357c064ee0 0x7f357c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:38.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.022+0000 7f359affd700 1 --2- 172.21.15.82:0/3299817235 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f357c064ee0 0x7f357c067390 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3584000f80 tx=0x7f3584009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:38.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.026+0000 7f3593fff700 1 -- 172.21.15.82:0/3299817235 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f358c04fe30 con 0x7f359c070900 2023-11-28T13:04:38.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.218+0000 7f35a0bf3700 1 -- 172.21.15.82:0/3299817235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f359c065fc0 con 0x7f359c070900 2023-11-28T13:04:38.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.218+0000 7f3593fff700 1 -- 172.21.15.82:0/3299817235 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f358c053450 con 0x7f359c070900 2023-11-28T13:04:38.225 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:04:38.226 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:04:38.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.222+0000 7f35a0bf3700 1 -- 172.21.15.82:0/3299817235 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f357c064ee0 msgr2=0x7f357c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:38.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.222+0000 7f35a0bf3700 1 --2- 172.21.15.82:0/3299817235 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f357c064ee0 0x7f357c067390 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3584000f80 tx=0x7f3584009000 comp rx=0 tx=0).stop 2023-11-28T13:04:38.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.222+0000 7f35a0bf3700 1 -- 172.21.15.82:0/3299817235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359c070900 msgr2=0x7f359c14aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:38.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.222+0000 7f35a0bf3700 1 --2- 172.21.15.82:0/3299817235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359c070900 0x7f359c14aad0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f358c00e840 tx=0x7f358c00ec00 comp rx=0 tx=0).stop 2023-11-28T13:04:38.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.222+0000 7f35a0bf3700 1 -- 172.21.15.82:0/3299817235 shutdown_connections 2023-11-28T13:04:38.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.222+0000 7f35a0bf3700 1 --2- 172.21.15.82:0/3299817235 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f357c064ee0 0x7f357c067390 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:38.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.222+0000 7f35a0bf3700 1 --2- 172.21.15.82:0/3299817235 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f359c1586f0 0x7f359c0af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:38.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.222+0000 7f35a0bf3700 1 --2- 172.21.15.82:0/3299817235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f359c0c8c50 0x7f359c0c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:38.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.222+0000 7f35a0bf3700 1 --2- 172.21.15.82:0/3299817235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359c070900 0x7f359c14aad0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:38.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.222+0000 7f35a0bf3700 1 -- 172.21.15.82:0/3299817235 >> 172.21.15.82:0/3299817235 conn(0x7f359c0ce600 msgr2=0x7f359c06a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:38.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.222+0000 7f35a0bf3700 1 -- 172.21.15.82:0/3299817235 shutdown_connections 2023-11-28T13:04:38.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:38.222+0000 7f35a0bf3700 1 -- 172.21.15.82:0/3299817235 wait complete. 2023-11-28T13:04:38.239 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:04:43.240 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:04:43.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.354+0000 7fea3b59e700 1 Processor -- start 2023-11-28T13:04:43.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.354+0000 7fea3b59e700 1 -- start start 2023-11-28T13:04:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea3b59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea3c070070 0x7fea3c070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea3b59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3c070980 con 0x7fea3c160900 2023-11-28T13:04:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea3b59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3c0ce030 con 0x7fea3c0c1910 2023-11-28T13:04:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea3b59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c0ce310 con 0x7fea3c070070 2023-11-28T13:04:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea39d9b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fea3c160900 0x7fea3c0cc1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39674/0 (socket says 172.21.15.82:39674) 2023-11-28T13:04:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea39d9b700 1 -- 172.21.15.82:0/4040503244 learned_addr learned my addr 172.21.15.82:0/4040503244 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:04:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea3a59c700 1 --2- 172.21.15.82:0/4040503244 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea3c070070 0x7fea3c070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea3959a700 1 -- 172.21.15.82:0/4040503244 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2335421626 0 0) 0x7fea3c070980 con 0x7fea3c160900 2023-11-28T13:04:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea3959a700 1 -- 172.21.15.82:0/4040503244 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea280035d0 con 0x7fea3c160900 2023-11-28T13:04:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea3959a700 1 -- 172.21.15.82:0/4040503244 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476356937 0 0) 0x7fea3c0ce030 con 0x7fea3c0c1910 2023-11-28T13:04:43.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea3959a700 1 -- 172.21.15.82:0/4040503244 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea3c070980 con 0x7fea3c0c1910 2023-11-28T13:04:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea3a59c700 1 -- 172.21.15.82:0/4040503244 >> v1:172.21.15.114:6789/0 conn(0x7fea3c0c1910 legacy=0x7fea3c06c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea3a59c700 1 -- 172.21.15.82:0/4040503244 >> v1:172.21.15.82:6789/0 conn(0x7fea3c160900 legacy=0x7fea3c0cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea3a59c700 1 -- 172.21.15.82:0/4040503244 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3c06a5d0 con 0x7fea3c070070 2023-11-28T13:04:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea3a59c700 1 --2- 172.21.15.82:0/4040503244 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea3c070070 0x7fea3c070440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fea2c009880 tx=0x7fea2c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20bd2ce244a9d4c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea3959a700 1 -- 172.21.15.82:0/4040503244 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c011830 con 0x7fea3c070070 2023-11-28T13:04:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea3959a700 1 -- 172.21.15.82:0/4040503244 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2c011990 con 0x7fea3c070070 2023-11-28T13:04:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea3959a700 1 -- 172.21.15.82:0/4040503244 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c011d20 con 0x7fea3c070070 2023-11-28T13:04:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea3b59e700 1 -- 172.21.15.82:0/4040503244 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea3c070070 msgr2=0x7fea3c070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea3b59e700 1 --2- 172.21.15.82:0/4040503244 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea3c070070 0x7fea3c070440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fea2c009880 tx=0x7fea2c009b90 comp rx=0 tx=0).stop 2023-11-28T13:04:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea3b59e700 1 -- 172.21.15.82:0/4040503244 shutdown_connections 2023-11-28T13:04:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea3b59e700 1 --2- 172.21.15.82:0/4040503244 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea3c070070 0x7fea3c070440 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.358+0000 7fea3b59e700 1 -- 172.21.15.82:0/4040503244 >> 172.21.15.82:0/4040503244 conn(0x7fea3c0ce600 msgr2=0x7fea3c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.362+0000 7fea3b59e700 1 -- 172.21.15.82:0/4040503244 shutdown_connections 2023-11-28T13:04:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.362+0000 7fea3b59e700 1 -- 172.21.15.82:0/4040503244 wait complete. 2023-11-28T13:04:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.362+0000 7fea3b59e700 1 Processor -- start 2023-11-28T13:04:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.362+0000 7fea3b59e700 1 -- start start 2023-11-28T13:04:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea3b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea3c14db00 0x7fea3c15af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea3b59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea3c0c3370 0x7fea3c06cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea3b59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea3c06d440 0x7fea3c0c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea3b59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c0c37c0 con 0x7fea3c14db00 2023-11-28T13:04:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea3b59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c06d8b0 con 0x7fea3c0c3370 2023-11-28T13:04:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea3b59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c0c39c0 con 0x7fea3c06d440 2023-11-28T13:04:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea3a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea3c14db00 0x7fea3c15af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea3a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea3c14db00 0x7fea3c15af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35314/0 (socket says 172.21.15.82:35314) 2023-11-28T13:04:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea3a59c700 1 -- 172.21.15.82:0/2675509057 learned_addr learned my addr 172.21.15.82:0/2675509057 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:43.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea39d9b700 1 --2- 172.21.15.82:0/2675509057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea3c0c3370 0x7fea3c06cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:43.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea3ad9d700 1 --2- 172.21.15.82:0/2675509057 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea3c06d440 0x7fea3c0c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:43.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea3a59c700 1 -- 172.21.15.82:0/2675509057 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea3c06d440 msgr2=0x7fea3c0c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:43.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea3a59c700 1 --2- 172.21.15.82:0/2675509057 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea3c06d440 0x7fea3c0c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:43.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea3a59c700 1 -- 172.21.15.82:0/2675509057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea3c0c3370 msgr2=0x7fea3c06cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:43.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea3a59c700 1 --2- 172.21.15.82:0/2675509057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea3c0c3370 0x7fea3c06cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:43.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea3a59c700 1 -- 172.21.15.82:0/2675509057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2c0094b0 con 0x7fea3c14db00 2023-11-28T13:04:43.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea3a59c700 1 --2- 172.21.15.82:0/2675509057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea3c14db00 0x7fea3c15af90 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0090b0 tx=0x7fea2c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:43.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea32ffd700 1 -- 172.21.15.82:0/2675509057 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c01a800 con 0x7fea3c14db00 2023-11-28T13:04:43.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea32ffd700 1 -- 172.21.15.82:0/2675509057 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2c01e070 con 0x7fea3c14db00 2023-11-28T13:04:43.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea3b59e700 1 -- 172.21.15.82:0/2675509057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea3c06ab90 con 0x7fea3c14db00 2023-11-28T13:04:43.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea32ffd700 1 -- 172.21.15.82:0/2675509057 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c01aba0 con 0x7fea3c14db00 2023-11-28T13:04:43.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea3b59e700 1 -- 172.21.15.82:0/2675509057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea3c06a8b0 con 0x7fea3c14db00 2023-11-28T13:04:43.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.366+0000 7fea3b59e700 1 -- 172.21.15.82:0/2675509057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3c0cdc50 con 0x7fea3c14db00 2023-11-28T13:04:43.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.370+0000 7fea32ffd700 1 -- 172.21.15.82:0/2675509057 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fea2c00f050 con 0x7fea3c14db00 2023-11-28T13:04:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.370+0000 7fea32ffd700 1 --2- 172.21.15.82:0/2675509057 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fea1c064ee0 0x7fea1c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.370+0000 7fea32ffd700 1 -- 172.21.15.82:0/2675509057 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7fea2c082be0 con 0x7fea3c14db00 2023-11-28T13:04:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.370+0000 7fea39d9b700 1 --2- 172.21.15.82:0/2675509057 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fea1c064ee0 0x7fea1c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.370+0000 7fea39d9b700 1 --2- 172.21.15.82:0/2675509057 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fea1c064ee0 0x7fea1c067390 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fea240012e0 tx=0x7fea24001ad0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:43.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.374+0000 7fea32ffd700 1 -- 172.21.15.82:0/2675509057 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fea2c050d00 con 0x7fea3c14db00 2023-11-28T13:04:43.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.574+0000 7fea3b59e700 1 -- 172.21.15.82:0/2675509057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fea3c065fc0 con 0x7fea3c14db00 2023-11-28T13:04:43.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.578+0000 7fea32ffd700 1 -- 172.21.15.82:0/2675509057 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fea2c0200c0 con 0x7fea3c14db00 2023-11-28T13:04:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:04:43.584 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:04:43.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.578+0000 7fea3b59e700 1 -- 172.21.15.82:0/2675509057 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fea1c064ee0 msgr2=0x7fea1c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:43.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.578+0000 7fea3b59e700 1 --2- 172.21.15.82:0/2675509057 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fea1c064ee0 0x7fea1c067390 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fea240012e0 tx=0x7fea24001ad0 comp rx=0 tx=0).stop 2023-11-28T13:04:43.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.578+0000 7fea3b59e700 1 -- 172.21.15.82:0/2675509057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea3c14db00 msgr2=0x7fea3c15af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:43.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.578+0000 7fea3b59e700 1 --2- 172.21.15.82:0/2675509057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea3c14db00 0x7fea3c15af90 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0090b0 tx=0x7fea2c004770 comp rx=0 tx=0).stop 2023-11-28T13:04:43.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.578+0000 7fea3b59e700 1 -- 172.21.15.82:0/2675509057 shutdown_connections 2023-11-28T13:04:43.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.578+0000 7fea3b59e700 1 --2- 172.21.15.82:0/2675509057 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fea1c064ee0 0x7fea1c067390 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:43.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.578+0000 7fea3b59e700 1 --2- 172.21.15.82:0/2675509057 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea3c06d440 0x7fea3c0c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:43.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.578+0000 7fea3b59e700 1 --2- 172.21.15.82:0/2675509057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea3c0c3370 0x7fea3c06cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:43.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.578+0000 7fea3b59e700 1 --2- 172.21.15.82:0/2675509057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea3c14db00 0x7fea3c15af90 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:43.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.578+0000 7fea3b59e700 1 -- 172.21.15.82:0/2675509057 >> 172.21.15.82:0/2675509057 conn(0x7fea3c0ce600 msgr2=0x7fea3c0b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:43.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.578+0000 7fea3b59e700 1 -- 172.21.15.82:0/2675509057 shutdown_connections 2023-11-28T13:04:43.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:43.578+0000 7fea3b59e700 1 -- 172.21.15.82:0/2675509057 wait complete. 2023-11-28T13:04:43.598 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:04:48.599 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:04:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff4788c2700 1 Processor -- start 2023-11-28T13:04:48.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff4788c2700 1 -- start start 2023-11-28T13:04:48.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff4788c2700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff47406b910 0x7ff4740d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff4788c2700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff47406bce0 0x7ff474160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff4788c2700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff474161000 0x7ff474069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff4788c2700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4740d06f0 con 0x7ff474161000 2023-11-28T13:04:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff4788c2700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff474161440 con 0x7ff47406bce0 2023-11-28T13:04:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff4788c2700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47415e530 con 0x7ff47406b910 2023-11-28T13:04:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff473fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff474161000 0x7ff474069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff472ffd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff47406bce0 0x7ff474160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff472ffd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff47406bce0 0x7ff474160ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:36594/0 (socket says 172.21.15.82:36594) 2023-11-28T13:04:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff472ffd700 1 -- 172.21.15.82:0/3069640667 learned_addr learned my addr 172.21.15.82:0/3069640667 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:48.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff4737fe700 1 --2- 172.21.15.82:0/3069640667 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff47406b910 0x7ff4740d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:48.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff473fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff474161000 0x7ff474069bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39262/0 (socket says 172.21.15.82:39262) 2023-11-28T13:04:48.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff472ffd700 1 -- 172.21.15.82:0/3069640667 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff47406b910 msgr2=0x7ff4740d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:48.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff472ffd700 1 --2- 172.21.15.82:0/3069640667 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff47406b910 0x7ff4740d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:48.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff472ffd700 1 -- 172.21.15.82:0/3069640667 >> v2:172.21.15.82:3300/0 conn(0x7ff474161000 msgr2=0x7ff474069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:48.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff472ffd700 1 --2- 172.21.15.82:0/3069640667 >> v2:172.21.15.82:3300/0 conn(0x7ff474161000 0x7ff474069bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:48.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff472ffd700 1 -- 172.21.15.82:0/3069640667 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff474161650 con 0x7ff47406bce0 2023-11-28T13:04:48.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff473fff700 1 --2- 172.21.15.82:0/3069640667 >> v2:172.21.15.82:3300/0 conn(0x7ff474161000 0x7ff474069bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:04:48.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff472ffd700 1 --2- 172.21.15.82:0/3069640667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff47406bce0 0x7ff474160ac0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff47408b8a0 tx=0x7ff46400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5ce8d98202c6d34 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:48.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff4727fc700 1 -- 172.21.15.82:0/3069640667 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46400e070 con 0x7ff47406bce0 2023-11-28T13:04:48.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff4727fc700 1 -- 172.21.15.82:0/3069640667 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46400b910 con 0x7ff47406bce0 2023-11-28T13:04:48.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff4727fc700 1 -- 172.21.15.82:0/3069640667 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46400bcc0 con 0x7ff47406bce0 2023-11-28T13:04:48.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff4788c2700 1 -- 172.21.15.82:0/3069640667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff47406bce0 msgr2=0x7ff474160ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:48.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff4788c2700 1 --2- 172.21.15.82:0/3069640667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff47406bce0 0x7ff474160ac0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff47408b8a0 tx=0x7ff46400b330 comp rx=0 tx=0).stop 2023-11-28T13:04:48.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff4788c2700 1 -- 172.21.15.82:0/3069640667 shutdown_connections 2023-11-28T13:04:48.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff4788c2700 1 --2- 172.21.15.82:0/3069640667 >> v2:172.21.15.82:3300/0 conn(0x7ff474161000 0x7ff474069bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:48.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.710+0000 7ff4788c2700 1 --2- 172.21.15.82:0/3069640667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff47406bce0 0x7ff474160ac0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:48.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff4788c2700 1 --2- 172.21.15.82:0/3069640667 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff47406b910 0x7ff4740d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:48.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff4788c2700 1 -- 172.21.15.82:0/3069640667 >> 172.21.15.82:0/3069640667 conn(0x7ff4740d2b20 msgr2=0x7ff4740d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:48.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff4788c2700 1 -- 172.21.15.82:0/3069640667 shutdown_connections 2023-11-28T13:04:48.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff4788c2700 1 -- 172.21.15.82:0/3069640667 wait complete. 2023-11-28T13:04:48.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff4788c2700 1 Processor -- start 2023-11-28T13:04:48.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff4788c2700 1 -- start start 2023-11-28T13:04:48.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff4788c2700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff47406b910 0x7ff4740b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:48.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff4788c2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff47406bce0 0x7ff4741f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:48.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff4788c2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff474161000 0x7ff47415f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:48.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff4788c2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4741f9350 con 0x7ff47406bce0 2023-11-28T13:04:48.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff4788c2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4740b5e90 con 0x7ff474161000 2023-11-28T13:04:48.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff4788c2700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff474150fe0 con 0x7ff47406b910 2023-11-28T13:04:48.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff472ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff47406bce0 0x7ff4741f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:48.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff472ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff47406bce0 0x7ff4741f5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39266/0 (socket says 172.21.15.82:39266) 2023-11-28T13:04:48.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff472ffd700 1 -- 172.21.15.82:0/4128052937 learned_addr learned my addr 172.21.15.82:0/4128052937 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:48.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff4737fe700 1 --2- 172.21.15.82:0/4128052937 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff47406b910 0x7ff4740b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:48.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff473fff700 1 --2- 172.21.15.82:0/4128052937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff474161000 0x7ff47415f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:48.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff472ffd700 1 -- 172.21.15.82:0/4128052937 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff47406b910 msgr2=0x7ff4740b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:48.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff472ffd700 1 --2- 172.21.15.82:0/4128052937 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff47406b910 0x7ff4740b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:48.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff472ffd700 1 -- 172.21.15.82:0/4128052937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff474161000 msgr2=0x7ff47415f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:48.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff472ffd700 1 --2- 172.21.15.82:0/4128052937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff474161000 0x7ff47415f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:48.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.714+0000 7ff472ffd700 1 -- 172.21.15.82:0/4128052937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c0094b0 con 0x7ff47406bce0 2023-11-28T13:04:48.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.718+0000 7ff472ffd700 1 --2- 172.21.15.82:0/4128052937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff47406bce0 0x7ff4741f5680 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff4740d0830 tx=0x7ff464004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:48.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.718+0000 7ff46bfff700 1 -- 172.21.15.82:0/4128052937 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46400ce80 con 0x7ff47406bce0 2023-11-28T13:04:48.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.718+0000 7ff46bfff700 1 -- 172.21.15.82:0/4128052937 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff464004250 con 0x7ff47406bce0 2023-11-28T13:04:48.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.718+0000 7ff4788c2700 1 -- 172.21.15.82:0/4128052937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff464009b30 con 0x7ff47406bce0 2023-11-28T13:04:48.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.718+0000 7ff46bfff700 1 -- 172.21.15.82:0/4128052937 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464004600 con 0x7ff47406bce0 2023-11-28T13:04:48.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.718+0000 7ff4788c2700 1 -- 172.21.15.82:0/4128052937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4740d0900 con 0x7ff47406bce0 2023-11-28T13:04:48.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.718+0000 7ff4788c2700 1 -- 172.21.15.82:0/4128052937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff474161930 con 0x7ff47406bce0 2023-11-28T13:04:48.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.718+0000 7ff46bfff700 1 -- 172.21.15.82:0/4128052937 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff464004760 con 0x7ff47406bce0 2023-11-28T13:04:48.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.722+0000 7ff46bfff700 1 --2- 172.21.15.82:0/4128052937 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff454064ee0 0x7ff454067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:48.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.722+0000 7ff4737fe700 1 --2- 172.21.15.82:0/4128052937 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff454064ee0 0x7ff454067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:48.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.722+0000 7ff46bfff700 1 -- 172.21.15.82:0/4128052937 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7ff464083610 con 0x7ff47406bce0 2023-11-28T13:04:48.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.722+0000 7ff4737fe700 1 --2- 172.21.15.82:0/4128052937 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff454064ee0 0x7ff454067390 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff474151a50 tx=0x7ff45c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:48.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.726+0000 7ff46bfff700 1 -- 172.21.15.82:0/4128052937 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff464051760 con 0x7ff47406bce0 2023-11-28T13:04:48.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.926+0000 7ff4788c2700 1 -- 172.21.15.82:0/4128052937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff4740d0be0 con 0x7ff47406bce0 2023-11-28T13:04:48.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.926+0000 7ff46bfff700 1 -- 172.21.15.82:0/4128052937 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7ff464054d80 con 0x7ff47406bce0 2023-11-28T13:04:48.932 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:04:48.933 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:04:48.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.926+0000 7ff4788c2700 1 -- 172.21.15.82:0/4128052937 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff454064ee0 msgr2=0x7ff454067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:48.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.926+0000 7ff4788c2700 1 --2- 172.21.15.82:0/4128052937 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff454064ee0 0x7ff454067390 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff474151a50 tx=0x7ff45c008040 comp rx=0 tx=0).stop 2023-11-28T13:04:48.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.926+0000 7ff4788c2700 1 -- 172.21.15.82:0/4128052937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff47406bce0 msgr2=0x7ff4741f5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:48.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.926+0000 7ff4788c2700 1 --2- 172.21.15.82:0/4128052937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff47406bce0 0x7ff4741f5680 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff4740d0830 tx=0x7ff464004af0 comp rx=0 tx=0).stop 2023-11-28T13:04:48.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.926+0000 7ff4788c2700 1 -- 172.21.15.82:0/4128052937 shutdown_connections 2023-11-28T13:04:48.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.926+0000 7ff4788c2700 1 --2- 172.21.15.82:0/4128052937 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff454064ee0 0x7ff454067390 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:48.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.926+0000 7ff4788c2700 1 --2- 172.21.15.82:0/4128052937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff474161000 0x7ff47415f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:48.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.926+0000 7ff4788c2700 1 --2- 172.21.15.82:0/4128052937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff47406bce0 0x7ff4741f5680 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:48.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.926+0000 7ff4788c2700 1 --2- 172.21.15.82:0/4128052937 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff47406b910 0x7ff4740b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:48.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.926+0000 7ff4788c2700 1 -- 172.21.15.82:0/4128052937 >> 172.21.15.82:0/4128052937 conn(0x7ff4740d2b20 msgr2=0x7ff4741634b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:48.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.926+0000 7ff4788c2700 1 -- 172.21.15.82:0/4128052937 shutdown_connections 2023-11-28T13:04:48.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:48.926+0000 7ff4788c2700 1 -- 172.21.15.82:0/4128052937 wait complete. 2023-11-28T13:04:48.947 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:04:53.947 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:04:54.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.066+0000 7f906f59e700 1 Processor -- start 2023-11-28T13:04:54.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.066+0000 7f906f59e700 1 -- start start 2023-11-28T13:04:54.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.066+0000 7f906f59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90680dee50 0x7f906804f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:54.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.066+0000 7f906f59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f90680538d0 0x7f906804fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:54.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.066+0000 7f906f59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90680064d0 con 0x7f906804f880 2023-11-28T13:04:54.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.066+0000 7f906f59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9068050210 con 0x7f90680538d0 2023-11-28T13:04:54.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.066+0000 7f906f59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90680df220 con 0x7f90680dee50 2023-11-28T13:04:54.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.066+0000 7f906e59c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90680dee50 0x7f906804f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:54.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.066+0000 7f906ed9d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f90680538d0 0x7f906804fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:54.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.066+0000 7f906dd9b700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f906804f880 0x7f9068006960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:57932/0 (socket says 172.21.15.82:57932) 2023-11-28T13:04:54.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.066+0000 7f906ed9d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f90680538d0 0x7f906804fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:36612/0 (socket says 172.21.15.82:36612) 2023-11-28T13:04:54.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.066+0000 7f906dd9b700 1 -- 172.21.15.82:0/196908975 learned_addr learned my addr 172.21.15.82:0/196908975 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:04:54.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.066+0000 7f906ed9d700 1 -- 172.21.15.82:0/196908975 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90680dee50 msgr2=0x7f906804f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:54.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.066+0000 7f906ed9d700 1 --2- 172.21.15.82:0/196908975 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90680dee50 0x7f906804f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:54.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.066+0000 7f906ed9d700 1 -- 172.21.15.82:0/196908975 >> v1:172.21.15.114:6789/0 conn(0x7f906804f880 legacy=0x7f9068006960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:54.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.066+0000 7f906ed9d700 1 -- 172.21.15.82:0/196908975 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90680340b0 con 0x7f90680538d0 2023-11-28T13:04:54.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.066+0000 7f906ed9d700 1 --2- 172.21.15.82:0/196908975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90680538d0 0x7f906804fcd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f907004f8c0 tx=0x7f9070072430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ce568efff03e723 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:54.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.066+0000 7f906d59a700 1 -- 172.21.15.82:0/196908975 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070094070 con 0x7f90680538d0 2023-11-28T13:04:54.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.066+0000 7f906d59a700 1 -- 172.21.15.82:0/196908975 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9070000990 con 0x7f90680538d0 2023-11-28T13:04:54.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.066+0000 7f906d59a700 1 -- 172.21.15.82:0/196908975 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90700657e0 con 0x7f90680538d0 2023-11-28T13:04:54.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.070+0000 7f906f59e700 1 -- 172.21.15.82:0/196908975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90680538d0 msgr2=0x7f906804fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:54.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.070+0000 7f906f59e700 1 --2- 172.21.15.82:0/196908975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90680538d0 0x7f906804fcd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f907004f8c0 tx=0x7f9070072430 comp rx=0 tx=0).stop 2023-11-28T13:04:54.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.070+0000 7f906f59e700 1 -- 172.21.15.82:0/196908975 shutdown_connections 2023-11-28T13:04:54.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.070+0000 7f906f59e700 1 --2- 172.21.15.82:0/196908975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90680538d0 0x7f906804fcd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:54.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.070+0000 7f906f59e700 1 --2- 172.21.15.82:0/196908975 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90680dee50 0x7f906804f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:54.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.070+0000 7f906f59e700 1 -- 172.21.15.82:0/196908975 >> 172.21.15.82:0/196908975 conn(0x7f9068051770 msgr2=0x7f9068051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:54.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.070+0000 7f906f59e700 1 -- 172.21.15.82:0/196908975 shutdown_connections 2023-11-28T13:04:54.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.070+0000 7f906f59e700 1 -- 172.21.15.82:0/196908975 wait complete. 2023-11-28T13:04:54.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.070+0000 7f906f59e700 1 Processor -- start 2023-11-28T13:04:54.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.070+0000 7f906f59e700 1 -- start start 2023-11-28T13:04:54.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.070+0000 7f906f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f906804f880 0x7f90680ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:54.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.070+0000 7f906f59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90680538d0 0x7f90680e0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:54.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.070+0000 7f906f59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90680dee50 0x7f90680e16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:54.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.070+0000 7f906f59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90680ceff0 con 0x7f906804f880 2023-11-28T13:04:54.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.070+0000 7f906f59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9068173e90 con 0x7f90680dee50 2023-11-28T13:04:54.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.070+0000 7f906f59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906804d120 con 0x7f90680538d0 2023-11-28T13:04:54.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.070+0000 7f906e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f906804f880 0x7f90680ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:54.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.070+0000 7f906e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f906804f880 0x7f90680ceab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39274/0 (socket says 172.21.15.82:39274) 2023-11-28T13:04:54.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.070+0000 7f906ed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90680dee50 0x7f90680e16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:54.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.070+0000 7f906dd9b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90680538d0 0x7f90680e0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:54.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.070+0000 7f906e59c700 1 -- 172.21.15.82:0/137382285 learned_addr learned my addr 172.21.15.82:0/137382285 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:54.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.074+0000 7f906e59c700 1 -- 172.21.15.82:0/137382285 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90680538d0 msgr2=0x7f90680e0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:54.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.074+0000 7f906e59c700 1 --2- 172.21.15.82:0/137382285 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90680538d0 0x7f90680e0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:54.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.074+0000 7f906e59c700 1 -- 172.21.15.82:0/137382285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90680dee50 msgr2=0x7f90680e16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:54.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.074+0000 7f906e59c700 1 --2- 172.21.15.82:0/137382285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90680dee50 0x7f90680e16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:54.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.074+0000 7f906e59c700 1 -- 172.21.15.82:0/137382285 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9068054770 con 0x7f906804f880 2023-11-28T13:04:54.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.074+0000 7f906ed9d700 1 --2- 172.21.15.82:0/137382285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90680dee50 0x7f90680e16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:04:54.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.074+0000 7f906e59c700 1 --2- 172.21.15.82:0/137382285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f906804f880 0x7f90680ceab0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f906400e9d0 tx=0x7f906400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:54.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.074+0000 7f905effd700 1 -- 172.21.15.82:0/137382285 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9064009720 con 0x7f906804f880 2023-11-28T13:04:54.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.074+0000 7f905effd700 1 -- 172.21.15.82:0/137382285 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906400c640 con 0x7f906804f880 2023-11-28T13:04:54.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.074+0000 7f906f59e700 1 -- 172.21.15.82:0/137382285 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9068054490 con 0x7f906804f880 2023-11-28T13:04:54.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.074+0000 7f905effd700 1 -- 172.21.15.82:0/137382285 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906400c9b0 con 0x7f906804f880 2023-11-28T13:04:54.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.074+0000 7f906f59e700 1 -- 172.21.15.82:0/137382285 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9068006160 con 0x7f906804f880 2023-11-28T13:04:54.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.074+0000 7f906f59e700 1 -- 172.21.15.82:0/137382285 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9068005550 con 0x7f906804f880 2023-11-28T13:04:54.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.078+0000 7f905effd700 1 -- 172.21.15.82:0/137382285 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9064019030 con 0x7f906804f880 2023-11-28T13:04:54.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.078+0000 7f905effd700 1 --2- 172.21.15.82:0/137382285 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9050064ee0 0x7f9050067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:54.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.078+0000 7f905effd700 1 -- 172.21.15.82:0/137382285 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f9064081eb0 con 0x7f906804f880 2023-11-28T13:04:54.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.078+0000 7f906dd9b700 1 --2- 172.21.15.82:0/137382285 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9050064ee0 0x7f9050067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:54.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.078+0000 7f906dd9b700 1 --2- 172.21.15.82:0/137382285 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9050064ee0 0x7f9050067390 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f90680e13a0 tx=0x7f9060007f30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:54.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.082+0000 7f905effd700 1 -- 172.21.15.82:0/137382285 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f906404fe60 con 0x7f906804f880 2023-11-28T13:04:54.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.282+0000 7f906f59e700 1 -- 172.21.15.82:0/137382285 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9068055a50 con 0x7f906804f880 2023-11-28T13:04:54.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.282+0000 7f905effd700 1 -- 172.21.15.82:0/137382285 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f9064053480 con 0x7f906804f880 2023-11-28T13:04:54.285 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:04:54.285 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:04:54.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.286+0000 7f906f59e700 1 -- 172.21.15.82:0/137382285 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9050064ee0 msgr2=0x7f9050067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:54.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.286+0000 7f906f59e700 1 --2- 172.21.15.82:0/137382285 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9050064ee0 0x7f9050067390 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f90680e13a0 tx=0x7f9060007f30 comp rx=0 tx=0).stop 2023-11-28T13:04:54.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.286+0000 7f906f59e700 1 -- 172.21.15.82:0/137382285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f906804f880 msgr2=0x7f90680ceab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:54.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.286+0000 7f906f59e700 1 --2- 172.21.15.82:0/137382285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f906804f880 0x7f90680ceab0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f906400e9d0 tx=0x7f906400ece0 comp rx=0 tx=0).stop 2023-11-28T13:04:54.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.286+0000 7f906f59e700 1 -- 172.21.15.82:0/137382285 shutdown_connections 2023-11-28T13:04:54.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.286+0000 7f906f59e700 1 --2- 172.21.15.82:0/137382285 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9050064ee0 0x7f9050067390 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:54.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.286+0000 7f906f59e700 1 --2- 172.21.15.82:0/137382285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90680dee50 0x7f90680e16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:54.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.286+0000 7f906f59e700 1 --2- 172.21.15.82:0/137382285 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f90680538d0 0x7f90680e0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:54.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.286+0000 7f906f59e700 1 --2- 172.21.15.82:0/137382285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f906804f880 0x7f90680ceab0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:54.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.286+0000 7f906f59e700 1 -- 172.21.15.82:0/137382285 >> 172.21.15.82:0/137382285 conn(0x7f9068051770 msgr2=0x7f9068051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:54.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.286+0000 7f906f59e700 1 -- 172.21.15.82:0/137382285 shutdown_connections 2023-11-28T13:04:54.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:54.286+0000 7f906f59e700 1 -- 172.21.15.82:0/137382285 wait complete. 2023-11-28T13:04:54.299 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:04:57.662 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:04:57.664 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:04:59.300 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:04:59.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.414+0000 7f4aa4832700 1 Processor -- start 2023-11-28T13:04:59.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.414+0000 7f4aa4832700 1 -- start start 2023-11-28T13:04:59.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4aa4832700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4aa01586f0 0x7f4aa015c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:59.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4aa4832700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4aa0070900 0x7f4aa0070d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4aa4832700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa006c3b0 con 0x7f4aa00c8c50 2023-11-28T13:04:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4aa4832700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa0071280 con 0x7f4aa0070900 2023-11-28T13:04:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4aa4832700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa015c8b0 con 0x7f4aa01586f0 2023-11-28T13:04:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4a9ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4aa0070900 0x7f4aa0070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4a9effd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4aa00c8c50 0x7f4aa006d880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56332/0 (socket says 172.21.15.82:56332) 2023-11-28T13:04:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4a9effd700 1 -- 172.21.15.82:0/3959610752 learned_addr learned my addr 172.21.15.82:0/3959610752 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:04:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4a9f7fe700 1 --2- 172.21.15.82:0/3959610752 >> v2:172.21.15.114:3300/0 conn(0x7f4aa01586f0 0x7f4aa015c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4a9ffff700 1 -- 172.21.15.82:0/3959610752 >> v2:172.21.15.114:3300/0 conn(0x7f4aa01586f0 msgr2=0x7f4aa015c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:04:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4a9ffff700 1 --2- 172.21.15.82:0/3959610752 >> v2:172.21.15.114:3300/0 conn(0x7f4aa01586f0 0x7f4aa015c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4a9ffff700 1 -- 172.21.15.82:0/3959610752 >> v1:172.21.15.82:6789/0 conn(0x7f4aa00c8c50 legacy=0x7f4aa006d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4a9ffff700 1 -- 172.21.15.82:0/3959610752 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa015cb90 con 0x7f4aa0070900 2023-11-28T13:04:59.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4a9ffff700 1 --2- 172.21.15.82:0/3959610752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4aa0070900 0x7f4aa0070d40 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f4aa00c5680 tx=0x7f4a9800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310fb5f438a72a27 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:59.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4a9e7fc700 1 -- 172.21.15.82:0/3959610752 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9800dd30 con 0x7f4aa0070900 2023-11-28T13:04:59.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4a9e7fc700 1 -- 172.21.15.82:0/3959610752 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9800de90 con 0x7f4aa0070900 2023-11-28T13:04:59.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4a9e7fc700 1 -- 172.21.15.82:0/3959610752 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a98010690 con 0x7f4aa0070900 2023-11-28T13:04:59.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4aa4832700 1 -- 172.21.15.82:0/3959610752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4aa0070900 msgr2=0x7f4aa0070d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:59.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4aa4832700 1 --2- 172.21.15.82:0/3959610752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4aa0070900 0x7f4aa0070d40 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f4aa00c5680 tx=0x7f4a9800bdd0 comp rx=0 tx=0).stop 2023-11-28T13:04:59.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4aa4832700 1 -- 172.21.15.82:0/3959610752 shutdown_connections 2023-11-28T13:04:59.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4aa4832700 1 --2- 172.21.15.82:0/3959610752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4aa0070900 0x7f4aa0070d40 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:59.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4aa4832700 1 --2- 172.21.15.82:0/3959610752 >> v2:172.21.15.114:3300/0 conn(0x7f4aa01586f0 0x7f4aa015c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:59.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4aa4832700 1 -- 172.21.15.82:0/3959610752 >> 172.21.15.82:0/3959610752 conn(0x7f4aa00ce600 msgr2=0x7f4aa00ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:59.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4aa4832700 1 -- 172.21.15.82:0/3959610752 shutdown_connections 2023-11-28T13:04:59.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.418+0000 7f4aa4832700 1 -- 172.21.15.82:0/3959610752 wait complete. 2023-11-28T13:04:59.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.422+0000 7f4aa4832700 1 Processor -- start 2023-11-28T13:04:59.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.422+0000 7f4aa4832700 1 -- start start 2023-11-28T13:04:59.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.422+0000 7f4aa4832700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4aa0070900 0x7f4aa01f5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:59.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.422+0000 7f4aa4832700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4aa00c8c50 0x7f4aa0158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:59.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.422+0000 7f4aa4832700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4aa01586f0 0x7f4aa0149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:59.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.422+0000 7f4aa4832700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa01592a0 con 0x7f4aa00c8c50 2023-11-28T13:04:59.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.422+0000 7f4aa4832700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa0159000 con 0x7f4aa01586f0 2023-11-28T13:04:59.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.422+0000 7f4aa4832700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa015b350 con 0x7f4aa0070900 2023-11-28T13:04:59.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.422+0000 7f4a9effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4aa00c8c50 0x7f4aa0158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:59.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.422+0000 7f4a9effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4aa00c8c50 0x7f4aa0158ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47916/0 (socket says 172.21.15.82:47916) 2023-11-28T13:04:59.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.422+0000 7f4a9effd700 1 -- 172.21.15.82:0/1118124224 learned_addr learned my addr 172.21.15.82:0/1118124224 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:04:59.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.422+0000 7f4a9ffff700 1 --2- 172.21.15.82:0/1118124224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4aa01586f0 0x7f4aa0149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:59.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.422+0000 7f4a9f7fe700 1 --2- 172.21.15.82:0/1118124224 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4aa0070900 0x7f4aa01f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:59.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.422+0000 7f4a9ffff700 1 -- 172.21.15.82:0/1118124224 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4aa0070900 msgr2=0x7f4aa01f5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:59.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.422+0000 7f4a9ffff700 1 --2- 172.21.15.82:0/1118124224 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4aa0070900 0x7f4aa01f5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:59.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.422+0000 7f4a9ffff700 1 -- 172.21.15.82:0/1118124224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4aa00c8c50 msgr2=0x7f4aa0158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:59.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.422+0000 7f4a9ffff700 1 --2- 172.21.15.82:0/1118124224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4aa00c8c50 0x7f4aa0158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:59.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.422+0000 7f4a9ffff700 1 -- 172.21.15.82:0/1118124224 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9800b750 con 0x7f4aa01586f0 2023-11-28T13:04:59.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.422+0000 7f4a9effd700 1 --2- 172.21.15.82:0/1118124224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4aa00c8c50 0x7f4aa0158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:04:59.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.422+0000 7f4a9ffff700 1 --2- 172.21.15.82:0/1118124224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4aa01586f0 0x7f4aa0149160 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4a98018000 tx=0x7f4a98004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:59.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.426+0000 7f4a87fff700 1 -- 172.21.15.82:0/1118124224 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a98003c10 con 0x7f4aa01586f0 2023-11-28T13:04:59.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.426+0000 7f4a87fff700 1 -- 172.21.15.82:0/1118124224 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a98003d90 con 0x7f4aa01586f0 2023-11-28T13:04:59.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.426+0000 7f4aa4832700 1 -- 172.21.15.82:0/1118124224 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa015d150 con 0x7f4aa01586f0 2023-11-28T13:04:59.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.426+0000 7f4a87fff700 1 -- 172.21.15.82:0/1118124224 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a980106b0 con 0x7f4aa01586f0 2023-11-28T13:04:59.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.426+0000 7f4aa4832700 1 -- 172.21.15.82:0/1118124224 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa015ce70 con 0x7f4aa01586f0 2023-11-28T13:04:59.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.426+0000 7f4aa4832700 1 -- 172.21.15.82:0/1118124224 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa00c90f0 con 0x7f4aa01586f0 2023-11-28T13:04:59.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.426+0000 7f4a87fff700 1 -- 172.21.15.82:0/1118124224 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4a98029020 con 0x7f4aa01586f0 2023-11-28T13:04:59.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.426+0000 7f4a87fff700 1 --2- 172.21.15.82:0/1118124224 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4a8c064ee0 0x7f4a8c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:04:59.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.426+0000 7f4a87fff700 1 -- 172.21.15.82:0/1118124224 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f4a98083690 con 0x7f4aa01586f0 2023-11-28T13:04:59.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.426+0000 7f4a9f7fe700 1 --2- 172.21.15.82:0/1118124224 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4a8c064ee0 0x7f4a8c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:04:59.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.430+0000 7f4a9f7fe700 1 --2- 172.21.15.82:0/1118124224 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4a8c064ee0 0x7f4a8c067390 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4a94007a60 tx=0x7f4a94008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:04:59.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.438+0000 7f4a87fff700 1 -- 172.21.15.82:0/1118124224 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4a980517b0 con 0x7f4aa01586f0 2023-11-28T13:04:59.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.630+0000 7f4aa4832700 1 -- 172.21.15.82:0/1118124224 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4aa0065fc0 con 0x7f4aa01586f0 2023-11-28T13:04:59.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.634+0000 7f4a87fff700 1 -- 172.21.15.82:0/1118124224 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f4a98054dd0 con 0x7f4aa01586f0 2023-11-28T13:04:59.638 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:04:59.638 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:04:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.638+0000 7f4aa4832700 1 -- 172.21.15.82:0/1118124224 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4a8c064ee0 msgr2=0x7f4a8c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.638+0000 7f4aa4832700 1 --2- 172.21.15.82:0/1118124224 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4a8c064ee0 0x7f4a8c067390 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4a94007a60 tx=0x7f4a94008040 comp rx=0 tx=0).stop 2023-11-28T13:04:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.638+0000 7f4aa4832700 1 -- 172.21.15.82:0/1118124224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4aa01586f0 msgr2=0x7f4aa0149160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:04:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.638+0000 7f4aa4832700 1 --2- 172.21.15.82:0/1118124224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4aa01586f0 0x7f4aa0149160 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4a98018000 tx=0x7f4a98004770 comp rx=0 tx=0).stop 2023-11-28T13:04:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.638+0000 7f4aa4832700 1 -- 172.21.15.82:0/1118124224 shutdown_connections 2023-11-28T13:04:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.638+0000 7f4aa4832700 1 --2- 172.21.15.82:0/1118124224 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4a8c064ee0 0x7f4a8c067390 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.638+0000 7f4aa4832700 1 --2- 172.21.15.82:0/1118124224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4aa01586f0 0x7f4aa0149160 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.638+0000 7f4aa4832700 1 --2- 172.21.15.82:0/1118124224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4aa00c8c50 0x7f4aa0158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.638+0000 7f4aa4832700 1 --2- 172.21.15.82:0/1118124224 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4aa0070900 0x7f4aa01f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:04:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.638+0000 7f4aa4832700 1 -- 172.21.15.82:0/1118124224 >> 172.21.15.82:0/1118124224 conn(0x7f4aa00ce600 msgr2=0x7f4aa006d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:04:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.638+0000 7f4aa4832700 1 -- 172.21.15.82:0/1118124224 shutdown_connections 2023-11-28T13:04:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:04:59.638+0000 7f4aa4832700 1 -- 172.21.15.82:0/1118124224 wait complete. 2023-11-28T13:04:59.656 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:05:04.657 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:05:04.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f95508e7700 1 Processor -- start 2023-11-28T13:05:04.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f95508e7700 1 -- start start 2023-11-28T13:05:04.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f95508e7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f954c06b910 0x7f954c160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:04.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f95508e7700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f954c0ced70 0x7f954c06bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:04.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f95508e7700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954c0d28e0 con 0x7f954c069bc0 2023-11-28T13:05:04.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f95508e7700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954c0cdfe0 con 0x7f954c06b910 2023-11-28T13:05:04.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f95508e7700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954c160cc0 con 0x7f954c0ced70 2023-11-28T13:05:04.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f954b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f954c06b910 0x7f954c160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:04.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f954bfff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f954c069bc0 0x7f954c069fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56342/0 (socket says 172.21.15.82:56342) 2023-11-28T13:05:04.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f954bfff700 1 -- 172.21.15.82:0/351905439 learned_addr learned my addr 172.21.15.82:0/351905439 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:05:04.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f954affd700 1 --2- 172.21.15.82:0/351905439 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f954c0ced70 0x7f954c06bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:04.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f954b7fe700 1 -- 172.21.15.82:0/351905439 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f954c0ced70 msgr2=0x7f954c06bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:05:04.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f954b7fe700 1 --2- 172.21.15.82:0/351905439 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f954c0ced70 0x7f954c06bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:04.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f954b7fe700 1 -- 172.21.15.82:0/351905439 >> v1:172.21.15.82:6789/0 conn(0x7f954c069bc0 legacy=0x7f954c069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:04.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f954b7fe700 1 -- 172.21.15.82:0/351905439 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c06c220 con 0x7f954c06b910 2023-11-28T13:05:04.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f954a7fc700 1 -- 172.21.15.82:0/351905439 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569024078 0 0) 0x7f9544001490 con 0x7f954c069bc0 2023-11-28T13:05:04.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f954b7fe700 1 --2- 172.21.15.82:0/351905439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f954c06b910 0x7f954c160780 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f953c009850 tx=0x7f953c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed35b8280ec77904 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:04.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f954a7fc700 1 -- 172.21.15.82:0/351905439 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c011830 con 0x7f954c06b910 2023-11-28T13:05:04.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f954a7fc700 1 -- 172.21.15.82:0/351905439 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953c011990 con 0x7f954c06b910 2023-11-28T13:05:04.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f954a7fc700 1 -- 172.21.15.82:0/351905439 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c011d20 con 0x7f954c06b910 2023-11-28T13:05:04.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f95508e7700 1 -- 172.21.15.82:0/351905439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f954c06b910 msgr2=0x7f954c160780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:04.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f95508e7700 1 --2- 172.21.15.82:0/351905439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f954c06b910 0x7f954c160780 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f953c009850 tx=0x7f953c009b60 comp rx=0 tx=0).stop 2023-11-28T13:05:04.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f95508e7700 1 -- 172.21.15.82:0/351905439 shutdown_connections 2023-11-28T13:05:04.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f95508e7700 1 --2- 172.21.15.82:0/351905439 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f954c0ced70 0x7f954c06bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:04.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f95508e7700 1 --2- 172.21.15.82:0/351905439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f954c06b910 0x7f954c160780 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:04.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f95508e7700 1 -- 172.21.15.82:0/351905439 >> 172.21.15.82:0/351905439 conn(0x7f954c0d2b20 msgr2=0x7f954c0d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:04.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f95508e7700 1 -- 172.21.15.82:0/351905439 shutdown_connections 2023-11-28T13:05:04.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.774+0000 7f95508e7700 1 -- 172.21.15.82:0/351905439 wait complete. 2023-11-28T13:05:04.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f95508e7700 1 Processor -- start 2023-11-28T13:05:04.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f95508e7700 1 -- start start 2023-11-28T13:05:04.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f95508e7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f954c069bc0 0x7f954c1f14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:04.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f95508e7700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f954c06b910 0x7f954c0cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:04.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f95508e7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f954c0ced70 0x7f954c14e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:04.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f95508e7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c0c9210 con 0x7f954c0ced70 2023-11-28T13:05:04.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f95508e7700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c1f1a20 con 0x7f954c069bc0 2023-11-28T13:05:04.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f95508e7700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954c0c8c50 con 0x7f954c06b910 2023-11-28T13:05:04.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f954bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f954c0ced70 0x7f954c14e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:04.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f954bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f954c0ced70 0x7f954c14e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47946/0 (socket says 172.21.15.82:47946) 2023-11-28T13:05:04.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f954bfff700 1 -- 172.21.15.82:0/1755206491 learned_addr learned my addr 172.21.15.82:0/1755206491 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:05:04.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f954b7fe700 1 --2- 172.21.15.82:0/1755206491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f954c069bc0 0x7f954c1f14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:04.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f954affd700 1 --2- 172.21.15.82:0/1755206491 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f954c06b910 0x7f954c0cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:04.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f954bfff700 1 -- 172.21.15.82:0/1755206491 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f954c06b910 msgr2=0x7f954c0cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:04.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f954bfff700 1 --2- 172.21.15.82:0/1755206491 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f954c06b910 0x7f954c0cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:04.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f954bfff700 1 -- 172.21.15.82:0/1755206491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f954c069bc0 msgr2=0x7f954c1f14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:04.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f954bfff700 1 --2- 172.21.15.82:0/1755206491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f954c069bc0 0x7f954c1f14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:04.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f954bfff700 1 -- 172.21.15.82:0/1755206491 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953c0094b0 con 0x7f954c0ced70 2023-11-28T13:05:04.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f954bfff700 1 --2- 172.21.15.82:0/1755206491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f954c0ced70 0x7f954c14e700 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f954400cba0 tx=0x7f954400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:04.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f9533fff700 1 -- 172.21.15.82:0/1755206491 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954400aa70 con 0x7f954c0ced70 2023-11-28T13:05:04.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f95508e7700 1 -- 172.21.15.82:0/1755206491 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954c0d1700 con 0x7f954c0ced70 2023-11-28T13:05:04.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f9533fff700 1 -- 172.21.15.82:0/1755206491 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954400abf0 con 0x7f954c0ced70 2023-11-28T13:05:04.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f95508e7700 1 -- 172.21.15.82:0/1755206491 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954c0b2040 con 0x7f954c0ced70 2023-11-28T13:05:04.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.778+0000 7f9533fff700 1 -- 172.21.15.82:0/1755206491 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95440070d0 con 0x7f954c0ced70 2023-11-28T13:05:04.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.782+0000 7f95508e7700 1 -- 172.21.15.82:0/1755206491 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f954c0cf2c0 con 0x7f954c0ced70 2023-11-28T13:05:04.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.782+0000 7f9533fff700 1 -- 172.21.15.82:0/1755206491 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9544010070 con 0x7f954c0ced70 2023-11-28T13:05:04.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.782+0000 7f9533fff700 1 --2- 172.21.15.82:0/1755206491 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9538064ee0 0x7f9538067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:04.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.782+0000 7f9533fff700 1 -- 172.21.15.82:0/1755206491 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f9544081630 con 0x7f954c0ced70 2023-11-28T13:05:04.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.782+0000 7f954b7fe700 1 --2- 172.21.15.82:0/1755206491 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9538064ee0 0x7f9538067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:04.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.782+0000 7f954b7fe700 1 --2- 172.21.15.82:0/1755206491 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9538064ee0 0x7f9538067390 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f953c014040 tx=0x7f953c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:04.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.790+0000 7f9533fff700 1 -- 172.21.15.82:0/1755206491 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f954404f6d0 con 0x7f954c0ced70 2023-11-28T13:05:04.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.986+0000 7f95508e7700 1 -- 172.21.15.82:0/1755206491 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f954c0d28e0 con 0x7f954c0ced70 2023-11-28T13:05:04.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.986+0000 7f9533fff700 1 -- 172.21.15.82:0/1755206491 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f95440180c0 con 0x7f954c0ced70 2023-11-28T13:05:04.988 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:05:04.988 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:05:04.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.986+0000 7f95508e7700 1 -- 172.21.15.82:0/1755206491 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9538064ee0 msgr2=0x7f9538067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:04.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.986+0000 7f95508e7700 1 --2- 172.21.15.82:0/1755206491 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9538064ee0 0x7f9538067390 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f953c014040 tx=0x7f953c008030 comp rx=0 tx=0).stop 2023-11-28T13:05:04.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.986+0000 7f95508e7700 1 -- 172.21.15.82:0/1755206491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f954c0ced70 msgr2=0x7f954c14e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:04.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.986+0000 7f95508e7700 1 --2- 172.21.15.82:0/1755206491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f954c0ced70 0x7f954c14e700 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f954400cba0 tx=0x7f954400ceb0 comp rx=0 tx=0).stop 2023-11-28T13:05:04.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.986+0000 7f95508e7700 1 -- 172.21.15.82:0/1755206491 shutdown_connections 2023-11-28T13:05:04.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.986+0000 7f95508e7700 1 --2- 172.21.15.82:0/1755206491 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9538064ee0 0x7f9538067390 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:04.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.986+0000 7f95508e7700 1 --2- 172.21.15.82:0/1755206491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f954c0ced70 0x7f954c14e700 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:04.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.986+0000 7f95508e7700 1 --2- 172.21.15.82:0/1755206491 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f954c06b910 0x7f954c0cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:04.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.986+0000 7f95508e7700 1 --2- 172.21.15.82:0/1755206491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f954c069bc0 0x7f954c1f14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:04.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.986+0000 7f95508e7700 1 -- 172.21.15.82:0/1755206491 >> 172.21.15.82:0/1755206491 conn(0x7f954c0d2b20 msgr2=0x7f954c160350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:04.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.986+0000 7f95508e7700 1 -- 172.21.15.82:0/1755206491 shutdown_connections 2023-11-28T13:05:04.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:04.986+0000 7f95508e7700 1 -- 172.21.15.82:0/1755206491 wait complete. 2023-11-28T13:05:05.003 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:05:10.003 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:05:10.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.118+0000 7f263f59e700 1 Processor -- start 2023-11-28T13:05:10.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.118+0000 7f263f59e700 1 -- start start 2023-11-28T13:05:10.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.118+0000 7f263f59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26400b6140 0x7f26400afb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:10.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.118+0000 7f263f59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f264015b6e0 0x7f26400d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:10.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.118+0000 7f263f59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f264015c820 con 0x7f264015a580 2023-11-28T13:05:10.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.118+0000 7f263f59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26400cb240 con 0x7f26400b6140 2023-11-28T13:05:10.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.118+0000 7f263f59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26400b0050 con 0x7f264015b6e0 2023-11-28T13:05:10.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.118+0000 7f263e59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26400b6140 0x7f26400afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:10.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.118+0000 7f263e59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26400b6140 0x7f26400afb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57674/0 (socket says 172.21.15.82:57674) 2023-11-28T13:05:10.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.118+0000 7f263e59c700 1 -- 172.21.15.82:0/4116848358 learned_addr learned my addr 172.21.15.82:0/4116848358 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:05:10.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.118+0000 7f263dd9b700 1 --2- 172.21.15.82:0/4116848358 >> v2:172.21.15.114:3300/0 conn(0x7f264015b6e0 0x7f26400d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:10.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.118+0000 7f263e59c700 1 -- 172.21.15.82:0/4116848358 >> v2:172.21.15.114:3300/0 conn(0x7f264015b6e0 msgr2=0x7f26400d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:05:10.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.118+0000 7f263e59c700 1 --2- 172.21.15.82:0/4116848358 >> v2:172.21.15.114:3300/0 conn(0x7f264015b6e0 0x7f26400d0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:10.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.118+0000 7f263e59c700 1 -- 172.21.15.82:0/4116848358 >> v1:172.21.15.114:6789/0 conn(0x7f264015a580 legacy=0x7f264015a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:10.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.118+0000 7f263d59a700 1 -- 172.21.15.82:0/4116848358 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631481443 0 0) 0x7f264015c820 con 0x7f264015a580 2023-11-28T13:05:10.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.118+0000 7f263e59c700 1 -- 172.21.15.82:0/4116848358 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26400d1480 con 0x7f26400b6140 2023-11-28T13:05:10.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.118+0000 7f263dd9b700 1 --2- 172.21.15.82:0/4116848358 >> v2:172.21.15.114:3300/0 conn(0x7f264015b6e0 0x7f26400d0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:05:10.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.122+0000 7f263e59c700 1 --2- 172.21.15.82:0/4116848358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26400b6140 0x7f26400afb10 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2630009910 tx=0x7f2630009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57c535b749ba87b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:10.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.122+0000 7f263d59a700 1 -- 172.21.15.82:0/4116848358 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2630011830 con 0x7f26400b6140 2023-11-28T13:05:10.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.122+0000 7f263d59a700 1 -- 172.21.15.82:0/4116848358 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2630011990 con 0x7f26400b6140 2023-11-28T13:05:10.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.122+0000 7f263d59a700 1 -- 172.21.15.82:0/4116848358 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2630011d40 con 0x7f26400b6140 2023-11-28T13:05:10.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.122+0000 7f263f59e700 1 -- 172.21.15.82:0/4116848358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26400b6140 msgr2=0x7f26400afb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:10.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.122+0000 7f263f59e700 1 --2- 172.21.15.82:0/4116848358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26400b6140 0x7f26400afb10 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2630009910 tx=0x7f2630009c20 comp rx=0 tx=0).stop 2023-11-28T13:05:10.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.122+0000 7f263f59e700 1 -- 172.21.15.82:0/4116848358 shutdown_connections 2023-11-28T13:05:10.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.122+0000 7f263f59e700 1 --2- 172.21.15.82:0/4116848358 >> v2:172.21.15.114:3300/0 conn(0x7f264015b6e0 0x7f26400d0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:10.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.122+0000 7f263f59e700 1 --2- 172.21.15.82:0/4116848358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26400b6140 0x7f26400afb10 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:10.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.122+0000 7f263f59e700 1 -- 172.21.15.82:0/4116848358 >> 172.21.15.82:0/4116848358 conn(0x7f26400cdf40 msgr2=0x7f26400d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:10.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.122+0000 7f263f59e700 1 -- 172.21.15.82:0/4116848358 shutdown_connections 2023-11-28T13:05:10.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.122+0000 7f263f59e700 1 -- 172.21.15.82:0/4116848358 wait complete. 2023-11-28T13:05:10.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.122+0000 7f263f59e700 1 Processor -- start 2023-11-28T13:05:10.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.122+0000 7f263f59e700 1 -- start start 2023-11-28T13:05:10.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f263f59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26400b6140 0x7f2640158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:10.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f263f59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f264015a580 0x7f26400b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:10.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f263f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f264015b6e0 0x7f26401f1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:10.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f263f59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26400b4840 con 0x7f264015b6e0 2023-11-28T13:05:10.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f263f59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2640159320 con 0x7f264015a580 2023-11-28T13:05:10.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f263f59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26400b4560 con 0x7f26400b6140 2023-11-28T13:05:10.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f263ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f264015b6e0 0x7f26401f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:10.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f263ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f264015b6e0 0x7f26401f1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57688/0 (socket says 172.21.15.82:57688) 2023-11-28T13:05:10.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f263ed9d700 1 -- 172.21.15.82:0/4144301828 learned_addr learned my addr 172.21.15.82:0/4144301828 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:05:10.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f263dd9b700 1 --2- 172.21.15.82:0/4144301828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f264015a580 0x7f26400b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:10.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f263e59c700 1 --2- 172.21.15.82:0/4144301828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26400b6140 0x7f2640158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:10.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f263ed9d700 1 -- 172.21.15.82:0/4144301828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26400b6140 msgr2=0x7f2640158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:10.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f263ed9d700 1 --2- 172.21.15.82:0/4144301828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26400b6140 0x7f2640158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:10.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f263ed9d700 1 -- 172.21.15.82:0/4144301828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f264015a580 msgr2=0x7f26400b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:10.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f263ed9d700 1 --2- 172.21.15.82:0/4144301828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f264015a580 0x7f26400b3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:10.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f263ed9d700 1 -- 172.21.15.82:0/4144301828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2628009a70 con 0x7f264015b6e0 2023-11-28T13:05:10.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f263ed9d700 1 --2- 172.21.15.82:0/4144301828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f264015b6e0 0x7f26401f1590 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f26380011e0 tx=0x7f263800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:10.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f2636ffd700 1 -- 172.21.15.82:0/4144301828 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26380054e0 con 0x7f264015b6e0 2023-11-28T13:05:10.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f2636ffd700 1 -- 172.21.15.82:0/4144301828 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26380036a0 con 0x7f264015b6e0 2023-11-28T13:05:10.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f263f59e700 1 -- 172.21.15.82:0/4144301828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2630009570 con 0x7f264015b6e0 2023-11-28T13:05:10.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f2636ffd700 1 -- 172.21.15.82:0/4144301828 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638003a50 con 0x7f264015b6e0 2023-11-28T13:05:10.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.126+0000 7f263f59e700 1 -- 172.21.15.82:0/4144301828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264015bef0 con 0x7f264015b6e0 2023-11-28T13:05:10.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.130+0000 7f263f59e700 1 -- 172.21.15.82:0/4144301828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264015bc10 con 0x7f264015b6e0 2023-11-28T13:05:10.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.130+0000 7f2636ffd700 1 -- 172.21.15.82:0/4144301828 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2638019030 con 0x7f264015b6e0 2023-11-28T13:05:10.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.130+0000 7f2636ffd700 1 --2- 172.21.15.82:0/4144301828 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2620064ee0 0x7f2620067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:10.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.130+0000 7f2636ffd700 1 -- 172.21.15.82:0/4144301828 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f26380811d0 con 0x7f264015b6e0 2023-11-28T13:05:10.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.130+0000 7f263e59c700 1 --2- 172.21.15.82:0/4144301828 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2620064ee0 0x7f2620067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:10.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.130+0000 7f263e59c700 1 --2- 172.21.15.82:0/4144301828 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2620064ee0 0x7f2620067390 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2630014040 tx=0x7f2630008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:10.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.138+0000 7f2636ffd700 1 -- 172.21.15.82:0/4144301828 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f263804f2f0 con 0x7f264015b6e0 2023-11-28T13:05:10.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.334+0000 7f263f59e700 1 -- 172.21.15.82:0/4144301828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f26400ab8b0 con 0x7f264015b6e0 2023-11-28T13:05:10.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.334+0000 7f2636ffd700 1 -- 172.21.15.82:0/4144301828 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f26400ab8b0 con 0x7f264015b6e0 2023-11-28T13:05:10.338 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:05:10.338 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:05:10.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.338+0000 7f263f59e700 1 -- 172.21.15.82:0/4144301828 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2620064ee0 msgr2=0x7f2620067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:10.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.338+0000 7f263f59e700 1 --2- 172.21.15.82:0/4144301828 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2620064ee0 0x7f2620067390 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2630014040 tx=0x7f2630008030 comp rx=0 tx=0).stop 2023-11-28T13:05:10.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.338+0000 7f263f59e700 1 -- 172.21.15.82:0/4144301828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f264015b6e0 msgr2=0x7f26401f1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:10.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.338+0000 7f263f59e700 1 --2- 172.21.15.82:0/4144301828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f264015b6e0 0x7f26401f1590 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f26380011e0 tx=0x7f263800c800 comp rx=0 tx=0).stop 2023-11-28T13:05:10.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.338+0000 7f263f59e700 1 -- 172.21.15.82:0/4144301828 shutdown_connections 2023-11-28T13:05:10.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.338+0000 7f263f59e700 1 --2- 172.21.15.82:0/4144301828 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2620064ee0 0x7f2620067390 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:10.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.338+0000 7f263f59e700 1 --2- 172.21.15.82:0/4144301828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f264015b6e0 0x7f26401f1590 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:10.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.338+0000 7f263f59e700 1 --2- 172.21.15.82:0/4144301828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f264015a580 0x7f26400b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:10.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.338+0000 7f263f59e700 1 --2- 172.21.15.82:0/4144301828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f26400b6140 0x7f2640158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:10.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.338+0000 7f263f59e700 1 -- 172.21.15.82:0/4144301828 >> 172.21.15.82:0/4144301828 conn(0x7f26400cdf40 msgr2=0x7f264015ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:10.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.338+0000 7f263f59e700 1 -- 172.21.15.82:0/4144301828 shutdown_connections 2023-11-28T13:05:10.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:10.338+0000 7f263f59e700 1 -- 172.21.15.82:0/4144301828 wait complete. 2023-11-28T13:05:10.352 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:05:15.353 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:05:15.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.469+0000 7f3eb087b700 1 Processor -- start 2023-11-28T13:05:15.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.469+0000 7f3eb087b700 1 -- start start 2023-11-28T13:05:15.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.469+0000 7f3eb087b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3eac0ae080 0x7f3eac0703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:15.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.469+0000 7f3eb087b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac0c9b10 con 0x7f3eac0cd590 2023-11-28T13:05:15.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.469+0000 7f3eb087b700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac0c9d40 con 0x7f3eac070920 2023-11-28T13:05:15.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.469+0000 7f3eb087b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eac1599d0 con 0x7f3eac0ae080 2023-11-28T13:05:15.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.469+0000 7f3eaa59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3eac0ae080 0x7f3eac0703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:15.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.469+0000 7f3eaa59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3eac0ae080 0x7f3eac0703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57700/0 (socket says 172.21.15.82:57700) 2023-11-28T13:05:15.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.469+0000 7f3eaa59c700 1 -- 172.21.15.82:0/2153663872 learned_addr learned my addr 172.21.15.82:0/2153663872 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:05:15.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.469+0000 7f3eaad9d700 1 --1- 172.21.15.82:0/2153663872 >> v1:172.21.15.82:6789/0 conn(0x7f3eac0cd590 0x7f3eac06c870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58992/0 (socket says 172.21.15.82:58992) 2023-11-28T13:05:15.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.469+0000 7f3eaa59c700 1 -- 172.21.15.82:0/2153663872 >> v1:172.21.15.114:6789/0 conn(0x7f3eac070920 legacy=0x7f3eac06c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:15.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.469+0000 7f3eaa59c700 1 -- 172.21.15.82:0/2153663872 >> v1:172.21.15.82:6789/0 conn(0x7f3eac0cd590 legacy=0x7f3eac06c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:15.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.469+0000 7f3eaa59c700 1 -- 172.21.15.82:0/2153663872 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac0c9fe0 con 0x7f3eac0ae080 2023-11-28T13:05:15.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.469+0000 7f3eaa59c700 1 --2- 172.21.15.82:0/2153663872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3eac0ae080 0x7f3eac0703e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009910 tx=0x7f3ea0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98a88c0260926b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:15.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.469+0000 7f3ea959a700 1 -- 172.21.15.82:0/2153663872 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea000ba60 con 0x7f3eac0ae080 2023-11-28T13:05:15.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.469+0000 7f3ea959a700 1 -- 172.21.15.82:0/2153663872 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea000bbc0 con 0x7f3eac0ae080 2023-11-28T13:05:15.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.469+0000 7f3ea959a700 1 -- 172.21.15.82:0/2153663872 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0009e60 con 0x7f3eac0ae080 2023-11-28T13:05:15.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.473+0000 7f3eb087b700 1 -- 172.21.15.82:0/2153663872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3eac0ae080 msgr2=0x7f3eac0703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:15.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.473+0000 7f3eb087b700 1 --2- 172.21.15.82:0/2153663872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3eac0ae080 0x7f3eac0703e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009910 tx=0x7f3ea0009c20 comp rx=0 tx=0).stop 2023-11-28T13:05:15.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.473+0000 7f3eb087b700 1 -- 172.21.15.82:0/2153663872 shutdown_connections 2023-11-28T13:05:15.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.473+0000 7f3eb087b700 1 --2- 172.21.15.82:0/2153663872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3eac0ae080 0x7f3eac0703e0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:15.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.473+0000 7f3eb087b700 1 -- 172.21.15.82:0/2153663872 >> 172.21.15.82:0/2153663872 conn(0x7f3eac0ce9b0 msgr2=0x7f3eac0ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:15.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.473+0000 7f3eb087b700 1 -- 172.21.15.82:0/2153663872 shutdown_connections 2023-11-28T13:05:15.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.473+0000 7f3eb087b700 1 -- 172.21.15.82:0/2153663872 wait complete. 2023-11-28T13:05:15.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.473+0000 7f3eb087b700 1 Processor -- start 2023-11-28T13:05:15.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.473+0000 7f3eb087b700 1 -- start start 2023-11-28T13:05:15.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.473+0000 7f3eb087b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3eac070920 0x7f3eac151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:15.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.473+0000 7f3eb087b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3eac0ae080 0x7f3eac156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:15.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.473+0000 7f3eb087b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3eac0cd590 0x7f3eac0c2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:15.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.473+0000 7f3eb087b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac0b17e0 con 0x7f3eac0cd590 2023-11-28T13:05:15.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.473+0000 7f3eb087b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac15b320 con 0x7f3eac0ae080 2023-11-28T13:05:15.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.473+0000 7f3eb087b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac152450 con 0x7f3eac070920 2023-11-28T13:05:15.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.477+0000 7f3eaad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3eac0cd590 0x7f3eac0c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:15.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.477+0000 7f3eaad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3eac0cd590 0x7f3eac0c2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57706/0 (socket says 172.21.15.82:57706) 2023-11-28T13:05:15.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.477+0000 7f3eaad9d700 1 -- 172.21.15.82:0/3464160737 learned_addr learned my addr 172.21.15.82:0/3464160737 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:05:15.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.477+0000 7f3ea9d9b700 1 --2- 172.21.15.82:0/3464160737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3eac0ae080 0x7f3eac156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:15.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.477+0000 7f3eaa59c700 1 --2- 172.21.15.82:0/3464160737 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3eac070920 0x7f3eac151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:15.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.477+0000 7f3eaad9d700 1 -- 172.21.15.82:0/3464160737 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3eac070920 msgr2=0x7f3eac151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:15.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.477+0000 7f3eaad9d700 1 --2- 172.21.15.82:0/3464160737 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3eac070920 0x7f3eac151f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:15.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.477+0000 7f3eaad9d700 1 -- 172.21.15.82:0/3464160737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3eac0ae080 msgr2=0x7f3eac156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:15.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.477+0000 7f3eaad9d700 1 --2- 172.21.15.82:0/3464160737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3eac0ae080 0x7f3eac156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:15.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.477+0000 7f3eaad9d700 1 -- 172.21.15.82:0/3464160737 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea0009570 con 0x7f3eac0cd590 2023-11-28T13:05:15.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.477+0000 7f3ea9d9b700 1 --2- 172.21.15.82:0/3464160737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3eac0ae080 0x7f3eac156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:05:15.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.477+0000 7f3eaad9d700 1 --2- 172.21.15.82:0/3464160737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3eac0cd590 0x7f3eac0c2650 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400c410 tx=0x7f3ea400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:15.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.477+0000 7f3e9affd700 1 -- 172.21.15.82:0/3464160737 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4005cd0 con 0x7f3eac0cd590 2023-11-28T13:05:15.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.477+0000 7f3e9affd700 1 -- 172.21.15.82:0/3464160737 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea4005e30 con 0x7f3eac0cd590 2023-11-28T13:05:15.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.477+0000 7f3eb087b700 1 -- 172.21.15.82:0/3464160737 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eac0ca5a0 con 0x7f3eac0cd590 2023-11-28T13:05:15.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.477+0000 7f3e9affd700 1 -- 172.21.15.82:0/3464160737 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40072f0 con 0x7f3eac0cd590 2023-11-28T13:05:15.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.477+0000 7f3eb087b700 1 -- 172.21.15.82:0/3464160737 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eac0ca2c0 con 0x7f3eac0cd590 2023-11-28T13:05:15.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.477+0000 7f3eb087b700 1 -- 172.21.15.82:0/3464160737 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eac0ca880 con 0x7f3eac0cd590 2023-11-28T13:05:15.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.481+0000 7f3e9affd700 1 -- 172.21.15.82:0/3464160737 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3ea4019030 con 0x7f3eac0cd590 2023-11-28T13:05:15.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.481+0000 7f3e9affd700 1 --2- 172.21.15.82:0/3464160737 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3e8c064ee0 0x7f3e8c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:15.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.481+0000 7f3e9affd700 1 -- 172.21.15.82:0/3464160737 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f3ea4081340 con 0x7f3eac0cd590 2023-11-28T13:05:15.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.481+0000 7f3eaa59c700 1 --2- 172.21.15.82:0/3464160737 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3e8c064ee0 0x7f3e8c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.481+0000 7f3eaa59c700 1 --2- 172.21.15.82:0/3464160737 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3e8c064ee0 0x7f3e8c067390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0006f80 tx=0x7f3ea0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:15.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.485+0000 7f3e9affd700 1 -- 172.21.15.82:0/3464160737 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3ea404f370 con 0x7f3eac0cd590 2023-11-28T13:05:15.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.685+0000 7f3eb087b700 1 -- 172.21.15.82:0/3464160737 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3eac06e310 con 0x7f3eac0cd590 2023-11-28T13:05:15.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.685+0000 7f3e9affd700 1 -- 172.21.15.82:0/3464160737 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f3ea4052990 con 0x7f3eac0cd590 2023-11-28T13:05:15.688 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:05:15.688 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:05:15.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.685+0000 7f3eb087b700 1 -- 172.21.15.82:0/3464160737 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3e8c064ee0 msgr2=0x7f3e8c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:15.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.685+0000 7f3eb087b700 1 --2- 172.21.15.82:0/3464160737 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3e8c064ee0 0x7f3e8c067390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0006f80 tx=0x7f3ea0008030 comp rx=0 tx=0).stop 2023-11-28T13:05:15.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.685+0000 7f3eb087b700 1 -- 172.21.15.82:0/3464160737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3eac0cd590 msgr2=0x7f3eac0c2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:15.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.685+0000 7f3eb087b700 1 --2- 172.21.15.82:0/3464160737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3eac0cd590 0x7f3eac0c2650 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400c410 tx=0x7f3ea400c7d0 comp rx=0 tx=0).stop 2023-11-28T13:05:15.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.685+0000 7f3eb087b700 1 -- 172.21.15.82:0/3464160737 shutdown_connections 2023-11-28T13:05:15.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.685+0000 7f3eb087b700 1 --2- 172.21.15.82:0/3464160737 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3e8c064ee0 0x7f3e8c067390 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:15.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.685+0000 7f3eb087b700 1 --2- 172.21.15.82:0/3464160737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3eac0cd590 0x7f3eac0c2650 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:15.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.685+0000 7f3eb087b700 1 --2- 172.21.15.82:0/3464160737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3eac0ae080 0x7f3eac156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:15.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.685+0000 7f3eb087b700 1 --2- 172.21.15.82:0/3464160737 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3eac070920 0x7f3eac151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:15.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.685+0000 7f3eb087b700 1 -- 172.21.15.82:0/3464160737 >> 172.21.15.82:0/3464160737 conn(0x7f3eac0ce9b0 msgr2=0x7f3eac15cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:15.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.685+0000 7f3eb087b700 1 -- 172.21.15.82:0/3464160737 shutdown_connections 2023-11-28T13:05:15.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:15.685+0000 7f3eb087b700 1 -- 172.21.15.82:0/3464160737 wait complete. 2023-11-28T13:05:15.702 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:05:20.703 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:05:20.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.813+0000 7ff06486a700 1 Processor -- start 2023-11-28T13:05:20.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.813+0000 7ff06486a700 1 -- start start 2023-11-28T13:05:20.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff06486a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff06006b910 0x7ff060160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:20.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff06486a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0600ced70 0x7ff06006bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:20.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff06486a700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0600d28e0 con 0x7ff060069bc0 2023-11-28T13:05:20.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff06486a700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0600cdfe0 con 0x7ff0600ced70 2023-11-28T13:05:20.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff06486a700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff060160cc0 con 0x7ff06006b910 2023-11-28T13:05:20.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff05e59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0600ced70 0x7ff06006bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:20.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff05e59c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0600ced70 0x7ff06006bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52342/0 (socket says 172.21.15.82:52342) 2023-11-28T13:05:20.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff05e59c700 1 -- 172.21.15.82:0/3583031862 learned_addr learned my addr 172.21.15.82:0/3583031862 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:05:20.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff05ed9d700 1 --2- 172.21.15.82:0/3583031862 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff06006b910 0x7ff060160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:20.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff05e59c700 1 -- 172.21.15.82:0/3583031862 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff06006b910 msgr2=0x7ff060160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:05:20.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff05e59c700 1 --2- 172.21.15.82:0/3583031862 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff06006b910 0x7ff060160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:20.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff05e59c700 1 -- 172.21.15.82:0/3583031862 >> v1:172.21.15.114:6789/0 conn(0x7ff060069bc0 legacy=0x7ff060069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:20.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff05e59c700 1 -- 172.21.15.82:0/3583031862 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06006c220 con 0x7ff0600ced70 2023-11-28T13:05:20.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff05e59c700 1 --2- 172.21.15.82:0/3583031862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0600ced70 0x7ff06006bce0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7ff048009910 tx=0x7ff048009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8269894fb402abf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:20.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff05dd9b700 1 -- 172.21.15.82:0/3583031862 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04800ba60 con 0x7ff0600ced70 2023-11-28T13:05:20.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff05dd9b700 1 -- 172.21.15.82:0/3583031862 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04800bbc0 con 0x7ff0600ced70 2023-11-28T13:05:20.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff05dd9b700 1 -- 172.21.15.82:0/3583031862 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff048009e60 con 0x7ff0600ced70 2023-11-28T13:05:20.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff06486a700 1 -- 172.21.15.82:0/3583031862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0600ced70 msgr2=0x7ff06006bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:20.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff06486a700 1 --2- 172.21.15.82:0/3583031862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0600ced70 0x7ff06006bce0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7ff048009910 tx=0x7ff048009c20 comp rx=0 tx=0).stop 2023-11-28T13:05:20.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff06486a700 1 -- 172.21.15.82:0/3583031862 shutdown_connections 2023-11-28T13:05:20.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff06486a700 1 --2- 172.21.15.82:0/3583031862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0600ced70 0x7ff06006bce0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:20.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff06486a700 1 --2- 172.21.15.82:0/3583031862 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff06006b910 0x7ff060160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:20.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff06486a700 1 -- 172.21.15.82:0/3583031862 >> 172.21.15.82:0/3583031862 conn(0x7ff0600d2b20 msgr2=0x7ff0600d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:20.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff06486a700 1 -- 172.21.15.82:0/3583031862 shutdown_connections 2023-11-28T13:05:20.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.817+0000 7ff06486a700 1 -- 172.21.15.82:0/3583031862 wait complete. 2023-11-28T13:05:20.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.821+0000 7ff06486a700 1 Processor -- start 2023-11-28T13:05:20.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.821+0000 7ff06486a700 1 -- start start 2023-11-28T13:05:20.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff06486a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff060069bc0 0x7ff06014c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:20.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff06486a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff06006b910 0x7ff06014cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:20.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff06486a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0600ced70 0x7ff0600c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:20.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff06486a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06014c020 con 0x7ff0600ced70 2023-11-28T13:05:20.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff06486a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0600ccc40 con 0x7ff060069bc0 2023-11-28T13:05:20.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff06486a700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06014c440 con 0x7ff06006b910 2023-11-28T13:05:20.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff05f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0600ced70 0x7ff0600c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:20.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff05f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0600ced70 0x7ff0600c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52356/0 (socket says 172.21.15.82:52356) 2023-11-28T13:05:20.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff05f59e700 1 -- 172.21.15.82:0/22267672 learned_addr learned my addr 172.21.15.82:0/22267672 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:05:20.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff05e59c700 1 --2- 172.21.15.82:0/22267672 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff06006b910 0x7ff06014cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:20.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff05ed9d700 1 --2- 172.21.15.82:0/22267672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff060069bc0 0x7ff06014c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:20.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff05f59e700 1 -- 172.21.15.82:0/22267672 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff06006b910 msgr2=0x7ff06014cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:20.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff05f59e700 1 --2- 172.21.15.82:0/22267672 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff06006b910 0x7ff06014cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:20.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff05f59e700 1 -- 172.21.15.82:0/22267672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff060069bc0 msgr2=0x7ff06014c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:20.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff05f59e700 1 --2- 172.21.15.82:0/22267672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff060069bc0 0x7ff06014c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:20.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff05f59e700 1 -- 172.21.15.82:0/22267672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff048009570 con 0x7ff0600ced70 2023-11-28T13:05:20.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff05ed9d700 1 --2- 172.21.15.82:0/22267672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff060069bc0 0x7ff06014c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:05:20.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff05f59e700 1 --2- 172.21.15.82:0/22267672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0600ced70 0x7ff0600c8ba0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ff05800cb50 tx=0x7ff05800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:20.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff0577fe700 1 -- 172.21.15.82:0/22267672 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058003c20 con 0x7ff0600ced70 2023-11-28T13:05:20.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff0577fe700 1 -- 172.21.15.82:0/22267672 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff058003d80 con 0x7ff0600ced70 2023-11-28T13:05:20.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff06486a700 1 -- 172.21.15.82:0/22267672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0600d1700 con 0x7ff0600ced70 2023-11-28T13:05:20.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff0577fe700 1 -- 172.21.15.82:0/22267672 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05800a9c0 con 0x7ff0600ced70 2023-11-28T13:05:20.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff06486a700 1 -- 172.21.15.82:0/22267672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0600b2040 con 0x7ff0600ced70 2023-11-28T13:05:20.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.825+0000 7ff06486a700 1 -- 172.21.15.82:0/22267672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0600cf2c0 con 0x7ff0600ced70 2023-11-28T13:05:20.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.829+0000 7ff0577fe700 1 -- 172.21.15.82:0/22267672 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff058010050 con 0x7ff0600ced70 2023-11-28T13:05:20.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.829+0000 7ff0577fe700 1 --2- 172.21.15.82:0/22267672 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff040064f10 0x7ff0400673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:20.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.829+0000 7ff0577fe700 1 -- 172.21.15.82:0/22267672 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7ff058081cd0 con 0x7ff0600ced70 2023-11-28T13:05:20.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.829+0000 7ff05ed9d700 1 --2- 172.21.15.82:0/22267672 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff040064f10 0x7ff0400673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:20.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.829+0000 7ff05ed9d700 1 --2- 172.21.15.82:0/22267672 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff040064f10 0x7ff0400673c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff050007e50 tx=0x7ff050008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:20.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:20.837+0000 7ff0577fe700 1 -- 172.21.15.82:0/22267672 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff05804fd00 con 0x7ff0600ced70 2023-11-28T13:05:21.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:21.037+0000 7ff06486a700 1 -- 172.21.15.82:0/22267672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff06014c160 con 0x7ff0600ced70 2023-11-28T13:05:21.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:21.037+0000 7ff0577fe700 1 -- 172.21.15.82:0/22267672 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7ff06014c160 con 0x7ff0600ced70 2023-11-28T13:05:21.042 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:05:21.042 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:05:21.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:21.041+0000 7ff06486a700 1 -- 172.21.15.82:0/22267672 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff040064f10 msgr2=0x7ff0400673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:21.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:21.041+0000 7ff06486a700 1 --2- 172.21.15.82:0/22267672 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff040064f10 0x7ff0400673c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff050007e50 tx=0x7ff050008040 comp rx=0 tx=0).stop 2023-11-28T13:05:21.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:21.041+0000 7ff06486a700 1 -- 172.21.15.82:0/22267672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0600ced70 msgr2=0x7ff0600c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:21.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:21.041+0000 7ff06486a700 1 --2- 172.21.15.82:0/22267672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0600ced70 0x7ff0600c8ba0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ff05800cb50 tx=0x7ff05800ce60 comp rx=0 tx=0).stop 2023-11-28T13:05:21.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:21.041+0000 7ff06486a700 1 -- 172.21.15.82:0/22267672 shutdown_connections 2023-11-28T13:05:21.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:21.041+0000 7ff06486a700 1 --2- 172.21.15.82:0/22267672 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7ff040064f10 0x7ff0400673c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:21.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:21.041+0000 7ff06486a700 1 --2- 172.21.15.82:0/22267672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0600ced70 0x7ff0600c8ba0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:21.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:21.041+0000 7ff06486a700 1 --2- 172.21.15.82:0/22267672 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff06006b910 0x7ff06014cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:21.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:21.041+0000 7ff06486a700 1 --2- 172.21.15.82:0/22267672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff060069bc0 0x7ff06014c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:21.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:21.041+0000 7ff06486a700 1 -- 172.21.15.82:0/22267672 >> 172.21.15.82:0/22267672 conn(0x7ff0600d2b20 msgr2=0x7ff060160350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:21.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:21.041+0000 7ff06486a700 1 -- 172.21.15.82:0/22267672 shutdown_connections 2023-11-28T13:05:21.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:21.041+0000 7ff06486a700 1 -- 172.21.15.82:0/22267672 wait complete. 2023-11-28T13:05:21.056 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:05:26.057 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:05:26.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.177+0000 7f1d36192700 1 Processor -- start 2023-11-28T13:05:26.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.177+0000 7f1d36192700 1 -- start start 2023-11-28T13:05:26.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.177+0000 7f1d36192700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1d3006b1f0 0x7f1d300cac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:26.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.177+0000 7f1d36192700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d3006c830 0x7f1d3006ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:26.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.177+0000 7f1d36192700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d300c9c30 con 0x7f1d30158f00 2023-11-28T13:05:26.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.177+0000 7f1d36192700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d3006d1f0 con 0x7f1d3006b1f0 2023-11-28T13:05:26.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.177+0000 7f1d36192700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3006ae20 con 0x7f1d3006c830 2023-11-28T13:05:26.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.177+0000 7f1d3498f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1d3006b1f0 0x7f1d300cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:26.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.177+0000 7f1d35991700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d3006c830 0x7f1d3006ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:26.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.177+0000 7f1d35190700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1d30158f00 0x7f1d3006a560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:35032/0 (socket says 172.21.15.82:35032) 2023-11-28T13:05:26.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.177+0000 7f1d35190700 1 -- 172.21.15.82:0/3666315342 learned_addr learned my addr 172.21.15.82:0/3666315342 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:05:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.181+0000 7f1d27fff700 1 -- 172.21.15.82:0/3666315342 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185909258 0 0) 0x7f1d300c9c30 con 0x7f1d30158f00 2023-11-28T13:05:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.181+0000 7f1d27fff700 1 -- 172.21.15.82:0/3666315342 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d1c0035d0 con 0x7f1d30158f00 2023-11-28T13:05:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.181+0000 7f1d35991700 1 -- 172.21.15.82:0/3666315342 >> v2:172.21.15.114:3300/0 conn(0x7f1d3006b1f0 msgr2=0x7f1d300cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:05:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.181+0000 7f1d35991700 1 --2- 172.21.15.82:0/3666315342 >> v2:172.21.15.114:3300/0 conn(0x7f1d3006b1f0 0x7f1d300cac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.181+0000 7f1d35991700 1 -- 172.21.15.82:0/3666315342 >> v1:172.21.15.114:6789/0 conn(0x7f1d30158f00 legacy=0x7f1d3006a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.181+0000 7f1d35991700 1 -- 172.21.15.82:0/3666315342 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d300ca790 con 0x7f1d3006c830 2023-11-28T13:05:26.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.181+0000 7f1d35991700 1 --2- 172.21.15.82:0/3666315342 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d3006c830 0x7f1d3006ccb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009d90 tx=0x7f1d2800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d448021bb5e85a55 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.181+0000 7f1d27fff700 1 -- 172.21.15.82:0/3666315342 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2800e070 con 0x7f1d3006c830 2023-11-28T13:05:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.181+0000 7f1d27fff700 1 -- 172.21.15.82:0/3666315342 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2800bb20 con 0x7f1d3006c830 2023-11-28T13:05:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.181+0000 7f1d27fff700 1 -- 172.21.15.82:0/3666315342 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28012430 con 0x7f1d3006c830 2023-11-28T13:05:26.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.181+0000 7f1d36192700 1 -- 172.21.15.82:0/3666315342 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d3006c830 msgr2=0x7f1d3006ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.181+0000 7f1d36192700 1 --2- 172.21.15.82:0/3666315342 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d3006c830 0x7f1d3006ccb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009d90 tx=0x7f1d2800b330 comp rx=0 tx=0).stop 2023-11-28T13:05:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.181+0000 7f1d36192700 1 -- 172.21.15.82:0/3666315342 shutdown_connections 2023-11-28T13:05:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.181+0000 7f1d36192700 1 --2- 172.21.15.82:0/3666315342 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d3006c830 0x7f1d3006ccb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.181+0000 7f1d36192700 1 --2- 172.21.15.82:0/3666315342 >> v2:172.21.15.114:3300/0 conn(0x7f1d3006b1f0 0x7f1d300cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.181+0000 7f1d36192700 1 -- 172.21.15.82:0/3666315342 >> 172.21.15.82:0/3666315342 conn(0x7f1d300cb890 msgr2=0x7f1d300cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.181+0000 7f1d36192700 1 -- 172.21.15.82:0/3666315342 shutdown_connections 2023-11-28T13:05:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.181+0000 7f1d36192700 1 -- 172.21.15.82:0/3666315342 wait complete. 2023-11-28T13:05:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d36192700 1 Processor -- start 2023-11-28T13:05:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d36192700 1 -- start start 2023-11-28T13:05:26.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d36192700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d3006b1f0 0x7f1d301436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:26.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d36192700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d3006c830 0x7f1d30145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:26.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d36192700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d30158f00 0x7f1d300cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:26.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d36192700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d300c7fb0 con 0x7f1d30158f00 2023-11-28T13:05:26.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d36192700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d30146080 con 0x7f1d3006c830 2023-11-28T13:05:26.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d36192700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d30146360 con 0x7f1d3006b1f0 2023-11-28T13:05:26.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d35991700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d30158f00 0x7f1d300cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:26.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d35190700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d3006b1f0 0x7f1d301436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:26.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d35991700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d30158f00 0x7f1d300cda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52364/0 (socket says 172.21.15.82:52364) 2023-11-28T13:05:26.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d35991700 1 -- 172.21.15.82:0/2379676979 learned_addr learned my addr 172.21.15.82:0/2379676979 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:05:26.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d3498f700 1 --2- 172.21.15.82:0/2379676979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d3006c830 0x7f1d30145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:26.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d35991700 1 -- 172.21.15.82:0/2379676979 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d3006b1f0 msgr2=0x7f1d301436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:26.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d35991700 1 --2- 172.21.15.82:0/2379676979 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d3006b1f0 0x7f1d301436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:26.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d35991700 1 -- 172.21.15.82:0/2379676979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d3006c830 msgr2=0x7f1d30145750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:26.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d35991700 1 --2- 172.21.15.82:0/2379676979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d3006c830 0x7f1d30145750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:26.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d35991700 1 -- 172.21.15.82:0/2379676979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d28009a70 con 0x7f1d30158f00 2023-11-28T13:05:26.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d35991700 1 --2- 172.21.15.82:0/2379676979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d30158f00 0x7f1d300cda50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f1d28014040 tx=0x7f1d28004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:26.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d25ffb700 1 -- 172.21.15.82:0/2379676979 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28020070 con 0x7f1d30158f00 2023-11-28T13:05:26.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d25ffb700 1 -- 172.21.15.82:0/2379676979 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d28003e10 con 0x7f1d30158f00 2023-11-28T13:05:26.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d36192700 1 -- 172.21.15.82:0/2379676979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d300ca140 con 0x7f1d30158f00 2023-11-28T13:05:26.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d25ffb700 1 -- 172.21.15.82:0/2379676979 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28012430 con 0x7f1d30158f00 2023-11-28T13:05:26.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d36192700 1 -- 172.21.15.82:0/2379676979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d300c9e60 con 0x7f1d30158f00 2023-11-28T13:05:26.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.185+0000 7f1d36192700 1 -- 172.21.15.82:0/2379676979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d300ca420 con 0x7f1d30158f00 2023-11-28T13:05:26.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.189+0000 7f1d25ffb700 1 -- 172.21.15.82:0/2379676979 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1d28012b30 con 0x7f1d30158f00 2023-11-28T13:05:26.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.189+0000 7f1d25ffb700 1 --2- 172.21.15.82:0/2379676979 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1d14064ee0 0x7f1d14067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:26.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.189+0000 7f1d25ffb700 1 -- 172.21.15.82:0/2379676979 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f1d28084fb0 con 0x7f1d30158f00 2023-11-28T13:05:26.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.189+0000 7f1d35190700 1 --2- 172.21.15.82:0/2379676979 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1d14064ee0 0x7f1d14067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:26.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.189+0000 7f1d35190700 1 --2- 172.21.15.82:0/2379676979 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1d14064ee0 0x7f1d14067390 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c007fd0 tx=0x7f1d2c007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:26.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.193+0000 7f1d25ffb700 1 -- 172.21.15.82:0/2379676979 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1d280530d0 con 0x7f1d30158f00 2023-11-28T13:05:26.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.389+0000 7f1d36192700 1 -- 172.21.15.82:0/2379676979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1d300c80f0 con 0x7f1d30158f00 2023-11-28T13:05:26.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.389+0000 7f1d25ffb700 1 -- 172.21.15.82:0/2379676979 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f1d2802b0c0 con 0x7f1d30158f00 2023-11-28T13:05:26.398 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:05:26.398 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:05:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.393+0000 7f1d36192700 1 -- 172.21.15.82:0/2379676979 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1d14064ee0 msgr2=0x7f1d14067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.393+0000 7f1d36192700 1 --2- 172.21.15.82:0/2379676979 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1d14064ee0 0x7f1d14067390 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c007fd0 tx=0x7f1d2c007de0 comp rx=0 tx=0).stop 2023-11-28T13:05:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.393+0000 7f1d36192700 1 -- 172.21.15.82:0/2379676979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d30158f00 msgr2=0x7f1d300cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.393+0000 7f1d36192700 1 --2- 172.21.15.82:0/2379676979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d30158f00 0x7f1d300cda50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f1d28014040 tx=0x7f1d28004af0 comp rx=0 tx=0).stop 2023-11-28T13:05:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.393+0000 7f1d36192700 1 -- 172.21.15.82:0/2379676979 shutdown_connections 2023-11-28T13:05:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.393+0000 7f1d36192700 1 --2- 172.21.15.82:0/2379676979 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1d14064ee0 0x7f1d14067390 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.393+0000 7f1d36192700 1 --2- 172.21.15.82:0/2379676979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d30158f00 0x7f1d300cda50 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.393+0000 7f1d36192700 1 --2- 172.21.15.82:0/2379676979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d3006c830 0x7f1d30145750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.393+0000 7f1d36192700 1 --2- 172.21.15.82:0/2379676979 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d3006b1f0 0x7f1d301436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.393+0000 7f1d36192700 1 -- 172.21.15.82:0/2379676979 >> 172.21.15.82:0/2379676979 conn(0x7f1d300cb890 msgr2=0x7f1d300b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.393+0000 7f1d36192700 1 -- 172.21.15.82:0/2379676979 shutdown_connections 2023-11-28T13:05:26.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:26.393+0000 7f1d36192700 1 -- 172.21.15.82:0/2379676979 wait complete. 2023-11-28T13:05:26.409 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:05:27.714 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:05:27.717 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:05:31.410 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:05:31.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.525+0000 7fa1dea60700 1 Processor -- start 2023-11-28T13:05:31.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.525+0000 7fa1dea60700 1 -- start start 2023-11-28T13:05:31.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.525+0000 7fa1dea60700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa1d8070070 0x7fa1d8070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:31.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.525+0000 7fa1dea60700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa1d8160900 0x7fa1d80cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:31.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.525+0000 7fa1dea60700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d8070980 con 0x7fa1d80c1910 2023-11-28T13:05:31.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.525+0000 7fa1dea60700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d80ce030 con 0x7fa1d8070070 2023-11-28T13:05:31.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.525+0000 7fa1dea60700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d80ce310 con 0x7fa1d8160900 2023-11-28T13:05:31.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.525+0000 7fa1de25f700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa1d80c1910 0x7fa1d81641e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:40620/0 (socket says 172.21.15.82:40620) 2023-11-28T13:05:31.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.525+0000 7fa1de25f700 1 -- 172.21.15.82:0/1377516920 learned_addr learned my addr 172.21.15.82:0/1377516920 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:05:31.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.525+0000 7fa1dda5e700 1 --2- 172.21.15.82:0/1377516920 >> v2:172.21.15.114:3300/0 conn(0x7fa1d8070070 0x7fa1d8070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:31.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.525+0000 7fa1dd25d700 1 --2- 172.21.15.82:0/1377516920 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa1d8160900 0x7fa1d80cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:31.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.525+0000 7fa1dca5c700 1 -- 172.21.15.82:0/1377516920 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4147568737 0 0) 0x7fa1d8070980 con 0x7fa1d80c1910 2023-11-28T13:05:31.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.525+0000 7fa1dca5c700 1 -- 172.21.15.82:0/1377516920 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1c40035d0 con 0x7fa1d80c1910 2023-11-28T13:05:31.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.529+0000 7fa1dda5e700 1 -- 172.21.15.82:0/1377516920 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa1d8160900 msgr2=0x7fa1d80cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:05:31.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.529+0000 7fa1dca5c700 1 -- 172.21.15.82:0/1377516920 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1321087585 0 0) 0x7fa1c40035d0 con 0x7fa1d80c1910 2023-11-28T13:05:31.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.529+0000 7fa1dda5e700 1 --2- 172.21.15.82:0/1377516920 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa1d8160900 0x7fa1d80cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:31.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.529+0000 7fa1dda5e700 1 -- 172.21.15.82:0/1377516920 >> v1:172.21.15.82:6789/0 conn(0x7fa1d80c1910 legacy=0x7fa1d81641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:31.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.529+0000 7fa1dda5e700 1 -- 172.21.15.82:0/1377516920 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d806a5d0 con 0x7fa1d8070070 2023-11-28T13:05:31.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.529+0000 7fa1dda5e700 1 --2- 172.21.15.82:0/1377516920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1d8070070 0x7fa1d8070440 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009d90 tx=0x7fa1c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a3117dbb168e34d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:31.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.529+0000 7fa1dca5c700 1 -- 172.21.15.82:0/1377516920 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c000e070 con 0x7fa1d8070070 2023-11-28T13:05:31.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.529+0000 7fa1dca5c700 1 -- 172.21.15.82:0/1377516920 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c0003a40 con 0x7fa1d8070070 2023-11-28T13:05:31.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.529+0000 7fa1dca5c700 1 -- 172.21.15.82:0/1377516920 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0001670 con 0x7fa1d8070070 2023-11-28T13:05:31.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.529+0000 7fa1dea60700 1 -- 172.21.15.82:0/1377516920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1d8070070 msgr2=0x7fa1d8070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:31.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.529+0000 7fa1dea60700 1 --2- 172.21.15.82:0/1377516920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1d8070070 0x7fa1d8070440 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009d90 tx=0x7fa1c000b330 comp rx=0 tx=0).stop 2023-11-28T13:05:31.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.529+0000 7fa1dea60700 1 -- 172.21.15.82:0/1377516920 shutdown_connections 2023-11-28T13:05:31.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.529+0000 7fa1dea60700 1 --2- 172.21.15.82:0/1377516920 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa1d8160900 0x7fa1d80cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:31.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.529+0000 7fa1dea60700 1 --2- 172.21.15.82:0/1377516920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1d8070070 0x7fa1d8070440 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:31.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.529+0000 7fa1dea60700 1 -- 172.21.15.82:0/1377516920 >> 172.21.15.82:0/1377516920 conn(0x7fa1d80ce600 msgr2=0x7fa1d80ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:31.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.529+0000 7fa1dea60700 1 -- 172.21.15.82:0/1377516920 shutdown_connections 2023-11-28T13:05:31.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.529+0000 7fa1dea60700 1 -- 172.21.15.82:0/1377516920 wait complete. 2023-11-28T13:05:31.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.529+0000 7fa1dea60700 1 Processor -- start 2023-11-28T13:05:31.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.529+0000 7fa1dea60700 1 -- start start 2023-11-28T13:05:31.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1dea60700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1d8070070 0x7fa1d815a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:31.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1dea60700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa1d80c2b40 0x7fa1d80c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:31.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1dea60700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d80c6620 0x7fa1d80c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:31.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1dea60700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d8160ce0 con 0x7fa1d80c6620 2023-11-28T13:05:31.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1dea60700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d815af00 con 0x7fa1d8070070 2023-11-28T13:05:31.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1dea60700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d80c6b60 con 0x7fa1d80c2b40 2023-11-28T13:05:31.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1de25f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d80c6620 0x7fa1d80c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:31.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1dda5e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1d8070070 0x7fa1d815a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:31.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1de25f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d80c6620 0x7fa1d80c6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37260/0 (socket says 172.21.15.82:37260) 2023-11-28T13:05:31.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1dda5e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1d8070070 0x7fa1d815a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:45270/0 (socket says 172.21.15.82:45270) 2023-11-28T13:05:31.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1de25f700 1 -- 172.21.15.82:0/2980026988 learned_addr learned my addr 172.21.15.82:0/2980026988 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:05:31.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1dd25d700 1 --2- 172.21.15.82:0/2980026988 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa1d80c2b40 0x7fa1d80c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:31.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1de25f700 1 -- 172.21.15.82:0/2980026988 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa1d80c2b40 msgr2=0x7fa1d80c60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:31.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1de25f700 1 --2- 172.21.15.82:0/2980026988 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa1d80c2b40 0x7fa1d80c60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:31.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1de25f700 1 -- 172.21.15.82:0/2980026988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1d8070070 msgr2=0x7fa1d815a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:31.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1de25f700 1 --2- 172.21.15.82:0/2980026988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1d8070070 0x7fa1d815a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:31.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1de25f700 1 -- 172.21.15.82:0/2980026988 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c0009a70 con 0x7fa1d80c6620 2023-11-28T13:05:31.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1de25f700 1 --2- 172.21.15.82:0/2980026988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d80c6620 0x7fa1d80c6ff0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa1d00011e0 tx=0x7fa1d000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:31.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1d67fc700 1 -- 172.21.15.82:0/2980026988 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0004ca0 con 0x7fa1d80c6620 2023-11-28T13:05:31.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1dea60700 1 -- 172.21.15.82:0/2980026988 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d806ab90 con 0x7fa1d80c6620 2023-11-28T13:05:31.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1d67fc700 1 -- 172.21.15.82:0/2980026988 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d0004e00 con 0x7fa1d80c6620 2023-11-28T13:05:31.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1dea60700 1 -- 172.21.15.82:0/2980026988 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d806a8b0 con 0x7fa1d80c6620 2023-11-28T13:05:31.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1d67fc700 1 -- 172.21.15.82:0/2980026988 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0007310 con 0x7fa1d80c6620 2023-11-28T13:05:31.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.533+0000 7fa1dea60700 1 -- 172.21.15.82:0/2980026988 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d80cc710 con 0x7fa1d80c6620 2023-11-28T13:05:31.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.537+0000 7fa1d67fc700 1 -- 172.21.15.82:0/2980026988 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa1d001a020 con 0x7fa1d80c6620 2023-11-28T13:05:31.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.537+0000 7fa1d67fc700 1 --2- 172.21.15.82:0/2980026988 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa1b8064f10 0x7fa1b80673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:31.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.537+0000 7fa1dda5e700 1 --2- 172.21.15.82:0/2980026988 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa1b8064f10 0x7fa1b80673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:31.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.537+0000 7fa1d67fc700 1 -- 172.21.15.82:0/2980026988 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7fa1d0081980 con 0x7fa1d80c6620 2023-11-28T13:05:31.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.537+0000 7fa1dda5e700 1 --2- 172.21.15.82:0/2980026988 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa1b8064f10 0x7fa1b80673c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0000f80 tx=0x7fa1c0011000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:31.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.545+0000 7fa1d67fc700 1 -- 172.21.15.82:0/2980026988 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa1d004fa20 con 0x7fa1d80c6620 2023-11-28T13:05:31.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.745+0000 7fa1dea60700 1 -- 172.21.15.82:0/2980026988 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa1d8065fc0 con 0x7fa1d80c6620 2023-11-28T13:05:31.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.745+0000 7fa1d67fc700 1 -- 172.21.15.82:0/2980026988 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fa1d0053040 con 0x7fa1d80c6620 2023-11-28T13:05:31.748 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:05:31.748 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:05:31.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.749+0000 7fa1dea60700 1 -- 172.21.15.82:0/2980026988 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa1b8064f10 msgr2=0x7fa1b80673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:31.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.749+0000 7fa1dea60700 1 --2- 172.21.15.82:0/2980026988 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa1b8064f10 0x7fa1b80673c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0000f80 tx=0x7fa1c0011000 comp rx=0 tx=0).stop 2023-11-28T13:05:31.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.749+0000 7fa1dea60700 1 -- 172.21.15.82:0/2980026988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d80c6620 msgr2=0x7fa1d80c6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:31.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.749+0000 7fa1dea60700 1 --2- 172.21.15.82:0/2980026988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d80c6620 0x7fa1d80c6ff0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa1d00011e0 tx=0x7fa1d000c800 comp rx=0 tx=0).stop 2023-11-28T13:05:31.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.749+0000 7fa1dea60700 1 -- 172.21.15.82:0/2980026988 shutdown_connections 2023-11-28T13:05:31.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.749+0000 7fa1dea60700 1 --2- 172.21.15.82:0/2980026988 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa1b8064f10 0x7fa1b80673c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:31.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.749+0000 7fa1dea60700 1 --2- 172.21.15.82:0/2980026988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d80c6620 0x7fa1d80c6ff0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:31.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.749+0000 7fa1dea60700 1 --2- 172.21.15.82:0/2980026988 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa1d80c2b40 0x7fa1d80c60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:31.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.749+0000 7fa1dea60700 1 --2- 172.21.15.82:0/2980026988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1d8070070 0x7fa1d815a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:31.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.749+0000 7fa1dea60700 1 -- 172.21.15.82:0/2980026988 >> 172.21.15.82:0/2980026988 conn(0x7fa1d80ce600 msgr2=0x7fa1d80b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:31.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.749+0000 7fa1dea60700 1 -- 172.21.15.82:0/2980026988 shutdown_connections 2023-11-28T13:05:31.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:31.749+0000 7fa1dea60700 1 -- 172.21.15.82:0/2980026988 wait complete. 2023-11-28T13:05:31.767 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:05:36.768 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:05:36.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.885+0000 7fba47fff700 1 Processor -- start 2023-11-28T13:05:36.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.885+0000 7fba47fff700 1 -- start start 2023-11-28T13:05:36.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba47fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fba400dc7f0 0x7fba40051740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:36.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba47fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba40006c40 0x7fba400e32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:36.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba47fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba40007f80 con 0x7fba40037000 2023-11-28T13:05:36.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba47fff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba400e3820 con 0x7fba400dc7f0 2023-11-28T13:05:36.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba47fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba400502a0 con 0x7fba40006c40 2023-11-28T13:05:36.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba467fc700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba40006c40 0x7fba400e32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:36.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba46ffd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fba400dc7f0 0x7fba40051740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:36.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba477fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fba40037000 0x7fba4003a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:38524/0 (socket says 172.21.15.82:38524) 2023-11-28T13:05:36.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba46ffd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fba400dc7f0 0x7fba40051740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:46914/0 (socket says 172.21.15.82:46914) 2023-11-28T13:05:36.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba467fc700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba40006c40 0x7fba400e32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:57048/0 (socket says 172.21.15.82:57048) 2023-11-28T13:05:36.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba477fe700 1 -- 172.21.15.82:0/878696599 learned_addr learned my addr 172.21.15.82:0/878696599 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:05:36.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba467fc700 1 -- 172.21.15.82:0/878696599 >> v2:172.21.15.114:3300/0 conn(0x7fba400dc7f0 msgr2=0x7fba40051740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:05:36.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba467fc700 1 --2- 172.21.15.82:0/878696599 >> v2:172.21.15.114:3300/0 conn(0x7fba400dc7f0 0x7fba40051740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:36.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba467fc700 1 -- 172.21.15.82:0/878696599 >> v1:172.21.15.114:6789/0 conn(0x7fba40037000 legacy=0x7fba4003a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:36.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba45ffb700 1 -- 172.21.15.82:0/878696599 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900500565 0 0) 0x7fba40007f80 con 0x7fba40037000 2023-11-28T13:05:36.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba467fc700 1 -- 172.21.15.82:0/878696599 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4004fce0 con 0x7fba40006c40 2023-11-28T13:05:36.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba46ffd700 1 --2- 172.21.15.82:0/878696599 >> v2:172.21.15.114:3300/0 conn(0x7fba400dc7f0 0x7fba40051740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:05:36.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba467fc700 1 --2- 172.21.15.82:0/878696599 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba40006c40 0x7fba400e32e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fba3c009850 tx=0x7fba3c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd77664fdde25941 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:36.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba45ffb700 1 -- 172.21.15.82:0/878696599 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c011830 con 0x7fba40006c40 2023-11-28T13:05:36.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba45ffb700 1 -- 172.21.15.82:0/878696599 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3c011990 con 0x7fba40006c40 2023-11-28T13:05:36.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba45ffb700 1 -- 172.21.15.82:0/878696599 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c011d40 con 0x7fba40006c40 2023-11-28T13:05:36.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba47fff700 1 -- 172.21.15.82:0/878696599 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba40006c40 msgr2=0x7fba400e32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:36.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba47fff700 1 --2- 172.21.15.82:0/878696599 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba40006c40 0x7fba400e32e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fba3c009850 tx=0x7fba3c009b60 comp rx=0 tx=0).stop 2023-11-28T13:05:36.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba47fff700 1 -- 172.21.15.82:0/878696599 shutdown_connections 2023-11-28T13:05:36.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba47fff700 1 --2- 172.21.15.82:0/878696599 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba40006c40 0x7fba400e32e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:36.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba47fff700 1 --2- 172.21.15.82:0/878696599 >> v2:172.21.15.114:3300/0 conn(0x7fba400dc7f0 0x7fba40051740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:36.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba47fff700 1 -- 172.21.15.82:0/878696599 >> 172.21.15.82:0/878696599 conn(0x7fba40052000 msgr2=0x7fba40052400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:36.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba47fff700 1 -- 172.21.15.82:0/878696599 shutdown_connections 2023-11-28T13:05:36.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.889+0000 7fba47fff700 1 -- 172.21.15.82:0/878696599 wait complete. 2023-11-28T13:05:36.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.893+0000 7fba47fff700 1 Processor -- start 2023-11-28T13:05:36.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.893+0000 7fba47fff700 1 -- start start 2023-11-28T13:05:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.893+0000 7fba47fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba40006c40 0x7fba400d44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.893+0000 7fba47fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba40037000 0x7fba4004dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.893+0000 7fba47fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba400dc7f0 0x7fba400396a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.893+0000 7fba47fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba400383b0 con 0x7fba40037000 2023-11-28T13:05:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.893+0000 7fba47fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba40038600 con 0x7fba40006c40 2023-11-28T13:05:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.893+0000 7fba47fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba400388e0 con 0x7fba400dc7f0 2023-11-28T13:05:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.893+0000 7fba467fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba40037000 0x7fba4004dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.893+0000 7fba467fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba40037000 0x7fba4004dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40094/0 (socket says 172.21.15.82:40094) 2023-11-28T13:05:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.893+0000 7fba467fc700 1 -- 172.21.15.82:0/521885106 learned_addr learned my addr 172.21.15.82:0/521885106 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:05:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.893+0000 7fba46ffd700 1 --2- 172.21.15.82:0/521885106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba40006c40 0x7fba400d44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.893+0000 7fba477fe700 1 --2- 172.21.15.82:0/521885106 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba400dc7f0 0x7fba400396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:36.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.897+0000 7fba467fc700 1 -- 172.21.15.82:0/521885106 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba400dc7f0 msgr2=0x7fba400396a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:36.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.897+0000 7fba467fc700 1 --2- 172.21.15.82:0/521885106 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba400dc7f0 0x7fba400396a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:36.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.897+0000 7fba467fc700 1 -- 172.21.15.82:0/521885106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba40006c40 msgr2=0x7fba400d44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:36.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.897+0000 7fba467fc700 1 --2- 172.21.15.82:0/521885106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba40006c40 0x7fba400d44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:36.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.897+0000 7fba467fc700 1 -- 172.21.15.82:0/521885106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba380094b0 con 0x7fba40037000 2023-11-28T13:05:36.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.897+0000 7fba467fc700 1 --2- 172.21.15.82:0/521885106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba40037000 0x7fba4004dfe0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fba3c013000 tx=0x7fba3c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:36.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.897+0000 7fba2f7fe700 1 -- 172.21.15.82:0/521885106 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c004480 con 0x7fba40037000 2023-11-28T13:05:36.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.897+0000 7fba2f7fe700 1 -- 172.21.15.82:0/521885106 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3c01f070 con 0x7fba40037000 2023-11-28T13:05:36.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.897+0000 7fba2f7fe700 1 -- 172.21.15.82:0/521885106 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c003900 con 0x7fba40037000 2023-11-28T13:05:36.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.897+0000 7fba47fff700 1 -- 172.21.15.82:0/521885106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3c0094b0 con 0x7fba40037000 2023-11-28T13:05:36.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.897+0000 7fba47fff700 1 -- 172.21.15.82:0/521885106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba40008220 con 0x7fba40037000 2023-11-28T13:05:36.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.897+0000 7fba47fff700 1 -- 172.21.15.82:0/521885106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba4004ffc0 con 0x7fba40037000 2023-11-28T13:05:36.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.897+0000 7fba2f7fe700 1 -- 172.21.15.82:0/521885106 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fba3c02a020 con 0x7fba40037000 2023-11-28T13:05:36.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.901+0000 7fba2f7fe700 1 --2- 172.21.15.82:0/521885106 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fba34064ee0 0x7fba34067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:36.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.901+0000 7fba2f7fe700 1 -- 172.21.15.82:0/521885106 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7fba3c083470 con 0x7fba40037000 2023-11-28T13:05:36.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.901+0000 7fba46ffd700 1 --2- 172.21.15.82:0/521885106 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fba34064ee0 0x7fba34067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:36.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.901+0000 7fba46ffd700 1 --2- 172.21.15.82:0/521885106 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fba34064ee0 0x7fba34067390 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fba38009ce0 tx=0x7fba38009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:36.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:36.905+0000 7fba2f7fe700 1 -- 172.21.15.82:0/521885106 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fba3c0514a0 con 0x7fba40037000 2023-11-28T13:05:37.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:37.101+0000 7fba47fff700 1 -- 172.21.15.82:0/521885106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fba400dcbc0 con 0x7fba40037000 2023-11-28T13:05:37.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:37.101+0000 7fba2f7fe700 1 -- 172.21.15.82:0/521885106 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fba3c054ac0 con 0x7fba40037000 2023-11-28T13:05:37.106 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:05:37.106 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:05:37.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:37.105+0000 7fba47fff700 1 -- 172.21.15.82:0/521885106 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fba34064ee0 msgr2=0x7fba34067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:37.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:37.105+0000 7fba47fff700 1 --2- 172.21.15.82:0/521885106 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fba34064ee0 0x7fba34067390 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fba38009ce0 tx=0x7fba38009240 comp rx=0 tx=0).stop 2023-11-28T13:05:37.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:37.105+0000 7fba47fff700 1 -- 172.21.15.82:0/521885106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba40037000 msgr2=0x7fba4004dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:37.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:37.105+0000 7fba47fff700 1 --2- 172.21.15.82:0/521885106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba40037000 0x7fba4004dfe0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fba3c013000 tx=0x7fba3c004770 comp rx=0 tx=0).stop 2023-11-28T13:05:37.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:37.105+0000 7fba47fff700 1 -- 172.21.15.82:0/521885106 shutdown_connections 2023-11-28T13:05:37.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:37.105+0000 7fba47fff700 1 --2- 172.21.15.82:0/521885106 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fba34064ee0 0x7fba34067390 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:37.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:37.105+0000 7fba47fff700 1 --2- 172.21.15.82:0/521885106 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba400dc7f0 0x7fba400396a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:37.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:37.105+0000 7fba47fff700 1 --2- 172.21.15.82:0/521885106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba40037000 0x7fba4004dfe0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:37.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:37.105+0000 7fba47fff700 1 --2- 172.21.15.82:0/521885106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba40006c40 0x7fba400d44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:37.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:37.105+0000 7fba47fff700 1 -- 172.21.15.82:0/521885106 >> 172.21.15.82:0/521885106 conn(0x7fba40052000 msgr2=0x7fba400063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:37.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:37.105+0000 7fba47fff700 1 -- 172.21.15.82:0/521885106 shutdown_connections 2023-11-28T13:05:37.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:37.105+0000 7fba47fff700 1 -- 172.21.15.82:0/521885106 wait complete. 2023-11-28T13:05:37.126 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:05:42.127 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:05:42.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.241+0000 7fef063aa700 1 Processor -- start 2023-11-28T13:05:42.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.241+0000 7fef063aa700 1 -- start start 2023-11-28T13:05:42.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.245+0000 7fef063aa700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fef001591c0 0x7fef0015d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:42.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.245+0000 7fef063aa700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fef00070070 0x7fef000704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:42.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.245+0000 7fef063aa700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef0015da50 con 0x7fef00158df0 2023-11-28T13:05:42.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.245+0000 7fef063aa700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef00070a30 con 0x7fef00070070 2023-11-28T13:05:42.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.245+0000 7fef063aa700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef000c9e20 con 0x7fef001591c0 2023-11-28T13:05:42.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.245+0000 7fef053a8700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fef00158df0 0x7fef0006c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38738/0 (socket says 172.21.15.82:38738) 2023-11-28T13:05:42.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.245+0000 7fef053a8700 1 -- 172.21.15.82:0/869805384 learned_addr learned my addr 172.21.15.82:0/869805384 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:05:42.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.245+0000 7fef05ba9700 1 --2- 172.21.15.82:0/869805384 >> v2:172.21.15.114:3300/0 conn(0x7fef00070070 0x7fef000704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:42.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.245+0000 7fef04ba7700 1 --2- 172.21.15.82:0/869805384 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fef001591c0 0x7fef0015d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:42.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.245+0000 7feef7fff700 1 -- 172.21.15.82:0/869805384 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034678168 0 0) 0x7feefc001110 con 0x7fef00158df0 2023-11-28T13:05:42.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.245+0000 7feef7fff700 1 -- 172.21.15.82:0/869805384 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeec0057e0 con 0x7fef00158df0 2023-11-28T13:05:42.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.245+0000 7fef04ba7700 1 -- 172.21.15.82:0/869805384 >> v2:172.21.15.114:3300/0 conn(0x7fef00070070 msgr2=0x7fef000704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:05:42.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.245+0000 7fef04ba7700 1 --2- 172.21.15.82:0/869805384 >> v2:172.21.15.114:3300/0 conn(0x7fef00070070 0x7fef000704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:42.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.245+0000 7fef04ba7700 1 -- 172.21.15.82:0/869805384 >> v1:172.21.15.82:6789/0 conn(0x7fef00158df0 legacy=0x7fef0006c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:42.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.245+0000 7fef04ba7700 1 -- 172.21.15.82:0/869805384 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef000cc640 con 0x7fef001591c0 2023-11-28T13:05:42.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.245+0000 7fef05ba9700 1 --2- 172.21.15.82:0/869805384 >> v2:172.21.15.114:3300/0 conn(0x7fef00070070 0x7fef000704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:05:42.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.245+0000 7fef04ba7700 1 --2- 172.21.15.82:0/869805384 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fef001591c0 0x7fef0015d510 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feef0009850 tx=0x7feef0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d119a3cc903da0b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:42.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.245+0000 7feef7fff700 1 -- 172.21.15.82:0/869805384 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0011830 con 0x7fef001591c0 2023-11-28T13:05:42.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.245+0000 7feef7fff700 1 -- 172.21.15.82:0/869805384 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef0011990 con 0x7fef001591c0 2023-11-28T13:05:42.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.245+0000 7feef7fff700 1 -- 172.21.15.82:0/869805384 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0011d00 con 0x7fef001591c0 2023-11-28T13:05:42.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.249+0000 7fef063aa700 1 -- 172.21.15.82:0/869805384 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fef001591c0 msgr2=0x7fef0015d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:42.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.249+0000 7fef063aa700 1 --2- 172.21.15.82:0/869805384 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fef001591c0 0x7fef0015d510 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feef0009850 tx=0x7feef0009b60 comp rx=0 tx=0).stop 2023-11-28T13:05:42.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.249+0000 7fef063aa700 1 -- 172.21.15.82:0/869805384 shutdown_connections 2023-11-28T13:05:42.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.249+0000 7fef063aa700 1 --2- 172.21.15.82:0/869805384 >> v2:172.21.15.114:3300/0 conn(0x7fef00070070 0x7fef000704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:42.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.249+0000 7fef063aa700 1 --2- 172.21.15.82:0/869805384 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fef001591c0 0x7fef0015d510 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:42.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.249+0000 7fef063aa700 1 -- 172.21.15.82:0/869805384 >> 172.21.15.82:0/869805384 conn(0x7fef000ce600 msgr2=0x7fef000ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:42.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.249+0000 7fef063aa700 1 -- 172.21.15.82:0/869805384 shutdown_connections 2023-11-28T13:05:42.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.249+0000 7fef063aa700 1 -- 172.21.15.82:0/869805384 wait complete. 2023-11-28T13:05:42.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.249+0000 7fef063aa700 1 Processor -- start 2023-11-28T13:05:42.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7fef063aa700 1 -- start start 2023-11-28T13:05:42.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7fef063aa700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fef00070070 0x7fef00157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:42.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7fef063aa700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef00158df0 0x7fef000b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:42.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7fef063aa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef001591c0 0x7fef001486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:42.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7fef063aa700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef00146610 con 0x7fef001591c0 2023-11-28T13:05:42.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7fef063aa700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef000c76a0 con 0x7fef00158df0 2023-11-28T13:05:42.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7fef063aa700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef000c7980 con 0x7fef00070070 2023-11-28T13:05:42.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7fef05ba9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef001591c0 0x7fef001486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:42.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7fef053a8700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fef00070070 0x7fef00157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:42.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7fef05ba9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef001591c0 0x7fef001486a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40096/0 (socket says 172.21.15.82:40096) 2023-11-28T13:05:42.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7fef05ba9700 1 -- 172.21.15.82:0/3963868462 learned_addr learned my addr 172.21.15.82:0/3963868462 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:05:42.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7fef04ba7700 1 --2- 172.21.15.82:0/3963868462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef00158df0 0x7fef000b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:42.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7fef05ba9700 1 -- 172.21.15.82:0/3963868462 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fef00070070 msgr2=0x7fef00157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:42.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7fef05ba9700 1 --2- 172.21.15.82:0/3963868462 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fef00070070 0x7fef00157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:42.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7fef05ba9700 1 -- 172.21.15.82:0/3963868462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef00158df0 msgr2=0x7fef000b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:42.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7fef05ba9700 1 --2- 172.21.15.82:0/3963868462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef00158df0 0x7fef000b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:42.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7fef05ba9700 1 -- 172.21.15.82:0/3963868462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef8009a70 con 0x7fef001591c0 2023-11-28T13:05:42.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7fef05ba9700 1 --2- 172.21.15.82:0/3963868462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef001591c0 0x7fef001486a0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7feef800efc0 tx=0x7feef800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:42.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7feef5ffb700 1 -- 172.21.15.82:0/3963868462 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef800ca90 con 0x7fef001591c0 2023-11-28T13:05:42.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7feef5ffb700 1 -- 172.21.15.82:0/3963868462 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef800f040 con 0x7fef001591c0 2023-11-28T13:05:42.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7fef063aa700 1 -- 172.21.15.82:0/3963868462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef00094b0 con 0x7fef001591c0 2023-11-28T13:05:42.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7feef5ffb700 1 -- 172.21.15.82:0/3963868462 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef800ce10 con 0x7fef001591c0 2023-11-28T13:05:42.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7fef063aa700 1 -- 172.21.15.82:0/3963868462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef000c9ab0 con 0x7fef001591c0 2023-11-28T13:05:42.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.253+0000 7fef063aa700 1 -- 172.21.15.82:0/3963868462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef000c97d0 con 0x7fef001591c0 2023-11-28T13:05:42.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.257+0000 7feef5ffb700 1 -- 172.21.15.82:0/3963868462 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7feef8014480 con 0x7fef001591c0 2023-11-28T13:05:42.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.257+0000 7feef5ffb700 1 --2- 172.21.15.82:0/3963868462 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feee4064ee0 0x7feee4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:42.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.257+0000 7feef5ffb700 1 -- 172.21.15.82:0/3963868462 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7feef8082780 con 0x7fef001591c0 2023-11-28T13:05:42.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.257+0000 7fef053a8700 1 --2- 172.21.15.82:0/3963868462 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feee4064ee0 0x7feee4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:42.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.257+0000 7fef053a8700 1 --2- 172.21.15.82:0/3963868462 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feee4064ee0 0x7feee4067390 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7feefc005930 tx=0x7feefc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:42.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.261+0000 7feef5ffb700 1 -- 172.21.15.82:0/3963868462 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7feef8050750 con 0x7fef001591c0 2023-11-28T13:05:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.461+0000 7fef063aa700 1 -- 172.21.15.82:0/3963868462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fef000c9480 con 0x7fef001591c0 2023-11-28T13:05:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.461+0000 7feef5ffb700 1 -- 172.21.15.82:0/3963868462 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7feef8009d70 con 0x7fef001591c0 2023-11-28T13:05:42.467 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:05:42.467 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:05:42.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.465+0000 7fef063aa700 1 -- 172.21.15.82:0/3963868462 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feee4064ee0 msgr2=0x7feee4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:42.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.465+0000 7fef063aa700 1 --2- 172.21.15.82:0/3963868462 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feee4064ee0 0x7feee4067390 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7feefc005930 tx=0x7feefc009040 comp rx=0 tx=0).stop 2023-11-28T13:05:42.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.465+0000 7fef063aa700 1 -- 172.21.15.82:0/3963868462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef001591c0 msgr2=0x7fef001486a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:42.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.465+0000 7fef063aa700 1 --2- 172.21.15.82:0/3963868462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef001591c0 0x7fef001486a0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7feef800efc0 tx=0x7feef800c3a0 comp rx=0 tx=0).stop 2023-11-28T13:05:42.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.465+0000 7fef063aa700 1 -- 172.21.15.82:0/3963868462 shutdown_connections 2023-11-28T13:05:42.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.465+0000 7fef063aa700 1 --2- 172.21.15.82:0/3963868462 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7feee4064ee0 0x7feee4067390 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:42.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.465+0000 7fef063aa700 1 --2- 172.21.15.82:0/3963868462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef001591c0 0x7fef001486a0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:42.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.465+0000 7fef063aa700 1 --2- 172.21.15.82:0/3963868462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef00158df0 0x7fef000b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:42.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.465+0000 7fef063aa700 1 --2- 172.21.15.82:0/3963868462 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fef00070070 0x7fef00157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:42.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.465+0000 7fef063aa700 1 -- 172.21.15.82:0/3963868462 >> 172.21.15.82:0/3963868462 conn(0x7fef000ce600 msgr2=0x7fef00069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:42.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.469+0000 7fef063aa700 1 -- 172.21.15.82:0/3963868462 shutdown_connections 2023-11-28T13:05:42.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:42.469+0000 7fef063aa700 1 -- 172.21.15.82:0/3963868462 wait complete. 2023-11-28T13:05:42.487 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:05:47.487 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:05:47.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.605+0000 7f7293fff700 1 Processor -- start 2023-11-28T13:05:47.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.605+0000 7f7293fff700 1 -- start start 2023-11-28T13:05:47.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.605+0000 7f7293fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f728c0e29f0 0x7f728c055490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:47.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.605+0000 7f7293fff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f728c007360 con 0x7f728c03b330 2023-11-28T13:05:47.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.605+0000 7f7293fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f728c053f70 con 0x7f728c038560 2023-11-28T13:05:47.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.605+0000 7f7293fff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f728c0e2dc0 con 0x7f728c0e29f0 2023-11-28T13:05:47.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.605+0000 7f7292ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f728c0e29f0 0x7f728c055490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:47.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.605+0000 7f72937fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f728c03b330 0x7f728c057210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33598/0 (socket says 172.21.15.82:33598) 2023-11-28T13:05:47.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.605+0000 7f72937fe700 1 -- 172.21.15.82:0/2885157110 learned_addr learned my addr 172.21.15.82:0/2885157110 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:05:47.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.605+0000 7f7291ffb700 1 -- 172.21.15.82:0/2885157110 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703845671 0 0) 0x7f728c053f70 con 0x7f728c038560 2023-11-28T13:05:47.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.605+0000 7f7292ffd700 1 -- 172.21.15.82:0/2885157110 >> v1:172.21.15.114:6789/0 conn(0x7f728c038560 legacy=0x7f728c03ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:47.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.605+0000 7f7292ffd700 1 -- 172.21.15.82:0/2885157110 >> v1:172.21.15.82:6789/0 conn(0x7f728c03b330 legacy=0x7f728c057210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:47.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.605+0000 7f7292ffd700 1 -- 172.21.15.82:0/2885157110 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c006dc0 con 0x7f728c0e29f0 2023-11-28T13:05:47.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.605+0000 7f7292ffd700 1 --2- 172.21.15.82:0/2885157110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f728c0e29f0 0x7f728c055490 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f7288009850 tx=0x7f7288009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9d2235f7eeec3b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:47.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.605+0000 7f7291ffb700 1 -- 172.21.15.82:0/2885157110 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7288004230 con 0x7f728c0e29f0 2023-11-28T13:05:47.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.605+0000 7f7291ffb700 1 -- 172.21.15.82:0/2885157110 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7288004390 con 0x7f728c0e29f0 2023-11-28T13:05:47.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.605+0000 7f7291ffb700 1 -- 172.21.15.82:0/2885157110 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72880036c0 con 0x7f728c0e29f0 2023-11-28T13:05:47.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.609+0000 7f7293fff700 1 -- 172.21.15.82:0/2885157110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f728c0e29f0 msgr2=0x7f728c055490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:47.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.609+0000 7f7293fff700 1 --2- 172.21.15.82:0/2885157110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f728c0e29f0 0x7f728c055490 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f7288009850 tx=0x7f7288009b60 comp rx=0 tx=0).stop 2023-11-28T13:05:47.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.609+0000 7f7293fff700 1 -- 172.21.15.82:0/2885157110 shutdown_connections 2023-11-28T13:05:47.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.609+0000 7f7293fff700 1 --2- 172.21.15.82:0/2885157110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f728c0e29f0 0x7f728c055490 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:47.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.609+0000 7f7293fff700 1 -- 172.21.15.82:0/2885157110 >> 172.21.15.82:0/2885157110 conn(0x7f728c055c20 msgr2=0x7f728c056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:47.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.609+0000 7f7293fff700 1 -- 172.21.15.82:0/2885157110 shutdown_connections 2023-11-28T13:05:47.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.609+0000 7f7293fff700 1 -- 172.21.15.82:0/2885157110 wait complete. 2023-11-28T13:05:47.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.609+0000 7f7293fff700 1 Processor -- start 2023-11-28T13:05:47.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.609+0000 7f7293fff700 1 -- start start 2023-11-28T13:05:47.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f7293fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f728c038560 0x7f728c17c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f7293fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f728c03b330 0x7f728c175390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f7293fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f728c0e29f0 0x7f728c1758d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f7293fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c1783a0 con 0x7f728c03b330 2023-11-28T13:05:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f7293fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c0ce3b0 con 0x7f728c038560 2023-11-28T13:05:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f7293fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728c0ce690 con 0x7f728c0e29f0 2023-11-28T13:05:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f72927fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f728c03b330 0x7f728c175390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f72927fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f728c03b330 0x7f728c175390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55000/0 (socket says 172.21.15.82:55000) 2023-11-28T13:05:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f72927fc700 1 -- 172.21.15.82:0/2424053130 learned_addr learned my addr 172.21.15.82:0/2424053130 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:05:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f7292ffd700 1 --2- 172.21.15.82:0/2424053130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f728c038560 0x7f728c17c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f72937fe700 1 --2- 172.21.15.82:0/2424053130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f728c0e29f0 0x7f728c1758d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f72927fc700 1 -- 172.21.15.82:0/2424053130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f728c0e29f0 msgr2=0x7f728c1758d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f72927fc700 1 --2- 172.21.15.82:0/2424053130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f728c0e29f0 0x7f728c1758d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f72927fc700 1 -- 172.21.15.82:0/2424053130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f728c038560 msgr2=0x7f728c17c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f72927fc700 1 --2- 172.21.15.82:0/2424053130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f728c038560 0x7f728c17c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f72927fc700 1 -- 172.21.15.82:0/2424053130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72880094b0 con 0x7f728c03b330 2023-11-28T13:05:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f72927fc700 1 --2- 172.21.15.82:0/2424053130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f728c03b330 0x7f728c175390 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f728400c540 tx=0x7f728400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f727b7fe700 1 -- 172.21.15.82:0/2424053130 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72840054e0 con 0x7f728c03b330 2023-11-28T13:05:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f727b7fe700 1 -- 172.21.15.82:0/2424053130 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72840036a0 con 0x7f728c03b330 2023-11-28T13:05:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f7293fff700 1 -- 172.21.15.82:0/2424053130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f728c053920 con 0x7f728c03b330 2023-11-28T13:05:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f727b7fe700 1 -- 172.21.15.82:0/2424053130 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7284003a50 con 0x7f728c03b330 2023-11-28T13:05:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f7293fff700 1 -- 172.21.15.82:0/2424053130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f728c007080 con 0x7f728c03b330 2023-11-28T13:05:47.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f7293fff700 1 -- 172.21.15.82:0/2424053130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f728c053c00 con 0x7f728c03b330 2023-11-28T13:05:47.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.613+0000 7f727b7fe700 1 -- 172.21.15.82:0/2424053130 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7284019030 con 0x7f728c03b330 2023-11-28T13:05:47.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.617+0000 7f727b7fe700 1 --2- 172.21.15.82:0/2424053130 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7280064ee0 0x7f7280067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:47.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.617+0000 7f7292ffd700 1 --2- 172.21.15.82:0/2424053130 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7280064ee0 0x7f7280067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:47.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.617+0000 7f727b7fe700 1 -- 172.21.15.82:0/2424053130 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f72840812f0 con 0x7f728c03b330 2023-11-28T13:05:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.617+0000 7f7292ffd700 1 --2- 172.21.15.82:0/2424053130 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7280064ee0 0x7f7280067390 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7288009850 tx=0x7f7288008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:47.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.621+0000 7f727b7fe700 1 -- 172.21.15.82:0/2424053130 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f728404f410 con 0x7f728c03b330 2023-11-28T13:05:47.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.813+0000 7f7293fff700 1 -- 172.21.15.82:0/2424053130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f728c1784e0 con 0x7f728c03b330 2023-11-28T13:05:47.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.817+0000 7f727b7fe700 1 -- 172.21.15.82:0/2424053130 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f728c1784e0 con 0x7f728c03b330 2023-11-28T13:05:47.819 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:05:47.819 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:05:47.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.817+0000 7f7293fff700 1 -- 172.21.15.82:0/2424053130 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7280064ee0 msgr2=0x7f7280067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:47.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.817+0000 7f7293fff700 1 --2- 172.21.15.82:0/2424053130 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7280064ee0 0x7f7280067390 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7288009850 tx=0x7f7288008030 comp rx=0 tx=0).stop 2023-11-28T13:05:47.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.817+0000 7f7293fff700 1 -- 172.21.15.82:0/2424053130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f728c03b330 msgr2=0x7f728c175390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:47.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.817+0000 7f7293fff700 1 --2- 172.21.15.82:0/2424053130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f728c03b330 0x7f728c175390 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f728400c540 tx=0x7f728400c900 comp rx=0 tx=0).stop 2023-11-28T13:05:47.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.817+0000 7f7293fff700 1 -- 172.21.15.82:0/2424053130 shutdown_connections 2023-11-28T13:05:47.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.817+0000 7f7293fff700 1 --2- 172.21.15.82:0/2424053130 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7280064ee0 0x7f7280067390 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:47.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.817+0000 7f7293fff700 1 --2- 172.21.15.82:0/2424053130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f728c0e29f0 0x7f728c1758d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:47.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.817+0000 7f7293fff700 1 --2- 172.21.15.82:0/2424053130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f728c03b330 0x7f728c175390 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:47.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.817+0000 7f7293fff700 1 --2- 172.21.15.82:0/2424053130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f728c038560 0x7f728c17c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:47.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.817+0000 7f7293fff700 1 -- 172.21.15.82:0/2424053130 >> 172.21.15.82:0/2424053130 conn(0x7f728c055c20 msgr2=0x7f728c0dd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:47.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.817+0000 7f7293fff700 1 -- 172.21.15.82:0/2424053130 shutdown_connections 2023-11-28T13:05:47.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:47.817+0000 7f7293fff700 1 -- 172.21.15.82:0/2424053130 wait complete. 2023-11-28T13:05:47.833 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:05:52.834 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:05:52.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.949+0000 7fd780ee3700 1 Processor -- start 2023-11-28T13:05:52.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.949+0000 7fd780ee3700 1 -- start start 2023-11-28T13:05:52.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.949+0000 7fd780ee3700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd77c06cc50 0x7fd77c06d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:52.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.949+0000 7fd780ee3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd77c069bc0 0x7fd77c0ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:52.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.949+0000 7fd780ee3700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd77c0cde50 con 0x7fd77c0cfdf0 2023-11-28T13:05:52.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.949+0000 7fd780ee3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd77c0aeb00 con 0x7fd77c069bc0 2023-11-28T13:05:52.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.949+0000 7fd780ee3700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd77c06d560 con 0x7fd77c06cc50 2023-11-28T13:05:52.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.949+0000 7fd77ad9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd77c069bc0 0x7fd77c0ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:52.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.953+0000 7fd77ad9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd77c069bc0 0x7fd77c0ce2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55002/0 (socket says 172.21.15.82:55002) 2023-11-28T13:05:52.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.953+0000 7fd77ad9d700 1 -- 172.21.15.82:0/3901818477 learned_addr learned my addr 172.21.15.82:0/3901818477 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:05:52.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.953+0000 7fd77a59c700 1 --2- 172.21.15.82:0/3901818477 >> v2:172.21.15.114:3300/0 conn(0x7fd77c06cc50 0x7fd77c06d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:52.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.953+0000 7fd77ad9d700 1 -- 172.21.15.82:0/3901818477 >> v2:172.21.15.114:3300/0 conn(0x7fd77c06cc50 msgr2=0x7fd77c06d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:05:52.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.953+0000 7fd77ad9d700 1 --2- 172.21.15.82:0/3901818477 >> v2:172.21.15.114:3300/0 conn(0x7fd77c06cc50 0x7fd77c06d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:52.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.953+0000 7fd77ad9d700 1 -- 172.21.15.82:0/3901818477 >> v1:172.21.15.114:6789/0 conn(0x7fd77c0cfdf0 legacy=0x7fd77c0ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:05:52.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.953+0000 7fd77ad9d700 1 -- 172.21.15.82:0/3901818477 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c0cd240 con 0x7fd77c069bc0 2023-11-28T13:05:52.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.953+0000 7fd77ad9d700 1 --2- 172.21.15.82:0/3901818477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd77c069bc0 0x7fd77c0ce2e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fd77c070740 tx=0x7fd77400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf9c954083df278 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:52.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.953+0000 7fd779d9b700 1 -- 172.21.15.82:0/3901818477 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77400e070 con 0x7fd77c069bc0 2023-11-28T13:05:52.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.953+0000 7fd779d9b700 1 -- 172.21.15.82:0/3901818477 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd774003a40 con 0x7fd77c069bc0 2023-11-28T13:05:52.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.953+0000 7fd779d9b700 1 -- 172.21.15.82:0/3901818477 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd774003df0 con 0x7fd77c069bc0 2023-11-28T13:05:52.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.953+0000 7fd780ee3700 1 -- 172.21.15.82:0/3901818477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd77c069bc0 msgr2=0x7fd77c0ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:52.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.953+0000 7fd780ee3700 1 --2- 172.21.15.82:0/3901818477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd77c069bc0 0x7fd77c0ce2e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fd77c070740 tx=0x7fd77400b330 comp rx=0 tx=0).stop 2023-11-28T13:05:52.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.953+0000 7fd780ee3700 1 -- 172.21.15.82:0/3901818477 shutdown_connections 2023-11-28T13:05:52.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.953+0000 7fd780ee3700 1 --2- 172.21.15.82:0/3901818477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd77c069bc0 0x7fd77c0ce2e0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:52.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.953+0000 7fd780ee3700 1 --2- 172.21.15.82:0/3901818477 >> v2:172.21.15.114:3300/0 conn(0x7fd77c06cc50 0x7fd77c06d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:52.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.953+0000 7fd780ee3700 1 -- 172.21.15.82:0/3901818477 >> 172.21.15.82:0/3901818477 conn(0x7fd77c0cc9b0 msgr2=0x7fd77c0cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:52.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.953+0000 7fd780ee3700 1 -- 172.21.15.82:0/3901818477 shutdown_connections 2023-11-28T13:05:52.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.953+0000 7fd780ee3700 1 -- 172.21.15.82:0/3901818477 wait complete. 2023-11-28T13:05:52.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.957+0000 7fd780ee3700 1 Processor -- start 2023-11-28T13:05:52.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.957+0000 7fd780ee3700 1 -- start start 2023-11-28T13:05:52.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.957+0000 7fd780ee3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd77c069bc0 0x7fd77c15ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:52.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.957+0000 7fd780ee3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd77c06cc50 0x7fd77c0cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:52.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.957+0000 7fd780ee3700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd77c0cfdf0 0x7fd77c0ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:52.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.957+0000 7fd780ee3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c0cb2b0 con 0x7fd77c069bc0 2023-11-28T13:05:52.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.957+0000 7fd780ee3700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c159860 con 0x7fd77c06cc50 2023-11-28T13:05:52.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.957+0000 7fd780ee3700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c159b40 con 0x7fd77c0cfdf0 2023-11-28T13:05:52.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.957+0000 7fd77a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd77c069bc0 0x7fd77c15ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:52.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.961+0000 7fd77a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd77c069bc0 0x7fd77c15ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55006/0 (socket says 172.21.15.82:55006) 2023-11-28T13:05:52.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.961+0000 7fd77a59c700 1 -- 172.21.15.82:0/312838700 learned_addr learned my addr 172.21.15.82:0/312838700 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:05:52.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.961+0000 7fd773fff700 1 --2- 172.21.15.82:0/312838700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd77c06cc50 0x7fd77c0cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:52.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.961+0000 7fd77ad9d700 1 --2- 172.21.15.82:0/312838700 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd77c0cfdf0 0x7fd77c0ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:52.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.961+0000 7fd77a59c700 1 -- 172.21.15.82:0/312838700 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd77c0cfdf0 msgr2=0x7fd77c0ad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:52.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.961+0000 7fd77a59c700 1 --2- 172.21.15.82:0/312838700 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd77c0cfdf0 0x7fd77c0ad7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:52.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.961+0000 7fd77a59c700 1 -- 172.21.15.82:0/312838700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd77c06cc50 msgr2=0x7fd77c0cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:52.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.961+0000 7fd77a59c700 1 --2- 172.21.15.82:0/312838700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd77c06cc50 0x7fd77c0cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:52.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.961+0000 7fd77a59c700 1 -- 172.21.15.82:0/312838700 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd774009b30 con 0x7fd77c069bc0 2023-11-28T13:05:52.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.961+0000 7fd77a59c700 1 --2- 172.21.15.82:0/312838700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd77c069bc0 0x7fd77c15ad20 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00e760 tx=0x7fd76c00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:52.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.961+0000 7fd772ffd700 1 -- 172.21.15.82:0/312838700 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c00c070 con 0x7fd77c069bc0 2023-11-28T13:05:52.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.961+0000 7fd772ffd700 1 -- 172.21.15.82:0/312838700 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76c013610 con 0x7fd77c069bc0 2023-11-28T13:05:52.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.961+0000 7fd780ee3700 1 -- 172.21.15.82:0/312838700 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd77c0cd800 con 0x7fd77c069bc0 2023-11-28T13:05:52.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.961+0000 7fd772ffd700 1 -- 172.21.15.82:0/312838700 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c013980 con 0x7fd77c069bc0 2023-11-28T13:05:52.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.961+0000 7fd780ee3700 1 -- 172.21.15.82:0/312838700 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77c0cd520 con 0x7fd77c069bc0 2023-11-28T13:05:52.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.961+0000 7fd780ee3700 1 -- 172.21.15.82:0/312838700 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd77c0cdae0 con 0x7fd77c069bc0 2023-11-28T13:05:52.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.961+0000 7fd772ffd700 1 -- 172.21.15.82:0/312838700 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd76c023070 con 0x7fd77c069bc0 2023-11-28T13:05:52.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.965+0000 7fd772ffd700 1 --2- 172.21.15.82:0/312838700 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd75c064ee0 0x7fd75c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:52.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.965+0000 7fd773fff700 1 --2- 172.21.15.82:0/312838700 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd75c064ee0 0x7fd75c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:52.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.965+0000 7fd772ffd700 1 -- 172.21.15.82:0/312838700 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7fd76c081d00 con 0x7fd77c069bc0 2023-11-28T13:05:52.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.965+0000 7fd773fff700 1 --2- 172.21.15.82:0/312838700 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd75c064ee0 0x7fd75c067390 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0b1d70 tx=0x7fd7640090e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:52.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:52.973+0000 7fd772ffd700 1 -- 172.21.15.82:0/312838700 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd76c04fd30 con 0x7fd77c069bc0 2023-11-28T13:05:53.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:53.169+0000 7fd780ee3700 1 -- 172.21.15.82:0/312838700 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd77c073e20 con 0x7fd77c069bc0 2023-11-28T13:05:53.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:53.169+0000 7fd772ffd700 1 -- 172.21.15.82:0/312838700 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fd76c00f040 con 0x7fd77c069bc0 2023-11-28T13:05:53.175 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:05:53.175 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:05:53.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:53.173+0000 7fd780ee3700 1 -- 172.21.15.82:0/312838700 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd75c064ee0 msgr2=0x7fd75c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:53.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:53.173+0000 7fd780ee3700 1 --2- 172.21.15.82:0/312838700 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd75c064ee0 0x7fd75c067390 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0b1d70 tx=0x7fd7640090e0 comp rx=0 tx=0).stop 2023-11-28T13:05:53.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:53.173+0000 7fd780ee3700 1 -- 172.21.15.82:0/312838700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd77c069bc0 msgr2=0x7fd77c15ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:53.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:53.173+0000 7fd780ee3700 1 --2- 172.21.15.82:0/312838700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd77c069bc0 0x7fd77c15ad20 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00e760 tx=0x7fd76c00ea70 comp rx=0 tx=0).stop 2023-11-28T13:05:53.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:53.173+0000 7fd780ee3700 1 -- 172.21.15.82:0/312838700 shutdown_connections 2023-11-28T13:05:53.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:53.173+0000 7fd780ee3700 1 --2- 172.21.15.82:0/312838700 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd75c064ee0 0x7fd75c067390 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:53.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:53.173+0000 7fd780ee3700 1 --2- 172.21.15.82:0/312838700 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd77c0cfdf0 0x7fd77c0ad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:53.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:53.173+0000 7fd780ee3700 1 --2- 172.21.15.82:0/312838700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd77c06cc50 0x7fd77c0cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:53.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:53.173+0000 7fd780ee3700 1 --2- 172.21.15.82:0/312838700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd77c069bc0 0x7fd77c15ad20 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:53.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:53.173+0000 7fd780ee3700 1 -- 172.21.15.82:0/312838700 >> 172.21.15.82:0/312838700 conn(0x7fd77c0cc9b0 msgr2=0x7fd77c06d840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:53.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:53.173+0000 7fd780ee3700 1 -- 172.21.15.82:0/312838700 shutdown_connections 2023-11-28T13:05:53.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:53.173+0000 7fd780ee3700 1 -- 172.21.15.82:0/312838700 wait complete. 2023-11-28T13:05:53.189 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:05:57.788 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:05:57.790 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:05:58.190 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:05:58.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.304+0000 7fd6ce158700 1 Processor -- start 2023-11-28T13:05:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.304+0000 7fd6ce158700 1 -- start start 2023-11-28T13:05:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6ce158700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd6c8070070 0x7fd6c8070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:58.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6ce158700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6c80c1910 0x7fd6c806c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:58.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6ce158700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c8070980 con 0x7fd6c8160900 2023-11-28T13:05:58.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6ce158700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c80ce030 con 0x7fd6c80c1910 2023-11-28T13:05:58.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6ce158700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c80ce310 con 0x7fd6c8070070 2023-11-28T13:05:58.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6cd957700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6c80c1910 0x7fd6c806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:58.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6cd957700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6c80c1910 0x7fd6c806c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40990/0 (socket says 172.21.15.82:40990) 2023-11-28T13:05:58.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6cd957700 1 -- 172.21.15.82:0/4050575567 learned_addr learned my addr 172.21.15.82:0/4050575567 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:05:58.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6cd156700 1 --2- 172.21.15.82:0/4050575567 >> v2:172.21.15.114:3300/0 conn(0x7fd6c8070070 0x7fd6c8070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:58.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6cd957700 1 -- 172.21.15.82:0/4050575567 >> v2:172.21.15.114:3300/0 conn(0x7fd6c8070070 msgr2=0x7fd6c8070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:05:58.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6cd957700 1 --2- 172.21.15.82:0/4050575567 >> v2:172.21.15.114:3300/0 conn(0x7fd6c8070070 0x7fd6c8070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:58.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6cd957700 1 -- 172.21.15.82:0/4050575567 >> v1:172.21.15.114:6789/0 conn(0x7fd6c8160900 legacy=0x7fd6c80cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:58.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6cd957700 1 -- 172.21.15.82:0/4050575567 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c806a5d0 con 0x7fd6c80c1910 2023-11-28T13:05:58.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6cd957700 1 --2- 172.21.15.82:0/4050575567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c80c1910 0x7fd6c806c070 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd6c806bf40 tx=0x7fd6c0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41269187919fb118 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:58.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6bffff700 1 -- 172.21.15.82:0/4050575567 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c000b8a0 con 0x7fd6c80c1910 2023-11-28T13:05:58.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6bffff700 1 -- 172.21.15.82:0/4050575567 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c000ba00 con 0x7fd6c80c1910 2023-11-28T13:05:58.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6bffff700 1 -- 172.21.15.82:0/4050575567 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c000bd90 con 0x7fd6c80c1910 2023-11-28T13:05:58.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6ce158700 1 -- 172.21.15.82:0/4050575567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c80c1910 msgr2=0x7fd6c806c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:58.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6ce158700 1 --2- 172.21.15.82:0/4050575567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c80c1910 0x7fd6c806c070 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd6c806bf40 tx=0x7fd6c0009bf0 comp rx=0 tx=0).stop 2023-11-28T13:05:58.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6ce158700 1 -- 172.21.15.82:0/4050575567 shutdown_connections 2023-11-28T13:05:58.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6ce158700 1 --2- 172.21.15.82:0/4050575567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c80c1910 0x7fd6c806c070 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:58.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6ce158700 1 --2- 172.21.15.82:0/4050575567 >> v2:172.21.15.114:3300/0 conn(0x7fd6c8070070 0x7fd6c8070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:58.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6ce158700 1 -- 172.21.15.82:0/4050575567 >> 172.21.15.82:0/4050575567 conn(0x7fd6c80ce600 msgr2=0x7fd6c80ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:58.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6ce158700 1 -- 172.21.15.82:0/4050575567 shutdown_connections 2023-11-28T13:05:58.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.308+0000 7fd6ce158700 1 -- 172.21.15.82:0/4050575567 wait complete. 2023-11-28T13:05:58.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.312+0000 7fd6ce158700 1 Processor -- start 2023-11-28T13:05:58.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.312+0000 7fd6ce158700 1 -- start start 2023-11-28T13:05:58.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6ce158700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6c8070070 0x7fd6c815cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:58.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6ce158700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c8160ce0 0x7fd6c80b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:58.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6ce158700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6c80b29c0 0x7fd6c80c2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:58.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6ce158700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c81f70f0 con 0x7fd6c8160ce0 2023-11-28T13:05:58.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6ce158700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c80b2e30 con 0x7fd6c8070070 2023-11-28T13:05:58.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6ce158700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c815d150 con 0x7fd6c80b29c0 2023-11-28T13:05:58.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6cc955700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c8160ce0 0x7fd6c80b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:58.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6cc955700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c8160ce0 0x7fd6c80b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40996/0 (socket says 172.21.15.82:40996) 2023-11-28T13:05:58.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6cc955700 1 -- 172.21.15.82:0/2815566961 learned_addr learned my addr 172.21.15.82:0/2815566961 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:05:58.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6cd156700 1 --2- 172.21.15.82:0/2815566961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6c8070070 0x7fd6c815cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:58.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6cd957700 1 --2- 172.21.15.82:0/2815566961 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6c80b29c0 0x7fd6c80c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:58.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6cc955700 1 -- 172.21.15.82:0/2815566961 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6c80b29c0 msgr2=0x7fd6c80c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:58.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6cc955700 1 --2- 172.21.15.82:0/2815566961 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6c80b29c0 0x7fd6c80c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:58.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6cc955700 1 -- 172.21.15.82:0/2815566961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6c8070070 msgr2=0x7fd6c815cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:58.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6cc955700 1 --2- 172.21.15.82:0/2815566961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6c8070070 0x7fd6c815cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:58.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6cc955700 1 -- 172.21.15.82:0/2815566961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c0009570 con 0x7fd6c8160ce0 2023-11-28T13:05:58.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6cc955700 1 --2- 172.21.15.82:0/2815566961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c8160ce0 0x7fd6c80b2480 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400cc80 tx=0x7fd6c400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:58.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6bdffb700 1 -- 172.21.15.82:0/2815566961 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4003c20 con 0x7fd6c8160ce0 2023-11-28T13:05:58.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6bdffb700 1 -- 172.21.15.82:0/2815566961 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c4003d80 con 0x7fd6c8160ce0 2023-11-28T13:05:58.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6ce158700 1 -- 172.21.15.82:0/2815566961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c806ab90 con 0x7fd6c8160ce0 2023-11-28T13:05:58.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6bdffb700 1 -- 172.21.15.82:0/2815566961 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c400aac0 con 0x7fd6c8160ce0 2023-11-28T13:05:58.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6ce158700 1 -- 172.21.15.82:0/2815566961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c806a8b0 con 0x7fd6c8160ce0 2023-11-28T13:05:58.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.316+0000 7fd6ce158700 1 -- 172.21.15.82:0/2815566961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c80cdc50 con 0x7fd6c8160ce0 2023-11-28T13:05:58.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.320+0000 7fd6bdffb700 1 -- 172.21.15.82:0/2815566961 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd6c4010050 con 0x7fd6c8160ce0 2023-11-28T13:05:58.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.320+0000 7fd6bdffb700 1 --2- 172.21.15.82:0/2815566961 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd6ac064ee0 0x7fd6ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:05:58.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.320+0000 7fd6cd156700 1 --2- 172.21.15.82:0/2815566961 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd6ac064ee0 0x7fd6ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:05:58.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.320+0000 7fd6bdffb700 1 -- 172.21.15.82:0/2815566961 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7fd6c4081e60 con 0x7fd6c8160ce0 2023-11-28T13:05:58.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.320+0000 7fd6cd156700 1 --2- 172.21.15.82:0/2815566961 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd6ac064ee0 0x7fd6ac067390 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8007a60 tx=0x7fd6b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:05:58.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.324+0000 7fd6bdffb700 1 -- 172.21.15.82:0/2815566961 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd6c404fe90 con 0x7fd6c8160ce0 2023-11-28T13:05:58.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.524+0000 7fd6ce158700 1 -- 172.21.15.82:0/2815566961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd6c80c32f0 con 0x7fd6c8160ce0 2023-11-28T13:05:58.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.528+0000 7fd6bdffb700 1 -- 172.21.15.82:0/2815566961 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fd6c80c32f0 con 0x7fd6c8160ce0 2023-11-28T13:05:58.531 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:05:58.532 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:05:58.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.528+0000 7fd6ce158700 1 -- 172.21.15.82:0/2815566961 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd6ac064ee0 msgr2=0x7fd6ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:58.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.528+0000 7fd6ce158700 1 --2- 172.21.15.82:0/2815566961 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd6ac064ee0 0x7fd6ac067390 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8007a60 tx=0x7fd6b8008040 comp rx=0 tx=0).stop 2023-11-28T13:05:58.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.528+0000 7fd6ce158700 1 -- 172.21.15.82:0/2815566961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c8160ce0 msgr2=0x7fd6c80b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:05:58.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.528+0000 7fd6ce158700 1 --2- 172.21.15.82:0/2815566961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c8160ce0 0x7fd6c80b2480 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400cc80 tx=0x7fd6c400cf90 comp rx=0 tx=0).stop 2023-11-28T13:05:58.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.528+0000 7fd6ce158700 1 -- 172.21.15.82:0/2815566961 shutdown_connections 2023-11-28T13:05:58.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.528+0000 7fd6ce158700 1 --2- 172.21.15.82:0/2815566961 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd6ac064ee0 0x7fd6ac067390 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:58.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.528+0000 7fd6ce158700 1 --2- 172.21.15.82:0/2815566961 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6c80b29c0 0x7fd6c80c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:58.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.528+0000 7fd6ce158700 1 --2- 172.21.15.82:0/2815566961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c8160ce0 0x7fd6c80b2480 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:58.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.528+0000 7fd6ce158700 1 --2- 172.21.15.82:0/2815566961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6c8070070 0x7fd6c815cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:05:58.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.528+0000 7fd6ce158700 1 -- 172.21.15.82:0/2815566961 >> 172.21.15.82:0/2815566961 conn(0x7fd6c80ce600 msgr2=0x7fd6c80adcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:05:58.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.528+0000 7fd6ce158700 1 -- 172.21.15.82:0/2815566961 shutdown_connections 2023-11-28T13:05:58.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:05:58.528+0000 7fd6ce158700 1 -- 172.21.15.82:0/2815566961 wait complete. 2023-11-28T13:05:58.547 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:06:03.548 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:06:03.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.664+0000 7f9af5ce2700 1 Processor -- start 2023-11-28T13:06:03.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.664+0000 7f9af5ce2700 1 -- start start 2023-11-28T13:06:03.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.664+0000 7f9af5ce2700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9af006d820 0x7f9af006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:03.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.664+0000 7f9af5ce2700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af015d9b0 con 0x7f9af006d3d0 2023-11-28T13:06:03.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.664+0000 7f9af5ce2700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af0159300 con 0x7f9af0158f30 2023-11-28T13:06:03.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.664+0000 7f9af5ce2700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af015ce30 con 0x7f9af006d820 2023-11-28T13:06:03.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.664+0000 7f9aeffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9af006d3d0 0x7f9af006b890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47676/0 (socket says 172.21.15.82:47676) 2023-11-28T13:06:03.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.664+0000 7f9aeffff700 1 -- 172.21.15.82:0/2076087471 learned_addr learned my addr 172.21.15.82:0/2076087471 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:06:03.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.664+0000 7f9af54e1700 1 --2- 172.21.15.82:0/2076087471 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9af006d820 0x7f9af006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:03.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.664+0000 7f9aef7fe700 1 -- 172.21.15.82:0/2076087471 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083734130 0 0) 0x7f9af0159300 con 0x7f9af0158f30 2023-11-28T13:06:03.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.664+0000 7f9aef7fe700 1 -- 172.21.15.82:0/2076087471 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9adc0057e0 con 0x7f9af0158f30 2023-11-28T13:06:03.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.664+0000 7f9aef7fe700 1 -- 172.21.15.82:0/2076087471 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135647274 0 0) 0x7f9af015d9b0 con 0x7f9af006d3d0 2023-11-28T13:06:03.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.664+0000 7f9aef7fe700 1 -- 172.21.15.82:0/2076087471 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9af0159300 con 0x7f9af006d3d0 2023-11-28T13:06:03.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.664+0000 7f9af54e1700 1 -- 172.21.15.82:0/2076087471 >> v1:172.21.15.114:6789/0 conn(0x7f9af0158f30 legacy=0x7f9af00ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:03.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.664+0000 7f9af54e1700 1 -- 172.21.15.82:0/2076087471 >> v1:172.21.15.82:6789/0 conn(0x7f9af006d3d0 legacy=0x7f9af006b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:03.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.664+0000 7f9aef7fe700 1 -- 172.21.15.82:0/2076087471 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4101081542 0 0) 0x7f9af0159300 con 0x7f9af006d3d0 2023-11-28T13:06:03.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.664+0000 7f9af54e1700 1 -- 172.21.15.82:0/2076087471 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af015d110 con 0x7f9af006d820 2023-11-28T13:06:03.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.664+0000 7f9af54e1700 1 --2- 172.21.15.82:0/2076087471 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9af006d820 0x7f9af006bfa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8009dc0 tx=0x7f9ad800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0039b7cb99f6fd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:03.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9aef7fe700 1 -- 172.21.15.82:0/2076087471 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad800e070 con 0x7f9af006d820 2023-11-28T13:06:03.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9aef7fe700 1 -- 172.21.15.82:0/2076087471 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad8003a40 con 0x7f9af006d820 2023-11-28T13:06:03.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9aef7fe700 1 -- 172.21.15.82:0/2076087471 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0001670 con 0x7f9af006d820 2023-11-28T13:06:03.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9af5ce2700 1 -- 172.21.15.82:0/2076087471 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9af006d820 msgr2=0x7f9af006bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:03.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9af5ce2700 1 --2- 172.21.15.82:0/2076087471 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9af006d820 0x7f9af006bfa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8009dc0 tx=0x7f9ad800b330 comp rx=0 tx=0).stop 2023-11-28T13:06:03.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9af5ce2700 1 -- 172.21.15.82:0/2076087471 shutdown_connections 2023-11-28T13:06:03.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9af5ce2700 1 --2- 172.21.15.82:0/2076087471 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9af006d820 0x7f9af006bfa0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:03.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9af5ce2700 1 -- 172.21.15.82:0/2076087471 >> 172.21.15.82:0/2076087471 conn(0x7f9af00cce10 msgr2=0x7f9af00cf700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:03.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9af5ce2700 1 -- 172.21.15.82:0/2076087471 shutdown_connections 2023-11-28T13:06:03.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9af5ce2700 1 -- 172.21.15.82:0/2076087471 wait complete. 2023-11-28T13:06:03.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9af5ce2700 1 Processor -- start 2023-11-28T13:06:03.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9af5ce2700 1 -- start start 2023-11-28T13:06:03.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9af5ce2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af006d3d0 0x7f9af01ed080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:03.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9af5ce2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9af006d820 0x7f9af014f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:03.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9af5ce2700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9af0158f30 0x7f9af014fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:03.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9af5ce2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af00b3090 con 0x7f9af006d820 2023-11-28T13:06:03.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9af5ce2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af01ed5c0 con 0x7f9af006d3d0 2023-11-28T13:06:03.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9af5ce2700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af00b0fa0 con 0x7f9af0158f30 2023-11-28T13:06:03.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9aeffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9af006d820 0x7f9af014f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:03.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9aeffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9af006d820 0x7f9af014f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41010/0 (socket says 172.21.15.82:41010) 2023-11-28T13:06:03.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9aeffff700 1 -- 172.21.15.82:0/4120626108 learned_addr learned my addr 172.21.15.82:0/4120626108 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:06:03.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9af4ce0700 1 --2- 172.21.15.82:0/4120626108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af006d3d0 0x7f9af01ed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:03.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9af54e1700 1 --2- 172.21.15.82:0/4120626108 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9af0158f30 0x7f9af014fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:03.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9aeffff700 1 -- 172.21.15.82:0/4120626108 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9af0158f30 msgr2=0x7f9af014fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:03.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9aeffff700 1 --2- 172.21.15.82:0/4120626108 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9af0158f30 0x7f9af014fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:03.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9aeffff700 1 -- 172.21.15.82:0/4120626108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af006d3d0 msgr2=0x7f9af01ed080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:03.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9aeffff700 1 --2- 172.21.15.82:0/4120626108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af006d3d0 0x7f9af01ed080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:03.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9aeffff700 1 -- 172.21.15.82:0/4120626108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad8009a70 con 0x7f9af006d820 2023-11-28T13:06:03.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.668+0000 7f9af4ce0700 1 --2- 172.21.15.82:0/4120626108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af006d3d0 0x7f9af01ed080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:06:03.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.672+0000 7f9aeffff700 1 --2- 172.21.15.82:0/4120626108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9af006d820 0x7f9af014f990 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000c550 tx=0x7f9ae000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:03.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.672+0000 7f9aed7fa700 1 -- 172.21.15.82:0/4120626108 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0004ca0 con 0x7f9af006d820 2023-11-28T13:06:03.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.672+0000 7f9aed7fa700 1 -- 172.21.15.82:0/4120626108 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae0004e00 con 0x7f9af006d820 2023-11-28T13:06:03.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.672+0000 7f9aed7fa700 1 -- 172.21.15.82:0/4120626108 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0007310 con 0x7f9af006d820 2023-11-28T13:06:03.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.672+0000 7f9af5ce2700 1 -- 172.21.15.82:0/4120626108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af015d6d0 con 0x7f9af006d820 2023-11-28T13:06:03.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.672+0000 7f9af5ce2700 1 -- 172.21.15.82:0/4120626108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af015d3f0 con 0x7f9af006d820 2023-11-28T13:06:03.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.672+0000 7f9af5ce2700 1 -- 172.21.15.82:0/4120626108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af00ce930 con 0x7f9af006d820 2023-11-28T13:06:03.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.672+0000 7f9aed7fa700 1 -- 172.21.15.82:0/4120626108 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9ae001a020 con 0x7f9af006d820 2023-11-28T13:06:03.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.672+0000 7f9aed7fa700 1 --2- 172.21.15.82:0/4120626108 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ad0064ee0 0x7f9ad0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:03.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.676+0000 7f9aed7fa700 1 -- 172.21.15.82:0/4120626108 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f9ae0081c30 con 0x7f9af006d820 2023-11-28T13:06:03.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.676+0000 7f9af4ce0700 1 --2- 172.21.15.82:0/4120626108 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ad0064ee0 0x7f9ad0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:03.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.676+0000 7f9af4ce0700 1 --2- 172.21.15.82:0/4120626108 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ad0064ee0 0x7f9ad0067390 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9ae80011e0 tx=0x7f9ae8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:03.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.680+0000 7f9aed7fa700 1 -- 172.21.15.82:0/4120626108 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9ae004fc00 con 0x7f9af006d820 2023-11-28T13:06:03.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.876+0000 7f9af5ce2700 1 -- 172.21.15.82:0/4120626108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9af015cb70 con 0x7f9af006d820 2023-11-28T13:06:03.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.876+0000 7f9aed7fa700 1 -- 172.21.15.82:0/4120626108 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f9ae0053220 con 0x7f9af006d820 2023-11-28T13:06:03.882 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:06:03.882 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:06:03.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.880+0000 7f9af5ce2700 1 -- 172.21.15.82:0/4120626108 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ad0064ee0 msgr2=0x7f9ad0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:03.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.880+0000 7f9af5ce2700 1 --2- 172.21.15.82:0/4120626108 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ad0064ee0 0x7f9ad0067390 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9ae80011e0 tx=0x7f9ae8009040 comp rx=0 tx=0).stop 2023-11-28T13:06:03.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.880+0000 7f9af5ce2700 1 -- 172.21.15.82:0/4120626108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9af006d820 msgr2=0x7f9af014f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:03.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.880+0000 7f9af5ce2700 1 --2- 172.21.15.82:0/4120626108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9af006d820 0x7f9af014f990 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000c550 tx=0x7f9ae000c910 comp rx=0 tx=0).stop 2023-11-28T13:06:03.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.880+0000 7f9af5ce2700 1 -- 172.21.15.82:0/4120626108 shutdown_connections 2023-11-28T13:06:03.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.880+0000 7f9af5ce2700 1 --2- 172.21.15.82:0/4120626108 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9ad0064ee0 0x7f9ad0067390 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:03.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.880+0000 7f9af5ce2700 1 --2- 172.21.15.82:0/4120626108 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9af0158f30 0x7f9af014fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:03.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.880+0000 7f9af5ce2700 1 --2- 172.21.15.82:0/4120626108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9af006d820 0x7f9af014f990 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:03.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.880+0000 7f9af5ce2700 1 --2- 172.21.15.82:0/4120626108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af006d3d0 0x7f9af01ed080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:03.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.880+0000 7f9af5ce2700 1 -- 172.21.15.82:0/4120626108 >> 172.21.15.82:0/4120626108 conn(0x7f9af00cce10 msgr2=0x7f9af00ce220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:03.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.880+0000 7f9af5ce2700 1 -- 172.21.15.82:0/4120626108 shutdown_connections 2023-11-28T13:06:03.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:03.880+0000 7f9af5ce2700 1 -- 172.21.15.82:0/4120626108 wait complete. 2023-11-28T13:06:03.897 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:06:08.898 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:06:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.148+0000 7f3692e27700 1 Processor -- start 2023-11-28T13:06:09.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.148+0000 7f3692e27700 1 -- start start 2023-11-28T13:06:09.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3692e27700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f368c0b1c70 0x7f368c06a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:09.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3692e27700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f368c0b5870 0x7f368c0b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:09.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3692e27700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f368c0d0c70 con 0x7f368c0b5c80 2023-11-28T13:06:09.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3692e27700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368c0cd090 con 0x7f368c0b1c70 2023-11-28T13:06:09.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3692e27700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368c0cd8a0 con 0x7f368c0b5870 2023-11-28T13:06:09.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3691e25700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f368c0b1c70 0x7f368c06a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:09.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3691e25700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f368c0b1c70 0x7f368c06a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35172/0 (socket says 172.21.15.82:35172) 2023-11-28T13:06:09.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3691e25700 1 -- 172.21.15.82:0/2854350531 learned_addr learned my addr 172.21.15.82:0/2854350531 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:06:09.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3691624700 1 --2- 172.21.15.82:0/2854350531 >> v2:172.21.15.114:3300/0 conn(0x7f368c0b5870 0x7f368c0b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:09.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3691e25700 1 -- 172.21.15.82:0/2854350531 >> v2:172.21.15.114:3300/0 conn(0x7f368c0b5870 msgr2=0x7f368c0b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:06:09.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3691e25700 1 --2- 172.21.15.82:0/2854350531 >> v2:172.21.15.114:3300/0 conn(0x7f368c0b5870 0x7f368c0b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:09.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3691e25700 1 -- 172.21.15.82:0/2854350531 >> v1:172.21.15.114:6789/0 conn(0x7f368c0b5c80 legacy=0x7f368c0d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:09.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3691e25700 1 -- 172.21.15.82:0/2854350531 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c06ab10 con 0x7f368c0b1c70 2023-11-28T13:06:09.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3691e25700 1 --2- 172.21.15.82:0/2854350531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f368c0b1c70 0x7f368c06a5d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f368c15fcf0 tx=0x7f3680009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f581c612dfe2c875 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:09.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3690e23700 1 -- 172.21.15.82:0/2854350531 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680011830 con 0x7f368c0b1c70 2023-11-28T13:06:09.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3690e23700 1 -- 172.21.15.82:0/2854350531 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3680011990 con 0x7f368c0b1c70 2023-11-28T13:06:09.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3690e23700 1 -- 172.21.15.82:0/2854350531 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680011d20 con 0x7f368c0b1c70 2023-11-28T13:06:09.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3692e27700 1 -- 172.21.15.82:0/2854350531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f368c0b1c70 msgr2=0x7f368c06a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:09.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3692e27700 1 --2- 172.21.15.82:0/2854350531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f368c0b1c70 0x7f368c06a5d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f368c15fcf0 tx=0x7f3680009bf0 comp rx=0 tx=0).stop 2023-11-28T13:06:09.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3692e27700 1 -- 172.21.15.82:0/2854350531 shutdown_connections 2023-11-28T13:06:09.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3692e27700 1 --2- 172.21.15.82:0/2854350531 >> v2:172.21.15.114:3300/0 conn(0x7f368c0b5870 0x7f368c0b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:09.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3692e27700 1 --2- 172.21.15.82:0/2854350531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f368c0b1c70 0x7f368c06a5d0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:09.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3692e27700 1 -- 172.21.15.82:0/2854350531 >> 172.21.15.82:0/2854350531 conn(0x7f368c0cf4c0 msgr2=0x7f368c0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:09.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3692e27700 1 -- 172.21.15.82:0/2854350531 shutdown_connections 2023-11-28T13:06:09.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.152+0000 7f3692e27700 1 -- 172.21.15.82:0/2854350531 wait complete. 2023-11-28T13:06:09.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f3692e27700 1 Processor -- start 2023-11-28T13:06:09.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f3692e27700 1 -- start start 2023-11-28T13:06:09.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f3692e27700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f368c0b1c70 0x7f368c14da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:09.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f3692e27700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f368c0b5870 0x7f368c0ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:09.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f3692e27700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f368c0b5c80 0x7f368c15de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:09.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f3692e27700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c153290 con 0x7f368c0b5870 2023-11-28T13:06:09.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f3692e27700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c152c80 con 0x7f368c0b1c70 2023-11-28T13:06:09.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f3692e27700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368c0cafa0 con 0x7f368c0b5c80 2023-11-28T13:06:09.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f3691624700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f368c0b5870 0x7f368c0ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:09.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f3691624700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f368c0b5870 0x7f368c0ca650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35188/0 (socket says 172.21.15.82:35188) 2023-11-28T13:06:09.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f3691624700 1 -- 172.21.15.82:0/3316002573 learned_addr learned my addr 172.21.15.82:0/3316002573 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:06:09.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f3691e25700 1 --2- 172.21.15.82:0/3316002573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f368c0b1c70 0x7f368c14da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:09.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f3692626700 1 --2- 172.21.15.82:0/3316002573 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f368c0b5c80 0x7f368c15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:09.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f3691624700 1 -- 172.21.15.82:0/3316002573 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f368c0b5c80 msgr2=0x7f368c15de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:09.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f3691624700 1 --2- 172.21.15.82:0/3316002573 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f368c0b5c80 0x7f368c15de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:09.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f3691624700 1 -- 172.21.15.82:0/3316002573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f368c0b1c70 msgr2=0x7f368c14da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:09.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f3691624700 1 --2- 172.21.15.82:0/3316002573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f368c0b1c70 0x7f368c14da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:09.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f3691624700 1 -- 172.21.15.82:0/3316002573 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3680009570 con 0x7f368c0b5870 2023-11-28T13:06:09.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f3692626700 1 --2- 172.21.15.82:0/3316002573 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f368c0b5c80 0x7f368c15de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:06:09.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f3691624700 1 --2- 172.21.15.82:0/3316002573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f368c0b5870 0x7f368c0ca650 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f368800e9d0 tx=0x7f368800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:09.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f367e7fc700 1 -- 172.21.15.82:0/3316002573 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3688009720 con 0x7f368c0b5870 2023-11-28T13:06:09.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f367e7fc700 1 -- 172.21.15.82:0/3316002573 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368800c850 con 0x7f368c0b5870 2023-11-28T13:06:09.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.156+0000 7f367e7fc700 1 -- 172.21.15.82:0/3316002573 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368800cbc0 con 0x7f368c0b5870 2023-11-28T13:06:09.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.160+0000 7f3692e27700 1 -- 172.21.15.82:0/3316002573 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368c0cd5c0 con 0x7f368c0b5870 2023-11-28T13:06:09.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.160+0000 7f3692e27700 1 -- 172.21.15.82:0/3316002573 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368c0cd2e0 con 0x7f368c0b5870 2023-11-28T13:06:09.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.160+0000 7f3692e27700 1 -- 172.21.15.82:0/3316002573 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368c0d0900 con 0x7f368c0b5870 2023-11-28T13:06:09.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.160+0000 7f367e7fc700 1 -- 172.21.15.82:0/3316002573 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3688019030 con 0x7f368c0b5870 2023-11-28T13:06:09.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.160+0000 7f367e7fc700 1 --2- 172.21.15.82:0/3316002573 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3670064ee0 0x7f3670067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:09.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.164+0000 7f367e7fc700 1 -- 172.21.15.82:0/3316002573 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f3688081eb0 con 0x7f368c0b5870 2023-11-28T13:06:09.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.164+0000 7f3691e25700 1 --2- 172.21.15.82:0/3316002573 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3670064ee0 0x7f3670067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:09.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.164+0000 7f3691e25700 1 --2- 172.21.15.82:0/3316002573 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3670064ee0 0x7f3670067390 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3680000c00 tx=0x7f3680008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:09.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.168+0000 7f367e7fc700 1 -- 172.21.15.82:0/3316002573 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f368804ffd0 con 0x7f368c0b5870 2023-11-28T13:06:09.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.368+0000 7f3692e27700 1 -- 172.21.15.82:0/3316002573 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f368c065fc0 con 0x7f368c0b5870 2023-11-28T13:06:09.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.368+0000 7f367e7fc700 1 -- 172.21.15.82:0/3316002573 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f36880535f0 con 0x7f368c0b5870 2023-11-28T13:06:09.375 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:06:09.375 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:06:09.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.372+0000 7f3692e27700 1 -- 172.21.15.82:0/3316002573 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3670064ee0 msgr2=0x7f3670067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:09.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.372+0000 7f3692e27700 1 --2- 172.21.15.82:0/3316002573 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3670064ee0 0x7f3670067390 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3680000c00 tx=0x7f3680008030 comp rx=0 tx=0).stop 2023-11-28T13:06:09.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.372+0000 7f3692e27700 1 -- 172.21.15.82:0/3316002573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f368c0b5870 msgr2=0x7f368c0ca650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:09.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.372+0000 7f3692e27700 1 --2- 172.21.15.82:0/3316002573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f368c0b5870 0x7f368c0ca650 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f368800e9d0 tx=0x7f368800ece0 comp rx=0 tx=0).stop 2023-11-28T13:06:09.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.372+0000 7f3692e27700 1 -- 172.21.15.82:0/3316002573 shutdown_connections 2023-11-28T13:06:09.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.372+0000 7f3692e27700 1 --2- 172.21.15.82:0/3316002573 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3670064ee0 0x7f3670067390 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:09.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.372+0000 7f3692e27700 1 --2- 172.21.15.82:0/3316002573 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f368c0b5c80 0x7f368c15de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:09.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.372+0000 7f3692e27700 1 --2- 172.21.15.82:0/3316002573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f368c0b5870 0x7f368c0ca650 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:09.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.372+0000 7f3692e27700 1 --2- 172.21.15.82:0/3316002573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f368c0b1c70 0x7f368c14da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:09.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.372+0000 7f3692e27700 1 -- 172.21.15.82:0/3316002573 >> 172.21.15.82:0/3316002573 conn(0x7f368c0cf4c0 msgr2=0x7f368c0d1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:09.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.372+0000 7f3692e27700 1 -- 172.21.15.82:0/3316002573 shutdown_connections 2023-11-28T13:06:09.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:09.372+0000 7f3692e27700 1 -- 172.21.15.82:0/3316002573 wait complete. 2023-11-28T13:06:09.389 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:06:14.390 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:06:14.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.500+0000 7fa5b359e700 1 Processor -- start 2023-11-28T13:06:14.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.500+0000 7fa5b359e700 1 -- start start 2023-11-28T13:06:14.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa5b4158df0 0x7fa5b415d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:14.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b359e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5b41591c0 0x7fa5b406c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:14.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b359e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b415da50 con 0x7fa5b4070070 2023-11-28T13:06:14.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b359e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b40c9e20 con 0x7fa5b4158df0 2023-11-28T13:06:14.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b359e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b406c5b0 con 0x7fa5b41591c0 2023-11-28T13:06:14.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b259c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa5b4158df0 0x7fa5b415d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:14.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b2d9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa5b4070070 0x7fa5b40ca2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45732/0 (socket says 172.21.15.82:45732) 2023-11-28T13:06:14.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b2d9d700 1 -- 172.21.15.82:0/739726908 learned_addr learned my addr 172.21.15.82:0/739726908 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:06:14.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b1d9b700 1 --2- 172.21.15.82:0/739726908 >> v2:172.21.15.114:3300/0 conn(0x7fa5b41591c0 0x7fa5b406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:14.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b259c700 1 -- 172.21.15.82:0/739726908 >> v2:172.21.15.114:3300/0 conn(0x7fa5b41591c0 msgr2=0x7fa5b406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:06:14.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b259c700 1 --2- 172.21.15.82:0/739726908 >> v2:172.21.15.114:3300/0 conn(0x7fa5b41591c0 0x7fa5b406c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:14.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b259c700 1 -- 172.21.15.82:0/739726908 >> v1:172.21.15.82:6789/0 conn(0x7fa5b4070070 legacy=0x7fa5b40ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:14.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b259c700 1 -- 172.21.15.82:0/739726908 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b40cc640 con 0x7fa5b4158df0 2023-11-28T13:06:14.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b159a700 1 -- 172.21.15.82:0/739726908 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169504966 0 0) 0x7fa5ac001490 con 0x7fa5b4070070 2023-11-28T13:06:14.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b1d9b700 1 --2- 172.21.15.82:0/739726908 >> v2:172.21.15.114:3300/0 conn(0x7fa5b41591c0 0x7fa5b406c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:06:14.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b259c700 1 --2- 172.21.15.82:0/739726908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5b4158df0 0x7fa5b415d510 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40b11a0 tx=0x7fa5a800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0fe20c33458397 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:14.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b159a700 1 -- 172.21.15.82:0/739726908 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a800dd30 con 0x7fa5b4158df0 2023-11-28T13:06:14.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b159a700 1 -- 172.21.15.82:0/739726908 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a800de90 con 0x7fa5b4158df0 2023-11-28T13:06:14.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b159a700 1 -- 172.21.15.82:0/739726908 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8010690 con 0x7fa5b4158df0 2023-11-28T13:06:14.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b359e700 1 -- 172.21.15.82:0/739726908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5b4158df0 msgr2=0x7fa5b415d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:14.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b359e700 1 --2- 172.21.15.82:0/739726908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5b4158df0 0x7fa5b415d510 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40b11a0 tx=0x7fa5a800bdd0 comp rx=0 tx=0).stop 2023-11-28T13:06:14.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b359e700 1 -- 172.21.15.82:0/739726908 shutdown_connections 2023-11-28T13:06:14.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b359e700 1 --2- 172.21.15.82:0/739726908 >> v2:172.21.15.114:3300/0 conn(0x7fa5b41591c0 0x7fa5b406c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:14.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b359e700 1 --2- 172.21.15.82:0/739726908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5b4158df0 0x7fa5b415d510 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:14.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b359e700 1 -- 172.21.15.82:0/739726908 >> 172.21.15.82:0/739726908 conn(0x7fa5b40ce600 msgr2=0x7fa5b40ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:14.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b359e700 1 -- 172.21.15.82:0/739726908 shutdown_connections 2023-11-28T13:06:14.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.504+0000 7fa5b359e700 1 -- 172.21.15.82:0/739726908 wait complete. 2023-11-28T13:06:14.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b359e700 1 Processor -- start 2023-11-28T13:06:14.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b359e700 1 -- start start 2023-11-28T13:06:14.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5b4070070 0x7fa5b40c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:14.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5b4158df0 0x7fa5b4156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:14.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b359e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa5b41591c0 0x7fa5b4153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:14.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40c5ec0 con 0x7fa5b4070070 2023-11-28T13:06:14.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b359e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40c35b0 con 0x7fa5b4158df0 2023-11-28T13:06:14.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b359e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40c5870 con 0x7fa5b41591c0 2023-11-28T13:06:14.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5b4070070 0x7fa5b40c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:14.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5b4070070 0x7fa5b40c2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35202/0 (socket says 172.21.15.82:35202) 2023-11-28T13:06:14.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b259c700 1 -- 172.21.15.82:0/1836587727 learned_addr learned my addr 172.21.15.82:0/1836587727 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:06:14.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b1d9b700 1 --2- 172.21.15.82:0/1836587727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5b4158df0 0x7fa5b4156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:14.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b2d9d700 1 --2- 172.21.15.82:0/1836587727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa5b41591c0 0x7fa5b4153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:14.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b259c700 1 -- 172.21.15.82:0/1836587727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa5b41591c0 msgr2=0x7fa5b4153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:14.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b259c700 1 --2- 172.21.15.82:0/1836587727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa5b41591c0 0x7fa5b4153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:14.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b259c700 1 -- 172.21.15.82:0/1836587727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5b4158df0 msgr2=0x7fa5b4156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:14.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b259c700 1 --2- 172.21.15.82:0/1836587727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5b4158df0 0x7fa5b4156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:14.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b259c700 1 -- 172.21.15.82:0/1836587727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a800b750 con 0x7fa5b4070070 2023-11-28T13:06:14.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b2d9d700 1 --2- 172.21.15.82:0/1836587727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa5b41591c0 0x7fa5b4153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:06:14.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b1d9b700 1 --2- 172.21.15.82:0/1836587727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5b4158df0 0x7fa5b4156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:06:14.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b259c700 1 --2- 172.21.15.82:0/1836587727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5b4070070 0x7fa5b40c2c90 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800b2c0 tx=0x7fa5a8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:14.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5a2ffd700 1 -- 172.21.15.82:0/1836587727 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8003e40 con 0x7fa5b4070070 2023-11-28T13:06:14.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5a2ffd700 1 -- 172.21.15.82:0/1836587727 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a8010470 con 0x7fa5b4070070 2023-11-28T13:06:14.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b359e700 1 -- 172.21.15.82:0/1836587727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b40c9ab0 con 0x7fa5b4070070 2023-11-28T13:06:14.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5a2ffd700 1 -- 172.21.15.82:0/1836587727 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8010820 con 0x7fa5b4070070 2023-11-28T13:06:14.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.508+0000 7fa5b359e700 1 -- 172.21.15.82:0/1836587727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b40c97d0 con 0x7fa5b4070070 2023-11-28T13:06:14.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.512+0000 7fa5a2ffd700 1 -- 172.21.15.82:0/1836587727 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa5a8019400 con 0x7fa5b4070070 2023-11-28T13:06:14.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.512+0000 7fa5b359e700 1 -- 172.21.15.82:0/1836587727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b40c9480 con 0x7fa5b4070070 2023-11-28T13:06:14.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.512+0000 7fa5a2ffd700 1 --2- 172.21.15.82:0/1836587727 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa594064ee0 0x7fa594067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:14.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.512+0000 7fa5a2ffd700 1 -- 172.21.15.82:0/1836587727 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7fa5a8083cd0 con 0x7fa5b4070070 2023-11-28T13:06:14.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.512+0000 7fa5b1d9b700 1 --2- 172.21.15.82:0/1836587727 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa594064ee0 0x7fa594067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:14.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.512+0000 7fa5b1d9b700 1 --2- 172.21.15.82:0/1836587727 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa594064ee0 0x7fa594067390 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40c6990 tx=0x7fa5a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:14.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.520+0000 7fa5a2ffd700 1 -- 172.21.15.82:0/1836587727 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa5a8051d50 con 0x7fa5b4070070 2023-11-28T13:06:14.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.716+0000 7fa5b359e700 1 -- 172.21.15.82:0/1836587727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa5b4065fc0 con 0x7fa5b4070070 2023-11-28T13:06:14.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.716+0000 7fa5a2ffd700 1 -- 172.21.15.82:0/1836587727 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fa5a8055370 con 0x7fa5b4070070 2023-11-28T13:06:14.720 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:06:14.720 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:06:14.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.716+0000 7fa5b359e700 1 -- 172.21.15.82:0/1836587727 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa594064ee0 msgr2=0x7fa594067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.716+0000 7fa5b359e700 1 --2- 172.21.15.82:0/1836587727 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa594064ee0 0x7fa594067390 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40c6990 tx=0x7fa5a4008040 comp rx=0 tx=0).stop 2023-11-28T13:06:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.716+0000 7fa5b359e700 1 -- 172.21.15.82:0/1836587727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5b4070070 msgr2=0x7fa5b40c2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.716+0000 7fa5b359e700 1 --2- 172.21.15.82:0/1836587727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5b4070070 0x7fa5b40c2c90 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800b2c0 tx=0x7fa5a8004770 comp rx=0 tx=0).stop 2023-11-28T13:06:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.716+0000 7fa5b359e700 1 -- 172.21.15.82:0/1836587727 shutdown_connections 2023-11-28T13:06:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.716+0000 7fa5b359e700 1 --2- 172.21.15.82:0/1836587727 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa594064ee0 0x7fa594067390 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.716+0000 7fa5b359e700 1 --2- 172.21.15.82:0/1836587727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa5b41591c0 0x7fa5b4153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.716+0000 7fa5b359e700 1 --2- 172.21.15.82:0/1836587727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5b4158df0 0x7fa5b4156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.716+0000 7fa5b359e700 1 --2- 172.21.15.82:0/1836587727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5b4070070 0x7fa5b40c2c90 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.716+0000 7fa5b359e700 1 -- 172.21.15.82:0/1836587727 >> 172.21.15.82:0/1836587727 conn(0x7fa5b40ce600 msgr2=0x7fa5b40b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.716+0000 7fa5b359e700 1 -- 172.21.15.82:0/1836587727 shutdown_connections 2023-11-28T13:06:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:14.716+0000 7fa5b359e700 1 -- 172.21.15.82:0/1836587727 wait complete. 2023-11-28T13:06:14.734 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:06:19.736 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:06:19.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.852+0000 7f24eb59e700 1 Processor -- start 2023-11-28T13:06:19.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.852+0000 7f24eb59e700 1 -- start start 2023-11-28T13:06:19.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24eb59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f24ec1591c0 0x7f24ec15d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:19.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24eb59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ec15da50 con 0x7f24ec158df0 2023-11-28T13:06:19.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24eb59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ec0c9e20 con 0x7f24ec070070 2023-11-28T13:06:19.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24eb59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24ec0cc640 con 0x7f24ec1591c0 2023-11-28T13:06:19.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24ea59c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f24ec158df0 0x7f24ec06c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45172/0 (socket says 172.21.15.82:45172) 2023-11-28T13:06:19.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24ea59c700 1 -- 172.21.15.82:0/3756532362 learned_addr learned my addr 172.21.15.82:0/3756532362 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:06:19.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24e9d9b700 1 --2- 172.21.15.82:0/3756532362 >> v2:172.21.15.114:3300/0 conn(0x7f24ec1591c0 0x7f24ec15d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:19.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24e959a700 1 -- 172.21.15.82:0/3756532362 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567024510 0 0) 0x7f24e0001110 con 0x7f24ec158df0 2023-11-28T13:06:19.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24e959a700 1 -- 172.21.15.82:0/3756532362 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24d40035d0 con 0x7f24ec158df0 2023-11-28T13:06:19.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24e9d9b700 1 -- 172.21.15.82:0/3756532362 >> v1:172.21.15.114:6789/0 conn(0x7f24ec070070 legacy=0x7f24ec0ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:19.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24e9d9b700 1 -- 172.21.15.82:0/3756532362 >> v1:172.21.15.82:6789/0 conn(0x7f24ec158df0 legacy=0x7f24ec06c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:19.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24e9d9b700 1 -- 172.21.15.82:0/3756532362 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec0c97d0 con 0x7f24ec1591c0 2023-11-28T13:06:19.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24e9d9b700 1 --2- 172.21.15.82:0/3756532362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24ec1591c0 0x7f24ec15d510 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f24dc009850 tx=0x7f24dc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3541477e4c751ffe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:19.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24e959a700 1 -- 172.21.15.82:0/3756532362 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc011830 con 0x7f24ec1591c0 2023-11-28T13:06:19.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24e959a700 1 -- 172.21.15.82:0/3756532362 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24dc011990 con 0x7f24ec1591c0 2023-11-28T13:06:19.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24e959a700 1 -- 172.21.15.82:0/3756532362 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc011d40 con 0x7f24ec1591c0 2023-11-28T13:06:19.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24eb59e700 1 -- 172.21.15.82:0/3756532362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24ec1591c0 msgr2=0x7f24ec15d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:19.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24eb59e700 1 --2- 172.21.15.82:0/3756532362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24ec1591c0 0x7f24ec15d510 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f24dc009850 tx=0x7f24dc009b60 comp rx=0 tx=0).stop 2023-11-28T13:06:19.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24eb59e700 1 -- 172.21.15.82:0/3756532362 shutdown_connections 2023-11-28T13:06:19.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24eb59e700 1 --2- 172.21.15.82:0/3756532362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24ec1591c0 0x7f24ec15d510 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:19.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24eb59e700 1 -- 172.21.15.82:0/3756532362 >> 172.21.15.82:0/3756532362 conn(0x7f24ec0ce600 msgr2=0x7f24ec0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:19.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24eb59e700 1 -- 172.21.15.82:0/3756532362 shutdown_connections 2023-11-28T13:06:19.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.856+0000 7f24eb59e700 1 -- 172.21.15.82:0/3756532362 wait complete. 2023-11-28T13:06:19.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24eb59e700 1 Processor -- start 2023-11-28T13:06:19.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24eb59e700 1 -- start start 2023-11-28T13:06:19.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24eb59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24ec070070 0x7f24ec0c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:19.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24eb59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24ec158df0 0x7f24ec0c2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:19.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24eb59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24ec1591c0 0x7f24ec15b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:19.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24eb59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec157c50 con 0x7f24ec070070 2023-11-28T13:06:19.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24eb59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec0c3ba0 con 0x7f24ec1591c0 2023-11-28T13:06:19.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24eb59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec153ec0 con 0x7f24ec158df0 2023-11-28T13:06:19.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24ea59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24ec070070 0x7f24ec0c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:19.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24ea59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24ec070070 0x7f24ec0c1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40972/0 (socket says 172.21.15.82:40972) 2023-11-28T13:06:19.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24ea59c700 1 -- 172.21.15.82:0/1412647663 learned_addr learned my addr 172.21.15.82:0/1412647663 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:06:19.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24ead9d700 1 --2- 172.21.15.82:0/1412647663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24ec1591c0 0x7f24ec15b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:19.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24e9d9b700 1 --2- 172.21.15.82:0/1412647663 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24ec158df0 0x7f24ec0c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:19.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24ea59c700 1 -- 172.21.15.82:0/1412647663 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24ec158df0 msgr2=0x7f24ec0c2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:19.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24ea59c700 1 --2- 172.21.15.82:0/1412647663 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24ec158df0 0x7f24ec0c2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:19.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24ea59c700 1 -- 172.21.15.82:0/1412647663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24ec1591c0 msgr2=0x7f24ec15b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:19.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24ea59c700 1 --2- 172.21.15.82:0/1412647663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24ec1591c0 0x7f24ec15b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:19.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24ea59c700 1 -- 172.21.15.82:0/1412647663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24dc0094b0 con 0x7f24ec070070 2023-11-28T13:06:19.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24ea59c700 1 --2- 172.21.15.82:0/1412647663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24ec070070 0x7f24ec0c1f40 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f24e000c700 tx=0x7f24e000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:19.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24daffd700 1 -- 172.21.15.82:0/1412647663 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e0005d90 con 0x7f24ec070070 2023-11-28T13:06:19.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24daffd700 1 -- 172.21.15.82:0/1412647663 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e00070d0 con 0x7f24ec070070 2023-11-28T13:06:19.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24eb59e700 1 -- 172.21.15.82:0/1412647663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24ec0c9480 con 0x7f24ec070070 2023-11-28T13:06:19.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24daffd700 1 -- 172.21.15.82:0/1412647663 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e0007480 con 0x7f24ec070070 2023-11-28T13:06:19.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.860+0000 7f24eb59e700 1 -- 172.21.15.82:0/1412647663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ec0c9ab0 con 0x7f24ec070070 2023-11-28T13:06:19.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.864+0000 7f24eb59e700 1 -- 172.21.15.82:0/1412647663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24ec0add00 con 0x7f24ec070070 2023-11-28T13:06:19.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.864+0000 7f24daffd700 1 -- 172.21.15.82:0/1412647663 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f24e0019030 con 0x7f24ec070070 2023-11-28T13:06:19.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.864+0000 7f24daffd700 1 --2- 172.21.15.82:0/1412647663 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f24cc064ee0 0x7f24cc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:19.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.864+0000 7f24daffd700 1 -- 172.21.15.82:0/1412647663 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f24e0081470 con 0x7f24ec070070 2023-11-28T13:06:19.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.864+0000 7f24e9d9b700 1 --2- 172.21.15.82:0/1412647663 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f24cc064ee0 0x7f24cc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:19.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.868+0000 7f24e9d9b700 1 --2- 172.21.15.82:0/1412647663 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f24cc064ee0 0x7f24cc067390 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f24ec1595d0 tx=0x7f24dc01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:19.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:19.872+0000 7f24daffd700 1 -- 172.21.15.82:0/1412647663 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f24e004f630 con 0x7f24ec070070 2023-11-28T13:06:20.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:20.068+0000 7f24eb59e700 1 -- 172.21.15.82:0/1412647663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f24ec15da50 con 0x7f24ec070070 2023-11-28T13:06:20.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:20.068+0000 7f24daffd700 1 -- 172.21.15.82:0/1412647663 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f24ec15da50 con 0x7f24ec070070 2023-11-28T13:06:20.075 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:06:20.075 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:06:20.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:20.072+0000 7f24eb59e700 1 -- 172.21.15.82:0/1412647663 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f24cc064ee0 msgr2=0x7f24cc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:20.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:20.072+0000 7f24eb59e700 1 --2- 172.21.15.82:0/1412647663 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f24cc064ee0 0x7f24cc067390 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f24ec1595d0 tx=0x7f24dc01c040 comp rx=0 tx=0).stop 2023-11-28T13:06:20.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:20.072+0000 7f24eb59e700 1 -- 172.21.15.82:0/1412647663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24ec070070 msgr2=0x7f24ec0c1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:20.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:20.072+0000 7f24eb59e700 1 --2- 172.21.15.82:0/1412647663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24ec070070 0x7f24ec0c1f40 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f24e000c700 tx=0x7f24e000ca10 comp rx=0 tx=0).stop 2023-11-28T13:06:20.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:20.072+0000 7f24eb59e700 1 -- 172.21.15.82:0/1412647663 shutdown_connections 2023-11-28T13:06:20.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:20.072+0000 7f24eb59e700 1 --2- 172.21.15.82:0/1412647663 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f24cc064ee0 0x7f24cc067390 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:20.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:20.072+0000 7f24eb59e700 1 --2- 172.21.15.82:0/1412647663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24ec1591c0 0x7f24ec15b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:20.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:20.072+0000 7f24eb59e700 1 --2- 172.21.15.82:0/1412647663 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24ec158df0 0x7f24ec0c2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:20.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:20.072+0000 7f24eb59e700 1 --2- 172.21.15.82:0/1412647663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24ec070070 0x7f24ec0c1f40 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:20.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:20.072+0000 7f24eb59e700 1 -- 172.21.15.82:0/1412647663 >> 172.21.15.82:0/1412647663 conn(0x7f24ec0ce600 msgr2=0x7f24ec0ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:20.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:20.072+0000 7f24eb59e700 1 -- 172.21.15.82:0/1412647663 shutdown_connections 2023-11-28T13:06:20.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:20.072+0000 7f24eb59e700 1 -- 172.21.15.82:0/1412647663 wait complete. 2023-11-28T13:06:20.089 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:06:25.090 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:06:25.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379d51b700 1 Processor -- start 2023-11-28T13:06:25.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379d51b700 1 -- start start 2023-11-28T13:06:25.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379d51b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37980b3910 0x7f379806b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:25.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379d51b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f379806c910 0x7f379806d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:25.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379d51b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3798070070 0x7f37980704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:25.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379d51b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3798070a10 con 0x7f3798070070 2023-11-28T13:06:25.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379d51b700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379806c480 con 0x7f379806c910 2023-11-28T13:06:25.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379d51b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379806dbe0 con 0x7f37980b3910 2023-11-28T13:06:25.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379cd1a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3798070070 0x7f37980704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:25.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379cd1a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3798070070 0x7f37980704d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40984/0 (socket says 172.21.15.82:40984) 2023-11-28T13:06:25.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379cd1a700 1 -- 172.21.15.82:0/1257491981 learned_addr learned my addr 172.21.15.82:0/1257491981 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:06:25.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f3797fff700 1 --2- 172.21.15.82:0/1257491981 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37980b3910 0x7f379806b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:25.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f37977fe700 1 --2- 172.21.15.82:0/1257491981 >> v2:172.21.15.114:3300/0 conn(0x7f379806c910 0x7f379806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:25.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379cd1a700 1 -- 172.21.15.82:0/1257491981 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37980b3910 msgr2=0x7f379806b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:06:25.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379cd1a700 1 --2- 172.21.15.82:0/1257491981 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37980b3910 0x7f379806b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:25.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379cd1a700 1 -- 172.21.15.82:0/1257491981 >> v2:172.21.15.114:3300/0 conn(0x7f379806c910 msgr2=0x7f379806d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:06:25.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379cd1a700 1 --2- 172.21.15.82:0/1257491981 >> v2:172.21.15.114:3300/0 conn(0x7f379806c910 0x7f379806d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:25.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379cd1a700 1 -- 172.21.15.82:0/1257491981 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379806dec0 con 0x7f3798070070 2023-11-28T13:06:25.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379cd1a700 1 --2- 172.21.15.82:0/1257491981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3798070070 0x7f37980704d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f37980ce4f0 tx=0x7f379000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d8de79168a8cc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:25.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f3796ffd700 1 -- 172.21.15.82:0/1257491981 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379000e070 con 0x7f3798070070 2023-11-28T13:06:25.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f3796ffd700 1 -- 172.21.15.82:0/1257491981 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379000b910 con 0x7f3798070070 2023-11-28T13:06:25.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f3796ffd700 1 -- 172.21.15.82:0/1257491981 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379000bcc0 con 0x7f3798070070 2023-11-28T13:06:25.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379d51b700 1 -- 172.21.15.82:0/1257491981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3798070070 msgr2=0x7f37980704d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:25.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379d51b700 1 --2- 172.21.15.82:0/1257491981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3798070070 0x7f37980704d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f37980ce4f0 tx=0x7f379000b330 comp rx=0 tx=0).stop 2023-11-28T13:06:25.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379d51b700 1 -- 172.21.15.82:0/1257491981 shutdown_connections 2023-11-28T13:06:25.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379d51b700 1 --2- 172.21.15.82:0/1257491981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3798070070 0x7f37980704d0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:25.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379d51b700 1 --2- 172.21.15.82:0/1257491981 >> v2:172.21.15.114:3300/0 conn(0x7f379806c910 0x7f379806d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:25.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379d51b700 1 --2- 172.21.15.82:0/1257491981 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37980b3910 0x7f379806b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:25.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379d51b700 1 -- 172.21.15.82:0/1257491981 >> 172.21.15.82:0/1257491981 conn(0x7f37980ce600 msgr2=0x7f37980ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:25.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379d51b700 1 -- 172.21.15.82:0/1257491981 shutdown_connections 2023-11-28T13:06:25.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.204+0000 7f379d51b700 1 -- 172.21.15.82:0/1257491981 wait complete. 2023-11-28T13:06:25.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.208+0000 7f379d51b700 1 Processor -- start 2023-11-28T13:06:25.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.208+0000 7f379d51b700 1 -- start start 2023-11-28T13:06:25.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.208+0000 7f379d51b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f379806c910 0x7f37981584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:25.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.208+0000 7f379d51b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3798070070 0x7f37980ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:25.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.208+0000 7f379d51b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37980b3910 0x7f37980aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:25.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.208+0000 7f379d51b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379815b610 con 0x7f3798070070 2023-11-28T13:06:25.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.208+0000 7f379d51b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37980ad1c0 con 0x7f379806c910 2023-11-28T13:06:25.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.208+0000 7f379d51b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379815a570 con 0x7f37980b3910 2023-11-28T13:06:25.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.208+0000 7f37977fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3798070070 0x7f37980ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:25.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.208+0000 7f37977fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3798070070 0x7f37980ae770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40992/0 (socket says 172.21.15.82:40992) 2023-11-28T13:06:25.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.208+0000 7f37977fe700 1 -- 172.21.15.82:0/3130287304 learned_addr learned my addr 172.21.15.82:0/3130287304 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:06:25.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.208+0000 7f379cd1a700 1 --2- 172.21.15.82:0/3130287304 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37980b3910 0x7f37980aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:25.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.208+0000 7f3797fff700 1 --2- 172.21.15.82:0/3130287304 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f379806c910 0x7f37981584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:25.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.208+0000 7f379cd1a700 1 -- 172.21.15.82:0/3130287304 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f379806c910 msgr2=0x7f37981584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:25.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.208+0000 7f379cd1a700 1 --2- 172.21.15.82:0/3130287304 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f379806c910 0x7f37981584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:25.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.208+0000 7f379cd1a700 1 -- 172.21.15.82:0/3130287304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3798070070 msgr2=0x7f37980ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:25.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.208+0000 7f379cd1a700 1 --2- 172.21.15.82:0/3130287304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3798070070 0x7f37980ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:25.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.208+0000 7f379cd1a700 1 -- 172.21.15.82:0/3130287304 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3790009b30 con 0x7f37980b3910 2023-11-28T13:06:25.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.208+0000 7f37977fe700 1 --2- 172.21.15.82:0/3130287304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3798070070 0x7f37980ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:06:25.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.212+0000 7f379cd1a700 1 --2- 172.21.15.82:0/3130287304 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37980b3910 0x7f37980aecb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f379806be20 tx=0x7f3790004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:25.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.212+0000 7f3794ff9700 1 -- 172.21.15.82:0/3130287304 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37900092e0 con 0x7f37980b3910 2023-11-28T13:06:25.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.212+0000 7f3794ff9700 1 -- 172.21.15.82:0/3130287304 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379000ce80 con 0x7f37980b3910 2023-11-28T13:06:25.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.212+0000 7f379d51b700 1 -- 172.21.15.82:0/3130287304 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37980c8f80 con 0x7f37980b3910 2023-11-28T13:06:25.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.212+0000 7f3794ff9700 1 -- 172.21.15.82:0/3130287304 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37900044b0 con 0x7f37980b3910 2023-11-28T13:06:25.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.212+0000 7f379d51b700 1 -- 172.21.15.82:0/3130287304 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379806c110 con 0x7f37980b3910 2023-11-28T13:06:25.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.212+0000 7f379d51b700 1 -- 172.21.15.82:0/3130287304 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f379806d860 con 0x7f37980b3910 2023-11-28T13:06:25.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.212+0000 7f3794ff9700 1 -- 172.21.15.82:0/3130287304 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3790004610 con 0x7f37980b3910 2023-11-28T13:06:25.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.212+0000 7f3794ff9700 1 --2- 172.21.15.82:0/3130287304 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3784064ee0 0x7f3784067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:25.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.212+0000 7f3794ff9700 1 -- 172.21.15.82:0/3130287304 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f37900834e0 con 0x7f37980b3910 2023-11-28T13:06:25.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.212+0000 7f3797fff700 1 --2- 172.21.15.82:0/3130287304 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3784064ee0 0x7f3784067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:25.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.216+0000 7f3797fff700 1 --2- 172.21.15.82:0/3130287304 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3784064ee0 0x7f3784067390 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3788009ad0 tx=0x7f3788009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:25.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.224+0000 7f3794ff9700 1 -- 172.21.15.82:0/3130287304 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3790051630 con 0x7f37980b3910 2023-11-28T13:06:25.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.424+0000 7f379d51b700 1 -- 172.21.15.82:0/3130287304 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f379815c960 con 0x7f37980b3910 2023-11-28T13:06:25.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.428+0000 7f3794ff9700 1 -- 172.21.15.82:0/3130287304 <== mon.2 v2:172.21.15.114:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f37900048a0 con 0x7f37980b3910 2023-11-28T13:06:25.432 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:06:25.432 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:06:25.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.428+0000 7f379d51b700 1 -- 172.21.15.82:0/3130287304 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3784064ee0 msgr2=0x7f3784067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:25.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.428+0000 7f379d51b700 1 --2- 172.21.15.82:0/3130287304 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3784064ee0 0x7f3784067390 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3788009ad0 tx=0x7f3788009240 comp rx=0 tx=0).stop 2023-11-28T13:06:25.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.428+0000 7f379d51b700 1 -- 172.21.15.82:0/3130287304 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37980b3910 msgr2=0x7f37980aecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:25.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.428+0000 7f379d51b700 1 --2- 172.21.15.82:0/3130287304 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37980b3910 0x7f37980aecb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f379806be20 tx=0x7f3790004af0 comp rx=0 tx=0).stop 2023-11-28T13:06:25.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.428+0000 7f379d51b700 1 -- 172.21.15.82:0/3130287304 shutdown_connections 2023-11-28T13:06:25.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.428+0000 7f379d51b700 1 --2- 172.21.15.82:0/3130287304 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3784064ee0 0x7f3784067390 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:25.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.428+0000 7f379d51b700 1 --2- 172.21.15.82:0/3130287304 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37980b3910 0x7f37980aecb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:25.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.428+0000 7f379d51b700 1 --2- 172.21.15.82:0/3130287304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3798070070 0x7f37980ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:25.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.428+0000 7f379d51b700 1 --2- 172.21.15.82:0/3130287304 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f379806c910 0x7f37981584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:25.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.428+0000 7f379d51b700 1 -- 172.21.15.82:0/3130287304 >> 172.21.15.82:0/3130287304 conn(0x7f37980ce600 msgr2=0x7f37980ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:25.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.428+0000 7f379d51b700 1 -- 172.21.15.82:0/3130287304 shutdown_connections 2023-11-28T13:06:25.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:25.428+0000 7f379d51b700 1 -- 172.21.15.82:0/3130287304 wait complete. 2023-11-28T13:06:25.446 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:06:27.843 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:06:27.846 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:06:30.447 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:06:30.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.560+0000 7fbe3759e700 1 Processor -- start 2023-11-28T13:06:30.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.560+0000 7fbe3759e700 1 -- start start 2023-11-28T13:06:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe3759e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbe3806b910 0x7fbe38160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe3759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe380d06f0 0x7fbe380d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe3759e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe380d28e0 con 0x7fbe380ced70 2023-11-28T13:06:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe3759e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe380cdfe0 con 0x7fbe3806b910 2023-11-28T13:06:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe3759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe38160cc0 con 0x7fbe380d06f0 2023-11-28T13:06:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe35d9b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbe380ced70 0x7fbe3806bce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35100/0 (socket says 172.21.15.82:35100) 2023-11-28T13:06:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe35d9b700 1 -- 172.21.15.82:0/3267700266 learned_addr learned my addr 172.21.15.82:0/3267700266 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:06:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe3659c700 1 --2- 172.21.15.82:0/3267700266 >> v2:172.21.15.114:3300/0 conn(0x7fbe3806b910 0x7fbe38160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe36d9d700 1 --2- 172.21.15.82:0/3267700266 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe380d06f0 0x7fbe380d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe3559a700 1 -- 172.21.15.82:0/3267700266 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229579250 0 0) 0x7fbe28001110 con 0x7fbe380ced70 2023-11-28T13:06:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe3559a700 1 -- 172.21.15.82:0/3267700266 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe240035d0 con 0x7fbe380ced70 2023-11-28T13:06:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe36d9d700 1 -- 172.21.15.82:0/3267700266 >> v2:172.21.15.114:3300/0 conn(0x7fbe3806b910 msgr2=0x7fbe38160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:06:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe36d9d700 1 --2- 172.21.15.82:0/3267700266 >> v2:172.21.15.114:3300/0 conn(0x7fbe3806b910 0x7fbe38160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe36d9d700 1 -- 172.21.15.82:0/3267700266 >> v1:172.21.15.82:6789/0 conn(0x7fbe380ced70 legacy=0x7fbe3806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe36d9d700 1 -- 172.21.15.82:0/3267700266 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe380b2040 con 0x7fbe380d06f0 2023-11-28T13:06:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe36d9d700 1 --2- 172.21.15.82:0/3267700266 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe380d06f0 0x7fbe380d0b30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbe30009d90 tx=0x7fbe3000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adadff61bdfd7606 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe3559a700 1 -- 172.21.15.82:0/3267700266 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3000e070 con 0x7fbe380d06f0 2023-11-28T13:06:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe3559a700 1 -- 172.21.15.82:0/3267700266 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3000bb20 con 0x7fbe380d06f0 2023-11-28T13:06:30.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe3559a700 1 -- 172.21.15.82:0/3267700266 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3000be90 con 0x7fbe380d06f0 2023-11-28T13:06:30.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe3759e700 1 -- 172.21.15.82:0/3267700266 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe380d06f0 msgr2=0x7fbe380d0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:30.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe3759e700 1 --2- 172.21.15.82:0/3267700266 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe380d06f0 0x7fbe380d0b30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbe30009d90 tx=0x7fbe3000b330 comp rx=0 tx=0).stop 2023-11-28T13:06:30.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe3759e700 1 -- 172.21.15.82:0/3267700266 shutdown_connections 2023-11-28T13:06:30.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe3759e700 1 --2- 172.21.15.82:0/3267700266 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe380d06f0 0x7fbe380d0b30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:30.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe3759e700 1 --2- 172.21.15.82:0/3267700266 >> v2:172.21.15.114:3300/0 conn(0x7fbe3806b910 0x7fbe38160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:30.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe3759e700 1 -- 172.21.15.82:0/3267700266 >> 172.21.15.82:0/3267700266 conn(0x7fbe380d2b20 msgr2=0x7fbe380d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:30.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe3759e700 1 -- 172.21.15.82:0/3267700266 shutdown_connections 2023-11-28T13:06:30.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.564+0000 7fbe3759e700 1 -- 172.21.15.82:0/3267700266 wait complete. 2023-11-28T13:06:30.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.568+0000 7fbe3759e700 1 Processor -- start 2023-11-28T13:06:30.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.568+0000 7fbe3759e700 1 -- start start 2023-11-28T13:06:30.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.568+0000 7fbe3759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe3806b910 0x7fbe380ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:30.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.568+0000 7fbe3759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe380ced70 0x7fbe38154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:30.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe3759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe380d06f0 0x7fbe381f59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:30.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe3759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe381f5520 con 0x7fbe380ced70 2023-11-28T13:06:30.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe3759e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe381f2400 con 0x7fbe3806b910 2023-11-28T13:06:30.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe3759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe381f26e0 con 0x7fbe380d06f0 2023-11-28T13:06:30.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe35d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe380ced70 0x7fbe38154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:30.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe35d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe380ced70 0x7fbe38154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48124/0 (socket says 172.21.15.82:48124) 2023-11-28T13:06:30.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe35d9b700 1 -- 172.21.15.82:0/4281322074 learned_addr learned my addr 172.21.15.82:0/4281322074 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:06:30.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe3659c700 1 --2- 172.21.15.82:0/4281322074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe3806b910 0x7fbe380ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:30.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe36d9d700 1 --2- 172.21.15.82:0/4281322074 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe380d06f0 0x7fbe381f59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:30.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe35d9b700 1 -- 172.21.15.82:0/4281322074 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe380d06f0 msgr2=0x7fbe381f59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:30.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe35d9b700 1 --2- 172.21.15.82:0/4281322074 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe380d06f0 0x7fbe381f59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:30.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe35d9b700 1 -- 172.21.15.82:0/4281322074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe3806b910 msgr2=0x7fbe380ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:30.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe35d9b700 1 --2- 172.21.15.82:0/4281322074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe3806b910 0x7fbe380ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:30.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe35d9b700 1 -- 172.21.15.82:0/4281322074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe30009a70 con 0x7fbe380ced70 2023-11-28T13:06:30.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe36d9d700 1 --2- 172.21.15.82:0/4281322074 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe380d06f0 0x7fbe381f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:06:30.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe35d9b700 1 --2- 172.21.15.82:0/4281322074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe380ced70 0x7fbe38154160 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800c410 tx=0x7fbe2800c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:30.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe2effd700 1 -- 172.21.15.82:0/4281322074 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28005d90 con 0x7fbe380ced70 2023-11-28T13:06:30.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe2effd700 1 -- 172.21.15.82:0/4281322074 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe280070d0 con 0x7fbe380ced70 2023-11-28T13:06:30.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe3759e700 1 -- 172.21.15.82:0/4281322074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe380d2320 con 0x7fbe380ced70 2023-11-28T13:06:30.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe2effd700 1 -- 172.21.15.82:0/4281322074 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28007460 con 0x7fbe380ced70 2023-11-28T13:06:30.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe3759e700 1 -- 172.21.15.82:0/4281322074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe380cf2c0 con 0x7fbe380ced70 2023-11-28T13:06:30.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe3759e700 1 -- 172.21.15.82:0/4281322074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe380d2600 con 0x7fbe380ced70 2023-11-28T13:06:30.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.572+0000 7fbe2effd700 1 -- 172.21.15.82:0/4281322074 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbe28019030 con 0x7fbe380ced70 2023-11-28T13:06:30.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.576+0000 7fbe2effd700 1 --2- 172.21.15.82:0/4281322074 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbe18064ee0 0x7fbe18067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:30.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.576+0000 7fbe2effd700 1 -- 172.21.15.82:0/4281322074 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7fbe28081030 con 0x7fbe380ced70 2023-11-28T13:06:30.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.576+0000 7fbe3659c700 1 --2- 172.21.15.82:0/4281322074 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbe18064ee0 0x7fbe18067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:30.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.576+0000 7fbe3659c700 1 --2- 172.21.15.82:0/4281322074 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbe18064ee0 0x7fbe18067390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbe380cd390 tx=0x7fbe20009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:30.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.584+0000 7fbe2effd700 1 -- 172.21.15.82:0/4281322074 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbe2804f150 con 0x7fbe380ced70 2023-11-28T13:06:30.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.780+0000 7fbe3759e700 1 -- 172.21.15.82:0/4281322074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbe380d28e0 con 0x7fbe380ced70 2023-11-28T13:06:30.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.780+0000 7fbe2effd700 1 -- 172.21.15.82:0/4281322074 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fbe280170c0 con 0x7fbe380ced70 2023-11-28T13:06:30.787 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:06:30.787 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:06:30.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.784+0000 7fbe3759e700 1 -- 172.21.15.82:0/4281322074 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbe18064ee0 msgr2=0x7fbe18067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:30.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.784+0000 7fbe3759e700 1 --2- 172.21.15.82:0/4281322074 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbe18064ee0 0x7fbe18067390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbe380cd390 tx=0x7fbe20009240 comp rx=0 tx=0).stop 2023-11-28T13:06:30.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.784+0000 7fbe3759e700 1 -- 172.21.15.82:0/4281322074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe380ced70 msgr2=0x7fbe38154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:30.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.784+0000 7fbe3759e700 1 --2- 172.21.15.82:0/4281322074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe380ced70 0x7fbe38154160 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800c410 tx=0x7fbe2800c720 comp rx=0 tx=0).stop 2023-11-28T13:06:30.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.784+0000 7fbe3759e700 1 -- 172.21.15.82:0/4281322074 shutdown_connections 2023-11-28T13:06:30.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.784+0000 7fbe3759e700 1 --2- 172.21.15.82:0/4281322074 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbe18064ee0 0x7fbe18067390 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:30.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.784+0000 7fbe3759e700 1 --2- 172.21.15.82:0/4281322074 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe380d06f0 0x7fbe381f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:30.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.784+0000 7fbe3759e700 1 --2- 172.21.15.82:0/4281322074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe380ced70 0x7fbe38154160 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:30.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.784+0000 7fbe3759e700 1 --2- 172.21.15.82:0/4281322074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe3806b910 0x7fbe380ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:30.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.784+0000 7fbe3759e700 1 -- 172.21.15.82:0/4281322074 >> 172.21.15.82:0/4281322074 conn(0x7fbe380d2b20 msgr2=0x7fbe380d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:30.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.784+0000 7fbe3759e700 1 -- 172.21.15.82:0/4281322074 shutdown_connections 2023-11-28T13:06:30.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:30.784+0000 7fbe3759e700 1 -- 172.21.15.82:0/4281322074 wait complete. 2023-11-28T13:06:30.801 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:06:35.802 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:06:35.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d3468700 1 Processor -- start 2023-11-28T13:06:35.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d3468700 1 -- start start 2023-11-28T13:06:35.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d3468700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc6cc070070 0x7fc6cc070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:35.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d3468700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc6cc0c1910 0x7fc6cc06c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:35.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d3468700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6cc070980 con 0x7fc6cc160900 2023-11-28T13:06:35.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d3468700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6cc0ce030 con 0x7fc6cc070070 2023-11-28T13:06:35.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d3468700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6cc0ce310 con 0x7fc6cc0c1910 2023-11-28T13:06:35.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d2466700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc6cc070070 0x7fc6cc070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d1c65700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc6cc160900 0x7fc6cc0cc1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35112/0 (socket says 172.21.15.82:35112) 2023-11-28T13:06:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d1c65700 1 -- 172.21.15.82:0/1950033884 learned_addr learned my addr 172.21.15.82:0/1950033884 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:06:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d2c67700 1 --2- 172.21.15.82:0/1950033884 >> v2:172.21.15.114:3300/0 conn(0x7fc6cc0c1910 0x7fc6cc06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d1464700 1 -- 172.21.15.82:0/1950033884 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079311253 0 0) 0x7fc6cc070980 con 0x7fc6cc160900 2023-11-28T13:06:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d1464700 1 -- 172.21.15.82:0/1950033884 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6b40035d0 con 0x7fc6cc160900 2023-11-28T13:06:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d2466700 1 -- 172.21.15.82:0/1950033884 >> v2:172.21.15.114:3300/0 conn(0x7fc6cc0c1910 msgr2=0x7fc6cc06c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:06:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d2466700 1 --2- 172.21.15.82:0/1950033884 >> v2:172.21.15.114:3300/0 conn(0x7fc6cc0c1910 0x7fc6cc06c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d2466700 1 -- 172.21.15.82:0/1950033884 >> v1:172.21.15.82:6789/0 conn(0x7fc6cc160900 legacy=0x7fc6cc0cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d2466700 1 -- 172.21.15.82:0/1950033884 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc06a5d0 con 0x7fc6cc070070 2023-11-28T13:06:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d2466700 1 --2- 172.21.15.82:0/1950033884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6cc070070 0x7fc6cc070440 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0b4530 tx=0x7fc6c0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa769b0c17a40a2a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:35.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d1464700 1 -- 172.21.15.82:0/1950033884 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0011830 con 0x7fc6cc070070 2023-11-28T13:06:35.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d1464700 1 -- 172.21.15.82:0/1950033884 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c0011990 con 0x7fc6cc070070 2023-11-28T13:06:35.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d1464700 1 -- 172.21.15.82:0/1950033884 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0011d00 con 0x7fc6cc070070 2023-11-28T13:06:35.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d3468700 1 -- 172.21.15.82:0/1950033884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6cc070070 msgr2=0x7fc6cc070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:35.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d3468700 1 --2- 172.21.15.82:0/1950033884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6cc070070 0x7fc6cc070440 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0b4530 tx=0x7fc6c0009b30 comp rx=0 tx=0).stop 2023-11-28T13:06:35.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d3468700 1 -- 172.21.15.82:0/1950033884 shutdown_connections 2023-11-28T13:06:35.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d3468700 1 --2- 172.21.15.82:0/1950033884 >> v2:172.21.15.114:3300/0 conn(0x7fc6cc0c1910 0x7fc6cc06c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:35.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d3468700 1 --2- 172.21.15.82:0/1950033884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6cc070070 0x7fc6cc070440 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:35.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d3468700 1 -- 172.21.15.82:0/1950033884 >> 172.21.15.82:0/1950033884 conn(0x7fc6cc0ce600 msgr2=0x7fc6cc0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:35.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d3468700 1 -- 172.21.15.82:0/1950033884 shutdown_connections 2023-11-28T13:06:35.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.920+0000 7fc6d3468700 1 -- 172.21.15.82:0/1950033884 wait complete. 2023-11-28T13:06:35.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.924+0000 7fc6d3468700 1 Processor -- start 2023-11-28T13:06:35.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.924+0000 7fc6d3468700 1 -- start start 2023-11-28T13:06:35.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.924+0000 7fc6d3468700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6cc070070 0x7fc6cc150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:35.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.924+0000 7fc6d3468700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6cc0c71c0 0x7fc6cc0c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:35.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.924+0000 7fc6d3468700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6cc160ce0 0x7fc6cc161150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:35.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.924+0000 7fc6d3468700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc162a70 con 0x7fc6cc0c71c0 2023-11-28T13:06:35.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.924+0000 7fc6d3468700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0c7b50 con 0x7fc6cc160ce0 2023-11-28T13:06:35.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.924+0000 7fc6d3468700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc1625e0 con 0x7fc6cc070070 2023-11-28T13:06:35.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.924+0000 7fc6d1c65700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6cc0c71c0 0x7fc6cc0c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:35.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.924+0000 7fc6d1c65700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6cc0c71c0 0x7fc6cc0c7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48138/0 (socket says 172.21.15.82:48138) 2023-11-28T13:06:35.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.924+0000 7fc6d1c65700 1 -- 172.21.15.82:0/3650381632 learned_addr learned my addr 172.21.15.82:0/3650381632 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:06:35.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.924+0000 7fc6d2c67700 1 --2- 172.21.15.82:0/3650381632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6cc160ce0 0x7fc6cc161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:35.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.924+0000 7fc6d2466700 1 --2- 172.21.15.82:0/3650381632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6cc070070 0x7fc6cc150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:35.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.928+0000 7fc6d1c65700 1 -- 172.21.15.82:0/3650381632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6cc070070 msgr2=0x7fc6cc150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:35.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.928+0000 7fc6d1c65700 1 --2- 172.21.15.82:0/3650381632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6cc070070 0x7fc6cc150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:35.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.928+0000 7fc6d1c65700 1 -- 172.21.15.82:0/3650381632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6cc160ce0 msgr2=0x7fc6cc161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:35.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.928+0000 7fc6d1c65700 1 --2- 172.21.15.82:0/3650381632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6cc160ce0 0x7fc6cc161150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:35.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.928+0000 7fc6d1c65700 1 -- 172.21.15.82:0/3650381632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c00094b0 con 0x7fc6cc0c71c0 2023-11-28T13:06:35.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.928+0000 7fc6d1c65700 1 --2- 172.21.15.82:0/3650381632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6cc0c71c0 0x7fc6cc0c7610 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00c4f0 tx=0x7fc6bc00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:35.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.928+0000 7fc6caffd700 1 -- 172.21.15.82:0/3650381632 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc00cea0 con 0x7fc6cc0c71c0 2023-11-28T13:06:35.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.928+0000 7fc6caffd700 1 -- 172.21.15.82:0/3650381632 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc005d90 con 0x7fc6cc0c71c0 2023-11-28T13:06:35.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.928+0000 7fc6d3468700 1 -- 172.21.15.82:0/3650381632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6cc06ab90 con 0x7fc6cc0c71c0 2023-11-28T13:06:35.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.928+0000 7fc6caffd700 1 -- 172.21.15.82:0/3650381632 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc0072d0 con 0x7fc6cc0c71c0 2023-11-28T13:06:35.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.928+0000 7fc6d3468700 1 -- 172.21.15.82:0/3650381632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6cc06a8b0 con 0x7fc6cc0c71c0 2023-11-28T13:06:35.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.928+0000 7fc6d3468700 1 -- 172.21.15.82:0/3650381632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6cc0cdc50 con 0x7fc6cc0c71c0 2023-11-28T13:06:35.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.928+0000 7fc6caffd700 1 -- 172.21.15.82:0/3650381632 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc6bc019030 con 0x7fc6cc0c71c0 2023-11-28T13:06:35.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.932+0000 7fc6caffd700 1 --2- 172.21.15.82:0/3650381632 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc6b8064ee0 0x7fc6b8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:35.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.932+0000 7fc6caffd700 1 -- 172.21.15.82:0/3650381632 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7fc6bc0810b0 con 0x7fc6cc0c71c0 2023-11-28T13:06:35.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.932+0000 7fc6d2466700 1 --2- 172.21.15.82:0/3650381632 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc6b8064ee0 0x7fc6b8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:35.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.932+0000 7fc6d2466700 1 --2- 172.21.15.82:0/3650381632 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc6b8064ee0 0x7fc6b8067390 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0000c00 tx=0x7fc6c0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:35.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:35.936+0000 7fc6caffd700 1 -- 172.21.15.82:0/3650381632 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc6bc04a400 con 0x7fc6cc0c71c0 2023-11-28T13:06:36.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:36.136+0000 7fc6d3468700 1 -- 172.21.15.82:0/3650381632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc6cc065fc0 con 0x7fc6cc0c71c0 2023-11-28T13:06:36.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:36.136+0000 7fc6caffd700 1 -- 172.21.15.82:0/3650381632 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fc6bc017020 con 0x7fc6cc0c71c0 2023-11-28T13:06:36.140 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:06:36.140 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:06:36.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:36.136+0000 7fc6d3468700 1 -- 172.21.15.82:0/3650381632 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc6b8064ee0 msgr2=0x7fc6b8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:36.136+0000 7fc6d3468700 1 --2- 172.21.15.82:0/3650381632 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc6b8064ee0 0x7fc6b8067390 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0000c00 tx=0x7fc6c0008030 comp rx=0 tx=0).stop 2023-11-28T13:06:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:36.136+0000 7fc6d3468700 1 -- 172.21.15.82:0/3650381632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6cc0c71c0 msgr2=0x7fc6cc0c7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:36.136+0000 7fc6d3468700 1 --2- 172.21.15.82:0/3650381632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6cc0c71c0 0x7fc6cc0c7610 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00c4f0 tx=0x7fc6bc00c800 comp rx=0 tx=0).stop 2023-11-28T13:06:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:36.136+0000 7fc6d3468700 1 -- 172.21.15.82:0/3650381632 shutdown_connections 2023-11-28T13:06:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:36.136+0000 7fc6d3468700 1 --2- 172.21.15.82:0/3650381632 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc6b8064ee0 0x7fc6b8067390 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:36.136+0000 7fc6d3468700 1 --2- 172.21.15.82:0/3650381632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6cc160ce0 0x7fc6cc161150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:36.136+0000 7fc6d3468700 1 --2- 172.21.15.82:0/3650381632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6cc0c71c0 0x7fc6cc0c7610 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:36.136+0000 7fc6d3468700 1 --2- 172.21.15.82:0/3650381632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6cc070070 0x7fc6cc150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:36.136+0000 7fc6d3468700 1 -- 172.21.15.82:0/3650381632 >> 172.21.15.82:0/3650381632 conn(0x7fc6cc0ce600 msgr2=0x7fc6cc0aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:36.136+0000 7fc6d3468700 1 -- 172.21.15.82:0/3650381632 shutdown_connections 2023-11-28T13:06:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:36.136+0000 7fc6d3468700 1 -- 172.21.15.82:0/3650381632 wait complete. 2023-11-28T13:06:36.154 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:06:41.155 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:06:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.272+0000 7f233ec51700 1 Processor -- start 2023-11-28T13:06:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.272+0000 7f233ec51700 1 -- start start 2023-11-28T13:06:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.272+0000 7f233ec51700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f233806b0a0 0x7f233806d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.272+0000 7f233ec51700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2338070070 0x7f2338070470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.272+0000 7f233ec51700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233806c480 con 0x7f23380b3910 2023-11-28T13:06:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.272+0000 7f233ec51700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23380709b0 con 0x7f2338070070 2023-11-28T13:06:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.272+0000 7f233ec51700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233806dbe0 con 0x7f233806b0a0 2023-11-28T13:06:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.272+0000 7f233e450700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2338070070 0x7f2338070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233e450700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2338070070 0x7f2338070470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45446/0 (socket says 172.21.15.82:45446) 2023-11-28T13:06:41.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233e450700 1 -- 172.21.15.82:0/166140053 learned_addr learned my addr 172.21.15.82:0/166140053 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:06:41.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233d44e700 1 --2- 172.21.15.82:0/166140053 >> v2:172.21.15.114:3300/0 conn(0x7f233806b0a0 0x7f233806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:41.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233e450700 1 -- 172.21.15.82:0/166140053 >> v2:172.21.15.114:3300/0 conn(0x7f233806b0a0 msgr2=0x7f233806d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:06:41.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233e450700 1 --2- 172.21.15.82:0/166140053 >> v2:172.21.15.114:3300/0 conn(0x7f233806b0a0 0x7f233806d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:41.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233e450700 1 -- 172.21.15.82:0/166140053 >> v1:172.21.15.114:6789/0 conn(0x7f23380b3910 legacy=0x7f233806c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:41.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233e450700 1 -- 172.21.15.82:0/166140053 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233806dec0 con 0x7f2338070070 2023-11-28T13:06:41.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233e450700 1 --2- 172.21.15.82:0/166140053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2338070070 0x7f2338070470 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f233806bd00 tx=0x7f2330009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f8082c93e7ff8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:41.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233cc4d700 1 -- 172.21.15.82:0/166140053 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2330011830 con 0x7f2338070070 2023-11-28T13:06:41.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233cc4d700 1 -- 172.21.15.82:0/166140053 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2330011990 con 0x7f2338070070 2023-11-28T13:06:41.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233cc4d700 1 -- 172.21.15.82:0/166140053 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2330011d20 con 0x7f2338070070 2023-11-28T13:06:41.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233ec51700 1 -- 172.21.15.82:0/166140053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2338070070 msgr2=0x7f2338070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:41.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233ec51700 1 --2- 172.21.15.82:0/166140053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2338070070 0x7f2338070470 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f233806bd00 tx=0x7f2330009bf0 comp rx=0 tx=0).stop 2023-11-28T13:06:41.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233ec51700 1 -- 172.21.15.82:0/166140053 shutdown_connections 2023-11-28T13:06:41.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233ec51700 1 --2- 172.21.15.82:0/166140053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2338070070 0x7f2338070470 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:41.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233ec51700 1 --2- 172.21.15.82:0/166140053 >> v2:172.21.15.114:3300/0 conn(0x7f233806b0a0 0x7f233806d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:41.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233ec51700 1 -- 172.21.15.82:0/166140053 >> 172.21.15.82:0/166140053 conn(0x7f23380ce600 msgr2=0x7f23380ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:41.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233ec51700 1 -- 172.21.15.82:0/166140053 shutdown_connections 2023-11-28T13:06:41.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233ec51700 1 -- 172.21.15.82:0/166140053 wait complete. 2023-11-28T13:06:41.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233ec51700 1 Processor -- start 2023-11-28T13:06:41.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233ec51700 1 -- start start 2023-11-28T13:06:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233ec51700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f233806b0a0 0x7f2338146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233ec51700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2338070070 0x7f233815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233ec51700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23380b3910 0x7f23380c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233ec51700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23380af030 con 0x7f233806b0a0 2023-11-28T13:06:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233ec51700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23380b00a0 con 0x7f2338070070 2023-11-28T13:06:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.276+0000 7f233ec51700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2338147420 con 0x7f23380b3910 2023-11-28T13:06:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.280+0000 7f233dc4f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f233806b0a0 0x7f2338146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.280+0000 7f233d44e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2338070070 0x7f233815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.280+0000 7f233d44e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2338070070 0x7f233815a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:47994/0 (socket says 172.21.15.82:47994) 2023-11-28T13:06:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.280+0000 7f233d44e700 1 -- 172.21.15.82:0/1022453471 learned_addr learned my addr 172.21.15.82:0/1022453471 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:06:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.280+0000 7f233e450700 1 --2- 172.21.15.82:0/1022453471 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23380b3910 0x7f23380c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:41.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.280+0000 7f233d44e700 1 -- 172.21.15.82:0/1022453471 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23380b3910 msgr2=0x7f23380c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:41.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.280+0000 7f233d44e700 1 --2- 172.21.15.82:0/1022453471 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23380b3910 0x7f23380c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:41.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.280+0000 7f233d44e700 1 -- 172.21.15.82:0/1022453471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f233806b0a0 msgr2=0x7f2338146ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:41.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.280+0000 7f233d44e700 1 --2- 172.21.15.82:0/1022453471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f233806b0a0 0x7f2338146ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:41.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.280+0000 7f233d44e700 1 -- 172.21.15.82:0/1022453471 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2330009570 con 0x7f2338070070 2023-11-28T13:06:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.280+0000 7f233d44e700 1 --2- 172.21.15.82:0/1022453471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2338070070 0x7f233815a5c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f233400efc0 tx=0x7f233400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.280+0000 7f232e7fc700 1 -- 172.21.15.82:0/1022453471 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233400cd10 con 0x7f2338070070 2023-11-28T13:06:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.280+0000 7f232e7fc700 1 -- 172.21.15.82:0/1022453471 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233400f040 con 0x7f2338070070 2023-11-28T13:06:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.280+0000 7f233ec51700 1 -- 172.21.15.82:0/1022453471 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23380c8f80 con 0x7f2338070070 2023-11-28T13:06:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.280+0000 7f232e7fc700 1 -- 172.21.15.82:0/1022453471 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23340146a0 con 0x7f2338070070 2023-11-28T13:06:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.280+0000 7f233ec51700 1 -- 172.21.15.82:0/1022453471 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233806c110 con 0x7f2338070070 2023-11-28T13:06:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.280+0000 7f233ec51700 1 -- 172.21.15.82:0/1022453471 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233806d860 con 0x7f2338070070 2023-11-28T13:06:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.284+0000 7f232e7fc700 1 -- 172.21.15.82:0/1022453471 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2334014800 con 0x7f2338070070 2023-11-28T13:06:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.284+0000 7f232e7fc700 1 --2- 172.21.15.82:0/1022453471 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f231c064ee0 0x7f231c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.284+0000 7f233dc4f700 1 --2- 172.21.15.82:0/1022453471 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f231c064ee0 0x7f231c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.284+0000 7f232e7fc700 1 -- 172.21.15.82:0/1022453471 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f2334082910 con 0x7f2338070070 2023-11-28T13:06:41.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.284+0000 7f233dc4f700 1 --2- 172.21.15.82:0/1022453471 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f231c064ee0 0x7f231c067390 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2328000f60 tx=0x7f2328009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:41.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.292+0000 7f232e7fc700 1 -- 172.21.15.82:0/1022453471 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2334050940 con 0x7f2338070070 2023-11-28T13:06:41.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.492+0000 7f233ec51700 1 -- 172.21.15.82:0/1022453471 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2338065fc0 con 0x7f2338070070 2023-11-28T13:06:41.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.492+0000 7f232e7fc700 1 -- 172.21.15.82:0/1022453471 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f2334053f60 con 0x7f2338070070 2023-11-28T13:06:41.498 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:06:41.499 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:06:41.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.496+0000 7f233ec51700 1 -- 172.21.15.82:0/1022453471 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f231c064ee0 msgr2=0x7f231c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:41.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.496+0000 7f233ec51700 1 --2- 172.21.15.82:0/1022453471 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f231c064ee0 0x7f231c067390 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2328000f60 tx=0x7f2328009040 comp rx=0 tx=0).stop 2023-11-28T13:06:41.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.496+0000 7f233ec51700 1 -- 172.21.15.82:0/1022453471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2338070070 msgr2=0x7f233815a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:41.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.496+0000 7f233ec51700 1 --2- 172.21.15.82:0/1022453471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2338070070 0x7f233815a5c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f233400efc0 tx=0x7f233400c3a0 comp rx=0 tx=0).stop 2023-11-28T13:06:41.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.496+0000 7f233ec51700 1 -- 172.21.15.82:0/1022453471 shutdown_connections 2023-11-28T13:06:41.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.496+0000 7f233ec51700 1 --2- 172.21.15.82:0/1022453471 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f231c064ee0 0x7f231c067390 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:41.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.496+0000 7f233ec51700 1 --2- 172.21.15.82:0/1022453471 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23380b3910 0x7f23380c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:41.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.496+0000 7f233ec51700 1 --2- 172.21.15.82:0/1022453471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2338070070 0x7f233815a5c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:41.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.496+0000 7f233ec51700 1 --2- 172.21.15.82:0/1022453471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f233806b0a0 0x7f2338146ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:41.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.496+0000 7f233ec51700 1 -- 172.21.15.82:0/1022453471 >> 172.21.15.82:0/1022453471 conn(0x7f23380ce600 msgr2=0x7f23380b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:41.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.496+0000 7f233ec51700 1 -- 172.21.15.82:0/1022453471 shutdown_connections 2023-11-28T13:06:41.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:41.496+0000 7f233ec51700 1 -- 172.21.15.82:0/1022453471 wait complete. 2023-11-28T13:06:41.512 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:06:46.513 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:06:46.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.627+0000 7f793cd73700 1 Processor -- start 2023-11-28T13:06:46.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.627+0000 7f793cd73700 1 -- start start 2023-11-28T13:06:46.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f793cd73700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f793815c340 0x7f79380cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:46.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f793cd73700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f793815ce20 0x7f79380b1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:46.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f793cd73700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79380b0b50 con 0x7f79380d0f40 2023-11-28T13:06:46.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f793cd73700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79380ceaa0 con 0x7f793815c340 2023-11-28T13:06:46.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f793cd73700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79380ce7c0 con 0x7f793815ce20 2023-11-28T13:06:46.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f79377fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f793815c340 0x7f79380cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:46.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f79377fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f793815c340 0x7f79380cae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40392/0 (socket says 172.21.15.82:40392) 2023-11-28T13:06:46.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f79377fe700 1 -- 172.21.15.82:0/4092187856 learned_addr learned my addr 172.21.15.82:0/4092187856 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:06:46.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f7937fff700 1 --2- 172.21.15.82:0/4092187856 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f793815ce20 0x7f79380b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:46.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f79377fe700 1 -- 172.21.15.82:0/4092187856 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f793815ce20 msgr2=0x7f79380b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:06:46.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f79377fe700 1 --2- 172.21.15.82:0/4092187856 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f793815ce20 0x7f79380b1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:46.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f79377fe700 1 -- 172.21.15.82:0/4092187856 >> v1:172.21.15.114:6789/0 conn(0x7f79380d0f40 legacy=0x7f793815c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:46.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f79377fe700 1 -- 172.21.15.82:0/4092187856 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79380d01b0 con 0x7f793815c340 2023-11-28T13:06:46.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f7937fff700 1 --2- 172.21.15.82:0/4092187856 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f793815ce20 0x7f79380b1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:06:46.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f79377fe700 1 --2- 172.21.15.82:0/4092187856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f793815c340 0x7f79380cae80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f7928009910 tx=0x7f7928009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce9fb80ff55ec90f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:46.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f7936ffd700 1 -- 172.21.15.82:0/4092187856 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792800ba60 con 0x7f793815c340 2023-11-28T13:06:46.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f7936ffd700 1 -- 172.21.15.82:0/4092187856 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792800bbc0 con 0x7f793815c340 2023-11-28T13:06:46.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f7936ffd700 1 -- 172.21.15.82:0/4092187856 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7928009e60 con 0x7f793815c340 2023-11-28T13:06:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f793cd73700 1 -- 172.21.15.82:0/4092187856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f793815c340 msgr2=0x7f79380cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f793cd73700 1 --2- 172.21.15.82:0/4092187856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f793815c340 0x7f79380cae80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f7928009910 tx=0x7f7928009c20 comp rx=0 tx=0).stop 2023-11-28T13:06:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f793cd73700 1 -- 172.21.15.82:0/4092187856 shutdown_connections 2023-11-28T13:06:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f793cd73700 1 --2- 172.21.15.82:0/4092187856 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f793815ce20 0x7f79380b1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f793cd73700 1 --2- 172.21.15.82:0/4092187856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f793815c340 0x7f79380cae80 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f793cd73700 1 -- 172.21.15.82:0/4092187856 >> 172.21.15.82:0/4092187856 conn(0x7f79380cdf40 msgr2=0x7f79380d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f793cd73700 1 -- 172.21.15.82:0/4092187856 shutdown_connections 2023-11-28T13:06:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.631+0000 7f793cd73700 1 -- 172.21.15.82:0/4092187856 wait complete. 2023-11-28T13:06:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f793cd73700 1 Processor -- start 2023-11-28T13:06:46.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f793cd73700 1 -- start start 2023-11-28T13:06:46.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f793cd73700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79380d0f40 0x7f7938152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:46.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f793cd73700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f793815c340 0x7f79380c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:46.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f793cd73700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f793815ce20 0x7f793815e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:46.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f793cd73700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793815a770 con 0x7f793815ce20 2023-11-28T13:06:46.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f793cd73700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793815aa50 con 0x7f79380d0f40 2023-11-28T13:06:46.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f793cd73700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793815ad30 con 0x7f793815c340 2023-11-28T13:06:46.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f7937fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f793815ce20 0x7f793815e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:46.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f7937fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f793815ce20 0x7f793815e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40398/0 (socket says 172.21.15.82:40398) 2023-11-28T13:06:46.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f79377fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79380d0f40 0x7f7938152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:46.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f7937fff700 1 -- 172.21.15.82:0/2370443338 learned_addr learned my addr 172.21.15.82:0/2370443338 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:06:46.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f792effd700 1 --2- 172.21.15.82:0/2370443338 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f793815c340 0x7f79380c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:46.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f7937fff700 1 -- 172.21.15.82:0/2370443338 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f793815c340 msgr2=0x7f79380c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:46.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f7937fff700 1 --2- 172.21.15.82:0/2370443338 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f793815c340 0x7f79380c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:46.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f7937fff700 1 -- 172.21.15.82:0/2370443338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79380d0f40 msgr2=0x7f7938152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:46.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f7937fff700 1 --2- 172.21.15.82:0/2370443338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79380d0f40 0x7f7938152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:46.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f7937fff700 1 -- 172.21.15.82:0/2370443338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7928009570 con 0x7f793815ce20 2023-11-28T13:06:46.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f7937fff700 1 --2- 172.21.15.82:0/2370443338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f793815ce20 0x7f793815e170 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f7930007ef0 tx=0x7f793000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:46.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f7934ff9700 1 -- 172.21.15.82:0/2370443338 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793000dd80 con 0x7f793815ce20 2023-11-28T13:06:46.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f7934ff9700 1 -- 172.21.15.82:0/2370443338 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793000f040 con 0x7f793815ce20 2023-11-28T13:06:46.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f793cd73700 1 -- 172.21.15.82:0/2370443338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79380d13b0 con 0x7f793815ce20 2023-11-28T13:06:46.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f7934ff9700 1 -- 172.21.15.82:0/2370443338 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930003c80 con 0x7f793815ce20 2023-11-28T13:06:46.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.635+0000 7f793cd73700 1 -- 172.21.15.82:0/2370443338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79380d0490 con 0x7f793815ce20 2023-11-28T13:06:46.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.639+0000 7f793cd73700 1 -- 172.21.15.82:0/2370443338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79380cfe60 con 0x7f793815ce20 2023-11-28T13:06:46.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.639+0000 7f7934ff9700 1 -- 172.21.15.82:0/2370443338 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f793001c030 con 0x7f793815ce20 2023-11-28T13:06:46.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.639+0000 7f7934ff9700 1 --2- 172.21.15.82:0/2370443338 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7918064ee0 0x7f7918067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:46.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.639+0000 7f7934ff9700 1 -- 172.21.15.82:0/2370443338 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f7930081f80 con 0x7f793815ce20 2023-11-28T13:06:46.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.639+0000 7f79377fe700 1 --2- 172.21.15.82:0/2370443338 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7918064ee0 0x7f7918067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:46.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.639+0000 7f79377fe700 1 --2- 172.21.15.82:0/2370443338 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7918064ee0 0x7f7918067390 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7928000c00 tx=0x7f7928008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:46.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.647+0000 7f7934ff9700 1 -- 172.21.15.82:0/2370443338 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f793004ff30 con 0x7f793815ce20 2023-11-28T13:06:46.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.843+0000 7f793cd73700 1 -- 172.21.15.82:0/2370443338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7938065fc0 con 0x7f793815ce20 2023-11-28T13:06:46.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.843+0000 7f7934ff9700 1 -- 172.21.15.82:0/2370443338 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f7930053550 con 0x7f793815ce20 2023-11-28T13:06:46.849 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:06:46.849 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:06:46.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.847+0000 7f793cd73700 1 -- 172.21.15.82:0/2370443338 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7918064ee0 msgr2=0x7f7918067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:46.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.847+0000 7f793cd73700 1 --2- 172.21.15.82:0/2370443338 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7918064ee0 0x7f7918067390 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7928000c00 tx=0x7f7928008030 comp rx=0 tx=0).stop 2023-11-28T13:06:46.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.847+0000 7f793cd73700 1 -- 172.21.15.82:0/2370443338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f793815ce20 msgr2=0x7f793815e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:46.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.847+0000 7f793cd73700 1 --2- 172.21.15.82:0/2370443338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f793815ce20 0x7f793815e170 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f7930007ef0 tx=0x7f793000d3b0 comp rx=0 tx=0).stop 2023-11-28T13:06:46.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.847+0000 7f793cd73700 1 -- 172.21.15.82:0/2370443338 shutdown_connections 2023-11-28T13:06:46.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.847+0000 7f793cd73700 1 --2- 172.21.15.82:0/2370443338 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7918064ee0 0x7f7918067390 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:46.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.847+0000 7f793cd73700 1 --2- 172.21.15.82:0/2370443338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f793815ce20 0x7f793815e170 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:46.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.847+0000 7f793cd73700 1 --2- 172.21.15.82:0/2370443338 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f793815c340 0x7f79380c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:46.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.847+0000 7f793cd73700 1 --2- 172.21.15.82:0/2370443338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79380d0f40 0x7f7938152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:46.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.847+0000 7f793cd73700 1 -- 172.21.15.82:0/2370443338 >> 172.21.15.82:0/2370443338 conn(0x7f79380cdf40 msgr2=0x7f793815c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:46.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.847+0000 7f793cd73700 1 -- 172.21.15.82:0/2370443338 shutdown_connections 2023-11-28T13:06:46.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:46.847+0000 7f793cd73700 1 -- 172.21.15.82:0/2370443338 wait complete. 2023-11-28T13:06:46.863 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:06:51.864 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:06:51.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.975+0000 7f485e2c8700 1 Processor -- start 2023-11-28T13:06:51.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.975+0000 7f485e2c8700 1 -- start start 2023-11-28T13:06:51.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.975+0000 7f485e2c8700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f485815c1c0 0x7f48580c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:51.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.975+0000 7f485e2c8700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f485806dae0 0x7f48580ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:51.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.975+0000 7f485e2c8700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48580cd2e0 con 0x7f48580ca4b0 2023-11-28T13:06:51.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.975+0000 7f485e2c8700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48580ca9c0 con 0x7f485815c1c0 2023-11-28T13:06:51.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.975+0000 7f485e2c8700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48580cd530 con 0x7f485806dae0 2023-11-28T13:06:51.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.975+0000 7f485d2c6700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f485815c1c0 0x7f48580c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:51.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.975+0000 7f485d2c6700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f485815c1c0 0x7f48580c9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40414/0 (socket says 172.21.15.82:40414) 2023-11-28T13:06:51.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.975+0000 7f485cac5700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f48580ca4b0 0x7f485806d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:40494/0 (socket says 172.21.15.82:40494) 2023-11-28T13:06:51.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.975+0000 7f485d2c6700 1 -- 172.21.15.82:0/2449288790 learned_addr learned my addr 172.21.15.82:0/2449288790 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:06:51.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.975+0000 7f485dac7700 1 --2- 172.21.15.82:0/2449288790 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f485806dae0 0x7f48580ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:51.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.975+0000 7f485d2c6700 1 -- 172.21.15.82:0/2449288790 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f485806dae0 msgr2=0x7f48580ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:06:51.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.975+0000 7f485d2c6700 1 --2- 172.21.15.82:0/2449288790 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f485806dae0 0x7f48580ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:51.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.975+0000 7f485d2c6700 1 -- 172.21.15.82:0/2449288790 >> v1:172.21.15.82:6789/0 conn(0x7f48580ca4b0 legacy=0x7f485806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:51.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.975+0000 7f485d2c6700 1 -- 172.21.15.82:0/2449288790 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48580cd810 con 0x7f485815c1c0 2023-11-28T13:06:51.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485d2c6700 1 --2- 172.21.15.82:0/2449288790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f485815c1c0 0x7f48580c9f70 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f4854009910 tx=0x7f4854009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b06987d2ff2b757 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:51.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f484ffff700 1 -- 172.21.15.82:0/2449288790 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485400ba60 con 0x7f485815c1c0 2023-11-28T13:06:51.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f484ffff700 1 -- 172.21.15.82:0/2449288790 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485400bbc0 con 0x7f485815c1c0 2023-11-28T13:06:51.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f484ffff700 1 -- 172.21.15.82:0/2449288790 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4854009e60 con 0x7f485815c1c0 2023-11-28T13:06:51.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485e2c8700 1 -- 172.21.15.82:0/2449288790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f485815c1c0 msgr2=0x7f48580c9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:51.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485e2c8700 1 --2- 172.21.15.82:0/2449288790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f485815c1c0 0x7f48580c9f70 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f4854009910 tx=0x7f4854009c20 comp rx=0 tx=0).stop 2023-11-28T13:06:51.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485e2c8700 1 -- 172.21.15.82:0/2449288790 shutdown_connections 2023-11-28T13:06:51.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485e2c8700 1 --2- 172.21.15.82:0/2449288790 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f485806dae0 0x7f48580ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:51.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485e2c8700 1 --2- 172.21.15.82:0/2449288790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f485815c1c0 0x7f48580c9f70 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:51.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485e2c8700 1 -- 172.21.15.82:0/2449288790 >> 172.21.15.82:0/2449288790 conn(0x7f48580cf710 msgr2=0x7f48580cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:51.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485e2c8700 1 -- 172.21.15.82:0/2449288790 shutdown_connections 2023-11-28T13:06:51.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485e2c8700 1 -- 172.21.15.82:0/2449288790 wait complete. 2023-11-28T13:06:51.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485e2c8700 1 Processor -- start 2023-11-28T13:06:51.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485e2c8700 1 -- start start 2023-11-28T13:06:51.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485e2c8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f485806dae0 0x7f4858157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:51.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485e2c8700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f48580ca4b0 0x7f48580c3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:51.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485e2c8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f485815c1c0 0x7f48580c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:51.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485e2c8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48580b4f20 con 0x7f485815c1c0 2023-11-28T13:06:51.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485e2c8700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48580b4310 con 0x7f485806dae0 2023-11-28T13:06:51.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485e2c8700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48580b45f0 con 0x7f48580ca4b0 2023-11-28T13:06:51.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485dac7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f485815c1c0 0x7f48580c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:51.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485dac7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f485815c1c0 0x7f48580c3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40420/0 (socket says 172.21.15.82:40420) 2023-11-28T13:06:51.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485dac7700 1 -- 172.21.15.82:0/4257500674 learned_addr learned my addr 172.21.15.82:0/4257500674 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:06:51.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485d2c6700 1 --2- 172.21.15.82:0/4257500674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f485806dae0 0x7f4858157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:51.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.979+0000 7f485cac5700 1 --2- 172.21.15.82:0/4257500674 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f48580ca4b0 0x7f48580c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:51.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.983+0000 7f485dac7700 1 -- 172.21.15.82:0/4257500674 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f48580ca4b0 msgr2=0x7f48580c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:51.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.983+0000 7f485dac7700 1 --2- 172.21.15.82:0/4257500674 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f48580ca4b0 0x7f48580c3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:51.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.983+0000 7f485dac7700 1 -- 172.21.15.82:0/4257500674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f485806dae0 msgr2=0x7f4858157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:51.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.983+0000 7f485dac7700 1 --2- 172.21.15.82:0/4257500674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f485806dae0 0x7f4858157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:51.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.983+0000 7f485dac7700 1 -- 172.21.15.82:0/4257500674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4854009570 con 0x7f485815c1c0 2023-11-28T13:06:51.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.983+0000 7f485dac7700 1 --2- 172.21.15.82:0/4257500674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f485815c1c0 0x7f48580c3780 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f4850007d40 tx=0x7f485000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:51.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.983+0000 7f484dffb700 1 -- 172.21.15.82:0/4257500674 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485000ed30 con 0x7f485815c1c0 2023-11-28T13:06:51.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.983+0000 7f484dffb700 1 -- 172.21.15.82:0/4257500674 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4850007e90 con 0x7f485815c1c0 2023-11-28T13:06:51.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.983+0000 7f484dffb700 1 -- 172.21.15.82:0/4257500674 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850014660 con 0x7f485815c1c0 2023-11-28T13:06:51.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.983+0000 7f485e2c8700 1 -- 172.21.15.82:0/4257500674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485815c590 con 0x7f485815c1c0 2023-11-28T13:06:51.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.983+0000 7f485e2c8700 1 -- 172.21.15.82:0/4257500674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48580cdaf0 con 0x7f485815c1c0 2023-11-28T13:06:51.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.983+0000 7f485e2c8700 1 -- 172.21.15.82:0/4257500674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4858160b70 con 0x7f485815c1c0 2023-11-28T13:06:51.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.983+0000 7f484dffb700 1 -- 172.21.15.82:0/4257500674 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4850012050 con 0x7f485815c1c0 2023-11-28T13:06:51.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.983+0000 7f484dffb700 1 --2- 172.21.15.82:0/4257500674 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f483c064ee0 0x7f483c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:51.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.983+0000 7f484dffb700 1 -- 172.21.15.82:0/4257500674 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f48500823b0 con 0x7f485815c1c0 2023-11-28T13:06:51.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.983+0000 7f485d2c6700 1 --2- 172.21.15.82:0/4257500674 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f483c064ee0 0x7f483c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:51.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.987+0000 7f485d2c6700 1 --2- 172.21.15.82:0/4257500674 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f483c064ee0 0x7f483c067390 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4854000c00 tx=0x7f4854008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:51.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:51.991+0000 7f484dffb700 1 -- 172.21.15.82:0/4257500674 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f48500504d0 con 0x7f485815c1c0 2023-11-28T13:06:52.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:52.183+0000 7f485e2c8700 1 -- 172.21.15.82:0/4257500674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4858159800 con 0x7f485815c1c0 2023-11-28T13:06:52.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:52.187+0000 7f484dffb700 1 -- 172.21.15.82:0/4257500674 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f4850053af0 con 0x7f485815c1c0 2023-11-28T13:06:52.191 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:06:52.191 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:06:52.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:52.187+0000 7f485e2c8700 1 -- 172.21.15.82:0/4257500674 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f483c064ee0 msgr2=0x7f483c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:52.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:52.187+0000 7f485e2c8700 1 --2- 172.21.15.82:0/4257500674 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f483c064ee0 0x7f483c067390 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4854000c00 tx=0x7f4854008030 comp rx=0 tx=0).stop 2023-11-28T13:06:52.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:52.187+0000 7f485e2c8700 1 -- 172.21.15.82:0/4257500674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f485815c1c0 msgr2=0x7f48580c3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:52.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:52.187+0000 7f485e2c8700 1 --2- 172.21.15.82:0/4257500674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f485815c1c0 0x7f48580c3780 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f4850007d40 tx=0x7f485000e3c0 comp rx=0 tx=0).stop 2023-11-28T13:06:52.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:52.187+0000 7f485e2c8700 1 -- 172.21.15.82:0/4257500674 shutdown_connections 2023-11-28T13:06:52.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:52.187+0000 7f485e2c8700 1 --2- 172.21.15.82:0/4257500674 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f483c064ee0 0x7f483c067390 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:52.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:52.187+0000 7f485e2c8700 1 --2- 172.21.15.82:0/4257500674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f485815c1c0 0x7f48580c3780 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:52.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:52.187+0000 7f485e2c8700 1 --2- 172.21.15.82:0/4257500674 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f48580ca4b0 0x7f48580c3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:52.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:52.187+0000 7f485e2c8700 1 --2- 172.21.15.82:0/4257500674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f485806dae0 0x7f4858157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:52.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:52.187+0000 7f485e2c8700 1 -- 172.21.15.82:0/4257500674 >> 172.21.15.82:0/4257500674 conn(0x7f48580cf710 msgr2=0x7f48580af170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:52.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:52.187+0000 7f485e2c8700 1 -- 172.21.15.82:0/4257500674 shutdown_connections 2023-11-28T13:06:52.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:52.187+0000 7f485e2c8700 1 -- 172.21.15.82:0/4257500674 wait complete. 2023-11-28T13:06:52.206 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:06:57.209 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:06:57.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.319+0000 7faeda482700 1 Processor -- start 2023-11-28T13:06:57.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.319+0000 7faeda482700 1 -- start start 2023-11-28T13:06:57.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.319+0000 7faeda482700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faed406b910 0x7faed4160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:57.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.319+0000 7faeda482700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faed40ced70 0x7faed406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:57.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.319+0000 7faeda482700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed40d28e0 con 0x7faed4069bc0 2023-11-28T13:06:57.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.319+0000 7faeda482700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed40cdfe0 con 0x7faed40ced70 2023-11-28T13:06:57.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.319+0000 7faeda482700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed4160cc0 con 0x7faed406b910 2023-11-28T13:06:57.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.319+0000 7faed8c7f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faed40ced70 0x7faed406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:57.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.319+0000 7faed8c7f700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faed40ced70 0x7faed406bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55062/0 (socket says 172.21.15.82:55062) 2023-11-28T13:06:57.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.319+0000 7faed8c7f700 1 -- 172.21.15.82:0/2076436984 learned_addr learned my addr 172.21.15.82:0/2076436984 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:06:57.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.319+0000 7faed9480700 1 --2- 172.21.15.82:0/2076436984 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faed406b910 0x7faed4160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:57.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.319+0000 7faed8c7f700 1 -- 172.21.15.82:0/2076436984 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faed406b910 msgr2=0x7faed4160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:06:57.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.319+0000 7faed8c7f700 1 --2- 172.21.15.82:0/2076436984 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faed406b910 0x7faed4160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:57.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.319+0000 7faed8c7f700 1 -- 172.21.15.82:0/2076436984 >> v1:172.21.15.82:6789/0 conn(0x7faed4069bc0 legacy=0x7faed4069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:57.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.319+0000 7faed8c7f700 1 -- 172.21.15.82:0/2076436984 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed406c220 con 0x7faed40ced70 2023-11-28T13:06:57.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.319+0000 7faed9480700 1 --2- 172.21.15.82:0/2076436984 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faed406b910 0x7faed4160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:06:57.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.323+0000 7faed8c7f700 1 --2- 172.21.15.82:0/2076436984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faed40ced70 0x7faed406bce0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7faed0009910 tx=0x7faed0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12eba43f8d2a4dea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:57.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.323+0000 7faecbfff700 1 -- 172.21.15.82:0/2076436984 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed000ba60 con 0x7faed40ced70 2023-11-28T13:06:57.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.323+0000 7faecbfff700 1 -- 172.21.15.82:0/2076436984 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed000bbc0 con 0x7faed40ced70 2023-11-28T13:06:57.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.323+0000 7faecbfff700 1 -- 172.21.15.82:0/2076436984 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0009e60 con 0x7faed40ced70 2023-11-28T13:06:57.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.323+0000 7faeda482700 1 -- 172.21.15.82:0/2076436984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faed40ced70 msgr2=0x7faed406bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:57.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.323+0000 7faeda482700 1 --2- 172.21.15.82:0/2076436984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faed40ced70 0x7faed406bce0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7faed0009910 tx=0x7faed0009c20 comp rx=0 tx=0).stop 2023-11-28T13:06:57.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.323+0000 7faeda482700 1 -- 172.21.15.82:0/2076436984 shutdown_connections 2023-11-28T13:06:57.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.323+0000 7faeda482700 1 --2- 172.21.15.82:0/2076436984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faed40ced70 0x7faed406bce0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:57.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.323+0000 7faeda482700 1 --2- 172.21.15.82:0/2076436984 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faed406b910 0x7faed4160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:57.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.323+0000 7faeda482700 1 -- 172.21.15.82:0/2076436984 >> 172.21.15.82:0/2076436984 conn(0x7faed40d2b20 msgr2=0x7faed40d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:57.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.323+0000 7faeda482700 1 -- 172.21.15.82:0/2076436984 shutdown_connections 2023-11-28T13:06:57.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.323+0000 7faeda482700 1 -- 172.21.15.82:0/2076436984 wait complete. 2023-11-28T13:06:57.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.323+0000 7faeda482700 1 Processor -- start 2023-11-28T13:06:57.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.323+0000 7faeda482700 1 -- start start 2023-11-28T13:06:57.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faeda482700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faed4069bc0 0x7faed40c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:57.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faeda482700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faed406b910 0x7faed40cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:57.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faeda482700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faed40ced70 0x7faed415c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:57.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faeda482700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed40c9f20 con 0x7faed4069bc0 2023-11-28T13:06:57.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faeda482700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed40ccec0 con 0x7faed40ced70 2023-11-28T13:06:57.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faeda482700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed40c6db0 con 0x7faed406b910 2023-11-28T13:06:57.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faed9480700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faed4069bc0 0x7faed40c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:57.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faed9480700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faed4069bc0 0x7faed40c8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55074/0 (socket says 172.21.15.82:55074) 2023-11-28T13:06:57.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faed9480700 1 -- 172.21.15.82:0/1625537400 learned_addr learned my addr 172.21.15.82:0/1625537400 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:06:57.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faed8c7f700 1 --2- 172.21.15.82:0/1625537400 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faed406b910 0x7faed40cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:57.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faed9c81700 1 --2- 172.21.15.82:0/1625537400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faed40ced70 0x7faed415c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:57.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faed9480700 1 -- 172.21.15.82:0/1625537400 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faed406b910 msgr2=0x7faed40cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:57.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faed9480700 1 --2- 172.21.15.82:0/1625537400 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faed406b910 0x7faed40cc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:57.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faed9480700 1 -- 172.21.15.82:0/1625537400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faed40ced70 msgr2=0x7faed415c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:57.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faed9480700 1 --2- 172.21.15.82:0/1625537400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faed40ced70 0x7faed415c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:57.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faed9480700 1 -- 172.21.15.82:0/1625537400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed0009570 con 0x7faed4069bc0 2023-11-28T13:06:57.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faed9480700 1 --2- 172.21.15.82:0/1625537400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faed4069bc0 0x7faed40c8fa0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7faec400c7f0 tx=0x7faec400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:57.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faec9ffb700 1 -- 172.21.15.82:0/1625537400 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec4011800 con 0x7faed4069bc0 2023-11-28T13:06:57.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faec9ffb700 1 -- 172.21.15.82:0/1625537400 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec4011960 con 0x7faed4069bc0 2023-11-28T13:06:57.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faeda482700 1 -- 172.21.15.82:0/1625537400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed40d1700 con 0x7faed4069bc0 2023-11-28T13:06:57.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faec9ffb700 1 -- 172.21.15.82:0/1625537400 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec4011cf0 con 0x7faed4069bc0 2023-11-28T13:06:57.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.327+0000 7faeda482700 1 -- 172.21.15.82:0/1625537400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed40b2040 con 0x7faed4069bc0 2023-11-28T13:06:57.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.331+0000 7faeda482700 1 -- 172.21.15.82:0/1625537400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed40cf2c0 con 0x7faed4069bc0 2023-11-28T13:06:57.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.331+0000 7faec9ffb700 1 -- 172.21.15.82:0/1625537400 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faec4020070 con 0x7faed4069bc0 2023-11-28T13:06:57.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.331+0000 7faec9ffb700 1 --2- 172.21.15.82:0/1625537400 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7faeb8064f10 0x7faeb80673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:06:57.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.331+0000 7faec9ffb700 1 -- 172.21.15.82:0/1625537400 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7faec40820f0 con 0x7faed4069bc0 2023-11-28T13:06:57.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.331+0000 7faed8c7f700 1 --2- 172.21.15.82:0/1625537400 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7faeb8064f10 0x7faeb80673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:06:57.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.331+0000 7faed8c7f700 1 --2- 172.21.15.82:0/1625537400 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7faeb8064f10 0x7faeb80673c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7faed0000c00 tx=0x7faed0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:06:57.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.339+0000 7faec9ffb700 1 -- 172.21.15.82:0/1625537400 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faec4050120 con 0x7faed4069bc0 2023-11-28T13:06:57.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.535+0000 7faeda482700 1 -- 172.21.15.82:0/1625537400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7faed4065fc0 con 0x7faed4069bc0 2023-11-28T13:06:57.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.535+0000 7faec9ffb700 1 -- 172.21.15.82:0/1625537400 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7faec4053740 con 0x7faed4069bc0 2023-11-28T13:06:57.542 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:06:57.543 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:06:57.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.539+0000 7faeda482700 1 -- 172.21.15.82:0/1625537400 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7faeb8064f10 msgr2=0x7faeb80673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:57.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.539+0000 7faeda482700 1 --2- 172.21.15.82:0/1625537400 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7faeb8064f10 0x7faeb80673c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7faed0000c00 tx=0x7faed0008030 comp rx=0 tx=0).stop 2023-11-28T13:06:57.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.539+0000 7faeda482700 1 -- 172.21.15.82:0/1625537400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faed4069bc0 msgr2=0x7faed40c8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:06:57.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.539+0000 7faeda482700 1 --2- 172.21.15.82:0/1625537400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faed4069bc0 0x7faed40c8fa0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7faec400c7f0 tx=0x7faec400cb00 comp rx=0 tx=0).stop 2023-11-28T13:06:57.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.543+0000 7faeda482700 1 -- 172.21.15.82:0/1625537400 shutdown_connections 2023-11-28T13:06:57.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.543+0000 7faeda482700 1 --2- 172.21.15.82:0/1625537400 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7faeb8064f10 0x7faeb80673c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:57.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.543+0000 7faeda482700 1 --2- 172.21.15.82:0/1625537400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faed40ced70 0x7faed415c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:57.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.543+0000 7faeda482700 1 --2- 172.21.15.82:0/1625537400 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faed406b910 0x7faed40cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:57.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.543+0000 7faeda482700 1 --2- 172.21.15.82:0/1625537400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faed4069bc0 0x7faed40c8fa0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:06:57.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.543+0000 7faeda482700 1 -- 172.21.15.82:0/1625537400 >> 172.21.15.82:0/1625537400 conn(0x7faed40d2b20 msgr2=0x7faed415efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:06:57.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.543+0000 7faeda482700 1 -- 172.21.15.82:0/1625537400 shutdown_connections 2023-11-28T13:06:57.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:06:57.543+0000 7faeda482700 1 -- 172.21.15.82:0/1625537400 wait complete. 2023-11-28T13:06:57.562 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:06:57.899 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:06:57.902 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:07:02.563 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:07:02.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.675+0000 7f220327b700 1 Processor -- start 2023-11-28T13:07:02.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.675+0000 7f220327b700 1 -- start start 2023-11-28T13:07:02.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f220327b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f21fc06d3d0 0x7f21fc06d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:02.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f220327b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21fc0ce010 0x7f21fc0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:02.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f220327b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21fc06dd60 con 0x7f21fc15c1c0 2023-11-28T13:07:02.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f220327b700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21fc0cd2e0 con 0x7f21fc06d3d0 2023-11-28T13:07:02.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f220327b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc0ca9c0 con 0x7f21fc0ce010 2023-11-28T13:07:02.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f2202279700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f21fc15c1c0 0x7f21fc0c9f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43268/0 (socket says 172.21.15.82:43268) 2023-11-28T13:07:02.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f2202279700 1 -- 172.21.15.82:0/2398731022 learned_addr learned my addr 172.21.15.82:0/2398731022 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:02.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f2201a78700 1 --2- 172.21.15.82:0/2398731022 >> v2:172.21.15.114:3300/0 conn(0x7f21fc06d3d0 0x7f21fc06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:02.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f2202a7a700 1 --2- 172.21.15.82:0/2398731022 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21fc0ce010 0x7f21fc0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:02.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f2201277700 1 -- 172.21.15.82:0/2398731022 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276344257 0 0) 0x7f21ec001110 con 0x7f21fc15c1c0 2023-11-28T13:07:02.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f2201277700 1 -- 172.21.15.82:0/2398731022 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21e40035d0 con 0x7f21fc15c1c0 2023-11-28T13:07:02.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f2201a78700 1 -- 172.21.15.82:0/2398731022 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21fc0ce010 msgr2=0x7f21fc0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:02.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f2201a78700 1 --2- 172.21.15.82:0/2398731022 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21fc0ce010 0x7f21fc0ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:02.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f2201a78700 1 -- 172.21.15.82:0/2398731022 >> v1:172.21.15.82:6789/0 conn(0x7f21fc15c1c0 legacy=0x7f21fc0c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:02.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f2201a78700 1 -- 172.21.15.82:0/2398731022 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc0cd530 con 0x7f21fc06d3d0 2023-11-28T13:07:02.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f2201a78700 1 --2- 172.21.15.82:0/2398731022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21fc06d3d0 0x7f21fc06d820 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009d90 tx=0x7f21f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a82a82555cfde541 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:02.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f2201277700 1 -- 172.21.15.82:0/2398731022 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f800e070 con 0x7f21fc06d3d0 2023-11-28T13:07:02.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f2201277700 1 -- 172.21.15.82:0/2398731022 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f800bb20 con 0x7f21fc06d3d0 2023-11-28T13:07:02.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f2201277700 1 -- 172.21.15.82:0/2398731022 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f8012430 con 0x7f21fc06d3d0 2023-11-28T13:07:02.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f220327b700 1 -- 172.21.15.82:0/2398731022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21fc06d3d0 msgr2=0x7f21fc06d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:02.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f220327b700 1 --2- 172.21.15.82:0/2398731022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21fc06d3d0 0x7f21fc06d820 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009d90 tx=0x7f21f800b330 comp rx=0 tx=0).stop 2023-11-28T13:07:02.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f220327b700 1 -- 172.21.15.82:0/2398731022 shutdown_connections 2023-11-28T13:07:02.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f220327b700 1 --2- 172.21.15.82:0/2398731022 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21fc0ce010 0x7f21fc0ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:02.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f220327b700 1 --2- 172.21.15.82:0/2398731022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21fc06d3d0 0x7f21fc06d820 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:02.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f220327b700 1 -- 172.21.15.82:0/2398731022 >> 172.21.15.82:0/2398731022 conn(0x7f21fc0cf710 msgr2=0x7f21fc0cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:02.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f220327b700 1 -- 172.21.15.82:0/2398731022 shutdown_connections 2023-11-28T13:07:02.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.679+0000 7f220327b700 1 -- 172.21.15.82:0/2398731022 wait complete. 2023-11-28T13:07:02.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f220327b700 1 Processor -- start 2023-11-28T13:07:02.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f220327b700 1 -- start start 2023-11-28T13:07:02.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f220327b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21fc06d3d0 0x7f21fc0adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:02.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f220327b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21fc0ce010 0x7f21fc14fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:02.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f220327b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21fc15c1c0 0x7f21fc150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:02.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f220327b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc0ac4a0 con 0x7f21fc15c1c0 2023-11-28T13:07:02.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f220327b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc14d430 con 0x7f21fc0ce010 2023-11-28T13:07:02.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f220327b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc0ab8b0 con 0x7f21fc06d3d0 2023-11-28T13:07:02.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f2202a7a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21fc15c1c0 0x7f21fc150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:02.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f2202a7a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21fc15c1c0 0x7f21fc150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55080/0 (socket says 172.21.15.82:55080) 2023-11-28T13:07:02.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f2202a7a700 1 -- 172.21.15.82:0/866405519 learned_addr learned my addr 172.21.15.82:0/866405519 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:02.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f2202279700 1 --2- 172.21.15.82:0/866405519 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21fc06d3d0 0x7f21fc0adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:02.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f2201a78700 1 --2- 172.21.15.82:0/866405519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21fc0ce010 0x7f21fc14fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:02.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f2202a7a700 1 -- 172.21.15.82:0/866405519 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21fc06d3d0 msgr2=0x7f21fc0adc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:02.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f2202a7a700 1 --2- 172.21.15.82:0/866405519 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21fc06d3d0 0x7f21fc0adc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:02.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f2202a7a700 1 -- 172.21.15.82:0/866405519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21fc0ce010 msgr2=0x7f21fc14fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:02.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f2202a7a700 1 --2- 172.21.15.82:0/866405519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21fc0ce010 0x7f21fc14fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:02.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f2202a7a700 1 -- 172.21.15.82:0/866405519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f8009a70 con 0x7f21fc15c1c0 2023-11-28T13:07:02.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f2202a7a700 1 --2- 172.21.15.82:0/866405519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21fc15c1c0 0x7f21fc150280 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f21f400e820 tx=0x7f21f400eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:02.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f21f2ffd700 1 -- 172.21.15.82:0/866405519 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f40095c0 con 0x7f21fc15c1c0 2023-11-28T13:07:02.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f220327b700 1 -- 172.21.15.82:0/866405519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21fc0cdaf0 con 0x7f21fc15c1c0 2023-11-28T13:07:02.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f21f2ffd700 1 -- 172.21.15.82:0/866405519 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f4013680 con 0x7f21fc15c1c0 2023-11-28T13:07:02.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f220327b700 1 -- 172.21.15.82:0/866405519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21fc0cd810 con 0x7f21fc15c1c0 2023-11-28T13:07:02.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f21f2ffd700 1 -- 172.21.15.82:0/866405519 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f4013a10 con 0x7f21fc15c1c0 2023-11-28T13:07:02.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.683+0000 7f220327b700 1 -- 172.21.15.82:0/866405519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21fc15c590 con 0x7f21fc15c1c0 2023-11-28T13:07:02.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.687+0000 7f21f2ffd700 1 -- 172.21.15.82:0/866405519 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f21f4019030 con 0x7f21fc15c1c0 2023-11-28T13:07:02.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.687+0000 7f21f2ffd700 1 --2- 172.21.15.82:0/866405519 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f21e8064ee0 0x7f21e8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:02.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.687+0000 7f21f2ffd700 1 -- 172.21.15.82:0/866405519 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f21f40823e0 con 0x7f21fc15c1c0 2023-11-28T13:07:02.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.687+0000 7f2202279700 1 --2- 172.21.15.82:0/866405519 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f21e8064ee0 0x7f21e8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:02.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.687+0000 7f2202279700 1 --2- 172.21.15.82:0/866405519 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f21e8064ee0 0x7f21e8067390 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f21ec007fd0 tx=0x7f21ec007c60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:02.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.691+0000 7f21f2ffd700 1 -- 172.21.15.82:0/866405519 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f21f4050500 con 0x7f21fc15c1c0 2023-11-28T13:07:02.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.883+0000 7f220327b700 1 -- 172.21.15.82:0/866405519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f21fc0ae180 con 0x7f21fc15c1c0 2023-11-28T13:07:02.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.883+0000 7f21f2ffd700 1 -- 172.21.15.82:0/866405519 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f21f4053b20 con 0x7f21fc15c1c0 2023-11-28T13:07:02.889 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:07:02.889 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:07:02.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.887+0000 7f220327b700 1 -- 172.21.15.82:0/866405519 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f21e8064ee0 msgr2=0x7f21e8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:02.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.887+0000 7f220327b700 1 --2- 172.21.15.82:0/866405519 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f21e8064ee0 0x7f21e8067390 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f21ec007fd0 tx=0x7f21ec007c60 comp rx=0 tx=0).stop 2023-11-28T13:07:02.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.887+0000 7f220327b700 1 -- 172.21.15.82:0/866405519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21fc15c1c0 msgr2=0x7f21fc150280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:02.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.887+0000 7f220327b700 1 --2- 172.21.15.82:0/866405519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21fc15c1c0 0x7f21fc150280 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f21f400e820 tx=0x7f21f400eb30 comp rx=0 tx=0).stop 2023-11-28T13:07:02.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.887+0000 7f220327b700 1 -- 172.21.15.82:0/866405519 shutdown_connections 2023-11-28T13:07:02.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.887+0000 7f220327b700 1 --2- 172.21.15.82:0/866405519 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f21e8064ee0 0x7f21e8067390 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:02.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.887+0000 7f220327b700 1 --2- 172.21.15.82:0/866405519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21fc15c1c0 0x7f21fc150280 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:02.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.887+0000 7f220327b700 1 --2- 172.21.15.82:0/866405519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21fc0ce010 0x7f21fc14fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:02.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.887+0000 7f220327b700 1 --2- 172.21.15.82:0/866405519 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21fc06d3d0 0x7f21fc0adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:02.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.887+0000 7f220327b700 1 -- 172.21.15.82:0/866405519 >> 172.21.15.82:0/866405519 conn(0x7f21fc0cf710 msgr2=0x7f21fc1568f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:02.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.887+0000 7f220327b700 1 -- 172.21.15.82:0/866405519 shutdown_connections 2023-11-28T13:07:02.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:02.887+0000 7f220327b700 1 -- 172.21.15.82:0/866405519 wait complete. 2023-11-28T13:07:02.904 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:07:07.904 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:07:08.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.019+0000 7f2310465700 1 Processor -- start 2023-11-28T13:07:08.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.019+0000 7f2310465700 1 -- start start 2023-11-28T13:07:08.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.019+0000 7f2310465700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f230806c600 0x7f230806ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:08.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.019+0000 7f2310465700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2308070c70 0x7f2308071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:08.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.019+0000 7f2310465700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23080715b0 con 0x7f2308158bc0 2023-11-28T13:07:08.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.019+0000 7f2310465700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230806ab20 con 0x7f230806c600 2023-11-28T13:07:08.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.019+0000 7f2310465700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23080c9460 con 0x7f2308070c70 2023-11-28T13:07:08.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.019+0000 7f230da00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f230806c600 0x7f230806ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:08.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.019+0000 7f230da00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f230806c600 0x7f230806ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47238/0 (socket says 172.21.15.82:47238) 2023-11-28T13:07:08.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.019+0000 7f230da00700 1 -- 172.21.15.82:0/545807476 learned_addr learned my addr 172.21.15.82:0/545807476 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:08.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.019+0000 7f230ea02700 1 --2- 172.21.15.82:0/545807476 >> v2:172.21.15.114:3300/0 conn(0x7f2308070c70 0x7f2308071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:08.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.019+0000 7f230da00700 1 -- 172.21.15.82:0/545807476 >> v2:172.21.15.114:3300/0 conn(0x7f2308070c70 msgr2=0x7f2308071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:08.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.019+0000 7f230da00700 1 --2- 172.21.15.82:0/545807476 >> v2:172.21.15.114:3300/0 conn(0x7f2308070c70 0x7f2308071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:08.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.019+0000 7f230da00700 1 -- 172.21.15.82:0/545807476 >> v1:172.21.15.114:6789/0 conn(0x7f2308158bc0 legacy=0x7f23080ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:08.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.019+0000 7f230da00700 1 -- 172.21.15.82:0/545807476 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23080c9740 con 0x7f230806c600 2023-11-28T13:07:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f230da00700 1 --2- 172.21.15.82:0/545807476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f230806c600 0x7f230806ca50 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f23080cc610 tx=0x7f2304009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9aeec8e0fdb866 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f230d1ff700 1 -- 172.21.15.82:0/545807476 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2304011830 con 0x7f230806c600 2023-11-28T13:07:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f230d1ff700 1 -- 172.21.15.82:0/545807476 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2304011990 con 0x7f230806c600 2023-11-28T13:07:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f230d1ff700 1 -- 172.21.15.82:0/545807476 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2304011d20 con 0x7f230806c600 2023-11-28T13:07:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f2310465700 1 -- 172.21.15.82:0/545807476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f230806c600 msgr2=0x7f230806ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f2310465700 1 --2- 172.21.15.82:0/545807476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f230806c600 0x7f230806ca50 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f23080cc610 tx=0x7f2304009bf0 comp rx=0 tx=0).stop 2023-11-28T13:07:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f2310465700 1 -- 172.21.15.82:0/545807476 shutdown_connections 2023-11-28T13:07:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f2310465700 1 --2- 172.21.15.82:0/545807476 >> v2:172.21.15.114:3300/0 conn(0x7f2308070c70 0x7f2308071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f2310465700 1 --2- 172.21.15.82:0/545807476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f230806c600 0x7f230806ca50 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f2310465700 1 -- 172.21.15.82:0/545807476 >> 172.21.15.82:0/545807476 conn(0x7f23080ce9b0 msgr2=0x7f23080ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f2310465700 1 -- 172.21.15.82:0/545807476 shutdown_connections 2023-11-28T13:07:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f2310465700 1 -- 172.21.15.82:0/545807476 wait complete. 2023-11-28T13:07:08.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f2310465700 1 Processor -- start 2023-11-28T13:07:08.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f2310465700 1 -- start start 2023-11-28T13:07:08.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f2310465700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f230806c600 0x7f23080b3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:08.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f2310465700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2308070c70 0x7f23081651a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:08.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f2310465700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2308157590 0x7f230815b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:08.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f2310465700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23080b3170 con 0x7f2308070c70 2023-11-28T13:07:08.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f2310465700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23080b2e90 con 0x7f2308157590 2023-11-28T13:07:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f2310465700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2308157f90 con 0x7f230806c600 2023-11-28T13:07:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f230da00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2308070c70 0x7f23081651a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f230da00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2308070c70 0x7f23081651a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47242/0 (socket says 172.21.15.82:47242) 2023-11-28T13:07:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f230da00700 1 -- 172.21.15.82:0/2059415275 learned_addr learned my addr 172.21.15.82:0/2059415275 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f230da00700 1 -- 172.21.15.82:0/2059415275 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f230806c600 msgr2=0x7f23080b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f230da00700 1 --2- 172.21.15.82:0/2059415275 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f230806c600 0x7f23080b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f230da00700 1 -- 172.21.15.82:0/2059415275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2308157590 msgr2=0x7f230815b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f230da00700 1 --2- 172.21.15.82:0/2059415275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2308157590 0x7f230815b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.023+0000 7f230da00700 1 -- 172.21.15.82:0/2059415275 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2304009570 con 0x7f2308070c70 2023-11-28T13:07:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.027+0000 7f230da00700 1 --2- 172.21.15.82:0/2059415275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2308070c70 0x7f23081651a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f230806e7f0 tx=0x7f2304004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.027+0000 7f22feffd700 1 -- 172.21.15.82:0/2059415275 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2304004480 con 0x7f2308070c70 2023-11-28T13:07:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.027+0000 7f22feffd700 1 -- 172.21.15.82:0/2059415275 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230401f070 con 0x7f2308070c70 2023-11-28T13:07:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.027+0000 7f2310465700 1 -- 172.21.15.82:0/2059415275 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23080c9d00 con 0x7f2308070c70 2023-11-28T13:07:08.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.027+0000 7f22feffd700 1 -- 172.21.15.82:0/2059415275 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23040038e0 con 0x7f2308070c70 2023-11-28T13:07:08.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.027+0000 7f2310465700 1 -- 172.21.15.82:0/2059415275 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23080c9a20 con 0x7f2308070c70 2023-11-28T13:07:08.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.027+0000 7f2310465700 1 -- 172.21.15.82:0/2059415275 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23080ca930 con 0x7f2308070c70 2023-11-28T13:07:08.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.027+0000 7f22feffd700 1 -- 172.21.15.82:0/2059415275 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f230402a020 con 0x7f2308070c70 2023-11-28T13:07:08.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.027+0000 7f22feffd700 1 --2- 172.21.15.82:0/2059415275 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f22ec064ee0 0x7f22ec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:08.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.027+0000 7f22feffd700 1 -- 172.21.15.82:0/2059415275 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f2304083670 con 0x7f2308070c70 2023-11-28T13:07:08.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.027+0000 7f230e201700 1 --2- 172.21.15.82:0/2059415275 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f22ec064ee0 0x7f22ec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:08.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.031+0000 7f230e201700 1 --2- 172.21.15.82:0/2059415275 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f22ec064ee0 0x7f22ec067390 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f22f8000f60 tx=0x7f22f8007a80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:08.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.035+0000 7f22feffd700 1 -- 172.21.15.82:0/2059415275 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f23040516a0 con 0x7f2308070c70 2023-11-28T13:07:08.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.235+0000 7f2310465700 1 -- 172.21.15.82:0/2059415275 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2308073e20 con 0x7f2308070c70 2023-11-28T13:07:08.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.235+0000 7f22feffd700 1 -- 172.21.15.82:0/2059415275 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f2304054cc0 con 0x7f2308070c70 2023-11-28T13:07:08.242 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:07:08.243 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:07:08.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.239+0000 7f2310465700 1 -- 172.21.15.82:0/2059415275 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f22ec064ee0 msgr2=0x7f22ec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:08.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.239+0000 7f2310465700 1 --2- 172.21.15.82:0/2059415275 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f22ec064ee0 0x7f22ec067390 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f22f8000f60 tx=0x7f22f8007a80 comp rx=0 tx=0).stop 2023-11-28T13:07:08.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.239+0000 7f2310465700 1 -- 172.21.15.82:0/2059415275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2308070c70 msgr2=0x7f23081651a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:08.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.239+0000 7f2310465700 1 --2- 172.21.15.82:0/2059415275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2308070c70 0x7f23081651a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f230806e7f0 tx=0x7f2304004770 comp rx=0 tx=0).stop 2023-11-28T13:07:08.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.239+0000 7f2310465700 1 -- 172.21.15.82:0/2059415275 shutdown_connections 2023-11-28T13:07:08.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.239+0000 7f2310465700 1 --2- 172.21.15.82:0/2059415275 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f22ec064ee0 0x7f22ec067390 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:08.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.239+0000 7f2310465700 1 --2- 172.21.15.82:0/2059415275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2308157590 0x7f230815b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:08.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.239+0000 7f2310465700 1 --2- 172.21.15.82:0/2059415275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2308070c70 0x7f23081651a0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:08.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.239+0000 7f2310465700 1 --2- 172.21.15.82:0/2059415275 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f230806c600 0x7f23080b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:08.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.239+0000 7f2310465700 1 -- 172.21.15.82:0/2059415275 >> 172.21.15.82:0/2059415275 conn(0x7f23080ce9b0 msgr2=0x7f23080ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:08.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.239+0000 7f2310465700 1 -- 172.21.15.82:0/2059415275 shutdown_connections 2023-11-28T13:07:08.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:08.239+0000 7f2310465700 1 -- 172.21.15.82:0/2059415275 wait complete. 2023-11-28T13:07:08.256 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:07:13.257 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:07:13.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.371+0000 7f42ae28e700 1 Processor -- start 2023-11-28T13:07:13.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.371+0000 7f42ae28e700 1 -- start start 2023-11-28T13:07:13.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ae28e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f42a8158df0 0x7f42a815d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:13.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ae28e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f42a81591c0 0x7f42a806c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:13.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ae28e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f42a8070070 0x7f42a80704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:13.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ae28e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a8070a30 con 0x7f42a8158df0 2023-11-28T13:07:13.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ae28e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a815da50 con 0x7f42a8070070 2023-11-28T13:07:13.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ae28e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a80c9e20 con 0x7f42a81591c0 2023-11-28T13:07:13.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ad28c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f42a8158df0 0x7f42a815d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:13.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ad28c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f42a8158df0 0x7f42a815d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47252/0 (socket says 172.21.15.82:47252) 2023-11-28T13:07:13.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ad28c700 1 -- 172.21.15.82:0/513829398 learned_addr learned my addr 172.21.15.82:0/513829398 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:13.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42aca8b700 1 --2- 172.21.15.82:0/513829398 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f42a81591c0 0x7f42a806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:13.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ada8d700 1 --2- 172.21.15.82:0/513829398 >> v2:172.21.15.114:3300/0 conn(0x7f42a8070070 0x7f42a80704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:13.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ad28c700 1 -- 172.21.15.82:0/513829398 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f42a81591c0 msgr2=0x7f42a806c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:13.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ad28c700 1 --2- 172.21.15.82:0/513829398 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f42a81591c0 0x7f42a806c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:13.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ad28c700 1 -- 172.21.15.82:0/513829398 >> v2:172.21.15.114:3300/0 conn(0x7f42a8070070 msgr2=0x7f42a80704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:13.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ad28c700 1 --2- 172.21.15.82:0/513829398 >> v2:172.21.15.114:3300/0 conn(0x7f42a8070070 0x7f42a80704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:13.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ad28c700 1 -- 172.21.15.82:0/513829398 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a806c5b0 con 0x7f42a8158df0 2023-11-28T13:07:13.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42aca8b700 1 --2- 172.21.15.82:0/513829398 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f42a81591c0 0x7f42a806c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:07:13.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ad28c700 1 --2- 172.21.15.82:0/513829398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a8158df0 0x7f42a815d510 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f42a806b6a0 tx=0x7f42a4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eac5a53f00d762c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:13.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f429ffff700 1 -- 172.21.15.82:0/513829398 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a4011830 con 0x7f42a8158df0 2023-11-28T13:07:13.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f429ffff700 1 -- 172.21.15.82:0/513829398 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a4011990 con 0x7f42a8158df0 2023-11-28T13:07:13.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f429ffff700 1 -- 172.21.15.82:0/513829398 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a4011d20 con 0x7f42a8158df0 2023-11-28T13:07:13.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ae28e700 1 -- 172.21.15.82:0/513829398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a8158df0 msgr2=0x7f42a815d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:13.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ae28e700 1 --2- 172.21.15.82:0/513829398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a8158df0 0x7f42a815d510 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f42a806b6a0 tx=0x7f42a4009bf0 comp rx=0 tx=0).stop 2023-11-28T13:07:13.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ae28e700 1 -- 172.21.15.82:0/513829398 shutdown_connections 2023-11-28T13:07:13.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ae28e700 1 --2- 172.21.15.82:0/513829398 >> v2:172.21.15.114:3300/0 conn(0x7f42a8070070 0x7f42a80704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:13.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ae28e700 1 --2- 172.21.15.82:0/513829398 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f42a81591c0 0x7f42a806c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:13.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ae28e700 1 --2- 172.21.15.82:0/513829398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a8158df0 0x7f42a815d510 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:13.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ae28e700 1 -- 172.21.15.82:0/513829398 >> 172.21.15.82:0/513829398 conn(0x7f42a80ce600 msgr2=0x7f42a80ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:13.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ae28e700 1 -- 172.21.15.82:0/513829398 shutdown_connections 2023-11-28T13:07:13.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.375+0000 7f42ae28e700 1 -- 172.21.15.82:0/513829398 wait complete. 2023-11-28T13:07:13.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f42ae28e700 1 Processor -- start 2023-11-28T13:07:13.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f42ae28e700 1 -- start start 2023-11-28T13:07:13.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f42ae28e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42a8070070 0x7f42a80c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:13.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f42ae28e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a8158df0 0x7f42a80c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:13.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f42ae28e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f42a81591c0 0x7f42a80c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:13.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f42ae28e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a80c56d0 con 0x7f42a8158df0 2023-11-28T13:07:13.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f42ae28e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a80c4790 con 0x7f42a8070070 2023-11-28T13:07:13.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f42ae28e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a80c4a70 con 0x7f42a81591c0 2023-11-28T13:07:13.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f42aca8b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a8158df0 0x7f42a80c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:13.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f42aca8b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a8158df0 0x7f42a80c3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47256/0 (socket says 172.21.15.82:47256) 2023-11-28T13:07:13.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f42aca8b700 1 -- 172.21.15.82:0/3306765567 learned_addr learned my addr 172.21.15.82:0/3306765567 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:13.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f42ad28c700 1 --2- 172.21.15.82:0/3306765567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42a8070070 0x7f42a80c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:13.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f42ada8d700 1 --2- 172.21.15.82:0/3306765567 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f42a81591c0 0x7f42a80c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:13.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f42aca8b700 1 -- 172.21.15.82:0/3306765567 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f42a81591c0 msgr2=0x7f42a80c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:13.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f42aca8b700 1 --2- 172.21.15.82:0/3306765567 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f42a81591c0 0x7f42a80c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:13.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f42aca8b700 1 -- 172.21.15.82:0/3306765567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42a8070070 msgr2=0x7f42a80c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:13.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f42aca8b700 1 --2- 172.21.15.82:0/3306765567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42a8070070 0x7f42a80c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:13.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f42aca8b700 1 -- 172.21.15.82:0/3306765567 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42980094b0 con 0x7f42a8158df0 2023-11-28T13:07:13.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f42aca8b700 1 --2- 172.21.15.82:0/3306765567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a8158df0 0x7f42a80c3ef0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f429800e9b0 tx=0x7f429800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:13.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f429dffb700 1 -- 172.21.15.82:0/3306765567 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429800ee50 con 0x7f42a8158df0 2023-11-28T13:07:13.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f429dffb700 1 -- 172.21.15.82:0/3306765567 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429800c850 con 0x7f42a8158df0 2023-11-28T13:07:13.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f42ae28e700 1 -- 172.21.15.82:0/3306765567 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a4009570 con 0x7f42a8158df0 2023-11-28T13:07:13.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f429dffb700 1 -- 172.21.15.82:0/3306765567 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429800cc00 con 0x7f42a8158df0 2023-11-28T13:07:13.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.379+0000 7f42ae28e700 1 -- 172.21.15.82:0/3306765567 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a80c97d0 con 0x7f42a8158df0 2023-11-28T13:07:13.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.383+0000 7f42ae28e700 1 -- 172.21.15.82:0/3306765567 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a80cc640 con 0x7f42a8158df0 2023-11-28T13:07:13.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.383+0000 7f429dffb700 1 -- 172.21.15.82:0/3306765567 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4298019030 con 0x7f42a8158df0 2023-11-28T13:07:13.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.383+0000 7f429dffb700 1 --2- 172.21.15.82:0/3306765567 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f428c064ee0 0x7f428c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:13.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.383+0000 7f429dffb700 1 -- 172.21.15.82:0/3306765567 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f4298081b20 con 0x7f42a8158df0 2023-11-28T13:07:13.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.383+0000 7f42ad28c700 1 --2- 172.21.15.82:0/3306765567 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f428c064ee0 0x7f428c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:13.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.383+0000 7f42ad28c700 1 --2- 172.21.15.82:0/3306765567 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f428c064ee0 0x7f428c067390 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f42a4000c00 tx=0x7f42a4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:13.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.391+0000 7f429dffb700 1 -- 172.21.15.82:0/3306765567 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f429804fb30 con 0x7f42a8158df0 2023-11-28T13:07:13.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.587+0000 7f42ae28e700 1 -- 172.21.15.82:0/3306765567 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f42a80c9ab0 con 0x7f42a8158df0 2023-11-28T13:07:13.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.591+0000 7f429dffb700 1 -- 172.21.15.82:0/3306765567 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f4298021080 con 0x7f42a8158df0 2023-11-28T13:07:13.596 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:07:13.596 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:07:13.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.591+0000 7f42ae28e700 1 -- 172.21.15.82:0/3306765567 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f428c064ee0 msgr2=0x7f428c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:13.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.591+0000 7f42ae28e700 1 --2- 172.21.15.82:0/3306765567 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f428c064ee0 0x7f428c067390 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f42a4000c00 tx=0x7f42a4008030 comp rx=0 tx=0).stop 2023-11-28T13:07:13.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.591+0000 7f42ae28e700 1 -- 172.21.15.82:0/3306765567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a8158df0 msgr2=0x7f42a80c3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:13.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.591+0000 7f42ae28e700 1 --2- 172.21.15.82:0/3306765567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a8158df0 0x7f42a80c3ef0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f429800e9b0 tx=0x7f429800ecc0 comp rx=0 tx=0).stop 2023-11-28T13:07:13.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.591+0000 7f42ae28e700 1 -- 172.21.15.82:0/3306765567 shutdown_connections 2023-11-28T13:07:13.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.591+0000 7f42ae28e700 1 --2- 172.21.15.82:0/3306765567 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f428c064ee0 0x7f428c067390 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:13.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.591+0000 7f42ae28e700 1 --2- 172.21.15.82:0/3306765567 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f42a81591c0 0x7f42a80c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:13.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.595+0000 7f42ae28e700 1 --2- 172.21.15.82:0/3306765567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a8158df0 0x7f42a80c3ef0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:13.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.595+0000 7f42ae28e700 1 --2- 172.21.15.82:0/3306765567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42a8070070 0x7f42a80c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:13.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.595+0000 7f42ae28e700 1 -- 172.21.15.82:0/3306765567 >> 172.21.15.82:0/3306765567 conn(0x7f42a80ce600 msgr2=0x7f42a80ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:13.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.595+0000 7f42ae28e700 1 -- 172.21.15.82:0/3306765567 shutdown_connections 2023-11-28T13:07:13.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:13.595+0000 7f42ae28e700 1 -- 172.21.15.82:0/3306765567 wait complete. 2023-11-28T13:07:13.615 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:07:18.616 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:07:18.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5bfff700 1 Processor -- start 2023-11-28T13:07:18.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5bfff700 1 -- start start 2023-11-28T13:07:18.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5bfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b5c06b910 0x7f2b5c160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:18.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5bfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2b5c0ced70 0x7f2b5c06bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:18.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2b5c069bc0 0x7f2b5c069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:18.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5bfff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5c0cdfe0 con 0x7f2b5c069bc0 2023-11-28T13:07:18.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5bfff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5c0d28e0 con 0x7f2b5c0ced70 2023-11-28T13:07:18.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5bfff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c160cc0 con 0x7f2b5c06b910 2023-11-28T13:07:18.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2b5c069bc0 0x7f2b5c069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:18.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5b7fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2b5c069bc0 0x7f2b5c069fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57210/0 (socket says 172.21.15.82:57210) 2023-11-28T13:07:18.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5b7fe700 1 -- 172.21.15.82:0/3353520813 learned_addr learned my addr 172.21.15.82:0/3353520813 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:18.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5affd700 1 --2- 172.21.15.82:0/3353520813 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b5c06b910 0x7f2b5c160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:18.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b53fff700 1 --2- 172.21.15.82:0/3353520813 >> v2:172.21.15.114:3300/0 conn(0x7f2b5c0ced70 0x7f2b5c06bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:18.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5b7fe700 1 -- 172.21.15.82:0/3353520813 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b5c06b910 msgr2=0x7f2b5c160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:18.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5b7fe700 1 --2- 172.21.15.82:0/3353520813 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b5c06b910 0x7f2b5c160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:18.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5b7fe700 1 -- 172.21.15.82:0/3353520813 >> v2:172.21.15.114:3300/0 conn(0x7f2b5c0ced70 msgr2=0x7f2b5c06bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:18.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5b7fe700 1 --2- 172.21.15.82:0/3353520813 >> v2:172.21.15.114:3300/0 conn(0x7f2b5c0ced70 0x7f2b5c06bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:18.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5b7fe700 1 -- 172.21.15.82:0/3353520813 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c06c220 con 0x7f2b5c069bc0 2023-11-28T13:07:18.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b53fff700 1 --2- 172.21.15.82:0/3353520813 >> v2:172.21.15.114:3300/0 conn(0x7f2b5c0ced70 0x7f2b5c06bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:07:18.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5b7fe700 1 --2- 172.21.15.82:0/3353520813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b5c069bc0 0x7f2b5c069fe0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c08b8a0 tx=0x7f2b5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6227e47acb2aeb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:18.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5a7fc700 1 -- 172.21.15.82:0/3353520813 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5400e070 con 0x7f2b5c069bc0 2023-11-28T13:07:18.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5a7fc700 1 -- 172.21.15.82:0/3353520813 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5400b9c0 con 0x7f2b5c069bc0 2023-11-28T13:07:18.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5a7fc700 1 -- 172.21.15.82:0/3353520813 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5400bd70 con 0x7f2b5c069bc0 2023-11-28T13:07:18.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5bfff700 1 -- 172.21.15.82:0/3353520813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b5c069bc0 msgr2=0x7f2b5c069fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:18.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5bfff700 1 --2- 172.21.15.82:0/3353520813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b5c069bc0 0x7f2b5c069fe0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c08b8a0 tx=0x7f2b5400b330 comp rx=0 tx=0).stop 2023-11-28T13:07:18.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5bfff700 1 -- 172.21.15.82:0/3353520813 shutdown_connections 2023-11-28T13:07:18.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5bfff700 1 --2- 172.21.15.82:0/3353520813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b5c069bc0 0x7f2b5c069fe0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:18.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5bfff700 1 --2- 172.21.15.82:0/3353520813 >> v2:172.21.15.114:3300/0 conn(0x7f2b5c0ced70 0x7f2b5c06bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:18.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5bfff700 1 --2- 172.21.15.82:0/3353520813 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b5c06b910 0x7f2b5c160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:18.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5bfff700 1 -- 172.21.15.82:0/3353520813 >> 172.21.15.82:0/3353520813 conn(0x7f2b5c0d2b20 msgr2=0x7f2b5c0d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:18.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5bfff700 1 -- 172.21.15.82:0/3353520813 shutdown_connections 2023-11-28T13:07:18.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.731+0000 7f2b5bfff700 1 -- 172.21.15.82:0/3353520813 wait complete. 2023-11-28T13:07:18.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b5bfff700 1 Processor -- start 2023-11-28T13:07:18.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b5bfff700 1 -- start start 2023-11-28T13:07:18.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b5bfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b5c069bc0 0x7f2b5c1f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:18.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b5bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b5c06b910 0x7f2b5c14cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:18.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b5bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b5c0ced70 0x7f2b5c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:18.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b5bfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c0c9bf0 con 0x7f2b5c0ced70 2023-11-28T13:07:18.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b5bfff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c0c9e90 con 0x7f2b5c06b910 2023-11-28T13:07:18.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b5bfff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c0ca170 con 0x7f2b5c069bc0 2023-11-28T13:07:18.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b5b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b5c0ced70 0x7f2b5c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:18.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b5b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b5c0ced70 0x7f2b5c0d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57218/0 (socket says 172.21.15.82:57218) 2023-11-28T13:07:18.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b5b7fe700 1 -- 172.21.15.82:0/751130078 learned_addr learned my addr 172.21.15.82:0/751130078 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:18.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b5affd700 1 --2- 172.21.15.82:0/751130078 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b5c069bc0 0x7f2b5c1f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:18.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b53fff700 1 --2- 172.21.15.82:0/751130078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b5c06b910 0x7f2b5c14cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:18.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b5b7fe700 1 -- 172.21.15.82:0/751130078 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b5c069bc0 msgr2=0x7f2b5c1f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:18.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b5b7fe700 1 --2- 172.21.15.82:0/751130078 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b5c069bc0 0x7f2b5c1f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:18.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b5b7fe700 1 -- 172.21.15.82:0/751130078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b5c06b910 msgr2=0x7f2b5c14cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:18.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b5b7fe700 1 --2- 172.21.15.82:0/751130078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b5c06b910 0x7f2b5c14cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:18.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b5b7fe700 1 -- 172.21.15.82:0/751130078 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b54009b30 con 0x7f2b5c0ced70 2023-11-28T13:07:18.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b5b7fe700 1 --2- 172.21.15.82:0/751130078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b5c0ced70 0x7f2b5c0d0c50 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c08aa00 tx=0x7f2b54004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:18.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b58ff9700 1 -- 172.21.15.82:0/751130078 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b540099b0 con 0x7f2b5c0ced70 2023-11-28T13:07:18.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b58ff9700 1 -- 172.21.15.82:0/751130078 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b54004250 con 0x7f2b5c0ced70 2023-11-28T13:07:18.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b5bfff700 1 -- 172.21.15.82:0/751130078 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5c0cf2c0 con 0x7f2b5c0ced70 2023-11-28T13:07:18.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b58ff9700 1 -- 172.21.15.82:0/751130078 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b54004600 con 0x7f2b5c0ced70 2023-11-28T13:07:18.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.735+0000 7f2b5bfff700 1 -- 172.21.15.82:0/751130078 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5c0b2040 con 0x7f2b5c0ced70 2023-11-28T13:07:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.739+0000 7f2b5bfff700 1 -- 172.21.15.82:0/751130078 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b5c0d2320 con 0x7f2b5c0ced70 2023-11-28T13:07:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.739+0000 7f2b58ff9700 1 -- 172.21.15.82:0/751130078 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2b5402b070 con 0x7f2b5c0ced70 2023-11-28T13:07:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.739+0000 7f2b58ff9700 1 --2- 172.21.15.82:0/751130078 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2b3c064f10 0x7f2b3c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.739+0000 7f2b58ff9700 1 -- 172.21.15.82:0/751130078 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f2b54082fc0 con 0x7f2b5c0ced70 2023-11-28T13:07:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.739+0000 7f2b5affd700 1 --2- 172.21.15.82:0/751130078 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2b3c064f10 0x7f2b3c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.739+0000 7f2b5affd700 1 --2- 172.21.15.82:0/751130078 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2b3c064f10 0x7f2b3c0673c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0045f0 tx=0x7f2b4c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:18.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.747+0000 7f2b58ff9700 1 -- 172.21.15.82:0/751130078 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2b54050f70 con 0x7f2b5c0ced70 2023-11-28T13:07:18.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.955+0000 7f2b5bfff700 1 -- 172.21.15.82:0/751130078 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2b5c065fc0 con 0x7f2b5c0ced70 2023-11-28T13:07:18.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.955+0000 7f2b58ff9700 1 -- 172.21.15.82:0/751130078 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f2b540290c0 con 0x7f2b5c0ced70 2023-11-28T13:07:18.960 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:07:18.960 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:07:18.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.959+0000 7f2b5bfff700 1 -- 172.21.15.82:0/751130078 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2b3c064f10 msgr2=0x7f2b3c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:18.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.959+0000 7f2b5bfff700 1 --2- 172.21.15.82:0/751130078 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2b3c064f10 0x7f2b3c0673c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0045f0 tx=0x7f2b4c008040 comp rx=0 tx=0).stop 2023-11-28T13:07:18.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.959+0000 7f2b5bfff700 1 -- 172.21.15.82:0/751130078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b5c0ced70 msgr2=0x7f2b5c0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:18.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.959+0000 7f2b5bfff700 1 --2- 172.21.15.82:0/751130078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b5c0ced70 0x7f2b5c0d0c50 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c08aa00 tx=0x7f2b54004af0 comp rx=0 tx=0).stop 2023-11-28T13:07:18.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.959+0000 7f2b5bfff700 1 -- 172.21.15.82:0/751130078 shutdown_connections 2023-11-28T13:07:18.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.959+0000 7f2b5bfff700 1 --2- 172.21.15.82:0/751130078 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2b3c064f10 0x7f2b3c0673c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:18.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.959+0000 7f2b5bfff700 1 --2- 172.21.15.82:0/751130078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b5c0ced70 0x7f2b5c0d0c50 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:18.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.959+0000 7f2b5bfff700 1 --2- 172.21.15.82:0/751130078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b5c06b910 0x7f2b5c14cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:18.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.959+0000 7f2b5bfff700 1 --2- 172.21.15.82:0/751130078 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b5c069bc0 0x7f2b5c1f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:18.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.959+0000 7f2b5bfff700 1 -- 172.21.15.82:0/751130078 >> 172.21.15.82:0/751130078 conn(0x7f2b5c0d2b20 msgr2=0x7f2b5c069f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:18.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.959+0000 7f2b5bfff700 1 -- 172.21.15.82:0/751130078 shutdown_connections 2023-11-28T13:07:18.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:18.959+0000 7f2b5bfff700 1 -- 172.21.15.82:0/751130078 wait complete. 2023-11-28T13:07:18.980 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:07:23.981 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:07:24.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.099+0000 7f7ba1cb3700 1 Processor -- start 2023-11-28T13:07:24.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.099+0000 7f7ba1cb3700 1 -- start start 2023-11-28T13:07:24.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7ba1cb3700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9c1586a0 0x7f7b9c06a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:24.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7ba1cb3700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7b9c0cb250 0x7f7b9c15c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:24.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7ba1cb3700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7b9c15ce20 0x7f7b9c0c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:24.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7ba1cb3700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9c15c450 con 0x7f7b9c0cb250 2023-11-28T13:07:24.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7ba1cb3700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9c06aae0 con 0x7f7b9c15ce20 2023-11-28T13:07:24.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7ba1cb3700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c06adc0 con 0x7f7b9c1586a0 2023-11-28T13:07:24.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7b9bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7b9c0cb250 0x7f7b9c15c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:24.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7b9bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7b9c0cb250 0x7f7b9c15c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57224/0 (socket says 172.21.15.82:57224) 2023-11-28T13:07:24.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7b9bfff700 1 -- 172.21.15.82:0/3755773268 learned_addr learned my addr 172.21.15.82:0/3755773268 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:24.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7ba14b2700 1 --2- 172.21.15.82:0/3755773268 >> v2:172.21.15.114:3300/0 conn(0x7f7b9c15ce20 0x7f7b9c0c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:24.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7ba0cb1700 1 --2- 172.21.15.82:0/3755773268 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9c1586a0 0x7f7b9c06a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:24.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7b9bfff700 1 -- 172.21.15.82:0/3755773268 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9c1586a0 msgr2=0x7f7b9c06a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:24.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7b9bfff700 1 --2- 172.21.15.82:0/3755773268 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9c1586a0 0x7f7b9c06a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:24.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7b9bfff700 1 -- 172.21.15.82:0/3755773268 >> v2:172.21.15.114:3300/0 conn(0x7f7b9c15ce20 msgr2=0x7f7b9c0c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:24.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7b9bfff700 1 --2- 172.21.15.82:0/3755773268 >> v2:172.21.15.114:3300/0 conn(0x7f7b9c15ce20 0x7f7b9c0c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:24.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7b9bfff700 1 -- 172.21.15.82:0/3755773268 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c06b0a0 con 0x7f7b9c0cb250 2023-11-28T13:07:24.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7b9bfff700 1 --2- 172.21.15.82:0/3755773268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9c0cb250 0x7f7b9c15c8e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c06e890 tx=0x7f7b8800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f49e70dfc9aae72 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:24.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7b9b7fe700 1 -- 172.21.15.82:0/3755773268 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8800dbf0 con 0x7f7b9c0cb250 2023-11-28T13:07:24.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7b9b7fe700 1 -- 172.21.15.82:0/3755773268 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8800dd50 con 0x7f7b9c0cb250 2023-11-28T13:07:24.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7b9b7fe700 1 -- 172.21.15.82:0/3755773268 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88004250 con 0x7f7b9c0cb250 2023-11-28T13:07:24.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7ba1cb3700 1 -- 172.21.15.82:0/3755773268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9c0cb250 msgr2=0x7f7b9c15c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:24.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7ba1cb3700 1 --2- 172.21.15.82:0/3755773268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9c0cb250 0x7f7b9c15c8e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c06e890 tx=0x7f7b8800bea0 comp rx=0 tx=0).stop 2023-11-28T13:07:24.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7ba1cb3700 1 -- 172.21.15.82:0/3755773268 shutdown_connections 2023-11-28T13:07:24.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7ba1cb3700 1 --2- 172.21.15.82:0/3755773268 >> v2:172.21.15.114:3300/0 conn(0x7f7b9c15ce20 0x7f7b9c0c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:24.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7ba1cb3700 1 --2- 172.21.15.82:0/3755773268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9c0cb250 0x7f7b9c15c8e0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:24.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7ba1cb3700 1 --2- 172.21.15.82:0/3755773268 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9c1586a0 0x7f7b9c06a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:24.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7ba1cb3700 1 -- 172.21.15.82:0/3755773268 >> 172.21.15.82:0/3755773268 conn(0x7f7b9c0cee50 msgr2=0x7f7b9c0cf220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:24.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7ba1cb3700 1 -- 172.21.15.82:0/3755773268 shutdown_connections 2023-11-28T13:07:24.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.103+0000 7f7ba1cb3700 1 -- 172.21.15.82:0/3755773268 wait complete. 2023-11-28T13:07:24.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.107+0000 7f7ba1cb3700 1 Processor -- start 2023-11-28T13:07:24.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.107+0000 7f7ba1cb3700 1 -- start start 2023-11-28T13:07:24.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.107+0000 7f7ba1cb3700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9c0cb250 0x7f7b9c158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:24.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.107+0000 7f7ba1cb3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9c1586a0 0x7f7b9c14d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.107+0000 7f7ba1cb3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b9c15ce20 0x7f7b9c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.107+0000 7f7ba1cb3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c15b210 con 0x7f7b9c1586a0 2023-11-28T13:07:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.107+0000 7f7ba1cb3700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c1591e0 con 0x7f7b9c15ce20 2023-11-28T13:07:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.107+0000 7f7ba1cb3700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c15abc0 con 0x7f7b9c0cb250 2023-11-28T13:07:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.107+0000 7f7b9bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9c1586a0 0x7f7b9c14d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.107+0000 7f7ba0cb1700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9c0cb250 0x7f7b9c158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.107+0000 7f7b9bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9c1586a0 0x7f7b9c14d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57240/0 (socket says 172.21.15.82:57240) 2023-11-28T13:07:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.107+0000 7f7b9bfff700 1 -- 172.21.15.82:0/2654744185 learned_addr learned my addr 172.21.15.82:0/2654744185 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.107+0000 7f7ba14b2700 1 --2- 172.21.15.82:0/2654744185 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b9c15ce20 0x7f7b9c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:24.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.107+0000 7f7b9bfff700 1 -- 172.21.15.82:0/2654744185 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9c0cb250 msgr2=0x7f7b9c158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.107+0000 7f7b9bfff700 1 --2- 172.21.15.82:0/2654744185 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9c0cb250 0x7f7b9c158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.107+0000 7f7b9bfff700 1 -- 172.21.15.82:0/2654744185 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b9c15ce20 msgr2=0x7f7b9c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.111+0000 7f7b9bfff700 1 --2- 172.21.15.82:0/2654744185 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b9c15ce20 0x7f7b9c15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.111+0000 7f7b9bfff700 1 -- 172.21.15.82:0/2654744185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8800b820 con 0x7f7b9c1586a0 2023-11-28T13:07:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.111+0000 7f7ba0cb1700 1 --2- 172.21.15.82:0/2654744185 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9c0cb250 0x7f7b9c158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:07:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.111+0000 7f7ba14b2700 1 --2- 172.21.15.82:0/2654744185 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b9c15ce20 0x7f7b9c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:07:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.111+0000 7f7b9bfff700 1 --2- 172.21.15.82:0/2654744185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9c1586a0 0x7f7b9c14d250 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f7b88019040 tx=0x7f7b88004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.111+0000 7f7b997fa700 1 -- 172.21.15.82:0/2654744185 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b880038d0 con 0x7f7b9c1586a0 2023-11-28T13:07:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.111+0000 7f7b997fa700 1 -- 172.21.15.82:0/2654744185 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b88003a70 con 0x7f7b9c1586a0 2023-11-28T13:07:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.111+0000 7f7ba1cb3700 1 -- 172.21.15.82:0/2654744185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9c06ca90 con 0x7f7b9c1586a0 2023-11-28T13:07:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.111+0000 7f7b997fa700 1 -- 172.21.15.82:0/2654744185 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88003e20 con 0x7f7b9c1586a0 2023-11-28T13:07:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.111+0000 7f7ba1cb3700 1 -- 172.21.15.82:0/2654744185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9c158a70 con 0x7f7b9c1586a0 2023-11-28T13:07:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.111+0000 7f7ba1cb3700 1 -- 172.21.15.82:0/2654744185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9c0c99e0 con 0x7f7b9c1586a0 2023-11-28T13:07:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.111+0000 7f7b997fa700 1 -- 172.21.15.82:0/2654744185 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7b88021450 con 0x7f7b9c1586a0 2023-11-28T13:07:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.115+0000 7f7b997fa700 1 --2- 172.21.15.82:0/2654744185 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b80064ee0 0x7f7b80067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.115+0000 7f7b997fa700 1 -- 172.21.15.82:0/2654744185 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f7b88086090 con 0x7f7b9c1586a0 2023-11-28T13:07:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.115+0000 7f7ba0cb1700 1 --2- 172.21.15.82:0/2654744185 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b80064ee0 0x7f7b80067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.115+0000 7f7ba0cb1700 1 --2- 172.21.15.82:0/2654744185 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b80064ee0 0x7f7b80067390 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c1f09f0 tx=0x7f7b90009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:24.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.119+0000 7f7b997fa700 1 -- 172.21.15.82:0/2654744185 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7b88054150 con 0x7f7b9c1586a0 2023-11-28T13:07:24.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.323+0000 7f7ba1cb3700 1 -- 172.21.15.82:0/2654744185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7b9c061850 con 0x7f7b9c1586a0 2023-11-28T13:07:24.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.323+0000 7f7b997fa700 1 -- 172.21.15.82:0/2654744185 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f7b88057770 con 0x7f7b9c1586a0 2023-11-28T13:07:24.331 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:07:24.332 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:07:24.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.327+0000 7f7ba1cb3700 1 -- 172.21.15.82:0/2654744185 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b80064ee0 msgr2=0x7f7b80067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:24.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.327+0000 7f7ba1cb3700 1 --2- 172.21.15.82:0/2654744185 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b80064ee0 0x7f7b80067390 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c1f09f0 tx=0x7f7b90009240 comp rx=0 tx=0).stop 2023-11-28T13:07:24.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.327+0000 7f7ba1cb3700 1 -- 172.21.15.82:0/2654744185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9c1586a0 msgr2=0x7f7b9c14d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:24.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.327+0000 7f7ba1cb3700 1 --2- 172.21.15.82:0/2654744185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9c1586a0 0x7f7b9c14d250 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f7b88019040 tx=0x7f7b88004770 comp rx=0 tx=0).stop 2023-11-28T13:07:24.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.327+0000 7f7ba1cb3700 1 -- 172.21.15.82:0/2654744185 shutdown_connections 2023-11-28T13:07:24.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.327+0000 7f7ba1cb3700 1 --2- 172.21.15.82:0/2654744185 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7b80064ee0 0x7f7b80067390 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:24.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.327+0000 7f7ba1cb3700 1 --2- 172.21.15.82:0/2654744185 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b9c15ce20 0x7f7b9c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:24.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.327+0000 7f7ba1cb3700 1 --2- 172.21.15.82:0/2654744185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b9c1586a0 0x7f7b9c14d250 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:24.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.327+0000 7f7ba1cb3700 1 --2- 172.21.15.82:0/2654744185 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b9c0cb250 0x7f7b9c158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:24.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.327+0000 7f7ba1cb3700 1 -- 172.21.15.82:0/2654744185 >> 172.21.15.82:0/2654744185 conn(0x7f7b9c0cee50 msgr2=0x7f7b9c06d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:24.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.327+0000 7f7ba1cb3700 1 -- 172.21.15.82:0/2654744185 shutdown_connections 2023-11-28T13:07:24.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:24.327+0000 7f7ba1cb3700 1 -- 172.21.15.82:0/2654744185 wait complete. 2023-11-28T13:07:24.351 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:07:27.955 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:07:27.958 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:07:29.353 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:07:29.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.467+0000 7efe77fff700 1 Processor -- start 2023-11-28T13:07:29.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.467+0000 7efe77fff700 1 -- start start 2023-11-28T13:07:29.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe77fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efe7815c2d0 0x7efe7806d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:29.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe77fff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe7806c3b0 con 0x7efe781586f0 2023-11-28T13:07:29.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe77fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe7815c8b0 con 0x7efe78070900 2023-11-28T13:07:29.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe77fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7815cb90 con 0x7efe7815c2d0 2023-11-28T13:07:29.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe76ffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efe781586f0 0x7efe780c8c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36990/0 (socket says 172.21.15.82:36990) 2023-11-28T13:07:29.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe76ffd700 1 -- 172.21.15.82:0/2278213932 learned_addr learned my addr 172.21.15.82:0/2278213932 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:29.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe767fc700 1 --2- 172.21.15.82:0/2278213932 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efe7815c2d0 0x7efe7806d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:29.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe75ffb700 1 -- 172.21.15.82:0/2278213932 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096017226 0 0) 0x7efe7806c3b0 con 0x7efe781586f0 2023-11-28T13:07:29.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe75ffb700 1 -- 172.21.15.82:0/2278213932 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe600034f0 con 0x7efe781586f0 2023-11-28T13:07:29.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe75ffb700 1 -- 172.21.15.82:0/2278213932 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3634838769 0 0) 0x7efe7815c8b0 con 0x7efe78070900 2023-11-28T13:07:29.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe75ffb700 1 -- 172.21.15.82:0/2278213932 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe7806c3b0 con 0x7efe78070900 2023-11-28T13:07:29.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe75ffb700 1 -- 172.21.15.82:0/2278213932 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3520395667 0 0) 0x7efe600034f0 con 0x7efe781586f0 2023-11-28T13:07:29.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe75ffb700 1 -- 172.21.15.82:0/2278213932 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efe7815c2d0 msgr2=0x7efe7806d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:29.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe75ffb700 1 --2- 172.21.15.82:0/2278213932 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efe7815c2d0 0x7efe7806d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe75ffb700 1 -- 172.21.15.82:0/2278213932 >> v1:172.21.15.114:6789/0 conn(0x7efe78070900 legacy=0x7efe7806c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe75ffb700 1 -- 172.21.15.82:0/2278213932 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7815ce70 con 0x7efe781586f0 2023-11-28T13:07:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe75ffb700 1 -- 172.21.15.82:0/2278213932 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7efe6c001670 con 0x7efe781586f0 2023-11-28T13:07:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe75ffb700 1 -- 172.21.15.82:0/2278213932 >> v1:172.21.15.82:6789/0 conn(0x7efe781586f0 legacy=0x7efe780c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe75ffb700 1 --2- 172.21.15.82:0/2278213932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe60003cd0 0x7efe600040c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe75ffb700 1 --2- 172.21.15.82:0/2278213932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe60008a30 0x7efe6000aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe75ffb700 1 --2- 172.21.15.82:0/2278213932 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efe7815c2d0 0x7efe6000d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe75ffb700 1 -- 172.21.15.82:0/2278213932 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7815cb90 con 0x7efe60008a30 2023-11-28T13:07:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe75ffb700 1 -- 172.21.15.82:0/2278213932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6000dcd0 con 0x7efe60003cd0 2023-11-28T13:07:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe75ffb700 1 -- 172.21.15.82:0/2278213932 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6000de90 con 0x7efe7815c2d0 2023-11-28T13:07:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe767fc700 1 --2- 172.21.15.82:0/2278213932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe60008a30 0x7efe6000aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:29.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe777fe700 1 --2- 172.21.15.82:0/2278213932 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efe7815c2d0 0x7efe6000d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe76ffd700 1 --2- 172.21.15.82:0/2278213932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe60003cd0 0x7efe600040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe777fe700 1 -- 172.21.15.82:0/2278213932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe60003cd0 msgr2=0x7efe600040c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe777fe700 1 --2- 172.21.15.82:0/2278213932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe60003cd0 0x7efe600040c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe777fe700 1 -- 172.21.15.82:0/2278213932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe60008a30 msgr2=0x7efe6000aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe777fe700 1 --2- 172.21.15.82:0/2278213932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe60008a30 0x7efe6000aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe777fe700 1 -- 172.21.15.82:0/2278213932 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe600034f0 con 0x7efe7815c2d0 2023-11-28T13:07:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe777fe700 1 --2- 172.21.15.82:0/2278213932 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efe7815c2d0 0x7efe6000d590 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efe70001960 tx=0x7efe600037a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8815ac486d994bf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe75ffb700 1 -- 172.21.15.82:0/2278213932 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70001450 con 0x7efe7815c2d0 2023-11-28T13:07:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe75ffb700 1 -- 172.21.15.82:0/2278213932 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe700052f0 con 0x7efe7815c2d0 2023-11-28T13:07:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.471+0000 7efe75ffb700 1 -- 172.21.15.82:0/2278213932 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe700036a0 con 0x7efe7815c2d0 2023-11-28T13:07:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.475+0000 7efe77fff700 1 -- 172.21.15.82:0/2278213932 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efe7815c2d0 msgr2=0x7efe6000d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.475+0000 7efe77fff700 1 --2- 172.21.15.82:0/2278213932 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efe7815c2d0 0x7efe6000d590 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efe70001960 tx=0x7efe600037a0 comp rx=0 tx=0).stop 2023-11-28T13:07:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.475+0000 7efe777fe700 1 -- 172.21.15.82:0/2278213932 reap_dead start 2023-11-28T13:07:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.475+0000 7efe77fff700 1 -- 172.21.15.82:0/2278213932 shutdown_connections 2023-11-28T13:07:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.475+0000 7efe77fff700 1 -- 172.21.15.82:0/2278213932 >> 172.21.15.82:0/2278213932 conn(0x7efe780ce600 msgr2=0x7efe780ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.475+0000 7efe77fff700 1 -- 172.21.15.82:0/2278213932 shutdown_connections 2023-11-28T13:07:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.475+0000 7efe77fff700 1 -- 172.21.15.82:0/2278213932 wait complete. 2023-11-28T13:07:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe77fff700 1 Processor -- start 2023-11-28T13:07:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe77fff700 1 -- start start 2023-11-28T13:07:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe77fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe78153660 0x7efe78153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe77fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efe781f3200 0x7efe7814fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe77fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe78150110 0x7efe781f2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe77fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe780b1f60 con 0x7efe78153660 2023-11-28T13:07:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe76ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe78153660 0x7efe78153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe76ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe78153660 0x7efe78153a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32946/0 (socket says 172.21.15.82:32946) 2023-11-28T13:07:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe76ffd700 1 -- 172.21.15.82:0/1303228110 learned_addr learned my addr 172.21.15.82:0/1303228110 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe77fff700 1 -- 172.21.15.82:0/1303228110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe78150620 con 0x7efe78150110 2023-11-28T13:07:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe77fff700 1 -- 172.21.15.82:0/1303228110 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe780b2220 con 0x7efe781f3200 2023-11-28T13:07:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe767fc700 1 --2- 172.21.15.82:0/1303228110 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efe781f3200 0x7efe7814fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe777fe700 1 --2- 172.21.15.82:0/1303228110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe78150110 0x7efe781f2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe76ffd700 1 -- 172.21.15.82:0/1303228110 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efe781f3200 msgr2=0x7efe7814fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe76ffd700 1 --2- 172.21.15.82:0/1303228110 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efe781f3200 0x7efe7814fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe76ffd700 1 -- 172.21.15.82:0/1303228110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe78150110 msgr2=0x7efe781f2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe76ffd700 1 --2- 172.21.15.82:0/1303228110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe78150110 0x7efe781f2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe76ffd700 1 -- 172.21.15.82:0/1303228110 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe78158ac0 con 0x7efe78153660 2023-11-28T13:07:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe777fe700 1 --2- 172.21.15.82:0/1303228110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe78150110 0x7efe781f2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:07:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe767fc700 1 --2- 172.21.15.82:0/1303228110 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efe781f3200 0x7efe7814fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:07:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe76ffd700 1 --2- 172.21.15.82:0/1303228110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe78153660 0x7efe78153a30 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0048f0 tx=0x7efe6c007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe5f7fe700 1 -- 172.21.15.82:0/1303228110 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c007800 con 0x7efe78153660 2023-11-28T13:07:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe5f7fe700 1 -- 172.21.15.82:0/1303228110 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c00f8d0 con 0x7efe78153660 2023-11-28T13:07:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.479+0000 7efe77fff700 1 -- 172.21.15.82:0/1303228110 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe7815d150 con 0x7efe78153660 2023-11-28T13:07:29.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.483+0000 7efe5f7fe700 1 -- 172.21.15.82:0/1303228110 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c00fc60 con 0x7efe78153660 2023-11-28T13:07:29.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.483+0000 7efe77fff700 1 -- 172.21.15.82:0/1303228110 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7806cf50 con 0x7efe78153660 2023-11-28T13:07:29.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.483+0000 7efe5f7fe700 1 -- 172.21.15.82:0/1303228110 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efe6c01d460 con 0x7efe78153660 2023-11-28T13:07:29.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.483+0000 7efe77fff700 1 -- 172.21.15.82:0/1303228110 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe78065fc0 con 0x7efe78153660 2023-11-28T13:07:29.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.483+0000 7efe5f7fe700 1 --2- 172.21.15.82:0/1303228110 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efe64064ee0 0x7efe64067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:29.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.483+0000 7efe767fc700 1 --2- 172.21.15.82:0/1303228110 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efe64064ee0 0x7efe64067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:29.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.483+0000 7efe5f7fe700 1 -- 172.21.15.82:0/1303228110 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7efe6c0820b0 con 0x7efe78153660 2023-11-28T13:07:29.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.483+0000 7efe767fc700 1 --2- 172.21.15.82:0/1303228110 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efe64064ee0 0x7efe64067390 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efe780af720 tx=0x7efe6800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:29.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.491+0000 7efe5f7fe700 1 -- 172.21.15.82:0/1303228110 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efe6c050170 con 0x7efe78153660 2023-11-28T13:07:29.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.679+0000 7efe77fff700 1 -- 172.21.15.82:0/1303228110 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7efe7806b2e0 con 0x7efe78153660 2023-11-28T13:07:29.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.683+0000 7efe5f7fe700 1 -- 172.21.15.82:0/1303228110 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7efe6c053790 con 0x7efe78153660 2023-11-28T13:07:29.687 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:07:29.688 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:07:29.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.683+0000 7efe77fff700 1 -- 172.21.15.82:0/1303228110 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efe64064ee0 msgr2=0x7efe64067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:29.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.683+0000 7efe77fff700 1 --2- 172.21.15.82:0/1303228110 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efe64064ee0 0x7efe64067390 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efe780af720 tx=0x7efe6800b040 comp rx=0 tx=0).stop 2023-11-28T13:07:29.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.683+0000 7efe77fff700 1 -- 172.21.15.82:0/1303228110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe78153660 msgr2=0x7efe78153a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:29.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.683+0000 7efe77fff700 1 --2- 172.21.15.82:0/1303228110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe78153660 0x7efe78153a30 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0048f0 tx=0x7efe6c007620 comp rx=0 tx=0).stop 2023-11-28T13:07:29.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.683+0000 7efe77fff700 1 -- 172.21.15.82:0/1303228110 shutdown_connections 2023-11-28T13:07:29.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.683+0000 7efe77fff700 1 --2- 172.21.15.82:0/1303228110 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7efe64064ee0 0x7efe64067390 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:29.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.683+0000 7efe77fff700 1 --2- 172.21.15.82:0/1303228110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe78150110 0x7efe781f2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:29.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.683+0000 7efe77fff700 1 --2- 172.21.15.82:0/1303228110 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efe781f3200 0x7efe7814fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:29.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.683+0000 7efe77fff700 1 --2- 172.21.15.82:0/1303228110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe78153660 0x7efe78153a30 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:29.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.683+0000 7efe77fff700 1 -- 172.21.15.82:0/1303228110 >> 172.21.15.82:0/1303228110 conn(0x7efe780ce600 msgr2=0x7efe78157a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:29.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.683+0000 7efe77fff700 1 -- 172.21.15.82:0/1303228110 shutdown_connections 2023-11-28T13:07:29.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:29.683+0000 7efe77fff700 1 -- 172.21.15.82:0/1303228110 wait complete. 2023-11-28T13:07:29.702 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:07:34.703 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:07:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f505ca31700 1 Processor -- start 2023-11-28T13:07:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f505ca31700 1 -- start start 2023-11-28T13:07:34.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f505ca31700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f505806dae0 0x7f505806b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:34.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f505ca31700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50580ae940 0x7f505806baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:34.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f505ca31700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f505815d5b0 con 0x7f5058158ed0 2023-11-28T13:07:34.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f505ca31700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50580aee90 con 0x7f505806dae0 2023-11-28T13:07:34.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f505ca31700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505815da40 con 0x7f50580ae940 2023-11-28T13:07:34.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f5057fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50580ae940 0x7f505806baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:34.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f5056ffd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f505806dae0 0x7f505806b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:34.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f5057fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50580ae940 0x7f505806baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:46960/0 (socket says 172.21.15.82:46960) 2023-11-28T13:07:34.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f5057fff700 1 -- 172.21.15.82:0/950889229 learned_addr learned my addr 172.21.15.82:0/950889229 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:34.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f50577fe700 1 --1- 172.21.15.82:0/950889229 >> v1:172.21.15.114:6789/0 conn(0x7f5058158ed0 0x7f505806d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:49698/0 (socket says 172.21.15.82:49698) 2023-11-28T13:07:34.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f5057fff700 1 -- 172.21.15.82:0/950889229 >> v2:172.21.15.114:3300/0 conn(0x7f505806dae0 msgr2=0x7f505806b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:34.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f5057fff700 1 --2- 172.21.15.82:0/950889229 >> v2:172.21.15.114:3300/0 conn(0x7f505806dae0 0x7f505806b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:34.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f5057fff700 1 -- 172.21.15.82:0/950889229 >> v1:172.21.15.114:6789/0 conn(0x7f5058158ed0 legacy=0x7f505806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:34.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f5057fff700 1 -- 172.21.15.82:0/950889229 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505815cc80 con 0x7f50580ae940 2023-11-28T13:07:34.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f5056ffd700 1 --2- 172.21.15.82:0/950889229 >> v2:172.21.15.114:3300/0 conn(0x7f505806dae0 0x7f505806b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:07:34.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f5057fff700 1 --2- 172.21.15.82:0/950889229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50580ae940 0x7f505806baa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5050009e50 tx=0x7f505000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff023616d8553f5c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:34.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f50567fc700 1 -- 172.21.15.82:0/950889229 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505000e070 con 0x7f50580ae940 2023-11-28T13:07:34.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f50567fc700 1 -- 172.21.15.82:0/950889229 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505000b910 con 0x7f50580ae940 2023-11-28T13:07:34.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f50567fc700 1 -- 172.21.15.82:0/950889229 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505000bcc0 con 0x7f50580ae940 2023-11-28T13:07:34.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f505ca31700 1 -- 172.21.15.82:0/950889229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50580ae940 msgr2=0x7f505806baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:34.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f505ca31700 1 --2- 172.21.15.82:0/950889229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50580ae940 0x7f505806baa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5050009e50 tx=0x7f505000b330 comp rx=0 tx=0).stop 2023-11-28T13:07:34.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f505ca31700 1 -- 172.21.15.82:0/950889229 shutdown_connections 2023-11-28T13:07:34.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f505ca31700 1 --2- 172.21.15.82:0/950889229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50580ae940 0x7f505806baa0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:34.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f505ca31700 1 --2- 172.21.15.82:0/950889229 >> v2:172.21.15.114:3300/0 conn(0x7f505806dae0 0x7f505806b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:34.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f505ca31700 1 -- 172.21.15.82:0/950889229 >> 172.21.15.82:0/950889229 conn(0x7f50580cf710 msgr2=0x7f50580cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:34.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f505ca31700 1 -- 172.21.15.82:0/950889229 shutdown_connections 2023-11-28T13:07:34.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.818+0000 7f505ca31700 1 -- 172.21.15.82:0/950889229 wait complete. 2023-11-28T13:07:34.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f505ca31700 1 Processor -- start 2023-11-28T13:07:34.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f505ca31700 1 -- start start 2023-11-28T13:07:34.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f505ca31700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f505806dae0 0x7f50581513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:34.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f505ca31700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50580ae940 0x7f5058154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:34.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f505ca31700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5058158ed0 0x7f505806bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:34.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f505ca31700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50580abf40 con 0x7f505806dae0 2023-11-28T13:07:34.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f505ca31700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50581578f0 con 0x7f5058158ed0 2023-11-28T13:07:34.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f505ca31700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5058157050 con 0x7f50580ae940 2023-11-28T13:07:34.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f50577fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f505806dae0 0x7f50581513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:34.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f50577fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f505806dae0 0x7f50581513c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32954/0 (socket says 172.21.15.82:32954) 2023-11-28T13:07:34.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f50577fe700 1 -- 172.21.15.82:0/966118177 learned_addr learned my addr 172.21.15.82:0/966118177 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:34.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f5057fff700 1 --2- 172.21.15.82:0/966118177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5058158ed0 0x7f505806bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:34.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f5056ffd700 1 --2- 172.21.15.82:0/966118177 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50580ae940 0x7f5058154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:34.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f50577fe700 1 -- 172.21.15.82:0/966118177 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50580ae940 msgr2=0x7f5058154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:34.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f50577fe700 1 --2- 172.21.15.82:0/966118177 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50580ae940 0x7f5058154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:34.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f50577fe700 1 -- 172.21.15.82:0/966118177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5058158ed0 msgr2=0x7f505806bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:34.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f50577fe700 1 --2- 172.21.15.82:0/966118177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5058158ed0 0x7f505806bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:34.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f50577fe700 1 -- 172.21.15.82:0/966118177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504000b750 con 0x7f505806dae0 2023-11-28T13:07:34.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f50577fe700 1 --2- 172.21.15.82:0/966118177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f505806dae0 0x7f50581513c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f504800c4d0 tx=0x7f504800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:34.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f504ffff700 1 -- 172.21.15.82:0/966118177 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5048005cd0 con 0x7f505806dae0 2023-11-28T13:07:34.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f504ffff700 1 -- 172.21.15.82:0/966118177 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5048005e30 con 0x7f505806dae0 2023-11-28T13:07:34.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f505ca31700 1 -- 172.21.15.82:0/966118177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5050009b30 con 0x7f505806dae0 2023-11-28T13:07:34.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f504ffff700 1 -- 172.21.15.82:0/966118177 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50480072d0 con 0x7f505806dae0 2023-11-28T13:07:34.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.822+0000 7f505ca31700 1 -- 172.21.15.82:0/966118177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f505815d240 con 0x7f505806dae0 2023-11-28T13:07:34.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.826+0000 7f505ca31700 1 -- 172.21.15.82:0/966118177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f505815cf60 con 0x7f505806dae0 2023-11-28T13:07:34.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.826+0000 7f504ffff700 1 -- 172.21.15.82:0/966118177 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5048019030 con 0x7f505806dae0 2023-11-28T13:07:34.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.826+0000 7f504ffff700 1 --2- 172.21.15.82:0/966118177 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f503c064ee0 0x7f503c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:34.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.826+0000 7f504ffff700 1 -- 172.21.15.82:0/966118177 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f5048080f30 con 0x7f505806dae0 2023-11-28T13:07:34.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.826+0000 7f5056ffd700 1 --2- 172.21.15.82:0/966118177 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f503c064ee0 0x7f503c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:34.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.826+0000 7f5056ffd700 1 --2- 172.21.15.82:0/966118177 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f503c064ee0 0x7f503c067390 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5058152110 tx=0x7f504000b450 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:34.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:34.834+0000 7f504ffff700 1 -- 172.21.15.82:0/966118177 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f504804a400 con 0x7f505806dae0 2023-11-28T13:07:35.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:35.026+0000 7f505ca31700 1 -- 172.21.15.82:0/966118177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f50581592a0 con 0x7f505806dae0 2023-11-28T13:07:35.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:35.026+0000 7f504ffff700 1 -- 172.21.15.82:0/966118177 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f50480170c0 con 0x7f505806dae0 2023-11-28T13:07:35.033 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:07:35.033 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:07:35.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:35.026+0000 7f505ca31700 1 -- 172.21.15.82:0/966118177 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f503c064ee0 msgr2=0x7f503c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:35.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:35.026+0000 7f505ca31700 1 --2- 172.21.15.82:0/966118177 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f503c064ee0 0x7f503c067390 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5058152110 tx=0x7f504000b450 comp rx=0 tx=0).stop 2023-11-28T13:07:35.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:35.026+0000 7f505ca31700 1 -- 172.21.15.82:0/966118177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f505806dae0 msgr2=0x7f50581513c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:35.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:35.026+0000 7f505ca31700 1 --2- 172.21.15.82:0/966118177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f505806dae0 0x7f50581513c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f504800c4d0 tx=0x7f504800c7e0 comp rx=0 tx=0).stop 2023-11-28T13:07:35.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:35.026+0000 7f505ca31700 1 -- 172.21.15.82:0/966118177 shutdown_connections 2023-11-28T13:07:35.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:35.026+0000 7f505ca31700 1 --2- 172.21.15.82:0/966118177 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f503c064ee0 0x7f503c067390 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:35.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:35.026+0000 7f505ca31700 1 --2- 172.21.15.82:0/966118177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5058158ed0 0x7f505806bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:35.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:35.026+0000 7f505ca31700 1 --2- 172.21.15.82:0/966118177 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50580ae940 0x7f5058154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:35.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:35.026+0000 7f505ca31700 1 --2- 172.21.15.82:0/966118177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f505806dae0 0x7f50581513c0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:35.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:35.030+0000 7f505ca31700 1 -- 172.21.15.82:0/966118177 >> 172.21.15.82:0/966118177 conn(0x7f50580cf710 msgr2=0x7f5058070fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:35.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:35.030+0000 7f505ca31700 1 -- 172.21.15.82:0/966118177 shutdown_connections 2023-11-28T13:07:35.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:35.030+0000 7f505ca31700 1 -- 172.21.15.82:0/966118177 wait complete. 2023-11-28T13:07:35.047 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=200 retry_count=0)... 2023-11-28T13:07:40.048 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T13:07:40.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.158+0000 7fa0e7fff700 1 Processor -- start 2023-11-28T13:07:40.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.158+0000 7fa0e7fff700 1 -- start start 2023-11-28T13:07:40.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.158+0000 7fa0e7fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e815c880 0x7fa0e80cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:40.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.158+0000 7fa0e7fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa0e80cc710 0x7fa0e806ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:40.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.158+0000 7fa0e7fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e8070850 con 0x7fa0e8158200 2023-11-28T13:07:40.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.158+0000 7fa0e7fff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e815ccd0 con 0x7fa0e80cc710 2023-11-28T13:07:40.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.158+0000 7fa0e7fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e80ccb90 con 0x7fa0e815c880 2023-11-28T13:07:40.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.158+0000 7fa0e67fc700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e815c880 0x7fa0e80cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:40.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.158+0000 7fa0e77fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa0e80cc710 0x7fa0e806ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:40.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.158+0000 7fa0e67fc700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e815c880 0x7fa0e80cc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:49918/0 (socket says 172.21.15.82:49918) 2023-11-28T13:07:40.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.158+0000 7fa0e67fc700 1 -- 172.21.15.82:0/2202375523 learned_addr learned my addr 172.21.15.82:0/2202375523 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:40.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.158+0000 7fa0e67fc700 1 -- 172.21.15.82:0/2202375523 >> v2:172.21.15.114:3300/0 conn(0x7fa0e80cc710 msgr2=0x7fa0e806ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:40.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.158+0000 7fa0e67fc700 1 --2- 172.21.15.82:0/2202375523 >> v2:172.21.15.114:3300/0 conn(0x7fa0e80cc710 0x7fa0e806ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.158+0000 7fa0e67fc700 1 -- 172.21.15.82:0/2202375523 >> v1:172.21.15.114:6789/0 conn(0x7fa0e8158200 legacy=0x7fa0e8070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:40.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.158+0000 7fa0e67fc700 1 -- 172.21.15.82:0/2202375523 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e806c210 con 0x7fa0e815c880 2023-11-28T13:07:40.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.162+0000 7fa0e67fc700 1 --2- 172.21.15.82:0/2202375523 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e815c880 0x7fa0e80cc1d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009e50 tx=0x7fa0d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=509590add446358e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:40.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.162+0000 7fa0e5ffb700 1 -- 172.21.15.82:0/2202375523 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d800bb10 con 0x7fa0e815c880 2023-11-28T13:07:40.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.162+0000 7fa0e5ffb700 1 -- 172.21.15.82:0/2202375523 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d800bc70 con 0x7fa0e815c880 2023-11-28T13:07:40.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.162+0000 7fa0e5ffb700 1 -- 172.21.15.82:0/2202375523 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8011460 con 0x7fa0e815c880 2023-11-28T13:07:40.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.162+0000 7fa0e7fff700 1 -- 172.21.15.82:0/2202375523 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e815c880 msgr2=0x7fa0e80cc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:40.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.162+0000 7fa0e7fff700 1 --2- 172.21.15.82:0/2202375523 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e815c880 0x7fa0e80cc1d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009e50 tx=0x7fa0d800b330 comp rx=0 tx=0).stop 2023-11-28T13:07:40.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.162+0000 7fa0e7fff700 1 -- 172.21.15.82:0/2202375523 shutdown_connections 2023-11-28T13:07:40.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.162+0000 7fa0e7fff700 1 --2- 172.21.15.82:0/2202375523 >> v2:172.21.15.114:3300/0 conn(0x7fa0e80cc710 0x7fa0e806ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.162+0000 7fa0e7fff700 1 --2- 172.21.15.82:0/2202375523 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e815c880 0x7fa0e80cc1d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.162+0000 7fa0e7fff700 1 -- 172.21.15.82:0/2202375523 >> 172.21.15.82:0/2202375523 conn(0x7fa0e80ce600 msgr2=0x7fa0e80ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:40.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.162+0000 7fa0e7fff700 1 -- 172.21.15.82:0/2202375523 shutdown_connections 2023-11-28T13:07:40.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.162+0000 7fa0e7fff700 1 -- 172.21.15.82:0/2202375523 wait complete. 2023-11-28T13:07:40.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.162+0000 7fa0e7fff700 1 Processor -- start 2023-11-28T13:07:40.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.162+0000 7fa0e7fff700 1 -- start start 2023-11-28T13:07:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0e7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e80cc710 0x7fa0e80c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0e7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0e8158200 0x7fa0e80c2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0e7fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e815c880 0x7fa0e8152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0e7fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e81f5440 con 0x7fa0e8158200 2023-11-28T13:07:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0e7fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e81f5720 con 0x7fa0e80cc710 2023-11-28T13:07:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0e7fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e81f5a00 con 0x7fa0e815c880 2023-11-28T13:07:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0e67fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0e8158200 0x7fa0e80c2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0e67fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0e8158200 0x7fa0e80c2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46506/0 (socket says 172.21.15.82:46506) 2023-11-28T13:07:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0e67fc700 1 -- 172.21.15.82:0/155467731 learned_addr learned my addr 172.21.15.82:0/155467731 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0e77fe700 1 --2- 172.21.15.82:0/155467731 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e815c880 0x7fa0e8152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0e6ffd700 1 --2- 172.21.15.82:0/155467731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e80cc710 0x7fa0e80c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0e67fc700 1 -- 172.21.15.82:0/155467731 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e815c880 msgr2=0x7fa0e8152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0e67fc700 1 --2- 172.21.15.82:0/155467731 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e815c880 0x7fa0e8152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0e67fc700 1 -- 172.21.15.82:0/155467731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e80cc710 msgr2=0x7fa0e80c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0e67fc700 1 --2- 172.21.15.82:0/155467731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e80cc710 0x7fa0e80c4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0e67fc700 1 -- 172.21.15.82:0/155467731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d8009b30 con 0x7fa0e8158200 2023-11-28T13:07:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0e67fc700 1 --2- 172.21.15.82:0/155467731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0e8158200 0x7fa0e80c2d00 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fa0d800b370 tx=0x7fa0d8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:40.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0cffff700 1 -- 172.21.15.82:0/155467731 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8011a20 con 0x7fa0e8158200 2023-11-28T13:07:40.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0cffff700 1 -- 172.21.15.82:0/155467731 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d8011ba0 con 0x7fa0e8158200 2023-11-28T13:07:40.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0e7fff700 1 -- 172.21.15.82:0/155467731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e806c7d0 con 0x7fa0e8158200 2023-11-28T13:07:40.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0cffff700 1 -- 172.21.15.82:0/155467731 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d80099b0 con 0x7fa0e8158200 2023-11-28T13:07:40.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0e7fff700 1 -- 172.21.15.82:0/155467731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e806c4f0 con 0x7fa0e8158200 2023-11-28T13:07:40.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0e7fff700 1 -- 172.21.15.82:0/155467731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e81585d0 con 0x7fa0e8158200 2023-11-28T13:07:40.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.166+0000 7fa0cffff700 1 -- 172.21.15.82:0/155467731 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa0d8029030 con 0x7fa0e8158200 2023-11-28T13:07:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.170+0000 7fa0cffff700 1 --2- 172.21.15.82:0/155467731 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa0d4064f10 0x7fa0d40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.170+0000 7fa0e6ffd700 1 --2- 172.21.15.82:0/155467731 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa0d4064f10 0x7fa0d40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.170+0000 7fa0cffff700 1 -- 172.21.15.82:0/155467731 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7fa0d80835f0 con 0x7fa0e8158200 2023-11-28T13:07:40.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.170+0000 7fa0e6ffd700 1 --2- 172.21.15.82:0/155467731 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa0d4064f10 0x7fa0d40673c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc001640 tx=0x7fa0dc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:40.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.178+0000 7fa0cffff700 1 -- 172.21.15.82:0/155467731 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa0d8051710 con 0x7fa0e8158200 2023-11-28T13:07:40.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.374+0000 7fa0e7fff700 1 -- 172.21.15.82:0/155467731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa0e8065fc0 con 0x7fa0e8158200 2023-11-28T13:07:40.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.374+0000 7fa0cffff700 1 -- 172.21.15.82:0/155467731 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fa0d80150c0 con 0x7fa0e8158200 2023-11-28T13:07:40.383 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:07:40.383 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T13:07:40.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.378+0000 7fa0e7fff700 1 -- 172.21.15.82:0/155467731 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa0d4064f10 msgr2=0x7fa0d40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:40.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.378+0000 7fa0e7fff700 1 --2- 172.21.15.82:0/155467731 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa0d4064f10 0x7fa0d40673c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc001640 tx=0x7fa0dc009040 comp rx=0 tx=0).stop 2023-11-28T13:07:40.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.378+0000 7fa0e7fff700 1 -- 172.21.15.82:0/155467731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0e8158200 msgr2=0x7fa0e80c2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:40.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.378+0000 7fa0e7fff700 1 --2- 172.21.15.82:0/155467731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0e8158200 0x7fa0e80c2d00 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fa0d800b370 tx=0x7fa0d8004af0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.378+0000 7fa0e7fff700 1 -- 172.21.15.82:0/155467731 shutdown_connections 2023-11-28T13:07:40.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.378+0000 7fa0e7fff700 1 --2- 172.21.15.82:0/155467731 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa0d4064f10 0x7fa0d40673c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.378+0000 7fa0e7fff700 1 --2- 172.21.15.82:0/155467731 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e815c880 0x7fa0e8152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.378+0000 7fa0e7fff700 1 --2- 172.21.15.82:0/155467731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0e8158200 0x7fa0e80c2d00 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.378+0000 7fa0e7fff700 1 --2- 172.21.15.82:0/155467731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e80cc710 0x7fa0e80c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.378+0000 7fa0e7fff700 1 -- 172.21.15.82:0/155467731 >> 172.21.15.82:0/155467731 conn(0x7fa0e80ce600 msgr2=0x7fa0e8155090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:40.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.378+0000 7fa0e7fff700 1 -- 172.21.15.82:0/155467731 shutdown_connections 2023-11-28T13:07:40.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.378+0000 7fa0e7fff700 1 -- 172.21.15.82:0/155467731 wait complete. 2023-11-28T13:07:40.401 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T13:07:40.401 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T13:07:40.417 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T13:07:40.439 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T13:07:40.439 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:07:40.439 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:07:40.446 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:07:40.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.598+0000 7f5532aae700 1 Processor -- start 2023-11-28T13:07:40.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.598+0000 7f5532aae700 1 -- start start 2023-11-28T13:07:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.598+0000 7f5532aae700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f552c1586f0 0x7f552c15c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.598+0000 7f5532aae700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f552c070900 0x7f552c070d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.598+0000 7f5532aae700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552c06c3b0 con 0x7f552c0c8c50 2023-11-28T13:07:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.598+0000 7f5532aae700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552c071280 con 0x7f552c070900 2023-11-28T13:07:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.598+0000 7f5532aae700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552c15c8b0 con 0x7f552c1586f0 2023-11-28T13:07:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.598+0000 7f55322ad700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f552c070900 0x7f552c070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.598+0000 7f55322ad700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f552c070900 0x7f552c070d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46520/0 (socket says 172.21.15.82:46520) 2023-11-28T13:07:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.598+0000 7f55322ad700 1 -- 172.21.15.82:0/2111855129 learned_addr learned my addr 172.21.15.82:0/2111855129 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.598+0000 7f5531aac700 1 --2- 172.21.15.82:0/2111855129 >> v2:172.21.15.114:3300/0 conn(0x7f552c1586f0 0x7f552c15c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.602+0000 7f55322ad700 1 -- 172.21.15.82:0/2111855129 >> v2:172.21.15.114:3300/0 conn(0x7f552c1586f0 msgr2=0x7f552c15c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.602+0000 7f55322ad700 1 --2- 172.21.15.82:0/2111855129 >> v2:172.21.15.114:3300/0 conn(0x7f552c1586f0 0x7f552c15c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.602+0000 7f55322ad700 1 -- 172.21.15.82:0/2111855129 >> v1:172.21.15.114:6789/0 conn(0x7f552c0c8c50 legacy=0x7f552c06d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:40.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.602+0000 7f55322ad700 1 -- 172.21.15.82:0/2111855129 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c15cb90 con 0x7f552c070900 2023-11-28T13:07:40.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.602+0000 7f55322ad700 1 --2- 172.21.15.82:0/2111855129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f552c070900 0x7f552c070d40 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f552c0c5680 tx=0x7f552400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238496601d473f7b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:40.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.602+0000 7f5530aaa700 1 -- 172.21.15.82:0/2111855129 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552400e070 con 0x7f552c070900 2023-11-28T13:07:40.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.602+0000 7f5530aaa700 1 -- 172.21.15.82:0/2111855129 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552400b9c0 con 0x7f552c070900 2023-11-28T13:07:40.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.602+0000 7f5530aaa700 1 -- 172.21.15.82:0/2111855129 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552400bd70 con 0x7f552c070900 2023-11-28T13:07:40.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.602+0000 7f5532aae700 1 -- 172.21.15.82:0/2111855129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f552c070900 msgr2=0x7f552c070d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:40.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.602+0000 7f5532aae700 1 --2- 172.21.15.82:0/2111855129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f552c070900 0x7f552c070d40 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f552c0c5680 tx=0x7f552400b330 comp rx=0 tx=0).stop 2023-11-28T13:07:40.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.602+0000 7f5532aae700 1 -- 172.21.15.82:0/2111855129 shutdown_connections 2023-11-28T13:07:40.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.602+0000 7f5532aae700 1 --2- 172.21.15.82:0/2111855129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f552c070900 0x7f552c070d40 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.602+0000 7f5532aae700 1 --2- 172.21.15.82:0/2111855129 >> v2:172.21.15.114:3300/0 conn(0x7f552c1586f0 0x7f552c15c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.602+0000 7f5532aae700 1 -- 172.21.15.82:0/2111855129 >> 172.21.15.82:0/2111855129 conn(0x7f552c0ce600 msgr2=0x7f552c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:40.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.602+0000 7f5532aae700 1 -- 172.21.15.82:0/2111855129 shutdown_connections 2023-11-28T13:07:40.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.602+0000 7f5532aae700 1 -- 172.21.15.82:0/2111855129 wait complete. 2023-11-28T13:07:40.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.602+0000 7f5532aae700 1 Processor -- start 2023-11-28T13:07:40.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.602+0000 7f5532aae700 1 -- start start 2023-11-28T13:07:40.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f5532aae700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f552c070900 0x7f552c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:40.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f5532aae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f552c0c8c50 0x7f552c14e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:40.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f5532aae700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f552c1586f0 0x7f552c14e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:40.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f5532aae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c14ec10 con 0x7f552c0c8c50 2023-11-28T13:07:40.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f5532aae700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c0c8140 con 0x7f552c070900 2023-11-28T13:07:40.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f5532aae700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552c1517a0 con 0x7f552c1586f0 2023-11-28T13:07:40.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f55312ab700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f552c0c8c50 0x7f552c14e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:40.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f55312ab700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f552c0c8c50 0x7f552c14e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46534/0 (socket says 172.21.15.82:46534) 2023-11-28T13:07:40.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f55312ab700 1 -- 172.21.15.82:0/3958238922 learned_addr learned my addr 172.21.15.82:0/3958238922 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:40.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f5531aac700 1 --2- 172.21.15.82:0/3958238922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f552c070900 0x7f552c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:40.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f55322ad700 1 --2- 172.21.15.82:0/3958238922 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f552c1586f0 0x7f552c14e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:40.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f55312ab700 1 -- 172.21.15.82:0/3958238922 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f552c1586f0 msgr2=0x7f552c14e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:40.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f55312ab700 1 --2- 172.21.15.82:0/3958238922 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f552c1586f0 0x7f552c14e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f55312ab700 1 -- 172.21.15.82:0/3958238922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f552c070900 msgr2=0x7f552c06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:40.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f55312ab700 1 --2- 172.21.15.82:0/3958238922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f552c070900 0x7f552c06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f55312ab700 1 -- 172.21.15.82:0/3958238922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5524009b30 con 0x7f552c0c8c50 2023-11-28T13:07:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f5531aac700 1 --2- 172.21.15.82:0/3958238922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f552c070900 0x7f552c06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:07:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f55312ab700 1 --2- 172.21.15.82:0/3958238922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f552c0c8c50 0x7f552c14e190 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f552800c500 tx=0x7f552800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f55227fc700 1 -- 172.21.15.82:0/3958238922 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55280052d0 con 0x7f552c0c8c50 2023-11-28T13:07:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f55227fc700 1 -- 172.21.15.82:0/3958238922 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5528005430 con 0x7f552c0c8c50 2023-11-28T13:07:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f55227fc700 1 -- 172.21.15.82:0/3958238922 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55280055a0 con 0x7f552c0c8c50 2023-11-28T13:07:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f5532aae700 1 -- 172.21.15.82:0/3958238922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552c15d150 con 0x7f552c0c8c50 2023-11-28T13:07:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.606+0000 7f5532aae700 1 -- 172.21.15.82:0/3958238922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552c15ce70 con 0x7f552c0c8c50 2023-11-28T13:07:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.610+0000 7f5532aae700 1 -- 172.21.15.82:0/3958238922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552c0c90f0 con 0x7f552c0c8c50 2023-11-28T13:07:40.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.610+0000 7f55227fc700 1 -- 172.21.15.82:0/3958238922 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5528019030 con 0x7f552c0c8c50 2023-11-28T13:07:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.610+0000 7f55227fc700 1 --2- 172.21.15.82:0/3958238922 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5510064ee0 0x7f5510067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.610+0000 7f5531aac700 1 --2- 172.21.15.82:0/3958238922 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5510064ee0 0x7f5510067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.610+0000 7f55227fc700 1 -- 172.21.15.82:0/3958238922 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f5528081180 con 0x7f552c0c8c50 2023-11-28T13:07:40.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.610+0000 7f5531aac700 1 --2- 172.21.15.82:0/3958238922 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5510064ee0 0x7f5510067390 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f552c0c4d30 tx=0x7f551c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:40.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.618+0000 7f55227fc700 1 -- 172.21.15.82:0/3958238922 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f552804f2a0 con 0x7f552c0c8c50 2023-11-28T13:07:40.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.782+0000 7f5532aae700 1 -- 172.21.15.82:0/3958238922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f552c065fc0 con 0x7f552c0c8c50 2023-11-28T13:07:40.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.786+0000 7f55227fc700 1 -- 172.21.15.82:0/3958238922 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+18032 (secure 0 0 0) 0x7f55280528c0 con 0x7f552c0c8c50 2023-11-28T13:07:40.792 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:07:40.792 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":67,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:04:10.914507+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:03:21.126074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T13:03:21.545268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.d","mappings":[{"from":7,"to":2}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.c","mappings":[{"from":4,"to":5},{"from":7,"to":3}]},{"pgid":"10.d","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:07:40.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.786+0000 7f5532aae700 1 -- 172.21.15.82:0/3958238922 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5510064ee0 msgr2=0x7f5510067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:40.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.786+0000 7f5532aae700 1 --2- 172.21.15.82:0/3958238922 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5510064ee0 0x7f5510067390 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f552c0c4d30 tx=0x7f551c008040 comp rx=0 tx=0).stop 2023-11-28T13:07:40.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.786+0000 7f5532aae700 1 -- 172.21.15.82:0/3958238922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f552c0c8c50 msgr2=0x7f552c14e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:40.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.786+0000 7f5532aae700 1 --2- 172.21.15.82:0/3958238922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f552c0c8c50 0x7f552c14e190 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f552800c500 tx=0x7f552800c810 comp rx=0 tx=0).stop 2023-11-28T13:07:40.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.786+0000 7f5532aae700 1 -- 172.21.15.82:0/3958238922 shutdown_connections 2023-11-28T13:07:40.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.786+0000 7f5532aae700 1 --2- 172.21.15.82:0/3958238922 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5510064ee0 0x7f5510067390 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.786+0000 7f5532aae700 1 --2- 172.21.15.82:0/3958238922 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f552c1586f0 0x7f552c14e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.786+0000 7f5532aae700 1 --2- 172.21.15.82:0/3958238922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f552c0c8c50 0x7f552c14e190 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.786+0000 7f5532aae700 1 --2- 172.21.15.82:0/3958238922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f552c070900 0x7f552c06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.786+0000 7f5532aae700 1 -- 172.21.15.82:0/3958238922 >> 172.21.15.82:0/3958238922 conn(0x7f552c0ce600 msgr2=0x7f552c06c840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:40.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.786+0000 7f5532aae700 1 -- 172.21.15.82:0/3958238922 shutdown_connections 2023-11-28T13:07:40.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.786+0000 7f5532aae700 1 -- 172.21.15.82:0/3958238922 wait complete. 2023-11-28T13:07:40.807 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T13:03:21.126074+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T13:03:21.545268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:07:40.808 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:07:40.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.918+0000 7fd9fe847700 1 Processor -- start 2023-11-28T13:07:40.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.918+0000 7fd9fe847700 1 -- start start 2023-11-28T13:07:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9fe847700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd9f80ae010 0x7fd9f815da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9fe847700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f8070b10 0x7fd9f806c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9fe847700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f80c9b30 con 0x7fd9f80cc610 2023-11-28T13:07:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9fe847700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f81599f0 con 0x7fd9f80ae010 2023-11-28T13:07:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9fe847700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f815dfc0 con 0x7fd9f8070b10 2023-11-28T13:07:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9f7fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd9f80ae010 0x7fd9f815da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9f7fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd9f80ae010 0x7fd9f815da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46548/0 (socket says 172.21.15.82:46548) 2023-11-28T13:07:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9f7fff700 1 -- 172.21.15.82:0/481119361 learned_addr learned my addr 172.21.15.82:0/481119361 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9fcde4700 1 --2- 172.21.15.82:0/481119361 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f8070b10 0x7fd9f806c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:40.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9f7fff700 1 -- 172.21.15.82:0/481119361 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f8070b10 msgr2=0x7fd9f806c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:40.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9f7fff700 1 --2- 172.21.15.82:0/481119361 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f8070b10 0x7fd9f806c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9f7fff700 1 -- 172.21.15.82:0/481119361 >> v1:172.21.15.114:6789/0 conn(0x7fd9f80cc610 legacy=0x7fd9f8070400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9f7fff700 1 -- 172.21.15.82:0/481119361 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f80ca970 con 0x7fd9f80ae010 2023-11-28T13:07:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9f7fff700 1 --2- 172.21.15.82:0/481119361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f80ae010 0x7fd9f815da80 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009940 tx=0x7fd9e0009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa440ec72b402f04 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9f6ffd700 1 -- 172.21.15.82:0/481119361 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0011830 con 0x7fd9f80ae010 2023-11-28T13:07:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9f6ffd700 1 -- 172.21.15.82:0/481119361 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e0011990 con 0x7fd9f80ae010 2023-11-28T13:07:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9f6ffd700 1 -- 172.21.15.82:0/481119361 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0011d20 con 0x7fd9f80ae010 2023-11-28T13:07:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9fe847700 1 -- 172.21.15.82:0/481119361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f80ae010 msgr2=0x7fd9f815da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9fe847700 1 --2- 172.21.15.82:0/481119361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f80ae010 0x7fd9f815da80 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009940 tx=0x7fd9e0009c50 comp rx=0 tx=0).stop 2023-11-28T13:07:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9fe847700 1 -- 172.21.15.82:0/481119361 shutdown_connections 2023-11-28T13:07:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9fe847700 1 --2- 172.21.15.82:0/481119361 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f8070b10 0x7fd9f806c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9fe847700 1 --2- 172.21.15.82:0/481119361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f80ae010 0x7fd9f815da80 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9fe847700 1 -- 172.21.15.82:0/481119361 >> 172.21.15.82:0/481119361 conn(0x7fd9f80ce9d0 msgr2=0x7fd9f80ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:40.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9fe847700 1 -- 172.21.15.82:0/481119361 shutdown_connections 2023-11-28T13:07:40.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.922+0000 7fd9fe847700 1 -- 172.21.15.82:0/481119361 wait complete. 2023-11-28T13:07:40.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9fe847700 1 Processor -- start 2023-11-28T13:07:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9fe847700 1 -- start start 2023-11-28T13:07:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9fe847700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9f8070b10 0x7fd9f815ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9fe847700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f80cc610 0x7fd9f81448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9fe847700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f814bdf0 0x7fd9f814c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9fe847700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f81497b0 con 0x7fd9f80cc610 2023-11-28T13:07:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9fe847700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f81491f0 con 0x7fd9f8070b10 2023-11-28T13:07:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9fe847700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f81494d0 con 0x7fd9f814bdf0 2023-11-28T13:07:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9f77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f80cc610 0x7fd9f81448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9f77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f80cc610 0x7fd9f81448f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46550/0 (socket says 172.21.15.82:46550) 2023-11-28T13:07:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9f77fe700 1 -- 172.21.15.82:0/4208647725 learned_addr learned my addr 172.21.15.82:0/4208647725 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9f7fff700 1 --2- 172.21.15.82:0/4208647725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9f8070b10 0x7fd9f815ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9fcde4700 1 --2- 172.21.15.82:0/4208647725 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f814bdf0 0x7fd9f814c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:40.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9f77fe700 1 -- 172.21.15.82:0/4208647725 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f814bdf0 msgr2=0x7fd9f814c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:40.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9f77fe700 1 --2- 172.21.15.82:0/4208647725 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f814bdf0 0x7fd9f814c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9f77fe700 1 -- 172.21.15.82:0/4208647725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9f8070b10 msgr2=0x7fd9f815ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:40.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9f77fe700 1 --2- 172.21.15.82:0/4208647725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9f8070b10 0x7fd9f815ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:40.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9f77fe700 1 -- 172.21.15.82:0/4208647725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e0009570 con 0x7fd9f80cc610 2023-11-28T13:07:40.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9f77fe700 1 --2- 172.21.15.82:0/4208647725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f80cc610 0x7fd9f81448f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800c500 tx=0x7fd9e800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:40.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9f4ff9700 1 -- 172.21.15.82:0/4208647725 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e80052d0 con 0x7fd9f80cc610 2023-11-28T13:07:40.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9f4ff9700 1 -- 172.21.15.82:0/4208647725 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e8005430 con 0x7fd9f80cc610 2023-11-28T13:07:40.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9fe847700 1 -- 172.21.15.82:0/4208647725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f80ca040 con 0x7fd9f80cc610 2023-11-28T13:07:40.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9f4ff9700 1 -- 172.21.15.82:0/4208647725 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e80055a0 con 0x7fd9f80cc610 2023-11-28T13:07:40.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9fe847700 1 -- 172.21.15.82:0/4208647725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f80c9d60 con 0x7fd9f80cc610 2023-11-28T13:07:40.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9f4ff9700 1 -- 172.21.15.82:0/4208647725 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd9e8019030 con 0x7fd9f80cc610 2023-11-28T13:07:40.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.926+0000 7fd9fe847700 1 -- 172.21.15.82:0/4208647725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f80ca320 con 0x7fd9f80cc610 2023-11-28T13:07:40.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.930+0000 7fd9f4ff9700 1 --2- 172.21.15.82:0/4208647725 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9d8064ee0 0x7fd9d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:40.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.930+0000 7fd9f4ff9700 1 -- 172.21.15.82:0/4208647725 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7fd9e8081360 con 0x7fd9f80cc610 2023-11-28T13:07:40.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.930+0000 7fd9f7fff700 1 --2- 172.21.15.82:0/4208647725 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9d8064ee0 0x7fd9d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:40.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.930+0000 7fd9f7fff700 1 --2- 172.21.15.82:0/4208647725 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9d8064ee0 0x7fd9d8067390 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd9f806f510 tx=0x7fd9e0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:40.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:40.934+0000 7fd9f4ff9700 1 -- 172.21.15.82:0/4208647725 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd9e804f400 con 0x7fd9f80cc610 2023-11-28T13:07:41.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.098+0000 7fd9fe847700 1 -- 172.21.15.82:0/4208647725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9f806e330 con 0x7fd9f80cc610 2023-11-28T13:07:41.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.098+0000 7fd9f4ff9700 1 -- 172.21.15.82:0/4208647725 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd9e8017020 con 0x7fd9f80cc610 2023-11-28T13:07:41.104 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:07:41.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.098+0000 7fd9fe847700 1 -- 172.21.15.82:0/4208647725 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9d8064ee0 msgr2=0x7fd9d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:41.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.098+0000 7fd9fe847700 1 --2- 172.21.15.82:0/4208647725 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9d8064ee0 0x7fd9d8067390 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd9f806f510 tx=0x7fd9e0008030 comp rx=0 tx=0).stop 2023-11-28T13:07:41.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.098+0000 7fd9fe847700 1 -- 172.21.15.82:0/4208647725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f80cc610 msgr2=0x7fd9f81448f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:41.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.098+0000 7fd9fe847700 1 --2- 172.21.15.82:0/4208647725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f80cc610 0x7fd9f81448f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800c500 tx=0x7fd9e800c8c0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.098+0000 7fd9fe847700 1 -- 172.21.15.82:0/4208647725 shutdown_connections 2023-11-28T13:07:41.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.098+0000 7fd9fe847700 1 --2- 172.21.15.82:0/4208647725 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd9d8064ee0 0x7fd9d8067390 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.098+0000 7fd9fe847700 1 --2- 172.21.15.82:0/4208647725 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f814bdf0 0x7fd9f814c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.098+0000 7fd9fe847700 1 --2- 172.21.15.82:0/4208647725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f80cc610 0x7fd9f81448f0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.098+0000 7fd9fe847700 1 --2- 172.21.15.82:0/4208647725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9f8070b10 0x7fd9f815ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.098+0000 7fd9fe847700 1 -- 172.21.15.82:0/4208647725 >> 172.21.15.82:0/4208647725 conn(0x7fd9f80ce9d0 msgr2=0x7fd9f80cdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:41.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.098+0000 7fd9fe847700 1 -- 172.21.15.82:0/4208647725 shutdown_connections 2023-11-28T13:07:41.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.098+0000 7fd9fe847700 1 -- 172.21.15.82:0/4208647725 wait complete. 2023-11-28T13:07:41.119 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:07:41.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.230+0000 7f33ede00700 1 Processor -- start 2023-11-28T13:07:41.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.230+0000 7f33ede00700 1 -- start start 2023-11-28T13:07:41.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.230+0000 7f33ede00700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f33e806b180 0x7f33e81608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:41.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.230+0000 7f33ede00700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33e80c79a0 0x7f33e80c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:41.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.230+0000 7f33ede00700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e80c82e0 con 0x7f33e81568b0 2023-11-28T13:07:41.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.230+0000 7f33ede00700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e8156c80 con 0x7f33e806b180 2023-11-28T13:07:41.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.230+0000 7f33ede00700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e8071f30 con 0x7f33e80c79a0 2023-11-28T13:07:41.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.234+0000 7f33ed5ff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33e80c79a0 0x7f33e80c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:41.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.234+0000 7f33e7fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f33e806b180 0x7f33e81608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:41.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.234+0000 7f33e7fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f33e806b180 0x7f33e81608a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:48148/0 (socket says 172.21.15.82:48148) 2023-11-28T13:07:41.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.234+0000 7f33e7fff700 1 -- 172.21.15.82:0/875085473 learned_addr learned my addr 172.21.15.82:0/875085473 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:41.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.234+0000 7f33ecdfe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f33e81568b0 0x7f33e8071650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:46312/0 (socket says 172.21.15.82:46312) 2023-11-28T13:07:41.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.234+0000 7f33ed5ff700 1 -- 172.21.15.82:0/875085473 >> v2:172.21.15.114:3300/0 conn(0x7f33e806b180 msgr2=0x7f33e81608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:41.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.234+0000 7f33ed5ff700 1 --2- 172.21.15.82:0/875085473 >> v2:172.21.15.114:3300/0 conn(0x7f33e806b180 0x7f33e81608a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.234+0000 7f33ed5ff700 1 -- 172.21.15.82:0/875085473 >> v1:172.21.15.114:6789/0 conn(0x7f33e81568b0 legacy=0x7f33e8071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:41.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.234+0000 7f33ed5ff700 1 -- 172.21.15.82:0/875085473 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e8072210 con 0x7f33e80c79a0 2023-11-28T13:07:41.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.234+0000 7f33ed5ff700 1 --2- 172.21.15.82:0/875085473 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33e80c79a0 0x7f33e80c7da0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009d90 tx=0x7f33e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b18d122a831cafa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:41.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.234+0000 7f33e77fe700 1 -- 172.21.15.82:0/875085473 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e000e070 con 0x7f33e80c79a0 2023-11-28T13:07:41.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.234+0000 7f33e77fe700 1 -- 172.21.15.82:0/875085473 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e000bb20 con 0x7f33e80c79a0 2023-11-28T13:07:41.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.234+0000 7f33e77fe700 1 -- 172.21.15.82:0/875085473 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e0012430 con 0x7f33e80c79a0 2023-11-28T13:07:41.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.234+0000 7f33ede00700 1 -- 172.21.15.82:0/875085473 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33e80c79a0 msgr2=0x7f33e80c7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:41.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.234+0000 7f33ede00700 1 --2- 172.21.15.82:0/875085473 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33e80c79a0 0x7f33e80c7da0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009d90 tx=0x7f33e000b330 comp rx=0 tx=0).stop 2023-11-28T13:07:41.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.234+0000 7f33ede00700 1 -- 172.21.15.82:0/875085473 shutdown_connections 2023-11-28T13:07:41.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.234+0000 7f33ede00700 1 --2- 172.21.15.82:0/875085473 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33e80c79a0 0x7f33e80c7da0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.234+0000 7f33ede00700 1 --2- 172.21.15.82:0/875085473 >> v2:172.21.15.114:3300/0 conn(0x7f33e806b180 0x7f33e81608a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.234+0000 7f33ede00700 1 -- 172.21.15.82:0/875085473 >> 172.21.15.82:0/875085473 conn(0x7f33e80ce630 msgr2=0x7f33e80cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:41.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.234+0000 7f33ede00700 1 -- 172.21.15.82:0/875085473 shutdown_connections 2023-11-28T13:07:41.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.234+0000 7f33ede00700 1 -- 172.21.15.82:0/875085473 wait complete. 2023-11-28T13:07:41.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33ede00700 1 Processor -- start 2023-11-28T13:07:41.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33ede00700 1 -- start start 2023-11-28T13:07:41.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33ede00700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33e806b180 0x7f33e814d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:41.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33ede00700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33e80c79a0 0x7f33e8145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:41.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33ede00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33e81568b0 0x7f33e8151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:41.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33ede00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e80cb5e0 con 0x7f33e81568b0 2023-11-28T13:07:41.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33ede00700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e814ddb0 con 0x7f33e806b180 2023-11-28T13:07:41.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33ede00700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e814d340 con 0x7f33e80c79a0 2023-11-28T13:07:41.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33ed5ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33e81568b0 0x7f33e8151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:41.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33ed5ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33e81568b0 0x7f33e8151970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46556/0 (socket says 172.21.15.82:46556) 2023-11-28T13:07:41.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33ed5ff700 1 -- 172.21.15.82:0/1130623985 learned_addr learned my addr 172.21.15.82:0/1130623985 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:41.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33ecdfe700 1 --2- 172.21.15.82:0/1130623985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33e806b180 0x7f33e814d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:41.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33e7fff700 1 --2- 172.21.15.82:0/1130623985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33e80c79a0 0x7f33e8145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:41.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33ed5ff700 1 -- 172.21.15.82:0/1130623985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33e80c79a0 msgr2=0x7f33e8145030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:41.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33ed5ff700 1 --2- 172.21.15.82:0/1130623985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33e80c79a0 0x7f33e8145030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33ed5ff700 1 -- 172.21.15.82:0/1130623985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33e806b180 msgr2=0x7f33e814d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:41.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33ed5ff700 1 --2- 172.21.15.82:0/1130623985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33e806b180 0x7f33e814d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33ed5ff700 1 -- 172.21.15.82:0/1130623985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e0009a70 con 0x7f33e81568b0 2023-11-28T13:07:41.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33ed5ff700 1 --2- 172.21.15.82:0/1130623985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33e81568b0 0x7f33e8151970 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f33e0014040 tx=0x7f33e0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:41.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33e57fa700 1 -- 172.21.15.82:0/1130623985 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e0012430 con 0x7f33e81568b0 2023-11-28T13:07:41.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33ede00700 1 -- 172.21.15.82:0/1130623985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e81600a0 con 0x7f33e81568b0 2023-11-28T13:07:41.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33e57fa700 1 -- 172.21.15.82:0/1130623985 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e0020070 con 0x7f33e81568b0 2023-11-28T13:07:41.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33e57fa700 1 -- 172.21.15.82:0/1130623985 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e00098f0 con 0x7f33e81568b0 2023-11-28T13:07:41.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.238+0000 7f33ede00700 1 -- 172.21.15.82:0/1130623985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e815fdc0 con 0x7f33e81568b0 2023-11-28T13:07:41.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.242+0000 7f33ede00700 1 -- 172.21.15.82:0/1130623985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e8160380 con 0x7f33e81568b0 2023-11-28T13:07:41.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.242+0000 7f33e57fa700 1 -- 172.21.15.82:0/1130623985 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f33e002e070 con 0x7f33e81568b0 2023-11-28T13:07:41.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.242+0000 7f33e57fa700 1 --2- 172.21.15.82:0/1130623985 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f33d4064ee0 0x7f33d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:41.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.242+0000 7f33ecdfe700 1 --2- 172.21.15.82:0/1130623985 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f33d4064ee0 0x7f33d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:41.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.242+0000 7f33e57fa700 1 -- 172.21.15.82:0/1130623985 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f33e0022070 con 0x7f33e81568b0 2023-11-28T13:07:41.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.242+0000 7f33ecdfe700 1 --2- 172.21.15.82:0/1130623985 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f33d4064ee0 0x7f33d4067390 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f33dc000f60 tx=0x7f33dc007eb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:41.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.250+0000 7f33e57fa700 1 -- 172.21.15.82:0/1130623985 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f33e0051c80 con 0x7f33e81568b0 2023-11-28T13:07:41.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.410+0000 7f33ede00700 1 -- 172.21.15.82:0/1130623985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f33e8065fc0 con 0x7f33e81568b0 2023-11-28T13:07:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.410+0000 7f33e57fa700 1 -- 172.21.15.82:0/1130623985 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v67) v1 ==== 92+0+10 (secure 0 0 0) 0x7f33e002c0a0 con 0x7f33e81568b0 2023-11-28T13:07:41.418 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:07:41.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.414+0000 7f33ede00700 1 -- 172.21.15.82:0/1130623985 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f33d4064ee0 msgr2=0x7f33d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:41.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.414+0000 7f33ede00700 1 --2- 172.21.15.82:0/1130623985 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f33d4064ee0 0x7f33d4067390 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f33dc000f60 tx=0x7f33dc007eb0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.414+0000 7f33ede00700 1 -- 172.21.15.82:0/1130623985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33e81568b0 msgr2=0x7f33e8151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:41.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.414+0000 7f33ede00700 1 --2- 172.21.15.82:0/1130623985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33e81568b0 0x7f33e8151970 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f33e0014040 tx=0x7f33e0004af0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.414+0000 7f33ede00700 1 -- 172.21.15.82:0/1130623985 shutdown_connections 2023-11-28T13:07:41.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.414+0000 7f33ede00700 1 --2- 172.21.15.82:0/1130623985 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f33d4064ee0 0x7f33d4067390 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.414+0000 7f33ede00700 1 --2- 172.21.15.82:0/1130623985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33e81568b0 0x7f33e8151970 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.414+0000 7f33ede00700 1 --2- 172.21.15.82:0/1130623985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33e80c79a0 0x7f33e8145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.414+0000 7f33ede00700 1 --2- 172.21.15.82:0/1130623985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33e806b180 0x7f33e814d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.414+0000 7f33ede00700 1 -- 172.21.15.82:0/1130623985 >> 172.21.15.82:0/1130623985 conn(0x7f33e80ce630 msgr2=0x7f33e815d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:41.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.414+0000 7f33ede00700 1 -- 172.21.15.82:0/1130623985 shutdown_connections 2023-11-28T13:07:41.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.414+0000 7f33ede00700 1 -- 172.21.15.82:0/1130623985 wait complete. 2023-11-28T13:07:41.432 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T13:07:41.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.542+0000 7fb947fff700 1 Processor -- start 2023-11-28T13:07:41.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.542+0000 7fb947fff700 1 -- start start 2023-11-28T13:07:41.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.542+0000 7fb947fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb94806c140 0x7fb9480cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:41.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.542+0000 7fb947fff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb948069bc0 con 0x7fb9480b1d10 2023-11-28T13:07:41.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.542+0000 7fb947fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9480d1480 con 0x7fb9480d25b0 2023-11-28T13:07:41.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.542+0000 7fb947fff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9480cd280 con 0x7fb94806c140 2023-11-28T13:07:41.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.546+0000 7fb946ffd700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb9480b1d10 0x7fb94806ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:59442/0 (socket says 172.21.15.82:59442) 2023-11-28T13:07:41.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.546+0000 7fb946ffd700 1 -- 172.21.15.82:0/410761743 learned_addr learned my addr 172.21.15.82:0/410761743 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:41.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.546+0000 7fb9467fc700 1 --2- 172.21.15.82:0/410761743 >> v2:172.21.15.114:3300/0 conn(0x7fb94806c140 0x7fb9480cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:41.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.546+0000 7fb945ffb700 1 -- 172.21.15.82:0/410761743 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228544750 0 0) 0x7fb948069bc0 con 0x7fb9480b1d10 2023-11-28T13:07:41.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.546+0000 7fb945ffb700 1 -- 172.21.15.82:0/410761743 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9300035d0 con 0x7fb9480b1d10 2023-11-28T13:07:41.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.546+0000 7fb945ffb700 1 -- 172.21.15.82:0/410761743 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689000777 0 0) 0x7fb9480d1480 con 0x7fb9480d25b0 2023-11-28T13:07:41.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.546+0000 7fb945ffb700 1 -- 172.21.15.82:0/410761743 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb948069bc0 con 0x7fb9480d25b0 2023-11-28T13:07:41.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.546+0000 7fb9467fc700 1 -- 172.21.15.82:0/410761743 >> v1:172.21.15.114:6789/0 conn(0x7fb9480d25b0 legacy=0x7fb94806a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:41.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.546+0000 7fb9467fc700 1 -- 172.21.15.82:0/410761743 >> v1:172.21.15.82:6789/0 conn(0x7fb9480b1d10 legacy=0x7fb94806ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:41.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.546+0000 7fb9467fc700 1 -- 172.21.15.82:0/410761743 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9480cd560 con 0x7fb94806c140 2023-11-28T13:07:41.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.546+0000 7fb9467fc700 1 --2- 172.21.15.82:0/410761743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb94806c140 0x7fb9480cec20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb938009850 tx=0x7fb938009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9f2dfda68c546c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:41.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.546+0000 7fb945ffb700 1 -- 172.21.15.82:0/410761743 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb938011830 con 0x7fb94806c140 2023-11-28T13:07:41.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.546+0000 7fb945ffb700 1 -- 172.21.15.82:0/410761743 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb938011990 con 0x7fb94806c140 2023-11-28T13:07:41.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.546+0000 7fb945ffb700 1 -- 172.21.15.82:0/410761743 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb938011d00 con 0x7fb94806c140 2023-11-28T13:07:41.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.546+0000 7fb947fff700 1 -- 172.21.15.82:0/410761743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb94806c140 msgr2=0x7fb9480cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:41.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.546+0000 7fb947fff700 1 --2- 172.21.15.82:0/410761743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb94806c140 0x7fb9480cec20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb938009850 tx=0x7fb938009b60 comp rx=0 tx=0).stop 2023-11-28T13:07:41.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.546+0000 7fb947fff700 1 -- 172.21.15.82:0/410761743 shutdown_connections 2023-11-28T13:07:41.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.546+0000 7fb947fff700 1 --2- 172.21.15.82:0/410761743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb94806c140 0x7fb9480cec20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.546+0000 7fb947fff700 1 -- 172.21.15.82:0/410761743 >> 172.21.15.82:0/410761743 conn(0x7fb9480b52a0 msgr2=0x7fb9480d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:41.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.546+0000 7fb947fff700 1 -- 172.21.15.82:0/410761743 shutdown_connections 2023-11-28T13:07:41.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.546+0000 7fb947fff700 1 -- 172.21.15.82:0/410761743 wait complete. 2023-11-28T13:07:41.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb947fff700 1 Processor -- start 2023-11-28T13:07:41.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb947fff700 1 -- start start 2023-11-28T13:07:41.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb947fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb94806c140 0x7fb948158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:41.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb947fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9480b1d10 0x7fb94815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:41.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb947fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9480d25b0 0x7fb9480c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:41.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb947fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb948158960 con 0x7fb9480b1d10 2023-11-28T13:07:41.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb947fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94815ddb0 con 0x7fb9480d25b0 2023-11-28T13:07:41.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb947fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94815e000 con 0x7fb94806c140 2023-11-28T13:07:41.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb9467fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9480b1d10 0x7fb94815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:41.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb9467fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9480b1d10 0x7fb94815f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46564/0 (socket says 172.21.15.82:46564) 2023-11-28T13:07:41.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb9467fc700 1 -- 172.21.15.82:0/2978306047 learned_addr learned my addr 172.21.15.82:0/2978306047 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:41.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb9477fe700 1 --2- 172.21.15.82:0/2978306047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9480d25b0 0x7fb9480c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:41.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb946ffd700 1 --2- 172.21.15.82:0/2978306047 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb94806c140 0x7fb948158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:41.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb9467fc700 1 -- 172.21.15.82:0/2978306047 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb94806c140 msgr2=0x7fb948158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:41.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb9467fc700 1 --2- 172.21.15.82:0/2978306047 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb94806c140 0x7fb948158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb9467fc700 1 -- 172.21.15.82:0/2978306047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9480d25b0 msgr2=0x7fb9480c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:41.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb9467fc700 1 --2- 172.21.15.82:0/2978306047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9480d25b0 0x7fb9480c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb9467fc700 1 -- 172.21.15.82:0/2978306047 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9380094b0 con 0x7fb9480b1d10 2023-11-28T13:07:41.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb946ffd700 1 --2- 172.21.15.82:0/2978306047 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb94806c140 0x7fb948158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:07:41.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb9467fc700 1 --2- 172.21.15.82:0/2978306047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9480b1d10 0x7fb94815f0a0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb9380090b0 tx=0x7fb938004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:41.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb92f7fe700 1 -- 172.21.15.82:0/2978306047 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb938004380 con 0x7fb9480b1d10 2023-11-28T13:07:41.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb92f7fe700 1 -- 172.21.15.82:0/2978306047 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93801f070 con 0x7fb9480b1d10 2023-11-28T13:07:41.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb947fff700 1 -- 172.21.15.82:0/2978306047 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9480d1050 con 0x7fb9480b1d10 2023-11-28T13:07:41.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb92f7fe700 1 -- 172.21.15.82:0/2978306047 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9380036c0 con 0x7fb9480b1d10 2023-11-28T13:07:41.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.550+0000 7fb947fff700 1 -- 172.21.15.82:0/2978306047 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9480b20e0 con 0x7fb9480b1d10 2023-11-28T13:07:41.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.554+0000 7fb947fff700 1 -- 172.21.15.82:0/2978306047 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9480d11e0 con 0x7fb9480b1d10 2023-11-28T13:07:41.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.554+0000 7fb92f7fe700 1 -- 172.21.15.82:0/2978306047 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb93802a020 con 0x7fb9480b1d10 2023-11-28T13:07:41.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.554+0000 7fb92f7fe700 1 --2- 172.21.15.82:0/2978306047 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb934064ee0 0x7fb934067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:41.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.554+0000 7fb946ffd700 1 --2- 172.21.15.82:0/2978306047 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb934064ee0 0x7fb934067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:41.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.554+0000 7fb92f7fe700 1 -- 172.21.15.82:0/2978306047 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7fb938083430 con 0x7fb9480b1d10 2023-11-28T13:07:41.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.554+0000 7fb946ffd700 1 --2- 172.21.15.82:0/2978306047 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb934064ee0 0x7fb934067390 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb93c000f60 tx=0x7fb93c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:41.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.562+0000 7fb92f7fe700 1 -- 172.21.15.82:0/2978306047 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb938051460 con 0x7fb9480b1d10 2023-11-28T13:07:41.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.726+0000 7fb947fff700 1 -- 172.21.15.82:0/2978306047 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb948065fc0 con 0x7fb9480b1d10 2023-11-28T13:07:41.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.726+0000 7fb92f7fe700 1 -- 172.21.15.82:0/2978306047 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v67) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb938015020 con 0x7fb9480b1d10 2023-11-28T13:07:41.732 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-11-28T13:07:41.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.726+0000 7fb947fff700 1 -- 172.21.15.82:0/2978306047 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb934064ee0 msgr2=0x7fb934067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:41.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.726+0000 7fb947fff700 1 --2- 172.21.15.82:0/2978306047 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb934064ee0 0x7fb934067390 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb93c000f60 tx=0x7fb93c009040 comp rx=0 tx=0).stop 2023-11-28T13:07:41.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.726+0000 7fb947fff700 1 -- 172.21.15.82:0/2978306047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9480b1d10 msgr2=0x7fb94815f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:41.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.726+0000 7fb947fff700 1 --2- 172.21.15.82:0/2978306047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9480b1d10 0x7fb94815f0a0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb9380090b0 tx=0x7fb938004770 comp rx=0 tx=0).stop 2023-11-28T13:07:41.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.726+0000 7fb947fff700 1 -- 172.21.15.82:0/2978306047 shutdown_connections 2023-11-28T13:07:41.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.726+0000 7fb947fff700 1 --2- 172.21.15.82:0/2978306047 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb934064ee0 0x7fb934067390 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.726+0000 7fb947fff700 1 --2- 172.21.15.82:0/2978306047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9480d25b0 0x7fb9480c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.726+0000 7fb947fff700 1 --2- 172.21.15.82:0/2978306047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9480b1d10 0x7fb94815f0a0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.726+0000 7fb947fff700 1 --2- 172.21.15.82:0/2978306047 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb94806c140 0x7fb948158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.726+0000 7fb947fff700 1 -- 172.21.15.82:0/2978306047 >> 172.21.15.82:0/2978306047 conn(0x7fb9480b52a0 msgr2=0x7fb9480d2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:41.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.726+0000 7fb947fff700 1 -- 172.21.15.82:0/2978306047 shutdown_connections 2023-11-28T13:07:41.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.726+0000 7fb947fff700 1 -- 172.21.15.82:0/2978306047 wait complete. 2023-11-28T13:07:41.747 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T13:07:41.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f0623fff700 1 Processor -- start 2023-11-28T13:07:41.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f0623fff700 1 -- start start 2023-11-28T13:07:41.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f0623fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06240ad820 0x7f062406a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:41.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f0623fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f06240c9b10 0x7f06240c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:41.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f0623fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06240c93a0 con 0x7f0624070910 2023-11-28T13:07:41.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f0623fff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06240c96f0 con 0x7f06240c9b10 2023-11-28T13:07:41.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f0623fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0624071580 con 0x7f06240ad820 2023-11-28T13:07:41.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f06227fc700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06240ad820 0x7f062406a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:41.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f06227fc700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06240ad820 0x7f062406a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:49998/0 (socket says 172.21.15.82:49998) 2023-11-28T13:07:41.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f06237fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f06240c9b10 0x7f06240c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:41.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f06227fc700 1 -- 172.21.15.82:0/3170399098 learned_addr learned my addr 172.21.15.82:0/3170399098 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:41.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f06237fe700 1 -- 172.21.15.82:0/3170399098 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06240ad820 msgr2=0x7f062406a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:41.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f06237fe700 1 --2- 172.21.15.82:0/3170399098 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06240ad820 0x7f062406a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f06237fe700 1 -- 172.21.15.82:0/3170399098 >> v1:172.21.15.114:6789/0 conn(0x7f0624070910 legacy=0x7f0624070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:41.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f06237fe700 1 -- 172.21.15.82:0/3170399098 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062406ab10 con 0x7f06240c9b10 2023-11-28T13:07:41.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f06237fe700 1 --2- 172.21.15.82:0/3170399098 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06240c9b10 0x7f06240c9f80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f061c009dc0 tx=0x7f061c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=543edecb862fe656 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:41.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f0621ffb700 1 -- 172.21.15.82:0/3170399098 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c00e070 con 0x7f06240c9b10 2023-11-28T13:07:41.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f0621ffb700 1 -- 172.21.15.82:0/3170399098 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c00bae0 con 0x7f06240c9b10 2023-11-28T13:07:41.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f0621ffb700 1 -- 172.21.15.82:0/3170399098 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c00be90 con 0x7f06240c9b10 2023-11-28T13:07:41.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f0623fff700 1 -- 172.21.15.82:0/3170399098 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06240c9b10 msgr2=0x7f06240c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:41.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f0623fff700 1 --2- 172.21.15.82:0/3170399098 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06240c9b10 0x7f06240c9f80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f061c009dc0 tx=0x7f061c00b330 comp rx=0 tx=0).stop 2023-11-28T13:07:41.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f0623fff700 1 -- 172.21.15.82:0/3170399098 shutdown_connections 2023-11-28T13:07:41.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f0623fff700 1 --2- 172.21.15.82:0/3170399098 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06240c9b10 0x7f06240c9f80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f0623fff700 1 --2- 172.21.15.82:0/3170399098 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06240ad820 0x7f062406a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.862+0000 7f0623fff700 1 -- 172.21.15.82:0/3170399098 >> 172.21.15.82:0/3170399098 conn(0x7f06240ce630 msgr2=0x7f06240cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:41.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f0623fff700 1 -- 172.21.15.82:0/3170399098 shutdown_connections 2023-11-28T13:07:41.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f0623fff700 1 -- 172.21.15.82:0/3170399098 wait complete. 2023-11-28T13:07:41.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f0623fff700 1 Processor -- start 2023-11-28T13:07:41.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f0623fff700 1 -- start start 2023-11-28T13:07:41.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f0623fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0624070910 0x7f06240b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:41.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f0623fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06240ad820 0x7f062414a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:41.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f0623fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06240c9b10 0x7f06240ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:41.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f0623fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0624159ed0 con 0x7f06240ad820 2023-11-28T13:07:41.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f0623fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06240b4020 con 0x7f06240c9b10 2023-11-28T13:07:41.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f0623fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0624154fa0 con 0x7f0624070910 2023-11-28T13:07:41.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f06227fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06240ad820 0x7f062414a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:41.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f06227fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06240ad820 0x7f062414a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46568/0 (socket says 172.21.15.82:46568) 2023-11-28T13:07:41.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f06227fc700 1 -- 172.21.15.82:0/1330310675 learned_addr learned my addr 172.21.15.82:0/1330310675 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:41.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f0622ffd700 1 --2- 172.21.15.82:0/1330310675 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0624070910 0x7f06240b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:41.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f06237fe700 1 --2- 172.21.15.82:0/1330310675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06240c9b10 0x7f06240ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:41.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f06227fc700 1 -- 172.21.15.82:0/1330310675 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0624070910 msgr2=0x7f06240b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:41.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f06227fc700 1 --2- 172.21.15.82:0/1330310675 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0624070910 0x7f06240b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f06227fc700 1 -- 172.21.15.82:0/1330310675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06240c9b10 msgr2=0x7f06240ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:41.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f06227fc700 1 --2- 172.21.15.82:0/1330310675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06240c9b10 0x7f06240ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:41.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f06227fc700 1 -- 172.21.15.82:0/1330310675 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c009a70 con 0x7f06240ad820 2023-11-28T13:07:41.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f06227fc700 1 --2- 172.21.15.82:0/1330310675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06240ad820 0x7f062414a770 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f060c00e8c0 tx=0x7f060c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:41.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f061bfff700 1 -- 172.21.15.82:0/1330310675 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c013680 con 0x7f06240ad820 2023-11-28T13:07:41.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f061bfff700 1 -- 172.21.15.82:0/1330310675 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060c0137e0 con 0x7f06240ad820 2023-11-28T13:07:41.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f0623fff700 1 -- 172.21.15.82:0/1330310675 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f062406b0c0 con 0x7f06240ad820 2023-11-28T13:07:41.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f061bfff700 1 -- 172.21.15.82:0/1330310675 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c013b70 con 0x7f06240ad820 2023-11-28T13:07:41.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.866+0000 7f0623fff700 1 -- 172.21.15.82:0/1330310675 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062406ade0 con 0x7f06240ad820 2023-11-28T13:07:41.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.870+0000 7f0623fff700 1 -- 172.21.15.82:0/1330310675 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0624159c30 con 0x7f06240ad820 2023-11-28T13:07:41.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.870+0000 7f061bfff700 1 -- 172.21.15.82:0/1330310675 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f060c019030 con 0x7f06240ad820 2023-11-28T13:07:41.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.870+0000 7f061bfff700 1 --2- 172.21.15.82:0/1330310675 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0604064ee0 0x7f0604067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:41.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.870+0000 7f061bfff700 1 -- 172.21.15.82:0/1330310675 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f060c082320 con 0x7f06240ad820 2023-11-28T13:07:41.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.870+0000 7f0622ffd700 1 --2- 172.21.15.82:0/1330310675 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0604064ee0 0x7f0604067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:41.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.870+0000 7f0622ffd700 1 --2- 172.21.15.82:0/1330310675 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0604064ee0 0x7f0604067390 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0614000f60 tx=0x7f0614009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:41.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:41.878+0000 7f061bfff700 1 -- 172.21.15.82:0/1330310675 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f060c0504e0 con 0x7f06240ad820 2023-11-28T13:07:42.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.042+0000 7f0623fff700 1 -- 172.21.15.82:0/1330310675 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0624159c30 con 0x7f06240ad820 2023-11-28T13:07:42.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.042+0000 7f061bfff700 1 -- 172.21.15.82:0/1330310675 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v67) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0624159c30 con 0x7f06240ad820 2023-11-28T13:07:42.051 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-11-28T13:07:42.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.046+0000 7f0623fff700 1 -- 172.21.15.82:0/1330310675 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0604064ee0 msgr2=0x7f0604067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:42.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.046+0000 7f0623fff700 1 --2- 172.21.15.82:0/1330310675 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0604064ee0 0x7f0604067390 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0614000f60 tx=0x7f0614009040 comp rx=0 tx=0).stop 2023-11-28T13:07:42.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.046+0000 7f0623fff700 1 -- 172.21.15.82:0/1330310675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06240ad820 msgr2=0x7f062414a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:42.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.046+0000 7f0623fff700 1 --2- 172.21.15.82:0/1330310675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06240ad820 0x7f062414a770 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f060c00e8c0 tx=0x7f060c00ebd0 comp rx=0 tx=0).stop 2023-11-28T13:07:42.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.046+0000 7f0623fff700 1 -- 172.21.15.82:0/1330310675 shutdown_connections 2023-11-28T13:07:42.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.046+0000 7f0623fff700 1 --2- 172.21.15.82:0/1330310675 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f0604064ee0 0x7f0604067390 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:42.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.046+0000 7f0623fff700 1 --2- 172.21.15.82:0/1330310675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06240c9b10 0x7f06240ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:42.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.046+0000 7f0623fff700 1 --2- 172.21.15.82:0/1330310675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06240ad820 0x7f062414a770 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:42.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.046+0000 7f0623fff700 1 --2- 172.21.15.82:0/1330310675 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0624070910 0x7f06240b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:42.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.046+0000 7f0623fff700 1 -- 172.21.15.82:0/1330310675 >> 172.21.15.82:0/1330310675 conn(0x7f06240ce630 msgr2=0x7f062415dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:42.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.046+0000 7f0623fff700 1 -- 172.21.15.82:0/1330310675 shutdown_connections 2023-11-28T13:07:42.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.046+0000 7f0623fff700 1 -- 172.21.15.82:0/1330310675 wait complete. 2023-11-28T13:07:42.065 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T13:07:42.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.170+0000 7f9bba579700 1 Processor -- start 2023-11-28T13:07:42.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.170+0000 7f9bba579700 1 -- start start 2023-11-28T13:07:42.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.170+0000 7f9bba579700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9bb415c2d0 0x7f9bb406d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:42.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.170+0000 7f9bba579700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bb4070900 0x7f9bb4070d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:42.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.170+0000 7f9bba579700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb406c3b0 con 0x7f9bb41586f0 2023-11-28T13:07:42.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.170+0000 7f9bba579700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb40712c0 con 0x7f9bb415c2d0 2023-11-28T13:07:42.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.170+0000 7f9bba579700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb415c8b0 con 0x7f9bb4070900 2023-11-28T13:07:42.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9bb8d76700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9bb415c2d0 0x7f9bb406d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:42.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9bb9d78700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bb4070900 0x7f9bb4070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:42.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9bb9d78700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bb4070900 0x7f9bb4070d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:50014/0 (socket says 172.21.15.82:50014) 2023-11-28T13:07:42.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9bb9d78700 1 -- 172.21.15.82:0/3816244079 learned_addr learned my addr 172.21.15.82:0/3816244079 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:42.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9bb8d76700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9bb415c2d0 0x7f9bb406d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:48200/0 (socket says 172.21.15.82:48200) 2023-11-28T13:07:42.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9bb9577700 1 --1- 172.21.15.82:0/3816244079 >> v1:172.21.15.114:6789/0 conn(0x7f9bb41586f0 0x7f9bb40c8c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:46338/0 (socket says 172.21.15.82:46338) 2023-11-28T13:07:42.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9bb9d78700 1 -- 172.21.15.82:0/3816244079 >> v2:172.21.15.114:3300/0 conn(0x7f9bb415c2d0 msgr2=0x7f9bb406d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:42.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9bb9d78700 1 --2- 172.21.15.82:0/3816244079 >> v2:172.21.15.114:3300/0 conn(0x7f9bb415c2d0 0x7f9bb406d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:42.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9bb9d78700 1 -- 172.21.15.82:0/3816244079 >> v1:172.21.15.114:6789/0 conn(0x7f9bb41586f0 legacy=0x7f9bb40c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:42.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9bb9d78700 1 -- 172.21.15.82:0/3816244079 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb415cb90 con 0x7f9bb4070900 2023-11-28T13:07:42.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9bb9d78700 1 --2- 172.21.15.82:0/3816244079 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bb4070900 0x7f9bb4070d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0009910 tx=0x7f9bb0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb49ce5847f070eb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:42.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9babfff700 1 -- 172.21.15.82:0/3816244079 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb000f8a0 con 0x7f9bb4070900 2023-11-28T13:07:42.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9babfff700 1 -- 172.21.15.82:0/3816244079 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb000fa00 con 0x7f9bb4070900 2023-11-28T13:07:42.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9babfff700 1 -- 172.21.15.82:0/3816244079 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb000fdb0 con 0x7f9bb4070900 2023-11-28T13:07:42.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9bba579700 1 -- 172.21.15.82:0/3816244079 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bb4070900 msgr2=0x7f9bb4070d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:42.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9bba579700 1 --2- 172.21.15.82:0/3816244079 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bb4070900 0x7f9bb4070d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0009910 tx=0x7f9bb0009c20 comp rx=0 tx=0).stop 2023-11-28T13:07:42.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9bba579700 1 -- 172.21.15.82:0/3816244079 shutdown_connections 2023-11-28T13:07:42.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9bba579700 1 --2- 172.21.15.82:0/3816244079 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bb4070900 0x7f9bb4070d80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:42.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9bba579700 1 --2- 172.21.15.82:0/3816244079 >> v2:172.21.15.114:3300/0 conn(0x7f9bb415c2d0 0x7f9bb406d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:42.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9bba579700 1 -- 172.21.15.82:0/3816244079 >> 172.21.15.82:0/3816244079 conn(0x7f9bb40ce600 msgr2=0x7f9bb40ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:42.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9bba579700 1 -- 172.21.15.82:0/3816244079 shutdown_connections 2023-11-28T13:07:42.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.174+0000 7f9bba579700 1 -- 172.21.15.82:0/3816244079 wait complete. 2023-11-28T13:07:42.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9bba579700 1 Processor -- start 2023-11-28T13:07:42.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9bba579700 1 -- start start 2023-11-28T13:07:42.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9bba579700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bb4070900 0x7f9bb40c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:42.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9bba579700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bb41586f0 0x7f9bb40c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:42.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9bba579700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bb415c2d0 0x7f9bb40c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:42.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9bba579700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb4146740 con 0x7f9bb4070900 2023-11-28T13:07:42.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9bba579700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb41469e0 con 0x7f9bb41586f0 2023-11-28T13:07:42.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9bba579700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb4146cc0 con 0x7f9bb415c2d0 2023-11-28T13:07:42.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9bb9577700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bb4070900 0x7f9bb40c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:42.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9bb9577700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bb4070900 0x7f9bb40c4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46576/0 (socket says 172.21.15.82:46576) 2023-11-28T13:07:42.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9bb9577700 1 -- 172.21.15.82:0/2423025401 learned_addr learned my addr 172.21.15.82:0/2423025401 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:42.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9bb8d76700 1 --2- 172.21.15.82:0/2423025401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bb41586f0 0x7f9bb40c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:42.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9bb9d78700 1 --2- 172.21.15.82:0/2423025401 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bb415c2d0 0x7f9bb40c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:42.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9bb9577700 1 -- 172.21.15.82:0/2423025401 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bb415c2d0 msgr2=0x7f9bb40c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:42.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9bb9577700 1 --2- 172.21.15.82:0/2423025401 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bb415c2d0 0x7f9bb40c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:42.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9bb9577700 1 -- 172.21.15.82:0/2423025401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bb41586f0 msgr2=0x7f9bb40c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:42.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9bb9577700 1 --2- 172.21.15.82:0/2423025401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bb41586f0 0x7f9bb40c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:42.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9bb9577700 1 -- 172.21.15.82:0/2423025401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb0009570 con 0x7f9bb4070900 2023-11-28T13:07:42.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9bb9577700 1 --2- 172.21.15.82:0/2423025401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bb4070900 0x7f9bb40c4a70 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f9ba400c700 tx=0x7f9ba400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:42.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9ba9ffb700 1 -- 172.21.15.82:0/2423025401 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4005cd0 con 0x7f9bb4070900 2023-11-28T13:07:42.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9ba9ffb700 1 -- 172.21.15.82:0/2423025401 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba4005e30 con 0x7f9bb4070900 2023-11-28T13:07:42.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9bba579700 1 -- 172.21.15.82:0/2423025401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb415d150 con 0x7f9bb4070900 2023-11-28T13:07:42.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9ba9ffb700 1 -- 172.21.15.82:0/2423025401 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40072d0 con 0x7f9bb4070900 2023-11-28T13:07:42.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.178+0000 7f9bba579700 1 -- 172.21.15.82:0/2423025401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb415ce70 con 0x7f9bb4070900 2023-11-28T13:07:42.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.182+0000 7f9bba579700 1 -- 172.21.15.82:0/2423025401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb406dd80 con 0x7f9bb4070900 2023-11-28T13:07:42.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.182+0000 7f9ba9ffb700 1 -- 172.21.15.82:0/2423025401 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9ba4019030 con 0x7f9bb4070900 2023-11-28T13:07:42.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.182+0000 7f9ba9ffb700 1 --2- 172.21.15.82:0/2423025401 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9b98064f10 0x7f9b980673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:42.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.182+0000 7f9ba9ffb700 1 -- 172.21.15.82:0/2423025401 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f9ba40810a0 con 0x7f9bb4070900 2023-11-28T13:07:42.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.182+0000 7f9bb8d76700 1 --2- 172.21.15.82:0/2423025401 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9b98064f10 0x7f9b980673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:42.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.182+0000 7f9bb8d76700 1 --2- 172.21.15.82:0/2423025401 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9b98064f10 0x7f9b980673c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40c4fb0 tx=0x7f9bac00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:42.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.190+0000 7f9ba9ffb700 1 -- 172.21.15.82:0/2423025401 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9ba404a400 con 0x7f9bb4070900 2023-11-28T13:07:42.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.366+0000 7f9bba579700 1 -- 172.21.15.82:0/2423025401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9bb4065fc0 con 0x7f9bb4070900 2023-11-28T13:07:42.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.366+0000 7f9ba9ffb700 1 -- 172.21.15.82:0/2423025401 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v67) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9ba4017080 con 0x7f9bb4070900 2023-11-28T13:07:42.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.366+0000 7f9bba579700 1 -- 172.21.15.82:0/2423025401 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9b98064f10 msgr2=0x7f9b980673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:42.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.366+0000 7f9bba579700 1 --2- 172.21.15.82:0/2423025401 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9b98064f10 0x7f9b980673c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40c4fb0 tx=0x7f9bac00b040 comp rx=0 tx=0).stop 2023-11-28T13:07:42.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.366+0000 7f9bba579700 1 -- 172.21.15.82:0/2423025401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bb4070900 msgr2=0x7f9bb40c4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:42.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.366+0000 7f9bba579700 1 --2- 172.21.15.82:0/2423025401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bb4070900 0x7f9bb40c4a70 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f9ba400c700 tx=0x7f9ba400ca10 comp rx=0 tx=0).stop 2023-11-28T13:07:42.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.366+0000 7f9bba579700 1 -- 172.21.15.82:0/2423025401 shutdown_connections 2023-11-28T13:07:42.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.366+0000 7f9bba579700 1 --2- 172.21.15.82:0/2423025401 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9b98064f10 0x7f9b980673c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:42.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.366+0000 7f9bba579700 1 --2- 172.21.15.82:0/2423025401 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bb415c2d0 0x7f9bb40c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:42.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.366+0000 7f9bba579700 1 --2- 172.21.15.82:0/2423025401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bb41586f0 0x7f9bb40c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:42.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.366+0000 7f9bba579700 1 --2- 172.21.15.82:0/2423025401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bb4070900 0x7f9bb40c4a70 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:42.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.366+0000 7f9bba579700 1 -- 172.21.15.82:0/2423025401 >> 172.21.15.82:0/2423025401 conn(0x7f9bb40ce600 msgr2=0x7f9bb406a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:42.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.366+0000 7f9bba579700 1 -- 172.21.15.82:0/2423025401 shutdown_connections 2023-11-28T13:07:42.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.366+0000 7f9bba579700 1 -- 172.21.15.82:0/2423025401 wait complete. 2023-11-28T13:07:42.376 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2023-11-28T13:07:42.387 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2023-11-28T13:07:42.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:07:42.387 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T13:07:42.395 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[51754]: fuse finished with error 0 and tester_r 0 2023-11-28T13:07:42.397 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-11-28T13:07:42.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:07:42.397 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T13:07:42.552 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:07:42.552 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:07:42.560 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19664 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T13:07:42.560 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-28T13:07:42.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:07:42.561 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T13:07:42.611 INFO:teuthology.orchestra.run.smithi114.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-28T13:07:42.611 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T13:07:42.612 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:07:42.612 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:07:42.620 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346276k,nr_inodes=4086569,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=221 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275484k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T13:07:42.620 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-11-28T13:07:42.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:07:42.621 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T13:07:42.669 INFO:teuthology.orchestra.run.smithi082.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-28T13:07:42.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T13:07:42.671 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:07:42.671 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:07:42.678 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19664 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T13:07:42.678 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-28T13:07:42.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:07:42.678 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T13:07:42.685 INFO:teuthology.orchestra.run.smithi114.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-28T13:07:42.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T13:07:42.686 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:07:42.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc734998700 1 Processor -- start 2023-11-28T13:07:42.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc734998700 1 -- start start 2023-11-28T13:07:42.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc734998700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc73006d820 0x7fc7300cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:42.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc734998700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc73015ddc0 con 0x7fc73006d3d0 2023-11-28T13:07:42.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc734998700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc73015e010 con 0x7fc73015a430 2023-11-28T13:07:42.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc734998700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc73006ced0 con 0x7fc73006d820 2023-11-28T13:07:42.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc72f59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc73006d820 0x7fc7300cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:42.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc727fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc73006d3d0 0x7fc7300ca4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:59454/0 (socket says 172.21.15.82:59454) 2023-11-28T13:07:42.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc727fff700 1 -- 172.21.15.82:0/1206385431 learned_addr learned my addr 172.21.15.82:0/1206385431 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:42.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc72e59c700 1 -- 172.21.15.82:0/1206385431 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1117404219 0 0) 0x7fc73015ddc0 con 0x7fc73006d3d0 2023-11-28T13:07:42.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc72f59e700 1 -- 172.21.15.82:0/1206385431 >> v1:172.21.15.114:6789/0 conn(0x7fc73015a430 legacy=0x7fc73006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:42.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc72f59e700 1 -- 172.21.15.82:0/1206385431 >> v1:172.21.15.82:6789/0 conn(0x7fc73006d3d0 legacy=0x7fc7300ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:42.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc72f59e700 1 -- 172.21.15.82:0/1206385431 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73015e2f0 con 0x7fc73006d820 2023-11-28T13:07:42.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc72f59e700 1 --2- 172.21.15.82:0/1206385431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc73006d820 0x7fc7300cabc0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc728009d90 tx=0x7fc72800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9489c4f96fd9ee8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc72e59c700 1 -- 172.21.15.82:0/1206385431 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72800e070 con 0x7fc73006d820 2023-11-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc72e59c700 1 -- 172.21.15.82:0/1206385431 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72800bbd0 con 0x7fc73006d820 2023-11-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc72e59c700 1 -- 172.21.15.82:0/1206385431 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc728012430 con 0x7fc73006d820 2023-11-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc734998700 1 -- 172.21.15.82:0/1206385431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc73006d820 msgr2=0x7fc7300cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc734998700 1 --2- 172.21.15.82:0/1206385431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc73006d820 0x7fc7300cabc0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc728009d90 tx=0x7fc72800b330 comp rx=0 tx=0).stop 2023-11-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc734998700 1 -- 172.21.15.82:0/1206385431 shutdown_connections 2023-11-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc734998700 1 --2- 172.21.15.82:0/1206385431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc73006d820 0x7fc7300cabc0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc734998700 1 -- 172.21.15.82:0/1206385431 >> 172.21.15.82:0/1206385431 conn(0x7fc7300cf710 msgr2=0x7fc7300cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc734998700 1 -- 172.21.15.82:0/1206385431 shutdown_connections 2023-11-28T13:07:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.802+0000 7fc734998700 1 -- 172.21.15.82:0/1206385431 wait complete. 2023-11-28T13:07:42.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.806+0000 7fc734998700 1 Processor -- start 2023-11-28T13:07:42.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.806+0000 7fc734998700 1 -- start start 2023-11-28T13:07:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.806+0000 7fc734998700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc73006d3d0 0x7fc730151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.806+0000 7fc734998700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc73006d820 0x7fc7300c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.806+0000 7fc734998700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7300c7050 0x7fc7300b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.806+0000 7fc734998700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73015bc40 con 0x7fc73006d3d0 2023-11-28T13:07:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.806+0000 7fc734998700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7300c75d0 con 0x7fc7300c7050 2023-11-28T13:07:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.806+0000 7fc734998700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7300c78b0 con 0x7fc73006d820 2023-11-28T13:07:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.806+0000 7fc72ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc73006d3d0 0x7fc730151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.806+0000 7fc72ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc73006d3d0 0x7fc730151810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46598/0 (socket says 172.21.15.82:46598) 2023-11-28T13:07:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.806+0000 7fc72ed9d700 1 -- 172.21.15.82:0/1655577569 learned_addr learned my addr 172.21.15.82:0/1655577569 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.806+0000 7fc72f59e700 1 --2- 172.21.15.82:0/1655577569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7300c7050 0x7fc7300b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:42.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.806+0000 7fc727fff700 1 --2- 172.21.15.82:0/1655577569 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc73006d820 0x7fc7300c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:42.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.810+0000 7fc72ed9d700 1 -- 172.21.15.82:0/1655577569 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc73006d820 msgr2=0x7fc7300c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:42.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.810+0000 7fc72ed9d700 1 --2- 172.21.15.82:0/1655577569 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc73006d820 0x7fc7300c6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:42.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.810+0000 7fc72ed9d700 1 -- 172.21.15.82:0/1655577569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7300c7050 msgr2=0x7fc7300b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:42.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.810+0000 7fc72ed9d700 1 --2- 172.21.15.82:0/1655577569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7300c7050 0x7fc7300b36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:42.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.810+0000 7fc72ed9d700 1 -- 172.21.15.82:0/1655577569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc728009a70 con 0x7fc73006d3d0 2023-11-28T13:07:42.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.810+0000 7fc72ed9d700 1 --2- 172.21.15.82:0/1655577569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc73006d3d0 0x7fc730151810 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc72000c500 tx=0x7fc72000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:42.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.810+0000 7fc7277fe700 1 -- 172.21.15.82:0/1655577569 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7200052d0 con 0x7fc73006d3d0 2023-11-28T13:07:42.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.810+0000 7fc7277fe700 1 -- 172.21.15.82:0/1655577569 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc720005430 con 0x7fc73006d3d0 2023-11-28T13:07:42.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.810+0000 7fc734998700 1 -- 172.21.15.82:0/1655577569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc73015e8b0 con 0x7fc73006d3d0 2023-11-28T13:07:42.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.810+0000 7fc7277fe700 1 -- 172.21.15.82:0/1655577569 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7200055a0 con 0x7fc73006d3d0 2023-11-28T13:07:42.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.810+0000 7fc734998700 1 -- 172.21.15.82:0/1655577569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc73015e5d0 con 0x7fc73006d3d0 2023-11-28T13:07:42.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.810+0000 7fc734998700 1 -- 172.21.15.82:0/1655577569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc73006dc30 con 0x7fc73006d3d0 2023-11-28T13:07:42.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.810+0000 7fc7277fe700 1 -- 172.21.15.82:0/1655577569 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc720019030 con 0x7fc73006d3d0 2023-11-28T13:07:42.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.814+0000 7fc7277fe700 1 --2- 172.21.15.82:0/1655577569 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc710064ee0 0x7fc710067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:42.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.814+0000 7fc7277fe700 1 -- 172.21.15.82:0/1655577569 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7fc720081160 con 0x7fc73006d3d0 2023-11-28T13:07:42.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.814+0000 7fc727fff700 1 --2- 172.21.15.82:0/1655577569 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc710064ee0 0x7fc710067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:42.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.814+0000 7fc727fff700 1 --2- 172.21.15.82:0/1655577569 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc710064ee0 0x7fc710067390 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc730152330 tx=0x7fc718004a70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:42.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:42.818+0000 7fc7277fe700 1 -- 172.21.15.82:0/1655577569 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc72004f280 con 0x7fc73006d3d0 2023-11-28T13:07:43.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.014+0000 7fc734998700 1 -- 172.21.15.82:0/1655577569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc730065fc0 con 0x7fc73006d3d0 2023-11-28T13:07:43.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.014+0000 7fc7277fe700 1 -- 172.21.15.82:0/1655577569 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4655 (secure 0 0 0) 0x7fc7200528a0 con 0x7fc73006d3d0 2023-11-28T13:07:43.020 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:07:43.020 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/3176308867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3176308867},{"type":"v1","addr":"172.21.15.114:6833","nonce":3176308867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6184,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1779270694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1779270694},{"type":"v1","addr":"172.21.15.114:6835","nonce":1779270694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1570999968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1570999968},{"type":"v1","addr":"172.21.15.82:6835","nonce":1570999968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:03:22.559646+0000","modified":"2023-11-28T13:03:34.920423+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":6,"addr":"172.21.15.82:6837/2902091405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2902091405},{"type":"v1","addr":"172.21.15.82:6837","nonce":2902091405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T13:07:43.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.014+0000 7fc734998700 1 -- 172.21.15.82:0/1655577569 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc710064ee0 msgr2=0x7fc710067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:43.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.014+0000 7fc734998700 1 --2- 172.21.15.82:0/1655577569 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc710064ee0 0x7fc710067390 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc730152330 tx=0x7fc718004a70 comp rx=0 tx=0).stop 2023-11-28T13:07:43.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.014+0000 7fc734998700 1 -- 172.21.15.82:0/1655577569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc73006d3d0 msgr2=0x7fc730151810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:43.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.014+0000 7fc734998700 1 --2- 172.21.15.82:0/1655577569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc73006d3d0 0x7fc730151810 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc72000c500 tx=0x7fc72000c810 comp rx=0 tx=0).stop 2023-11-28T13:07:43.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.014+0000 7fc734998700 1 -- 172.21.15.82:0/1655577569 shutdown_connections 2023-11-28T13:07:43.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.014+0000 7fc734998700 1 --2- 172.21.15.82:0/1655577569 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc710064ee0 0x7fc710067390 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.014+0000 7fc734998700 1 --2- 172.21.15.82:0/1655577569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7300c7050 0x7fc7300b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.014+0000 7fc734998700 1 --2- 172.21.15.82:0/1655577569 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc73006d820 0x7fc7300c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.014+0000 7fc734998700 1 --2- 172.21.15.82:0/1655577569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc73006d3d0 0x7fc730151810 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.014+0000 7fc734998700 1 -- 172.21.15.82:0/1655577569 >> 172.21.15.82:0/1655577569 conn(0x7fc7300cf710 msgr2=0x7fc7300b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:43.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.014+0000 7fc734998700 1 -- 172.21.15.82:0/1655577569 shutdown_connections 2023-11-28T13:07:43.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.014+0000 7fc734998700 1 -- 172.21.15.82:0/1655577569 wait complete. 2023-11-28T13:07:43.026 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2023-11-28T13:07:43.036 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:07:43.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e98e0f700 1 Processor -- start 2023-11-28T13:07:43.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e98e0f700 1 -- start start 2023-11-28T13:07:43.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e98e0f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1e94158200 0x7f1e9415c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:43.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e98e0f700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e94070850 con 0x7f1e940cc8e0 2023-11-28T13:07:43.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e98e0f700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9406c210 con 0x7f1e94070070 2023-11-28T13:07:43.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e98e0f700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9406c4f0 con 0x7f1e94158200 2023-11-28T13:07:43.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e93fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1e940cc8e0 0x7f1e9406d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:59468/0 (socket says 172.21.15.82:59468) 2023-11-28T13:07:43.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e93fff700 1 -- 172.21.15.82:0/2549961564 learned_addr learned my addr 172.21.15.82:0/2549961564 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:43.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e937fe700 1 --2- 172.21.15.82:0/2549961564 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1e94158200 0x7f1e9415c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:43.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e927fc700 1 -- 172.21.15.82:0/2549961564 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3469563279 0 0) 0x7f1e94070850 con 0x7f1e940cc8e0 2023-11-28T13:07:43.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e927fc700 1 -- 172.21.15.82:0/2549961564 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e800035d0 con 0x7f1e940cc8e0 2023-11-28T13:07:43.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e927fc700 1 -- 172.21.15.82:0/2549961564 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1670412407 0 0) 0x7f1e800035d0 con 0x7f1e940cc8e0 2023-11-28T13:07:43.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e927fc700 1 -- 172.21.15.82:0/2549961564 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1e94158200 msgr2=0x7f1e9415c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:43.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e927fc700 1 --2- 172.21.15.82:0/2549961564 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1e94158200 0x7f1e9415c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e927fc700 1 -- 172.21.15.82:0/2549961564 >> v1:172.21.15.114:6789/0 conn(0x7f1e94070070 legacy=0x7f1e940cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:43.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e927fc700 1 -- 172.21.15.82:0/2549961564 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9406c7d0 con 0x7f1e940cc8e0 2023-11-28T13:07:43.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e927fc700 1 -- 172.21.15.82:0/2549961564 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f1e8c001690 con 0x7f1e940cc8e0 2023-11-28T13:07:43.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e927fc700 1 -- 172.21.15.82:0/2549961564 >> v1:172.21.15.82:6789/0 conn(0x7f1e940cc8e0 legacy=0x7f1e9406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:43.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e927fc700 1 --2- 172.21.15.82:0/2549961564 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1e94158200 0x7f1e80003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:43.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e927fc700 1 --2- 172.21.15.82:0/2549961564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e80003f90 0x7f1e80004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:43.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e927fc700 1 --2- 172.21.15.82:0/2549961564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e80004db0 0x7f1e80005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:43.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e927fc700 1 -- 172.21.15.82:0/2549961564 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9406c4f0 con 0x7f1e80004db0 2023-11-28T13:07:43.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e927fc700 1 -- 172.21.15.82:0/2549961564 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8000ba60 con 0x7f1e80003f90 2023-11-28T13:07:43.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.138+0000 7f1e927fc700 1 -- 172.21.15.82:0/2549961564 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8000bc20 con 0x7f1e94158200 2023-11-28T13:07:43.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.142+0000 7f1e93fff700 1 --2- 172.21.15.82:0/2549961564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e80004db0 0x7f1e80005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:43.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.142+0000 7f1e92ffd700 1 --2- 172.21.15.82:0/2549961564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e80003f90 0x7f1e80004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:43.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.142+0000 7f1e937fe700 1 --2- 172.21.15.82:0/2549961564 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1e94158200 0x7f1e80003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:43.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.142+0000 7f1e93fff700 1 -- 172.21.15.82:0/2549961564 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1e94158200 msgr2=0x7f1e80003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:43.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.142+0000 7f1e93fff700 1 --2- 172.21.15.82:0/2549961564 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1e94158200 0x7f1e80003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.142+0000 7f1e93fff700 1 -- 172.21.15.82:0/2549961564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e80003f90 msgr2=0x7f1e80004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:43.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.142+0000 7f1e93fff700 1 --2- 172.21.15.82:0/2549961564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e80003f90 0x7f1e80004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.142+0000 7f1e93fff700 1 -- 172.21.15.82:0/2549961564 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e800035d0 con 0x7f1e80004db0 2023-11-28T13:07:43.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.142+0000 7f1e93fff700 1 --2- 172.21.15.82:0/2549961564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e80004db0 0x7f1e80005220 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f1e940c8c00 tx=0x7f1e800058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17388c70a66b572 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:43.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.142+0000 7f1e927fc700 1 -- 172.21.15.82:0/2549961564 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c00cdb0 con 0x7f1e80004db0 2023-11-28T13:07:43.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.142+0000 7f1e927fc700 1 -- 172.21.15.82:0/2549961564 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8c005980 con 0x7f1e80004db0 2023-11-28T13:07:43.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.142+0000 7f1e927fc700 1 -- 172.21.15.82:0/2549961564 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c005d10 con 0x7f1e80004db0 2023-11-28T13:07:43.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.142+0000 7f1e98e0f700 1 -- 172.21.15.82:0/2549961564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e80004db0 msgr2=0x7f1e80005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:43.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.142+0000 7f1e98e0f700 1 --2- 172.21.15.82:0/2549961564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e80004db0 0x7f1e80005220 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f1e940c8c00 tx=0x7f1e800058a0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.142+0000 7f1e93fff700 1 -- 172.21.15.82:0/2549961564 reap_dead start 2023-11-28T13:07:43.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.142+0000 7f1e98e0f700 1 -- 172.21.15.82:0/2549961564 shutdown_connections 2023-11-28T13:07:43.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.142+0000 7f1e98e0f700 1 -- 172.21.15.82:0/2549961564 >> 172.21.15.82:0/2549961564 conn(0x7f1e940ce600 msgr2=0x7f1e940ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:43.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.142+0000 7f1e98e0f700 1 -- 172.21.15.82:0/2549961564 shutdown_connections 2023-11-28T13:07:43.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.142+0000 7f1e98e0f700 1 -- 172.21.15.82:0/2549961564 wait complete. 2023-11-28T13:07:43.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.146+0000 7f1e98e0f700 1 Processor -- start 2023-11-28T13:07:43.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.146+0000 7f1e98e0f700 1 -- start start 2023-11-28T13:07:43.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.146+0000 7f1e98e0f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1e80004db0 0x7f1e94164300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:43.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.146+0000 7f1e98e0f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e9414a980 0x7f1e9414adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:43.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.146+0000 7f1e98e0f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e940ae120 0x7f1e940ae590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:43.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.146+0000 7f1e98e0f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9414b510 con 0x7f1e9414a980 2023-11-28T13:07:43.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.146+0000 7f1e98e0f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e940af080 con 0x7f1e940ae120 2023-11-28T13:07:43.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.146+0000 7f1e98e0f700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9414b330 con 0x7f1e80004db0 2023-11-28T13:07:43.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.150+0000 7f1e92ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e9414a980 0x7f1e9414adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:43.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.150+0000 7f1e92ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e9414a980 0x7f1e9414adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46610/0 (socket says 172.21.15.82:46610) 2023-11-28T13:07:43.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.150+0000 7f1e92ffd700 1 -- 172.21.15.82:0/3998471942 learned_addr learned my addr 172.21.15.82:0/3998471942 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:43.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.150+0000 7f1e937fe700 1 --2- 172.21.15.82:0/3998471942 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1e80004db0 0x7f1e94164300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:43.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.150+0000 7f1e93fff700 1 --2- 172.21.15.82:0/3998471942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e940ae120 0x7f1e940ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:43.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.150+0000 7f1e92ffd700 1 -- 172.21.15.82:0/3998471942 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1e80004db0 msgr2=0x7f1e94164300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:43.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.150+0000 7f1e92ffd700 1 --2- 172.21.15.82:0/3998471942 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1e80004db0 0x7f1e94164300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.150+0000 7f1e92ffd700 1 -- 172.21.15.82:0/3998471942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e940ae120 msgr2=0x7f1e940ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:43.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.150+0000 7f1e92ffd700 1 --2- 172.21.15.82:0/3998471942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e940ae120 0x7f1e940ae590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.150+0000 7f1e92ffd700 1 -- 172.21.15.82:0/3998471942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e940704c0 con 0x7f1e9414a980 2023-11-28T13:07:43.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.150+0000 7f1e92ffd700 1 --2- 172.21.15.82:0/3998471942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e9414a980 0x7f1e9414adf0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400d400 tx=0x7f1e8400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:43.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.150+0000 7f1e8bfff700 1 -- 172.21.15.82:0/3998471942 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8400dd20 con 0x7f1e9414a980 2023-11-28T13:07:43.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.150+0000 7f1e8bfff700 1 -- 172.21.15.82:0/3998471942 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8400de80 con 0x7f1e9414a980 2023-11-28T13:07:43.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.150+0000 7f1e98e0f700 1 -- 172.21.15.82:0/3998471942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e941585d0 con 0x7f1e9414a980 2023-11-28T13:07:43.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.150+0000 7f1e8bfff700 1 -- 172.21.15.82:0/3998471942 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e84003c60 con 0x7f1e9414a980 2023-11-28T13:07:43.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.150+0000 7f1e98e0f700 1 -- 172.21.15.82:0/3998471942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9406e160 con 0x7f1e9414a980 2023-11-28T13:07:43.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.150+0000 7f1e98e0f700 1 -- 172.21.15.82:0/3998471942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e940c1f40 con 0x7f1e9414a980 2023-11-28T13:07:43.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.150+0000 7f1e8bfff700 1 -- 172.21.15.82:0/3998471942 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1e840050d0 con 0x7f1e9414a980 2023-11-28T13:07:43.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.150+0000 7f1e8bfff700 1 --2- 172.21.15.82:0/3998471942 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1e74064ee0 0x7f1e74067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:43.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.150+0000 7f1e8bfff700 1 -- 172.21.15.82:0/3998471942 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f1e840825e0 con 0x7f1e9414a980 2023-11-28T13:07:43.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.150+0000 7f1e937fe700 1 --2- 172.21.15.82:0/3998471942 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1e74064ee0 0x7f1e74067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:43.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.154+0000 7f1e937fe700 1 --2- 172.21.15.82:0/3998471942 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1e74064ee0 0x7f1e74067390 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c009c70 tx=0x7f1e7c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:43.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.158+0000 7f1e8bfff700 1 -- 172.21.15.82:0/3998471942 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1e840507c0 con 0x7f1e9414a980 2023-11-28T13:07:43.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.322+0000 7f1e98e0f700 1 -- 172.21.15.82:0/3998471942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e94065fc0 con 0x7f1e9414a980 2023-11-28T13:07:43.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.326+0000 7f1e8bfff700 1 -- 172.21.15.82:0/3998471942 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+18032 (secure 0 0 0) 0x7f1e84002000 con 0x7f1e9414a980 2023-11-28T13:07:43.333 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:07:43.333 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":67,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:04:10.914507+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:03:21.126074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T13:03:21.545268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.d","mappings":[{"from":7,"to":2}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.c","mappings":[{"from":4,"to":5},{"from":7,"to":3}]},{"pgid":"10.d","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:07:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.326+0000 7f1e98e0f700 1 -- 172.21.15.82:0/3998471942 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1e74064ee0 msgr2=0x7f1e74067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.326+0000 7f1e98e0f700 1 --2- 172.21.15.82:0/3998471942 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1e74064ee0 0x7f1e74067390 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c009c70 tx=0x7f1e7c009240 comp rx=0 tx=0).stop 2023-11-28T13:07:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.326+0000 7f1e98e0f700 1 -- 172.21.15.82:0/3998471942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e9414a980 msgr2=0x7f1e9414adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.326+0000 7f1e98e0f700 1 --2- 172.21.15.82:0/3998471942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e9414a980 0x7f1e9414adf0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400d400 tx=0x7f1e8400d710 comp rx=0 tx=0).stop 2023-11-28T13:07:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.326+0000 7f1e98e0f700 1 -- 172.21.15.82:0/3998471942 shutdown_connections 2023-11-28T13:07:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.326+0000 7f1e98e0f700 1 --2- 172.21.15.82:0/3998471942 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1e74064ee0 0x7f1e74067390 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.326+0000 7f1e98e0f700 1 --2- 172.21.15.82:0/3998471942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e940ae120 0x7f1e940ae590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.326+0000 7f1e98e0f700 1 --2- 172.21.15.82:0/3998471942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e9414a980 0x7f1e9414adf0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.326+0000 7f1e98e0f700 1 --2- 172.21.15.82:0/3998471942 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1e80004db0 0x7f1e94164300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.326+0000 7f1e98e0f700 1 -- 172.21.15.82:0/3998471942 >> 172.21.15.82:0/3998471942 conn(0x7f1e940ce600 msgr2=0x7f1e94159680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:43.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.326+0000 7f1e98e0f700 1 -- 172.21.15.82:0/3998471942 shutdown_connections 2023-11-28T13:07:43.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.326+0000 7f1e98e0f700 1 -- 172.21.15.82:0/3998471942 wait complete. 2023-11-28T13:07:43.348 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T13:00:15.214655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T13:00:19.939981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T13:03:21.126074+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T13:03:21.545268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T13:07:43.349 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T13:07:43.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.458+0000 7f1344e14700 1 Processor -- start 2023-11-28T13:07:43.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f1344e14700 1 -- start start 2023-11-28T13:07:43.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f1344e14700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f134006b180 0x7f13401608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:43.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f1344e14700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13400c79a0 0x7f13400c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:43.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f1344e14700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13400c82e0 con 0x7f13401568b0 2023-11-28T13:07:43.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f1344e14700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1340156c80 con 0x7f134006b180 2023-11-28T13:07:43.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f1344e14700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1340071f30 con 0x7f13400c79a0 2023-11-28T13:07:43.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f133f7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f13401568b0 0x7f1340071650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:59480/0 (socket says 172.21.15.82:59480) 2023-11-28T13:07:43.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f133f7fe700 1 -- 172.21.15.82:0/1097909042 learned_addr learned my addr 172.21.15.82:0/1097909042 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:43.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f133effd700 1 --2- 172.21.15.82:0/1097909042 >> v2:172.21.15.114:3300/0 conn(0x7f134006b180 0x7f13401608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:43.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f133ffff700 1 --2- 172.21.15.82:0/1097909042 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13400c79a0 0x7f13400c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:43.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f133e7fc700 1 -- 172.21.15.82:0/1097909042 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835199912 0 0) 0x7f13400c82e0 con 0x7f13401568b0 2023-11-28T13:07:43.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f133e7fc700 1 -- 172.21.15.82:0/1097909042 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13280035d0 con 0x7f13401568b0 2023-11-28T13:07:43.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f133e7fc700 1 -- 172.21.15.82:0/1097909042 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3808343728 0 0) 0x7f13280035d0 con 0x7f13401568b0 2023-11-28T13:07:43.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f133effd700 1 -- 172.21.15.82:0/1097909042 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13400c79a0 msgr2=0x7f13400c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:43.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f133effd700 1 --2- 172.21.15.82:0/1097909042 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13400c79a0 0x7f13400c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f133effd700 1 -- 172.21.15.82:0/1097909042 >> v1:172.21.15.82:6789/0 conn(0x7f13401568b0 legacy=0x7f1340071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:43.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f133effd700 1 -- 172.21.15.82:0/1097909042 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1340072210 con 0x7f134006b180 2023-11-28T13:07:43.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f133effd700 1 --2- 172.21.15.82:0/1097909042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f134006b180 0x7f13401608a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1330009850 tx=0x7f1330009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d35cce7596a0dcf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:43.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f133e7fc700 1 -- 172.21.15.82:0/1097909042 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1334001690 con 0x7f134006b180 2023-11-28T13:07:43.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f133e7fc700 1 -- 172.21.15.82:0/1097909042 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1330004030 con 0x7f134006b180 2023-11-28T13:07:43.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f133e7fc700 1 -- 172.21.15.82:0/1097909042 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13300043a0 con 0x7f134006b180 2023-11-28T13:07:43.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f1344e14700 1 -- 172.21.15.82:0/1097909042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f134006b180 msgr2=0x7f13401608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:43.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f1344e14700 1 --2- 172.21.15.82:0/1097909042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f134006b180 0x7f13401608a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1330009850 tx=0x7f1330009b60 comp rx=0 tx=0).stop 2023-11-28T13:07:43.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f1344e14700 1 -- 172.21.15.82:0/1097909042 shutdown_connections 2023-11-28T13:07:43.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f1344e14700 1 --2- 172.21.15.82:0/1097909042 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13400c79a0 0x7f13400c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f1344e14700 1 --2- 172.21.15.82:0/1097909042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f134006b180 0x7f13401608a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f1344e14700 1 -- 172.21.15.82:0/1097909042 >> 172.21.15.82:0/1097909042 conn(0x7f13400ce630 msgr2=0x7f13400cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:43.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f1344e14700 1 -- 172.21.15.82:0/1097909042 shutdown_connections 2023-11-28T13:07:43.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.462+0000 7f1344e14700 1 -- 172.21.15.82:0/1097909042 wait complete. 2023-11-28T13:07:43.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f1344e14700 1 Processor -- start 2023-11-28T13:07:43.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f1344e14700 1 -- start start 2023-11-28T13:07:43.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f1344e14700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f134006b180 0x7f13400cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:43.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f1344e14700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13400c79a0 0x7f134014af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:43.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f1344e14700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13401568b0 0x7f13401f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:43.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f1344e14700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13400cb040 con 0x7f13400c79a0 2023-11-28T13:07:43.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f1344e14700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13400cdf20 con 0x7f13401568b0 2023-11-28T13:07:43.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f1344e14700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1340150ac0 con 0x7f134006b180 2023-11-28T13:07:43.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f133effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13400c79a0 0x7f134014af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:43.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f133effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13400c79a0 0x7f134014af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46624/0 (socket says 172.21.15.82:46624) 2023-11-28T13:07:43.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f133effd700 1 -- 172.21.15.82:0/1809847163 learned_addr learned my addr 172.21.15.82:0/1809847163 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:43.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f133ffff700 1 --2- 172.21.15.82:0/1809847163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13401568b0 0x7f13401f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:43.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f133f7fe700 1 --2- 172.21.15.82:0/1809847163 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f134006b180 0x7f13400cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:43.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f133effd700 1 -- 172.21.15.82:0/1809847163 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f134006b180 msgr2=0x7f13400cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:43.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f133effd700 1 --2- 172.21.15.82:0/1809847163 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f134006b180 0x7f13400cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f133effd700 1 -- 172.21.15.82:0/1809847163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13401568b0 msgr2=0x7f13401f4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:43.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f133effd700 1 --2- 172.21.15.82:0/1809847163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13401568b0 0x7f13401f4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f133effd700 1 -- 172.21.15.82:0/1809847163 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13300094b0 con 0x7f13400c79a0 2023-11-28T13:07:43.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f133ffff700 1 --2- 172.21.15.82:0/1809847163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13401568b0 0x7f13401f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:07:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f133effd700 1 --2- 172.21.15.82:0/1809847163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13400c79a0 0x7f134014af60 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f13300090b0 tx=0x7f1330004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f1327fff700 1 -- 172.21.15.82:0/1809847163 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1330004590 con 0x7f13400c79a0 2023-11-28T13:07:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f1327fff700 1 -- 172.21.15.82:0/1809847163 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133001f070 con 0x7f13400c79a0 2023-11-28T13:07:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f1344e14700 1 -- 172.21.15.82:0/1809847163 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13401600a0 con 0x7f13400c79a0 2023-11-28T13:07:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.466+0000 7f1327fff700 1 -- 172.21.15.82:0/1809847163 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1330011850 con 0x7f13400c79a0 2023-11-28T13:07:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.470+0000 7f1344e14700 1 -- 172.21.15.82:0/1809847163 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134015fdc0 con 0x7f13400c79a0 2023-11-28T13:07:43.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.470+0000 7f1344e14700 1 -- 172.21.15.82:0/1809847163 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1340160380 con 0x7f13400c79a0 2023-11-28T13:07:43.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.470+0000 7f1327fff700 1 -- 172.21.15.82:0/1809847163 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1330017020 con 0x7f13400c79a0 2023-11-28T13:07:43.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.470+0000 7f1327fff700 1 --2- 172.21.15.82:0/1809847163 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f132c064ee0 0x7f132c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:43.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.470+0000 7f133f7fe700 1 --2- 172.21.15.82:0/1809847163 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f132c064ee0 0x7f132c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:43.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.470+0000 7f1327fff700 1 -- 172.21.15.82:0/1809847163 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f1330021070 con 0x7f13400c79a0 2023-11-28T13:07:43.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.470+0000 7f133f7fe700 1 --2- 172.21.15.82:0/1809847163 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f132c064ee0 0x7f132c067390 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f134015d8a0 tx=0x7f1334000ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:43.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.478+0000 7f1327fff700 1 -- 172.21.15.82:0/1809847163 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f13300519d0 con 0x7f13400c79a0 2023-11-28T13:07:43.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.642+0000 7f1344e14700 1 -- 172.21.15.82:0/1809847163 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1340065fc0 con 0x7f13400c79a0 2023-11-28T13:07:43.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.642+0000 7f1327fff700 1 -- 172.21.15.82:0/1809847163 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1330054ff0 con 0x7f13400c79a0 2023-11-28T13:07:43.658 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-11-28T13:07:43.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.642+0000 7f1344e14700 1 -- 172.21.15.82:0/1809847163 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f132c064ee0 msgr2=0x7f132c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:43.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.642+0000 7f1344e14700 1 --2- 172.21.15.82:0/1809847163 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f132c064ee0 0x7f132c067390 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f134015d8a0 tx=0x7f1334000ed0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.642+0000 7f1344e14700 1 -- 172.21.15.82:0/1809847163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13400c79a0 msgr2=0x7f134014af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:43.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.642+0000 7f1344e14700 1 --2- 172.21.15.82:0/1809847163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13400c79a0 0x7f134014af60 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f13300090b0 tx=0x7f1330004770 comp rx=0 tx=0).stop 2023-11-28T13:07:43.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.642+0000 7f1344e14700 1 -- 172.21.15.82:0/1809847163 shutdown_connections 2023-11-28T13:07:43.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.642+0000 7f1344e14700 1 --2- 172.21.15.82:0/1809847163 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f132c064ee0 0x7f132c067390 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.642+0000 7f1344e14700 1 --2- 172.21.15.82:0/1809847163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13401568b0 0x7f13401f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.642+0000 7f1344e14700 1 --2- 172.21.15.82:0/1809847163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13400c79a0 0x7f134014af60 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.642+0000 7f1344e14700 1 --2- 172.21.15.82:0/1809847163 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f134006b180 0x7f13400cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.642+0000 7f1344e14700 1 -- 172.21.15.82:0/1809847163 >> 172.21.15.82:0/1809847163 conn(0x7f13400ce630 msgr2=0x7f134014ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:43.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.642+0000 7f1344e14700 1 -- 172.21.15.82:0/1809847163 shutdown_connections 2023-11-28T13:07:43.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.642+0000 7f1344e14700 1 -- 172.21.15.82:0/1809847163 wait complete. 2023-11-28T13:07:43.663 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T13:07:43.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.774+0000 7f9a23fff700 1 Processor -- start 2023-11-28T13:07:43.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.774+0000 7f9a23fff700 1 -- start start 2023-11-28T13:07:43.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a23fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a24158eb0 0x7f9a240c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:43.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a23fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a240b0c70 0x7f9a2415c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:43.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a23fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a240ad9b0 con 0x7f9a240ae090 2023-11-28T13:07:43.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a23fff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a240adee0 con 0x7f9a24158eb0 2023-11-28T13:07:43.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a23fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a24159280 con 0x7f9a240b0c70 2023-11-28T13:07:43.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a22ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a24158eb0 0x7f9a240c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:43.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a22ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a24158eb0 0x7f9a240c8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46634/0 (socket says 172.21.15.82:46634) 2023-11-28T13:07:43.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a22ffd700 1 -- 172.21.15.82:0/3580669604 learned_addr learned my addr 172.21.15.82:0/3580669604 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a237fe700 1 --2- 172.21.15.82:0/3580669604 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a240b0c70 0x7f9a2415c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a22ffd700 1 -- 172.21.15.82:0/3580669604 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a240b0c70 msgr2=0x7f9a2415c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a22ffd700 1 --2- 172.21.15.82:0/3580669604 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a240b0c70 0x7f9a2415c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a22ffd700 1 -- 172.21.15.82:0/3580669604 >> v1:172.21.15.114:6789/0 conn(0x7f9a240ae090 legacy=0x7f9a240b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a22ffd700 1 -- 172.21.15.82:0/3580669604 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a24069e60 con 0x7f9a24158eb0 2023-11-28T13:07:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a237fe700 1 --2- 172.21.15.82:0/3580669604 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a240b0c70 0x7f9a2415c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:07:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a22ffd700 1 --2- 172.21.15.82:0/3580669604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a24158eb0 0x7f9a240c8c80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00d150 tx=0x7f9a1c00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25998c66717879b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a21ffb700 1 -- 172.21.15.82:0/3580669604 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c010070 con 0x7f9a24158eb0 2023-11-28T13:07:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a21ffb700 1 -- 172.21.15.82:0/3580669604 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1c00ddc0 con 0x7f9a24158eb0 2023-11-28T13:07:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a21ffb700 1 -- 172.21.15.82:0/3580669604 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c00b310 con 0x7f9a24158eb0 2023-11-28T13:07:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a23fff700 1 -- 172.21.15.82:0/3580669604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a24158eb0 msgr2=0x7f9a240c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a23fff700 1 --2- 172.21.15.82:0/3580669604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a24158eb0 0x7f9a240c8c80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00d150 tx=0x7f9a1c00d460 comp rx=0 tx=0).stop 2023-11-28T13:07:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a23fff700 1 -- 172.21.15.82:0/3580669604 shutdown_connections 2023-11-28T13:07:43.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a23fff700 1 --2- 172.21.15.82:0/3580669604 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a240b0c70 0x7f9a2415c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a23fff700 1 --2- 172.21.15.82:0/3580669604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a24158eb0 0x7f9a240c8c80 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a23fff700 1 -- 172.21.15.82:0/3580669604 >> 172.21.15.82:0/3580669604 conn(0x7f9a240ce630 msgr2=0x7f9a240cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a23fff700 1 -- 172.21.15.82:0/3580669604 shutdown_connections 2023-11-28T13:07:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.778+0000 7f9a23fff700 1 -- 172.21.15.82:0/3580669604 wait complete. 2023-11-28T13:07:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a23fff700 1 Processor -- start 2023-11-28T13:07:43.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a23fff700 1 -- start start 2023-11-28T13:07:43.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a23fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a240ae090 0x7f9a2414af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:43.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a23fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a240b0c70 0x7f9a240b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:43.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a23fff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a24158eb0 0x7f9a24153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:43.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a23fff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a240cc1d0 con 0x7f9a240ae090 2023-11-28T13:07:43.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a23fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a240cb130 con 0x7f9a240b0c70 2023-11-28T13:07:43.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a23fff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a240cb410 con 0x7f9a24158eb0 2023-11-28T13:07:43.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a22ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a240ae090 0x7f9a2414af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:43.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a22ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a240ae090 0x7f9a2414af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46640/0 (socket says 172.21.15.82:46640) 2023-11-28T13:07:43.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a22ffd700 1 -- 172.21.15.82:0/3253748642 learned_addr learned my addr 172.21.15.82:0/3253748642 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:43.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a227fc700 1 --2- 172.21.15.82:0/3253748642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a240b0c70 0x7f9a240b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:43.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a237fe700 1 --2- 172.21.15.82:0/3253748642 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a24158eb0 0x7f9a24153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:43.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a22ffd700 1 -- 172.21.15.82:0/3253748642 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a24158eb0 msgr2=0x7f9a24153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:43.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a22ffd700 1 --2- 172.21.15.82:0/3253748642 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a24158eb0 0x7f9a24153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a22ffd700 1 -- 172.21.15.82:0/3253748642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a240b0c70 msgr2=0x7f9a240b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:43.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a22ffd700 1 --2- 172.21.15.82:0/3253748642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a240b0c70 0x7f9a240b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a22ffd700 1 -- 172.21.15.82:0/3253748642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c00bd40 con 0x7f9a240ae090 2023-11-28T13:07:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a227fc700 1 --2- 172.21.15.82:0/3253748642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a240b0c70 0x7f9a240b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:07:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a22ffd700 1 --2- 172.21.15.82:0/3253748642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a240ae090 0x7f9a2414af60 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f9a2406bdd0 tx=0x7f9a1c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a1b7fe700 1 -- 172.21.15.82:0/3253748642 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c009a10 con 0x7f9a240ae090 2023-11-28T13:07:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a1b7fe700 1 -- 172.21.15.82:0/3253748642 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1c009bb0 con 0x7f9a240ae090 2023-11-28T13:07:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a23fff700 1 -- 172.21.15.82:0/3253748642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a24071c90 con 0x7f9a240ae090 2023-11-28T13:07:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a1b7fe700 1 -- 172.21.15.82:0/3253748642 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c00b4c0 con 0x7f9a240ae090 2023-11-28T13:07:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.782+0000 7f9a23fff700 1 -- 172.21.15.82:0/3253748642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a240adc00 con 0x7f9a240ae090 2023-11-28T13:07:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.786+0000 7f9a23fff700 1 -- 172.21.15.82:0/3253748642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a24071f70 con 0x7f9a240ae090 2023-11-28T13:07:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.786+0000 7f9a1b7fe700 1 -- 172.21.15.82:0/3253748642 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9a1c023030 con 0x7f9a240ae090 2023-11-28T13:07:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.786+0000 7f9a1b7fe700 1 --2- 172.21.15.82:0/3253748642 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9a04064f10 0x7f9a040673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.786+0000 7f9a1b7fe700 1 -- 172.21.15.82:0/3253748642 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f9a1c083a20 con 0x7f9a240ae090 2023-11-28T13:07:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.786+0000 7f9a227fc700 1 --2- 172.21.15.82:0/3253748642 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9a04064f10 0x7f9a040673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.786+0000 7f9a227fc700 1 --2- 172.21.15.82:0/3253748642 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9a04064f10 0x7f9a040673c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9a2415c550 tx=0x7f9a0c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:43.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.794+0000 7f9a1b7fe700 1 -- 172.21.15.82:0/3253748642 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9a1c0519d0 con 0x7f9a240ae090 2023-11-28T13:07:43.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.954+0000 7f9a23fff700 1 -- 172.21.15.82:0/3253748642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9a24065fc0 con 0x7f9a240ae090 2023-11-28T13:07:43.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.958+0000 7f9a1b7fe700 1 -- 172.21.15.82:0/3253748642 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v67) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9a1c054ff0 con 0x7f9a240ae090 2023-11-28T13:07:43.964 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-11-28T13:07:43.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.958+0000 7f9a23fff700 1 -- 172.21.15.82:0/3253748642 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9a04064f10 msgr2=0x7f9a040673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:43.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.958+0000 7f9a23fff700 1 --2- 172.21.15.82:0/3253748642 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9a04064f10 0x7f9a040673c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9a2415c550 tx=0x7f9a0c009040 comp rx=0 tx=0).stop 2023-11-28T13:07:43.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.958+0000 7f9a23fff700 1 -- 172.21.15.82:0/3253748642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a240ae090 msgr2=0x7f9a2414af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:43.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.958+0000 7f9a23fff700 1 --2- 172.21.15.82:0/3253748642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a240ae090 0x7f9a2414af60 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f9a2406bdd0 tx=0x7f9a1c004af0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.958+0000 7f9a23fff700 1 -- 172.21.15.82:0/3253748642 shutdown_connections 2023-11-28T13:07:43.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.958+0000 7f9a23fff700 1 --2- 172.21.15.82:0/3253748642 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9a04064f10 0x7f9a040673c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.958+0000 7f9a23fff700 1 --2- 172.21.15.82:0/3253748642 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a24158eb0 0x7f9a24153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.958+0000 7f9a23fff700 1 --2- 172.21.15.82:0/3253748642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a240b0c70 0x7f9a240b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.958+0000 7f9a23fff700 1 --2- 172.21.15.82:0/3253748642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a240ae090 0x7f9a2414af60 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:43.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.958+0000 7f9a23fff700 1 -- 172.21.15.82:0/3253748642 >> 172.21.15.82:0/3253748642 conn(0x7f9a240ce630 msgr2=0x7f9a24158180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:43.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.958+0000 7f9a23fff700 1 -- 172.21.15.82:0/3253748642 shutdown_connections 2023-11-28T13:07:43.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:43.958+0000 7f9a23fff700 1 -- 172.21.15.82:0/3253748642 wait complete. 2023-11-28T13:07:43.979 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T13:07:44.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.090+0000 7f58c3571700 1 Processor -- start 2023-11-28T13:07:44.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.090+0000 7f58c3571700 1 -- start start 2023-11-28T13:07:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.090+0000 7f58c3571700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f58bc070890 0x7f58bc06b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.090+0000 7f58c3571700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f58bc070c60 0x7f58bc0b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.090+0000 7f58c3571700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58bc06beb0 con 0x7f58bc0cbca0 2023-11-28T13:07:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.090+0000 7f58c3571700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58bc06a8d0 con 0x7f58bc070c60 2023-11-28T13:07:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.090+0000 7f58c3571700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58bc06abb0 con 0x7f58bc070890 2023-11-28T13:07:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.090+0000 7f58c1d6e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f58bc070c60 0x7f58bc0b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.090+0000 7f58c2d70700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f58bc0cbca0 0x7f58bc0cc100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:59486/0 (socket says 172.21.15.82:59486) 2023-11-28T13:07:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.090+0000 7f58c2d70700 1 -- 172.21.15.82:0/4088490285 learned_addr learned my addr 172.21.15.82:0/4088490285 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.090+0000 7f58c256f700 1 --2- 172.21.15.82:0/4088490285 >> v2:172.21.15.114:3300/0 conn(0x7f58bc070890 0x7f58bc06b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:44.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.090+0000 7f58c1d6e700 1 -- 172.21.15.82:0/4088490285 >> v2:172.21.15.114:3300/0 conn(0x7f58bc070890 msgr2=0x7f58bc06b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:44.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.090+0000 7f58c1d6e700 1 --2- 172.21.15.82:0/4088490285 >> v2:172.21.15.114:3300/0 conn(0x7f58bc070890 0x7f58bc06b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.094+0000 7f58c1d6e700 1 -- 172.21.15.82:0/4088490285 >> v1:172.21.15.82:6789/0 conn(0x7f58bc0cbca0 legacy=0x7f58bc0cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:44.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.094+0000 7f58c156d700 1 -- 172.21.15.82:0/4088490285 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997797882 0 0) 0x7f58bc06beb0 con 0x7f58bc0cbca0 2023-11-28T13:07:44.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.094+0000 7f58c1d6e700 1 -- 172.21.15.82:0/4088490285 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc06ae90 con 0x7f58bc070c60 2023-11-28T13:07:44.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.094+0000 7f58c1d6e700 1 --2- 172.21.15.82:0/4088490285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58bc070c60 0x7f58bc0b2cd0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0cfae0 tx=0x7f58ac009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894b2692a4787638 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:44.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.094+0000 7f58c156d700 1 -- 172.21.15.82:0/4088490285 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac011830 con 0x7f58bc070c60 2023-11-28T13:07:44.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.094+0000 7f58c156d700 1 -- 172.21.15.82:0/4088490285 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ac011990 con 0x7f58bc070c60 2023-11-28T13:07:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.094+0000 7f58c156d700 1 -- 172.21.15.82:0/4088490285 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac011d20 con 0x7f58bc070c60 2023-11-28T13:07:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.094+0000 7f58c3571700 1 -- 172.21.15.82:0/4088490285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58bc070c60 msgr2=0x7f58bc0b2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.094+0000 7f58c3571700 1 --2- 172.21.15.82:0/4088490285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58bc070c60 0x7f58bc0b2cd0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0cfae0 tx=0x7f58ac009b30 comp rx=0 tx=0).stop 2023-11-28T13:07:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.094+0000 7f58c3571700 1 -- 172.21.15.82:0/4088490285 shutdown_connections 2023-11-28T13:07:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.094+0000 7f58c3571700 1 --2- 172.21.15.82:0/4088490285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58bc070c60 0x7f58bc0b2cd0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.094+0000 7f58c3571700 1 --2- 172.21.15.82:0/4088490285 >> v2:172.21.15.114:3300/0 conn(0x7f58bc070890 0x7f58bc06b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.094+0000 7f58c3571700 1 -- 172.21.15.82:0/4088490285 >> 172.21.15.82:0/4088490285 conn(0x7f58bc0cee90 msgr2=0x7f58bc0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.094+0000 7f58c3571700 1 -- 172.21.15.82:0/4088490285 shutdown_connections 2023-11-28T13:07:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.094+0000 7f58c3571700 1 -- 172.21.15.82:0/4088490285 wait complete. 2023-11-28T13:07:44.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.094+0000 7f58c3571700 1 Processor -- start 2023-11-28T13:07:44.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58c3571700 1 -- start start 2023-11-28T13:07:44.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58c3571700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58bc070890 0x7f58bc1497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:44.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58c3571700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58bc070c60 0x7f58bc149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:44.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58c3571700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58bc0cbca0 0x7f58bc0cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:44.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58c3571700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc149570 con 0x7f58bc070890 2023-11-28T13:07:44.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58c3571700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc149da0 con 0x7f58bc070c60 2023-11-28T13:07:44.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58c3571700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc0c9c70 con 0x7f58bc0cbca0 2023-11-28T13:07:44.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58c256f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58bc070890 0x7f58bc1497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:44.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58c256f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58bc070890 0x7f58bc1497c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46658/0 (socket says 172.21.15.82:46658) 2023-11-28T13:07:44.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58c256f700 1 -- 172.21.15.82:0/3864291545 learned_addr learned my addr 172.21.15.82:0/3864291545 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58c1d6e700 1 --2- 172.21.15.82:0/3864291545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58bc070c60 0x7f58bc149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58c2d70700 1 --2- 172.21.15.82:0/3864291545 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58bc0cbca0 0x7f58bc0cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58c256f700 1 -- 172.21.15.82:0/3864291545 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58bc0cbca0 msgr2=0x7f58bc0cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58c256f700 1 --2- 172.21.15.82:0/3864291545 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58bc0cbca0 0x7f58bc0cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58c256f700 1 -- 172.21.15.82:0/3864291545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58bc070c60 msgr2=0x7f58bc149030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58c256f700 1 --2- 172.21.15.82:0/3864291545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58bc070c60 0x7f58bc149030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58c256f700 1 -- 172.21.15.82:0/3864291545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac0094b0 con 0x7f58bc070890 2023-11-28T13:07:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58c256f700 1 --2- 172.21.15.82:0/3864291545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58bc070890 0x7f58bc1497c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f58b800e9d0 tx=0x7f58b800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58b2ffd700 1 -- 172.21.15.82:0/3864291545 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8009720 con 0x7f58bc070890 2023-11-28T13:07:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58b2ffd700 1 -- 172.21.15.82:0/3864291545 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b800ee70 con 0x7f58bc070890 2023-11-28T13:07:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58c3571700 1 -- 172.21.15.82:0/3864291545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58bc06b450 con 0x7f58bc070890 2023-11-28T13:07:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58b2ffd700 1 -- 172.21.15.82:0/3864291545 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b800ca50 con 0x7f58bc070890 2023-11-28T13:07:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.098+0000 7f58c3571700 1 -- 172.21.15.82:0/3864291545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58bc06b170 con 0x7f58bc070890 2023-11-28T13:07:44.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.102+0000 7f58c3571700 1 -- 172.21.15.82:0/3864291545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58bc0b3210 con 0x7f58bc070890 2023-11-28T13:07:44.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.102+0000 7f58b2ffd700 1 -- 172.21.15.82:0/3864291545 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f58b8019030 con 0x7f58bc070890 2023-11-28T13:07:44.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.102+0000 7f58b2ffd700 1 --2- 172.21.15.82:0/3864291545 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f58a0064f10 0x7f58a00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.102+0000 7f58c1d6e700 1 --2- 172.21.15.82:0/3864291545 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f58a0064f10 0x7f58a00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.102+0000 7f58b2ffd700 1 -- 172.21.15.82:0/3864291545 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f58b8081d70 con 0x7f58bc070890 2023-11-28T13:07:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.102+0000 7f58c1d6e700 1 --2- 172.21.15.82:0/3864291545 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f58a0064f10 0x7f58a00673c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0090b0 tx=0x7f58ac008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:44.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.110+0000 7f58b2ffd700 1 -- 172.21.15.82:0/3864291545 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f58b804fe90 con 0x7f58bc070890 2023-11-28T13:07:44.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.274+0000 7f58c3571700 1 -- 172.21.15.82:0/3864291545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f58bc065fc0 con 0x7f58bc070890 2023-11-28T13:07:44.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.274+0000 7f58b2ffd700 1 -- 172.21.15.82:0/3864291545 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v67) v1 ==== 104+0+11 (secure 0 0 0) 0x7f58b80534b0 con 0x7f58bc070890 2023-11-28T13:07:44.280 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-11-28T13:07:44.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.274+0000 7f58c3571700 1 -- 172.21.15.82:0/3864291545 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f58a0064f10 msgr2=0x7f58a00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:44.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.274+0000 7f58c3571700 1 --2- 172.21.15.82:0/3864291545 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f58a0064f10 0x7f58a00673c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0090b0 tx=0x7f58ac008030 comp rx=0 tx=0).stop 2023-11-28T13:07:44.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.274+0000 7f58c3571700 1 -- 172.21.15.82:0/3864291545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58bc070890 msgr2=0x7f58bc1497c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:44.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.274+0000 7f58c3571700 1 --2- 172.21.15.82:0/3864291545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58bc070890 0x7f58bc1497c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f58b800e9d0 tx=0x7f58b800ece0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.274+0000 7f58c3571700 1 -- 172.21.15.82:0/3864291545 shutdown_connections 2023-11-28T13:07:44.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.274+0000 7f58c3571700 1 --2- 172.21.15.82:0/3864291545 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f58a0064f10 0x7f58a00673c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.274+0000 7f58c3571700 1 --2- 172.21.15.82:0/3864291545 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58bc0cbca0 0x7f58bc0cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.274+0000 7f58c3571700 1 --2- 172.21.15.82:0/3864291545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58bc070c60 0x7f58bc149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.274+0000 7f58c3571700 1 --2- 172.21.15.82:0/3864291545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58bc070890 0x7f58bc1497c0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.274+0000 7f58c3571700 1 -- 172.21.15.82:0/3864291545 >> 172.21.15.82:0/3864291545 conn(0x7f58bc0cee90 msgr2=0x7f58bc072b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:44.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.274+0000 7f58c3571700 1 -- 172.21.15.82:0/3864291545 shutdown_connections 2023-11-28T13:07:44.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.274+0000 7f58c3571700 1 -- 172.21.15.82:0/3864291545 wait complete. 2023-11-28T13:07:44.295 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T13:07:44.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.406+0000 7f6860da5700 1 Processor -- start 2023-11-28T13:07:44.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.406+0000 7f6860da5700 1 -- start start 2023-11-28T13:07:44.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.406+0000 7f6860da5700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f685c0ced60 0x7f685c06b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:44.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.406+0000 7f6860da5700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f685c06bd40 0x7f685c0d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:44.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.406+0000 7f6860da5700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685c06af10 con 0x7f685c15fcb0 2023-11-28T13:07:44.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.406+0000 7f6860da5700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685c0cf1e0 con 0x7f685c0ced60 2023-11-28T13:07:44.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.406+0000 7f6860da5700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685c06c1c0 con 0x7f685c06bd40 2023-11-28T13:07:44.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.406+0000 7f6859d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f685c0ced60 0x7f685c06b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:44.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.406+0000 7f685ad9d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f685c06bd40 0x7f685c0d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:44.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.406+0000 7f6859d9b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f685c0ced60 0x7f685c06b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46668/0 (socket says 172.21.15.82:46668) 2023-11-28T13:07:44.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.406+0000 7f6859d9b700 1 -- 172.21.15.82:0/1769948008 learned_addr learned my addr 172.21.15.82:0/1769948008 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:44.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.406+0000 7f685a59c700 1 --1- 172.21.15.82:0/1769948008 >> v1:172.21.15.114:6789/0 conn(0x7f685c15fcb0 0x7f685c0cd200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:46372/0 (socket says 172.21.15.82:46372) 2023-11-28T13:07:44.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.410+0000 7f6859d9b700 1 -- 172.21.15.82:0/1769948008 >> v2:172.21.15.114:3300/0 conn(0x7f685c06bd40 msgr2=0x7f685c0d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:44.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.410+0000 7f6859d9b700 1 --2- 172.21.15.82:0/1769948008 >> v2:172.21.15.114:3300/0 conn(0x7f685c06bd40 0x7f685c0d0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.410+0000 7f6859d9b700 1 -- 172.21.15.82:0/1769948008 >> v1:172.21.15.114:6789/0 conn(0x7f685c15fcb0 legacy=0x7f685c0cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.410+0000 7f6859d9b700 1 -- 172.21.15.82:0/1769948008 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c0cd910 con 0x7f685c0ced60 2023-11-28T13:07:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.410+0000 7f685959a700 1 -- 172.21.15.82:0/1769948008 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43939027 0 0) 0x7f685c06af10 con 0x7f685c15fcb0 2023-11-28T13:07:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.410+0000 7f685ad9d700 1 --2- 172.21.15.82:0/1769948008 >> v2:172.21.15.114:3300/0 conn(0x7f685c06bd40 0x7f685c0d0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:07:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.410+0000 7f6859d9b700 1 --2- 172.21.15.82:0/1769948008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f685c0ced60 0x7f685c06b800 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f685c161200 tx=0x7f6850009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95fd45f9f634f17 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.410+0000 7f685959a700 1 -- 172.21.15.82:0/1769948008 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850011830 con 0x7f685c0ced60 2023-11-28T13:07:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.410+0000 7f685959a700 1 -- 172.21.15.82:0/1769948008 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6850011990 con 0x7f685c0ced60 2023-11-28T13:07:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.410+0000 7f685959a700 1 -- 172.21.15.82:0/1769948008 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850011d20 con 0x7f685c0ced60 2023-11-28T13:07:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.410+0000 7f6860da5700 1 -- 172.21.15.82:0/1769948008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f685c0ced60 msgr2=0x7f685c06b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.410+0000 7f6860da5700 1 --2- 172.21.15.82:0/1769948008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f685c0ced60 0x7f685c06b800 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f685c161200 tx=0x7f6850009bf0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.410+0000 7f6860da5700 1 -- 172.21.15.82:0/1769948008 shutdown_connections 2023-11-28T13:07:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.410+0000 7f6860da5700 1 --2- 172.21.15.82:0/1769948008 >> v2:172.21.15.114:3300/0 conn(0x7f685c06bd40 0x7f685c0d0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.410+0000 7f6860da5700 1 --2- 172.21.15.82:0/1769948008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f685c0ced60 0x7f685c06b800 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.410+0000 7f6860da5700 1 -- 172.21.15.82:0/1769948008 >> 172.21.15.82:0/1769948008 conn(0x7f685c0d02c0 msgr2=0x7f685c0d2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:44.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.410+0000 7f6860da5700 1 -- 172.21.15.82:0/1769948008 shutdown_connections 2023-11-28T13:07:44.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.410+0000 7f6860da5700 1 -- 172.21.15.82:0/1769948008 wait complete. 2023-11-28T13:07:44.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.410+0000 7f6860da5700 1 Processor -- start 2023-11-28T13:07:44.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f6860da5700 1 -- start start 2023-11-28T13:07:44.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f6860da5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f685c06bd40 0x7f685c0c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:44.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f6860da5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f685c0ced60 0x7f685c156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:44.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f6860da5700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f685c15fcb0 0x7f685c1f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:44.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f6860da5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c0b5f10 con 0x7f685c06bd40 2023-11-28T13:07:44.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f6860da5700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c0caf50 con 0x7f685c0ced60 2023-11-28T13:07:44.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f6860da5700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685c0ca990 con 0x7f685c15fcb0 2023-11-28T13:07:44.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f685a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f685c06bd40 0x7f685c0c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:44.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f685a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f685c06bd40 0x7f685c0c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46678/0 (socket says 172.21.15.82:46678) 2023-11-28T13:07:44.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f6859d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f685c0ced60 0x7f685c156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:44.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f685a59c700 1 -- 172.21.15.82:0/590177343 learned_addr learned my addr 172.21.15.82:0/590177343 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:44.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f685ad9d700 1 --2- 172.21.15.82:0/590177343 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f685c15fcb0 0x7f685c1f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:44.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f685a59c700 1 -- 172.21.15.82:0/590177343 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f685c15fcb0 msgr2=0x7f685c1f1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:44.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f685a59c700 1 --2- 172.21.15.82:0/590177343 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f685c15fcb0 0x7f685c1f1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f685a59c700 1 -- 172.21.15.82:0/590177343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f685c0ced60 msgr2=0x7f685c156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:44.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f685a59c700 1 --2- 172.21.15.82:0/590177343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f685c0ced60 0x7f685c156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f685a59c700 1 -- 172.21.15.82:0/590177343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6854009a70 con 0x7f685c06bd40 2023-11-28T13:07:44.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f685a59c700 1 --2- 172.21.15.82:0/590177343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f685c06bd40 0x7f685c0c9c80 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f684c00c4e0 tx=0x7f684c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:44.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f684affd700 1 -- 172.21.15.82:0/590177343 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c004ca0 con 0x7f685c06bd40 2023-11-28T13:07:44.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f684affd700 1 -- 172.21.15.82:0/590177343 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684c004e20 con 0x7f685c06bd40 2023-11-28T13:07:44.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f6860da5700 1 -- 172.21.15.82:0/590177343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6850009570 con 0x7f685c06bd40 2023-11-28T13:07:44.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f684affd700 1 -- 172.21.15.82:0/590177343 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c007310 con 0x7f685c06bd40 2023-11-28T13:07:44.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.414+0000 7f6860da5700 1 -- 172.21.15.82:0/590177343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685c06a670 con 0x7f685c06bd40 2023-11-28T13:07:44.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.418+0000 7f6860da5700 1 -- 172.21.15.82:0/590177343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f685c0d0820 con 0x7f685c06bd40 2023-11-28T13:07:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.418+0000 7f684affd700 1 -- 172.21.15.82:0/590177343 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f684c01a020 con 0x7f685c06bd40 2023-11-28T13:07:44.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.418+0000 7f684affd700 1 --2- 172.21.15.82:0/590177343 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f683c064ee0 0x7f683c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:44.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.418+0000 7f684affd700 1 -- 172.21.15.82:0/590177343 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f684c081a60 con 0x7f685c06bd40 2023-11-28T13:07:44.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.418+0000 7f6859d9b700 1 --2- 172.21.15.82:0/590177343 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f683c064ee0 0x7f683c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:44.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.418+0000 7f6859d9b700 1 --2- 172.21.15.82:0/590177343 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f683c064ee0 0x7f683c067390 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6850000c00 tx=0x7f6850008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:44.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.426+0000 7f684affd700 1 -- 172.21.15.82:0/590177343 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f684c04fa90 con 0x7f685c06bd40 2023-11-28T13:07:44.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.586+0000 7f6860da5700 1 -- 172.21.15.82:0/590177343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f685c06a950 con 0x7f685c06bd40 2023-11-28T13:07:44.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.590+0000 7f684affd700 1 -- 172.21.15.82:0/590177343 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v67) v1 ==== 100+0+11 (secure 0 0 0) 0x7f684c0530b0 con 0x7f685c06bd40 2023-11-28T13:07:44.595 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-11-28T13:07:44.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.590+0000 7f6860da5700 1 -- 172.21.15.82:0/590177343 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f683c064ee0 msgr2=0x7f683c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:44.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.590+0000 7f6860da5700 1 --2- 172.21.15.82:0/590177343 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f683c064ee0 0x7f683c067390 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6850000c00 tx=0x7f6850008030 comp rx=0 tx=0).stop 2023-11-28T13:07:44.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.590+0000 7f6860da5700 1 -- 172.21.15.82:0/590177343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f685c06bd40 msgr2=0x7f685c0c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:44.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.590+0000 7f6860da5700 1 --2- 172.21.15.82:0/590177343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f685c06bd40 0x7f685c0c9c80 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f684c00c4e0 tx=0x7f684c00c7f0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.590+0000 7f6860da5700 1 -- 172.21.15.82:0/590177343 shutdown_connections 2023-11-28T13:07:44.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.590+0000 7f6860da5700 1 --2- 172.21.15.82:0/590177343 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f683c064ee0 0x7f683c067390 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.590+0000 7f6860da5700 1 --2- 172.21.15.82:0/590177343 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f685c15fcb0 0x7f685c1f1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.590+0000 7f6860da5700 1 --2- 172.21.15.82:0/590177343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f685c0ced60 0x7f685c156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.590+0000 7f6860da5700 1 --2- 172.21.15.82:0/590177343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f685c06bd40 0x7f685c0c9c80 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.590+0000 7f6860da5700 1 -- 172.21.15.82:0/590177343 >> 172.21.15.82:0/590177343 conn(0x7f685c0d02c0 msgr2=0x7f685c15f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:44.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.590+0000 7f6860da5700 1 -- 172.21.15.82:0/590177343 shutdown_connections 2023-11-28T13:07:44.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.590+0000 7f6860da5700 1 -- 172.21.15.82:0/590177343 wait complete. 2023-11-28T13:07:44.610 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:07:44.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.714+0000 7fc31ae4e700 1 Processor -- start 2023-11-28T13:07:44.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc31ae4e700 1 -- start start 2023-11-28T13:07:44.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc31ae4e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc31415a1d0 0x7fc31415c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:44.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc31ae4e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc31415cf30 0x7fc3140703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:44.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc31ae4e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc314069bc0 con 0x7fc314159e00 2023-11-28T13:07:44.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc31ae4e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31415d3d0 con 0x7fc31415a1d0 2023-11-28T13:07:44.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc31ae4e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3140ce6b0 con 0x7fc31415cf30 2023-11-28T13:07:44.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc313fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc31415a1d0 0x7fc31415c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:44.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc313fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc31415a1d0 0x7fc31415c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46686/0 (socket says 172.21.15.82:46686) 2023-11-28T13:07:44.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc313fff700 1 -- 172.21.15.82:0/4018742020 learned_addr learned my addr 172.21.15.82:0/4018742020 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:44.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc313fff700 1 -- 172.21.15.82:0/4018742020 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc31415cf30 msgr2=0x7fc3140703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:44.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc3193eb700 1 --2- 172.21.15.82:0/4018742020 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc31415cf30 0x7fc3140703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:44.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc313fff700 1 --2- 172.21.15.82:0/4018742020 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc31415cf30 0x7fc3140703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc313fff700 1 -- 172.21.15.82:0/4018742020 >> v1:172.21.15.82:6789/0 conn(0x7fc314159e00 legacy=0x7fc31406a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:44.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc313fff700 1 -- 172.21.15.82:0/4018742020 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31415d5b0 con 0x7fc31415a1d0 2023-11-28T13:07:44.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc313fff700 1 --2- 172.21.15.82:0/4018742020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31415a1d0 0x7fc31415c9f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fc304009e50 tx=0x7fc30400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a14c451ea777494 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:44.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc3137fe700 1 -- 172.21.15.82:0/4018742020 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30400e070 con 0x7fc31415a1d0 2023-11-28T13:07:44.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc3137fe700 1 -- 172.21.15.82:0/4018742020 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30400b9c0 con 0x7fc31415a1d0 2023-11-28T13:07:44.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc3137fe700 1 -- 172.21.15.82:0/4018742020 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30400bd70 con 0x7fc31415a1d0 2023-11-28T13:07:44.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc31ae4e700 1 -- 172.21.15.82:0/4018742020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31415a1d0 msgr2=0x7fc31415c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:44.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc31ae4e700 1 --2- 172.21.15.82:0/4018742020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31415a1d0 0x7fc31415c9f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fc304009e50 tx=0x7fc30400b330 comp rx=0 tx=0).stop 2023-11-28T13:07:44.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc31ae4e700 1 -- 172.21.15.82:0/4018742020 shutdown_connections 2023-11-28T13:07:44.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc31ae4e700 1 --2- 172.21.15.82:0/4018742020 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc31415cf30 0x7fc3140703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc31ae4e700 1 --2- 172.21.15.82:0/4018742020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31415a1d0 0x7fc31415c9f0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc31ae4e700 1 -- 172.21.15.82:0/4018742020 >> 172.21.15.82:0/4018742020 conn(0x7fc3140ce9b0 msgr2=0x7fc3140ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:44.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc31ae4e700 1 -- 172.21.15.82:0/4018742020 shutdown_connections 2023-11-28T13:07:44.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.718+0000 7fc31ae4e700 1 -- 172.21.15.82:0/4018742020 wait complete. 2023-11-28T13:07:44.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc31ae4e700 1 Processor -- start 2023-11-28T13:07:44.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc31ae4e700 1 -- start start 2023-11-28T13:07:44.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc31ae4e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc314159e00 0x7fc3141f1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:44.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc31ae4e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31415a1d0 0x7fc31415c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:44.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc31ae4e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc31415cf30 0x7fc31415c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:44.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc31ae4e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31415cc00 con 0x7fc31415a1d0 2023-11-28T13:07:44.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc31ae4e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3140acd50 con 0x7fc31415cf30 2023-11-28T13:07:44.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc31ae4e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3140ad030 con 0x7fc314159e00 2023-11-28T13:07:44.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc313fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31415a1d0 0x7fc31415c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:44.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc313fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31415a1d0 0x7fc31415c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46690/0 (socket says 172.21.15.82:46690) 2023-11-28T13:07:44.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc313fff700 1 -- 172.21.15.82:0/3283846356 learned_addr learned my addr 172.21.15.82:0/3283846356 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:44.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc3193eb700 1 --2- 172.21.15.82:0/3283846356 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc31415cf30 0x7fc31415c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:44.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc318bea700 1 --2- 172.21.15.82:0/3283846356 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc314159e00 0x7fc3141f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:44.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc313fff700 1 -- 172.21.15.82:0/3283846356 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc314159e00 msgr2=0x7fc3141f1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:44.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc313fff700 1 --2- 172.21.15.82:0/3283846356 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc314159e00 0x7fc3141f1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc313fff700 1 -- 172.21.15.82:0/3283846356 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc31415cf30 msgr2=0x7fc31415c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:44.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc313fff700 1 --2- 172.21.15.82:0/3283846356 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc31415cf30 0x7fc31415c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc313fff700 1 -- 172.21.15.82:0/3283846356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc304009b30 con 0x7fc31415a1d0 2023-11-28T13:07:44.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc3193eb700 1 --2- 172.21.15.82:0/3283846356 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc31415cf30 0x7fc31415c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:07:44.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc318bea700 1 --2- 172.21.15.82:0/3283846356 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc314159e00 0x7fc3141f1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:07:44.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc313fff700 1 --2- 172.21.15.82:0/3283846356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31415a1d0 0x7fc31415c080 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fc30400b730 tx=0x7fc304004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:44.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.722+0000 7fc3117fa700 1 -- 172.21.15.82:0/3283846356 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc304003e30 con 0x7fc31415a1d0 2023-11-28T13:07:44.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.726+0000 7fc31ae4e700 1 -- 172.21.15.82:0/3283846356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc314069e80 con 0x7fc31415a1d0 2023-11-28T13:07:44.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.726+0000 7fc3117fa700 1 -- 172.21.15.82:0/3283846356 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3040094d0 con 0x7fc31415a1d0 2023-11-28T13:07:44.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.726+0000 7fc3117fa700 1 -- 172.21.15.82:0/3283846356 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30401c680 con 0x7fc31415a1d0 2023-11-28T13:07:44.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.726+0000 7fc31ae4e700 1 -- 172.21.15.82:0/3283846356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31415d890 con 0x7fc31415a1d0 2023-11-28T13:07:44.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.726+0000 7fc31ae4e700 1 -- 172.21.15.82:0/3283846356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31406a160 con 0x7fc31415a1d0 2023-11-28T13:07:44.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.726+0000 7fc3117fa700 1 -- 172.21.15.82:0/3283846356 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc304022030 con 0x7fc31415a1d0 2023-11-28T13:07:44.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.726+0000 7fc3117fa700 1 --2- 172.21.15.82:0/3283846356 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc300064ee0 0x7fc300067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:44.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.726+0000 7fc3117fa700 1 -- 172.21.15.82:0/3283846356 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7fc304083930 con 0x7fc31415a1d0 2023-11-28T13:07:44.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.726+0000 7fc318bea700 1 --2- 172.21.15.82:0/3283846356 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc300064ee0 0x7fc300067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:44.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.730+0000 7fc318bea700 1 --2- 172.21.15.82:0/3283846356 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc300064ee0 0x7fc300067390 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc308000f60 tx=0x7fc308009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:44.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.730+0000 7fc3117fa700 1 -- 172.21.15.82:0/3283846356 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc304051a50 con 0x7fc31415a1d0 2023-11-28T13:07:44.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.934+0000 7fc31ae4e700 1 -- 172.21.15.82:0/3283846356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc314073e20 con 0x7fc31415a1d0 2023-11-28T13:07:44.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.934+0000 7fc3117fa700 1 -- 172.21.15.82:0/3283846356 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4655 (secure 0 0 0) 0x7fc304055070 con 0x7fc31415a1d0 2023-11-28T13:07:44.940 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:07:44.941 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/3176308867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3176308867},{"type":"v1","addr":"172.21.15.114:6833","nonce":3176308867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6184,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1779270694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1779270694},{"type":"v1","addr":"172.21.15.114:6835","nonce":1779270694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1570999968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1570999968},{"type":"v1","addr":"172.21.15.82:6835","nonce":1570999968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:03:22.559646+0000","modified":"2023-11-28T13:03:34.920423+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":6,"addr":"172.21.15.82:6837/2902091405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2902091405},{"type":"v1","addr":"172.21.15.82:6837","nonce":2902091405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T13:07:44.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.934+0000 7fc31ae4e700 1 -- 172.21.15.82:0/3283846356 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc300064ee0 msgr2=0x7fc300067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:44.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.934+0000 7fc31ae4e700 1 --2- 172.21.15.82:0/3283846356 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc300064ee0 0x7fc300067390 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc308000f60 tx=0x7fc308009040 comp rx=0 tx=0).stop 2023-11-28T13:07:44.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.934+0000 7fc31ae4e700 1 -- 172.21.15.82:0/3283846356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31415a1d0 msgr2=0x7fc31415c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:44.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.934+0000 7fc31ae4e700 1 --2- 172.21.15.82:0/3283846356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31415a1d0 0x7fc31415c080 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fc30400b730 tx=0x7fc304004af0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.938+0000 7fc31ae4e700 1 -- 172.21.15.82:0/3283846356 shutdown_connections 2023-11-28T13:07:44.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.938+0000 7fc31ae4e700 1 --2- 172.21.15.82:0/3283846356 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc300064ee0 0x7fc300067390 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.938+0000 7fc31ae4e700 1 --2- 172.21.15.82:0/3283846356 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc31415cf30 0x7fc31415c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.938+0000 7fc31ae4e700 1 --2- 172.21.15.82:0/3283846356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31415a1d0 0x7fc31415c080 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.938+0000 7fc31ae4e700 1 --2- 172.21.15.82:0/3283846356 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc314159e00 0x7fc3141f1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:44.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.938+0000 7fc31ae4e700 1 -- 172.21.15.82:0/3283846356 >> 172.21.15.82:0/3283846356 conn(0x7fc3140ce9b0 msgr2=0x7fc31415e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:44.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.938+0000 7fc31ae4e700 1 -- 172.21.15.82:0/3283846356 shutdown_connections 2023-11-28T13:07:44.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:44.938+0000 7fc31ae4e700 1 -- 172.21.15.82:0/3283846356 wait complete. 2023-11-28T13:07:44.945 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2023-11-28T13:07:44.956 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:07:45.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.062+0000 7fc7c9194700 1 Processor -- start 2023-11-28T13:07:45.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.062+0000 7fc7c9194700 1 -- start start 2023-11-28T13:07:45.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.062+0000 7fc7c9194700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc7c406b910 0x7fc7c4160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:45.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.062+0000 7fc7c9194700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc7c40ced70 0x7fc7c406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:45.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.062+0000 7fc7c9194700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c40d28e0 con 0x7fc7c4069bc0 2023-11-28T13:07:45.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.062+0000 7fc7c9194700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c40cdfe0 con 0x7fc7c40ced70 2023-11-28T13:07:45.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.062+0000 7fc7c9194700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c4160cc0 con 0x7fc7c406b910 2023-11-28T13:07:45.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7bbfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc7c40ced70 0x7fc7c406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:45.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7c8993700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc7c4069bc0 0x7fc7c4069fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:59502/0 (socket says 172.21.15.82:59502) 2023-11-28T13:07:45.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7c8993700 1 -- 172.21.15.82:0/2558750719 learned_addr learned my addr 172.21.15.82:0/2558750719 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:45.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7c3fff700 1 --2- 172.21.15.82:0/2558750719 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc7c406b910 0x7fc7c4160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:45.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7c37fe700 1 -- 172.21.15.82:0/2558750719 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70219897 0 0) 0x7fc7bc001490 con 0x7fc7c4069bc0 2023-11-28T13:07:45.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7c37fe700 1 -- 172.21.15.82:0/2558750719 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7b00035d0 con 0x7fc7c4069bc0 2023-11-28T13:07:45.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7bbfff700 1 -- 172.21.15.82:0/2558750719 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc7c406b910 msgr2=0x7fc7c4160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:45.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7bbfff700 1 --2- 172.21.15.82:0/2558750719 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc7c406b910 0x7fc7c4160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7bbfff700 1 -- 172.21.15.82:0/2558750719 >> v1:172.21.15.82:6789/0 conn(0x7fc7c4069bc0 legacy=0x7fc7c4069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:45.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7bbfff700 1 -- 172.21.15.82:0/2558750719 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c406c220 con 0x7fc7c40ced70 2023-11-28T13:07:45.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7bbfff700 1 --2- 172.21.15.82:0/2558750719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c40ced70 0x7fc7c406bce0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009850 tx=0x7fc7ac009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ac2dff7f4fb44c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:45.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7c37fe700 1 -- 172.21.15.82:0/2558750719 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac011830 con 0x7fc7c40ced70 2023-11-28T13:07:45.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7c37fe700 1 -- 172.21.15.82:0/2558750719 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ac011990 con 0x7fc7c40ced70 2023-11-28T13:07:45.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7c37fe700 1 -- 172.21.15.82:0/2558750719 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac011d40 con 0x7fc7c40ced70 2023-11-28T13:07:45.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7c9194700 1 -- 172.21.15.82:0/2558750719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c40ced70 msgr2=0x7fc7c406bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:45.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7c9194700 1 --2- 172.21.15.82:0/2558750719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c40ced70 0x7fc7c406bce0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009850 tx=0x7fc7ac009b60 comp rx=0 tx=0).stop 2023-11-28T13:07:45.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7c9194700 1 -- 172.21.15.82:0/2558750719 shutdown_connections 2023-11-28T13:07:45.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7c9194700 1 --2- 172.21.15.82:0/2558750719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c40ced70 0x7fc7c406bce0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7c9194700 1 --2- 172.21.15.82:0/2558750719 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc7c406b910 0x7fc7c4160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7c9194700 1 -- 172.21.15.82:0/2558750719 >> 172.21.15.82:0/2558750719 conn(0x7fc7c40d2b20 msgr2=0x7fc7c40d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:45.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7c9194700 1 -- 172.21.15.82:0/2558750719 shutdown_connections 2023-11-28T13:07:45.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7c9194700 1 -- 172.21.15.82:0/2558750719 wait complete. 2023-11-28T13:07:45.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7c9194700 1 Processor -- start 2023-11-28T13:07:45.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.066+0000 7fc7c9194700 1 -- start start 2023-11-28T13:07:45.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7c9194700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7c4069bc0 0x7fc7c40b2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:45.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7c9194700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c406b910 0x7fc7c40a9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:45.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7c9194700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc7c40ced70 0x7fc7c40a9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:45.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7c9194700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c40c7a10 con 0x7fc7c406b910 2023-11-28T13:07:45.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7c9194700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c40b1340 con 0x7fc7c4069bc0 2023-11-28T13:07:45.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7c9194700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c40c70e0 con 0x7fc7c40ced70 2023-11-28T13:07:45.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7bbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c406b910 0x7fc7c40a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7bbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c406b910 0x7fc7c40a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46710/0 (socket says 172.21.15.82:46710) 2023-11-28T13:07:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7bbfff700 1 -- 172.21.15.82:0/2009093982 learned_addr learned my addr 172.21.15.82:0/2009093982 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7c8993700 1 --2- 172.21.15.82:0/2009093982 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc7c40ced70 0x7fc7c40a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7c3fff700 1 --2- 172.21.15.82:0/2009093982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7c4069bc0 0x7fc7c40b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7bbfff700 1 -- 172.21.15.82:0/2009093982 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc7c40ced70 msgr2=0x7fc7c40a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7bbfff700 1 --2- 172.21.15.82:0/2009093982 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc7c40ced70 0x7fc7c40a9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7bbfff700 1 -- 172.21.15.82:0/2009093982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7c4069bc0 msgr2=0x7fc7c40b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7bbfff700 1 --2- 172.21.15.82:0/2009093982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7c4069bc0 0x7fc7c40b2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7bbfff700 1 -- 172.21.15.82:0/2009093982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ac0094b0 con 0x7fc7c406b910 2023-11-28T13:07:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7bbfff700 1 --2- 172.21.15.82:0/2009093982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c406b910 0x7fc7c40a9430 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac0090b0 tx=0x7fc7ac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7c17fa700 1 -- 172.21.15.82:0/2009093982 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac004570 con 0x7fc7c406b910 2023-11-28T13:07:45.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7c17fa700 1 -- 172.21.15.82:0/2009093982 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ac01f070 con 0x7fc7c406b910 2023-11-28T13:07:45.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7c9194700 1 -- 172.21.15.82:0/2009093982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c40d1700 con 0x7fc7c406b910 2023-11-28T13:07:45.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7c17fa700 1 -- 172.21.15.82:0/2009093982 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac003900 con 0x7fc7c406b910 2023-11-28T13:07:45.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7c9194700 1 -- 172.21.15.82:0/2009093982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c40b2040 con 0x7fc7c406b910 2023-11-28T13:07:45.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.070+0000 7fc7c9194700 1 -- 172.21.15.82:0/2009093982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c40cf2c0 con 0x7fc7c406b910 2023-11-28T13:07:45.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.074+0000 7fc7c17fa700 1 -- 172.21.15.82:0/2009093982 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc7ac02a020 con 0x7fc7c406b910 2023-11-28T13:07:45.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.074+0000 7fc7c17fa700 1 --2- 172.21.15.82:0/2009093982 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc7a4064f10 0x7fc7a40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:45.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.074+0000 7fc7c17fa700 1 -- 172.21.15.82:0/2009093982 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7fc7ac083990 con 0x7fc7c406b910 2023-11-28T13:07:45.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.074+0000 7fc7c3fff700 1 --2- 172.21.15.82:0/2009093982 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc7a4064f10 0x7fc7a40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:45.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.074+0000 7fc7c3fff700 1 --2- 172.21.15.82:0/2009093982 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc7a4064f10 0x7fc7a40673c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400b9d0 tx=0x7fc7b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:45.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.078+0000 7fc7c17fa700 1 -- 172.21.15.82:0/2009093982 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc7ac051a40 con 0x7fc7c406b910 2023-11-28T13:07:45.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.238+0000 7fc7c9194700 1 -- 172.21.15.82:0/2009093982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7c4065fc0 con 0x7fc7c406b910 2023-11-28T13:07:45.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.238+0000 7fc7c17fa700 1 -- 172.21.15.82:0/2009093982 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+18032 (secure 0 0 0) 0x7fc7ac006ce0 con 0x7fc7c406b910 2023-11-28T13:07:45.245 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:07:45.246 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":67,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:04:10.914507+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:03:21.126074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T13:03:21.545268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.d","mappings":[{"from":7,"to":2}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.c","mappings":[{"from":4,"to":5},{"from":7,"to":3}]},{"pgid":"10.d","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:07:45.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.238+0000 7fc7c9194700 1 -- 172.21.15.82:0/2009093982 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc7a4064f10 msgr2=0x7fc7a40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:45.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.238+0000 7fc7c9194700 1 --2- 172.21.15.82:0/2009093982 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc7a4064f10 0x7fc7a40673c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400b9d0 tx=0x7fc7b4008040 comp rx=0 tx=0).stop 2023-11-28T13:07:45.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.242+0000 7fc7c9194700 1 -- 172.21.15.82:0/2009093982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c406b910 msgr2=0x7fc7c40a9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:45.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.242+0000 7fc7c9194700 1 --2- 172.21.15.82:0/2009093982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c406b910 0x7fc7c40a9430 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac0090b0 tx=0x7fc7ac004770 comp rx=0 tx=0).stop 2023-11-28T13:07:45.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.242+0000 7fc7c9194700 1 -- 172.21.15.82:0/2009093982 shutdown_connections 2023-11-28T13:07:45.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.242+0000 7fc7c9194700 1 --2- 172.21.15.82:0/2009093982 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc7a4064f10 0x7fc7a40673c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.242+0000 7fc7c9194700 1 --2- 172.21.15.82:0/2009093982 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc7c40ced70 0x7fc7c40a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.242+0000 7fc7c9194700 1 --2- 172.21.15.82:0/2009093982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c406b910 0x7fc7c40a9430 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.242+0000 7fc7c9194700 1 --2- 172.21.15.82:0/2009093982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7c4069bc0 0x7fc7c40b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.242+0000 7fc7c9194700 1 -- 172.21.15.82:0/2009093982 >> 172.21.15.82:0/2009093982 conn(0x7fc7c40d2b20 msgr2=0x7fc7c40b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:45.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.242+0000 7fc7c9194700 1 -- 172.21.15.82:0/2009093982 shutdown_connections 2023-11-28T13:07:45.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.242+0000 7fc7c9194700 1 -- 172.21.15.82:0/2009093982 wait complete. 2023-11-28T13:07:45.259 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T13:07:45.259 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:07:45.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa2ae500700 1 Processor -- start 2023-11-28T13:07:45.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa2ae500700 1 -- start start 2023-11-28T13:07:45.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa2ae500700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa2a8070070 0x7fa2a8070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:45.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa2ae500700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa2a806d980 0x7fa2a80cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:45.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa2ae500700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa2a806cfa0 0x7fa2a815fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:45.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa2ae500700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a806d780 con 0x7fa2a806d980 2023-11-28T13:07:45.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa2ae500700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a806cb10 con 0x7fa2a806cfa0 2023-11-28T13:07:45.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa2ae500700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a8070980 con 0x7fa2a8070070 2023-11-28T13:07:45.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa2accfd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa2a806d980 0x7fa2a80cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:45.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa2accfd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa2a806d980 0x7fa2a80cc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46714/0 (socket says 172.21.15.82:46714) 2023-11-28T13:07:45.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa2ad4fe700 1 --2- 172.21.15.82:0/3066872493 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa2a8070070 0x7fa2a8070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:45.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa2accfd700 1 -- 172.21.15.82:0/3066872493 learned_addr learned my addr 172.21.15.82:0/3066872493 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:45.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa2adcff700 1 --2- 172.21.15.82:0/3066872493 >> v2:172.21.15.114:3300/0 conn(0x7fa2a806cfa0 0x7fa2a815fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:45.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa2accfd700 1 -- 172.21.15.82:0/3066872493 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa2a8070070 msgr2=0x7fa2a8070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:45.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa2accfd700 1 --2- 172.21.15.82:0/3066872493 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa2a8070070 0x7fa2a8070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa2accfd700 1 -- 172.21.15.82:0/3066872493 >> v2:172.21.15.114:3300/0 conn(0x7fa2a806cfa0 msgr2=0x7fa2a815fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:45.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa2accfd700 1 --2- 172.21.15.82:0/3066872493 >> v2:172.21.15.114:3300/0 conn(0x7fa2a806cfa0 0x7fa2a815fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa2accfd700 1 -- 172.21.15.82:0/3066872493 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a806ddf0 con 0x7fa2a806d980 2023-11-28T13:07:45.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa2accfd700 1 --2- 172.21.15.82:0/3066872493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2a806d980 0x7fa2a80cc1d0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8070ce0 tx=0x7fa298009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6b255ad519d0ea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:45.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa29ffff700 1 -- 172.21.15.82:0/3066872493 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa298011830 con 0x7fa2a806d980 2023-11-28T13:07:45.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa29ffff700 1 -- 172.21.15.82:0/3066872493 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa298011990 con 0x7fa2a806d980 2023-11-28T13:07:45.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa29ffff700 1 -- 172.21.15.82:0/3066872493 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa298011d20 con 0x7fa2a806d980 2023-11-28T13:07:45.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa2ae500700 1 -- 172.21.15.82:0/3066872493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2a806d980 msgr2=0x7fa2a80cc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:45.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.366+0000 7fa2ae500700 1 --2- 172.21.15.82:0/3066872493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2a806d980 0x7fa2a80cc1d0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8070ce0 tx=0x7fa298009bf0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ae500700 1 -- 172.21.15.82:0/3066872493 shutdown_connections 2023-11-28T13:07:45.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ae500700 1 --2- 172.21.15.82:0/3066872493 >> v2:172.21.15.114:3300/0 conn(0x7fa2a806cfa0 0x7fa2a815fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ae500700 1 --2- 172.21.15.82:0/3066872493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2a806d980 0x7fa2a80cc1d0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ae500700 1 --2- 172.21.15.82:0/3066872493 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa2a8070070 0x7fa2a8070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ae500700 1 -- 172.21.15.82:0/3066872493 >> 172.21.15.82:0/3066872493 conn(0x7fa2a80ce600 msgr2=0x7fa2a80ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:45.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ae500700 1 -- 172.21.15.82:0/3066872493 shutdown_connections 2023-11-28T13:07:45.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ae500700 1 -- 172.21.15.82:0/3066872493 wait complete. 2023-11-28T13:07:45.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ae500700 1 Processor -- start 2023-11-28T13:07:45.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ae500700 1 -- start start 2023-11-28T13:07:45.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ae500700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2a806cfa0 0x7fa2a80b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:45.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ae500700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa2a806d980 0x7fa2a80acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:45.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ae500700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2a8070070 0x7fa2a80c2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:45.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ae500700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a80af090 con 0x7fa2a806cfa0 2023-11-28T13:07:45.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ae500700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a81f1c80 con 0x7fa2a8070070 2023-11-28T13:07:45.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ae500700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a81f1f60 con 0x7fa2a806d980 2023-11-28T13:07:45.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ad4fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2a806cfa0 0x7fa2a80b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:45.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ad4fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2a806cfa0 0x7fa2a80b0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46720/0 (socket says 172.21.15.82:46720) 2023-11-28T13:07:45.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ad4fe700 1 -- 172.21.15.82:0/2994405810 learned_addr learned my addr 172.21.15.82:0/2994405810 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:45.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2accfd700 1 --2- 172.21.15.82:0/2994405810 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa2a806d980 0x7fa2a80acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:45.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2adcff700 1 --2- 172.21.15.82:0/2994405810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2a8070070 0x7fa2a80c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:45.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ad4fe700 1 -- 172.21.15.82:0/2994405810 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa2a806d980 msgr2=0x7fa2a80acb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:45.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ad4fe700 1 --2- 172.21.15.82:0/2994405810 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa2a806d980 0x7fa2a80acb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ad4fe700 1 -- 172.21.15.82:0/2994405810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2a8070070 msgr2=0x7fa2a80c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:45.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ad4fe700 1 --2- 172.21.15.82:0/2994405810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2a8070070 0x7fa2a80c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ad4fe700 1 -- 172.21.15.82:0/2994405810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa298009570 con 0x7fa2a806cfa0 2023-11-28T13:07:45.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2adcff700 1 --2- 172.21.15.82:0/2994405810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2a8070070 0x7fa2a80c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:07:45.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.370+0000 7fa2ad4fe700 1 --2- 172.21.15.82:0/2994405810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2a806cfa0 0x7fa2a80b0920 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fa2a400e870 tx=0x7fa2a400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:45.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.374+0000 7fa29dffb700 1 -- 172.21.15.82:0/2994405810 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a40095c0 con 0x7fa2a806cfa0 2023-11-28T13:07:45.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.374+0000 7fa29dffb700 1 -- 172.21.15.82:0/2994405810 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a400ee70 con 0x7fa2a806cfa0 2023-11-28T13:07:45.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.374+0000 7fa2ae500700 1 -- 172.21.15.82:0/2994405810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a80ce310 con 0x7fa2a806cfa0 2023-11-28T13:07:45.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.374+0000 7fa29dffb700 1 -- 172.21.15.82:0/2994405810 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a400ca70 con 0x7fa2a806cfa0 2023-11-28T13:07:45.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.374+0000 7fa2ae500700 1 -- 172.21.15.82:0/2994405810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a80ce030 con 0x7fa2a806cfa0 2023-11-28T13:07:45.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.374+0000 7fa2ae500700 1 -- 172.21.15.82:0/2994405810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a80cc710 con 0x7fa2a806cfa0 2023-11-28T13:07:45.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.374+0000 7fa29dffb700 1 -- 172.21.15.82:0/2994405810 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa2a4019030 con 0x7fa2a806cfa0 2023-11-28T13:07:45.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.374+0000 7fa29dffb700 1 --2- 172.21.15.82:0/2994405810 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa28c064ee0 0x7fa28c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:45.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.374+0000 7fa29dffb700 1 -- 172.21.15.82:0/2994405810 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7fa2a4081e90 con 0x7fa2a806cfa0 2023-11-28T13:07:45.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.374+0000 7fa2accfd700 1 --2- 172.21.15.82:0/2994405810 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa28c064ee0 0x7fa28c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:45.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.374+0000 7fa2accfd700 1 --2- 172.21.15.82:0/2994405810 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa28c064ee0 0x7fa28c067390 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa298009c30 tx=0x7fa298008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:45.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.382+0000 7fa29dffb700 1 -- 172.21.15.82:0/2994405810 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa2a404ff30 con 0x7fa2a806cfa0 2023-11-28T13:07:45.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.582+0000 7fa2ae500700 1 -- 172.21.15.82:0/2994405810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2a8065fc0 con 0x7fa2a806cfa0 2023-11-28T13:07:45.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.582+0000 7fa29dffb700 1 -- 172.21.15.82:0/2994405810 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4655 (secure 0 0 0) 0x7fa2a4053550 con 0x7fa2a806cfa0 2023-11-28T13:07:45.591 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:07:45.591 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/3176308867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3176308867},{"type":"v1","addr":"172.21.15.114:6833","nonce":3176308867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6184,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1779270694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1779270694},{"type":"v1","addr":"172.21.15.114:6835","nonce":1779270694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1570999968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1570999968},{"type":"v1","addr":"172.21.15.82:6835","nonce":1570999968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:03:22.559646+0000","modified":"2023-11-28T13:03:34.920423+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":6,"addr":"172.21.15.82:6837/2902091405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2902091405},{"type":"v1","addr":"172.21.15.82:6837","nonce":2902091405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T13:07:45.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.586+0000 7fa2ae500700 1 -- 172.21.15.82:0/2994405810 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa28c064ee0 msgr2=0x7fa28c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:45.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.586+0000 7fa2ae500700 1 --2- 172.21.15.82:0/2994405810 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa28c064ee0 0x7fa28c067390 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa298009c30 tx=0x7fa298008030 comp rx=0 tx=0).stop 2023-11-28T13:07:45.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.586+0000 7fa2ae500700 1 -- 172.21.15.82:0/2994405810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2a806cfa0 msgr2=0x7fa2a80b0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:45.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.586+0000 7fa2ae500700 1 --2- 172.21.15.82:0/2994405810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2a806cfa0 0x7fa2a80b0920 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fa2a400e870 tx=0x7fa2a400ec30 comp rx=0 tx=0).stop 2023-11-28T13:07:45.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.586+0000 7fa2ae500700 1 -- 172.21.15.82:0/2994405810 shutdown_connections 2023-11-28T13:07:45.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.586+0000 7fa2ae500700 1 --2- 172.21.15.82:0/2994405810 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fa28c064ee0 0x7fa28c067390 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.586+0000 7fa2ae500700 1 --2- 172.21.15.82:0/2994405810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2a8070070 0x7fa2a80c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.586+0000 7fa2ae500700 1 --2- 172.21.15.82:0/2994405810 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa2a806d980 0x7fa2a80acb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.586+0000 7fa2ae500700 1 --2- 172.21.15.82:0/2994405810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2a806cfa0 0x7fa2a80b0920 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.586+0000 7fa2ae500700 1 -- 172.21.15.82:0/2994405810 >> 172.21.15.82:0/2994405810 conn(0x7fa2a80ce600 msgr2=0x7fa2a80b1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:45.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.586+0000 7fa2ae500700 1 -- 172.21.15.82:0/2994405810 shutdown_connections 2023-11-28T13:07:45.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.586+0000 7fa2ae500700 1 -- 172.21.15.82:0/2994405810 wait complete. 2023-11-28T13:07:45.595 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2023-11-28T13:07:45.606 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:07:45.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1df5861700 1 Processor -- start 2023-11-28T13:07:45.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1df5861700 1 -- start start 2023-11-28T13:07:45.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1df5861700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1df006b910 0x7f1df0160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:45.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1df5861700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1df00ced70 0x7f1df006bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:45.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1df5861700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1df0069bc0 0x7f1df006a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:45.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1df5861700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df00cdfe0 con 0x7f1df00ced70 2023-11-28T13:07:45.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1df5861700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df00d28e0 con 0x7f1df006b910 2023-11-28T13:07:45.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1df5861700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df0160cc0 con 0x7f1df0069bc0 2023-11-28T13:07:45.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1deffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1df00ced70 0x7f1df006bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:45.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1deffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1df00ced70 0x7f1df006bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46722/0 (socket says 172.21.15.82:46722) 2023-11-28T13:07:45.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1deffff700 1 -- 172.21.15.82:0/821267423 learned_addr learned my addr 172.21.15.82:0/821267423 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:45.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1df485f700 1 --2- 172.21.15.82:0/821267423 >> v2:172.21.15.114:3300/0 conn(0x7f1df006b910 0x7f1df0160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:45.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1df5060700 1 --2- 172.21.15.82:0/821267423 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1df0069bc0 0x7f1df006a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:45.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1deffff700 1 -- 172.21.15.82:0/821267423 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1df0069bc0 msgr2=0x7f1df006a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:45.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1deffff700 1 --2- 172.21.15.82:0/821267423 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1df0069bc0 0x7f1df006a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1deffff700 1 -- 172.21.15.82:0/821267423 >> v2:172.21.15.114:3300/0 conn(0x7f1df006b910 msgr2=0x7f1df0160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:45.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1deffff700 1 --2- 172.21.15.82:0/821267423 >> v2:172.21.15.114:3300/0 conn(0x7f1df006b910 0x7f1df0160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1deffff700 1 -- 172.21.15.82:0/821267423 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df006c220 con 0x7f1df00ced70 2023-11-28T13:07:45.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1deffff700 1 --2- 172.21.15.82:0/821267423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1df00ced70 0x7f1df006bce0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f1df00d2a80 tx=0x7f1de4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4aca165908164f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:45.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1def7fe700 1 -- 172.21.15.82:0/821267423 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de4011830 con 0x7f1df00ced70 2023-11-28T13:07:45.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1def7fe700 1 -- 172.21.15.82:0/821267423 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de4011990 con 0x7f1df00ced70 2023-11-28T13:07:45.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1def7fe700 1 -- 172.21.15.82:0/821267423 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de4011d20 con 0x7f1df00ced70 2023-11-28T13:07:45.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1df5861700 1 -- 172.21.15.82:0/821267423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1df00ced70 msgr2=0x7f1df006bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:45.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.714+0000 7f1df5861700 1 --2- 172.21.15.82:0/821267423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1df00ced70 0x7f1df006bce0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f1df00d2a80 tx=0x7f1de4009bf0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.718+0000 7f1df5861700 1 -- 172.21.15.82:0/821267423 shutdown_connections 2023-11-28T13:07:45.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.718+0000 7f1df5861700 1 --2- 172.21.15.82:0/821267423 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1df0069bc0 0x7f1df006a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.718+0000 7f1df5861700 1 --2- 172.21.15.82:0/821267423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1df00ced70 0x7f1df006bce0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.718+0000 7f1df5861700 1 --2- 172.21.15.82:0/821267423 >> v2:172.21.15.114:3300/0 conn(0x7f1df006b910 0x7f1df0160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.718+0000 7f1df5861700 1 -- 172.21.15.82:0/821267423 >> 172.21.15.82:0/821267423 conn(0x7f1df00d2b20 msgr2=0x7f1df00d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:45.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.718+0000 7f1df5861700 1 -- 172.21.15.82:0/821267423 shutdown_connections 2023-11-28T13:07:45.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.718+0000 7f1df5861700 1 -- 172.21.15.82:0/821267423 wait complete. 2023-11-28T13:07:45.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.718+0000 7f1df5861700 1 Processor -- start 2023-11-28T13:07:45.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.718+0000 7f1df5861700 1 -- start start 2023-11-28T13:07:45.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.718+0000 7f1df5861700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1df0069bc0 0x7f1df00cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:45.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.718+0000 7f1df5861700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1df006b910 0x7f1df00cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:45.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.718+0000 7f1df5861700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1df00ced70 0x7f1df00ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:45.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.718+0000 7f1df5861700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df00cc6e0 con 0x7f1df0069bc0 2023-11-28T13:07:45.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.722+0000 7f1df5861700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df00caed0 con 0x7f1df00ced70 2023-11-28T13:07:45.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.722+0000 7f1df5861700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df00cb100 con 0x7f1df006b910 2023-11-28T13:07:45.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.722+0000 7f1df485f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1df0069bc0 0x7f1df00cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:45.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.722+0000 7f1df485f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1df0069bc0 0x7f1df00cca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46726/0 (socket says 172.21.15.82:46726) 2023-11-28T13:07:45.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.722+0000 7f1df485f700 1 -- 172.21.15.82:0/3426426498 learned_addr learned my addr 172.21.15.82:0/3426426498 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:45.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.722+0000 7f1df5060700 1 --2- 172.21.15.82:0/3426426498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1df00ced70 0x7f1df00ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:45.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.722+0000 7f1deffff700 1 --2- 172.21.15.82:0/3426426498 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1df006b910 0x7f1df00cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:45.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.722+0000 7f1df485f700 1 -- 172.21.15.82:0/3426426498 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1df006b910 msgr2=0x7f1df00cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:45.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.722+0000 7f1df485f700 1 --2- 172.21.15.82:0/3426426498 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1df006b910 0x7f1df00cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.722+0000 7f1df485f700 1 -- 172.21.15.82:0/3426426498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1df00ced70 msgr2=0x7f1df00ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:45.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.722+0000 7f1df485f700 1 --2- 172.21.15.82:0/3426426498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1df00ced70 0x7f1df00ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.722+0000 7f1df485f700 1 -- 172.21.15.82:0/3426426498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de4009570 con 0x7f1df0069bc0 2023-11-28T13:07:45.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.722+0000 7f1df485f700 1 --2- 172.21.15.82:0/3426426498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1df0069bc0 0x7f1df00cca80 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00e840 tx=0x7f1ddc00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:45.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.722+0000 7f1ded7fa700 1 -- 172.21.15.82:0/3426426498 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc0095a0 con 0x7f1df0069bc0 2023-11-28T13:07:45.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.722+0000 7f1df5861700 1 -- 172.21.15.82:0/3426426498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df00cf2c0 con 0x7f1df0069bc0 2023-11-28T13:07:45.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.722+0000 7f1ded7fa700 1 -- 172.21.15.82:0/3426426498 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ddc013680 con 0x7f1df0069bc0 2023-11-28T13:07:45.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.722+0000 7f1ded7fa700 1 -- 172.21.15.82:0/3426426498 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc0139f0 con 0x7f1df0069bc0 2023-11-28T13:07:45.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.722+0000 7f1df5861700 1 -- 172.21.15.82:0/3426426498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df00b2040 con 0x7f1df0069bc0 2023-11-28T13:07:45.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.722+0000 7f1df5861700 1 -- 172.21.15.82:0/3426426498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df00d2320 con 0x7f1df0069bc0 2023-11-28T13:07:45.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.726+0000 7f1ded7fa700 1 -- 172.21.15.82:0/3426426498 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1ddc023070 con 0x7f1df0069bc0 2023-11-28T13:07:45.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.726+0000 7f1ded7fa700 1 --2- 172.21.15.82:0/3426426498 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1dd4064ee0 0x7f1dd4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:45.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.726+0000 7f1ded7fa700 1 -- 172.21.15.82:0/3426426498 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f1ddc0823b0 con 0x7f1df0069bc0 2023-11-28T13:07:45.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.726+0000 7f1deffff700 1 --2- 172.21.15.82:0/3426426498 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1dd4064ee0 0x7f1dd4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:45.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.726+0000 7f1deffff700 1 --2- 172.21.15.82:0/3426426498 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1dd4064ee0 0x7f1dd4067390 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1df00d2a80 tx=0x7f1de4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:45.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.734+0000 7f1ded7fa700 1 -- 172.21.15.82:0/3426426498 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1ddc053fa0 con 0x7f1df0069bc0 2023-11-28T13:07:45.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.926+0000 7f1df5861700 1 -- 172.21.15.82:0/3426426498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1df0065fc0 con 0x7f1df0069bc0 2023-11-28T13:07:45.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.926+0000 7f1ded7fa700 1 -- 172.21.15.82:0/3426426498 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4655 (secure 0 0 0) 0x7f1ddc053b90 con 0x7f1df0069bc0 2023-11-28T13:07:45.934 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:07:45.934 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/3176308867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3176308867},{"type":"v1","addr":"172.21.15.114:6833","nonce":3176308867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6184,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1779270694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1779270694},{"type":"v1","addr":"172.21.15.114:6835","nonce":1779270694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1570999968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1570999968},{"type":"v1","addr":"172.21.15.82:6835","nonce":1570999968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T13:03:22.559646+0000","modified":"2023-11-28T13:03:34.920423+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":6,"addr":"172.21.15.82:6837/2902091405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2902091405},{"type":"v1","addr":"172.21.15.82:6837","nonce":2902091405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T13:07:45.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.930+0000 7f1df5861700 1 -- 172.21.15.82:0/3426426498 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1dd4064ee0 msgr2=0x7f1dd4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:45.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.930+0000 7f1df5861700 1 --2- 172.21.15.82:0/3426426498 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1dd4064ee0 0x7f1dd4067390 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1df00d2a80 tx=0x7f1de4008030 comp rx=0 tx=0).stop 2023-11-28T13:07:45.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.930+0000 7f1df5861700 1 -- 172.21.15.82:0/3426426498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1df0069bc0 msgr2=0x7f1df00cca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:45.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.930+0000 7f1df5861700 1 --2- 172.21.15.82:0/3426426498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1df0069bc0 0x7f1df00cca80 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00e840 tx=0x7f1ddc00eb50 comp rx=0 tx=0).stop 2023-11-28T13:07:45.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.930+0000 7f1df5861700 1 -- 172.21.15.82:0/3426426498 shutdown_connections 2023-11-28T13:07:45.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.930+0000 7f1df5861700 1 --2- 172.21.15.82:0/3426426498 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1dd4064ee0 0x7f1dd4067390 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.930+0000 7f1df5861700 1 --2- 172.21.15.82:0/3426426498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1df00ced70 0x7f1df00ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.930+0000 7f1df5861700 1 --2- 172.21.15.82:0/3426426498 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1df006b910 0x7f1df00cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.930+0000 7f1df5861700 1 --2- 172.21.15.82:0/3426426498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1df0069bc0 0x7f1df00cca80 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:45.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.930+0000 7f1df5861700 1 -- 172.21.15.82:0/3426426498 >> 172.21.15.82:0/3426426498 conn(0x7f1df00d2b20 msgr2=0x7f1df00b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:45.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.934+0000 7f1df5861700 1 -- 172.21.15.82:0/3426426498 shutdown_connections 2023-11-28T13:07:45.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:45.934+0000 7f1df5861700 1 -- 172.21.15.82:0/3426426498 wait complete. 2023-11-28T13:07:45.941 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2023-11-28T13:07:45.955 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:07:46.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.058+0000 7f93cf59e700 1 Processor -- start 2023-11-28T13:07:46.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.058+0000 7f93cf59e700 1 -- start start 2023-11-28T13:07:46.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.058+0000 7f93cf59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93d0160380 0x7f93d006d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:46.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.058+0000 7f93cf59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f93d0160750 0x7f93d0070730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:46.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.058+0000 7f93cf59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d006d780 con 0x7f93d0070c70 2023-11-28T13:07:46.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.058+0000 7f93cf59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d00cd070 con 0x7f93d0160750 2023-11-28T13:07:46.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.058+0000 7f93cf59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d00710f0 con 0x7f93d0160380 2023-11-28T13:07:46.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.058+0000 7f93ce59c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93d0160380 0x7f93d006d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:46.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.058+0000 7f93cdd9b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f93d0160750 0x7f93d0070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:46.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.058+0000 7f93ced9d700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f93d0070c70 0x7f93d0164130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:46378/0 (socket says 172.21.15.82:46378) 2023-11-28T13:07:46.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.058+0000 7f93ced9d700 1 -- 172.21.15.82:0/2066151960 learned_addr learned my addr 172.21.15.82:0/2066151960 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:46.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.058+0000 7f93ce59c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93d0160380 0x7f93d006d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:50186/0 (socket says 172.21.15.82:50186) 2023-11-28T13:07:46.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.058+0000 7f93ce59c700 1 -- 172.21.15.82:0/2066151960 >> v2:172.21.15.114:3300/0 conn(0x7f93d0160750 msgr2=0x7f93d0070730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:46.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.058+0000 7f93cd59a700 1 -- 172.21.15.82:0/2066151960 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873075280 0 0) 0x7f93d006d780 con 0x7f93d0070c70 2023-11-28T13:07:46.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.058+0000 7f93ce59c700 1 --2- 172.21.15.82:0/2066151960 >> v2:172.21.15.114:3300/0 conn(0x7f93d0160750 0x7f93d0070730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:46.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.058+0000 7f93ce59c700 1 -- 172.21.15.82:0/2066151960 >> v1:172.21.15.114:6789/0 conn(0x7f93d0070c70 legacy=0x7f93d0164130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:46.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.058+0000 7f93ce59c700 1 -- 172.21.15.82:0/2066151960 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d00ccaf0 con 0x7f93d0160380 2023-11-28T13:07:46.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.058+0000 7f93ce59c700 1 --2- 172.21.15.82:0/2066151960 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93d0160380 0x7f93d006d240 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f93b8009d90 tx=0x7f93b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54a498cb31c5aabf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:46.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.058+0000 7f93cd59a700 1 -- 172.21.15.82:0/2066151960 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b800e070 con 0x7f93d0160380 2023-11-28T13:07:46.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.058+0000 7f93cd59a700 1 -- 172.21.15.82:0/2066151960 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b800bb20 con 0x7f93d0160380 2023-11-28T13:07:46.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.058+0000 7f93cd59a700 1 -- 172.21.15.82:0/2066151960 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b8012430 con 0x7f93d0160380 2023-11-28T13:07:46.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cf59e700 1 -- 172.21.15.82:0/2066151960 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93d0160380 msgr2=0x7f93d006d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:46.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cf59e700 1 --2- 172.21.15.82:0/2066151960 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93d0160380 0x7f93d006d240 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f93b8009d90 tx=0x7f93b800b330 comp rx=0 tx=0).stop 2023-11-28T13:07:46.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cf59e700 1 -- 172.21.15.82:0/2066151960 shutdown_connections 2023-11-28T13:07:46.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cf59e700 1 --2- 172.21.15.82:0/2066151960 >> v2:172.21.15.114:3300/0 conn(0x7f93d0160750 0x7f93d0070730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:46.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cf59e700 1 --2- 172.21.15.82:0/2066151960 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93d0160380 0x7f93d006d240 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:46.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cf59e700 1 -- 172.21.15.82:0/2066151960 >> 172.21.15.82:0/2066151960 conn(0x7f93d00cb890 msgr2=0x7f93d00cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:46.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cf59e700 1 -- 172.21.15.82:0/2066151960 shutdown_connections 2023-11-28T13:07:46.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cf59e700 1 -- 172.21.15.82:0/2066151960 wait complete. 2023-11-28T13:07:46.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cf59e700 1 Processor -- start 2023-11-28T13:07:46.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cf59e700 1 -- start start 2023-11-28T13:07:46.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cf59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93d0070c70 0x7f93d015e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:46.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cf59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d0160380 0x7f93d00c01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:46.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cf59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93d0160750 0x7f93d00c0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:46.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cf59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d015ee30 con 0x7f93d0160380 2023-11-28T13:07:46.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cf59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d01e9620 con 0x7f93d0160750 2023-11-28T13:07:46.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cf59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d00c0d50 con 0x7f93d0070c70 2023-11-28T13:07:46.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cdd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d0160380 0x7f93d00c01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:46.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cdd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d0160380 0x7f93d00c01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46740/0 (socket says 172.21.15.82:46740) 2023-11-28T13:07:46.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93ced9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93d0160750 0x7f93d00c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:46.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cdd9b700 1 -- 172.21.15.82:0/2518748006 learned_addr learned my addr 172.21.15.82:0/2518748006 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:46.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93ce59c700 1 --2- 172.21.15.82:0/2518748006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93d0070c70 0x7f93d015e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:46.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cdd9b700 1 -- 172.21.15.82:0/2518748006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93d0070c70 msgr2=0x7f93d015e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:46.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cdd9b700 1 --2- 172.21.15.82:0/2518748006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93d0070c70 0x7f93d015e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:46.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cdd9b700 1 -- 172.21.15.82:0/2518748006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93d0160750 msgr2=0x7f93d00c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:46.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cdd9b700 1 --2- 172.21.15.82:0/2518748006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93d0160750 0x7f93d00c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:46.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cdd9b700 1 -- 172.21.15.82:0/2518748006 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b8009a70 con 0x7f93d0160380 2023-11-28T13:07:46.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cdd9b700 1 --2- 172.21.15.82:0/2518748006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d0160380 0x7f93d00c01e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f93c000e840 tx=0x7f93c000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:46.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93c6ffd700 1 -- 172.21.15.82:0/2518748006 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c00095a0 con 0x7f93d0160380 2023-11-28T13:07:46.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93c6ffd700 1 -- 172.21.15.82:0/2518748006 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c0013680 con 0x7f93d0160380 2023-11-28T13:07:46.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93c6ffd700 1 -- 172.21.15.82:0/2518748006 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c00139f0 con 0x7f93d0160380 2023-11-28T13:07:46.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cf59e700 1 -- 172.21.15.82:0/2518748006 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d00ccd90 con 0x7f93d0160380 2023-11-28T13:07:46.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.062+0000 7f93cf59e700 1 -- 172.21.15.82:0/2518748006 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d00ce9b0 con 0x7f93d0160380 2023-11-28T13:07:46.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.066+0000 7f93cf59e700 1 -- 172.21.15.82:0/2518748006 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d00719f0 con 0x7f93d0160380 2023-11-28T13:07:46.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.066+0000 7f93c6ffd700 1 -- 172.21.15.82:0/2518748006 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f93c0019030 con 0x7f93d0160380 2023-11-28T13:07:46.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.066+0000 7f93c6ffd700 1 --2- 172.21.15.82:0/2518748006 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93b4064ee0 0x7f93b4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:46.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.070+0000 7f93ce59c700 1 --2- 172.21.15.82:0/2518748006 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93b4064ee0 0x7f93b4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:46.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.070+0000 7f93c6ffd700 1 -- 172.21.15.82:0/2518748006 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f93c0081de0 con 0x7f93d0160380 2023-11-28T13:07:46.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.070+0000 7f93ce59c700 1 --2- 172.21.15.82:0/2518748006 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93b4064ee0 0x7f93b4067390 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f93b8014040 tx=0x7f93b8011000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:46.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.074+0000 7f93c6ffd700 1 -- 172.21.15.82:0/2518748006 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f93c004fd30 con 0x7f93d0160380 2023-11-28T13:07:46.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.238+0000 7f93cf59e700 1 -- 172.21.15.82:0/2518748006 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93d0065fc0 con 0x7f93d0160380 2023-11-28T13:07:46.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.242+0000 7f93c6ffd700 1 -- 172.21.15.82:0/2518748006 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+18032 (secure 0 0 0) 0x7f93c0053350 con 0x7f93d0160380 2023-11-28T13:07:46.250 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:07:46.251 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":67,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:04:10.914507+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T13:03:21.126074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T13:03:21.545268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.d","mappings":[{"from":7,"to":2}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.c","mappings":[{"from":4,"to":5},{"from":7,"to":3}]},{"pgid":"10.d","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:07:46.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.246+0000 7f93cf59e700 1 -- 172.21.15.82:0/2518748006 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93b4064ee0 msgr2=0x7f93b4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:46.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.246+0000 7f93cf59e700 1 --2- 172.21.15.82:0/2518748006 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93b4064ee0 0x7f93b4067390 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f93b8014040 tx=0x7f93b8011000 comp rx=0 tx=0).stop 2023-11-28T13:07:46.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.246+0000 7f93cf59e700 1 -- 172.21.15.82:0/2518748006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d0160380 msgr2=0x7f93d00c01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:46.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.246+0000 7f93cf59e700 1 --2- 172.21.15.82:0/2518748006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d0160380 0x7f93d00c01e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f93c000e840 tx=0x7f93c000eb50 comp rx=0 tx=0).stop 2023-11-28T13:07:46.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.246+0000 7f93cf59e700 1 -- 172.21.15.82:0/2518748006 shutdown_connections 2023-11-28T13:07:46.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.246+0000 7f93cf59e700 1 --2- 172.21.15.82:0/2518748006 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93b4064ee0 0x7f93b4067390 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:46.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.246+0000 7f93cf59e700 1 --2- 172.21.15.82:0/2518748006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93d0160750 0x7f93d00c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:46.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.246+0000 7f93cf59e700 1 --2- 172.21.15.82:0/2518748006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93d0160380 0x7f93d00c01e0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:46.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.246+0000 7f93cf59e700 1 --2- 172.21.15.82:0/2518748006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f93d0070c70 0x7f93d015e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:46.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.246+0000 7f93cf59e700 1 -- 172.21.15.82:0/2518748006 >> 172.21.15.82:0/2518748006 conn(0x7f93d00cb890 msgr2=0x7f93d0163330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:46.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.246+0000 7f93cf59e700 1 -- 172.21.15.82:0/2518748006 shutdown_connections 2023-11-28T13:07:46.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.246+0000 7f93cf59e700 1 -- 172.21.15.82:0/2518748006 wait complete. 2023-11-28T13:07:46.270 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T13:07:46.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.382+0000 7f940759e700 1 Processor -- start 2023-11-28T13:07:46.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.382+0000 7f940759e700 1 -- start start 2023-11-28T13:07:46.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.382+0000 7f940759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f940815c340 0x7f94080cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:46.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.382+0000 7f940759e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f94080d0f40 0x7f940815c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:46.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.382+0000 7f940759e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94080b0b50 con 0x7f940815cc50 2023-11-28T13:07:46.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.382+0000 7f940759e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94080ceaa0 con 0x7f94080d0f40 2023-11-28T13:07:46.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.382+0000 7f940759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940815d0d0 con 0x7f940815c340 2023-11-28T13:07:46.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.382+0000 7f9405d9b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f94080d0f40 0x7f940815c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:46.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.382+0000 7f9405d9b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f94080d0f40 0x7f940815c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.82:48396/0 (socket says 172.21.15.82:48396) 2023-11-28T13:07:46.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.382+0000 7f9405d9b700 1 -- 172.21.15.82:0/2240232487 learned_addr learned my addr 172.21.15.82:0/2240232487 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.382+0000 7f940659c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f940815c340 0x7f94080cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.382+0000 7f9406d9d700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f940815cc50 0x7f94080b1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:46388/0 (socket says 172.21.15.82:46388) 2023-11-28T13:07:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.382+0000 7f940659c700 1 -- 172.21.15.82:0/2240232487 >> v2:172.21.15.114:3300/0 conn(0x7f94080d0f40 msgr2=0x7f940815c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.382+0000 7f940659c700 1 --2- 172.21.15.82:0/2240232487 >> v2:172.21.15.114:3300/0 conn(0x7f94080d0f40 0x7f940815c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.382+0000 7f940659c700 1 -- 172.21.15.82:0/2240232487 >> v1:172.21.15.114:6789/0 conn(0x7f940815cc50 legacy=0x7f94080b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.382+0000 7f940659c700 1 -- 172.21.15.82:0/2240232487 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94080ce7c0 con 0x7f940815c340 2023-11-28T13:07:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.382+0000 7f9405d9b700 1 --2- 172.21.15.82:0/2240232487 >> v2:172.21.15.114:3300/0 conn(0x7f94080d0f40 0x7f940815c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:07:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.382+0000 7f940659c700 1 --2- 172.21.15.82:0/2240232487 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f940815c340 0x7f94080cae80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9400009850 tx=0x7f9400009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e957d628e5fea457 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.382+0000 7f940559a700 1 -- 172.21.15.82:0/2240232487 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9400011830 con 0x7f940815c340 2023-11-28T13:07:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.382+0000 7f940559a700 1 -- 172.21.15.82:0/2240232487 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9400011990 con 0x7f940815c340 2023-11-28T13:07:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.382+0000 7f940559a700 1 -- 172.21.15.82:0/2240232487 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9400011d40 con 0x7f940815c340 2023-11-28T13:07:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.386+0000 7f940759e700 1 -- 172.21.15.82:0/2240232487 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f940815c340 msgr2=0x7f94080cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.386+0000 7f940759e700 1 --2- 172.21.15.82:0/2240232487 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f940815c340 0x7f94080cae80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9400009850 tx=0x7f9400009b60 comp rx=0 tx=0).stop 2023-11-28T13:07:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.386+0000 7f940759e700 1 -- 172.21.15.82:0/2240232487 shutdown_connections 2023-11-28T13:07:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.386+0000 7f940759e700 1 --2- 172.21.15.82:0/2240232487 >> v2:172.21.15.114:3300/0 conn(0x7f94080d0f40 0x7f940815c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.386+0000 7f940759e700 1 --2- 172.21.15.82:0/2240232487 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f940815c340 0x7f94080cae80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.386+0000 7f940759e700 1 -- 172.21.15.82:0/2240232487 >> 172.21.15.82:0/2240232487 conn(0x7f94080cdf40 msgr2=0x7f94080d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.386+0000 7f940759e700 1 -- 172.21.15.82:0/2240232487 shutdown_connections 2023-11-28T13:07:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.386+0000 7f940759e700 1 -- 172.21.15.82:0/2240232487 wait complete. 2023-11-28T13:07:46.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.386+0000 7f940759e700 1 Processor -- start 2023-11-28T13:07:46.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.386+0000 7f940759e700 1 -- start start 2023-11-28T13:07:46.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.386+0000 7f940759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94080d0f40 0x7f94081459f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:46.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.386+0000 7f940759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f940815cc50 0x7f940806e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:46.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.386+0000 7f940759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9408153300 0x7f940806ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:46.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.386+0000 7f940759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94080c92b0 con 0x7f94080d0f40 2023-11-28T13:07:46.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.386+0000 7f940759e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94080c9590 con 0x7f940815cc50 2023-11-28T13:07:46.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.386+0000 7f940759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94080c9870 con 0x7f9408153300 2023-11-28T13:07:46.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.386+0000 7f940659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94080d0f40 0x7f94081459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:46.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.386+0000 7f9405d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f940815cc50 0x7f940806e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:46.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.386+0000 7f940659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94080d0f40 0x7f94081459f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46750/0 (socket says 172.21.15.82:46750) 2023-11-28T13:07:46.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.386+0000 7f940659c700 1 -- 172.21.15.82:0/1712265492 learned_addr learned my addr 172.21.15.82:0/1712265492 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:46.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.386+0000 7f9406d9d700 1 --2- 172.21.15.82:0/1712265492 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9408153300 0x7f940806ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:46.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.390+0000 7f940659c700 1 -- 172.21.15.82:0/1712265492 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9408153300 msgr2=0x7f940806ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:46.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.390+0000 7f940659c700 1 --2- 172.21.15.82:0/1712265492 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9408153300 0x7f940806ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:46.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.390+0000 7f940659c700 1 -- 172.21.15.82:0/1712265492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f940815cc50 msgr2=0x7f940806e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:46.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.390+0000 7f940659c700 1 --2- 172.21.15.82:0/1712265492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f940815cc50 0x7f940806e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:46.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.390+0000 7f940659c700 1 -- 172.21.15.82:0/1712265492 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f0009b30 con 0x7f94080d0f40 2023-11-28T13:07:46.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.390+0000 7f940659c700 1 --2- 172.21.15.82:0/1712265492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94080d0f40 0x7f94081459f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f94000090b0 tx=0x7f9400004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:46.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.390+0000 7f93feffd700 1 -- 172.21.15.82:0/1712265492 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94000043c0 con 0x7f94080d0f40 2023-11-28T13:07:46.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.390+0000 7f93feffd700 1 -- 172.21.15.82:0/1712265492 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940001f070 con 0x7f94080d0f40 2023-11-28T13:07:46.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.390+0000 7f940759e700 1 -- 172.21.15.82:0/1712265492 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94000094b0 con 0x7f94080d0f40 2023-11-28T13:07:46.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.390+0000 7f93feffd700 1 -- 172.21.15.82:0/1712265492 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94000036c0 con 0x7f94080d0f40 2023-11-28T13:07:46.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.390+0000 7f940759e700 1 -- 172.21.15.82:0/1712265492 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94080d0490 con 0x7f94080d0f40 2023-11-28T13:07:46.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.390+0000 7f940759e700 1 -- 172.21.15.82:0/1712265492 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94080d01b0 con 0x7f94080d0f40 2023-11-28T13:07:46.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.390+0000 7f93feffd700 1 -- 172.21.15.82:0/1712265492 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f940002a020 con 0x7f94080d0f40 2023-11-28T13:07:46.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.394+0000 7f93feffd700 1 --2- 172.21.15.82:0/1712265492 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93e8064f30 0x7f93e80673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:46.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.394+0000 7f93feffd700 1 -- 172.21.15.82:0/1712265492 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6186+0+0 (secure 0 0 0) 0x7f94000831d0 con 0x7f94080d0f40 2023-11-28T13:07:46.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.394+0000 7f9405d9b700 1 --2- 172.21.15.82:0/1712265492 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93e8064f30 0x7f93e80673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:46.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.394+0000 7f9405d9b700 1 --2- 172.21.15.82:0/1712265492 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93e8064f30 0x7f93e80673e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f94080c6e30 tx=0x7f93f000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:46.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.398+0000 7f93feffd700 1 -- 172.21.15.82:0/1712265492 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9400051390 con 0x7f94080d0f40 2023-11-28T13:07:46.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:46.594+0000 7f940759e700 1 -- 172.21.15.82:0/1712265492 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f94080d13b0 con 0x7f94080d0f40 2023-11-28T13:07:47.410 INFO:tasks.ceph.mon.a.smithi082.stderr:2023-11-28T13:07:47.406+0000 7f1907e90700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T13:07:47.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.418+0000 7f93feffd700 1 -- 172.21.15.82:0/1712265492 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) v1 ==== 161+0+0 (secure 0 0 0) 0x7f94000549b0 con 0x7f94080d0f40 2023-11-28T13:07:47.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.422+0000 7f940759e700 1 -- 172.21.15.82:0/1712265492 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93e8064f30 msgr2=0x7f93e80673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:47.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.422+0000 7f940759e700 1 --2- 172.21.15.82:0/1712265492 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93e8064f30 0x7f93e80673e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f94080c6e30 tx=0x7f93f000b040 comp rx=0 tx=0).stop 2023-11-28T13:07:47.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.422+0000 7f940759e700 1 -- 172.21.15.82:0/1712265492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94080d0f40 msgr2=0x7f94081459f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.422+0000 7f940759e700 1 --2- 172.21.15.82:0/1712265492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94080d0f40 0x7f94081459f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f94000090b0 tx=0x7f9400004770 comp rx=0 tx=0).stop 2023-11-28T13:07:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.422+0000 7f940759e700 1 -- 172.21.15.82:0/1712265492 shutdown_connections 2023-11-28T13:07:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.422+0000 7f940759e700 1 --2- 172.21.15.82:0/1712265492 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f93e8064f30 0x7f93e80673e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.422+0000 7f940759e700 1 --2- 172.21.15.82:0/1712265492 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9408153300 0x7f940806ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.422+0000 7f940759e700 1 --2- 172.21.15.82:0/1712265492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f940815cc50 0x7f940806e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.422+0000 7f940759e700 1 --2- 172.21.15.82:0/1712265492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94080d0f40 0x7f94081459f0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.422+0000 7f940759e700 1 -- 172.21.15.82:0/1712265492 >> 172.21.15.82:0/1712265492 conn(0x7f94080cdf40 msgr2=0x7f94080d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.422+0000 7f940759e700 1 -- 172.21.15.82:0/1712265492 shutdown_connections 2023-11-28T13:07:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.422+0000 7f940759e700 1 -- 172.21.15.82:0/1712265492 wait complete. 2023-11-28T13:07:47.432 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T13:07:47.447 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T13:07:47.470 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-11-28T13:07:47.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.558+0000 7fd2e19af700 1 Processor -- start 2023-11-28T13:07:47.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.558+0000 7fd2e19af700 1 -- start start 2023-11-28T13:07:47.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e19af700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd2dc06d820 0x7fd2dc06c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:47.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e19af700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2dc0ce870 con 0x7fd2dc158ff0 2023-11-28T13:07:47.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e19af700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2dc1593c0 con 0x7fd2dc06d3d0 2023-11-28T13:07:47.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e19af700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2dc0cd9c0 con 0x7fd2dc06d820 2023-11-28T13:07:47.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e09ad700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd2dc158ff0 0x7fd2dc15d470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52542/0 (socket says 172.21.15.82:52542) 2023-11-28T13:07:47.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e09ad700 1 -- 172.21.15.82:0/1992420394 learned_addr learned my addr 172.21.15.82:0/1992420394 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:47.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e11ae700 1 --2- 172.21.15.82:0/1992420394 >> v2:172.21.15.114:3300/0 conn(0x7fd2dc06d820 0x7fd2dc06c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:47.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2db7fe700 1 -- 172.21.15.82:0/1992420394 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046656929 0 0) 0x7fd2dc0ce870 con 0x7fd2dc158ff0 2023-11-28T13:07:47.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2db7fe700 1 -- 172.21.15.82:0/1992420394 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2cc0035d0 con 0x7fd2dc158ff0 2023-11-28T13:07:47.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2db7fe700 1 -- 172.21.15.82:0/1992420394 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 763319759 0 0) 0x7fd2cc0035d0 con 0x7fd2dc158ff0 2023-11-28T13:07:47.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2db7fe700 1 -- 172.21.15.82:0/1992420394 >> v2:172.21.15.114:3300/0 conn(0x7fd2dc06d820 msgr2=0x7fd2dc06c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:47.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2db7fe700 1 --2- 172.21.15.82:0/1992420394 >> v2:172.21.15.114:3300/0 conn(0x7fd2dc06d820 0x7fd2dc06c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:47.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2db7fe700 1 -- 172.21.15.82:0/1992420394 >> v1:172.21.15.114:6789/0 conn(0x7fd2dc06d3d0 legacy=0x7fd2dc06ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:47.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2db7fe700 1 -- 172.21.15.82:0/1992420394 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2dc0cdc60 con 0x7fd2dc158ff0 2023-11-28T13:07:47.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2db7fe700 1 -- 172.21.15.82:0/1992420394 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7fd2d0001670 con 0x7fd2dc158ff0 2023-11-28T13:07:47.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2db7fe700 1 -- 172.21.15.82:0/1992420394 >> v1:172.21.15.82:6789/0 conn(0x7fd2dc158ff0 legacy=0x7fd2dc15d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:47.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2db7fe700 1 --2- 172.21.15.82:0/1992420394 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd2cc003a20 0x7fd2cc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:47.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2db7fe700 1 --2- 172.21.15.82:0/1992420394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2cc004870 0x7fd2cc004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:47.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2db7fe700 1 --2- 172.21.15.82:0/1992420394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2cc005220 0x7fd2cc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:47.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2db7fe700 1 -- 172.21.15.82:0/1992420394 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc0cd9c0 con 0x7fd2cc005220 2023-11-28T13:07:47.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2db7fe700 1 -- 172.21.15.82:0/1992420394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc00c130 con 0x7fd2cc004870 2023-11-28T13:07:47.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2db7fe700 1 -- 172.21.15.82:0/1992420394 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc00c2f0 con 0x7fd2cc003a20 2023-11-28T13:07:47.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e11ae700 1 --2- 172.21.15.82:0/1992420394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2cc005220 0x7fd2cc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:47.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2dbfff700 1 --2- 172.21.15.82:0/1992420394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2cc004870 0x7fd2cc004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:47.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e09ad700 1 --2- 172.21.15.82:0/1992420394 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd2cc003a20 0x7fd2cc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:47.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e11ae700 1 -- 172.21.15.82:0/1992420394 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd2cc003a20 msgr2=0x7fd2cc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:47.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e11ae700 1 --2- 172.21.15.82:0/1992420394 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd2cc003a20 0x7fd2cc003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:47.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e11ae700 1 -- 172.21.15.82:0/1992420394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2cc004870 msgr2=0x7fd2cc004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:47.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e11ae700 1 --2- 172.21.15.82:0/1992420394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2cc004870 0x7fd2cc004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:47.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e11ae700 1 -- 172.21.15.82:0/1992420394 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2cc0035d0 con 0x7fd2cc005220 2023-11-28T13:07:47.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e11ae700 1 -- 172.21.15.82:0/1992420394 reap_dead start 2023-11-28T13:07:47.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e11ae700 1 --2- 172.21.15.82:0/1992420394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2cc005220 0x7fd2cc00ba30 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4009fc0 tx=0x7fd2cc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21edaeda6f584a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:47.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2db7fe700 1 -- 172.21.15.82:0/1992420394 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4003a40 con 0x7fd2cc005220 2023-11-28T13:07:47.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2db7fe700 1 -- 172.21.15.82:0/1992420394 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d400f040 con 0x7fd2cc005220 2023-11-28T13:07:47.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2db7fe700 1 -- 172.21.15.82:0/1992420394 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4003e00 con 0x7fd2cc005220 2023-11-28T13:07:47.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e19af700 1 -- 172.21.15.82:0/1992420394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2cc005220 msgr2=0x7fd2cc00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:47.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e19af700 1 --2- 172.21.15.82:0/1992420394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2cc005220 0x7fd2cc00ba30 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4009fc0 tx=0x7fd2cc0058a0 comp rx=0 tx=0).stop 2023-11-28T13:07:47.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e19af700 1 -- 172.21.15.82:0/1992420394 shutdown_connections 2023-11-28T13:07:47.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e19af700 1 --2- 172.21.15.82:0/1992420394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2cc005220 0x7fd2cc00ba30 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:47.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e19af700 1 -- 172.21.15.82:0/1992420394 >> 172.21.15.82:0/1992420394 conn(0x7fd2dc0cf710 msgr2=0x7fd2dc0cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:47.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e19af700 1 -- 172.21.15.82:0/1992420394 shutdown_connections 2023-11-28T13:07:47.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.562+0000 7fd2e19af700 1 -- 172.21.15.82:0/1992420394 wait complete. 2023-11-28T13:07:47.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2e19af700 1 Processor -- start 2023-11-28T13:07:47.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2e19af700 1 -- start start 2023-11-28T13:07:47.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2e19af700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2cc005220 0x7fd2dc14fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:47.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2e19af700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd2dc159620 0x7fd2dc15aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:47.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2e19af700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2dc1554d0 0x7fd2dc155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:47.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2e19af700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc155e80 con 0x7fd2dc1554d0 2023-11-28T13:07:47.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2e19af700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc15b730 con 0x7fd2cc005220 2023-11-28T13:07:47.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2e19af700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc15ba10 con 0x7fd2dc159620 2023-11-28T13:07:47.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2e11ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2dc1554d0 0x7fd2dc155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:47.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2e11ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2dc1554d0 0x7fd2dc155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50304/0 (socket says 172.21.15.82:50304) 2023-11-28T13:07:47.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2dbfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd2dc159620 0x7fd2dc15aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:47.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2e11ae700 1 -- 172.21.15.82:0/1003063408 learned_addr learned my addr 172.21.15.82:0/1003063408 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:47.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2e09ad700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2cc005220 0x7fd2dc14fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:47.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2e11ae700 1 -- 172.21.15.82:0/1003063408 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd2dc159620 msgr2=0x7fd2dc15aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:47.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2e11ae700 1 --2- 172.21.15.82:0/1003063408 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd2dc159620 0x7fd2dc15aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:47.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2e11ae700 1 -- 172.21.15.82:0/1003063408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2cc005220 msgr2=0x7fd2dc14fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:47.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2e11ae700 1 --2- 172.21.15.82:0/1003063408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2cc005220 0x7fd2dc14fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:47.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2e11ae700 1 -- 172.21.15.82:0/1003063408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2dc0ce220 con 0x7fd2dc1554d0 2023-11-28T13:07:47.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2e11ae700 1 --2- 172.21.15.82:0/1003063408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2dc1554d0 0x7fd2dc155940 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc0c2d60 tx=0x7fd2d4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:47.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2d97fa700 1 -- 172.21.15.82:0/1003063408 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4003e30 con 0x7fd2dc1554d0 2023-11-28T13:07:47.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2d97fa700 1 -- 172.21.15.82:0/1003063408 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d4004230 con 0x7fd2dc1554d0 2023-11-28T13:07:47.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2e19af700 1 -- 172.21.15.82:0/1003063408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2dc0cdf40 con 0x7fd2dc1554d0 2023-11-28T13:07:47.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2d97fa700 1 -- 172.21.15.82:0/1003063408 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d40045e0 con 0x7fd2dc1554d0 2023-11-28T13:07:47.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.566+0000 7fd2e19af700 1 -- 172.21.15.82:0/1003063408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2dc0ce500 con 0x7fd2dc1554d0 2023-11-28T13:07:47.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.570+0000 7fd2e19af700 1 -- 172.21.15.82:0/1003063408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2dc065fc0 con 0x7fd2dc1554d0 2023-11-28T13:07:47.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.570+0000 7fd2d97fa700 1 -- 172.21.15.82:0/1003063408 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd2d4004740 con 0x7fd2dc1554d0 2023-11-28T13:07:47.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.570+0000 7fd2d97fa700 1 --2- 172.21.15.82:0/1003063408 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd2c0064ee0 0x7fd2c0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:47.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.570+0000 7fd2d97fa700 1 -- 172.21.15.82:0/1003063408 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6272+0+0 (secure 0 0 0) 0x7fd2d4083270 con 0x7fd2dc1554d0 2023-11-28T13:07:47.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.570+0000 7fd2e09ad700 1 --2- 172.21.15.82:0/1003063408 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd2c0064ee0 0x7fd2c0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:47.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.570+0000 7fd2e09ad700 1 --2- 172.21.15.82:0/1003063408 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd2c0064ee0 0x7fd2c0067390 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0000c00 tx=0x7fd2d0000ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:47.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.582+0000 7fd2d97fa700 1 -- 172.21.15.82:0/1003063408 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd2d40512c0 con 0x7fd2dc1554d0 2023-11-28T13:07:47.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:47.778+0000 7fd2e19af700 1 -- 172.21.15.82:0/1003063408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd2dc0d0630 con 0x7fd2dc1554d0 2023-11-28T13:07:48.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.422+0000 7fd2d97fa700 1 -- 172.21.15.82:0/1003063408 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd2d40548e0 con 0x7fd2dc1554d0 2023-11-28T13:07:48.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.430+0000 7fd2e19af700 1 -- 172.21.15.82:0/1003063408 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd2c0064ee0 msgr2=0x7fd2c0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:48.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.430+0000 7fd2e19af700 1 --2- 172.21.15.82:0/1003063408 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd2c0064ee0 0x7fd2c0067390 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0000c00 tx=0x7fd2d0000ed0 comp rx=0 tx=0).stop 2023-11-28T13:07:48.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.430+0000 7fd2e19af700 1 -- 172.21.15.82:0/1003063408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2dc1554d0 msgr2=0x7fd2dc155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.430+0000 7fd2e19af700 1 --2- 172.21.15.82:0/1003063408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2dc1554d0 0x7fd2dc155940 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc0c2d60 tx=0x7fd2d4009750 comp rx=0 tx=0).stop 2023-11-28T13:07:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.430+0000 7fd2e19af700 1 -- 172.21.15.82:0/1003063408 shutdown_connections 2023-11-28T13:07:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.430+0000 7fd2e19af700 1 --2- 172.21.15.82:0/1003063408 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fd2c0064ee0 0x7fd2c0067390 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.430+0000 7fd2e19af700 1 --2- 172.21.15.82:0/1003063408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2dc1554d0 0x7fd2dc155940 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.430+0000 7fd2e19af700 1 --2- 172.21.15.82:0/1003063408 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd2dc159620 0x7fd2dc15aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.430+0000 7fd2e19af700 1 --2- 172.21.15.82:0/1003063408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2cc005220 0x7fd2dc14fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.430+0000 7fd2e19af700 1 -- 172.21.15.82:0/1003063408 >> 172.21.15.82:0/1003063408 conn(0x7fd2dc0cf710 msgr2=0x7fd2dc153ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.430+0000 7fd2e19af700 1 -- 172.21.15.82:0/1003063408 shutdown_connections 2023-11-28T13:07:48.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.430+0000 7fd2e19af700 1 -- 172.21.15.82:0/1003063408 wait complete. 2023-11-28T13:07:48.451 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T13:07:48.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.618+0000 7fefbe358700 1 Processor -- start 2023-11-28T13:07:48.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.618+0000 7fefbe358700 1 -- start start 2023-11-28T13:07:48.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.618+0000 7fefbe358700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefb80afd20 0x7fefb8165120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:48.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.618+0000 7fefbe358700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb80cc9b0 con 0x7fefb80cce20 2023-11-28T13:07:48.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.618+0000 7fefbe358700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb80d02b0 con 0x7fefb806fe00 2023-11-28T13:07:48.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.618+0000 7fefbe358700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb806e220 con 0x7fefb80afd20 2023-11-28T13:07:48.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.618+0000 7fefb77fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fefb80cce20 0x7fefb80701d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52544/0 (socket says 172.21.15.82:52544) 2023-11-28T13:07:48.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.618+0000 7fefb77fe700 1 -- 172.21.15.82:0/955785867 learned_addr learned my addr 172.21.15.82:0/955785867 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:48.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.618+0000 7fefbc8f5700 1 --2- 172.21.15.82:0/955785867 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefb80afd20 0x7fefb8165120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:48.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.618+0000 7fefb6ffd700 1 -- 172.21.15.82:0/955785867 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3021017022 0 0) 0x7fefb80cc9b0 con 0x7fefb80cce20 2023-11-28T13:07:48.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.618+0000 7fefb6ffd700 1 -- 172.21.15.82:0/955785867 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefa40035d0 con 0x7fefb80cce20 2023-11-28T13:07:48.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.618+0000 7fefb6ffd700 1 -- 172.21.15.82:0/955785867 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632039122 0 0) 0x7fefb80d02b0 con 0x7fefb806fe00 2023-11-28T13:07:48.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.618+0000 7fefb6ffd700 1 -- 172.21.15.82:0/955785867 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefb80cc9b0 con 0x7fefb806fe00 2023-11-28T13:07:48.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.618+0000 7fefbc8f5700 1 -- 172.21.15.82:0/955785867 >> v1:172.21.15.114:6789/0 conn(0x7fefb806fe00 legacy=0x7fefb80cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:48.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.618+0000 7fefbc8f5700 1 -- 172.21.15.82:0/955785867 >> v1:172.21.15.82:6789/0 conn(0x7fefb80cce20 legacy=0x7fefb80701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:48.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.618+0000 7fefbc8f5700 1 -- 172.21.15.82:0/955785867 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb806e500 con 0x7fefb80afd20 2023-11-28T13:07:48.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.618+0000 7fefbc8f5700 1 --2- 172.21.15.82:0/955785867 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefb80afd20 0x7fefb8165120 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009dc0 tx=0x7fefb000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df2a38401d00b98c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:48.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.622+0000 7fefb6ffd700 1 -- 172.21.15.82:0/955785867 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb000e070 con 0x7fefb80afd20 2023-11-28T13:07:48.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.622+0000 7fefb6ffd700 1 -- 172.21.15.82:0/955785867 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb000bb20 con 0x7fefb80afd20 2023-11-28T13:07:48.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.622+0000 7fefb6ffd700 1 -- 172.21.15.82:0/955785867 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb0012430 con 0x7fefb80afd20 2023-11-28T13:07:48.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.622+0000 7fefbe358700 1 -- 172.21.15.82:0/955785867 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefb80afd20 msgr2=0x7fefb8165120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:48.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.622+0000 7fefbe358700 1 --2- 172.21.15.82:0/955785867 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefb80afd20 0x7fefb8165120 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009dc0 tx=0x7fefb000b330 comp rx=0 tx=0).stop 2023-11-28T13:07:48.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.622+0000 7fefbe358700 1 -- 172.21.15.82:0/955785867 shutdown_connections 2023-11-28T13:07:48.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.622+0000 7fefbe358700 1 --2- 172.21.15.82:0/955785867 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefb80afd20 0x7fefb8165120 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:48.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.622+0000 7fefbe358700 1 -- 172.21.15.82:0/955785867 >> 172.21.15.82:0/955785867 conn(0x7fefb80d0990 msgr2=0x7fefb80d0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:48.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.622+0000 7fefbe358700 1 -- 172.21.15.82:0/955785867 shutdown_connections 2023-11-28T13:07:48.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.622+0000 7fefbe358700 1 -- 172.21.15.82:0/955785867 wait complete. 2023-11-28T13:07:48.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.622+0000 7fefbe358700 1 Processor -- start 2023-11-28T13:07:48.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.622+0000 7fefbe358700 1 -- start start 2023-11-28T13:07:48.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefbe358700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefb806fe00 0x7fefb81532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:48.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefbe358700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb80afd20 0x7fefb80b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:48.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefbe358700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefb80cce20 0x7fefb815dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:48.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefbe358700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb80b41a0 con 0x7fefb806fe00 2023-11-28T13:07:48.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefbe358700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb80b4ff0 con 0x7fefb80afd20 2023-11-28T13:07:48.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefbe358700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb81537f0 con 0x7fefb80cce20 2023-11-28T13:07:48.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefb7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefb806fe00 0x7fefb81532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:48.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefb7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefb806fe00 0x7fefb81532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50310/0 (socket says 172.21.15.82:50310) 2023-11-28T13:07:48.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefb7fff700 1 -- 172.21.15.82:0/918996216 learned_addr learned my addr 172.21.15.82:0/918996216 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:48.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefbc8f5700 1 --2- 172.21.15.82:0/918996216 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefb80cce20 0x7fefb815dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:48.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefb77fe700 1 --2- 172.21.15.82:0/918996216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb80afd20 0x7fefb80b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:48.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefb7fff700 1 -- 172.21.15.82:0/918996216 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefb80cce20 msgr2=0x7fefb815dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:48.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefb7fff700 1 --2- 172.21.15.82:0/918996216 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefb80cce20 0x7fefb815dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:48.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefb7fff700 1 -- 172.21.15.82:0/918996216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb80afd20 msgr2=0x7fefb80b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:48.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefb7fff700 1 --2- 172.21.15.82:0/918996216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb80afd20 0x7fefb80b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:48.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefb7fff700 1 -- 172.21.15.82:0/918996216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb0009a70 con 0x7fefb806fe00 2023-11-28T13:07:48.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefb7fff700 1 --2- 172.21.15.82:0/918996216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefb806fe00 0x7fefb81532b0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fefa800c730 tx=0x7fefa800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:48.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefb4ff9700 1 -- 172.21.15.82:0/918996216 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa80052d0 con 0x7fefb806fe00 2023-11-28T13:07:48.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefb4ff9700 1 -- 172.21.15.82:0/918996216 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa8005450 con 0x7fefb806fe00 2023-11-28T13:07:48.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefbe358700 1 -- 172.21.15.82:0/918996216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb806f670 con 0x7fefb806fe00 2023-11-28T13:07:48.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefb4ff9700 1 -- 172.21.15.82:0/918996216 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa80038e0 con 0x7fefb806fe00 2023-11-28T13:07:48.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefbe358700 1 -- 172.21.15.82:0/918996216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb80d0500 con 0x7fefb806fe00 2023-11-28T13:07:48.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.626+0000 7fefb4ff9700 1 -- 172.21.15.82:0/918996216 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fefa8019030 con 0x7fefb806fe00 2023-11-28T13:07:48.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.630+0000 7fefbe358700 1 -- 172.21.15.82:0/918996216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9c005310 con 0x7fefb806fe00 2023-11-28T13:07:48.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.630+0000 7fefb4ff9700 1 --2- 172.21.15.82:0/918996216 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fef98064f10 0x7fef980673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:48.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.630+0000 7fefb77fe700 1 --2- 172.21.15.82:0/918996216 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fef98064f10 0x7fef980673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:48.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.630+0000 7fefb4ff9700 1 -- 172.21.15.82:0/918996216 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6272+0+0 (secure 0 0 0) 0x7fefa80812a0 con 0x7fefb806fe00 2023-11-28T13:07:48.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.630+0000 7fefb77fe700 1 --2- 172.21.15.82:0/918996216 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fef98064f10 0x7fef980673c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fefb8159e20 tx=0x7fefa0007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:48.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.638+0000 7fefb4ff9700 1 -- 172.21.15.82:0/918996216 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fefa804f2a0 con 0x7fefb806fe00 2023-11-28T13:07:48.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:48.806+0000 7fefbe358700 1 -- 172.21.15.82:0/918996216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fef9c0055c0 con 0x7fefb806fe00 2023-11-28T13:07:49.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.430+0000 7fefb4ff9700 1 -- 172.21.15.82:0/918996216 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v69) v1 ==== 181+0+0 (secure 0 0 0) 0x7fefa80528c0 con 0x7fefb806fe00 2023-11-28T13:07:49.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.438+0000 7fefbe358700 1 -- 172.21.15.82:0/918996216 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fef98064f10 msgr2=0x7fef980673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:49.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.438+0000 7fefbe358700 1 --2- 172.21.15.82:0/918996216 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fef98064f10 0x7fef980673c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fefb8159e20 tx=0x7fefa0007de0 comp rx=0 tx=0).stop 2023-11-28T13:07:49.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.438+0000 7fefbe358700 1 -- 172.21.15.82:0/918996216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefb806fe00 msgr2=0x7fefb81532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:49.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.438+0000 7fefbe358700 1 --2- 172.21.15.82:0/918996216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefb806fe00 0x7fefb81532b0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fefa800c730 tx=0x7fefa800ca40 comp rx=0 tx=0).stop 2023-11-28T13:07:49.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.438+0000 7fefbe358700 1 -- 172.21.15.82:0/918996216 shutdown_connections 2023-11-28T13:07:49.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.438+0000 7fefbe358700 1 --2- 172.21.15.82:0/918996216 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fef98064f10 0x7fef980673c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:49.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.438+0000 7fefbe358700 1 --2- 172.21.15.82:0/918996216 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefb80cce20 0x7fefb815dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:49.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.438+0000 7fefbe358700 1 --2- 172.21.15.82:0/918996216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb80afd20 0x7fefb80b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:49.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.438+0000 7fefbe358700 1 --2- 172.21.15.82:0/918996216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefb806fe00 0x7fefb81532b0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:49.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.438+0000 7fefbe358700 1 -- 172.21.15.82:0/918996216 >> 172.21.15.82:0/918996216 conn(0x7fefb80d0990 msgr2=0x7fefb8072b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:49.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.438+0000 7fefbe358700 1 -- 172.21.15.82:0/918996216 shutdown_connections 2023-11-28T13:07:49.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.438+0000 7fefbe358700 1 -- 172.21.15.82:0/918996216 wait complete. 2023-11-28T13:07:49.446 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2023-11-28T13:07:49.462 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T13:07:49.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.570+0000 7f27a4e30700 1 Processor -- start 2023-11-28T13:07:49.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f27a4e30700 1 -- start start 2023-11-28T13:07:49.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f27a4e30700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f27a00ae190 0x7f27a006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:49.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f27a4e30700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a00caf40 con 0x7f27a00707d0 2023-11-28T13:07:49.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f27a4e30700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a00cb1c0 con 0x7f27a015c0d0 2023-11-28T13:07:49.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f27a4e30700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a00cb780 con 0x7f27a00ae190 2023-11-28T13:07:49.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279ffff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f27a00707d0 0x7f27a015fd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52548/0 (socket says 172.21.15.82:52548) 2023-11-28T13:07:49.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279ffff700 1 -- 172.21.15.82:0/3467083139 learned_addr learned my addr 172.21.15.82:0/3467083139 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:49.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279effd700 1 --2- 172.21.15.82:0/3467083139 >> v2:172.21.15.114:3300/0 conn(0x7f27a00ae190 0x7f27a006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:49.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279e7fc700 1 -- 172.21.15.82:0/3467083139 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586052153 0 0) 0x7f27a00caf40 con 0x7f27a00707d0 2023-11-28T13:07:49.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279e7fc700 1 -- 172.21.15.82:0/3467083139 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f278c0035d0 con 0x7f27a00707d0 2023-11-28T13:07:49.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279e7fc700 1 -- 172.21.15.82:0/3467083139 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328629296 0 0) 0x7f27a00cb1c0 con 0x7f27a015c0d0 2023-11-28T13:07:49.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279e7fc700 1 -- 172.21.15.82:0/3467083139 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27a00caf40 con 0x7f27a015c0d0 2023-11-28T13:07:49.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279e7fc700 1 -- 172.21.15.82:0/3467083139 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 87871587 0 0) 0x7f278c0035d0 con 0x7f27a00707d0 2023-11-28T13:07:49.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279e7fc700 1 -- 172.21.15.82:0/3467083139 >> v2:172.21.15.114:3300/0 conn(0x7f27a00ae190 msgr2=0x7f27a006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:49.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279e7fc700 1 --2- 172.21.15.82:0/3467083139 >> v2:172.21.15.114:3300/0 conn(0x7f27a00ae190 0x7f27a006d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:49.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279e7fc700 1 -- 172.21.15.82:0/3467083139 >> v1:172.21.15.114:6789/0 conn(0x7f27a015c0d0 legacy=0x7f27a00c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:49.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279e7fc700 1 -- 172.21.15.82:0/3467083139 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a00cb4a0 con 0x7f27a00707d0 2023-11-28T13:07:49.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279e7fc700 1 -- 172.21.15.82:0/3467083139 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f27980019f0 con 0x7f27a00707d0 2023-11-28T13:07:49.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279effd700 1 --2- 172.21.15.82:0/3467083139 >> v2:172.21.15.114:3300/0 conn(0x7f27a00ae190 0x7f27a006d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:07:49.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279e7fc700 1 -- 172.21.15.82:0/3467083139 >> v1:172.21.15.82:6789/0 conn(0x7f27a00707d0 legacy=0x7f27a015fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:49.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279e7fc700 1 --2- 172.21.15.82:0/3467083139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f278c003bb0 0x7f278c003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:49.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279e7fc700 1 --2- 172.21.15.82:0/3467083139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f278c004870 0x7f278c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:49.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279e7fc700 1 --2- 172.21.15.82:0/3467083139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f278c005220 0x7f278c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:49.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279e7fc700 1 -- 172.21.15.82:0/3467083139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a00cb780 con 0x7f278c003bb0 2023-11-28T13:07:49.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279e7fc700 1 -- 172.21.15.82:0/3467083139 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c00c080 con 0x7f278c004870 2023-11-28T13:07:49.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279e7fc700 1 -- 172.21.15.82:0/3467083139 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278c00c240 con 0x7f278c005220 2023-11-28T13:07:49.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279f7fe700 1 --2- 172.21.15.82:0/3467083139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f278c003bb0 0x7f278c003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:49.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279effd700 1 --2- 172.21.15.82:0/3467083139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f278c004870 0x7f278c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:49.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279ffff700 1 --2- 172.21.15.82:0/3467083139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f278c005220 0x7f278c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:49.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279f7fe700 1 -- 172.21.15.82:0/3467083139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f278c005220 msgr2=0x7f278c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:49.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279f7fe700 1 --2- 172.21.15.82:0/3467083139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f278c005220 0x7f278c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:49.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279f7fe700 1 -- 172.21.15.82:0/3467083139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f278c004870 msgr2=0x7f278c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:49.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279f7fe700 1 --2- 172.21.15.82:0/3467083139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f278c004870 0x7f278c004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:49.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279f7fe700 1 -- 172.21.15.82:0/3467083139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c0035d0 con 0x7f278c003bb0 2023-11-28T13:07:49.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.574+0000 7f279ffff700 1 -- 172.21.15.82:0/3467083139 reap_dead start 2023-11-28T13:07:49.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.578+0000 7f279f7fe700 1 --2- 172.21.15.82:0/3467083139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f278c003bb0 0x7f278c003fa0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f2788001960 tx=0x7f278c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa8c8fafba2b135c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:49.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.578+0000 7f279e7fc700 1 -- 172.21.15.82:0/3467083139 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2788001450 con 0x7f278c003bb0 2023-11-28T13:07:49.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.578+0000 7f279e7fc700 1 -- 172.21.15.82:0/3467083139 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27880052f0 con 0x7f278c003bb0 2023-11-28T13:07:49.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.578+0000 7f279e7fc700 1 -- 172.21.15.82:0/3467083139 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27880036a0 con 0x7f278c003bb0 2023-11-28T13:07:49.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.578+0000 7f27a4e30700 1 -- 172.21.15.82:0/3467083139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f278c003bb0 msgr2=0x7f278c003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:49.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.578+0000 7f27a4e30700 1 --2- 172.21.15.82:0/3467083139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f278c003bb0 0x7f278c003fa0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f2788001960 tx=0x7f278c0058a0 comp rx=0 tx=0).stop 2023-11-28T13:07:49.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.578+0000 7f27a4e30700 1 -- 172.21.15.82:0/3467083139 shutdown_connections 2023-11-28T13:07:49.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.578+0000 7f27a4e30700 1 --2- 172.21.15.82:0/3467083139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f278c003bb0 0x7f278c003fa0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:49.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.578+0000 7f27a4e30700 1 -- 172.21.15.82:0/3467083139 >> 172.21.15.82:0/3467083139 conn(0x7f27a00b1660 msgr2=0x7f27a00cee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:49.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.578+0000 7f27a4e30700 1 -- 172.21.15.82:0/3467083139 shutdown_connections 2023-11-28T13:07:49.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.578+0000 7f27a4e30700 1 -- 172.21.15.82:0/3467083139 wait complete. 2023-11-28T13:07:49.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.578+0000 7f27a4e30700 1 Processor -- start 2023-11-28T13:07:49.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.578+0000 7f27a4e30700 1 -- start start 2023-11-28T13:07:49.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f27a4e30700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f278c003bb0 0x7f27a015d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:49.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f27a4e30700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27a01f4df0 0x7f27a01587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:49.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f27a4e30700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27a00c94c0 0x7f27a00c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:49.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f27a4e30700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a015d8a0 con 0x7f27a01f4df0 2023-11-28T13:07:49.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f27a4e30700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a00c9e70 con 0x7f27a00c94c0 2023-11-28T13:07:49.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f27a4e30700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a00c6af0 con 0x7f278c003bb0 2023-11-28T13:07:49.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f279effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27a01f4df0 0x7f27a01587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:49.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f279effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27a01f4df0 0x7f27a01587e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50336/0 (socket says 172.21.15.82:50336) 2023-11-28T13:07:49.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f279effd700 1 -- 172.21.15.82:0/20194149 learned_addr learned my addr 172.21.15.82:0/20194149 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:49.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f279ffff700 1 --2- 172.21.15.82:0/20194149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27a00c94c0 0x7f27a00c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:49.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f279f7fe700 1 --2- 172.21.15.82:0/20194149 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f278c003bb0 0x7f27a015d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:49.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f279effd700 1 -- 172.21.15.82:0/20194149 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f278c003bb0 msgr2=0x7f27a015d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:49.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f279effd700 1 --2- 172.21.15.82:0/20194149 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f278c003bb0 0x7f27a015d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:49.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f279effd700 1 -- 172.21.15.82:0/20194149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27a00c94c0 msgr2=0x7f27a00c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:49.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f279effd700 1 --2- 172.21.15.82:0/20194149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27a00c94c0 0x7f27a00c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:49.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f279effd700 1 -- 172.21.15.82:0/20194149 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a006ccc0 con 0x7f27a01f4df0 2023-11-28T13:07:49.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f279effd700 1 --2- 172.21.15.82:0/20194149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27a01f4df0 0x7f27a01587e0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f2790011d30 tx=0x7f279000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:49.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f2797fff700 1 -- 172.21.15.82:0/20194149 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279000fa20 con 0x7f27a01f4df0 2023-11-28T13:07:49.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f2797fff700 1 -- 172.21.15.82:0/20194149 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279000fb80 con 0x7f27a01f4df0 2023-11-28T13:07:49.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f2797fff700 1 -- 172.21.15.82:0/20194149 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790014440 con 0x7f27a01f4df0 2023-11-28T13:07:49.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f27a4e30700 1 -- 172.21.15.82:0/20194149 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a006c9e0 con 0x7f27a01f4df0 2023-11-28T13:07:49.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.582+0000 7f27a4e30700 1 -- 172.21.15.82:0/20194149 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a015c4a0 con 0x7f27a01f4df0 2023-11-28T13:07:49.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.586+0000 7f27a4e30700 1 -- 172.21.15.82:0/20194149 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a0065fc0 con 0x7f27a01f4df0 2023-11-28T13:07:49.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.586+0000 7f2797fff700 1 -- 172.21.15.82:0/20194149 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f27900147b0 con 0x7f27a01f4df0 2023-11-28T13:07:49.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.586+0000 7f2797fff700 1 --2- 172.21.15.82:0/20194149 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2780064f10 0x7f27800673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:49.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.586+0000 7f2797fff700 1 -- 172.21.15.82:0/20194149 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5805+0+0 (secure 0 0 0) 0x7f2790082a30 con 0x7f27a01f4df0 2023-11-28T13:07:49.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.586+0000 7f279f7fe700 1 --2- 172.21.15.82:0/20194149 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2780064f10 0x7f27800673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:49.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.586+0000 7f279f7fe700 1 --2- 172.21.15.82:0/20194149 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2780064f10 0x7f27800673c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2788005040 tx=0x7f278800a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:49.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.594+0000 7f2797fff700 1 -- 172.21.15.82:0/20194149 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2790050b60 con 0x7f27a01f4df0 2023-11-28T13:07:49.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:49.758+0000 7f27a4e30700 1 -- 172.21.15.82:0/20194149 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f27a00cf630 con 0x7f27a01f4df0 2023-11-28T13:07:50.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.442+0000 7f2797fff700 1 -- 172.21.15.82:0/20194149 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v70) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2790022020 con 0x7f27a01f4df0 2023-11-28T13:07:50.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.450+0000 7f27a4e30700 1 -- 172.21.15.82:0/20194149 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2780064f10 msgr2=0x7f27800673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:50.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.450+0000 7f27a4e30700 1 --2- 172.21.15.82:0/20194149 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2780064f10 0x7f27800673c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2788005040 tx=0x7f278800a000 comp rx=0 tx=0).stop 2023-11-28T13:07:50.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.450+0000 7f27a4e30700 1 -- 172.21.15.82:0/20194149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27a01f4df0 msgr2=0x7f27a01587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:50.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.450+0000 7f27a4e30700 1 --2- 172.21.15.82:0/20194149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27a01f4df0 0x7f27a01587e0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f2790011d30 tx=0x7f279000f520 comp rx=0 tx=0).stop 2023-11-28T13:07:50.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.450+0000 7f27a4e30700 1 -- 172.21.15.82:0/20194149 shutdown_connections 2023-11-28T13:07:50.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.450+0000 7f27a4e30700 1 --2- 172.21.15.82:0/20194149 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f2780064f10 0x7f27800673c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:50.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.450+0000 7f27a4e30700 1 --2- 172.21.15.82:0/20194149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27a00c94c0 0x7f27a00c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:50.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.450+0000 7f27a4e30700 1 --2- 172.21.15.82:0/20194149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27a01f4df0 0x7f27a01587e0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:50.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.450+0000 7f27a4e30700 1 --2- 172.21.15.82:0/20194149 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f278c003bb0 0x7f27a015d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:50.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.450+0000 7f27a4e30700 1 -- 172.21.15.82:0/20194149 >> 172.21.15.82:0/20194149 conn(0x7f27a00b1660 msgr2=0x7f27a015fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:50.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.450+0000 7f27a4e30700 1 -- 172.21.15.82:0/20194149 shutdown_connections 2023-11-28T13:07:50.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.450+0000 7f27a4e30700 1 -- 172.21.15.82:0/20194149 wait complete. 2023-11-28T13:07:50.459 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2023-11-28T13:07:50.474 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T13:07:50.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.582+0000 7f12fffff700 1 Processor -- start 2023-11-28T13:07:50.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.582+0000 7f12fffff700 1 -- start start 2023-11-28T13:07:50.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12fffff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1300150ee0 0x7f1300070120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:50.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12fffff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f13000ad8b0 0x7f13000add10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:50.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12fffff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13000ae250 con 0x7f1300070660 2023-11-28T13:07:50.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12fffff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1300069bc0 con 0x7f13000ad8b0 2023-11-28T13:07:50.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12fffff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1300069e80 con 0x7f1300150ee0 2023-11-28T13:07:50.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12fe7fc700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1300070660 0x7f130006ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52554/0 (socket says 172.21.15.82:52554) 2023-11-28T13:07:50.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12fe7fc700 1 -- 172.21.15.82:0/1319504734 learned_addr learned my addr 172.21.15.82:0/1319504734 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:50.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12feffd700 1 --2- 172.21.15.82:0/1319504734 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1300150ee0 0x7f1300070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:50.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12ff7fe700 1 --2- 172.21.15.82:0/1319504734 >> v2:172.21.15.114:3300/0 conn(0x7f13000ad8b0 0x7f13000add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:50.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12fdffb700 1 -- 172.21.15.82:0/1319504734 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495113324 0 0) 0x7f13000ae250 con 0x7f1300070660 2023-11-28T13:07:50.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12fdffb700 1 -- 172.21.15.82:0/1319504734 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12ec0035d0 con 0x7f1300070660 2023-11-28T13:07:50.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12feffd700 1 -- 172.21.15.82:0/1319504734 >> v2:172.21.15.114:3300/0 conn(0x7f13000ad8b0 msgr2=0x7f13000add10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:50.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12feffd700 1 --2- 172.21.15.82:0/1319504734 >> v2:172.21.15.114:3300/0 conn(0x7f13000ad8b0 0x7f13000add10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:50.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12feffd700 1 -- 172.21.15.82:0/1319504734 >> v1:172.21.15.82:6789/0 conn(0x7f1300070660 legacy=0x7f130006ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:50.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12feffd700 1 -- 172.21.15.82:0/1319504734 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130006a160 con 0x7f1300150ee0 2023-11-28T13:07:50.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12ff7fe700 1 --2- 172.21.15.82:0/1319504734 >> v2:172.21.15.114:3300/0 conn(0x7f13000ad8b0 0x7f13000add10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:07:50.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12feffd700 1 --2- 172.21.15.82:0/1319504734 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1300150ee0 0x7f1300070120 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009850 tx=0x7f12e8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b26943756fffe84 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:50.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12fdffb700 1 -- 172.21.15.82:0/1319504734 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8011830 con 0x7f1300150ee0 2023-11-28T13:07:50.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12fdffb700 1 -- 172.21.15.82:0/1319504734 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e8011990 con 0x7f1300150ee0 2023-11-28T13:07:50.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12fdffb700 1 -- 172.21.15.82:0/1319504734 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8011d40 con 0x7f1300150ee0 2023-11-28T13:07:50.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12fffff700 1 -- 172.21.15.82:0/1319504734 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1300150ee0 msgr2=0x7f1300070120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:50.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.586+0000 7f12fffff700 1 --2- 172.21.15.82:0/1319504734 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1300150ee0 0x7f1300070120 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009850 tx=0x7f12e8009b60 comp rx=0 tx=0).stop 2023-11-28T13:07:50.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12fffff700 1 -- 172.21.15.82:0/1319504734 shutdown_connections 2023-11-28T13:07:50.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12fffff700 1 --2- 172.21.15.82:0/1319504734 >> v2:172.21.15.114:3300/0 conn(0x7f13000ad8b0 0x7f13000add10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:50.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12fffff700 1 --2- 172.21.15.82:0/1319504734 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1300150ee0 0x7f1300070120 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:50.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12fffff700 1 -- 172.21.15.82:0/1319504734 >> 172.21.15.82:0/1319504734 conn(0x7f13000ce630 msgr2=0x7f13000cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:50.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12fffff700 1 -- 172.21.15.82:0/1319504734 shutdown_connections 2023-11-28T13:07:50.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12fffff700 1 -- 172.21.15.82:0/1319504734 wait complete. 2023-11-28T13:07:50.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12fffff700 1 Processor -- start 2023-11-28T13:07:50.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12fffff700 1 -- start start 2023-11-28T13:07:50.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12fffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1300070660 0x7f1300155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:50.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12fffff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13000ad8b0 0x7f130015c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:50.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12fffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1300150ee0 0x7f130015cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:50.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12fffff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13001556d0 con 0x7f1300070660 2023-11-28T13:07:50.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12fffff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000b4280 con 0x7f1300150ee0 2023-11-28T13:07:50.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12fffff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1300154d30 con 0x7f13000ad8b0 2023-11-28T13:07:50.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12feffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1300070660 0x7f1300155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:50.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12feffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1300070660 0x7f1300155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50350/0 (socket says 172.21.15.82:50350) 2023-11-28T13:07:50.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12feffd700 1 -- 172.21.15.82:0/1479306507 learned_addr learned my addr 172.21.15.82:0/1479306507 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:50.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12fe7fc700 1 --2- 172.21.15.82:0/1479306507 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13000ad8b0 0x7f130015c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:50.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12ff7fe700 1 --2- 172.21.15.82:0/1479306507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1300150ee0 0x7f130015cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:50.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12feffd700 1 -- 172.21.15.82:0/1479306507 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13000ad8b0 msgr2=0x7f130015c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:50.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12feffd700 1 --2- 172.21.15.82:0/1479306507 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13000ad8b0 0x7f130015c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:50.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12feffd700 1 -- 172.21.15.82:0/1479306507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1300150ee0 msgr2=0x7f130015cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:50.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12feffd700 1 --2- 172.21.15.82:0/1479306507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1300150ee0 0x7f130015cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:50.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12feffd700 1 -- 172.21.15.82:0/1479306507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f80094b0 con 0x7f1300070660 2023-11-28T13:07:50.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.590+0000 7f12feffd700 1 --2- 172.21.15.82:0/1479306507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1300070660 0x7f1300155af0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f12e8014040 tx=0x7f12e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:50.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.594+0000 7f12f77fe700 1 -- 172.21.15.82:0/1479306507 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8004590 con 0x7f1300070660 2023-11-28T13:07:50.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.594+0000 7f12fffff700 1 -- 172.21.15.82:0/1479306507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e80094b0 con 0x7f1300070660 2023-11-28T13:07:50.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.594+0000 7f12f77fe700 1 -- 172.21.15.82:0/1479306507 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e801e070 con 0x7f1300070660 2023-11-28T13:07:50.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.594+0000 7f12f77fe700 1 -- 172.21.15.82:0/1479306507 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8003900 con 0x7f1300070660 2023-11-28T13:07:50.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.594+0000 7f12fffff700 1 -- 172.21.15.82:0/1479306507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130006a720 con 0x7f1300070660 2023-11-28T13:07:50.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.594+0000 7f12fffff700 1 -- 172.21.15.82:0/1479306507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130006a440 con 0x7f1300070660 2023-11-28T13:07:50.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.594+0000 7f12f77fe700 1 -- 172.21.15.82:0/1479306507 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f12e800f050 con 0x7f1300070660 2023-11-28T13:07:50.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.594+0000 7f12f77fe700 1 --2- 172.21.15.82:0/1479306507 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f12e0064ee0 0x7f12e0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:50.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.594+0000 7f12f77fe700 1 -- 172.21.15.82:0/1479306507 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f12e8020070 con 0x7f1300070660 2023-11-28T13:07:50.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.594+0000 7f12fe7fc700 1 --2- 172.21.15.82:0/1479306507 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f12e0064ee0 0x7f12e0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:50.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.594+0000 7f12fe7fc700 1 --2- 172.21.15.82:0/1479306507 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f12e0064ee0 0x7f12e0067390 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f13000b3ce0 tx=0x7f12f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:50.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.598+0000 7f12f77fe700 1 -- 172.21.15.82:0/1479306507 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f12e80514c0 con 0x7f1300070660 2023-11-28T13:07:50.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.770+0000 7f12fffff700 1 -- 172.21.15.82:0/1479306507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f130006b350 con 0x7f1300070660 2023-11-28T13:07:50.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.774+0000 7f12f77fe700 1 -- 172.21.15.82:0/1479306507 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f12e80150a0 con 0x7f1300070660 2023-11-28T13:07:50.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.774+0000 7f12fffff700 1 -- 172.21.15.82:0/1479306507 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f12e0064ee0 msgr2=0x7f12e0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:50.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.774+0000 7f12fffff700 1 --2- 172.21.15.82:0/1479306507 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f12e0064ee0 0x7f12e0067390 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f13000b3ce0 tx=0x7f12f0009040 comp rx=0 tx=0).stop 2023-11-28T13:07:50.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.774+0000 7f12fffff700 1 -- 172.21.15.82:0/1479306507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1300070660 msgr2=0x7f1300155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:50.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.774+0000 7f12fffff700 1 --2- 172.21.15.82:0/1479306507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1300070660 0x7f1300155af0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f12e8014040 tx=0x7f12e8004770 comp rx=0 tx=0).stop 2023-11-28T13:07:50.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.774+0000 7f12fffff700 1 -- 172.21.15.82:0/1479306507 shutdown_connections 2023-11-28T13:07:50.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.774+0000 7f12fffff700 1 --2- 172.21.15.82:0/1479306507 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f12e0064ee0 0x7f12e0067390 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:50.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.774+0000 7f12fffff700 1 --2- 172.21.15.82:0/1479306507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1300150ee0 0x7f130015cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:50.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.774+0000 7f12fffff700 1 --2- 172.21.15.82:0/1479306507 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f13000ad8b0 0x7f130015c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:50.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.774+0000 7f12fffff700 1 --2- 172.21.15.82:0/1479306507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1300070660 0x7f1300155af0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:50.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.774+0000 7f12fffff700 1 -- 172.21.15.82:0/1479306507 >> 172.21.15.82:0/1479306507 conn(0x7f13000ce630 msgr2=0x7f13000add10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:50.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.778+0000 7f12fffff700 1 -- 172.21.15.82:0/1479306507 shutdown_connections 2023-11-28T13:07:50.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.778+0000 7f12fffff700 1 -- 172.21.15.82:0/1479306507 wait complete. 2023-11-28T13:07:50.795 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2023-11-28T13:07:50.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.890+0000 7f438f59e700 1 Processor -- start 2023-11-28T13:07:50.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.890+0000 7f438f59e700 1 -- start start 2023-11-28T13:07:50.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.890+0000 7f438f59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f439006dae0 0x7f439006b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:50.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.890+0000 7f438f59e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439015d5b0 con 0x7f4390158ed0 2023-11-28T13:07:50.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.890+0000 7f438f59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439015da40 con 0x7f43900ae940 2023-11-28T13:07:50.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.890+0000 7f438f59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43900aee90 con 0x7f439006dae0 2023-11-28T13:07:50.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.890+0000 7f438e59c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4390158ed0 0x7f439006d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52560/0 (socket says 172.21.15.82:52560) 2023-11-28T13:07:50.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.890+0000 7f438e59c700 1 -- 172.21.15.82:0/1538181198 learned_addr learned my addr 172.21.15.82:0/1538181198 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:50.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.894+0000 7f438dd9b700 1 --2- 172.21.15.82:0/1538181198 >> v2:172.21.15.82:3300/0 conn(0x7f439006dae0 0x7f439006b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:50.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.894+0000 7f438d59a700 1 -- 172.21.15.82:0/1538181198 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929856397 0 0) 0x7f439015d5b0 con 0x7f4390158ed0 2023-11-28T13:07:50.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.894+0000 7f438d59a700 1 -- 172.21.15.82:0/1538181198 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43780035d0 con 0x7f4390158ed0 2023-11-28T13:07:50.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.894+0000 7f438dd9b700 1 -- 172.21.15.82:0/1538181198 >> v1:172.21.15.114:6789/0 conn(0x7f43900ae940 legacy=0x7f439006baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:50.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.894+0000 7f438dd9b700 1 -- 172.21.15.82:0/1538181198 >> v1:172.21.15.82:6789/0 conn(0x7f4390158ed0 legacy=0x7f439006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:50.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.894+0000 7f438dd9b700 1 -- 172.21.15.82:0/1538181198 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439015cc80 con 0x7f439006dae0 2023-11-28T13:07:50.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.894+0000 7f438dd9b700 1 --2- 172.21.15.82:0/1538181198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f439006dae0 0x7f439006b560 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f4384009850 tx=0x7f4384009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d289cacfdea07893 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:50.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.894+0000 7f438d59a700 1 -- 172.21.15.82:0/1538181198 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4384011830 con 0x7f439006dae0 2023-11-28T13:07:50.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.894+0000 7f438d59a700 1 -- 172.21.15.82:0/1538181198 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4384011990 con 0x7f439006dae0 2023-11-28T13:07:50.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.894+0000 7f438d59a700 1 -- 172.21.15.82:0/1538181198 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4384011d40 con 0x7f439006dae0 2023-11-28T13:07:50.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.894+0000 7f438f59e700 1 -- 172.21.15.82:0/1538181198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f439006dae0 msgr2=0x7f439006b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:50.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.894+0000 7f438f59e700 1 --2- 172.21.15.82:0/1538181198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f439006dae0 0x7f439006b560 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f4384009850 tx=0x7f4384009b60 comp rx=0 tx=0).stop 2023-11-28T13:07:50.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.894+0000 7f438f59e700 1 -- 172.21.15.82:0/1538181198 shutdown_connections 2023-11-28T13:07:50.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.894+0000 7f438f59e700 1 --2- 172.21.15.82:0/1538181198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f439006dae0 0x7f439006b560 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:50.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.894+0000 7f438f59e700 1 -- 172.21.15.82:0/1538181198 >> 172.21.15.82:0/1538181198 conn(0x7f43900cf710 msgr2=0x7f43900cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:50.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.894+0000 7f438f59e700 1 -- 172.21.15.82:0/1538181198 shutdown_connections 2023-11-28T13:07:50.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.894+0000 7f438f59e700 1 -- 172.21.15.82:0/1538181198 wait complete. 2023-11-28T13:07:50.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.898+0000 7f438f59e700 1 Processor -- start 2023-11-28T13:07:50.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.898+0000 7f438f59e700 1 -- start start 2023-11-28T13:07:50.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.898+0000 7f438f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f439006dae0 0x7f43900cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:50.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.898+0000 7f438f59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43900ae940 0x7f43900d0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:50.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.898+0000 7f438f59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4390158ed0 0x7f439015aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:50.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.898+0000 7f438f59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439015c570 con 0x7f439006dae0 2023-11-28T13:07:50.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.898+0000 7f438f59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43901f0bb0 con 0x7f4390158ed0 2023-11-28T13:07:50.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.898+0000 7f438f59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439015bcd0 con 0x7f43900ae940 2023-11-28T13:07:50.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.898+0000 7f438e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f439006dae0 0x7f43900cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:50.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.898+0000 7f438e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f439006dae0 0x7f43900cfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50368/0 (socket says 172.21.15.82:50368) 2023-11-28T13:07:50.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.898+0000 7f438e59c700 1 -- 172.21.15.82:0/425033308 learned_addr learned my addr 172.21.15.82:0/425033308 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:50.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.898+0000 7f438dd9b700 1 --2- 172.21.15.82:0/425033308 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43900ae940 0x7f43900d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:50.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.898+0000 7f438ed9d700 1 --2- 172.21.15.82:0/425033308 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4390158ed0 0x7f439015aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:50.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.898+0000 7f438e59c700 1 -- 172.21.15.82:0/425033308 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43900ae940 msgr2=0x7f43900d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:50.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.898+0000 7f438e59c700 1 --2- 172.21.15.82:0/425033308 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43900ae940 0x7f43900d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:50.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.898+0000 7f438e59c700 1 -- 172.21.15.82:0/425033308 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4390158ed0 msgr2=0x7f439015aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:50.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.898+0000 7f438e59c700 1 --2- 172.21.15.82:0/425033308 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4390158ed0 0x7f439015aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:50.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.898+0000 7f438e59c700 1 -- 172.21.15.82:0/425033308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43840094b0 con 0x7f439006dae0 2023-11-28T13:07:50.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.898+0000 7f438e59c700 1 --2- 172.21.15.82:0/425033308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f439006dae0 0x7f43900cfae0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f438000c4d0 tx=0x7f438000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:50.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.898+0000 7f437effd700 1 -- 172.21.15.82:0/425033308 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4380005d90 con 0x7f439006dae0 2023-11-28T13:07:50.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.902+0000 7f437effd700 1 -- 172.21.15.82:0/425033308 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43800070d0 con 0x7f439006dae0 2023-11-28T13:07:50.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.902+0000 7f437effd700 1 -- 172.21.15.82:0/425033308 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4380007480 con 0x7f439006dae0 2023-11-28T13:07:50.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.902+0000 7f438f59e700 1 -- 172.21.15.82:0/425033308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439015d240 con 0x7f439006dae0 2023-11-28T13:07:50.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.902+0000 7f438f59e700 1 -- 172.21.15.82:0/425033308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439015cf60 con 0x7f439006dae0 2023-11-28T13:07:50.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.902+0000 7f438f59e700 1 -- 172.21.15.82:0/425033308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43901592a0 con 0x7f439006dae0 2023-11-28T13:07:50.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.902+0000 7f437effd700 1 -- 172.21.15.82:0/425033308 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4380019030 con 0x7f439006dae0 2023-11-28T13:07:50.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.902+0000 7f437effd700 1 --2- 172.21.15.82:0/425033308 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4370064ee0 0x7f4370067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:50.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.902+0000 7f437effd700 1 -- 172.21.15.82:0/425033308 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4380080e00 con 0x7f439006dae0 2023-11-28T13:07:50.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.902+0000 7f438dd9b700 1 --2- 172.21.15.82:0/425033308 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4370064ee0 0x7f4370067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:50.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.902+0000 7f438dd9b700 1 --2- 172.21.15.82:0/425033308 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4370064ee0 0x7f4370067390 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f439006ded0 tx=0x7f4384008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:50.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:50.910+0000 7f437effd700 1 -- 172.21.15.82:0/425033308 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f438004f2a0 con 0x7f439006dae0 2023-11-28T13:07:51.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:51.134+0000 7f438f59e700 1 -- 172.21.15.82:0/425033308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7f43901f0980 con 0x7f439006dae0 2023-11-28T13:07:51.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:51.450+0000 7f437effd700 1 -- 172.21.15.82:0/425033308 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v331) v1 ==== 169+0+0 (secure 0 0 0) 0x7f43901f0980 con 0x7f439006dae0 2023-11-28T13:07:51.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:51.454+0000 7f438f59e700 1 -- 172.21.15.82:0/425033308 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4370064ee0 msgr2=0x7f4370067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:51.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:51.454+0000 7f438f59e700 1 --2- 172.21.15.82:0/425033308 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4370064ee0 0x7f4370067390 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f439006ded0 tx=0x7f4384008030 comp rx=0 tx=0).stop 2023-11-28T13:07:51.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:51.454+0000 7f438f59e700 1 -- 172.21.15.82:0/425033308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f439006dae0 msgr2=0x7f43900cfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:51.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:51.454+0000 7f438f59e700 1 --2- 172.21.15.82:0/425033308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f439006dae0 0x7f43900cfae0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f438000c4d0 tx=0x7f438000c7e0 comp rx=0 tx=0).stop 2023-11-28T13:07:51.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:51.454+0000 7f438f59e700 1 -- 172.21.15.82:0/425033308 shutdown_connections 2023-11-28T13:07:51.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:51.454+0000 7f438f59e700 1 --2- 172.21.15.82:0/425033308 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4370064ee0 0x7f4370067390 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:51.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:51.454+0000 7f438f59e700 1 --2- 172.21.15.82:0/425033308 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4390158ed0 0x7f439015aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:51.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:51.454+0000 7f438f59e700 1 --2- 172.21.15.82:0/425033308 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43900ae940 0x7f43900d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:51.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:51.454+0000 7f438f59e700 1 --2- 172.21.15.82:0/425033308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f439006dae0 0x7f43900cfae0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:51.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:51.454+0000 7f438f59e700 1 -- 172.21.15.82:0/425033308 >> 172.21.15.82:0/425033308 conn(0x7f43900cf710 msgr2=0x7f43900caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:51.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:51.454+0000 7f438f59e700 1 -- 172.21.15.82:0/425033308 shutdown_connections 2023-11-28T13:07:51.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:51.454+0000 7f438f59e700 1 -- 172.21.15.82:0/425033308 wait complete. 2023-11-28T13:07:51.478 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ERROR 2023-11-28T13:07:51.479 INFO:tasks.cephfs_test_runner: 2023-11-28T13:07:51.479 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T13:07:51.479 INFO:tasks.cephfs_test_runner:ERROR: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T13:07:51.479 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared 2023-11-28T13:07:51.479 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T13:07:51.479 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T13:07:51.479 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_3ae99413970476692dfab1fe38dadb056700a61d/qa/tasks/cephfs/test_forward_scrub.py", line 500, in test_health_status_after_backtrace_repair 2023-11-28T13:07:51.479 INFO:tasks.cephfs_test_runner: self.wait_until_true(lambda: self._check_for_presence_of_MDS_damage(), timeout=200) 2023-11-28T13:07:51.479 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_3ae99413970476692dfab1fe38dadb056700a61d/qa/tasks/ceph_test_case.py", line 212, in wait_until_true 2023-11-28T13:07:51.480 INFO:tasks.cephfs_test_runner: raise TestTimeoutError("Timed out after {0}s and {1} retries".format(elapsed, retry_count)) 2023-11-28T13:07:51.480 INFO:tasks.cephfs_test_runner:tasks.ceph_test_case.TestTimeoutError: Timed out after 200s and 0 retries 2023-11-28T13:07:51.480 INFO:tasks.cephfs_test_runner: 2023-11-28T13:07:51.480 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T13:07:51.480 INFO:tasks.cephfs_test_runner:Ran 3 tests in 413.228s 2023-11-28T13:07:51.480 INFO:tasks.cephfs_test_runner: 2023-11-28T13:07:51.480 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-28T13:07:51.480 INFO:tasks.cephfs_test_runner: 2023-11-28T13:07:51.480 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T13:07:51.480 INFO:tasks.cephfs_test_runner:ERROR: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T13:07:51.480 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared 2023-11-28T13:07:51.481 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T13:07:51.481 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T13:07:51.481 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_3ae99413970476692dfab1fe38dadb056700a61d/qa/tasks/cephfs/test_forward_scrub.py", line 500, in test_health_status_after_backtrace_repair 2023-11-28T13:07:51.481 INFO:tasks.cephfs_test_runner: self.wait_until_true(lambda: self._check_for_presence_of_MDS_damage(), timeout=200) 2023-11-28T13:07:51.481 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_3ae99413970476692dfab1fe38dadb056700a61d/qa/tasks/ceph_test_case.py", line 212, in wait_until_true 2023-11-28T13:07:51.481 INFO:tasks.cephfs_test_runner: raise TestTimeoutError("Timed out after {0}s and {1} retries".format(elapsed, retry_count)) 2023-11-28T13:07:51.481 INFO:tasks.cephfs_test_runner:tasks.ceph_test_case.TestTimeoutError: Timed out after 200s and 0 retries 2023-11-28T13:07:51.481 INFO:tasks.cephfs_test_runner: 2023-11-28T13:07:51.481 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_neesingh-rh_ceph_3ae99413970476692dfab1fe38dadb056700a61d/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T13:07:51.588 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=e285605a25264ca48f9df0fa8ec5d42d Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_neesingh-rh_ceph_3ae99413970476692dfab1fe38dadb056700a61d/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T13:07:51.590 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-28T13:07:51.599 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-28T13:07:51.612 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-28T13:07:51.612 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:07:51.612 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:07:51.625 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346276k,nr_inodes=4086569,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=221 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275484k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T13:07:51.626 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-11-28T13:07:51.626 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:07:51.674 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346276k,nr_inodes=4086569,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=221 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275484k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T13:07:51.674 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:07:51.674 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:07:51.682 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19664 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T13:07:51.682 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-28T13:07:51.682 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T13:07:51.689 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19664 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275488k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T13:07:51.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:07:51.689 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-11-28T13:07:51.698 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T13:07:51.698 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T13:07:51.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:07:51.698 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T13:07:51.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:07:51.756 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T13:07:51.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:07:51.772 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2023-11-28T13:07:51.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:07:51.937 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-11-28T13:07:51.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-28T13:07:51.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T13:07:51.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:07:51.945 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T13:07:51.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:07:51.962 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T13:07:51.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T13:07:51.973 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2023-11-28T13:07:52.151 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-28T13:07:52.161 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T13:07:52.161 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:07:52.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.274+0000 7f0301767700 1 Processor -- start 2023-11-28T13:07:52.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.274+0000 7f0301767700 1 -- start start 2023-11-28T13:07:52.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f0301767700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f02fc0c1910 0x7f02fc16b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:52.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f0301767700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02fc0ce030 con 0x7f02fc160900 2023-11-28T13:07:52.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f0301767700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02fc0ce310 con 0x7f02fc070070 2023-11-28T13:07:52.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f0301767700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02fc06a5d0 con 0x7f02fc0c1910 2023-11-28T13:07:52.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f02fb7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f02fc160900 0x7f02fc0cc1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52576/0 (socket says 172.21.15.82:52576) 2023-11-28T13:07:52.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f02fb7fe700 1 -- 172.21.15.82:0/914995227 learned_addr learned my addr 172.21.15.82:0/914995227 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:52.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f0300f66700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f02fc0c1910 0x7f02fc16b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:52.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f02faffd700 1 -- 172.21.15.82:0/914995227 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756364591 0 0) 0x7f02fc0ce030 con 0x7f02fc160900 2023-11-28T13:07:52.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f0300f66700 1 -- 172.21.15.82:0/914995227 >> v1:172.21.15.114:6789/0 conn(0x7f02fc070070 legacy=0x7f02fc070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:52.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f0300f66700 1 -- 172.21.15.82:0/914995227 >> v1:172.21.15.82:6789/0 conn(0x7f02fc160900 legacy=0x7f02fc0cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:52.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f0300f66700 1 -- 172.21.15.82:0/914995227 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02fc06a8b0 con 0x7f02fc0c1910 2023-11-28T13:07:52.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f0300f66700 1 --2- 172.21.15.82:0/914995227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02fc0c1910 0x7f02fc16b570 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009d90 tx=0x7f02f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865c521314b1c7db server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:52.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f02faffd700 1 -- 172.21.15.82:0/914995227 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f400e070 con 0x7f02fc0c1910 2023-11-28T13:07:52.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f02faffd700 1 -- 172.21.15.82:0/914995227 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f400bbd0 con 0x7f02fc0c1910 2023-11-28T13:07:52.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f02faffd700 1 -- 172.21.15.82:0/914995227 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f4012430 con 0x7f02fc0c1910 2023-11-28T13:07:52.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f0301767700 1 -- 172.21.15.82:0/914995227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02fc0c1910 msgr2=0x7f02fc16b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:52.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f0301767700 1 --2- 172.21.15.82:0/914995227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02fc0c1910 0x7f02fc16b570 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009d90 tx=0x7f02f400b330 comp rx=0 tx=0).stop 2023-11-28T13:07:52.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f0301767700 1 -- 172.21.15.82:0/914995227 shutdown_connections 2023-11-28T13:07:52.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f0301767700 1 --2- 172.21.15.82:0/914995227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02fc0c1910 0x7f02fc16b570 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:52.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f0301767700 1 -- 172.21.15.82:0/914995227 >> 172.21.15.82:0/914995227 conn(0x7f02fc0ce600 msgr2=0x7f02fc0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:52.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f0301767700 1 -- 172.21.15.82:0/914995227 shutdown_connections 2023-11-28T13:07:52.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.278+0000 7f0301767700 1 -- 172.21.15.82:0/914995227 wait complete. 2023-11-28T13:07:52.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f0301767700 1 Processor -- start 2023-11-28T13:07:52.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f0301767700 1 -- start start 2023-11-28T13:07:52.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f0301767700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02fc070070 0x7f02fc0c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:52.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f0301767700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02fc1f53a0 0x7f02fc162f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:52.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f0301767700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02fc1f57f0 0x7f02fc1634b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:52.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f0301767700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0c31b0 con 0x7f02fc1f53a0 2023-11-28T13:07:52.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f0301767700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0b2480 con 0x7f02fc1f57f0 2023-11-28T13:07:52.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f0301767700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc1639f0 con 0x7f02fc070070 2023-11-28T13:07:52.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f02fb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02fc1f53a0 0x7f02fc162f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:52.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f02fb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02fc1f53a0 0x7f02fc162f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50382/0 (socket says 172.21.15.82:50382) 2023-11-28T13:07:52.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f02fb7fe700 1 -- 172.21.15.82:0/3850528208 learned_addr learned my addr 172.21.15.82:0/3850528208 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:52.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f0300f66700 1 --2- 172.21.15.82:0/3850528208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02fc1f57f0 0x7f02fc1634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:52.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f02fbfff700 1 --2- 172.21.15.82:0/3850528208 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02fc070070 0x7f02fc0c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:52.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f02fb7fe700 1 -- 172.21.15.82:0/3850528208 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02fc070070 msgr2=0x7f02fc0c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:52.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f02fb7fe700 1 --2- 172.21.15.82:0/3850528208 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02fc070070 0x7f02fc0c82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:52.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f02fb7fe700 1 -- 172.21.15.82:0/3850528208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02fc1f57f0 msgr2=0x7f02fc1634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:52.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f02fb7fe700 1 --2- 172.21.15.82:0/3850528208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02fc1f57f0 0x7f02fc1634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:52.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f02fb7fe700 1 -- 172.21.15.82:0/3850528208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f4009a70 con 0x7f02fc1f53a0 2023-11-28T13:07:52.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f0300f66700 1 --2- 172.21.15.82:0/3850528208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02fc1f57f0 0x7f02fc1634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:07:52.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f02fb7fe700 1 --2- 172.21.15.82:0/3850528208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02fc1f53a0 0x7f02fc162f70 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00c500 tx=0x7f02ec00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:52.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f02f8ff9700 1 -- 172.21.15.82:0/3850528208 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec004ca0 con 0x7f02fc1f53a0 2023-11-28T13:07:52.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f02f8ff9700 1 -- 172.21.15.82:0/3850528208 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec004e00 con 0x7f02fc1f53a0 2023-11-28T13:07:52.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f0301767700 1 -- 172.21.15.82:0/3850528208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02fc0cdc50 con 0x7f02fc1f53a0 2023-11-28T13:07:52.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f02f8ff9700 1 -- 172.21.15.82:0/3850528208 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec007310 con 0x7f02fc1f53a0 2023-11-28T13:07:52.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.282+0000 7f0301767700 1 -- 172.21.15.82:0/3850528208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02fc06ab90 con 0x7f02fc1f53a0 2023-11-28T13:07:52.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.286+0000 7f0301767700 1 -- 172.21.15.82:0/3850528208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02fc0cdde0 con 0x7f02fc1f53a0 2023-11-28T13:07:52.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.286+0000 7f02f8ff9700 1 -- 172.21.15.82:0/3850528208 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f02ec01a020 con 0x7f02fc1f53a0 2023-11-28T13:07:52.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.286+0000 7f02f8ff9700 1 --2- 172.21.15.82:0/3850528208 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f02e8064ee0 0x7f02e8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:52.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.286+0000 7f02f8ff9700 1 -- 172.21.15.82:0/3850528208 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f02ec081770 con 0x7f02fc1f53a0 2023-11-28T13:07:52.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.286+0000 7f02fbfff700 1 --2- 172.21.15.82:0/3850528208 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f02e8064ee0 0x7f02e8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:52.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.286+0000 7f02fbfff700 1 --2- 172.21.15.82:0/3850528208 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f02e8064ee0 0x7f02e8067390 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f02f0000f60 tx=0x7f02f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:52.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.294+0000 7f02f8ff9700 1 -- 172.21.15.82:0/3850528208 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f02ec04fc00 con 0x7f02fc1f53a0 2023-11-28T13:07:52.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.454+0000 7f0301767700 1 -- 172.21.15.82:0/3850528208 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02fc065fc0 con 0x7f02e8064ee0 2023-11-28T13:07:52.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.458+0000 7f02f8ff9700 1 -- 172.21.15.82:0/3850528208 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71390 (secure 0 0 0) 0x7f02fc065fc0 con 0x7f02e8064ee0 2023-11-28T13:07:52.465 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:07:52.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.458+0000 7f0301767700 1 -- 172.21.15.82:0/3850528208 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f02e8064ee0 msgr2=0x7f02e8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:52.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.458+0000 7f0301767700 1 --2- 172.21.15.82:0/3850528208 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f02e8064ee0 0x7f02e8067390 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f02f0000f60 tx=0x7f02f0009040 comp rx=0 tx=0).stop 2023-11-28T13:07:52.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.458+0000 7f0301767700 1 -- 172.21.15.82:0/3850528208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02fc1f53a0 msgr2=0x7f02fc162f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:52.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.458+0000 7f0301767700 1 --2- 172.21.15.82:0/3850528208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02fc1f53a0 0x7f02fc162f70 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00c500 tx=0x7f02ec00c810 comp rx=0 tx=0).stop 2023-11-28T13:07:52.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.458+0000 7f0301767700 1 -- 172.21.15.82:0/3850528208 shutdown_connections 2023-11-28T13:07:52.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.458+0000 7f0301767700 1 --2- 172.21.15.82:0/3850528208 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f02e8064ee0 0x7f02e8067390 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:52.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.458+0000 7f0301767700 1 --2- 172.21.15.82:0/3850528208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02fc1f57f0 0x7f02fc1634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:52.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.458+0000 7f0301767700 1 --2- 172.21.15.82:0/3850528208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02fc1f53a0 0x7f02fc162f70 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:52.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.458+0000 7f0301767700 1 --2- 172.21.15.82:0/3850528208 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02fc070070 0x7f02fc0c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:52.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.458+0000 7f0301767700 1 -- 172.21.15.82:0/3850528208 >> 172.21.15.82:0/3850528208 conn(0x7f02fc0ce600 msgr2=0x7f02fc0aef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:52.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.458+0000 7f0301767700 1 -- 172.21.15.82:0/3850528208 shutdown_connections 2023-11-28T13:07:52.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.458+0000 7f0301767700 1 -- 172.21.15.82:0/3850528208 wait complete. 2023-11-28T13:07:52.468 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:07:52.478 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2023-11-28T13:07:51.317607+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":88472,"kb_used_data":7640,"kb_used_omap":0,"kb_used_meta":80768,"kb_avail":754886248,"statfs":{"total":773094113280,"available":773003517952,"internally_reserved":0,"allocated":7823360,"data_stored":4123600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":82706432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12288,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-6,"num_read_kb":-5,"num_write":-76,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":-70,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002628"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":214,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:19.246350+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:06:19.246350+0000","last_peered":"2023-11-28T13:06:19.246350+0000","last_clean":"2023-11-28T13:06:19.246350+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:06:19.246350+0000","last_undegraded":"2023-11-28T13:06:19.246350+0000","last_fullsized":"2023-11-28T13:06:19.246350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":49,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:39.250917+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:06:39.250917+0000","last_peered":"2023-11-28T13:06:39.250917+0000","last_clean":"2023-11-28T13:06:39.250917+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:06:39.250917+0000","last_undegraded":"2023-11-28T13:06:39.250917+0000","last_fullsized":"2023-11-28T13:06:39.250917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:24.247427+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:06:24.247427+0000","last_peered":"2023-11-28T13:06:24.247427+0000","last_clean":"2023-11-28T13:06:24.247427+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:06:24.247427+0000","last_undegraded":"2023-11-28T13:06:24.247427+0000","last_fullsized":"2023-11-28T13:06:24.247427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:39.246301+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:06:39.246301+0000","last_peered":"2023-11-28T13:06:39.246301+0000","last_clean":"2023-11-28T13:06:39.246301+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:06:39.246301+0000","last_undegraded":"2023-11-28T13:06:39.246301+0000","last_fullsized":"2023-11-28T13:06:39.246301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:39.250867+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:06:39.250867+0000","last_peered":"2023-11-28T13:06:39.250867+0000","last_clean":"2023-11-28T13:06:39.250867+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:06:39.250867+0000","last_undegraded":"2023-11-28T13:06:39.250867+0000","last_fullsized":"2023-11-28T13:06:39.250867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:39.252305+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:06:39.252305+0000","last_peered":"2023-11-28T13:06:39.252305+0000","last_clean":"2023-11-28T13:06:39.252305+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:06:39.252305+0000","last_undegraded":"2023-11-28T13:06:39.252305+0000","last_fullsized":"2023-11-28T13:06:39.252305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:39.250439+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:06:39.250439+0000","last_peered":"2023-11-28T13:06:39.250439+0000","last_clean":"2023-11-28T13:06:39.250439+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:06:39.250439+0000","last_undegraded":"2023-11-28T13:06:39.250439+0000","last_fullsized":"2023-11-28T13:06:39.250439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:54.254780+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:06:54.254780+0000","last_peered":"2023-11-28T13:06:54.254780+0000","last_clean":"2023-11-28T13:06:54.254780+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:06:54.254780+0000","last_undegraded":"2023-11-28T13:06:54.254780+0000","last_fullsized":"2023-11-28T13:06:54.254780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:54.252746+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:06:54.252746+0000","last_peered":"2023-11-28T13:06:54.252746+0000","last_clean":"2023-11-28T13:06:54.252746+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:06:54.252746+0000","last_undegraded":"2023-11-28T13:06:54.252746+0000","last_fullsized":"2023-11-28T13:06:54.252746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574942,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15160,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":13760,"kb_avail":94356680,"statfs":{"total":96636764160,"available":96621240320,"internally_reserved":0,"allocated":1425408,"data_stored":955844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14090240},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.84999999999999998,"15min":0.82899999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2150000000000001,"5min":1.28,"15min":1.3859999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.85899999999999999,"15min":0.89200000000000002},"min":{"1min":0.65100000000000002,"5min":0.51200000000000001,"15min":0.5},"max":{"1min":1.196,"5min":1.2130000000000001,"15min":1.377},"last":0.96299999999999997}]},{"osd":1,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.86599999999999999,"15min":0.90100000000000002},"min":{"1min":0.63800000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.1839999999999999,"5min":1.2410000000000001,"15min":1.599},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.86699999999999999,"15min":0.91900000000000004},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.091,"5min":1.194,"15min":1.375},"last":1.0620000000000001}]},{"osd":2,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.85499999999999998,"15min":0.91000000000000003},"min":{"1min":0.61299999999999999,"5min":0.54100000000000004,"15min":0.53300000000000003},"max":{"1min":1.1559999999999999,"5min":1.198,"15min":2.9060000000000001},"last":1.018},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.94099999999999995,"15min":0.91800000000000004},"min":{"1min":0.63600000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1830000000000001,"5min":1.3109999999999999,"15min":1.6659999999999999},"last":0.84299999999999997}]},{"osd":3,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.89900000000000002,"15min":0.93200000000000005},"min":{"1min":0.625,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.26,"5min":1.26,"15min":1.6399999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.022,"5min":0.95399999999999996,"15min":0.93400000000000005},"min":{"1min":0.80400000000000005,"5min":0.72499999999999998,"15min":0.59799999999999998},"max":{"1min":1.2090000000000001,"5min":1.212,"15min":1.3660000000000001},"last":0.89600000000000002}]},{"osd":4,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.85599999999999998,"15min":0.95699999999999996},"min":{"1min":0.60799999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.135,"5min":1.1739999999999999,"15min":1.6819999999999999},"last":0.872},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.90700000000000003,"15min":0.94599999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1499999999999999,"5min":1.2649999999999999,"15min":1.409},"last":1.119}]},{"osd":5,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.91800000000000004,"15min":0.996},"min":{"1min":0.66700000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.282,"5min":1.282,"15min":1.466},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.99099999999999999,"15min":1.0680000000000001},"min":{"1min":0.71099999999999997,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.175,"5min":1.2589999999999999,"15min":1.5449999999999999},"last":1.139}]},{"osd":6,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0429999999999999,"15min":1.1379999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.68799999999999994},"max":{"1min":1.236,"5min":1.28,"15min":2.0630000000000002},"last":1.105},{"interface":"front","average":{"1min":1.048,"5min":1.042,"15min":1.1299999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.2450000000000001,"5min":1.407,"15min":1.794},"last":1.379}]}]},{"osd":6,"up_from":13,"seq":55834574943,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9516,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362324,"statfs":{"total":96636764160,"available":96627019776,"internally_reserved":0,"allocated":823296,"data_stored":364820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81000000000000005,"15min":0.82699999999999996},"min":{"1min":0.54400000000000004,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1000000000000001,"5min":1.23,"15min":1.5580000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.90500000000000003,"15min":0.86499999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.54100000000000004},"max":{"1min":1.1599999999999999,"5min":1.448,"15min":1.448},"last":0.754}]},{"osd":1,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.93600000000000005,"15min":0.88800000000000001},"min":{"1min":0.65300000000000002,"5min":0.59199999999999997,"15min":0.51900000000000002},"max":{"1min":1.25,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.143},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85599999999999998,"15min":0.86299999999999999},"min":{"1min":0.66900000000000004,"5min":0.59699999999999998,"15min":0.55900000000000005},"max":{"1min":1.0349999999999999,"5min":1.716,"15min":1.716},"last":0.96099999999999997}]},{"osd":2,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.878,"15min":0.88100000000000001},"min":{"1min":0.60599999999999998,"5min":0.505,"15min":0.505},"max":{"1min":1.1319999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93700000000000006,"15min":0.90600000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.175,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.101}]},{"osd":3,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.88,"15min":0.88100000000000001},"min":{"1min":0.68300000000000005,"5min":0.57399999999999995,"15min":0.53300000000000003},"max":{"1min":1.149,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96399999999999997,"15min":0.97199999999999998},"min":{"1min":0.69399999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1950000000000001,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.879}]},{"osd":4,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.94299999999999995,"15min":0.94699999999999995},"min":{"1min":0.61599999999999999,"5min":0.60999999999999999,"15min":0.59699999999999998},"max":{"1min":1.3,"5min":1.746,"15min":1.8049999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.96399999999999997,"15min":1.3140000000000001},"min":{"1min":0.72499999999999998,"5min":0.63500000000000001,"15min":0.629},"max":{"1min":1.228,"5min":1.2969999999999999,"15min":10.566000000000001},"last":0.66200000000000003}]},{"osd":5,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":1.006,"15min":1.0580000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3069999999999999,"5min":2.048,"15min":2.048},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.042,"5min":1.1120000000000001,"15min":1.095},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.325,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":0.90600000000000003}]},{"osd":7,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.044,"15min":1.1779999999999999},"min":{"1min":0.78400000000000003,"5min":0.751,"15min":0.74299999999999999},"max":{"1min":1.208,"5min":1.367,"15min":3.4980000000000002},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.141,"15min":1.264},"min":{"1min":0.98899999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.3759999999999999,"5min":1.7669999999999999,"15min":3.593},"last":1.0409999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574944,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9708,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362132,"statfs":{"total":96636764160,"available":96626823168,"internally_reserved":0,"allocated":823296,"data_stored":364808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.82099999999999995,"15min":0.81799999999999995},"min":{"1min":0.60899999999999999,"5min":0.53700000000000003,"15min":0.502},"max":{"1min":1.054,"5min":1.171,"15min":1.171},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.876,"15min":0.83899999999999997},"min":{"1min":0.68400000000000005,"5min":0.55400000000000005,"15min":0.48399999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.2589999999999999}]},{"osd":1,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.84699999999999998,"15min":0.83099999999999996},"min":{"1min":0.66000000000000003,"5min":0.48999999999999999,"15min":0.46000000000000002},"max":{"1min":1.077,"5min":1.1919999999999999,"15min":1.274},"last":1.302},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.86899999999999999,"15min":0.82099999999999995},"min":{"1min":0.54600000000000004,"5min":0.434,"15min":0.434},"max":{"1min":1.173,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.0700000000000001}]},{"osd":2,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.88300000000000001,"15min":0.83599999999999997},"min":{"1min":0.67800000000000005,"5min":0.59599999999999997,"15min":0.45500000000000002},"max":{"1min":1.212,"5min":1.395,"15min":1.395},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.89400000000000002,"15min":0.92300000000000004},"min":{"1min":0.66200000000000003,"5min":0.55700000000000005,"15min":0.53000000000000003},"max":{"1min":1.198,"5min":1.26,"15min":1.3560000000000001},"last":1.034}]},{"osd":3,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.93999999999999995,"15min":0.89600000000000002},"min":{"1min":0.70299999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.014,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.82399999999999995,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2210000000000001,"5min":1.365,"15min":1.403},"last":1.208}]},{"osd":4,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.86899999999999999,"15min":0.88200000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.40699999999999997},"max":{"1min":1.246,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.97899999999999998,"15min":0.96699999999999997},"min":{"1min":0.56899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.444,"5min":1.5189999999999999,"15min":4.3300000000000001},"last":1.4099999999999999}]},{"osd":6,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97299999999999998,"15min":1.0089999999999999},"min":{"1min":0.68799999999999994,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.224,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0660000000000001,"15min":1.0409999999999999},"min":{"1min":0.82899999999999996,"5min":0.70599999999999996,"15min":0.59299999999999997},"max":{"1min":1.3129999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.3380000000000001}]},{"osd":7,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.1000000000000001,"15min":1.0629999999999999},"min":{"1min":0.73399999999999999,"5min":0.58399999999999996,"15min":0.56599999999999995},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":4.234},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.101,"15min":1.1259999999999999},"min":{"1min":0.77900000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2989999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.377}]}]},{"osd":4,"up_from":13,"seq":55834574943,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9916,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361924,"statfs":{"total":96636764160,"available":96626610176,"internally_reserved":0,"allocated":839680,"data_stored":376292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.86099999999999999,"15min":0.82799999999999996},"min":{"1min":0.58899999999999997,"5min":0.57999999999999996,"15min":0.53600000000000003},"max":{"1min":1.107,"5min":1.1699999999999999,"15min":1.2589999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.84399999999999997,"15min":0.82299999999999995},"min":{"1min":0.69499999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2150000000000001,"5min":1.429,"15min":1.429},"last":0.77400000000000002}]},{"osd":1,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81799999999999995,"15min":0.81699999999999995},"min":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.54300000000000004},"max":{"1min":1.038,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":1.177},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.88800000000000001,"15min":0.876},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0700000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.70799999999999996}]},{"osd":2,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.82499999999999996,"15min":0.83499999999999996},"min":{"1min":0.65200000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.002,"5min":1.296,"15min":1.357},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.90500000000000003,"15min":0.89300000000000002},"min":{"1min":0.65600000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1339999999999999,"5min":1.2270000000000001,"15min":1.2549999999999999},"last":1}]},{"osd":3,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.90600000000000003,"15min":0.88500000000000001},"min":{"1min":0.64900000000000002,"5min":0.64300000000000002,"15min":0.61899999999999999},"max":{"1min":1.1519999999999999,"5min":1.252,"15min":1.252},"last":1.048},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.98099999999999998,"15min":0.98799999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.66400000000000003},"max":{"1min":1.1619999999999999,"5min":1.222,"15min":1.474},"last":0.86799999999999999}]},{"osd":5,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.85499999999999998,"15min":0.88700000000000001},"min":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.53400000000000003},"max":{"1min":1.0369999999999999,"5min":1.2809999999999999,"15min":1.4590000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.94099999999999995,"15min":0.97599999999999998},"min":{"1min":0.68200000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2490000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.81799999999999995}]},{"osd":6,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.92600000000000005,"15min":0.997},"min":{"1min":0.65500000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.093,"5min":1.657,"15min":1.657},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.026,"15min":1.0629999999999999},"min":{"1min":0.77000000000000002,"5min":0.62,"15min":0.62},"max":{"1min":1.135,"5min":1.4690000000000001,"15min":1.5149999999999999},"last":1.23}]},{"osd":7,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.034,"15min":1.073},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.296,"5min":1.389,"15min":1.526},"last":1.147},{"interface":"front","average":{"1min":1.071,"5min":1.0960000000000001,"15min":1.133},"min":{"1min":0.82299999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.258,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.98899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574942,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9896,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361944,"statfs":{"total":96636764160,"available":96626630656,"internally_reserved":0,"allocated":819200,"data_stored":364786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.629,"15min":0.60999999999999999},"min":{"1min":0.48299999999999998,"5min":0.41399999999999998,"15min":0.39400000000000002},"max":{"1min":1.0049999999999999,"5min":1.0840000000000001,"15min":1.0900000000000001},"last":0.621},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.54100000000000004,"5min":0.45100000000000001,"15min":0.43099999999999999},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.58199999999999996}]},{"osd":1,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.496,"5min":0.45500000000000002,"15min":0.32500000000000001},"max":{"1min":0.93899999999999995,"5min":1.0129999999999999,"15min":1.1890000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77400000000000002,"15min":0.76400000000000001},"min":{"1min":0.55600000000000005,"5min":0.48399999999999999,"15min":0.441},"max":{"1min":0.93200000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.71199999999999997}]},{"osd":2,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76400000000000001,"15min":0.749},"min":{"1min":0.49099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0129999999999999,"5min":1.028,"15min":1.2989999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.83699999999999997,"15min":0.83099999999999996},"min":{"1min":0.71799999999999997,"5min":0.52400000000000002,"15min":0.438},"max":{"1min":1.0720000000000001,"5min":1.1659999999999999,"15min":1.4550000000000001},"last":0.85399999999999998}]},{"osd":4,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.90800000000000003,"15min":0.96599999999999997},"min":{"1min":0.80900000000000005,"5min":0.65200000000000002,"15min":0.63100000000000001},"max":{"1min":1.2569999999999999,"5min":1.3400000000000001,"15min":1.405},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.98199999999999998,"15min":1.0249999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.57899999999999996},"max":{"1min":1.2929999999999999,"5min":1.3620000000000001,"15min":1.7150000000000001},"last":0.76500000000000001}]},{"osd":5,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.97499999999999998,"15min":1.034},"min":{"1min":0.79300000000000004,"5min":0.64400000000000002,"15min":0.57399999999999995},"max":{"1min":1.26,"5min":1.518,"15min":1.5549999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.044,"15min":1.075},"min":{"1min":0.91700000000000004,"5min":0.76400000000000001,"15min":0.73799999999999999},"max":{"1min":1.329,"5min":1.5449999999999999,"15min":1.6639999999999999},"last":0.96299999999999997}]},{"osd":6,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.02,"15min":1.069},"min":{"1min":0.89200000000000002,"5min":0.72699999999999998,"15min":0.55600000000000005},"max":{"1min":1.3420000000000001,"5min":1.371,"15min":1.446},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0700000000000001,"15min":1.0980000000000001},"min":{"1min":0.75600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3360000000000001,"5min":1.45,"15min":1.6220000000000001},"last":0.91700000000000004}]},{"osd":7,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1120000000000001,"15min":1.141},"min":{"1min":0.99099999999999999,"5min":0.85699999999999998,"15min":0.67900000000000005},"max":{"1min":1.4019999999999999,"5min":1.488,"15min":1.5669999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.073,"15min":1.141},"min":{"1min":0.879,"5min":0.77200000000000002,"15min":0.67100000000000004},"max":{"1min":1.3069999999999999,"5min":1.534,"15min":1.6499999999999999},"last":0.94599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9644,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362196,"statfs":{"total":96636764160,"available":96626888704,"internally_reserved":0,"allocated":823296,"data_stored":364856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77400000000000002,"5min":0.94999999999999996,"15min":0.997},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71299999999999997,"15min":0.64800000000000002},"min":{"1min":0.52200000000000002,"5min":0.39400000000000002,"15min":0.38500000000000001},"max":{"1min":0.96699999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.69699999999999995}]},{"osd":1,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64600000000000002,"15min":0.628},"min":{"1min":0.45000000000000001,"5min":0.378,"15min":0.36199999999999999},"max":{"1min":0.85599999999999998,"5min":0.997,"15min":1.123},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72299999999999998,"15min":0.68999999999999995},"min":{"1min":0.56499999999999995,"5min":0.45600000000000002,"15min":0.44400000000000001},"max":{"1min":0.90000000000000002,"5min":1.0009999999999999,"15min":1.0569999999999999},"last":0.54100000000000004}]},{"osd":3,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80900000000000005,"15min":0.751},"min":{"1min":0.61399999999999999,"5min":0.46000000000000002,"15min":0.317},"max":{"1min":1.079,"5min":1.143,"15min":1.1599999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76700000000000002,"15min":0.75},"min":{"1min":0.54900000000000004,"5min":0.436,"15min":0.34000000000000002},"max":{"1min":0.93400000000000005,"5min":1.222,"15min":1.222},"last":0.73999999999999999}]},{"osd":4,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.93500000000000005,"15min":0.92100000000000004},"min":{"1min":0.80600000000000005,"5min":0.64800000000000002,"15min":0.498},"max":{"1min":1.1639999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.998,"5min":1.0029999999999999,"15min":1.004},"min":{"1min":0.86699999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1599999999999999,"5min":1.3,"15min":1.4159999999999999},"last":1.1319999999999999}]},{"osd":5,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94299999999999995,"15min":0.95099999999999996},"min":{"1min":0.70199999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.226,"5min":1.343,"15min":1.4430000000000001},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.022,"15min":1},"min":{"1min":0.71099999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.407,"5min":1.643,"15min":1.6830000000000001},"last":1.3100000000000001}]},{"osd":6,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.024,"15min":1.0329999999999999},"min":{"1min":0.78700000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.3260000000000001,"5min":1.6060000000000001,"15min":1.8240000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.018,"15min":1.006},"min":{"1min":0.71899999999999997,"5min":0.67900000000000005,"15min":0.55400000000000005},"max":{"1min":1.224,"5min":1.54,"15min":1.54},"last":0.89900000000000002}]},{"osd":7,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0700000000000001,"15min":1.0640000000000001},"min":{"1min":0.77000000000000002,"5min":0.74399999999999999,"15min":0.57199999999999995},"max":{"1min":1.276,"5min":1.5069999999999999,"15min":1.5980000000000001},"last":1.292},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.147,"15min":1.1160000000000001},"min":{"1min":0.83399999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3640000000000001,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":1.246}]}]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9740,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362100,"statfs":{"total":96636764160,"available":96626790400,"internally_reserved":0,"allocated":856064,"data_stored":377040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.624,"15min":0.63900000000000001},"min":{"1min":0.502,"5min":0.38700000000000001,"15min":0.314},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68600000000000005,"15min":0.68100000000000005},"min":{"1min":0.52500000000000002,"5min":0.39500000000000002,"15min":0.318},"max":{"1min":1.0629999999999999,"5min":1.1040000000000001,"15min":1.181},"last":0.624}]},{"osd":2,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.54500000000000004,"5min":0.42699999999999999,"15min":0.38500000000000001},"max":{"1min":1.208,"5min":1.2230000000000001,"15min":1.3009999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.75900000000000001,"15min":0.75600000000000001},"min":{"1min":0.55600000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1200000000000001,"5min":1.228,"15min":1.409},"last":0.54100000000000004}]},{"osd":3,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.871,"15min":0.83999999999999997},"min":{"1min":0.626,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.246,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.80700000000000005,"15min":0.76200000000000001},"min":{"1min":0.66600000000000004,"5min":0.46300000000000002,"15min":0.435},"max":{"1min":1.036,"5min":1.1240000000000001,"15min":1.2529999999999999},"last":0.66300000000000003}]},{"osd":4,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.97599999999999998,"15min":0.98599999999999999},"min":{"1min":0.81699999999999995,"5min":0.66600000000000004,"15min":0.61899999999999999},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92500000000000004,"15min":0.93500000000000005},"min":{"1min":0.73199999999999998,"5min":0.64100000000000001,"15min":0.52000000000000002},"max":{"1min":1.1060000000000001,"5min":1.3049999999999999,"15min":2.1309999999999998},"last":0.77400000000000002}]},{"osd":5,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0029999999999999,"15min":0.98399999999999999},"min":{"1min":0.80200000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.95999999999999996,"15min":1.0189999999999999},"min":{"1min":0.88200000000000001,"5min":0.63100000000000001,"15min":0.60799999999999998},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":2.004},"last":0.874}]},{"osd":6,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97799999999999998,"15min":0.996},"min":{"1min":0.78400000000000003,"5min":0.63600000000000001,"15min":0.61499999999999999},"max":{"1min":1.3109999999999999,"5min":1.3660000000000001,"15min":1.889},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.129,"5min":1.087,"15min":1.1000000000000001},"min":{"1min":0.93300000000000005,"5min":0.745,"15min":0.64400000000000002},"max":{"1min":1.5389999999999999,"5min":1.6739999999999999,"15min":1.9610000000000001},"last":0.752}]},{"osd":7,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.0840000000000001,"15min":1.089},"min":{"1min":0.81200000000000006,"5min":0.629,"15min":0.629},"max":{"1min":1.5149999999999999,"5min":1.6200000000000001,"15min":1.766},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.0569999999999999,"15min":1.0980000000000001},"min":{"1min":0.91500000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":2.0470000000000002},"last":0.82699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574944,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14892,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":13504,"kb_avail":94356948,"statfs":{"total":96636764160,"available":96621514752,"internally_reserved":0,"allocated":1413120,"data_stored":955154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13828096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65600000000000003,"15min":0.64000000000000001},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.35099999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71099999999999997,"15min":0.66400000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.36699999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.198},"last":0.61099999999999999}]},{"osd":2,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.74099999999999999,"15min":0.71799999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.28599999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.73599999999999999,"15min":0.71699999999999997},"min":{"1min":0.55800000000000005,"5min":0.434,"15min":0.34399999999999997},"max":{"1min":1.099,"5min":1.099,"15min":1.143},"last":0.77900000000000003}]},{"osd":3,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70399999999999996,"15min":0.68700000000000006},"min":{"1min":0.52700000000000002,"5min":0.41299999999999998,"15min":0.39200000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.298},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.83799999999999997,"15min":0.84299999999999997},"min":{"1min":0.66300000000000003,"5min":0.54700000000000004,"15min":0.32100000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.629},"last":0.746}]},{"osd":4,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.71499999999999997,"5min":0.69999999999999996,"15min":0.68700000000000006},"max":{"1min":1.153,"5min":1.341,"15min":1.341},"last":0.88},{"interface":"front","average":{"1min":1.01,"5min":0.98099999999999998,"15min":0.96499999999999997},"min":{"1min":0.83699999999999997,"5min":0.73599999999999999,"15min":0.56100000000000005},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.82899999999999996}]},{"osd":5,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97299999999999998,"15min":0.98399999999999999},"min":{"1min":0.755,"5min":0.71699999999999997,"15min":0.65800000000000003},"max":{"1min":1.2170000000000001,"5min":1.337,"15min":1.895},"last":1.01},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.96299999999999997,"15min":0.94699999999999995},"min":{"1min":0.90300000000000002,"5min":0.76200000000000001,"15min":0.68899999999999995},"max":{"1min":1.1879999999999999,"5min":1.3009999999999999,"15min":1.319},"last":0.80300000000000005}]},{"osd":6,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0580000000000001,"15min":1.0509999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.70299999999999996},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.034},{"interface":"front","average":{"1min":1.05,"5min":1.0640000000000001,"15min":1.0760000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.75800000000000001},"max":{"1min":1.3149999999999999,"5min":1.4950000000000001,"15min":2.1059999999999999},"last":1.163}]},{"osd":7,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.075,"15min":1.099},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.329,"5min":1.4330000000000001,"15min":2.1869999999999998},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0409999999999999,"15min":1.0229999999999999},"min":{"1min":0.83199999999999996,"5min":0.748,"15min":0.60899999999999999},"max":{"1min":1.2789999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.054}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:07:52.480 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:07:52.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.582+0000 7f447359e700 1 Processor -- start 2023-11-28T13:07:52.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.582+0000 7f447359e700 1 -- start start 2023-11-28T13:07:52.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.582+0000 7f447359e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f44740ced70 0x7f447406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:52.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.582+0000 7f447359e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f44740d06f0 0x7f44740d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:52.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.582+0000 7f447359e700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44740d28e0 con 0x7f447406b910 2023-11-28T13:07:52.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.582+0000 7f447359e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44740cdfe0 con 0x7f44740ced70 2023-11-28T13:07:52.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.582+0000 7f447359e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f447406c220 con 0x7f44740d06f0 2023-11-28T13:07:52.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.582+0000 7f447259c700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f447406b910 0x7f4474160780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52580/0 (socket says 172.21.15.82:52580) 2023-11-28T13:07:52.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.582+0000 7f447259c700 1 -- 172.21.15.82:0/2838155798 learned_addr learned my addr 172.21.15.82:0/2838155798 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:52.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f4471d9b700 1 --2- 172.21.15.82:0/2838155798 >> v2:172.21.15.82:3300/0 conn(0x7f44740ced70 0x7f447406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:52.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f4472d9d700 1 --2- 172.21.15.82:0/2838155798 >> v2:172.21.15.114:3300/0 conn(0x7f44740d06f0 0x7f44740d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:52.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f447159a700 1 -- 172.21.15.82:0/2838155798 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 353610176 0 0) 0x7f446c001490 con 0x7f447406b910 2023-11-28T13:07:52.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f447159a700 1 -- 172.21.15.82:0/2838155798 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f445c0035d0 con 0x7f447406b910 2023-11-28T13:07:52.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f447159a700 1 -- 172.21.15.82:0/2838155798 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2510960052 0 0) 0x7f445c0035d0 con 0x7f447406b910 2023-11-28T13:07:52.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f4471d9b700 1 -- 172.21.15.82:0/2838155798 >> v2:172.21.15.114:3300/0 conn(0x7f44740d06f0 msgr2=0x7f44740d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:52.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f4471d9b700 1 --2- 172.21.15.82:0/2838155798 >> v2:172.21.15.114:3300/0 conn(0x7f44740d06f0 0x7f44740d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:52.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f4471d9b700 1 -- 172.21.15.82:0/2838155798 >> v1:172.21.15.82:6789/0 conn(0x7f447406b910 legacy=0x7f4474160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:52.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f4471d9b700 1 -- 172.21.15.82:0/2838155798 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44740b2040 con 0x7f44740ced70 2023-11-28T13:07:52.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f4472d9d700 1 --2- 172.21.15.82:0/2838155798 >> v2:172.21.15.114:3300/0 conn(0x7f44740d06f0 0x7f44740d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:07:52.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f4471d9b700 1 --2- 172.21.15.82:0/2838155798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44740ced70 0x7f447406bce0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f44740b23b0 tx=0x7f4468009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17bb1ce81be16d0e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:52.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f447159a700 1 -- 172.21.15.82:0/2838155798 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c001b80 con 0x7f44740ced70 2023-11-28T13:07:52.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f447159a700 1 -- 172.21.15.82:0/2838155798 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4468004030 con 0x7f44740ced70 2023-11-28T13:07:52.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f447159a700 1 -- 172.21.15.82:0/2838155798 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44680043a0 con 0x7f44740ced70 2023-11-28T13:07:52.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f447359e700 1 -- 172.21.15.82:0/2838155798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44740ced70 msgr2=0x7f447406bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:52.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f447359e700 1 --2- 172.21.15.82:0/2838155798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44740ced70 0x7f447406bce0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f44740b23b0 tx=0x7f4468009b30 comp rx=0 tx=0).stop 2023-11-28T13:07:52.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f447359e700 1 -- 172.21.15.82:0/2838155798 shutdown_connections 2023-11-28T13:07:52.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f447359e700 1 --2- 172.21.15.82:0/2838155798 >> v2:172.21.15.114:3300/0 conn(0x7f44740d06f0 0x7f44740d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:52.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f447359e700 1 --2- 172.21.15.82:0/2838155798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44740ced70 0x7f447406bce0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:52.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f447359e700 1 -- 172.21.15.82:0/2838155798 >> 172.21.15.82:0/2838155798 conn(0x7f44740d2b20 msgr2=0x7f44740d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:52.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f447359e700 1 -- 172.21.15.82:0/2838155798 shutdown_connections 2023-11-28T13:07:52.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.586+0000 7f447359e700 1 -- 172.21.15.82:0/2838155798 wait complete. 2023-11-28T13:07:52.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f447359e700 1 Processor -- start 2023-11-28T13:07:52.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f447359e700 1 -- start start 2023-11-28T13:07:52.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f447359e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f447406b910 0x7f4474148630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:52.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f447359e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44740ced70 0x7f44740c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:52.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f447359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44740d06f0 0x7f44740c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:52.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f447359e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447415c300 con 0x7f44740ced70 2023-11-28T13:07:52.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f447359e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447414be90 con 0x7f44740d06f0 2023-11-28T13:07:52.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f447359e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447414bbb0 con 0x7f447406b910 2023-11-28T13:07:52.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f4471d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44740ced70 0x7f44740c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:52.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f4471d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44740ced70 0x7f44740c6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50410/0 (socket says 172.21.15.82:50410) 2023-11-28T13:07:52.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f4471d9b700 1 -- 172.21.15.82:0/1880837255 learned_addr learned my addr 172.21.15.82:0/1880837255 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:52.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f4472d9d700 1 --2- 172.21.15.82:0/1880837255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44740d06f0 0x7f44740c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:52.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f447259c700 1 --2- 172.21.15.82:0/1880837255 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f447406b910 0x7f4474148630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:52.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f4471d9b700 1 -- 172.21.15.82:0/1880837255 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f447406b910 msgr2=0x7f4474148630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:52.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f4471d9b700 1 --2- 172.21.15.82:0/1880837255 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f447406b910 0x7f4474148630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:52.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f4471d9b700 1 -- 172.21.15.82:0/1880837255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44740d06f0 msgr2=0x7f44740c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:52.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f4471d9b700 1 --2- 172.21.15.82:0/1880837255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44740d06f0 0x7f44740c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:52.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f4471d9b700 1 -- 172.21.15.82:0/1880837255 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44640094b0 con 0x7f44740ced70 2023-11-28T13:07:52.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f4471d9b700 1 --2- 172.21.15.82:0/1880837255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44740ced70 0x7f44740c6650 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f44680090b0 tx=0x7f4468004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:52.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f4462ffd700 1 -- 172.21.15.82:0/1880837255 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4468003db0 con 0x7f44740ced70 2023-11-28T13:07:52.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f4462ffd700 1 -- 172.21.15.82:0/1880837255 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446801f070 con 0x7f44740ced70 2023-11-28T13:07:52.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f447359e700 1 -- 172.21.15.82:0/1880837255 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44680094b0 con 0x7f44740ced70 2023-11-28T13:07:52.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f4462ffd700 1 -- 172.21.15.82:0/1880837255 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4468011870 con 0x7f44740ced70 2023-11-28T13:07:52.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.590+0000 7f447359e700 1 -- 172.21.15.82:0/1880837255 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44740d2320 con 0x7f44740ced70 2023-11-28T13:07:52.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.594+0000 7f447359e700 1 -- 172.21.15.82:0/1880837255 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44740cf2c0 con 0x7f44740ced70 2023-11-28T13:07:52.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.594+0000 7f4462ffd700 1 -- 172.21.15.82:0/1880837255 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4468017020 con 0x7f44740ced70 2023-11-28T13:07:52.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.594+0000 7f4462ffd700 1 --2- 172.21.15.82:0/1880837255 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4454064ee0 0x7f4454067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:52.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.594+0000 7f4462ffd700 1 -- 172.21.15.82:0/1880837255 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4468021070 con 0x7f44740ced70 2023-11-28T13:07:52.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.594+0000 7f447259c700 1 --2- 172.21.15.82:0/1880837255 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4454064ee0 0x7f4454067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:52.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.598+0000 7f447259c700 1 --2- 172.21.15.82:0/1880837255 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4454064ee0 0x7f4454067390 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f446c007160 tx=0x7f446c001490 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:52.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.602+0000 7f4462ffd700 1 -- 172.21.15.82:0/1880837255 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f44680518c0 con 0x7f44740ced70 2023-11-28T13:07:52.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.758+0000 7f447359e700 1 -- 172.21.15.82:0/1880837255 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44741f1cf0 con 0x7f4454064ee0 2023-11-28T13:07:52.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.766+0000 7f4462ffd700 1 -- 172.21.15.82:0/1880837255 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71390 (secure 0 0 0) 0x7f446c001a60 con 0x7f4454064ee0 2023-11-28T13:07:52.773 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:07:52.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.766+0000 7f447359e700 1 -- 172.21.15.82:0/1880837255 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4454064ee0 msgr2=0x7f4454067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:52.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.766+0000 7f447359e700 1 --2- 172.21.15.82:0/1880837255 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4454064ee0 0x7f4454067390 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f446c007160 tx=0x7f446c001490 comp rx=0 tx=0).stop 2023-11-28T13:07:52.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.766+0000 7f447359e700 1 -- 172.21.15.82:0/1880837255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44740ced70 msgr2=0x7f44740c6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:52.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.766+0000 7f447359e700 1 --2- 172.21.15.82:0/1880837255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44740ced70 0x7f44740c6650 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f44680090b0 tx=0x7f4468004770 comp rx=0 tx=0).stop 2023-11-28T13:07:52.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.766+0000 7f447359e700 1 -- 172.21.15.82:0/1880837255 shutdown_connections 2023-11-28T13:07:52.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.766+0000 7f447359e700 1 --2- 172.21.15.82:0/1880837255 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4454064ee0 0x7f4454067390 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:52.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.766+0000 7f447359e700 1 --2- 172.21.15.82:0/1880837255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44740d06f0 0x7f44740c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:52.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.766+0000 7f447359e700 1 --2- 172.21.15.82:0/1880837255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44740ced70 0x7f44740c6650 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:52.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.766+0000 7f447359e700 1 --2- 172.21.15.82:0/1880837255 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f447406b910 0x7f4474148630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:52.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.766+0000 7f447359e700 1 -- 172.21.15.82:0/1880837255 >> 172.21.15.82:0/1880837255 conn(0x7f44740d2b20 msgr2=0x7f447415ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:52.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.766+0000 7f447359e700 1 -- 172.21.15.82:0/1880837255 shutdown_connections 2023-11-28T13:07:52.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.766+0000 7f447359e700 1 -- 172.21.15.82:0/1880837255 wait complete. 2023-11-28T13:07:52.776 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:07:52.788 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2023-11-28T13:07:51.317607+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":88472,"kb_used_data":7640,"kb_used_omap":0,"kb_used_meta":80768,"kb_avail":754886248,"statfs":{"total":773094113280,"available":773003517952,"internally_reserved":0,"allocated":7823360,"data_stored":4123600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":82706432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12288,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-6,"num_read_kb":-5,"num_write":-76,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":-70,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002628"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":214,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:19.246350+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:06:19.246350+0000","last_peered":"2023-11-28T13:06:19.246350+0000","last_clean":"2023-11-28T13:06:19.246350+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:06:19.246350+0000","last_undegraded":"2023-11-28T13:06:19.246350+0000","last_fullsized":"2023-11-28T13:06:19.246350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":49,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:39.250917+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:06:39.250917+0000","last_peered":"2023-11-28T13:06:39.250917+0000","last_clean":"2023-11-28T13:06:39.250917+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:06:39.250917+0000","last_undegraded":"2023-11-28T13:06:39.250917+0000","last_fullsized":"2023-11-28T13:06:39.250917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:24.247427+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:06:24.247427+0000","last_peered":"2023-11-28T13:06:24.247427+0000","last_clean":"2023-11-28T13:06:24.247427+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:06:24.247427+0000","last_undegraded":"2023-11-28T13:06:24.247427+0000","last_fullsized":"2023-11-28T13:06:24.247427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:39.246301+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:06:39.246301+0000","last_peered":"2023-11-28T13:06:39.246301+0000","last_clean":"2023-11-28T13:06:39.246301+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:06:39.246301+0000","last_undegraded":"2023-11-28T13:06:39.246301+0000","last_fullsized":"2023-11-28T13:06:39.246301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:39.250867+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:06:39.250867+0000","last_peered":"2023-11-28T13:06:39.250867+0000","last_clean":"2023-11-28T13:06:39.250867+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:06:39.250867+0000","last_undegraded":"2023-11-28T13:06:39.250867+0000","last_fullsized":"2023-11-28T13:06:39.250867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:39.252305+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:06:39.252305+0000","last_peered":"2023-11-28T13:06:39.252305+0000","last_clean":"2023-11-28T13:06:39.252305+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:06:39.252305+0000","last_undegraded":"2023-11-28T13:06:39.252305+0000","last_fullsized":"2023-11-28T13:06:39.252305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:39.250439+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:06:39.250439+0000","last_peered":"2023-11-28T13:06:39.250439+0000","last_clean":"2023-11-28T13:06:39.250439+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:06:39.250439+0000","last_undegraded":"2023-11-28T13:06:39.250439+0000","last_fullsized":"2023-11-28T13:06:39.250439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:54.254780+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:06:54.254780+0000","last_peered":"2023-11-28T13:06:54.254780+0000","last_clean":"2023-11-28T13:06:54.254780+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:06:54.254780+0000","last_undegraded":"2023-11-28T13:06:54.254780+0000","last_fullsized":"2023-11-28T13:06:54.254780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:54.252746+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:06:54.252746+0000","last_peered":"2023-11-28T13:06:54.252746+0000","last_clean":"2023-11-28T13:06:54.252746+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:06:54.252746+0000","last_undegraded":"2023-11-28T13:06:54.252746+0000","last_fullsized":"2023-11-28T13:06:54.252746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574942,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15160,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":13760,"kb_avail":94356680,"statfs":{"total":96636764160,"available":96621240320,"internally_reserved":0,"allocated":1425408,"data_stored":955844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14090240},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.84999999999999998,"15min":0.82899999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2150000000000001,"5min":1.28,"15min":1.3859999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.85899999999999999,"15min":0.89200000000000002},"min":{"1min":0.65100000000000002,"5min":0.51200000000000001,"15min":0.5},"max":{"1min":1.196,"5min":1.2130000000000001,"15min":1.377},"last":0.96299999999999997}]},{"osd":1,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.86599999999999999,"15min":0.90100000000000002},"min":{"1min":0.63800000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.1839999999999999,"5min":1.2410000000000001,"15min":1.599},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.86699999999999999,"15min":0.91900000000000004},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.091,"5min":1.194,"15min":1.375},"last":1.0620000000000001}]},{"osd":2,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.85499999999999998,"15min":0.91000000000000003},"min":{"1min":0.61299999999999999,"5min":0.54100000000000004,"15min":0.53300000000000003},"max":{"1min":1.1559999999999999,"5min":1.198,"15min":2.9060000000000001},"last":1.018},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.94099999999999995,"15min":0.91800000000000004},"min":{"1min":0.63600000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1830000000000001,"5min":1.3109999999999999,"15min":1.6659999999999999},"last":0.84299999999999997}]},{"osd":3,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.89900000000000002,"15min":0.93200000000000005},"min":{"1min":0.625,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.26,"5min":1.26,"15min":1.6399999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.022,"5min":0.95399999999999996,"15min":0.93400000000000005},"min":{"1min":0.80400000000000005,"5min":0.72499999999999998,"15min":0.59799999999999998},"max":{"1min":1.2090000000000001,"5min":1.212,"15min":1.3660000000000001},"last":0.89600000000000002}]},{"osd":4,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.85599999999999998,"15min":0.95699999999999996},"min":{"1min":0.60799999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.135,"5min":1.1739999999999999,"15min":1.6819999999999999},"last":0.872},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.90700000000000003,"15min":0.94599999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1499999999999999,"5min":1.2649999999999999,"15min":1.409},"last":1.119}]},{"osd":5,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.91800000000000004,"15min":0.996},"min":{"1min":0.66700000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.282,"5min":1.282,"15min":1.466},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.99099999999999999,"15min":1.0680000000000001},"min":{"1min":0.71099999999999997,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.175,"5min":1.2589999999999999,"15min":1.5449999999999999},"last":1.139}]},{"osd":6,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0429999999999999,"15min":1.1379999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.68799999999999994},"max":{"1min":1.236,"5min":1.28,"15min":2.0630000000000002},"last":1.105},{"interface":"front","average":{"1min":1.048,"5min":1.042,"15min":1.1299999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.2450000000000001,"5min":1.407,"15min":1.794},"last":1.379}]}]},{"osd":6,"up_from":13,"seq":55834574943,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9516,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362324,"statfs":{"total":96636764160,"available":96627019776,"internally_reserved":0,"allocated":823296,"data_stored":364820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81000000000000005,"15min":0.82699999999999996},"min":{"1min":0.54400000000000004,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1000000000000001,"5min":1.23,"15min":1.5580000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.90500000000000003,"15min":0.86499999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.54100000000000004},"max":{"1min":1.1599999999999999,"5min":1.448,"15min":1.448},"last":0.754}]},{"osd":1,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.93600000000000005,"15min":0.88800000000000001},"min":{"1min":0.65300000000000002,"5min":0.59199999999999997,"15min":0.51900000000000002},"max":{"1min":1.25,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.143},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85599999999999998,"15min":0.86299999999999999},"min":{"1min":0.66900000000000004,"5min":0.59699999999999998,"15min":0.55900000000000005},"max":{"1min":1.0349999999999999,"5min":1.716,"15min":1.716},"last":0.96099999999999997}]},{"osd":2,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.878,"15min":0.88100000000000001},"min":{"1min":0.60599999999999998,"5min":0.505,"15min":0.505},"max":{"1min":1.1319999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93700000000000006,"15min":0.90600000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.175,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.101}]},{"osd":3,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.88,"15min":0.88100000000000001},"min":{"1min":0.68300000000000005,"5min":0.57399999999999995,"15min":0.53300000000000003},"max":{"1min":1.149,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96399999999999997,"15min":0.97199999999999998},"min":{"1min":0.69399999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1950000000000001,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.879}]},{"osd":4,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.94299999999999995,"15min":0.94699999999999995},"min":{"1min":0.61599999999999999,"5min":0.60999999999999999,"15min":0.59699999999999998},"max":{"1min":1.3,"5min":1.746,"15min":1.8049999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.96399999999999997,"15min":1.3140000000000001},"min":{"1min":0.72499999999999998,"5min":0.63500000000000001,"15min":0.629},"max":{"1min":1.228,"5min":1.2969999999999999,"15min":10.566000000000001},"last":0.66200000000000003}]},{"osd":5,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":1.006,"15min":1.0580000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3069999999999999,"5min":2.048,"15min":2.048},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.042,"5min":1.1120000000000001,"15min":1.095},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.325,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":0.90600000000000003}]},{"osd":7,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.044,"15min":1.1779999999999999},"min":{"1min":0.78400000000000003,"5min":0.751,"15min":0.74299999999999999},"max":{"1min":1.208,"5min":1.367,"15min":3.4980000000000002},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.141,"15min":1.264},"min":{"1min":0.98899999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.3759999999999999,"5min":1.7669999999999999,"15min":3.593},"last":1.0409999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574944,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9708,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362132,"statfs":{"total":96636764160,"available":96626823168,"internally_reserved":0,"allocated":823296,"data_stored":364808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.82099999999999995,"15min":0.81799999999999995},"min":{"1min":0.60899999999999999,"5min":0.53700000000000003,"15min":0.502},"max":{"1min":1.054,"5min":1.171,"15min":1.171},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.876,"15min":0.83899999999999997},"min":{"1min":0.68400000000000005,"5min":0.55400000000000005,"15min":0.48399999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.2589999999999999}]},{"osd":1,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.84699999999999998,"15min":0.83099999999999996},"min":{"1min":0.66000000000000003,"5min":0.48999999999999999,"15min":0.46000000000000002},"max":{"1min":1.077,"5min":1.1919999999999999,"15min":1.274},"last":1.302},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.86899999999999999,"15min":0.82099999999999995},"min":{"1min":0.54600000000000004,"5min":0.434,"15min":0.434},"max":{"1min":1.173,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.0700000000000001}]},{"osd":2,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.88300000000000001,"15min":0.83599999999999997},"min":{"1min":0.67800000000000005,"5min":0.59599999999999997,"15min":0.45500000000000002},"max":{"1min":1.212,"5min":1.395,"15min":1.395},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.89400000000000002,"15min":0.92300000000000004},"min":{"1min":0.66200000000000003,"5min":0.55700000000000005,"15min":0.53000000000000003},"max":{"1min":1.198,"5min":1.26,"15min":1.3560000000000001},"last":1.034}]},{"osd":3,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.93999999999999995,"15min":0.89600000000000002},"min":{"1min":0.70299999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.014,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.82399999999999995,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2210000000000001,"5min":1.365,"15min":1.403},"last":1.208}]},{"osd":4,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.86899999999999999,"15min":0.88200000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.40699999999999997},"max":{"1min":1.246,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.97899999999999998,"15min":0.96699999999999997},"min":{"1min":0.56899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.444,"5min":1.5189999999999999,"15min":4.3300000000000001},"last":1.4099999999999999}]},{"osd":6,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97299999999999998,"15min":1.0089999999999999},"min":{"1min":0.68799999999999994,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.224,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0660000000000001,"15min":1.0409999999999999},"min":{"1min":0.82899999999999996,"5min":0.70599999999999996,"15min":0.59299999999999997},"max":{"1min":1.3129999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.3380000000000001}]},{"osd":7,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.1000000000000001,"15min":1.0629999999999999},"min":{"1min":0.73399999999999999,"5min":0.58399999999999996,"15min":0.56599999999999995},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":4.234},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.101,"15min":1.1259999999999999},"min":{"1min":0.77900000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2989999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.377}]}]},{"osd":4,"up_from":13,"seq":55834574943,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9916,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361924,"statfs":{"total":96636764160,"available":96626610176,"internally_reserved":0,"allocated":839680,"data_stored":376292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.86099999999999999,"15min":0.82799999999999996},"min":{"1min":0.58899999999999997,"5min":0.57999999999999996,"15min":0.53600000000000003},"max":{"1min":1.107,"5min":1.1699999999999999,"15min":1.2589999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.84399999999999997,"15min":0.82299999999999995},"min":{"1min":0.69499999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2150000000000001,"5min":1.429,"15min":1.429},"last":0.77400000000000002}]},{"osd":1,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81799999999999995,"15min":0.81699999999999995},"min":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.54300000000000004},"max":{"1min":1.038,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":1.177},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.88800000000000001,"15min":0.876},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0700000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.70799999999999996}]},{"osd":2,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.82499999999999996,"15min":0.83499999999999996},"min":{"1min":0.65200000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.002,"5min":1.296,"15min":1.357},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.90500000000000003,"15min":0.89300000000000002},"min":{"1min":0.65600000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1339999999999999,"5min":1.2270000000000001,"15min":1.2549999999999999},"last":1}]},{"osd":3,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.90600000000000003,"15min":0.88500000000000001},"min":{"1min":0.64900000000000002,"5min":0.64300000000000002,"15min":0.61899999999999999},"max":{"1min":1.1519999999999999,"5min":1.252,"15min":1.252},"last":1.048},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.98099999999999998,"15min":0.98799999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.66400000000000003},"max":{"1min":1.1619999999999999,"5min":1.222,"15min":1.474},"last":0.86799999999999999}]},{"osd":5,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.85499999999999998,"15min":0.88700000000000001},"min":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.53400000000000003},"max":{"1min":1.0369999999999999,"5min":1.2809999999999999,"15min":1.4590000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.94099999999999995,"15min":0.97599999999999998},"min":{"1min":0.68200000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2490000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.81799999999999995}]},{"osd":6,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.92600000000000005,"15min":0.997},"min":{"1min":0.65500000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.093,"5min":1.657,"15min":1.657},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.026,"15min":1.0629999999999999},"min":{"1min":0.77000000000000002,"5min":0.62,"15min":0.62},"max":{"1min":1.135,"5min":1.4690000000000001,"15min":1.5149999999999999},"last":1.23}]},{"osd":7,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.034,"15min":1.073},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.296,"5min":1.389,"15min":1.526},"last":1.147},{"interface":"front","average":{"1min":1.071,"5min":1.0960000000000001,"15min":1.133},"min":{"1min":0.82299999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.258,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.98899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574942,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9896,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361944,"statfs":{"total":96636764160,"available":96626630656,"internally_reserved":0,"allocated":819200,"data_stored":364786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.629,"15min":0.60999999999999999},"min":{"1min":0.48299999999999998,"5min":0.41399999999999998,"15min":0.39400000000000002},"max":{"1min":1.0049999999999999,"5min":1.0840000000000001,"15min":1.0900000000000001},"last":0.621},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.54100000000000004,"5min":0.45100000000000001,"15min":0.43099999999999999},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.58199999999999996}]},{"osd":1,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.496,"5min":0.45500000000000002,"15min":0.32500000000000001},"max":{"1min":0.93899999999999995,"5min":1.0129999999999999,"15min":1.1890000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77400000000000002,"15min":0.76400000000000001},"min":{"1min":0.55600000000000005,"5min":0.48399999999999999,"15min":0.441},"max":{"1min":0.93200000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.71199999999999997}]},{"osd":2,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76400000000000001,"15min":0.749},"min":{"1min":0.49099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0129999999999999,"5min":1.028,"15min":1.2989999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.83699999999999997,"15min":0.83099999999999996},"min":{"1min":0.71799999999999997,"5min":0.52400000000000002,"15min":0.438},"max":{"1min":1.0720000000000001,"5min":1.1659999999999999,"15min":1.4550000000000001},"last":0.85399999999999998}]},{"osd":4,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.90800000000000003,"15min":0.96599999999999997},"min":{"1min":0.80900000000000005,"5min":0.65200000000000002,"15min":0.63100000000000001},"max":{"1min":1.2569999999999999,"5min":1.3400000000000001,"15min":1.405},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.98199999999999998,"15min":1.0249999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.57899999999999996},"max":{"1min":1.2929999999999999,"5min":1.3620000000000001,"15min":1.7150000000000001},"last":0.76500000000000001}]},{"osd":5,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.97499999999999998,"15min":1.034},"min":{"1min":0.79300000000000004,"5min":0.64400000000000002,"15min":0.57399999999999995},"max":{"1min":1.26,"5min":1.518,"15min":1.5549999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.044,"15min":1.075},"min":{"1min":0.91700000000000004,"5min":0.76400000000000001,"15min":0.73799999999999999},"max":{"1min":1.329,"5min":1.5449999999999999,"15min":1.6639999999999999},"last":0.96299999999999997}]},{"osd":6,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.02,"15min":1.069},"min":{"1min":0.89200000000000002,"5min":0.72699999999999998,"15min":0.55600000000000005},"max":{"1min":1.3420000000000001,"5min":1.371,"15min":1.446},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0700000000000001,"15min":1.0980000000000001},"min":{"1min":0.75600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3360000000000001,"5min":1.45,"15min":1.6220000000000001},"last":0.91700000000000004}]},{"osd":7,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1120000000000001,"15min":1.141},"min":{"1min":0.99099999999999999,"5min":0.85699999999999998,"15min":0.67900000000000005},"max":{"1min":1.4019999999999999,"5min":1.488,"15min":1.5669999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.073,"15min":1.141},"min":{"1min":0.879,"5min":0.77200000000000002,"15min":0.67100000000000004},"max":{"1min":1.3069999999999999,"5min":1.534,"15min":1.6499999999999999},"last":0.94599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9644,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362196,"statfs":{"total":96636764160,"available":96626888704,"internally_reserved":0,"allocated":823296,"data_stored":364856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77400000000000002,"5min":0.94999999999999996,"15min":0.997},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71299999999999997,"15min":0.64800000000000002},"min":{"1min":0.52200000000000002,"5min":0.39400000000000002,"15min":0.38500000000000001},"max":{"1min":0.96699999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.69699999999999995}]},{"osd":1,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64600000000000002,"15min":0.628},"min":{"1min":0.45000000000000001,"5min":0.378,"15min":0.36199999999999999},"max":{"1min":0.85599999999999998,"5min":0.997,"15min":1.123},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72299999999999998,"15min":0.68999999999999995},"min":{"1min":0.56499999999999995,"5min":0.45600000000000002,"15min":0.44400000000000001},"max":{"1min":0.90000000000000002,"5min":1.0009999999999999,"15min":1.0569999999999999},"last":0.54100000000000004}]},{"osd":3,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80900000000000005,"15min":0.751},"min":{"1min":0.61399999999999999,"5min":0.46000000000000002,"15min":0.317},"max":{"1min":1.079,"5min":1.143,"15min":1.1599999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76700000000000002,"15min":0.75},"min":{"1min":0.54900000000000004,"5min":0.436,"15min":0.34000000000000002},"max":{"1min":0.93400000000000005,"5min":1.222,"15min":1.222},"last":0.73999999999999999}]},{"osd":4,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.93500000000000005,"15min":0.92100000000000004},"min":{"1min":0.80600000000000005,"5min":0.64800000000000002,"15min":0.498},"max":{"1min":1.1639999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.998,"5min":1.0029999999999999,"15min":1.004},"min":{"1min":0.86699999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1599999999999999,"5min":1.3,"15min":1.4159999999999999},"last":1.1319999999999999}]},{"osd":5,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94299999999999995,"15min":0.95099999999999996},"min":{"1min":0.70199999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.226,"5min":1.343,"15min":1.4430000000000001},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.022,"15min":1},"min":{"1min":0.71099999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.407,"5min":1.643,"15min":1.6830000000000001},"last":1.3100000000000001}]},{"osd":6,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.024,"15min":1.0329999999999999},"min":{"1min":0.78700000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.3260000000000001,"5min":1.6060000000000001,"15min":1.8240000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.018,"15min":1.006},"min":{"1min":0.71899999999999997,"5min":0.67900000000000005,"15min":0.55400000000000005},"max":{"1min":1.224,"5min":1.54,"15min":1.54},"last":0.89900000000000002}]},{"osd":7,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0700000000000001,"15min":1.0640000000000001},"min":{"1min":0.77000000000000002,"5min":0.74399999999999999,"15min":0.57199999999999995},"max":{"1min":1.276,"5min":1.5069999999999999,"15min":1.5980000000000001},"last":1.292},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.147,"15min":1.1160000000000001},"min":{"1min":0.83399999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3640000000000001,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":1.246}]}]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9740,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362100,"statfs":{"total":96636764160,"available":96626790400,"internally_reserved":0,"allocated":856064,"data_stored":377040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.624,"15min":0.63900000000000001},"min":{"1min":0.502,"5min":0.38700000000000001,"15min":0.314},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68600000000000005,"15min":0.68100000000000005},"min":{"1min":0.52500000000000002,"5min":0.39500000000000002,"15min":0.318},"max":{"1min":1.0629999999999999,"5min":1.1040000000000001,"15min":1.181},"last":0.624}]},{"osd":2,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.54500000000000004,"5min":0.42699999999999999,"15min":0.38500000000000001},"max":{"1min":1.208,"5min":1.2230000000000001,"15min":1.3009999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.75900000000000001,"15min":0.75600000000000001},"min":{"1min":0.55600000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1200000000000001,"5min":1.228,"15min":1.409},"last":0.54100000000000004}]},{"osd":3,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.871,"15min":0.83999999999999997},"min":{"1min":0.626,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.246,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.80700000000000005,"15min":0.76200000000000001},"min":{"1min":0.66600000000000004,"5min":0.46300000000000002,"15min":0.435},"max":{"1min":1.036,"5min":1.1240000000000001,"15min":1.2529999999999999},"last":0.66300000000000003}]},{"osd":4,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.97599999999999998,"15min":0.98599999999999999},"min":{"1min":0.81699999999999995,"5min":0.66600000000000004,"15min":0.61899999999999999},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92500000000000004,"15min":0.93500000000000005},"min":{"1min":0.73199999999999998,"5min":0.64100000000000001,"15min":0.52000000000000002},"max":{"1min":1.1060000000000001,"5min":1.3049999999999999,"15min":2.1309999999999998},"last":0.77400000000000002}]},{"osd":5,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0029999999999999,"15min":0.98399999999999999},"min":{"1min":0.80200000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.95999999999999996,"15min":1.0189999999999999},"min":{"1min":0.88200000000000001,"5min":0.63100000000000001,"15min":0.60799999999999998},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":2.004},"last":0.874}]},{"osd":6,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97799999999999998,"15min":0.996},"min":{"1min":0.78400000000000003,"5min":0.63600000000000001,"15min":0.61499999999999999},"max":{"1min":1.3109999999999999,"5min":1.3660000000000001,"15min":1.889},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.129,"5min":1.087,"15min":1.1000000000000001},"min":{"1min":0.93300000000000005,"5min":0.745,"15min":0.64400000000000002},"max":{"1min":1.5389999999999999,"5min":1.6739999999999999,"15min":1.9610000000000001},"last":0.752}]},{"osd":7,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.0840000000000001,"15min":1.089},"min":{"1min":0.81200000000000006,"5min":0.629,"15min":0.629},"max":{"1min":1.5149999999999999,"5min":1.6200000000000001,"15min":1.766},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.0569999999999999,"15min":1.0980000000000001},"min":{"1min":0.91500000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":2.0470000000000002},"last":0.82699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574944,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14892,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":13504,"kb_avail":94356948,"statfs":{"total":96636764160,"available":96621514752,"internally_reserved":0,"allocated":1413120,"data_stored":955154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13828096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65600000000000003,"15min":0.64000000000000001},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.35099999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71099999999999997,"15min":0.66400000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.36699999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.198},"last":0.61099999999999999}]},{"osd":2,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.74099999999999999,"15min":0.71799999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.28599999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.73599999999999999,"15min":0.71699999999999997},"min":{"1min":0.55800000000000005,"5min":0.434,"15min":0.34399999999999997},"max":{"1min":1.099,"5min":1.099,"15min":1.143},"last":0.77900000000000003}]},{"osd":3,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70399999999999996,"15min":0.68700000000000006},"min":{"1min":0.52700000000000002,"5min":0.41299999999999998,"15min":0.39200000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.298},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.83799999999999997,"15min":0.84299999999999997},"min":{"1min":0.66300000000000003,"5min":0.54700000000000004,"15min":0.32100000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.629},"last":0.746}]},{"osd":4,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.71499999999999997,"5min":0.69999999999999996,"15min":0.68700000000000006},"max":{"1min":1.153,"5min":1.341,"15min":1.341},"last":0.88},{"interface":"front","average":{"1min":1.01,"5min":0.98099999999999998,"15min":0.96499999999999997},"min":{"1min":0.83699999999999997,"5min":0.73599999999999999,"15min":0.56100000000000005},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.82899999999999996}]},{"osd":5,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97299999999999998,"15min":0.98399999999999999},"min":{"1min":0.755,"5min":0.71699999999999997,"15min":0.65800000000000003},"max":{"1min":1.2170000000000001,"5min":1.337,"15min":1.895},"last":1.01},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.96299999999999997,"15min":0.94699999999999995},"min":{"1min":0.90300000000000002,"5min":0.76200000000000001,"15min":0.68899999999999995},"max":{"1min":1.1879999999999999,"5min":1.3009999999999999,"15min":1.319},"last":0.80300000000000005}]},{"osd":6,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0580000000000001,"15min":1.0509999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.70299999999999996},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.034},{"interface":"front","average":{"1min":1.05,"5min":1.0640000000000001,"15min":1.0760000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.75800000000000001},"max":{"1min":1.3149999999999999,"5min":1.4950000000000001,"15min":2.1059999999999999},"last":1.163}]},{"osd":7,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.075,"15min":1.099},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.329,"5min":1.4330000000000001,"15min":2.1869999999999998},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0409999999999999,"15min":1.0229999999999999},"min":{"1min":0.83199999999999996,"5min":0.748,"15min":0.60899999999999999},"max":{"1min":1.2789999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.054}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:07:52.790 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T13:07:52.790 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:07:52.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.890+0000 7f5fa5b18700 1 Processor -- start 2023-11-28T13:07:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.890+0000 7f5fa5b18700 1 -- start start 2023-11-28T13:07:52.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.890+0000 7f5fa5b18700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5fa006b0a0 0x7f5fa006d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:52.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.890+0000 7f5fa5b18700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5fa0070070 0x7f5fa0070470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:52.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.890+0000 7f5fa5b18700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa006c480 con 0x7f5fa00b3910 2023-11-28T13:07:52.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.890+0000 7f5fa5b18700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa00709b0 con 0x7f5fa006b0a0 2023-11-28T13:07:52.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.890+0000 7f5fa5b18700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa006dbe0 con 0x7f5fa0070070 2023-11-28T13:07:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.890+0000 7f5f9ffff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5fa006b0a0 0x7f5fa006d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.890+0000 7f5fa4b16700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5fa00b3910 0x7f5fa006c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52594/0 (socket says 172.21.15.82:52594) 2023-11-28T13:07:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.890+0000 7f5fa4b16700 1 -- 172.21.15.82:0/4275664695 learned_addr learned my addr 172.21.15.82:0/4275664695 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.890+0000 7f5fa5317700 1 --2- 172.21.15.82:0/4275664695 >> v2:172.21.15.114:3300/0 conn(0x7f5fa0070070 0x7f5fa0070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.890+0000 7f5f9ffff700 1 -- 172.21.15.82:0/4275664695 >> v2:172.21.15.114:3300/0 conn(0x7f5fa0070070 msgr2=0x7f5fa0070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.890+0000 7f5f9ffff700 1 --2- 172.21.15.82:0/4275664695 >> v2:172.21.15.114:3300/0 conn(0x7f5fa0070070 0x7f5fa0070470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.890+0000 7f5f9ffff700 1 -- 172.21.15.82:0/4275664695 >> v1:172.21.15.82:6789/0 conn(0x7f5fa00b3910 legacy=0x7f5fa006c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:52.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.890+0000 7f5f9f7fe700 1 -- 172.21.15.82:0/4275664695 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276841344 0 0) 0x7f5fa006c480 con 0x7f5fa00b3910 2023-11-28T13:07:52.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.890+0000 7f5f9ffff700 1 -- 172.21.15.82:0/4275664695 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa006dec0 con 0x7f5fa006b0a0 2023-11-28T13:07:52.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.894+0000 7f5f9ffff700 1 --2- 172.21.15.82:0/4275664695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fa006b0a0 0x7f5fa006d320 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0070000 tx=0x7f5f9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7557d6f1de9ce83 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:52.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.894+0000 7f5f9f7fe700 1 -- 172.21.15.82:0/4275664695 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9000e070 con 0x7f5fa006b0a0 2023-11-28T13:07:52.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.894+0000 7f5f9f7fe700 1 -- 172.21.15.82:0/4275664695 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9000bbd0 con 0x7f5fa006b0a0 2023-11-28T13:07:52.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.894+0000 7f5f9f7fe700 1 -- 172.21.15.82:0/4275664695 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f90012430 con 0x7f5fa006b0a0 2023-11-28T13:07:52.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.894+0000 7f5fa5b18700 1 -- 172.21.15.82:0/4275664695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fa006b0a0 msgr2=0x7f5fa006d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:52.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.894+0000 7f5fa5b18700 1 --2- 172.21.15.82:0/4275664695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fa006b0a0 0x7f5fa006d320 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0070000 tx=0x7f5f9000b330 comp rx=0 tx=0).stop 2023-11-28T13:07:52.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.894+0000 7f5fa5b18700 1 -- 172.21.15.82:0/4275664695 shutdown_connections 2023-11-28T13:07:52.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.894+0000 7f5fa5b18700 1 --2- 172.21.15.82:0/4275664695 >> v2:172.21.15.114:3300/0 conn(0x7f5fa0070070 0x7f5fa0070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:52.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.894+0000 7f5fa5b18700 1 --2- 172.21.15.82:0/4275664695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fa006b0a0 0x7f5fa006d320 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:52.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.894+0000 7f5fa5b18700 1 -- 172.21.15.82:0/4275664695 >> 172.21.15.82:0/4275664695 conn(0x7f5fa00ce600 msgr2=0x7f5fa00ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:52.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.894+0000 7f5fa5b18700 1 -- 172.21.15.82:0/4275664695 shutdown_connections 2023-11-28T13:07:52.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.894+0000 7f5fa5b18700 1 -- 172.21.15.82:0/4275664695 wait complete. 2023-11-28T13:07:52.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.898+0000 7f5fa5b18700 1 Processor -- start 2023-11-28T13:07:52.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.898+0000 7f5fa5b18700 1 -- start start 2023-11-28T13:07:52.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.898+0000 7f5fa5b18700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5fa006b0a0 0x7f5fa00c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:52.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.898+0000 7f5fa5b18700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fa0070070 0x7f5fa0154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:52.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.898+0000 7f5fa5b18700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fa00b3910 0x7f5fa014eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:52.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.898+0000 7f5fa5b18700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa0155030 con 0x7f5fa0070070 2023-11-28T13:07:52.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.898+0000 7f5fa5b18700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa014f050 con 0x7f5fa00b3910 2023-11-28T13:07:52.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.898+0000 7f5fa5b18700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa00c5dd0 con 0x7f5fa006b0a0 2023-11-28T13:07:52.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.898+0000 7f5f9ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fa0070070 0x7f5fa0154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:52.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.898+0000 7f5f9ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fa0070070 0x7f5fa0154af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50428/0 (socket says 172.21.15.82:50428) 2023-11-28T13:07:52.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.898+0000 7f5f9ffff700 1 -- 172.21.15.82:0/3094485688 learned_addr learned my addr 172.21.15.82:0/3094485688 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:52.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.898+0000 7f5fa4b16700 1 --2- 172.21.15.82:0/3094485688 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5fa006b0a0 0x7f5fa00c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:52.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.898+0000 7f5fa5317700 1 --2- 172.21.15.82:0/3094485688 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fa00b3910 0x7f5fa014eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:52.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.898+0000 7f5f9ffff700 1 -- 172.21.15.82:0/3094485688 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5fa006b0a0 msgr2=0x7f5fa00c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:52.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.898+0000 7f5f9ffff700 1 --2- 172.21.15.82:0/3094485688 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5fa006b0a0 0x7f5fa00c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:52.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.898+0000 7f5f9ffff700 1 -- 172.21.15.82:0/3094485688 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fa00b3910 msgr2=0x7f5fa014eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:52.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.898+0000 7f5f9ffff700 1 --2- 172.21.15.82:0/3094485688 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fa00b3910 0x7f5fa014eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:52.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.898+0000 7f5f9ffff700 1 -- 172.21.15.82:0/3094485688 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f90009a70 con 0x7f5fa0070070 2023-11-28T13:07:52.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.902+0000 7f5f9ffff700 1 --2- 172.21.15.82:0/3094485688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fa0070070 0x7f5fa0154af0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f5f90014040 tx=0x7f5f90004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:52.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.902+0000 7f5f9d7fa700 1 -- 172.21.15.82:0/3094485688 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f90012430 con 0x7f5fa0070070 2023-11-28T13:07:52.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.902+0000 7f5f9d7fa700 1 -- 172.21.15.82:0/3094485688 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f90020070 con 0x7f5fa0070070 2023-11-28T13:07:52.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.902+0000 7f5fa5b18700 1 -- 172.21.15.82:0/3094485688 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa00c8f80 con 0x7f5fa0070070 2023-11-28T13:07:52.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.902+0000 7f5f9d7fa700 1 -- 172.21.15.82:0/3094485688 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f90004040 con 0x7f5fa0070070 2023-11-28T13:07:52.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.902+0000 7f5fa5b18700 1 -- 172.21.15.82:0/3094485688 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa006c110 con 0x7f5fa0070070 2023-11-28T13:07:52.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.902+0000 7f5fa5b18700 1 -- 172.21.15.82:0/3094485688 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa006d860 con 0x7f5fa0070070 2023-11-28T13:07:52.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.902+0000 7f5f9d7fa700 1 -- 172.21.15.82:0/3094485688 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5f900041a0 con 0x7f5fa0070070 2023-11-28T13:07:52.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.902+0000 7f5f9d7fa700 1 --2- 172.21.15.82:0/3094485688 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5f8c064ee0 0x7f5f8c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:52.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.902+0000 7f5f9d7fa700 1 -- 172.21.15.82:0/3094485688 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5f90022070 con 0x7f5fa0070070 2023-11-28T13:07:52.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.902+0000 7f5fa4b16700 1 --2- 172.21.15.82:0/3094485688 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5f8c064ee0 0x7f5f8c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:52.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.902+0000 7f5fa4b16700 1 --2- 172.21.15.82:0/3094485688 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5f8c064ee0 0x7f5f8c067390 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5f94000f60 tx=0x7f5f94007e90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:52.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:52.906+0000 7f5f9d7fa700 1 -- 172.21.15.82:0/3094485688 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5f90052440 con 0x7f5fa0070070 2023-11-28T13:07:53.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.066+0000 7f5fa5b18700 1 -- 172.21.15.82:0/3094485688 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5fa0065fc0 con 0x7f5f8c064ee0 2023-11-28T13:07:53.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.070+0000 7f5f9d7fa700 1 -- 172.21.15.82:0/3094485688 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71390 (secure 0 0 0) 0x7f5fa0065fc0 con 0x7f5f8c064ee0 2023-11-28T13:07:53.080 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:07:53.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.074+0000 7f5fa5b18700 1 -- 172.21.15.82:0/3094485688 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5f8c064ee0 msgr2=0x7f5f8c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:53.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.074+0000 7f5fa5b18700 1 --2- 172.21.15.82:0/3094485688 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5f8c064ee0 0x7f5f8c067390 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5f94000f60 tx=0x7f5f94007e90 comp rx=0 tx=0).stop 2023-11-28T13:07:53.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.074+0000 7f5fa5b18700 1 -- 172.21.15.82:0/3094485688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fa0070070 msgr2=0x7f5fa0154af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:53.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.074+0000 7f5fa5b18700 1 --2- 172.21.15.82:0/3094485688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fa0070070 0x7f5fa0154af0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f5f90014040 tx=0x7f5f90004af0 comp rx=0 tx=0).stop 2023-11-28T13:07:53.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.074+0000 7f5fa5b18700 1 -- 172.21.15.82:0/3094485688 shutdown_connections 2023-11-28T13:07:53.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.074+0000 7f5fa5b18700 1 --2- 172.21.15.82:0/3094485688 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5f8c064ee0 0x7f5f8c067390 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:53.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.074+0000 7f5fa5b18700 1 --2- 172.21.15.82:0/3094485688 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fa00b3910 0x7f5fa014eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:53.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.074+0000 7f5fa5b18700 1 --2- 172.21.15.82:0/3094485688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fa0070070 0x7f5fa0154af0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:53.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.074+0000 7f5fa5b18700 1 --2- 172.21.15.82:0/3094485688 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5fa006b0a0 0x7f5fa00c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:53.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.074+0000 7f5fa5b18700 1 -- 172.21.15.82:0/3094485688 >> 172.21.15.82:0/3094485688 conn(0x7f5fa00ce600 msgr2=0x7f5fa00b26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:53.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.074+0000 7f5fa5b18700 1 -- 172.21.15.82:0/3094485688 shutdown_connections 2023-11-28T13:07:53.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.074+0000 7f5fa5b18700 1 -- 172.21.15.82:0/3094485688 wait complete. 2023-11-28T13:07:53.084 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:07:53.094 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2023-11-28T13:07:51.317607+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":88472,"kb_used_data":7640,"kb_used_omap":0,"kb_used_meta":80768,"kb_avail":754886248,"statfs":{"total":773094113280,"available":773003517952,"internally_reserved":0,"allocated":7823360,"data_stored":4123600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":82706432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12288,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-6,"num_read_kb":-5,"num_write":-76,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":-70,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002628"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":214,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:19.246350+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:06:19.246350+0000","last_peered":"2023-11-28T13:06:19.246350+0000","last_clean":"2023-11-28T13:06:19.246350+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:06:19.246350+0000","last_undegraded":"2023-11-28T13:06:19.246350+0000","last_fullsized":"2023-11-28T13:06:19.246350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":49,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:39.250917+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:06:39.250917+0000","last_peered":"2023-11-28T13:06:39.250917+0000","last_clean":"2023-11-28T13:06:39.250917+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:06:39.250917+0000","last_undegraded":"2023-11-28T13:06:39.250917+0000","last_fullsized":"2023-11-28T13:06:39.250917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:24.247427+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:06:24.247427+0000","last_peered":"2023-11-28T13:06:24.247427+0000","last_clean":"2023-11-28T13:06:24.247427+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:06:24.247427+0000","last_undegraded":"2023-11-28T13:06:24.247427+0000","last_fullsized":"2023-11-28T13:06:24.247427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:39.246301+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:06:39.246301+0000","last_peered":"2023-11-28T13:06:39.246301+0000","last_clean":"2023-11-28T13:06:39.246301+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:06:39.246301+0000","last_undegraded":"2023-11-28T13:06:39.246301+0000","last_fullsized":"2023-11-28T13:06:39.246301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:39.250867+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:06:39.250867+0000","last_peered":"2023-11-28T13:06:39.250867+0000","last_clean":"2023-11-28T13:06:39.250867+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:06:39.250867+0000","last_undegraded":"2023-11-28T13:06:39.250867+0000","last_fullsized":"2023-11-28T13:06:39.250867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:39.252305+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:06:39.252305+0000","last_peered":"2023-11-28T13:06:39.252305+0000","last_clean":"2023-11-28T13:06:39.252305+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:06:39.252305+0000","last_undegraded":"2023-11-28T13:06:39.252305+0000","last_fullsized":"2023-11-28T13:06:39.252305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:39.250439+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:06:39.250439+0000","last_peered":"2023-11-28T13:06:39.250439+0000","last_clean":"2023-11-28T13:06:39.250439+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:06:39.250439+0000","last_undegraded":"2023-11-28T13:06:39.250439+0000","last_fullsized":"2023-11-28T13:06:39.250439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:54.254780+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:06:54.254780+0000","last_peered":"2023-11-28T13:06:54.254780+0000","last_clean":"2023-11-28T13:06:54.254780+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:06:54.254780+0000","last_undegraded":"2023-11-28T13:06:54.254780+0000","last_fullsized":"2023-11-28T13:06:54.254780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-28T13:06:54.252746+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:06:54.252746+0000","last_peered":"2023-11-28T13:06:54.252746+0000","last_clean":"2023-11-28T13:06:54.252746+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:06:54.252746+0000","last_undegraded":"2023-11-28T13:06:54.252746+0000","last_fullsized":"2023-11-28T13:06:54.252746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574942,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15160,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":13760,"kb_avail":94356680,"statfs":{"total":96636764160,"available":96621240320,"internally_reserved":0,"allocated":1425408,"data_stored":955844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14090240},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.84999999999999998,"15min":0.82899999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2150000000000001,"5min":1.28,"15min":1.3859999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.85899999999999999,"15min":0.89200000000000002},"min":{"1min":0.65100000000000002,"5min":0.51200000000000001,"15min":0.5},"max":{"1min":1.196,"5min":1.2130000000000001,"15min":1.377},"last":0.96299999999999997}]},{"osd":1,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.86599999999999999,"15min":0.90100000000000002},"min":{"1min":0.63800000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.1839999999999999,"5min":1.2410000000000001,"15min":1.599},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.86699999999999999,"15min":0.91900000000000004},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.091,"5min":1.194,"15min":1.375},"last":1.0620000000000001}]},{"osd":2,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.85499999999999998,"15min":0.91000000000000003},"min":{"1min":0.61299999999999999,"5min":0.54100000000000004,"15min":0.53300000000000003},"max":{"1min":1.1559999999999999,"5min":1.198,"15min":2.9060000000000001},"last":1.018},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.94099999999999995,"15min":0.91800000000000004},"min":{"1min":0.63600000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1830000000000001,"5min":1.3109999999999999,"15min":1.6659999999999999},"last":0.84299999999999997}]},{"osd":3,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.89900000000000002,"15min":0.93200000000000005},"min":{"1min":0.625,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.26,"5min":1.26,"15min":1.6399999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.022,"5min":0.95399999999999996,"15min":0.93400000000000005},"min":{"1min":0.80400000000000005,"5min":0.72499999999999998,"15min":0.59799999999999998},"max":{"1min":1.2090000000000001,"5min":1.212,"15min":1.3660000000000001},"last":0.89600000000000002}]},{"osd":4,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.85599999999999998,"15min":0.95699999999999996},"min":{"1min":0.60799999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.135,"5min":1.1739999999999999,"15min":1.6819999999999999},"last":0.872},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.90700000000000003,"15min":0.94599999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1499999999999999,"5min":1.2649999999999999,"15min":1.409},"last":1.119}]},{"osd":5,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.91800000000000004,"15min":0.996},"min":{"1min":0.66700000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.282,"5min":1.282,"15min":1.466},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.99099999999999999,"15min":1.0680000000000001},"min":{"1min":0.71099999999999997,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.175,"5min":1.2589999999999999,"15min":1.5449999999999999},"last":1.139}]},{"osd":6,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0429999999999999,"15min":1.1379999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.68799999999999994},"max":{"1min":1.236,"5min":1.28,"15min":2.0630000000000002},"last":1.105},{"interface":"front","average":{"1min":1.048,"5min":1.042,"15min":1.1299999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.2450000000000001,"5min":1.407,"15min":1.794},"last":1.379}]}]},{"osd":6,"up_from":13,"seq":55834574943,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9516,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362324,"statfs":{"total":96636764160,"available":96627019776,"internally_reserved":0,"allocated":823296,"data_stored":364820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81000000000000005,"15min":0.82699999999999996},"min":{"1min":0.54400000000000004,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1000000000000001,"5min":1.23,"15min":1.5580000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.90500000000000003,"15min":0.86499999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.54100000000000004},"max":{"1min":1.1599999999999999,"5min":1.448,"15min":1.448},"last":0.754}]},{"osd":1,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.93600000000000005,"15min":0.88800000000000001},"min":{"1min":0.65300000000000002,"5min":0.59199999999999997,"15min":0.51900000000000002},"max":{"1min":1.25,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.143},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85599999999999998,"15min":0.86299999999999999},"min":{"1min":0.66900000000000004,"5min":0.59699999999999998,"15min":0.55900000000000005},"max":{"1min":1.0349999999999999,"5min":1.716,"15min":1.716},"last":0.96099999999999997}]},{"osd":2,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.878,"15min":0.88100000000000001},"min":{"1min":0.60599999999999998,"5min":0.505,"15min":0.505},"max":{"1min":1.1319999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93700000000000006,"15min":0.90600000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.175,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.101}]},{"osd":3,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.88,"15min":0.88100000000000001},"min":{"1min":0.68300000000000005,"5min":0.57399999999999995,"15min":0.53300000000000003},"max":{"1min":1.149,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96399999999999997,"15min":0.97199999999999998},"min":{"1min":0.69399999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1950000000000001,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.879}]},{"osd":4,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.94299999999999995,"15min":0.94699999999999995},"min":{"1min":0.61599999999999999,"5min":0.60999999999999999,"15min":0.59699999999999998},"max":{"1min":1.3,"5min":1.746,"15min":1.8049999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.96399999999999997,"15min":1.3140000000000001},"min":{"1min":0.72499999999999998,"5min":0.63500000000000001,"15min":0.629},"max":{"1min":1.228,"5min":1.2969999999999999,"15min":10.566000000000001},"last":0.66200000000000003}]},{"osd":5,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":1.006,"15min":1.0580000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3069999999999999,"5min":2.048,"15min":2.048},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.042,"5min":1.1120000000000001,"15min":1.095},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.325,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":0.90600000000000003}]},{"osd":7,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.044,"15min":1.1779999999999999},"min":{"1min":0.78400000000000003,"5min":0.751,"15min":0.74299999999999999},"max":{"1min":1.208,"5min":1.367,"15min":3.4980000000000002},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.141,"15min":1.264},"min":{"1min":0.98899999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.3759999999999999,"5min":1.7669999999999999,"15min":3.593},"last":1.0409999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574944,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9708,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362132,"statfs":{"total":96636764160,"available":96626823168,"internally_reserved":0,"allocated":823296,"data_stored":364808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.82099999999999995,"15min":0.81799999999999995},"min":{"1min":0.60899999999999999,"5min":0.53700000000000003,"15min":0.502},"max":{"1min":1.054,"5min":1.171,"15min":1.171},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.876,"15min":0.83899999999999997},"min":{"1min":0.68400000000000005,"5min":0.55400000000000005,"15min":0.48399999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.2589999999999999}]},{"osd":1,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.84699999999999998,"15min":0.83099999999999996},"min":{"1min":0.66000000000000003,"5min":0.48999999999999999,"15min":0.46000000000000002},"max":{"1min":1.077,"5min":1.1919999999999999,"15min":1.274},"last":1.302},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.86899999999999999,"15min":0.82099999999999995},"min":{"1min":0.54600000000000004,"5min":0.434,"15min":0.434},"max":{"1min":1.173,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.0700000000000001}]},{"osd":2,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.88300000000000001,"15min":0.83599999999999997},"min":{"1min":0.67800000000000005,"5min":0.59599999999999997,"15min":0.45500000000000002},"max":{"1min":1.212,"5min":1.395,"15min":1.395},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.89400000000000002,"15min":0.92300000000000004},"min":{"1min":0.66200000000000003,"5min":0.55700000000000005,"15min":0.53000000000000003},"max":{"1min":1.198,"5min":1.26,"15min":1.3560000000000001},"last":1.034}]},{"osd":3,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.93999999999999995,"15min":0.89600000000000002},"min":{"1min":0.70299999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.014,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.82399999999999995,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2210000000000001,"5min":1.365,"15min":1.403},"last":1.208}]},{"osd":4,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.86899999999999999,"15min":0.88200000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.40699999999999997},"max":{"1min":1.246,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.97899999999999998,"15min":0.96699999999999997},"min":{"1min":0.56899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.444,"5min":1.5189999999999999,"15min":4.3300000000000001},"last":1.4099999999999999}]},{"osd":6,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97299999999999998,"15min":1.0089999999999999},"min":{"1min":0.68799999999999994,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.224,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0660000000000001,"15min":1.0409999999999999},"min":{"1min":0.82899999999999996,"5min":0.70599999999999996,"15min":0.59299999999999997},"max":{"1min":1.3129999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.3380000000000001}]},{"osd":7,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.1000000000000001,"15min":1.0629999999999999},"min":{"1min":0.73399999999999999,"5min":0.58399999999999996,"15min":0.56599999999999995},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":4.234},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.101,"15min":1.1259999999999999},"min":{"1min":0.77900000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2989999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.377}]}]},{"osd":4,"up_from":13,"seq":55834574943,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9916,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361924,"statfs":{"total":96636764160,"available":96626610176,"internally_reserved":0,"allocated":839680,"data_stored":376292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.86099999999999999,"15min":0.82799999999999996},"min":{"1min":0.58899999999999997,"5min":0.57999999999999996,"15min":0.53600000000000003},"max":{"1min":1.107,"5min":1.1699999999999999,"15min":1.2589999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.84399999999999997,"15min":0.82299999999999995},"min":{"1min":0.69499999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2150000000000001,"5min":1.429,"15min":1.429},"last":0.77400000000000002}]},{"osd":1,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81799999999999995,"15min":0.81699999999999995},"min":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.54300000000000004},"max":{"1min":1.038,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":1.177},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.88800000000000001,"15min":0.876},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0700000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.70799999999999996}]},{"osd":2,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.82499999999999996,"15min":0.83499999999999996},"min":{"1min":0.65200000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.002,"5min":1.296,"15min":1.357},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.90500000000000003,"15min":0.89300000000000002},"min":{"1min":0.65600000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1339999999999999,"5min":1.2270000000000001,"15min":1.2549999999999999},"last":1}]},{"osd":3,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.90600000000000003,"15min":0.88500000000000001},"min":{"1min":0.64900000000000002,"5min":0.64300000000000002,"15min":0.61899999999999999},"max":{"1min":1.1519999999999999,"5min":1.252,"15min":1.252},"last":1.048},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.98099999999999998,"15min":0.98799999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.66400000000000003},"max":{"1min":1.1619999999999999,"5min":1.222,"15min":1.474},"last":0.86799999999999999}]},{"osd":5,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.85499999999999998,"15min":0.88700000000000001},"min":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.53400000000000003},"max":{"1min":1.0369999999999999,"5min":1.2809999999999999,"15min":1.4590000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.94099999999999995,"15min":0.97599999999999998},"min":{"1min":0.68200000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2490000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.81799999999999995}]},{"osd":6,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.92600000000000005,"15min":0.997},"min":{"1min":0.65500000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.093,"5min":1.657,"15min":1.657},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.026,"15min":1.0629999999999999},"min":{"1min":0.77000000000000002,"5min":0.62,"15min":0.62},"max":{"1min":1.135,"5min":1.4690000000000001,"15min":1.5149999999999999},"last":1.23}]},{"osd":7,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.034,"15min":1.073},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.296,"5min":1.389,"15min":1.526},"last":1.147},{"interface":"front","average":{"1min":1.071,"5min":1.0960000000000001,"15min":1.133},"min":{"1min":0.82299999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.258,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.98899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574942,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9896,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361944,"statfs":{"total":96636764160,"available":96626630656,"internally_reserved":0,"allocated":819200,"data_stored":364786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.629,"15min":0.60999999999999999},"min":{"1min":0.48299999999999998,"5min":0.41399999999999998,"15min":0.39400000000000002},"max":{"1min":1.0049999999999999,"5min":1.0840000000000001,"15min":1.0900000000000001},"last":0.621},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.54100000000000004,"5min":0.45100000000000001,"15min":0.43099999999999999},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.58199999999999996}]},{"osd":1,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.496,"5min":0.45500000000000002,"15min":0.32500000000000001},"max":{"1min":0.93899999999999995,"5min":1.0129999999999999,"15min":1.1890000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77400000000000002,"15min":0.76400000000000001},"min":{"1min":0.55600000000000005,"5min":0.48399999999999999,"15min":0.441},"max":{"1min":0.93200000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.71199999999999997}]},{"osd":2,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76400000000000001,"15min":0.749},"min":{"1min":0.49099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0129999999999999,"5min":1.028,"15min":1.2989999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.83699999999999997,"15min":0.83099999999999996},"min":{"1min":0.71799999999999997,"5min":0.52400000000000002,"15min":0.438},"max":{"1min":1.0720000000000001,"5min":1.1659999999999999,"15min":1.4550000000000001},"last":0.85399999999999998}]},{"osd":4,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.90800000000000003,"15min":0.96599999999999997},"min":{"1min":0.80900000000000005,"5min":0.65200000000000002,"15min":0.63100000000000001},"max":{"1min":1.2569999999999999,"5min":1.3400000000000001,"15min":1.405},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.98199999999999998,"15min":1.0249999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.57899999999999996},"max":{"1min":1.2929999999999999,"5min":1.3620000000000001,"15min":1.7150000000000001},"last":0.76500000000000001}]},{"osd":5,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.97499999999999998,"15min":1.034},"min":{"1min":0.79300000000000004,"5min":0.64400000000000002,"15min":0.57399999999999995},"max":{"1min":1.26,"5min":1.518,"15min":1.5549999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.044,"15min":1.075},"min":{"1min":0.91700000000000004,"5min":0.76400000000000001,"15min":0.73799999999999999},"max":{"1min":1.329,"5min":1.5449999999999999,"15min":1.6639999999999999},"last":0.96299999999999997}]},{"osd":6,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.02,"15min":1.069},"min":{"1min":0.89200000000000002,"5min":0.72699999999999998,"15min":0.55600000000000005},"max":{"1min":1.3420000000000001,"5min":1.371,"15min":1.446},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0700000000000001,"15min":1.0980000000000001},"min":{"1min":0.75600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3360000000000001,"5min":1.45,"15min":1.6220000000000001},"last":0.91700000000000004}]},{"osd":7,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1120000000000001,"15min":1.141},"min":{"1min":0.99099999999999999,"5min":0.85699999999999998,"15min":0.67900000000000005},"max":{"1min":1.4019999999999999,"5min":1.488,"15min":1.5669999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.073,"15min":1.141},"min":{"1min":0.879,"5min":0.77200000000000002,"15min":0.67100000000000004},"max":{"1min":1.3069999999999999,"5min":1.534,"15min":1.6499999999999999},"last":0.94599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9644,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362196,"statfs":{"total":96636764160,"available":96626888704,"internally_reserved":0,"allocated":823296,"data_stored":364856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77400000000000002,"5min":0.94999999999999996,"15min":0.997},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71299999999999997,"15min":0.64800000000000002},"min":{"1min":0.52200000000000002,"5min":0.39400000000000002,"15min":0.38500000000000001},"max":{"1min":0.96699999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.69699999999999995}]},{"osd":1,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64600000000000002,"15min":0.628},"min":{"1min":0.45000000000000001,"5min":0.378,"15min":0.36199999999999999},"max":{"1min":0.85599999999999998,"5min":0.997,"15min":1.123},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72299999999999998,"15min":0.68999999999999995},"min":{"1min":0.56499999999999995,"5min":0.45600000000000002,"15min":0.44400000000000001},"max":{"1min":0.90000000000000002,"5min":1.0009999999999999,"15min":1.0569999999999999},"last":0.54100000000000004}]},{"osd":3,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80900000000000005,"15min":0.751},"min":{"1min":0.61399999999999999,"5min":0.46000000000000002,"15min":0.317},"max":{"1min":1.079,"5min":1.143,"15min":1.1599999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76700000000000002,"15min":0.75},"min":{"1min":0.54900000000000004,"5min":0.436,"15min":0.34000000000000002},"max":{"1min":0.93400000000000005,"5min":1.222,"15min":1.222},"last":0.73999999999999999}]},{"osd":4,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.93500000000000005,"15min":0.92100000000000004},"min":{"1min":0.80600000000000005,"5min":0.64800000000000002,"15min":0.498},"max":{"1min":1.1639999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.998,"5min":1.0029999999999999,"15min":1.004},"min":{"1min":0.86699999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1599999999999999,"5min":1.3,"15min":1.4159999999999999},"last":1.1319999999999999}]},{"osd":5,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94299999999999995,"15min":0.95099999999999996},"min":{"1min":0.70199999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.226,"5min":1.343,"15min":1.4430000000000001},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.022,"15min":1},"min":{"1min":0.71099999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.407,"5min":1.643,"15min":1.6830000000000001},"last":1.3100000000000001}]},{"osd":6,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.024,"15min":1.0329999999999999},"min":{"1min":0.78700000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.3260000000000001,"5min":1.6060000000000001,"15min":1.8240000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.018,"15min":1.006},"min":{"1min":0.71899999999999997,"5min":0.67900000000000005,"15min":0.55400000000000005},"max":{"1min":1.224,"5min":1.54,"15min":1.54},"last":0.89900000000000002}]},{"osd":7,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0700000000000001,"15min":1.0640000000000001},"min":{"1min":0.77000000000000002,"5min":0.74399999999999999,"15min":0.57199999999999995},"max":{"1min":1.276,"5min":1.5069999999999999,"15min":1.5980000000000001},"last":1.292},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.147,"15min":1.1160000000000001},"min":{"1min":0.83399999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3640000000000001,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":1.246}]}]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9740,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362100,"statfs":{"total":96636764160,"available":96626790400,"internally_reserved":0,"allocated":856064,"data_stored":377040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.624,"15min":0.63900000000000001},"min":{"1min":0.502,"5min":0.38700000000000001,"15min":0.314},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68600000000000005,"15min":0.68100000000000005},"min":{"1min":0.52500000000000002,"5min":0.39500000000000002,"15min":0.318},"max":{"1min":1.0629999999999999,"5min":1.1040000000000001,"15min":1.181},"last":0.624}]},{"osd":2,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.54500000000000004,"5min":0.42699999999999999,"15min":0.38500000000000001},"max":{"1min":1.208,"5min":1.2230000000000001,"15min":1.3009999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.75900000000000001,"15min":0.75600000000000001},"min":{"1min":0.55600000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1200000000000001,"5min":1.228,"15min":1.409},"last":0.54100000000000004}]},{"osd":3,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.871,"15min":0.83999999999999997},"min":{"1min":0.626,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.246,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.80700000000000005,"15min":0.76200000000000001},"min":{"1min":0.66600000000000004,"5min":0.46300000000000002,"15min":0.435},"max":{"1min":1.036,"5min":1.1240000000000001,"15min":1.2529999999999999},"last":0.66300000000000003}]},{"osd":4,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.97599999999999998,"15min":0.98599999999999999},"min":{"1min":0.81699999999999995,"5min":0.66600000000000004,"15min":0.61899999999999999},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92500000000000004,"15min":0.93500000000000005},"min":{"1min":0.73199999999999998,"5min":0.64100000000000001,"15min":0.52000000000000002},"max":{"1min":1.1060000000000001,"5min":1.3049999999999999,"15min":2.1309999999999998},"last":0.77400000000000002}]},{"osd":5,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0029999999999999,"15min":0.98399999999999999},"min":{"1min":0.80200000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.95999999999999996,"15min":1.0189999999999999},"min":{"1min":0.88200000000000001,"5min":0.63100000000000001,"15min":0.60799999999999998},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":2.004},"last":0.874}]},{"osd":6,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97799999999999998,"15min":0.996},"min":{"1min":0.78400000000000003,"5min":0.63600000000000001,"15min":0.61499999999999999},"max":{"1min":1.3109999999999999,"5min":1.3660000000000001,"15min":1.889},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.129,"5min":1.087,"15min":1.1000000000000001},"min":{"1min":0.93300000000000005,"5min":0.745,"15min":0.64400000000000002},"max":{"1min":1.5389999999999999,"5min":1.6739999999999999,"15min":1.9610000000000001},"last":0.752}]},{"osd":7,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.0840000000000001,"15min":1.089},"min":{"1min":0.81200000000000006,"5min":0.629,"15min":0.629},"max":{"1min":1.5149999999999999,"5min":1.6200000000000001,"15min":1.766},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.0569999999999999,"15min":1.0980000000000001},"min":{"1min":0.91500000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":2.0470000000000002},"last":0.82699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574944,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14892,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":13504,"kb_avail":94356948,"statfs":{"total":96636764160,"available":96621514752,"internally_reserved":0,"allocated":1413120,"data_stored":955154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13828096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65600000000000003,"15min":0.64000000000000001},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.35099999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71099999999999997,"15min":0.66400000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.36699999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.198},"last":0.61099999999999999}]},{"osd":2,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.74099999999999999,"15min":0.71799999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.28599999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.73599999999999999,"15min":0.71699999999999997},"min":{"1min":0.55800000000000005,"5min":0.434,"15min":0.34399999999999997},"max":{"1min":1.099,"5min":1.099,"15min":1.143},"last":0.77900000000000003}]},{"osd":3,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70399999999999996,"15min":0.68700000000000006},"min":{"1min":0.52700000000000002,"5min":0.41299999999999998,"15min":0.39200000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.298},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.83799999999999997,"15min":0.84299999999999997},"min":{"1min":0.66300000000000003,"5min":0.54700000000000004,"15min":0.32100000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.629},"last":0.746}]},{"osd":4,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.71499999999999997,"5min":0.69999999999999996,"15min":0.68700000000000006},"max":{"1min":1.153,"5min":1.341,"15min":1.341},"last":0.88},{"interface":"front","average":{"1min":1.01,"5min":0.98099999999999998,"15min":0.96499999999999997},"min":{"1min":0.83699999999999997,"5min":0.73599999999999999,"15min":0.56100000000000005},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.82899999999999996}]},{"osd":5,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97299999999999998,"15min":0.98399999999999999},"min":{"1min":0.755,"5min":0.71699999999999997,"15min":0.65800000000000003},"max":{"1min":1.2170000000000001,"5min":1.337,"15min":1.895},"last":1.01},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.96299999999999997,"15min":0.94699999999999995},"min":{"1min":0.90300000000000002,"5min":0.76200000000000001,"15min":0.68899999999999995},"max":{"1min":1.1879999999999999,"5min":1.3009999999999999,"15min":1.319},"last":0.80300000000000005}]},{"osd":6,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0580000000000001,"15min":1.0509999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.70299999999999996},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.034},{"interface":"front","average":{"1min":1.05,"5min":1.0640000000000001,"15min":1.0760000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.75800000000000001},"max":{"1min":1.3149999999999999,"5min":1.4950000000000001,"15min":2.1059999999999999},"last":1.163}]},{"osd":7,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.075,"15min":1.099},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.329,"5min":1.4330000000000001,"15min":2.1869999999999998},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0409999999999999,"15min":1.0229999999999999},"min":{"1min":0.83199999999999996,"5min":0.748,"15min":0.60899999999999999},"max":{"1min":1.2789999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.054}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:07:53.096 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T13:07:53.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.202+0000 7f94a18a7700 1 Processor -- start 2023-11-28T13:07:53.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.202+0000 7f94a18a7700 1 -- start start 2023-11-28T13:07:53.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.202+0000 7f94a18a7700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f949c0ced70 0x7f949c06bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:53.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.202+0000 7f94a18a7700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f949c0d06f0 0x7f949c0d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:53.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.202+0000 7f94a18a7700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949c0d28e0 con 0x7f949c06b910 2023-11-28T13:07:53.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.202+0000 7f94a18a7700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f949c0cdfe0 con 0x7f949c0ced70 2023-11-28T13:07:53.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.202+0000 7f94a18a7700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949c06c220 con 0x7f949c0d06f0 2023-11-28T13:07:53.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.202+0000 7f949bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f949c0ced70 0x7f949c06bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:53.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.202+0000 7f949bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f949c0ced70 0x7f949c06bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50430/0 (socket says 172.21.15.82:50430) 2023-11-28T13:07:53.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.202+0000 7f949bfff700 1 -- 172.21.15.82:0/515666058 learned_addr learned my addr 172.21.15.82:0/515666058 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:53.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.202+0000 7f94a10a6700 1 --2- 172.21.15.82:0/515666058 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f949c0d06f0 0x7f949c0d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:53.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.202+0000 7f949bfff700 1 -- 172.21.15.82:0/515666058 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f949c0d06f0 msgr2=0x7f949c0d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:53.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.202+0000 7f949bfff700 1 --2- 172.21.15.82:0/515666058 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f949c0d06f0 0x7f949c0d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:53.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.202+0000 7f949bfff700 1 -- 172.21.15.82:0/515666058 >> v1:172.21.15.82:6789/0 conn(0x7f949c06b910 legacy=0x7f949c160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:53.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.202+0000 7f949b7fe700 1 -- 172.21.15.82:0/515666058 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008363937 0 0) 0x7f948c001110 con 0x7f949c06b910 2023-11-28T13:07:53.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.202+0000 7f949bfff700 1 -- 172.21.15.82:0/515666058 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c0b2040 con 0x7f949c0ced70 2023-11-28T13:07:53.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.202+0000 7f949bfff700 1 --2- 172.21.15.82:0/515666058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c0ced70 0x7f949c06bce0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f9484009e50 tx=0x7f948400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d70d33b7eb64a9d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:53.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.202+0000 7f949b7fe700 1 -- 172.21.15.82:0/515666058 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948400e070 con 0x7f949c0ced70 2023-11-28T13:07:53.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.202+0000 7f949b7fe700 1 -- 172.21.15.82:0/515666058 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948400b9c0 con 0x7f949c0ced70 2023-11-28T13:07:53.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.202+0000 7f949b7fe700 1 -- 172.21.15.82:0/515666058 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948400bd70 con 0x7f949c0ced70 2023-11-28T13:07:53.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a18a7700 1 -- 172.21.15.82:0/515666058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c0ced70 msgr2=0x7f949c06bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:53.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a18a7700 1 --2- 172.21.15.82:0/515666058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c0ced70 0x7f949c06bce0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f9484009e50 tx=0x7f948400b330 comp rx=0 tx=0).stop 2023-11-28T13:07:53.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a18a7700 1 -- 172.21.15.82:0/515666058 shutdown_connections 2023-11-28T13:07:53.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a18a7700 1 --2- 172.21.15.82:0/515666058 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f949c0d06f0 0x7f949c0d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:53.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a18a7700 1 --2- 172.21.15.82:0/515666058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c0ced70 0x7f949c06bce0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:53.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a18a7700 1 -- 172.21.15.82:0/515666058 >> 172.21.15.82:0/515666058 conn(0x7f949c0d2b20 msgr2=0x7f949c0d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:53.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a18a7700 1 -- 172.21.15.82:0/515666058 shutdown_connections 2023-11-28T13:07:53.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a18a7700 1 -- 172.21.15.82:0/515666058 wait complete. 2023-11-28T13:07:53.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a18a7700 1 Processor -- start 2023-11-28T13:07:53.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a18a7700 1 -- start start 2023-11-28T13:07:53.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a18a7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c06b910 0x7f949c157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:53.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a18a7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f949c0ced70 0x7f949c0b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:53.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a18a7700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f949c0d06f0 0x7f949c158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:53.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a18a7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c0cb1a0 con 0x7f949c06b910 2023-11-28T13:07:53.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a18a7700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c0cb480 con 0x7f949c0ced70 2023-11-28T13:07:53.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a18a7700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949c0cb760 con 0x7f949c0d06f0 2023-11-28T13:07:53.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a08a5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c06b910 0x7f949c157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:53.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f949bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f949c0ced70 0x7f949c0b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:53.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a08a5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c06b910 0x7f949c157ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50446/0 (socket says 172.21.15.82:50446) 2023-11-28T13:07:53.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a08a5700 1 -- 172.21.15.82:0/787054394 learned_addr learned my addr 172.21.15.82:0/787054394 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:53.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a10a6700 1 --2- 172.21.15.82:0/787054394 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f949c0d06f0 0x7f949c158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:53.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a08a5700 1 -- 172.21.15.82:0/787054394 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f949c0d06f0 msgr2=0x7f949c158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:53.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a08a5700 1 --2- 172.21.15.82:0/787054394 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f949c0d06f0 0x7f949c158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:53.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a08a5700 1 -- 172.21.15.82:0/787054394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f949c0ced70 msgr2=0x7f949c0b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:53.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a08a5700 1 --2- 172.21.15.82:0/787054394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f949c0ced70 0x7f949c0b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:53.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a08a5700 1 -- 172.21.15.82:0/787054394 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9484009b30 con 0x7f949c06b910 2023-11-28T13:07:53.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94a08a5700 1 --2- 172.21.15.82:0/787054394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c06b910 0x7f949c157ff0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f948c00c520 tx=0x7f948c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:53.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94997fa700 1 -- 172.21.15.82:0/787054394 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c0054e0 con 0x7f949c06b910 2023-11-28T13:07:53.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.206+0000 7f94997fa700 1 -- 172.21.15.82:0/787054394 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948c0036a0 con 0x7f949c06b910 2023-11-28T13:07:53.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.210+0000 7f94997fa700 1 -- 172.21.15.82:0/787054394 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c003a50 con 0x7f949c06b910 2023-11-28T13:07:53.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.210+0000 7f94a18a7700 1 -- 172.21.15.82:0/787054394 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949c0d2320 con 0x7f949c06b910 2023-11-28T13:07:53.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.210+0000 7f94a18a7700 1 -- 172.21.15.82:0/787054394 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949c0cf2c0 con 0x7f949c06b910 2023-11-28T13:07:53.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.210+0000 7f94a18a7700 1 -- 172.21.15.82:0/787054394 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949c0d2600 con 0x7f949c06b910 2023-11-28T13:07:53.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.210+0000 7f94997fa700 1 -- 172.21.15.82:0/787054394 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f948c019030 con 0x7f949c06b910 2023-11-28T13:07:53.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.210+0000 7f94997fa700 1 --2- 172.21.15.82:0/787054394 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9480064ee0 0x7f9480067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:53.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.210+0000 7f949bfff700 1 --2- 172.21.15.82:0/787054394 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9480064ee0 0x7f9480067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:53.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.210+0000 7f94997fa700 1 -- 172.21.15.82:0/787054394 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f948c080c40 con 0x7f949c06b910 2023-11-28T13:07:53.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.210+0000 7f949bfff700 1 --2- 172.21.15.82:0/787054394 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9480064ee0 0x7f9480067390 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9484009e50 tx=0x7f9484009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.218+0000 7f94997fa700 1 -- 172.21.15.82:0/787054394 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f948c086020 con 0x7f949c06b910 2023-11-28T13:07:53.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.382+0000 7f94a18a7700 1 -- 172.21.15.82:0/787054394 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f949c0d28e0 con 0x7f949c06b910 2023-11-28T13:07:53.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.386+0000 7f94997fa700 1 -- 172.21.15.82:0/787054394 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+14301 (secure 0 0 0) 0x7f949c0d28e0 con 0x7f949c06b910 2023-11-28T13:07:53.391 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:07:53.392 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":70,"fsid":"aef8a97f-1d6c-4a2b-9410-16861b3e9e35","created":"2023-11-28T13:00:01.865785+0000","modified":"2023-11-28T13:07:50.434813+0000","last_up_change":"2023-11-28T13:00:13.370415+0000","last_in_change":"2023-11-28T13:00:04.037126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T13:00:15.214655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T13:00:19.939981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f0346359-05e2-462a-835a-2a98ce816643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":36629},{"type":"v1","addr":"172.21.15.82:6817","nonce":36629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":36629},{"type":"v1","addr":"172.21.15.82:6819","nonce":36629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":36629},{"type":"v1","addr":"172.21.15.82:6823","nonce":36629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":36629},{"type":"v1","addr":"172.21.15.82:6821","nonce":36629}]},"public_addr":"172.21.15.82:6817/36629","cluster_addr":"172.21.15.82:6819/36629","heartbeat_back_addr":"172.21.15.82:6823/36629","heartbeat_front_addr":"172.21.15.82:6821/36629","state":["exists","up"]},{"osd":1,"uuid":"d796feec-c9a1-4ef0-999a-fd6ecd844f39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":36628},{"type":"v1","addr":"172.21.15.82:6809","nonce":36628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":36628},{"type":"v1","addr":"172.21.15.82:6811","nonce":36628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":36628},{"type":"v1","addr":"172.21.15.82:6815","nonce":36628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":36628},{"type":"v1","addr":"172.21.15.82:6813","nonce":36628}]},"public_addr":"172.21.15.82:6809/36628","cluster_addr":"172.21.15.82:6811/36628","heartbeat_back_addr":"172.21.15.82:6815/36628","heartbeat_front_addr":"172.21.15.82:6813/36628","state":["exists","up"]},{"osd":2,"uuid":"d5527c57-1b08-46b1-a9ca-237581f84c3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":36636},{"type":"v1","addr":"172.21.15.82:6825","nonce":36636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":36636},{"type":"v1","addr":"172.21.15.82:6827","nonce":36636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":36636},{"type":"v1","addr":"172.21.15.82:6831","nonce":36636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":36636},{"type":"v1","addr":"172.21.15.82:6829","nonce":36636}]},"public_addr":"172.21.15.82:6825/36636","cluster_addr":"172.21.15.82:6827/36636","heartbeat_back_addr":"172.21.15.82:6831/36636","heartbeat_front_addr":"172.21.15.82:6829/36636","state":["exists","up"]},{"osd":3,"uuid":"2fc42c69-ef00-4571-8936-19e4a078f577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":36627},{"type":"v1","addr":"172.21.15.82:6801","nonce":36627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":36627},{"type":"v1","addr":"172.21.15.82:6803","nonce":36627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":36627},{"type":"v1","addr":"172.21.15.82:6807","nonce":36627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":36627},{"type":"v1","addr":"172.21.15.82:6805","nonce":36627}]},"public_addr":"172.21.15.82:6801/36627","cluster_addr":"172.21.15.82:6803/36627","heartbeat_back_addr":"172.21.15.82:6807/36627","heartbeat_front_addr":"172.21.15.82:6805/36627","state":["exists","up"]},{"osd":4,"uuid":"e75dc42f-d78f-44f0-8660-c8c0bd22520f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":36803},{"type":"v1","addr":"172.21.15.114:6801","nonce":36803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":36803},{"type":"v1","addr":"172.21.15.114:6803","nonce":36803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":36803},{"type":"v1","addr":"172.21.15.114:6807","nonce":36803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":36803},{"type":"v1","addr":"172.21.15.114:6805","nonce":36803}]},"public_addr":"172.21.15.114:6801/36803","cluster_addr":"172.21.15.114:6803/36803","heartbeat_back_addr":"172.21.15.114:6807/36803","heartbeat_front_addr":"172.21.15.114:6805/36803","state":["exists","up"]},{"osd":5,"uuid":"a5a1c7bb-1023-4612-b514-c08962299656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":36804},{"type":"v1","addr":"172.21.15.114:6809","nonce":36804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":36804},{"type":"v1","addr":"172.21.15.114:6811","nonce":36804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":36804},{"type":"v1","addr":"172.21.15.114:6815","nonce":36804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":36804},{"type":"v1","addr":"172.21.15.114:6813","nonce":36804}]},"public_addr":"172.21.15.114:6809/36804","cluster_addr":"172.21.15.114:6811/36804","heartbeat_back_addr":"172.21.15.114:6815/36804","heartbeat_front_addr":"172.21.15.114:6813/36804","state":["exists","up"]},{"osd":6,"uuid":"d0fd94dd-a682-4b21-866a-9a1c6dd593bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":36805},{"type":"v1","addr":"172.21.15.114:6825","nonce":36805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":36805},{"type":"v1","addr":"172.21.15.114:6827","nonce":36805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":36805},{"type":"v1","addr":"172.21.15.114:6831","nonce":36805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":36805},{"type":"v1","addr":"172.21.15.114:6829","nonce":36805}]},"public_addr":"172.21.15.114:6825/36805","cluster_addr":"172.21.15.114:6827/36805","heartbeat_back_addr":"172.21.15.114:6831/36805","heartbeat_front_addr":"172.21.15.114:6829/36805","state":["exists","up"]},{"osd":7,"uuid":"72e4a428-ed3b-4d32-875f-b1cbb9eefced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":36806},{"type":"v1","addr":"172.21.15.114:6817","nonce":36806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":36806},{"type":"v1","addr":"172.21.15.114:6819","nonce":36806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":36806},{"type":"v1","addr":"172.21.15.114:6823","nonce":36806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":36806},{"type":"v1","addr":"172.21.15.114:6821","nonce":36806}]},"public_addr":"172.21.15.114:6817/36806","cluster_addr":"172.21.15.114:6819/36806","heartbeat_back_addr":"172.21.15.114:6823/36806","heartbeat_front_addr":"172.21.15.114:6821/36806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.407488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.192250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.600212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.305695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.294309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.553109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.565749+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T13:00:09.389584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6837/2902091405":"2023-11-29T13:07:46.601143+0000","172.21.15.82:6836/2902091405":"2023-11-29T13:07:46.601143+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T13:07:53.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.386+0000 7f94a18a7700 1 -- 172.21.15.82:0/787054394 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9480064ee0 msgr2=0x7f9480067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:53.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.386+0000 7f94a18a7700 1 --2- 172.21.15.82:0/787054394 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9480064ee0 0x7f9480067390 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9484009e50 tx=0x7f9484009000 comp rx=0 tx=0).stop 2023-11-28T13:07:53.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.386+0000 7f94a18a7700 1 -- 172.21.15.82:0/787054394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c06b910 msgr2=0x7f949c157ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:53.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.386+0000 7f94a18a7700 1 --2- 172.21.15.82:0/787054394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c06b910 0x7f949c157ff0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f948c00c520 tx=0x7f948c00c830 comp rx=0 tx=0).stop 2023-11-28T13:07:53.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.386+0000 7f94a18a7700 1 -- 172.21.15.82:0/787054394 shutdown_connections 2023-11-28T13:07:53.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.386+0000 7f94a18a7700 1 --2- 172.21.15.82:0/787054394 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9480064ee0 0x7f9480067390 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:53.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.386+0000 7f94a18a7700 1 --2- 172.21.15.82:0/787054394 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f949c0d06f0 0x7f949c158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:53.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.386+0000 7f94a18a7700 1 --2- 172.21.15.82:0/787054394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f949c0ced70 0x7f949c0b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:53.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.386+0000 7f94a18a7700 1 --2- 172.21.15.82:0/787054394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c06b910 0x7f949c157ff0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:53.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.386+0000 7f94a18a7700 1 -- 172.21.15.82:0/787054394 >> 172.21.15.82:0/787054394 conn(0x7f949c0d2b20 msgr2=0x7f949c15ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:53.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.386+0000 7f94a18a7700 1 -- 172.21.15.82:0/787054394 shutdown_connections 2023-11-28T13:07:53.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:53.386+0000 7f94a18a7700 1 -- 172.21.15.82:0/787054394 wait complete. 2023-11-28T13:07:54.408 INFO:tasks.ceph:Scrubbing osd.0 2023-11-28T13:07:54.408 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-28T13:07:54.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270f34f700 1 Processor -- start 2023-11-28T13:07:54.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270f34f700 1 -- start start 2023-11-28T13:07:54.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270f34f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f270806a460 0x7f27081648a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:54.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270f34f700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27080c8bc0 con 0x7f27081604b0 2023-11-28T13:07:54.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270f34f700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27080c8e10 con 0x7f27080caec0 2023-11-28T13:07:54.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270f34f700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27080c90f0 con 0x7f270806a460 2023-11-28T13:07:54.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270e34d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f27081604b0 0x7f27080ca6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52606/0 (socket says 172.21.15.82:52606) 2023-11-28T13:07:54.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270e34d700 1 -- 172.21.15.82:0/2189875168 learned_addr learned my addr 172.21.15.82:0/2189875168 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:54.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270db4c700 1 --2- 172.21.15.82:0/2189875168 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f270806a460 0x7f27081648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:54.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270d34b700 1 -- 172.21.15.82:0/2189875168 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310918777 0 0) 0x7f27080c8bc0 con 0x7f27081604b0 2023-11-28T13:07:54.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270d34b700 1 -- 172.21.15.82:0/2189875168 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26f40035d0 con 0x7f27081604b0 2023-11-28T13:07:54.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270d34b700 1 -- 172.21.15.82:0/2189875168 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3766426055 0 0) 0x7f26f40035d0 con 0x7f27081604b0 2023-11-28T13:07:54.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270d34b700 1 -- 172.21.15.82:0/2189875168 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f270806a460 msgr2=0x7f27081648a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:54.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270d34b700 1 --2- 172.21.15.82:0/2189875168 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f270806a460 0x7f27081648a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:54.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270d34b700 1 -- 172.21.15.82:0/2189875168 >> v1:172.21.15.114:6789/0 conn(0x7f27080caec0 legacy=0x7f27080cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:54.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270d34b700 1 -- 172.21.15.82:0/2189875168 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27081640a0 con 0x7f27081604b0 2023-11-28T13:07:54.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270d34b700 1 -- 172.21.15.82:0/2189875168 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f26f8001670 con 0x7f27081604b0 2023-11-28T13:07:54.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270d34b700 1 -- 172.21.15.82:0/2189875168 >> v1:172.21.15.82:6789/0 conn(0x7f27081604b0 legacy=0x7f27080ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:54.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270d34b700 1 --2- 172.21.15.82:0/2189875168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26f4003a50 0x7f26f4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:54.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270d34b700 1 --2- 172.21.15.82:0/2189875168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f40043f0 0x7f26f40048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:54.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270d34b700 1 --2- 172.21.15.82:0/2189875168 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f270806a460 0x7f26f4005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:54.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270d34b700 1 -- 172.21.15.82:0/2189875168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27080c90f0 con 0x7f26f40043f0 2023-11-28T13:07:54.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270d34b700 1 -- 172.21.15.82:0/2189875168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f400ba30 con 0x7f26f4003a50 2023-11-28T13:07:54.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270d34b700 1 -- 172.21.15.82:0/2189875168 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f400bbf0 con 0x7f270806a460 2023-11-28T13:07:54.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270db4c700 1 --2- 172.21.15.82:0/2189875168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f40043f0 0x7f26f40048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:54.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270e34d700 1 --2- 172.21.15.82:0/2189875168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26f4003a50 0x7f26f4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:54.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270eb4e700 1 --2- 172.21.15.82:0/2189875168 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f270806a460 0x7f26f4005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:54.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270db4c700 1 -- 172.21.15.82:0/2189875168 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f270806a460 msgr2=0x7f26f4005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:54.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270db4c700 1 --2- 172.21.15.82:0/2189875168 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f270806a460 0x7f26f4005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:54.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270db4c700 1 -- 172.21.15.82:0/2189875168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26f4003a50 msgr2=0x7f26f4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:54.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270db4c700 1 --2- 172.21.15.82:0/2189875168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26f4003a50 0x7f26f4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:54.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270db4c700 1 -- 172.21.15.82:0/2189875168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f40035d0 con 0x7f26f40043f0 2023-11-28T13:07:54.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270eb4e700 1 --2- 172.21.15.82:0/2189875168 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f270806a460 0x7f26f4005110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:07:54.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270db4c700 1 --2- 172.21.15.82:0/2189875168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f40043f0 0x7f26f40048b0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f2704009fc0 tx=0x7f26f40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7410a5141187fd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:54.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270d34b700 1 -- 172.21.15.82:0/2189875168 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270400ec30 con 0x7f26f40043f0 2023-11-28T13:07:54.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270d34b700 1 -- 172.21.15.82:0/2189875168 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270400f040 con 0x7f26f40043f0 2023-11-28T13:07:54.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.534+0000 7f270d34b700 1 -- 172.21.15.82:0/2189875168 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2704014480 con 0x7f26f40043f0 2023-11-28T13:07:54.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.538+0000 7f270f34f700 1 -- 172.21.15.82:0/2189875168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f40043f0 msgr2=0x7f26f40048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:54.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.538+0000 7f270f34f700 1 --2- 172.21.15.82:0/2189875168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f40043f0 0x7f26f40048b0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f2704009fc0 tx=0x7f26f40058a0 comp rx=0 tx=0).stop 2023-11-28T13:07:54.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.538+0000 7f270eb4e700 1 -- 172.21.15.82:0/2189875168 reap_dead start 2023-11-28T13:07:54.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.538+0000 7f270f34f700 1 -- 172.21.15.82:0/2189875168 shutdown_connections 2023-11-28T13:07:54.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.538+0000 7f270f34f700 1 -- 172.21.15.82:0/2189875168 >> 172.21.15.82:0/2189875168 conn(0x7f270806cc60 msgr2=0x7f27080b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:54.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.538+0000 7f270f34f700 1 -- 172.21.15.82:0/2189875168 shutdown_connections 2023-11-28T13:07:54.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.538+0000 7f270f34f700 1 -- 172.21.15.82:0/2189875168 wait complete. 2023-11-28T13:07:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.538+0000 7f270f34f700 1 Processor -- start 2023-11-28T13:07:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.538+0000 7f270f34f700 1 -- start start 2023-11-28T13:07:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.538+0000 7f270f34f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26f40043f0 0x7f27080c35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.538+0000 7f270f34f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27080ccc10 0x7f27080cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.538+0000 7f270f34f700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f27080c2020 0x7f27080c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.538+0000 7f270f34f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27080c7660 con 0x7f27080ccc10 2023-11-28T13:07:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.538+0000 7f270f34f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27080cd5c0 con 0x7f26f40043f0 2023-11-28T13:07:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.538+0000 7f270f34f700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2708158d60 con 0x7f27080c2020 2023-11-28T13:07:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.542+0000 7f270db4c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27080ccc10 0x7f27080cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.542+0000 7f270db4c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27080ccc10 0x7f27080cd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50468/0 (socket says 172.21.15.82:50468) 2023-11-28T13:07:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.542+0000 7f270db4c700 1 -- 172.21.15.82:0/3151078955 learned_addr learned my addr 172.21.15.82:0/3151078955 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.542+0000 7f270eb4e700 1 --2- 172.21.15.82:0/3151078955 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f27080c2020 0x7f27080c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.542+0000 7f270e34d700 1 --2- 172.21.15.82:0/3151078955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26f40043f0 0x7f27080c35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.542+0000 7f270db4c700 1 -- 172.21.15.82:0/3151078955 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f27080c2020 msgr2=0x7f27080c2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.542+0000 7f270db4c700 1 --2- 172.21.15.82:0/3151078955 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f27080c2020 0x7f27080c2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.542+0000 7f270db4c700 1 -- 172.21.15.82:0/3151078955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26f40043f0 msgr2=0x7f27080c35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.542+0000 7f270db4c700 1 --2- 172.21.15.82:0/3151078955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26f40043f0 0x7f27080c35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.542+0000 7f270db4c700 1 -- 172.21.15.82:0/3151078955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2708160880 con 0x7f27080ccc10 2023-11-28T13:07:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.542+0000 7f270db4c700 1 --2- 172.21.15.82:0/3151078955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27080ccc10 0x7f27080cd080 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f270400ef60 tx=0x7f2704009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.542+0000 7f26feffd700 1 -- 172.21.15.82:0/3151078955 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2704004450 con 0x7f27080ccc10 2023-11-28T13:07:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.542+0000 7f26feffd700 1 -- 172.21.15.82:0/3151078955 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27040045b0 con 0x7f27080ccc10 2023-11-28T13:07:54.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.542+0000 7f270f34f700 1 -- 172.21.15.82:0/3151078955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2708164380 con 0x7f27080ccc10 2023-11-28T13:07:54.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.542+0000 7f26feffd700 1 -- 172.21.15.82:0/3151078955 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2704004960 con 0x7f27080ccc10 2023-11-28T13:07:54.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.542+0000 7f270f34f700 1 -- 172.21.15.82:0/3151078955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270806a8c0 con 0x7f27080ccc10 2023-11-28T13:07:54.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.542+0000 7f26feffd700 1 -- 172.21.15.82:0/3151078955 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2704014480 con 0x7f27080ccc10 2023-11-28T13:07:54.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.542+0000 7f270f34f700 1 -- 172.21.15.82:0/3151078955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2708065fc0 con 0x7f27080ccc10 2023-11-28T13:07:54.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.546+0000 7f26feffd700 1 --2- 172.21.15.82:0/3151078955 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f26ec064f10 0x7f26ec0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:54.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.546+0000 7f26feffd700 1 -- 172.21.15.82:0/3151078955 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2704083800 con 0x7f27080ccc10 2023-11-28T13:07:54.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.546+0000 7f270e34d700 1 --2- 172.21.15.82:0/3151078955 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f26ec064f10 0x7f26ec0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:54.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.546+0000 7f26feffd700 1 --2- 172.21.15.82:0/3151078955 >> [v2:172.21.15.82:6816/36629,v1:172.21.15.82:6817/36629] conn(0x7f26ec06b380 0x7f26ec06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:54.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.546+0000 7f26feffd700 1 -- 172.21.15.82:0/3151078955 --> [v2:172.21.15.82:6816/36629,v1:172.21.15.82:6817/36629] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f26ec06de40 con 0x7f26ec06b380 2023-11-28T13:07:54.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.546+0000 7f26feffd700 1 -- 172.21.15.82:0/3151078955 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27040882a0 con 0x7f27080ccc10 2023-11-28T13:07:54.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.546+0000 7f270eb4e700 1 --2- 172.21.15.82:0/3151078955 >> [v2:172.21.15.82:6816/36629,v1:172.21.15.82:6817/36629] conn(0x7f26ec06b380 0x7f26ec06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:54.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.546+0000 7f270e34d700 1 --2- 172.21.15.82:0/3151078955 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f26ec064f10 0x7f26ec0673c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f26f8001cb0 tx=0x7f26f8007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:54.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.546+0000 7f270eb4e700 1 --2- 172.21.15.82:0/3151078955 >> [v2:172.21.15.82:6816/36629,v1:172.21.15.82:6817/36629] conn(0x7f26ec06b380 0x7f26ec06d790 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:54.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.546+0000 7f26feffd700 1 -- 172.21.15.82:0/3151078955 <== osd.0 v2:172.21.15.82:6816/36629 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f26ec06de40 con 0x7f26ec06b380 2023-11-28T13:07:54.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.566+0000 7f270f34f700 1 -- 172.21.15.82:0/3151078955 --> [v2:172.21.15.82:6816/36629,v1:172.21.15.82:6817/36629] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f270806ae70 con 0x7f26ec06b380 2023-11-28T13:07:54.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.566+0000 7f26feffd700 1 -- 172.21.15.82:0/3151078955 <== osd.0 v2:172.21.15.82:6816/36629 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f270806ae70 con 0x7f26ec06b380 2023-11-28T13:07:54.572 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:07:54.572 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T13:07:54.572 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:07:54.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.566+0000 7f270f34f700 1 -- 172.21.15.82:0/3151078955 >> [v2:172.21.15.82:6816/36629,v1:172.21.15.82:6817/36629] conn(0x7f26ec06b380 msgr2=0x7f26ec06d790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:54.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.566+0000 7f270f34f700 1 --2- 172.21.15.82:0/3151078955 >> [v2:172.21.15.82:6816/36629,v1:172.21.15.82:6817/36629] conn(0x7f26ec06b380 0x7f26ec06d790 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:54.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.566+0000 7f270f34f700 1 -- 172.21.15.82:0/3151078955 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f26ec064f10 msgr2=0x7f26ec0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:54.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.566+0000 7f270f34f700 1 --2- 172.21.15.82:0/3151078955 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f26ec064f10 0x7f26ec0673c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f26f8001cb0 tx=0x7f26f8007040 comp rx=0 tx=0).stop 2023-11-28T13:07:54.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.566+0000 7f270f34f700 1 -- 172.21.15.82:0/3151078955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27080ccc10 msgr2=0x7f27080cd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:54.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.566+0000 7f270f34f700 1 --2- 172.21.15.82:0/3151078955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27080ccc10 0x7f27080cd080 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f270400ef60 tx=0x7f2704009750 comp rx=0 tx=0).stop 2023-11-28T13:07:54.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.566+0000 7f270eb4e700 1 -- 172.21.15.82:0/3151078955 reap_dead start 2023-11-28T13:07:54.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.566+0000 7f270f34f700 1 -- 172.21.15.82:0/3151078955 shutdown_connections 2023-11-28T13:07:54.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.566+0000 7f270f34f700 1 -- 172.21.15.82:0/3151078955 >> 172.21.15.82:0/3151078955 conn(0x7f270806cc60 msgr2=0x7f27081624f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:54.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.566+0000 7f270f34f700 1 -- 172.21.15.82:0/3151078955 shutdown_connections 2023-11-28T13:07:54.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.566+0000 7f270f34f700 1 -- 172.21.15.82:0/3151078955 wait complete. 2023-11-28T13:07:54.586 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-28T13:07:54.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.702+0000 7f3fa8827700 1 Processor -- start 2023-11-28T13:07:54.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.702+0000 7f3fa8827700 1 -- start start 2023-11-28T13:07:54.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.702+0000 7f3fa8827700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3fa40c93d0 0x7f3fa4070730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:54.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.702+0000 7f3fa8827700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3fa4070c70 0x7f3fa406ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:54.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.702+0000 7f3fa8827700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa406a9d0 con 0x7f3fa4158760 2023-11-28T13:07:54.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.702+0000 7f3fa8827700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa406a450 con 0x7f3fa40c93d0 2023-11-28T13:07:54.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.702+0000 7f3fa8827700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa4158b30 con 0x7f3fa4070c70 2023-11-28T13:07:54.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.702+0000 7f3f9bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3fa40c93d0 0x7f3fa4070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:54.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.702+0000 7f3f9bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3fa40c93d0 0x7f3fa4070730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50476/0 (socket says 172.21.15.82:50476) 2023-11-28T13:07:54.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.702+0000 7f3f9bfff700 1 -- 172.21.15.82:0/3679900881 learned_addr learned my addr 172.21.15.82:0/3679900881 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:54.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.702+0000 7f3fa2d9d700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3fa4158760 0x7f3fa415c1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52620/0 (socket says 172.21.15.82:52620) 2023-11-28T13:07:54.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.702+0000 7f3fa359e700 1 --2- 172.21.15.82:0/3679900881 >> v2:172.21.15.114:3300/0 conn(0x7f3fa4070c70 0x7f3fa406ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:54.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.702+0000 7f3f9bfff700 1 -- 172.21.15.82:0/3679900881 >> v2:172.21.15.114:3300/0 conn(0x7f3fa4070c70 msgr2=0x7f3fa406ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:54.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.702+0000 7f3f9bfff700 1 --2- 172.21.15.82:0/3679900881 >> v2:172.21.15.114:3300/0 conn(0x7f3fa4070c70 0x7f3fa406ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:54.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.702+0000 7f3f9bfff700 1 -- 172.21.15.82:0/3679900881 >> v1:172.21.15.82:6789/0 conn(0x7f3fa4158760 legacy=0x7f3fa415c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:54.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.702+0000 7f3f9bfff700 1 -- 172.21.15.82:0/3679900881 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa40710b0 con 0x7f3fa40c93d0 2023-11-28T13:07:54.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.702+0000 7f3f9bfff700 1 --2- 172.21.15.82:0/3679900881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fa40c93d0 0x7f3fa4070730 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c009910 tx=0x7f3f8c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738b4979ace035a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:54.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.702+0000 7f3fa259c700 1 -- 172.21.15.82:0/3679900881 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c00ba20 con 0x7f3fa40c93d0 2023-11-28T13:07:54.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.706+0000 7f3fa259c700 1 -- 172.21.15.82:0/3679900881 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c00bb80 con 0x7f3fa40c93d0 2023-11-28T13:07:54.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.706+0000 7f3fa259c700 1 -- 172.21.15.82:0/3679900881 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c009e60 con 0x7f3fa40c93d0 2023-11-28T13:07:54.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.706+0000 7f3fa8827700 1 -- 172.21.15.82:0/3679900881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fa40c93d0 msgr2=0x7f3fa4070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:54.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.706+0000 7f3fa8827700 1 --2- 172.21.15.82:0/3679900881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fa40c93d0 0x7f3fa4070730 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c009910 tx=0x7f3f8c009c20 comp rx=0 tx=0).stop 2023-11-28T13:07:54.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.706+0000 7f3fa8827700 1 -- 172.21.15.82:0/3679900881 shutdown_connections 2023-11-28T13:07:54.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.706+0000 7f3fa8827700 1 --2- 172.21.15.82:0/3679900881 >> v2:172.21.15.114:3300/0 conn(0x7f3fa4070c70 0x7f3fa406ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:54.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.706+0000 7f3fa8827700 1 --2- 172.21.15.82:0/3679900881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fa40c93d0 0x7f3fa4070730 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:54.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.706+0000 7f3fa8827700 1 -- 172.21.15.82:0/3679900881 >> 172.21.15.82:0/3679900881 conn(0x7f3fa40cb890 msgr2=0x7f3fa40cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:54.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.706+0000 7f3fa8827700 1 -- 172.21.15.82:0/3679900881 shutdown_connections 2023-11-28T13:07:54.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.706+0000 7f3fa8827700 1 -- 172.21.15.82:0/3679900881 wait complete. 2023-11-28T13:07:54.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.706+0000 7f3fa8827700 1 Processor -- start 2023-11-28T13:07:54.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.706+0000 7f3fa8827700 1 -- start start 2023-11-28T13:07:54.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.706+0000 7f3fa8827700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fa4070c70 0x7f3fa41485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:54.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.706+0000 7f3fa8827700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fa40c93d0 0x7f3fa4148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:54.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.706+0000 7f3fa8827700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3fa4158760 0x7f3fa41565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:54.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.706+0000 7f3fa8827700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40b0cc0 con 0x7f3fa40c93d0 2023-11-28T13:07:54.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.706+0000 7f3fa8827700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40b1ce0 con 0x7f3fa4070c70 2023-11-28T13:07:54.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.706+0000 7f3fa8827700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa4148b30 con 0x7f3fa4158760 2023-11-28T13:07:54.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.710+0000 7f3f9bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fa40c93d0 0x7f3fa4148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:54.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.710+0000 7f3f9bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fa40c93d0 0x7f3fa4148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50480/0 (socket says 172.21.15.82:50480) 2023-11-28T13:07:54.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.710+0000 7f3f9bfff700 1 -- 172.21.15.82:0/1121272270 learned_addr learned my addr 172.21.15.82:0/1121272270 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:54.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.710+0000 7f3fa2d9d700 1 --2- 172.21.15.82:0/1121272270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fa4070c70 0x7f3fa41485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:54.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.710+0000 7f3fa359e700 1 --2- 172.21.15.82:0/1121272270 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3fa4158760 0x7f3fa41565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:54.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.710+0000 7f3f9bfff700 1 -- 172.21.15.82:0/1121272270 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3fa4158760 msgr2=0x7f3fa41565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:54.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.710+0000 7f3f9bfff700 1 --2- 172.21.15.82:0/1121272270 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3fa4158760 0x7f3fa41565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:54.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.710+0000 7f3f9bfff700 1 -- 172.21.15.82:0/1121272270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fa4070c70 msgr2=0x7f3fa41485f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:54.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.710+0000 7f3f9bfff700 1 --2- 172.21.15.82:0/1121272270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fa4070c70 0x7f3fa41485f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:54.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.710+0000 7f3f9bfff700 1 -- 172.21.15.82:0/1121272270 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c009570 con 0x7f3fa40c93d0 2023-11-28T13:07:54.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.710+0000 7f3f9bfff700 1 --2- 172.21.15.82:0/1121272270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fa40c93d0 0x7f3fa4148d60 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f3fa406ff60 tx=0x7f3f8c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:54.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.710+0000 7f3f9b7fe700 1 -- 172.21.15.82:0/1121272270 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c004310 con 0x7f3fa40c93d0 2023-11-28T13:07:54.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.710+0000 7f3f9b7fe700 1 -- 172.21.15.82:0/1121272270 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c01f070 con 0x7f3fa40c93d0 2023-11-28T13:07:54.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.710+0000 7f3fa8827700 1 -- 172.21.15.82:0/1121272270 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa415cf30 con 0x7f3fa40c93d0 2023-11-28T13:07:54.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.710+0000 7f3f9b7fe700 1 -- 172.21.15.82:0/1121272270 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c0036c0 con 0x7f3fa40c93d0 2023-11-28T13:07:54.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.710+0000 7f3fa8827700 1 -- 172.21.15.82:0/1121272270 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa415cc50 con 0x7f3fa40c93d0 2023-11-28T13:07:54.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.710+0000 7f3f9b7fe700 1 -- 172.21.15.82:0/1121272270 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3f8c02a020 con 0x7f3fa40c93d0 2023-11-28T13:07:54.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.710+0000 7f3fa8827700 1 -- 172.21.15.82:0/1121272270 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa406a660 con 0x7f3fa40c93d0 2023-11-28T13:07:54.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.710+0000 7f3f9b7fe700 1 --2- 172.21.15.82:0/1121272270 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3f84064ee0 0x7f3f84067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:54.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.710+0000 7f3f9b7fe700 1 -- 172.21.15.82:0/1121272270 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3f8c0830c0 con 0x7f3fa40c93d0 2023-11-28T13:07:54.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.714+0000 7f3fa2d9d700 1 --2- 172.21.15.82:0/1121272270 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3f84064ee0 0x7f3f84067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:54.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.714+0000 7f3fa2d9d700 1 --2- 172.21.15.82:0/1121272270 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3f84064ee0 0x7f3f84067390 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3fa40c9250 tx=0x7f3f94001280 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:54.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.722+0000 7f3f9b7fe700 1 -- 172.21.15.82:0/1121272270 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3f8c051560 con 0x7f3fa40c93d0 2023-11-28T13:07:54.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.878+0000 7f3fa8827700 1 -- 172.21.15.82:0/1121272270 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fa4065fc0 con 0x7f3f84064ee0 2023-11-28T13:07:54.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.878+0000 7f3f9b7fe700 1 -- 172.21.15.82:0/1121272270 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3fa4065fc0 con 0x7f3f84064ee0 2023-11-28T13:07:54.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.878+0000 7f3fa8827700 1 -- 172.21.15.82:0/1121272270 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3f84064ee0 msgr2=0x7f3f84067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:54.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.878+0000 7f3fa8827700 1 --2- 172.21.15.82:0/1121272270 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3f84064ee0 0x7f3f84067390 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3fa40c9250 tx=0x7f3f94001280 comp rx=0 tx=0).stop 2023-11-28T13:07:54.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.878+0000 7f3fa8827700 1 -- 172.21.15.82:0/1121272270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fa40c93d0 msgr2=0x7f3fa4148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:54.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.878+0000 7f3fa8827700 1 --2- 172.21.15.82:0/1121272270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fa40c93d0 0x7f3fa4148d60 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f3fa406ff60 tx=0x7f3f8c004770 comp rx=0 tx=0).stop 2023-11-28T13:07:54.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.878+0000 7f3fa8827700 1 -- 172.21.15.82:0/1121272270 shutdown_connections 2023-11-28T13:07:54.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.878+0000 7f3fa8827700 1 --2- 172.21.15.82:0/1121272270 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f3f84064ee0 0x7f3f84067390 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:54.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.878+0000 7f3fa8827700 1 --2- 172.21.15.82:0/1121272270 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3fa4158760 0x7f3fa41565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:54.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.878+0000 7f3fa8827700 1 --2- 172.21.15.82:0/1121272270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fa40c93d0 0x7f3fa4148d60 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:54.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.878+0000 7f3fa8827700 1 --2- 172.21.15.82:0/1121272270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fa4070c70 0x7f3fa41485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:54.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.878+0000 7f3fa8827700 1 -- 172.21.15.82:0/1121272270 >> 172.21.15.82:0/1121272270 conn(0x7f3fa40cb890 msgr2=0x7f3fa4155550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:54.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.882+0000 7f3fa8827700 1 -- 172.21.15.82:0/1121272270 shutdown_connections 2023-11-28T13:07:54.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:54.882+0000 7f3fa8827700 1 -- 172.21.15.82:0/1121272270 wait complete. 2023-11-28T13:07:54.890 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 0 to deep-scrub 2023-11-28T13:07:54.900 INFO:tasks.ceph:Scrubbing osd.1 2023-11-28T13:07:54.900 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-28T13:07:55.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.010+0000 7f98888be700 1 Processor -- start 2023-11-28T13:07:55.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.010+0000 7f98888be700 1 -- start start 2023-11-28T13:07:55.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f98888be700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f988406b800 0x7f9884069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f98888be700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f98840cd060 0x7f988406bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f98888be700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f988415fec0 con 0x7f9884160350 2023-11-28T13:07:55.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f98888be700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f988406c110 con 0x7f98840cd060 2023-11-28T13:07:55.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f98888be700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f988406a230 con 0x7f988406b800 2023-11-28T13:07:55.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f9882ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f98840cd060 0x7f988406bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f9883fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9884160350 0x7f988415c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52626/0 (socket says 172.21.15.82:52626) 2023-11-28T13:07:55.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f9883fff700 1 -- 172.21.15.82:0/2905431970 learned_addr learned my addr 172.21.15.82:0/2905431970 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:55.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f98837fe700 1 --2- 172.21.15.82:0/2905431970 >> v2:172.21.15.114:3300/0 conn(0x7f988406b800 0x7f9884069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f9882ffd700 1 -- 172.21.15.82:0/2905431970 >> v2:172.21.15.114:3300/0 conn(0x7f988406b800 msgr2=0x7f9884069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:55.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f9882ffd700 1 --2- 172.21.15.82:0/2905431970 >> v2:172.21.15.114:3300/0 conn(0x7f988406b800 0x7f9884069bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f9882ffd700 1 -- 172.21.15.82:0/2905431970 >> v1:172.21.15.82:6789/0 conn(0x7f9884160350 legacy=0x7f988415c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f9882ffd700 1 -- 172.21.15.82:0/2905431970 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988406a510 con 0x7f98840cd060 2023-11-28T13:07:55.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f98837fe700 1 --2- 172.21.15.82:0/2905431970 >> v2:172.21.15.114:3300/0 conn(0x7f988406b800 0x7f9884069bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T13:07:55.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f9882ffd700 1 --2- 172.21.15.82:0/2905431970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98840cd060 0x7f988406bbd0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f98840d3260 tx=0x7f9874009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b670515039e4c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:55.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f98827fc700 1 -- 172.21.15.82:0/2905431970 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9874011830 con 0x7f98840cd060 2023-11-28T13:07:55.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f98827fc700 1 -- 172.21.15.82:0/2905431970 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9874011990 con 0x7f98840cd060 2023-11-28T13:07:55.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f98827fc700 1 -- 172.21.15.82:0/2905431970 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9874011d40 con 0x7f98840cd060 2023-11-28T13:07:55.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f98888be700 1 -- 172.21.15.82:0/2905431970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98840cd060 msgr2=0x7f988406bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f98888be700 1 --2- 172.21.15.82:0/2905431970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98840cd060 0x7f988406bbd0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f98840d3260 tx=0x7f9874009b30 comp rx=0 tx=0).stop 2023-11-28T13:07:55.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f98888be700 1 -- 172.21.15.82:0/2905431970 shutdown_connections 2023-11-28T13:07:55.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f98888be700 1 --2- 172.21.15.82:0/2905431970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98840cd060 0x7f988406bbd0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f98888be700 1 --2- 172.21.15.82:0/2905431970 >> v2:172.21.15.114:3300/0 conn(0x7f988406b800 0x7f9884069bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f98888be700 1 -- 172.21.15.82:0/2905431970 >> 172.21.15.82:0/2905431970 conn(0x7f98840d0090 msgr2=0x7f98840d2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:55.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f98888be700 1 -- 172.21.15.82:0/2905431970 shutdown_connections 2023-11-28T13:07:55.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.014+0000 7f98888be700 1 -- 172.21.15.82:0/2905431970 wait complete. 2023-11-28T13:07:55.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f98888be700 1 Processor -- start 2023-11-28T13:07:55.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f98888be700 1 -- start start 2023-11-28T13:07:55.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f98888be700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f988406b800 0x7f9884152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f98888be700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98840cd060 0x7f988414db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f98888be700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9884160350 0x7f98840cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f98888be700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988414d9c0 con 0x7f988406b800 2023-11-28T13:07:55.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f98888be700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98840c7840 con 0x7f9884160350 2023-11-28T13:07:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f98888be700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98840c7b20 con 0x7f98840cd060 2023-11-28T13:07:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f98837fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f988406b800 0x7f9884152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f98837fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f988406b800 0x7f9884152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50486/0 (socket says 172.21.15.82:50486) 2023-11-28T13:07:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f98837fe700 1 -- 172.21.15.82:0/3164360721 learned_addr learned my addr 172.21.15.82:0/3164360721 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f9882ffd700 1 --2- 172.21.15.82:0/3164360721 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98840cd060 0x7f988414db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f9883fff700 1 --2- 172.21.15.82:0/3164360721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9884160350 0x7f98840cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f98837fe700 1 -- 172.21.15.82:0/3164360721 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98840cd060 msgr2=0x7f988414db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f98837fe700 1 --2- 172.21.15.82:0/3164360721 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98840cd060 0x7f988414db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f98837fe700 1 -- 172.21.15.82:0/3164360721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9884160350 msgr2=0x7f98840cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f98837fe700 1 --2- 172.21.15.82:0/3164360721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9884160350 0x7f98840cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f98837fe700 1 -- 172.21.15.82:0/3164360721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98740094b0 con 0x7f988406b800 2023-11-28T13:07:55.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f98837fe700 1 --2- 172.21.15.82:0/3164360721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f988406b800 0x7f9884152f20 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f987800e810 tx=0x7f987800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:55.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f986bfff700 1 -- 172.21.15.82:0/3164360721 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9878013610 con 0x7f988406b800 2023-11-28T13:07:55.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f986bfff700 1 -- 172.21.15.82:0/3164360721 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9878013770 con 0x7f988406b800 2023-11-28T13:07:55.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f98888be700 1 -- 172.21.15.82:0/3164360721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98840cd4d0 con 0x7f988406b800 2023-11-28T13:07:55.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f986bfff700 1 -- 172.21.15.82:0/3164360721 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9878013b00 con 0x7f988406b800 2023-11-28T13:07:55.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f98888be700 1 -- 172.21.15.82:0/3164360721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f988406a7f0 con 0x7f988406b800 2023-11-28T13:07:55.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.018+0000 7f98888be700 1 -- 172.21.15.82:0/3164360721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9884156a10 con 0x7f988406b800 2023-11-28T13:07:55.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.022+0000 7f986bfff700 1 -- 172.21.15.82:0/3164360721 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9878023070 con 0x7f988406b800 2023-11-28T13:07:55.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.022+0000 7f986bfff700 1 --2- 172.21.15.82:0/3164360721 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9870064ee0 0x7f9870067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.022+0000 7f9882ffd700 1 --2- 172.21.15.82:0/3164360721 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9870064ee0 0x7f9870067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.022+0000 7f986bfff700 1 -- 172.21.15.82:0/3164360721 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9878081f00 con 0x7f988406b800 2023-11-28T13:07:55.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.022+0000 7f986bfff700 1 --2- 172.21.15.82:0/3164360721 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x7f987006b350 0x7f987006d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.022+0000 7f986bfff700 1 -- 172.21.15.82:0/3164360721 --> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f987006de10 con 0x7f987006b350 2023-11-28T13:07:55.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.022+0000 7f986bfff700 1 -- 172.21.15.82:0/3164360721 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98780822b0 con 0x7f988406b800 2023-11-28T13:07:55.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.022+0000 7f9883fff700 1 --2- 172.21.15.82:0/3164360721 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x7f987006b350 0x7f987006d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.022+0000 7f9882ffd700 1 --2- 172.21.15.82:0/3164360721 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9870064ee0 0x7f9870067390 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f98740090b0 tx=0x7f9874008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:55.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.022+0000 7f9883fff700 1 --2- 172.21.15.82:0/3164360721 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x7f987006b350 0x7f987006d760 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:55.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.022+0000 7f986bfff700 1 -- 172.21.15.82:0/3164360721 <== osd.1 v2:172.21.15.82:6808/36628 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f987006de10 con 0x7f987006b350 2023-11-28T13:07:55.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.038+0000 7f98888be700 1 -- 172.21.15.82:0/3164360721 --> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9884065fc0 con 0x7f987006b350 2023-11-28T13:07:55.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.038+0000 7f986bfff700 1 -- 172.21.15.82:0/3164360721 <== osd.1 v2:172.21.15.82:6808/36628 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9884065fc0 con 0x7f987006b350 2023-11-28T13:07:55.046 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:07:55.046 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T13:07:55.046 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:07:55.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.038+0000 7f98888be700 1 -- 172.21.15.82:0/3164360721 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x7f987006b350 msgr2=0x7f987006d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.038+0000 7f98888be700 1 --2- 172.21.15.82:0/3164360721 >> [v2:172.21.15.82:6808/36628,v1:172.21.15.82:6809/36628] conn(0x7f987006b350 0x7f987006d760 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.038+0000 7f98888be700 1 -- 172.21.15.82:0/3164360721 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9870064ee0 msgr2=0x7f9870067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.038+0000 7f98888be700 1 --2- 172.21.15.82:0/3164360721 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9870064ee0 0x7f9870067390 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f98740090b0 tx=0x7f9874008030 comp rx=0 tx=0).stop 2023-11-28T13:07:55.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.038+0000 7f98888be700 1 -- 172.21.15.82:0/3164360721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f988406b800 msgr2=0x7f9884152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.038+0000 7f98888be700 1 --2- 172.21.15.82:0/3164360721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f988406b800 0x7f9884152f20 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f987800e810 tx=0x7f987800ebd0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.038+0000 7f9883fff700 1 -- 172.21.15.82:0/3164360721 reap_dead start 2023-11-28T13:07:55.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.038+0000 7f98888be700 1 -- 172.21.15.82:0/3164360721 shutdown_connections 2023-11-28T13:07:55.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.038+0000 7f98888be700 1 -- 172.21.15.82:0/3164360721 >> 172.21.15.82:0/3164360721 conn(0x7f98840d0090 msgr2=0x7f988415f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:55.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.038+0000 7f98888be700 1 -- 172.21.15.82:0/3164360721 shutdown_connections 2023-11-28T13:07:55.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.038+0000 7f98888be700 1 -- 172.21.15.82:0/3164360721 wait complete. 2023-11-28T13:07:55.058 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-28T13:07:55.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.166+0000 7f565e82b700 1 Processor -- start 2023-11-28T13:07:55.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.166+0000 7f565e82b700 1 -- start start 2023-11-28T13:07:55.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565e82b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5658160900 0x7f56580cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565e82b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f56580c1910 0x7f565806c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565e82b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56580ce030 con 0x7f5658070070 2023-11-28T13:07:55.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565e82b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56580ce310 con 0x7f56580c1910 2023-11-28T13:07:55.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565e82b700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f565806a5d0 con 0x7f5658160900 2023-11-28T13:07:55.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565d829700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5658070070 0x7f5658070440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52640/0 (socket says 172.21.15.82:52640) 2023-11-28T13:07:55.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565e02a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f56580c1910 0x7f565806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565d829700 1 -- 172.21.15.82:0/1846426933 learned_addr learned my addr 172.21.15.82:0/1846426933 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:55.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565d028700 1 --2- 172.21.15.82:0/1846426933 >> v2:172.21.15.114:3300/0 conn(0x7f5658160900 0x7f56580cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565e02a700 1 -- 172.21.15.82:0/1846426933 >> v2:172.21.15.114:3300/0 conn(0x7f5658160900 msgr2=0x7f56580cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565e02a700 1 --2- 172.21.15.82:0/1846426933 >> v2:172.21.15.114:3300/0 conn(0x7f5658160900 0x7f56580cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565e02a700 1 -- 172.21.15.82:0/1846426933 >> v1:172.21.15.82:6789/0 conn(0x7f5658070070 legacy=0x7f5658070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565e02a700 1 -- 172.21.15.82:0/1846426933 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565806a8b0 con 0x7f56580c1910 2023-11-28T13:07:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565c827700 1 -- 172.21.15.82:0/1846426933 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854481163 0 0) 0x7f56580ce030 con 0x7f5658070070 2023-11-28T13:07:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565e02a700 1 --2- 172.21.15.82:0/1846426933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56580c1910 0x7f565806c070 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f565806b6b0 tx=0x7f5650009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33a1c206b343c76 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565c827700 1 -- 172.21.15.82:0/1846426933 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5650011830 con 0x7f56580c1910 2023-11-28T13:07:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565c827700 1 -- 172.21.15.82:0/1846426933 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5650011990 con 0x7f56580c1910 2023-11-28T13:07:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565c827700 1 -- 172.21.15.82:0/1846426933 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5650011d20 con 0x7f56580c1910 2023-11-28T13:07:55.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565e82b700 1 -- 172.21.15.82:0/1846426933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56580c1910 msgr2=0x7f565806c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565e82b700 1 --2- 172.21.15.82:0/1846426933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56580c1910 0x7f565806c070 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f565806b6b0 tx=0x7f5650009b30 comp rx=0 tx=0).stop 2023-11-28T13:07:55.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565e82b700 1 -- 172.21.15.82:0/1846426933 shutdown_connections 2023-11-28T13:07:55.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565e82b700 1 --2- 172.21.15.82:0/1846426933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56580c1910 0x7f565806c070 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565e82b700 1 --2- 172.21.15.82:0/1846426933 >> v2:172.21.15.114:3300/0 conn(0x7f5658160900 0x7f56580cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565e82b700 1 -- 172.21.15.82:0/1846426933 >> 172.21.15.82:0/1846426933 conn(0x7f56580ce600 msgr2=0x7f56580ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:55.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565e82b700 1 -- 172.21.15.82:0/1846426933 shutdown_connections 2023-11-28T13:07:55.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565e82b700 1 -- 172.21.15.82:0/1846426933 wait complete. 2023-11-28T13:07:55.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565e82b700 1 Processor -- start 2023-11-28T13:07:55.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.170+0000 7f565e82b700 1 -- start start 2023-11-28T13:07:55.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f565e82b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5658070070 0x7f56581f5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f565e82b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56580c5970 0x7f56581f9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f565e82b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5658151390 0x7f565806c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f565e82b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56581f95e0 con 0x7f56580c5970 2023-11-28T13:07:55.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f565e82b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5658151d60 con 0x7f5658151390 2023-11-28T13:07:55.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f565e82b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5658152040 con 0x7f5658070070 2023-11-28T13:07:55.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f565d028700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56580c5970 0x7f56581f9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f565e02a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5658151390 0x7f565806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f565d028700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56580c5970 0x7f56581f9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50510/0 (socket says 172.21.15.82:50510) 2023-11-28T13:07:55.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f565d028700 1 -- 172.21.15.82:0/2855755487 learned_addr learned my addr 172.21.15.82:0/2855755487 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:55.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f565d829700 1 --2- 172.21.15.82:0/2855755487 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5658070070 0x7f56581f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f565d028700 1 -- 172.21.15.82:0/2855755487 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5658070070 msgr2=0x7f56581f5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f565d028700 1 --2- 172.21.15.82:0/2855755487 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5658070070 0x7f56581f5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f565d028700 1 -- 172.21.15.82:0/2855755487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5658151390 msgr2=0x7f565806c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f565d028700 1 --2- 172.21.15.82:0/2855755487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5658151390 0x7f565806c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f565d028700 1 -- 172.21.15.82:0/2855755487 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56500094b0 con 0x7f56580c5970 2023-11-28T13:07:55.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f565d028700 1 --2- 172.21.15.82:0/2855755487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56580c5970 0x7f56581f9a00 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f564800efc0 tx=0x7f564800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:55.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f56567fc700 1 -- 172.21.15.82:0/2855755487 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564800cdc0 con 0x7f56580c5970 2023-11-28T13:07:55.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f56567fc700 1 -- 172.21.15.82:0/2855755487 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564800f040 con 0x7f56580c5970 2023-11-28T13:07:55.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f565e82b700 1 -- 172.21.15.82:0/2855755487 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56580cc710 con 0x7f56580c5970 2023-11-28T13:07:55.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f56567fc700 1 -- 172.21.15.82:0/2855755487 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56480146a0 con 0x7f56580c5970 2023-11-28T13:07:55.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f565e82b700 1 -- 172.21.15.82:0/2855755487 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565806ab90 con 0x7f56580c5970 2023-11-28T13:07:55.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f565e82b700 1 -- 172.21.15.82:0/2855755487 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56580cdc50 con 0x7f56580c5970 2023-11-28T13:07:55.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.174+0000 7f56567fc700 1 -- 172.21.15.82:0/2855755487 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5648014800 con 0x7f56580c5970 2023-11-28T13:07:55.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.178+0000 7f56567fc700 1 --2- 172.21.15.82:0/2855755487 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5644064ee0 0x7f5644067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.178+0000 7f565d829700 1 --2- 172.21.15.82:0/2855755487 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5644064ee0 0x7f5644067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.178+0000 7f56567fc700 1 -- 172.21.15.82:0/2855755487 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5648082990 con 0x7f56580c5970 2023-11-28T13:07:55.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.178+0000 7f565d829700 1 --2- 172.21.15.82:0/2855755487 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5644064ee0 0x7f5644067390 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f564c000f60 tx=0x7f564c007cb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:55.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.182+0000 7f56567fc700 1 -- 172.21.15.82:0/2855755487 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5648050d60 con 0x7f56580c5970 2023-11-28T13:07:55.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.346+0000 7f565e82b700 1 -- 172.21.15.82:0/2855755487 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f56581f9720 con 0x7f5644064ee0 2023-11-28T13:07:55.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.350+0000 7f56567fc700 1 -- 172.21.15.82:0/2855755487 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f56581f9720 con 0x7f5644064ee0 2023-11-28T13:07:55.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.350+0000 7f565e82b700 1 -- 172.21.15.82:0/2855755487 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5644064ee0 msgr2=0x7f5644067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.350+0000 7f565e82b700 1 --2- 172.21.15.82:0/2855755487 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5644064ee0 0x7f5644067390 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f564c000f60 tx=0x7f564c007cb0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.350+0000 7f565e82b700 1 -- 172.21.15.82:0/2855755487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56580c5970 msgr2=0x7f56581f9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.350+0000 7f565e82b700 1 --2- 172.21.15.82:0/2855755487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56580c5970 0x7f56581f9a00 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f564800efc0 tx=0x7f564800c3a0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.350+0000 7f565e82b700 1 -- 172.21.15.82:0/2855755487 shutdown_connections 2023-11-28T13:07:55.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.350+0000 7f565e82b700 1 --2- 172.21.15.82:0/2855755487 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f5644064ee0 0x7f5644067390 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.350+0000 7f565e82b700 1 --2- 172.21.15.82:0/2855755487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5658151390 0x7f565806c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.350+0000 7f565e82b700 1 --2- 172.21.15.82:0/2855755487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56580c5970 0x7f56581f9a00 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.350+0000 7f565e82b700 1 --2- 172.21.15.82:0/2855755487 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5658070070 0x7f56581f5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.350+0000 7f565e82b700 1 -- 172.21.15.82:0/2855755487 >> 172.21.15.82:0/2855755487 conn(0x7f56580ce600 msgr2=0x7f5658070440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:55.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.350+0000 7f565e82b700 1 -- 172.21.15.82:0/2855755487 shutdown_connections 2023-11-28T13:07:55.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.350+0000 7f565e82b700 1 -- 172.21.15.82:0/2855755487 wait complete. 2023-11-28T13:07:55.360 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 1 to deep-scrub 2023-11-28T13:07:55.370 INFO:tasks.ceph:Scrubbing osd.2 2023-11-28T13:07:55.370 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-28T13:07:55.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.486+0000 7f8dcada3700 1 Processor -- start 2023-11-28T13:07:55.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.486+0000 7f8dcada3700 1 -- start start 2023-11-28T13:07:55.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dcada3700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8dbc03b390 0x7f8dbc03c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dcada3700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dbc059040 con 0x7f8dbc0e28c0 2023-11-28T13:07:55.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dcada3700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dbc058a30 con 0x7f8dbc0e6eb0 2023-11-28T13:07:55.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dcada3700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc053850 con 0x7f8dbc03b390 2023-11-28T13:07:55.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc9da1700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8dbc0e28c0 0x7f8dbc03ac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52642/0 (socket says 172.21.15.82:52642) 2023-11-28T13:07:55.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc9da1700 1 -- 172.21.15.82:0/2533389794 learned_addr learned my addr 172.21.15.82:0/2533389794 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:55.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc95a0700 1 --2- 172.21.15.82:0/2533389794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8dbc03b390 0x7f8dbc03c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc8d9f700 1 -- 172.21.15.82:0/2533389794 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895799627 0 0) 0x7f8dbc059040 con 0x7f8dbc0e28c0 2023-11-28T13:07:55.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc8d9f700 1 -- 172.21.15.82:0/2533389794 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8db00035d0 con 0x7f8dbc0e28c0 2023-11-28T13:07:55.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc8d9f700 1 -- 172.21.15.82:0/2533389794 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546045069 0 0) 0x7f8dbc058a30 con 0x7f8dbc0e6eb0 2023-11-28T13:07:55.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc8d9f700 1 -- 172.21.15.82:0/2533389794 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dbc059040 con 0x7f8dbc0e6eb0 2023-11-28T13:07:55.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc8d9f700 1 -- 172.21.15.82:0/2533389794 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4135936898 0 0) 0x7f8db00035d0 con 0x7f8dbc0e28c0 2023-11-28T13:07:55.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc8d9f700 1 -- 172.21.15.82:0/2533389794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8dbc03b390 msgr2=0x7f8dbc03c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:55.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc8d9f700 1 --2- 172.21.15.82:0/2533389794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8dbc03b390 0x7f8dbc03c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc8d9f700 1 -- 172.21.15.82:0/2533389794 >> v1:172.21.15.114:6789/0 conn(0x7f8dbc0e6eb0 legacy=0x7f8dbc0570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc8d9f700 1 -- 172.21.15.82:0/2533389794 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc053b30 con 0x7f8dbc0e28c0 2023-11-28T13:07:55.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc8d9f700 1 -- 172.21.15.82:0/2533389794 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f8dc0001670 con 0x7f8dbc0e28c0 2023-11-28T13:07:55.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc8d9f700 1 -- 172.21.15.82:0/2533389794 >> v1:172.21.15.82:6789/0 conn(0x7f8dbc0e28c0 legacy=0x7f8dbc03ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc8d9f700 1 --2- 172.21.15.82:0/2533389794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8dbc03b390 0x7f8db0003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc8d9f700 1 --2- 172.21.15.82:0/2533389794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8db0004140 0x7f8db0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc8d9f700 1 --2- 172.21.15.82:0/2533389794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8db0004db0 0x7f8db0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc8d9f700 1 -- 172.21.15.82:0/2533389794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc053850 con 0x7f8db0004140 2023-11-28T13:07:55.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc8d9f700 1 -- 172.21.15.82:0/2533389794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db000b9a0 con 0x7f8db0004db0 2023-11-28T13:07:55.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc8d9f700 1 -- 172.21.15.82:0/2533389794 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db000bb60 con 0x7f8dbc03b390 2023-11-28T13:07:55.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc95a0700 1 --2- 172.21.15.82:0/2533389794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8db0004140 0x7f8db0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dca5a2700 1 --2- 172.21.15.82:0/2533389794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8db0004db0 0x7f8db0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc9da1700 1 --2- 172.21.15.82:0/2533389794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8dbc03b390 0x7f8db0003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc95a0700 1 -- 172.21.15.82:0/2533389794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8dbc03b390 msgr2=0x7f8db0003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:55.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc95a0700 1 --2- 172.21.15.82:0/2533389794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8dbc03b390 0x7f8db0003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc95a0700 1 -- 172.21.15.82:0/2533389794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8db0004db0 msgr2=0x7f8db0005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:55.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc95a0700 1 --2- 172.21.15.82:0/2533389794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8db0004db0 0x7f8db0005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc95a0700 1 -- 172.21.15.82:0/2533389794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db00035d0 con 0x7f8db0004140 2023-11-28T13:07:55.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dca5a2700 1 --2- 172.21.15.82:0/2533389794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8db0004db0 0x7f8db0005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:07:55.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc95a0700 1 --2- 172.21.15.82:0/2533389794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8db0004140 0x7f8db0004870 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f8db4009b40 tx=0x7f8db00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa28d4c134dcf60 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:55.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc8d9f700 1 -- 172.21.15.82:0/2533389794 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db400e6c0 con 0x7f8db0004140 2023-11-28T13:07:55.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc8d9f700 1 -- 172.21.15.82:0/2533389794 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db400e820 con 0x7f8db0004140 2023-11-28T13:07:55.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.490+0000 7f8dc8d9f700 1 -- 172.21.15.82:0/2533389794 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db400eb90 con 0x7f8db0004140 2023-11-28T13:07:55.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.494+0000 7f8dcada3700 1 -- 172.21.15.82:0/2533389794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8db0004140 msgr2=0x7f8db0004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.494+0000 7f8dcada3700 1 --2- 172.21.15.82:0/2533389794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8db0004140 0x7f8db0004870 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f8db4009b40 tx=0x7f8db00058a0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.494+0000 7f8dca5a2700 1 -- 172.21.15.82:0/2533389794 reap_dead start 2023-11-28T13:07:55.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.494+0000 7f8dcada3700 1 -- 172.21.15.82:0/2533389794 shutdown_connections 2023-11-28T13:07:55.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.494+0000 7f8dcada3700 1 -- 172.21.15.82:0/2533389794 >> 172.21.15.82:0/2533389794 conn(0x7f8dbc055c80 msgr2=0x7f8dbc056080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:55.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.494+0000 7f8dcada3700 1 -- 172.21.15.82:0/2533389794 shutdown_connections 2023-11-28T13:07:55.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.494+0000 7f8dcada3700 1 -- 172.21.15.82:0/2533389794 wait complete. 2023-11-28T13:07:55.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.494+0000 7f8dcada3700 1 Processor -- start 2023-11-28T13:07:55.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.494+0000 7f8dcada3700 1 -- start start 2023-11-28T13:07:55.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.494+0000 7f8dcada3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8dbc0dd770 0x7f8dbc0e3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.494+0000 7f8dcada3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dbc050cb0 0x7f8dbc0e4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.494+0000 7f8dcada3700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8dbc0502d0 0x7f8dbc04cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.494+0000 7f8dcada3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc04dbf0 con 0x7f8dbc050cb0 2023-11-28T13:07:55.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.494+0000 7f8dcada3700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc04ded0 con 0x7f8dbc0dd770 2023-11-28T13:07:55.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.494+0000 7f8dcada3700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc04e1b0 con 0x7f8dbc0502d0 2023-11-28T13:07:55.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.498+0000 7f8dc95a0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dbc050cb0 0x7f8dbc0e4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.498+0000 7f8dc95a0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dbc050cb0 0x7f8dbc0e4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50524/0 (socket says 172.21.15.82:50524) 2023-11-28T13:07:55.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.498+0000 7f8dc95a0700 1 -- 172.21.15.82:0/2736243978 learned_addr learned my addr 172.21.15.82:0/2736243978 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:55.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.498+0000 7f8dca5a2700 1 --2- 172.21.15.82:0/2736243978 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8dbc0502d0 0x7f8dbc04cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.498+0000 7f8dc9da1700 1 --2- 172.21.15.82:0/2736243978 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8dbc0dd770 0x7f8dbc0e3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.498+0000 7f8dc95a0700 1 -- 172.21.15.82:0/2736243978 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8dbc0502d0 msgr2=0x7f8dbc04cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.498+0000 7f8dc95a0700 1 --2- 172.21.15.82:0/2736243978 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8dbc0502d0 0x7f8dbc04cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.498+0000 7f8dc95a0700 1 -- 172.21.15.82:0/2736243978 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8dbc0dd770 msgr2=0x7f8dbc0e3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.498+0000 7f8dc95a0700 1 --2- 172.21.15.82:0/2736243978 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8dbc0dd770 0x7f8dbc0e3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.498+0000 7f8dc95a0700 1 -- 172.21.15.82:0/2736243978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc0e7330 con 0x7f8dbc050cb0 2023-11-28T13:07:55.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.498+0000 7f8dc95a0700 1 --2- 172.21.15.82:0/2736243978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dbc050cb0 0x7f8dbc0e4530 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f8db4016000 tx=0x7f8db40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:55.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.498+0000 7f8dba7fc700 1 -- 172.21.15.82:0/2736243978 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db400e6c0 con 0x7f8dbc050cb0 2023-11-28T13:07:55.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.498+0000 7f8dba7fc700 1 -- 172.21.15.82:0/2736243978 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db40038e0 con 0x7f8dbc050cb0 2023-11-28T13:07:55.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.498+0000 7f8dcada3700 1 -- 172.21.15.82:0/2736243978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dbc058cd0 con 0x7f8dbc050cb0 2023-11-28T13:07:55.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.498+0000 7f8dba7fc700 1 -- 172.21.15.82:0/2736243978 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db4003c90 con 0x7f8dbc050cb0 2023-11-28T13:07:55.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.498+0000 7f8dcada3700 1 -- 172.21.15.82:0/2736243978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dbc0e2c90 con 0x7f8dbc050cb0 2023-11-28T13:07:55.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.498+0000 7f8dcada3700 1 -- 172.21.15.82:0/2736243978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8dbc04dd60 con 0x7f8dbc050cb0 2023-11-28T13:07:55.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.502+0000 7f8dba7fc700 1 -- 172.21.15.82:0/2736243978 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8db402c030 con 0x7f8dbc050cb0 2023-11-28T13:07:55.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.502+0000 7f8dba7fc700 1 --2- 172.21.15.82:0/2736243978 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8da8064ee0 0x7f8da8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.502+0000 7f8dba7fc700 1 -- 172.21.15.82:0/2736243978 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8db4082b90 con 0x7f8dbc050cb0 2023-11-28T13:07:55.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.502+0000 7f8dc9da1700 1 --2- 172.21.15.82:0/2736243978 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8da8064ee0 0x7f8da8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.502+0000 7f8dba7fc700 1 --2- 172.21.15.82:0/2736243978 >> [v2:172.21.15.82:6824/36636,v1:172.21.15.82:6825/36636] conn(0x7f8da806b350 0x7f8da806d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.502+0000 7f8dba7fc700 1 -- 172.21.15.82:0/2736243978 --> [v2:172.21.15.82:6824/36636,v1:172.21.15.82:6825/36636] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8da806de10 con 0x7f8da806b350 2023-11-28T13:07:55.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.502+0000 7f8dba7fc700 1 -- 172.21.15.82:0/2736243978 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8db40872a0 con 0x7f8dbc050cb0 2023-11-28T13:07:55.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.502+0000 7f8dca5a2700 1 --2- 172.21.15.82:0/2736243978 >> [v2:172.21.15.82:6824/36636,v1:172.21.15.82:6825/36636] conn(0x7f8da806b350 0x7f8da806d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.502+0000 7f8dc9da1700 1 --2- 172.21.15.82:0/2736243978 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8da8064ee0 0x7f8da8067390 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0001d00 tx=0x7f8dc00079a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:55.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.502+0000 7f8dca5a2700 1 --2- 172.21.15.82:0/2736243978 >> [v2:172.21.15.82:6824/36636,v1:172.21.15.82:6825/36636] conn(0x7f8da806b350 0x7f8da806d760 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:55.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.502+0000 7f8dba7fc700 1 -- 172.21.15.82:0/2736243978 <== osd.2 v2:172.21.15.82:6824/36636 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8da806de10 con 0x7f8da806b350 2023-11-28T13:07:55.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.518+0000 7f8dcada3700 1 -- 172.21.15.82:0/2736243978 --> [v2:172.21.15.82:6824/36636,v1:172.21.15.82:6825/36636] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8dbc04dbf0 con 0x7f8da806b350 2023-11-28T13:07:55.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.518+0000 7f8dba7fc700 1 -- 172.21.15.82:0/2736243978 <== osd.2 v2:172.21.15.82:6824/36636 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8dbc04dbf0 con 0x7f8da806b350 2023-11-28T13:07:55.524 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:07:55.525 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T13:07:55.525 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:07:55.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.518+0000 7f8dcada3700 1 -- 172.21.15.82:0/2736243978 >> [v2:172.21.15.82:6824/36636,v1:172.21.15.82:6825/36636] conn(0x7f8da806b350 msgr2=0x7f8da806d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.518+0000 7f8dcada3700 1 --2- 172.21.15.82:0/2736243978 >> [v2:172.21.15.82:6824/36636,v1:172.21.15.82:6825/36636] conn(0x7f8da806b350 0x7f8da806d760 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.518+0000 7f8dcada3700 1 -- 172.21.15.82:0/2736243978 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8da8064ee0 msgr2=0x7f8da8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.518+0000 7f8dcada3700 1 --2- 172.21.15.82:0/2736243978 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f8da8064ee0 0x7f8da8067390 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0001d00 tx=0x7f8dc00079a0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.518+0000 7f8dcada3700 1 -- 172.21.15.82:0/2736243978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dbc050cb0 msgr2=0x7f8dbc0e4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.518+0000 7f8dcada3700 1 --2- 172.21.15.82:0/2736243978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dbc050cb0 0x7f8dbc0e4530 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f8db4016000 tx=0x7f8db40047e0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.518+0000 7f8dca5a2700 1 -- 172.21.15.82:0/2736243978 reap_dead start 2023-11-28T13:07:55.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.518+0000 7f8dcada3700 1 -- 172.21.15.82:0/2736243978 shutdown_connections 2023-11-28T13:07:55.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.518+0000 7f8dcada3700 1 -- 172.21.15.82:0/2736243978 >> 172.21.15.82:0/2736243978 conn(0x7f8dbc055c80 msgr2=0x7f8dbc03d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:55.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.518+0000 7f8dcada3700 1 -- 172.21.15.82:0/2736243978 shutdown_connections 2023-11-28T13:07:55.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.518+0000 7f8dcada3700 1 -- 172.21.15.82:0/2736243978 wait complete. 2023-11-28T13:07:55.537 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-28T13:07:55.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.650+0000 7f7d2cf5c700 1 Processor -- start 2023-11-28T13:07:55.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.650+0000 7f7d2cf5c700 1 -- start start 2023-11-28T13:07:55.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.650+0000 7f7d2cf5c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7d280703e0 0x7f7d280707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.650+0000 7f7d2cf5c700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d28070cf0 con 0x7f7d28160b20 2023-11-28T13:07:55.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.650+0000 7f7d2cf5c700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d280ce680 con 0x7f7d280ade20 2023-11-28T13:07:55.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.650+0000 7f7d2cf5c700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d28069c60 con 0x7f7d280703e0 2023-11-28T13:07:55.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.650+0000 7f7d25d9b700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7d28160b20 0x7f7d280ad710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52644/0 (socket says 172.21.15.82:52644) 2023-11-28T13:07:55.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.650+0000 7f7d2659c700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7d280703e0 0x7f7d280707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.650+0000 7f7d25d9b700 1 -- 172.21.15.82:0/1953476697 learned_addr learned my addr 172.21.15.82:0/1953476697 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:55.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.650+0000 7f7d2559a700 1 -- 172.21.15.82:0/1953476697 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794458331 0 0) 0x7f7d28070cf0 con 0x7f7d28160b20 2023-11-28T13:07:55.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.650+0000 7f7d2559a700 1 -- 172.21.15.82:0/1953476697 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d140035d0 con 0x7f7d28160b20 2023-11-28T13:07:55.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.650+0000 7f7d2659c700 1 -- 172.21.15.82:0/1953476697 >> v1:172.21.15.114:6789/0 conn(0x7f7d280ade20 legacy=0x7f7d280ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.650+0000 7f7d2659c700 1 -- 172.21.15.82:0/1953476697 >> v1:172.21.15.82:6789/0 conn(0x7f7d28160b20 legacy=0x7f7d280ad710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.650+0000 7f7d2659c700 1 -- 172.21.15.82:0/1953476697 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d28069f40 con 0x7f7d280703e0 2023-11-28T13:07:55.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.650+0000 7f7d2659c700 1 --2- 172.21.15.82:0/1953476697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d280703e0 0x7f7d280707b0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009850 tx=0x7f7d10009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b211745c67bf6e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:55.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.650+0000 7f7d2559a700 1 -- 172.21.15.82:0/1953476697 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d10011830 con 0x7f7d280703e0 2023-11-28T13:07:55.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.650+0000 7f7d2559a700 1 -- 172.21.15.82:0/1953476697 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d10011990 con 0x7f7d280703e0 2023-11-28T13:07:55.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.650+0000 7f7d2559a700 1 -- 172.21.15.82:0/1953476697 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d10011d40 con 0x7f7d280703e0 2023-11-28T13:07:55.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.650+0000 7f7d2cf5c700 1 -- 172.21.15.82:0/1953476697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d280703e0 msgr2=0x7f7d280707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.650+0000 7f7d2cf5c700 1 --2- 172.21.15.82:0/1953476697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d280703e0 0x7f7d280707b0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009850 tx=0x7f7d10009b60 comp rx=0 tx=0).stop 2023-11-28T13:07:55.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.654+0000 7f7d2cf5c700 1 -- 172.21.15.82:0/1953476697 shutdown_connections 2023-11-28T13:07:55.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.654+0000 7f7d2cf5c700 1 --2- 172.21.15.82:0/1953476697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d280703e0 0x7f7d280707b0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.654+0000 7f7d2cf5c700 1 -- 172.21.15.82:0/1953476697 >> 172.21.15.82:0/1953476697 conn(0x7f7d280ce9b0 msgr2=0x7f7d280ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:55.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.654+0000 7f7d2cf5c700 1 -- 172.21.15.82:0/1953476697 shutdown_connections 2023-11-28T13:07:55.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.654+0000 7f7d2cf5c700 1 -- 172.21.15.82:0/1953476697 wait complete. 2023-11-28T13:07:55.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.654+0000 7f7d2cf5c700 1 Processor -- start 2023-11-28T13:07:55.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.654+0000 7f7d2cf5c700 1 -- start start 2023-11-28T13:07:55.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.654+0000 7f7d2cf5c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d280703e0 0x7f7d2815c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.654+0000 7f7d2cf5c700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d280ade20 0x7f7d280af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.654+0000 7f7d2cf5c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d28160b20 0x7f7d280af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.654+0000 7f7d2cf5c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d281e9c90 con 0x7f7d280703e0 2023-11-28T13:07:55.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.654+0000 7f7d2cf5c700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d280c4c60 con 0x7f7d28160b20 2023-11-28T13:07:55.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.654+0000 7f7d2cf5c700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d281e90e0 con 0x7f7d280ade20 2023-11-28T13:07:55.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.654+0000 7f7d2659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d280703e0 0x7f7d2815c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.654+0000 7f7d2659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d280703e0 0x7f7d2815c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50540/0 (socket says 172.21.15.82:50540) 2023-11-28T13:07:55.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.654+0000 7f7d2659c700 1 -- 172.21.15.82:0/3276981997 learned_addr learned my addr 172.21.15.82:0/3276981997 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:55.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.658+0000 7f7d25d9b700 1 --2- 172.21.15.82:0/3276981997 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d280ade20 0x7f7d280af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.658+0000 7f7d26d9d700 1 --2- 172.21.15.82:0/3276981997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d28160b20 0x7f7d280af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.658+0000 7f7d2659c700 1 -- 172.21.15.82:0/3276981997 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d280ade20 msgr2=0x7f7d280af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.658+0000 7f7d2659c700 1 --2- 172.21.15.82:0/3276981997 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d280ade20 0x7f7d280af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.658+0000 7f7d2659c700 1 -- 172.21.15.82:0/3276981997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d28160b20 msgr2=0x7f7d280af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.658+0000 7f7d2659c700 1 --2- 172.21.15.82:0/3276981997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d28160b20 0x7f7d280af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.658+0000 7f7d2659c700 1 -- 172.21.15.82:0/3276981997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d100094b0 con 0x7f7d280703e0 2023-11-28T13:07:55.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.658+0000 7f7d2659c700 1 --2- 172.21.15.82:0/3276981997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d280703e0 0x7f7d2815c890 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f7d10000c00 tx=0x7f7d10004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:55.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.658+0000 7f7d1effd700 1 -- 172.21.15.82:0/3276981997 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1001a840 con 0x7f7d280703e0 2023-11-28T13:07:55.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.658+0000 7f7d1effd700 1 -- 172.21.15.82:0/3276981997 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1001f070 con 0x7f7d280703e0 2023-11-28T13:07:55.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.658+0000 7f7d2cf5c700 1 -- 172.21.15.82:0/3276981997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d2806a500 con 0x7f7d280703e0 2023-11-28T13:07:55.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.658+0000 7f7d1effd700 1 -- 172.21.15.82:0/3276981997 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1001abe0 con 0x7f7d280703e0 2023-11-28T13:07:55.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.658+0000 7f7d2cf5c700 1 -- 172.21.15.82:0/3276981997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d2806a220 con 0x7f7d280703e0 2023-11-28T13:07:55.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.658+0000 7f7d2cf5c700 1 -- 172.21.15.82:0/3276981997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d2806a7e0 con 0x7f7d280703e0 2023-11-28T13:07:55.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.658+0000 7f7d1effd700 1 -- 172.21.15.82:0/3276981997 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7d1000f050 con 0x7f7d280703e0 2023-11-28T13:07:55.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.658+0000 7f7d1effd700 1 --2- 172.21.15.82:0/3276981997 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7d08064ee0 0x7f7d08067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.658+0000 7f7d1effd700 1 -- 172.21.15.82:0/3276981997 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7d10021070 con 0x7f7d280703e0 2023-11-28T13:07:55.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.658+0000 7f7d25d9b700 1 --2- 172.21.15.82:0/3276981997 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7d08064ee0 0x7f7d08067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.662+0000 7f7d25d9b700 1 --2- 172.21.15.82:0/3276981997 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7d08064ee0 0x7f7d08067390 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7d280b0250 tx=0x7f7d200019f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:55.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.662+0000 7f7d1effd700 1 -- 172.21.15.82:0/3276981997 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7d10051860 con 0x7f7d280703e0 2023-11-28T13:07:55.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.826+0000 7f7d2cf5c700 1 -- 172.21.15.82:0/3276981997 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d280c1b00 con 0x7f7d08064ee0 2023-11-28T13:07:55.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.826+0000 7f7d1effd700 1 -- 172.21.15.82:0/3276981997 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7d280c1b00 con 0x7f7d08064ee0 2023-11-28T13:07:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.830+0000 7f7d2cf5c700 1 -- 172.21.15.82:0/3276981997 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7d08064ee0 msgr2=0x7f7d08067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.830+0000 7f7d2cf5c700 1 --2- 172.21.15.82:0/3276981997 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7d08064ee0 0x7f7d08067390 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7d280b0250 tx=0x7f7d200019f0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.830+0000 7f7d2cf5c700 1 -- 172.21.15.82:0/3276981997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d280703e0 msgr2=0x7f7d2815c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.830+0000 7f7d2cf5c700 1 --2- 172.21.15.82:0/3276981997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d280703e0 0x7f7d2815c890 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f7d10000c00 tx=0x7f7d10004770 comp rx=0 tx=0).stop 2023-11-28T13:07:55.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.830+0000 7f7d2cf5c700 1 -- 172.21.15.82:0/3276981997 shutdown_connections 2023-11-28T13:07:55.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.830+0000 7f7d2cf5c700 1 --2- 172.21.15.82:0/3276981997 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7d08064ee0 0x7f7d08067390 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.830+0000 7f7d2cf5c700 1 --2- 172.21.15.82:0/3276981997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d28160b20 0x7f7d280af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.830+0000 7f7d2cf5c700 1 --2- 172.21.15.82:0/3276981997 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d280ade20 0x7f7d280af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.830+0000 7f7d2cf5c700 1 --2- 172.21.15.82:0/3276981997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d280703e0 0x7f7d2815c890 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.830+0000 7f7d2cf5c700 1 -- 172.21.15.82:0/3276981997 >> 172.21.15.82:0/3276981997 conn(0x7f7d280ce9b0 msgr2=0x7f7d2806d050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:55.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.830+0000 7f7d2cf5c700 1 -- 172.21.15.82:0/3276981997 shutdown_connections 2023-11-28T13:07:55.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.830+0000 7f7d2cf5c700 1 -- 172.21.15.82:0/3276981997 wait complete. 2023-11-28T13:07:55.838 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 2 to deep-scrub 2023-11-28T13:07:55.849 INFO:tasks.ceph:Scrubbing osd.3 2023-11-28T13:07:55.850 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-28T13:07:55.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.966+0000 7fba0bfff700 1 Processor -- start 2023-11-28T13:07:55.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.966+0000 7fba0bfff700 1 -- start start 2023-11-28T13:07:55.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0bfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fba040df660 0x7fba04054850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0bfff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fba04055570 0x7fba04052190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0bfff700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba04055b10 con 0x7fba04037960 2023-11-28T13:07:55.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0bfff700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba04053ab0 con 0x7fba04055570 2023-11-28T13:07:55.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0bfff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba04053d90 con 0x7fba040df660 2023-11-28T13:07:55.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0a7fc700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fba04055570 0x7fba04052190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0b7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fba04037960 0x7fba04037d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52654/0 (socket says 172.21.15.82:52654) 2023-11-28T13:07:55.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0b7fe700 1 -- 172.21.15.82:0/2379420170 learned_addr learned my addr 172.21.15.82:0/2379420170 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:55.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0affd700 1 --2- 172.21.15.82:0/2379420170 >> v2:172.21.15.114:3300/0 conn(0x7fba040df660 0x7fba04054850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0a7fc700 1 -- 172.21.15.82:0/2379420170 >> v2:172.21.15.114:3300/0 conn(0x7fba040df660 msgr2=0x7fba04054850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:55.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0a7fc700 1 --2- 172.21.15.82:0/2379420170 >> v2:172.21.15.114:3300/0 conn(0x7fba040df660 0x7fba04054850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0a7fc700 1 -- 172.21.15.82:0/2379420170 >> v1:172.21.15.82:6789/0 conn(0x7fba04037960 legacy=0x7fba04037d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0a7fc700 1 -- 172.21.15.82:0/2379420170 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba04054070 con 0x7fba04055570 2023-11-28T13:07:55.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0a7fc700 1 --2- 172.21.15.82:0/2379420170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba04055570 0x7fba04052190 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fba04038ad0 tx=0x7fb9fc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267c896eda53f037 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:55.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba09ffb700 1 -- 172.21.15.82:0/2379420170 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc00f8a0 con 0x7fba04055570 2023-11-28T13:07:55.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba09ffb700 1 -- 172.21.15.82:0/2379420170 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc00fa00 con 0x7fba04055570 2023-11-28T13:07:55.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba09ffb700 1 -- 172.21.15.82:0/2379420170 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc00fd90 con 0x7fba04055570 2023-11-28T13:07:55.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0bfff700 1 -- 172.21.15.82:0/2379420170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba04055570 msgr2=0x7fba04052190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0bfff700 1 --2- 172.21.15.82:0/2379420170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba04055570 0x7fba04052190 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fba04038ad0 tx=0x7fb9fc009b30 comp rx=0 tx=0).stop 2023-11-28T13:07:55.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0bfff700 1 -- 172.21.15.82:0/2379420170 shutdown_connections 2023-11-28T13:07:55.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0bfff700 1 --2- 172.21.15.82:0/2379420170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba04055570 0x7fba04052190 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0bfff700 1 --2- 172.21.15.82:0/2379420170 >> v2:172.21.15.114:3300/0 conn(0x7fba040df660 0x7fba04054850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0bfff700 1 -- 172.21.15.82:0/2379420170 >> 172.21.15.82:0/2379420170 conn(0x7fba04052960 msgr2=0x7fba04052d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:55.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0bfff700 1 -- 172.21.15.82:0/2379420170 shutdown_connections 2023-11-28T13:07:55.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.970+0000 7fba0bfff700 1 -- 172.21.15.82:0/2379420170 wait complete. 2023-11-28T13:07:55.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.974+0000 7fba0bfff700 1 Processor -- start 2023-11-28T13:07:55.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.974+0000 7fba0bfff700 1 -- start start 2023-11-28T13:07:55.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.974+0000 7fba0bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba04037960 0x7fba04173710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.974+0000 7fba0bfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba04055570 0x7fba0404bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.974+0000 7fba0bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba040df660 0x7fba040c4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.974+0000 7fba0bfff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba04173c50 con 0x7fba04037960 2023-11-28T13:07:55.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.974+0000 7fba0bfff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0404c480 con 0x7fba040df660 2023-11-28T13:07:55.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.974+0000 7fba0bfff700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba040e2b70 con 0x7fba04055570 2023-11-28T13:07:55.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.978+0000 7fba0affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba04037960 0x7fba04173710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.978+0000 7fba0affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba04037960 0x7fba04173710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50566/0 (socket says 172.21.15.82:50566) 2023-11-28T13:07:55.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.978+0000 7fba0affd700 1 -- 172.21.15.82:0/4130458818 learned_addr learned my addr 172.21.15.82:0/4130458818 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:55.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.978+0000 7fba0b7fe700 1 --2- 172.21.15.82:0/4130458818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba040df660 0x7fba040c4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.978+0000 7fba0a7fc700 1 --2- 172.21.15.82:0/4130458818 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba04055570 0x7fba0404bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.978+0000 7fba0affd700 1 -- 172.21.15.82:0/4130458818 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba04055570 msgr2=0x7fba0404bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.978+0000 7fba0affd700 1 --2- 172.21.15.82:0/4130458818 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba04055570 0x7fba0404bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.978+0000 7fba0affd700 1 -- 172.21.15.82:0/4130458818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba040df660 msgr2=0x7fba040c4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:55.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.978+0000 7fba0affd700 1 --2- 172.21.15.82:0/4130458818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba040df660 0x7fba040c4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:55.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.978+0000 7fba0affd700 1 -- 172.21.15.82:0/4130458818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc0094b0 con 0x7fba04037960 2023-11-28T13:07:55.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.978+0000 7fba0affd700 1 --2- 172.21.15.82:0/4130458818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba04037960 0x7fba04173710 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fb9f400e9d0 tx=0x7fb9f400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:55.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.978+0000 7fba03fff700 1 -- 172.21.15.82:0/4130458818 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4009720 con 0x7fba04037960 2023-11-28T13:07:55.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.978+0000 7fba03fff700 1 -- 172.21.15.82:0/4130458818 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f400ee70 con 0x7fba04037960 2023-11-28T13:07:55.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.978+0000 7fba0bfff700 1 -- 172.21.15.82:0/4130458818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba040526d0 con 0x7fba04037960 2023-11-28T13:07:55.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.978+0000 7fba03fff700 1 -- 172.21.15.82:0/4130458818 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f400ca50 con 0x7fba04037960 2023-11-28T13:07:55.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.978+0000 7fba0bfff700 1 -- 172.21.15.82:0/4130458818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba04054350 con 0x7fba04037960 2023-11-28T13:07:55.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.978+0000 7fba0bfff700 1 -- 172.21.15.82:0/4130458818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fba040dfa30 con 0x7fba04037960 2023-11-28T13:07:55.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.978+0000 7fba03fff700 1 -- 172.21.15.82:0/4130458818 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb9f4019030 con 0x7fba04037960 2023-11-28T13:07:55.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.982+0000 7fba03fff700 1 --2- 172.21.15.82:0/4130458818 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb9ec064f10 0x7fb9ec0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.982+0000 7fba03fff700 1 -- 172.21.15.82:0/4130458818 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb9f4081ac0 con 0x7fba04037960 2023-11-28T13:07:55.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.982+0000 7fba0a7fc700 1 --2- 172.21.15.82:0/4130458818 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb9ec064f10 0x7fb9ec0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.982+0000 7fba03fff700 1 --2- 172.21.15.82:0/4130458818 >> [v2:172.21.15.82:6800/36627,v1:172.21.15.82:6801/36627] conn(0x7fb9ec06b380 0x7fb9ec06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:55.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.982+0000 7fba03fff700 1 -- 172.21.15.82:0/4130458818 --> [v2:172.21.15.82:6800/36627,v1:172.21.15.82:6801/36627] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb9ec06de40 con 0x7fb9ec06b380 2023-11-28T13:07:55.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.982+0000 7fba03fff700 1 -- 172.21.15.82:0/4130458818 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9f40862a0 con 0x7fba04037960 2023-11-28T13:07:55.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.982+0000 7fba0b7fe700 1 --2- 172.21.15.82:0/4130458818 >> [v2:172.21.15.82:6800/36627,v1:172.21.15.82:6801/36627] conn(0x7fb9ec06b380 0x7fb9ec06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:55.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.982+0000 7fba0a7fc700 1 --2- 172.21.15.82:0/4130458818 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb9ec064f10 0x7fb9ec0673c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc000c00 tx=0x7fb9fc01b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:55.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.982+0000 7fba0b7fe700 1 --2- 172.21.15.82:0/4130458818 >> [v2:172.21.15.82:6800/36627,v1:172.21.15.82:6801/36627] conn(0x7fb9ec06b380 0x7fb9ec06d790 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:55.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:55.982+0000 7fba03fff700 1 -- 172.21.15.82:0/4130458818 <== osd.3 v2:172.21.15.82:6800/36627 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb9ec06de40 con 0x7fb9ec06b380 2023-11-28T13:07:56.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.002+0000 7fba0bfff700 1 -- 172.21.15.82:0/4130458818 --> [v2:172.21.15.82:6800/36627,v1:172.21.15.82:6801/36627] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fba04005990 con 0x7fb9ec06b380 2023-11-28T13:07:56.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.002+0000 7fba03fff700 1 -- 172.21.15.82:0/4130458818 <== osd.3 v2:172.21.15.82:6800/36627 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fba04005990 con 0x7fb9ec06b380 2023-11-28T13:07:56.010 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:07:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T13:07:56.011 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:07:56.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.002+0000 7fba0bfff700 1 -- 172.21.15.82:0/4130458818 >> [v2:172.21.15.82:6800/36627,v1:172.21.15.82:6801/36627] conn(0x7fb9ec06b380 msgr2=0x7fb9ec06d790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.002+0000 7fba0bfff700 1 --2- 172.21.15.82:0/4130458818 >> [v2:172.21.15.82:6800/36627,v1:172.21.15.82:6801/36627] conn(0x7fb9ec06b380 0x7fb9ec06d790 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.002+0000 7fba0bfff700 1 -- 172.21.15.82:0/4130458818 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb9ec064f10 msgr2=0x7fb9ec0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.002+0000 7fba0bfff700 1 --2- 172.21.15.82:0/4130458818 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fb9ec064f10 0x7fb9ec0673c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc000c00 tx=0x7fb9fc01b040 comp rx=0 tx=0).stop 2023-11-28T13:07:56.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.002+0000 7fba0bfff700 1 -- 172.21.15.82:0/4130458818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba04037960 msgr2=0x7fba04173710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.002+0000 7fba0bfff700 1 --2- 172.21.15.82:0/4130458818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba04037960 0x7fba04173710 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fb9f400e9d0 tx=0x7fb9f400ece0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.002+0000 7fba0b7fe700 1 -- 172.21.15.82:0/4130458818 reap_dead start 2023-11-28T13:07:56.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.002+0000 7fba0bfff700 1 -- 172.21.15.82:0/4130458818 shutdown_connections 2023-11-28T13:07:56.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.002+0000 7fba0bfff700 1 -- 172.21.15.82:0/4130458818 >> 172.21.15.82:0/4130458818 conn(0x7fba04052960 msgr2=0x7fba040dcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:56.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.002+0000 7fba0bfff700 1 -- 172.21.15.82:0/4130458818 shutdown_connections 2023-11-28T13:07:56.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.002+0000 7fba0bfff700 1 -- 172.21.15.82:0/4130458818 wait complete. 2023-11-28T13:07:56.024 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-28T13:07:56.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe4cc73700 1 Processor -- start 2023-11-28T13:07:56.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe4cc73700 1 -- start start 2023-11-28T13:07:56.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe4cc73700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbe480b3910 0x7fbe4806b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe4cc73700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe4806c910 0x7fbe4806d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe4cc73700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4806c480 con 0x7fbe48070070 2023-11-28T13:07:56.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe4cc73700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4806dbe0 con 0x7fbe480b3910 2023-11-28T13:07:56.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe4cc73700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4806dec0 con 0x7fbe4806c910 2023-11-28T13:07:56.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe47fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbe48070070 0x7fbe4815db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52670/0 (socket says 172.21.15.82:52670) 2023-11-28T13:07:56.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe47fff700 1 -- 172.21.15.82:0/782319388 learned_addr learned my addr 172.21.15.82:0/782319388 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:56.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe477fe700 1 --2- 172.21.15.82:0/782319388 >> v2:172.21.15.114:3300/0 conn(0x7fbe480b3910 0x7fbe4806b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe46ffd700 1 --2- 172.21.15.82:0/782319388 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe4806c910 0x7fbe4806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe467fc700 1 -- 172.21.15.82:0/782319388 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441785590 0 0) 0x7fbe4806c480 con 0x7fbe48070070 2023-11-28T13:07:56.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe467fc700 1 -- 172.21.15.82:0/782319388 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe300035d0 con 0x7fbe48070070 2023-11-28T13:07:56.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe477fe700 1 -- 172.21.15.82:0/782319388 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe4806c910 msgr2=0x7fbe4806d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:56.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe477fe700 1 --2- 172.21.15.82:0/782319388 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe4806c910 0x7fbe4806d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe477fe700 1 -- 172.21.15.82:0/782319388 >> v1:172.21.15.82:6789/0 conn(0x7fbe48070070 legacy=0x7fbe4815db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe477fe700 1 -- 172.21.15.82:0/782319388 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4806c110 con 0x7fbe480b3910 2023-11-28T13:07:56.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe477fe700 1 --2- 172.21.15.82:0/782319388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe480b3910 0x7fbe4806b0a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c009850 tx=0x7fbe3c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a830b7a40c10bb1e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:56.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe467fc700 1 -- 172.21.15.82:0/782319388 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c011830 con 0x7fbe480b3910 2023-11-28T13:07:56.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe467fc700 1 -- 172.21.15.82:0/782319388 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c011990 con 0x7fbe480b3910 2023-11-28T13:07:56.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe467fc700 1 -- 172.21.15.82:0/782319388 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c011d40 con 0x7fbe480b3910 2023-11-28T13:07:56.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe4cc73700 1 -- 172.21.15.82:0/782319388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe480b3910 msgr2=0x7fbe4806b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe4cc73700 1 --2- 172.21.15.82:0/782319388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe480b3910 0x7fbe4806b0a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c009850 tx=0x7fbe3c009b60 comp rx=0 tx=0).stop 2023-11-28T13:07:56.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe4cc73700 1 -- 172.21.15.82:0/782319388 shutdown_connections 2023-11-28T13:07:56.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe4cc73700 1 --2- 172.21.15.82:0/782319388 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe4806c910 0x7fbe4806d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe4cc73700 1 --2- 172.21.15.82:0/782319388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe480b3910 0x7fbe4806b0a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe4cc73700 1 -- 172.21.15.82:0/782319388 >> 172.21.15.82:0/782319388 conn(0x7fbe480ce600 msgr2=0x7fbe480ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:56.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe4cc73700 1 -- 172.21.15.82:0/782319388 shutdown_connections 2023-11-28T13:07:56.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.134+0000 7fbe4cc73700 1 -- 172.21.15.82:0/782319388 wait complete. 2023-11-28T13:07:56.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe4cc73700 1 Processor -- start 2023-11-28T13:07:56.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe4cc73700 1 -- start start 2023-11-28T13:07:56.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe4cc73700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe4806c910 0x7fbe4815b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe4cc73700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe48070070 0x7fbe480c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe4cc73700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe480b3910 0x7fbe4815dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe4cc73700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4815e3e0 con 0x7fbe48070070 2023-11-28T13:07:56.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe4cc73700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4815a710 con 0x7fbe480b3910 2023-11-28T13:07:56.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe4cc73700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4815a9f0 con 0x7fbe4806c910 2023-11-28T13:07:56.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe46ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe48070070 0x7fbe480c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe46ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe48070070 0x7fbe480c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50570/0 (socket says 172.21.15.82:50570) 2023-11-28T13:07:56.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe46ffd700 1 -- 172.21.15.82:0/3564817725 learned_addr learned my addr 172.21.15.82:0/3564817725 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:56.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe477fe700 1 --2- 172.21.15.82:0/3564817725 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe4806c910 0x7fbe4815b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe47fff700 1 --2- 172.21.15.82:0/3564817725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe480b3910 0x7fbe4815dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe46ffd700 1 -- 172.21.15.82:0/3564817725 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe4806c910 msgr2=0x7fbe4815b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe46ffd700 1 --2- 172.21.15.82:0/3564817725 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe4806c910 0x7fbe4815b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe46ffd700 1 -- 172.21.15.82:0/3564817725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe480b3910 msgr2=0x7fbe4815dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe46ffd700 1 --2- 172.21.15.82:0/3564817725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe480b3910 0x7fbe4815dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe46ffd700 1 -- 172.21.15.82:0/3564817725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c0094b0 con 0x7fbe48070070 2023-11-28T13:07:56.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe46ffd700 1 --2- 172.21.15.82:0/3564817725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe48070070 0x7fbe480c7880 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800e840 tx=0x7fbe3800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:56.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe2ffff700 1 -- 172.21.15.82:0/3564817725 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe380095a0 con 0x7fbe48070070 2023-11-28T13:07:56.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe4cc73700 1 -- 172.21.15.82:0/3564817725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe4806d860 con 0x7fbe48070070 2023-11-28T13:07:56.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe2ffff700 1 -- 172.21.15.82:0/3564817725 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe38013680 con 0x7fbe48070070 2023-11-28T13:07:56.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe2ffff700 1 -- 172.21.15.82:0/3564817725 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe380139f0 con 0x7fbe48070070 2023-11-28T13:07:56.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.138+0000 7fbe4cc73700 1 -- 172.21.15.82:0/3564817725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe480c8f80 con 0x7fbe48070070 2023-11-28T13:07:56.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.142+0000 7fbe2ffff700 1 -- 172.21.15.82:0/3564817725 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbe38019030 con 0x7fbe48070070 2023-11-28T13:07:56.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.142+0000 7fbe4cc73700 1 -- 172.21.15.82:0/3564817725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe480b3ce0 con 0x7fbe48070070 2023-11-28T13:07:56.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.142+0000 7fbe2ffff700 1 --2- 172.21.15.82:0/3564817725 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbe34064ee0 0x7fbe34067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.142+0000 7fbe2ffff700 1 -- 172.21.15.82:0/3564817725 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fbe380819e0 con 0x7fbe48070070 2023-11-28T13:07:56.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.142+0000 7fbe477fe700 1 --2- 172.21.15.82:0/3564817725 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbe34064ee0 0x7fbe34067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.142+0000 7fbe477fe700 1 --2- 172.21.15.82:0/3564817725 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbe34064ee0 0x7fbe34067390 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0090b0 tx=0x7fbe3c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:56.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.150+0000 7fbe2ffff700 1 -- 172.21.15.82:0/3564817725 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbe3804fe00 con 0x7fbe48070070 2023-11-28T13:07:56.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.310+0000 7fbe4cc73700 1 -- 172.21.15.82:0/3564817725 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe48065fc0 con 0x7fbe34064ee0 2023-11-28T13:07:56.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.310+0000 7fbe2ffff700 1 -- 172.21.15.82:0/3564817725 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbe48065fc0 con 0x7fbe34064ee0 2023-11-28T13:07:56.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.314+0000 7fbe4cc73700 1 -- 172.21.15.82:0/3564817725 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbe34064ee0 msgr2=0x7fbe34067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.314+0000 7fbe4cc73700 1 --2- 172.21.15.82:0/3564817725 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbe34064ee0 0x7fbe34067390 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0090b0 tx=0x7fbe3c008030 comp rx=0 tx=0).stop 2023-11-28T13:07:56.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.314+0000 7fbe4cc73700 1 -- 172.21.15.82:0/3564817725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe48070070 msgr2=0x7fbe480c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.314+0000 7fbe4cc73700 1 --2- 172.21.15.82:0/3564817725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe48070070 0x7fbe480c7880 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800e840 tx=0x7fbe3800eb50 comp rx=0 tx=0).stop 2023-11-28T13:07:56.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.314+0000 7fbe4cc73700 1 -- 172.21.15.82:0/3564817725 shutdown_connections 2023-11-28T13:07:56.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.314+0000 7fbe4cc73700 1 --2- 172.21.15.82:0/3564817725 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fbe34064ee0 0x7fbe34067390 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.314+0000 7fbe4cc73700 1 --2- 172.21.15.82:0/3564817725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe480b3910 0x7fbe4815dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.314+0000 7fbe4cc73700 1 --2- 172.21.15.82:0/3564817725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe48070070 0x7fbe480c7880 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.314+0000 7fbe4cc73700 1 --2- 172.21.15.82:0/3564817725 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbe4806c910 0x7fbe4815b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.314+0000 7fbe4cc73700 1 -- 172.21.15.82:0/3564817725 >> 172.21.15.82:0/3564817725 conn(0x7fbe480ce600 msgr2=0x7fbe480b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:56.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.314+0000 7fbe4cc73700 1 -- 172.21.15.82:0/3564817725 shutdown_connections 2023-11-28T13:07:56.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.314+0000 7fbe4cc73700 1 -- 172.21.15.82:0/3564817725 wait complete. 2023-11-28T13:07:56.325 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 3 to deep-scrub 2023-11-28T13:07:56.337 INFO:tasks.ceph:Scrubbing osd.4 2023-11-28T13:07:56.338 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-28T13:07:56.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.454+0000 7f23d9e3d700 1 Processor -- start 2023-11-28T13:07:56.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.454+0000 7f23d9e3d700 1 -- start start 2023-11-28T13:07:56.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.454+0000 7f23d9e3d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f23d4158e60 0x7f23d40cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.454+0000 7f23d9e3d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f23d40b1830 0x7f23d406b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.454+0000 7f23d9e3d700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d40cd7b0 con 0x7f23d415ca50 2023-11-28T13:07:56.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.454+0000 7f23d9e3d700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d40cda50 con 0x7f23d4158e60 2023-11-28T13:07:56.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.454+0000 7f23d9e3d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d40cdd30 con 0x7f23d40b1830 2023-11-28T13:07:56.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.454+0000 7f23d8e3b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f23d4158e60 0x7f23d40cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.458+0000 7f23d8e3b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f23d4158e60 0x7f23d40cd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50582/0 (socket says 172.21.15.82:50582) 2023-11-28T13:07:56.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.458+0000 7f23d8e3b700 1 -- 172.21.15.82:0/3751386060 learned_addr learned my addr 172.21.15.82:0/3751386060 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:56.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.458+0000 7f23d963c700 1 --2- 172.21.15.82:0/3751386060 >> v2:172.21.15.114:3300/0 conn(0x7f23d40b1830 0x7f23d406b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.458+0000 7f23d8e3b700 1 -- 172.21.15.82:0/3751386060 >> v2:172.21.15.114:3300/0 conn(0x7f23d40b1830 msgr2=0x7f23d406b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:56.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.458+0000 7f23d8e3b700 1 --2- 172.21.15.82:0/3751386060 >> v2:172.21.15.114:3300/0 conn(0x7f23d40b1830 0x7f23d406b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.458+0000 7f23d8e3b700 1 -- 172.21.15.82:0/3751386060 >> v1:172.21.15.114:6789/0 conn(0x7f23d415ca50 legacy=0x7f23d40b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.458+0000 7f23d8e3b700 1 -- 172.21.15.82:0/3751386060 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d40ce010 con 0x7f23d4158e60 2023-11-28T13:07:56.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.458+0000 7f23d8e3b700 1 --2- 172.21.15.82:0/3751386060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d4158e60 0x7f23d40cd270 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f23d40c6670 tx=0x7f23c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9bd3202c16c40c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:56.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.458+0000 7f23d37fe700 1 -- 172.21.15.82:0/3751386060 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c400e070 con 0x7f23d4158e60 2023-11-28T13:07:56.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.458+0000 7f23d37fe700 1 -- 172.21.15.82:0/3751386060 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c400b910 con 0x7f23d4158e60 2023-11-28T13:07:56.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.458+0000 7f23d37fe700 1 -- 172.21.15.82:0/3751386060 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c400bcc0 con 0x7f23d4158e60 2023-11-28T13:07:56.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.458+0000 7f23d9e3d700 1 -- 172.21.15.82:0/3751386060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d4158e60 msgr2=0x7f23d40cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.458+0000 7f23d9e3d700 1 --2- 172.21.15.82:0/3751386060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d4158e60 0x7f23d40cd270 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f23d40c6670 tx=0x7f23c400b330 comp rx=0 tx=0).stop 2023-11-28T13:07:56.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.458+0000 7f23d9e3d700 1 -- 172.21.15.82:0/3751386060 shutdown_connections 2023-11-28T13:07:56.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.458+0000 7f23d9e3d700 1 --2- 172.21.15.82:0/3751386060 >> v2:172.21.15.114:3300/0 conn(0x7f23d40b1830 0x7f23d406b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.458+0000 7f23d9e3d700 1 --2- 172.21.15.82:0/3751386060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d4158e60 0x7f23d40cd270 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.458+0000 7f23d9e3d700 1 -- 172.21.15.82:0/3751386060 >> 172.21.15.82:0/3751386060 conn(0x7f23d40cc120 msgr2=0x7f23d40cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:56.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.458+0000 7f23d9e3d700 1 -- 172.21.15.82:0/3751386060 shutdown_connections 2023-11-28T13:07:56.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.458+0000 7f23d9e3d700 1 -- 172.21.15.82:0/3751386060 wait complete. 2023-11-28T13:07:56.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d9e3d700 1 Processor -- start 2023-11-28T13:07:56.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d9e3d700 1 -- start start 2023-11-28T13:07:56.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d9e3d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23d40b1830 0x7f23d4149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d9e3d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d4158e60 0x7f23d40b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d9e3d700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23d415ca50 0x7f23d40cf680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d9e3d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d414a240 con 0x7f23d4158e60 2023-11-28T13:07:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d9e3d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d40b5030 con 0x7f23d40b1830 2023-11-28T13:07:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d9e3d700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d40b5310 con 0x7f23d415ca50 2023-11-28T13:07:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d4158e60 0x7f23d40b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d4158e60 0x7f23d40b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50598/0 (socket says 172.21.15.82:50598) 2023-11-28T13:07:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d3fff700 1 -- 172.21.15.82:0/2695132781 learned_addr learned my addr 172.21.15.82:0/2695132781 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d8e3b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23d40b1830 0x7f23d4149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d963c700 1 --2- 172.21.15.82:0/2695132781 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23d415ca50 0x7f23d40cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d3fff700 1 -- 172.21.15.82:0/2695132781 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23d415ca50 msgr2=0x7f23d40cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d3fff700 1 --2- 172.21.15.82:0/2695132781 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23d415ca50 0x7f23d40cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d3fff700 1 -- 172.21.15.82:0/2695132781 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23d40b1830 msgr2=0x7f23d4149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d3fff700 1 --2- 172.21.15.82:0/2695132781 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23d40b1830 0x7f23d4149d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d3fff700 1 -- 172.21.15.82:0/2695132781 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c4009b30 con 0x7f23d4158e60 2023-11-28T13:07:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d3fff700 1 --2- 172.21.15.82:0/2695132781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d4158e60 0x7f23d40b47c0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f23bc00c500 tx=0x7f23bc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d17fa700 1 -- 172.21.15.82:0/2695132781 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc0052d0 con 0x7f23d4158e60 2023-11-28T13:07:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d17fa700 1 -- 172.21.15.82:0/2695132781 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23bc005430 con 0x7f23d4158e60 2023-11-28T13:07:56.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d9e3d700 1 -- 172.21.15.82:0/2695132781 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d40ce5d0 con 0x7f23d4158e60 2023-11-28T13:07:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d17fa700 1 -- 172.21.15.82:0/2695132781 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc0055a0 con 0x7f23d4158e60 2023-11-28T13:07:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.462+0000 7f23d9e3d700 1 -- 172.21.15.82:0/2695132781 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d40ce2f0 con 0x7f23d4158e60 2023-11-28T13:07:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.466+0000 7f23d9e3d700 1 -- 172.21.15.82:0/2695132781 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f23d4159230 con 0x7f23d4158e60 2023-11-28T13:07:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.466+0000 7f23d17fa700 1 -- 172.21.15.82:0/2695132781 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f23bc019030 con 0x7f23d4158e60 2023-11-28T13:07:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.466+0000 7f23d17fa700 1 --2- 172.21.15.82:0/2695132781 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f23b8064ee0 0x7f23b8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.466+0000 7f23d17fa700 1 -- 172.21.15.82:0/2695132781 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f23bc081470 con 0x7f23d4158e60 2023-11-28T13:07:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.466+0000 7f23d8e3b700 1 --2- 172.21.15.82:0/2695132781 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f23b8064ee0 0x7f23b8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.466+0000 7f23d17fa700 1 --2- 172.21.15.82:0/2695132781 >> [v2:172.21.15.114:6800/36803,v1:172.21.15.114:6801/36803] conn(0x7f23b806b350 0x7f23b806d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.466+0000 7f23d17fa700 1 -- 172.21.15.82:0/2695132781 --> [v2:172.21.15.114:6800/36803,v1:172.21.15.114:6801/36803] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f23b806de10 con 0x7f23b806b350 2023-11-28T13:07:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.466+0000 7f23d17fa700 1 -- 172.21.15.82:0/2695132781 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23bc0818b0 con 0x7f23d4158e60 2023-11-28T13:07:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.466+0000 7f23d963c700 1 --2- 172.21.15.82:0/2695132781 >> [v2:172.21.15.114:6800/36803,v1:172.21.15.114:6801/36803] conn(0x7f23b806b350 0x7f23b806d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.470+0000 7f23d8e3b700 1 --2- 172.21.15.82:0/2695132781 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f23b8064ee0 0x7f23b8067390 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f23c4000f80 tx=0x7f23c4009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.470+0000 7f23d963c700 1 --2- 172.21.15.82:0/2695132781 >> [v2:172.21.15.114:6800/36803,v1:172.21.15.114:6801/36803] conn(0x7f23b806b350 0x7f23b806d760 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.470+0000 7f23d17fa700 1 -- 172.21.15.82:0/2695132781 <== osd.4 v2:172.21.15.114:6800/36803 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f23b806de10 con 0x7f23b806b350 2023-11-28T13:07:56.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.486+0000 7f23d9e3d700 1 -- 172.21.15.82:0/2695132781 --> [v2:172.21.15.114:6800/36803,v1:172.21.15.114:6801/36803] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f23d4065fc0 con 0x7f23b806b350 2023-11-28T13:07:56.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.486+0000 7f23d17fa700 1 -- 172.21.15.82:0/2695132781 <== osd.4 v2:172.21.15.114:6800/36803 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f23d4065fc0 con 0x7f23b806b350 2023-11-28T13:07:56.495 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:07:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T13:07:56.495 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:07:56.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.490+0000 7f23d9e3d700 1 -- 172.21.15.82:0/2695132781 >> [v2:172.21.15.114:6800/36803,v1:172.21.15.114:6801/36803] conn(0x7f23b806b350 msgr2=0x7f23b806d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.490+0000 7f23d9e3d700 1 --2- 172.21.15.82:0/2695132781 >> [v2:172.21.15.114:6800/36803,v1:172.21.15.114:6801/36803] conn(0x7f23b806b350 0x7f23b806d760 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.490+0000 7f23d9e3d700 1 -- 172.21.15.82:0/2695132781 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f23b8064ee0 msgr2=0x7f23b8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.490+0000 7f23d9e3d700 1 --2- 172.21.15.82:0/2695132781 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f23b8064ee0 0x7f23b8067390 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f23c4000f80 tx=0x7f23c4009000 comp rx=0 tx=0).stop 2023-11-28T13:07:56.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.490+0000 7f23d9e3d700 1 -- 172.21.15.82:0/2695132781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d4158e60 msgr2=0x7f23d40b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.490+0000 7f23d9e3d700 1 --2- 172.21.15.82:0/2695132781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d4158e60 0x7f23d40b47c0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f23bc00c500 tx=0x7f23bc00c810 comp rx=0 tx=0).stop 2023-11-28T13:07:56.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.490+0000 7f23d963c700 1 -- 172.21.15.82:0/2695132781 reap_dead start 2023-11-28T13:07:56.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.490+0000 7f23d9e3d700 1 -- 172.21.15.82:0/2695132781 shutdown_connections 2023-11-28T13:07:56.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.490+0000 7f23d9e3d700 1 -- 172.21.15.82:0/2695132781 >> 172.21.15.82:0/2695132781 conn(0x7f23d40cc120 msgr2=0x7f23d40cac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:56.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.490+0000 7f23d9e3d700 1 -- 172.21.15.82:0/2695132781 shutdown_connections 2023-11-28T13:07:56.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.490+0000 7f23d9e3d700 1 -- 172.21.15.82:0/2695132781 wait complete. 2023-11-28T13:07:56.510 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-28T13:07:56.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.618+0000 7f7365581700 1 Processor -- start 2023-11-28T13:07:56.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.618+0000 7f7365581700 1 -- start start 2023-11-28T13:07:56.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.618+0000 7f7365581700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73600b3910 0x7f736006b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.618+0000 7f7365581700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f736006c910 0x7f736006d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.618+0000 7f7365581700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736006c480 con 0x7f7360070070 2023-11-28T13:07:56.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.618+0000 7f7365581700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736006dbe0 con 0x7f736006c910 2023-11-28T13:07:56.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.618+0000 7f7365581700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736006dec0 con 0x7f73600b3910 2023-11-28T13:07:56.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.618+0000 7f7357fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f736006c910 0x7f736006d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.618+0000 7f7357fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f736006c910 0x7f736006d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51768/0 (socket says 172.21.15.82:51768) 2023-11-28T13:07:56.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.618+0000 7f7357fff700 1 -- 172.21.15.82:0/783901061 learned_addr learned my addr 172.21.15.82:0/783901061 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:56.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.618+0000 7f735ffff700 1 --2- 172.21.15.82:0/783901061 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73600b3910 0x7f736006b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.618+0000 7f7357fff700 1 -- 172.21.15.82:0/783901061 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73600b3910 msgr2=0x7f736006b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:56.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.618+0000 7f7357fff700 1 --2- 172.21.15.82:0/783901061 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73600b3910 0x7f736006b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.618+0000 7f7357fff700 1 -- 172.21.15.82:0/783901061 >> v1:172.21.15.114:6789/0 conn(0x7f7360070070 legacy=0x7f736015db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:56.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.622+0000 7f7357fff700 1 -- 172.21.15.82:0/783901061 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736006c110 con 0x7f736006c910 2023-11-28T13:07:56.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.622+0000 7f735ffff700 1 --2- 172.21.15.82:0/783901061 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73600b3910 0x7f736006b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:07:56.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.622+0000 7f7357fff700 1 --2- 172.21.15.82:0/783901061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f736006c910 0x7f736006d320 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f7348009910 tx=0x7f7348009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f81efb0794c34f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:56.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.622+0000 7f735f7fe700 1 -- 172.21.15.82:0/783901061 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7348004230 con 0x7f736006c910 2023-11-28T13:07:56.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.622+0000 7f735f7fe700 1 -- 172.21.15.82:0/783901061 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7348004390 con 0x7f736006c910 2023-11-28T13:07:56.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.622+0000 7f735f7fe700 1 -- 172.21.15.82:0/783901061 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7348009e60 con 0x7f736006c910 2023-11-28T13:07:56.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.622+0000 7f7365581700 1 -- 172.21.15.82:0/783901061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f736006c910 msgr2=0x7f736006d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.622+0000 7f7365581700 1 --2- 172.21.15.82:0/783901061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f736006c910 0x7f736006d320 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f7348009910 tx=0x7f7348009c20 comp rx=0 tx=0).stop 2023-11-28T13:07:56.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.622+0000 7f7365581700 1 -- 172.21.15.82:0/783901061 shutdown_connections 2023-11-28T13:07:56.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.622+0000 7f7365581700 1 --2- 172.21.15.82:0/783901061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f736006c910 0x7f736006d320 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.622+0000 7f7365581700 1 --2- 172.21.15.82:0/783901061 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f73600b3910 0x7f736006b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.622+0000 7f7365581700 1 -- 172.21.15.82:0/783901061 >> 172.21.15.82:0/783901061 conn(0x7f73600ce600 msgr2=0x7f73600ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:56.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.622+0000 7f7365581700 1 -- 172.21.15.82:0/783901061 shutdown_connections 2023-11-28T13:07:56.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.622+0000 7f7365581700 1 -- 172.21.15.82:0/783901061 wait complete. 2023-11-28T13:07:56.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.622+0000 7f7365581700 1 Processor -- start 2023-11-28T13:07:56.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.622+0000 7f7365581700 1 -- start start 2023-11-28T13:07:56.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f7365581700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f736006c910 0x7f73600c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f7365581700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7360070070 0x7f73600ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f7365581700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73600b3910 0x7f736015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f7365581700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73600ad550 con 0x7f736006c910 2023-11-28T13:07:56.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f7365581700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73600af340 con 0x7f73600b3910 2023-11-28T13:07:56.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f7365581700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73600af7d0 con 0x7f7360070070 2023-11-28T13:07:56.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f735ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f736006c910 0x7f73600c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f735ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f736006c910 0x7f73600c80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51778/0 (socket says 172.21.15.82:51778) 2023-11-28T13:07:56.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f735ffff700 1 -- 172.21.15.82:0/547012958 learned_addr learned my addr 172.21.15.82:0/547012958 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:56.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f7357fff700 1 --2- 172.21.15.82:0/547012958 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7360070070 0x7f73600ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f7364d80700 1 --2- 172.21.15.82:0/547012958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73600b3910 0x7f736015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f735ffff700 1 -- 172.21.15.82:0/547012958 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7360070070 msgr2=0x7f73600ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f735ffff700 1 --2- 172.21.15.82:0/547012958 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7360070070 0x7f73600ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f735ffff700 1 -- 172.21.15.82:0/547012958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73600b3910 msgr2=0x7f736015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f735ffff700 1 --2- 172.21.15.82:0/547012958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73600b3910 0x7f736015c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f735ffff700 1 -- 172.21.15.82:0/547012958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7348009570 con 0x7f736006c910 2023-11-28T13:07:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f735ffff700 1 --2- 172.21.15.82:0/547012958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f736006c910 0x7f73600c80c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f735000c7a0 tx=0x7f735000cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f735d7fa700 1 -- 172.21.15.82:0/547012958 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7350011800 con 0x7f736006c910 2023-11-28T13:07:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f735d7fa700 1 -- 172.21.15.82:0/547012958 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7350011960 con 0x7f736006c910 2023-11-28T13:07:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f7365581700 1 -- 172.21.15.82:0/547012958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f736006d860 con 0x7f736006c910 2023-11-28T13:07:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f735d7fa700 1 -- 172.21.15.82:0/547012958 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7350011d10 con 0x7f736006c910 2023-11-28T13:07:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f7365581700 1 -- 172.21.15.82:0/547012958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73600c8f80 con 0x7f736006c910 2023-11-28T13:07:56.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.626+0000 7f7365581700 1 -- 172.21.15.82:0/547012958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73600b3ce0 con 0x7f736006c910 2023-11-28T13:07:56.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.630+0000 7f735d7fa700 1 -- 172.21.15.82:0/547012958 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7350021070 con 0x7f736006c910 2023-11-28T13:07:56.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.630+0000 7f735d7fa700 1 --2- 172.21.15.82:0/547012958 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7340064ee0 0x7f7340067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.630+0000 7f7357fff700 1 --2- 172.21.15.82:0/547012958 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7340064ee0 0x7f7340067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.630+0000 7f735d7fa700 1 -- 172.21.15.82:0/547012958 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7350081ae0 con 0x7f736006c910 2023-11-28T13:07:56.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.630+0000 7f7357fff700 1 --2- 172.21.15.82:0/547012958 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7340064ee0 0x7f7340067390 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7348009910 tx=0x7f7348008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:56.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.634+0000 7f735d7fa700 1 -- 172.21.15.82:0/547012958 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f735004feb0 con 0x7f736006c910 2023-11-28T13:07:56.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.798+0000 7f7365581700 1 -- 172.21.15.82:0/547012958 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f73600af480 con 0x7f7340064ee0 2023-11-28T13:07:56.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.798+0000 7f735d7fa700 1 -- 172.21.15.82:0/547012958 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f734800b820 con 0x7f7340064ee0 2023-11-28T13:07:56.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.802+0000 7f7365581700 1 -- 172.21.15.82:0/547012958 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7340064ee0 msgr2=0x7f7340067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.802+0000 7f7365581700 1 --2- 172.21.15.82:0/547012958 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7340064ee0 0x7f7340067390 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7348009910 tx=0x7f7348008030 comp rx=0 tx=0).stop 2023-11-28T13:07:56.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.802+0000 7f7365581700 1 -- 172.21.15.82:0/547012958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f736006c910 msgr2=0x7f73600c80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.802+0000 7f7365581700 1 --2- 172.21.15.82:0/547012958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f736006c910 0x7f73600c80c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f735000c7a0 tx=0x7f735000cab0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.802+0000 7f7365581700 1 -- 172.21.15.82:0/547012958 shutdown_connections 2023-11-28T13:07:56.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.802+0000 7f7365581700 1 --2- 172.21.15.82:0/547012958 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f7340064ee0 0x7f7340067390 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.802+0000 7f7365581700 1 --2- 172.21.15.82:0/547012958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73600b3910 0x7f736015c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.802+0000 7f7365581700 1 --2- 172.21.15.82:0/547012958 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7360070070 0x7f73600ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.802+0000 7f7365581700 1 --2- 172.21.15.82:0/547012958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f736006c910 0x7f73600c80c0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.802+0000 7f7365581700 1 -- 172.21.15.82:0/547012958 >> 172.21.15.82:0/547012958 conn(0x7f73600ce600 msgr2=0x7f7360070730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:56.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.802+0000 7f7365581700 1 -- 172.21.15.82:0/547012958 shutdown_connections 2023-11-28T13:07:56.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.802+0000 7f7365581700 1 -- 172.21.15.82:0/547012958 wait complete. 2023-11-28T13:07:56.810 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 4 to deep-scrub 2023-11-28T13:07:56.820 INFO:tasks.ceph:Scrubbing osd.5 2023-11-28T13:07:56.820 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-28T13:07:56.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc146362700 1 Processor -- start 2023-11-28T13:07:56.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc146362700 1 -- start start 2023-11-28T13:07:56.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc146362700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc14006a460 0x7fc1401648a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc146362700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1400c8bc0 con 0x7fc1400caec0 2023-11-28T13:07:56.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc146362700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1400c8e10 con 0x7fc1401604b0 2023-11-28T13:07:56.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc146362700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1400c90f0 con 0x7fc14006a460 2023-11-28T13:07:56.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc145b61700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc1400caec0 0x7fc1400cb320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:46068/0 (socket says 172.21.15.82:46068) 2023-11-28T13:07:56.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc145b61700 1 -- 172.21.15.82:0/3579037963 learned_addr learned my addr 172.21.15.82:0/3579037963 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:56.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc144b5f700 1 --2- 172.21.15.82:0/3579037963 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc14006a460 0x7fc1401648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc137fff700 1 -- 172.21.15.82:0/3579037963 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414723566 0 0) 0x7fc1400c8bc0 con 0x7fc1400caec0 2023-11-28T13:07:56.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc137fff700 1 -- 172.21.15.82:0/3579037963 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc12c0035d0 con 0x7fc1400caec0 2023-11-28T13:07:56.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc137fff700 1 -- 172.21.15.82:0/3579037963 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2010459911 0 0) 0x7fc12c0035d0 con 0x7fc1400caec0 2023-11-28T13:07:56.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc137fff700 1 -- 172.21.15.82:0/3579037963 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc14006a460 msgr2=0x7fc1401648a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:56.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc137fff700 1 --2- 172.21.15.82:0/3579037963 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc14006a460 0x7fc1401648a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc137fff700 1 -- 172.21.15.82:0/3579037963 >> v1:172.21.15.114:6789/0 conn(0x7fc1401604b0 legacy=0x7fc1400ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc137fff700 1 -- 172.21.15.82:0/3579037963 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1401640a0 con 0x7fc1400caec0 2023-11-28T13:07:56.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc137fff700 1 -- 172.21.15.82:0/3579037963 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7fc1380019f0 con 0x7fc1400caec0 2023-11-28T13:07:56.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc137fff700 1 -- 172.21.15.82:0/3579037963 >> v1:172.21.15.82:6789/0 conn(0x7fc1400caec0 legacy=0x7fc1400cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc137fff700 1 --2- 172.21.15.82:0/3579037963 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc14006a460 0x7fc12c003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc137fff700 1 --2- 172.21.15.82:0/3579037963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc12c003f90 0x7fc12c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc137fff700 1 --2- 172.21.15.82:0/3579037963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc12c004db0 0x7fc12c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc137fff700 1 -- 172.21.15.82:0/3579037963 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1400c90f0 con 0x7fc12c003f90 2023-11-28T13:07:56.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc137fff700 1 -- 172.21.15.82:0/3579037963 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c00ba60 con 0x7fc12c004db0 2023-11-28T13:07:56.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.934+0000 7fc137fff700 1 -- 172.21.15.82:0/3579037963 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c00bc20 con 0x7fc14006a460 2023-11-28T13:07:56.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc144b5f700 1 --2- 172.21.15.82:0/3579037963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc12c003f90 0x7fc12c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc145b61700 1 --2- 172.21.15.82:0/3579037963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc12c004db0 0x7fc12c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc145360700 1 --2- 172.21.15.82:0/3579037963 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc14006a460 0x7fc12c003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc144b5f700 1 -- 172.21.15.82:0/3579037963 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc14006a460 msgr2=0x7fc12c003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:56.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc144b5f700 1 --2- 172.21.15.82:0/3579037963 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc14006a460 0x7fc12c003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc144b5f700 1 -- 172.21.15.82:0/3579037963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc12c004db0 msgr2=0x7fc12c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:56.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc144b5f700 1 --2- 172.21.15.82:0/3579037963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc12c004db0 0x7fc12c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc144b5f700 1 -- 172.21.15.82:0/3579037963 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c0035d0 con 0x7fc12c003f90 2023-11-28T13:07:56.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc144b5f700 1 --2- 172.21.15.82:0/3579037963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc12c003f90 0x7fc12c004870 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fc13c009b70 tx=0x7fc12c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24bf424e7e74c5e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:56.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc137fff700 1 -- 172.21.15.82:0/3579037963 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c00e6c0 con 0x7fc12c003f90 2023-11-28T13:07:56.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc137fff700 1 -- 172.21.15.82:0/3579037963 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c00e820 con 0x7fc12c003f90 2023-11-28T13:07:56.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc137fff700 1 -- 172.21.15.82:0/3579037963 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c00eb90 con 0x7fc12c003f90 2023-11-28T13:07:56.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc146362700 1 -- 172.21.15.82:0/3579037963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc12c003f90 msgr2=0x7fc12c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc146362700 1 --2- 172.21.15.82:0/3579037963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc12c003f90 0x7fc12c004870 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fc13c009b70 tx=0x7fc12c0058a0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc145b61700 1 -- 172.21.15.82:0/3579037963 reap_dead start 2023-11-28T13:07:56.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc146362700 1 -- 172.21.15.82:0/3579037963 shutdown_connections 2023-11-28T13:07:56.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc146362700 1 -- 172.21.15.82:0/3579037963 >> 172.21.15.82:0/3579037963 conn(0x7fc14006cc60 msgr2=0x7fc1400b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:56.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc146362700 1 -- 172.21.15.82:0/3579037963 shutdown_connections 2023-11-28T13:07:56.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc146362700 1 -- 172.21.15.82:0/3579037963 wait complete. 2023-11-28T13:07:56.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc146362700 1 Processor -- start 2023-11-28T13:07:56.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc146362700 1 -- start start 2023-11-28T13:07:56.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc146362700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc12c003f90 0x7fc14015e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc146362700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc14015eb30 0x7fc14015ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc146362700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc14014b9e0 0x7fc14014be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc146362700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14015f4c0 con 0x7fc14015eb30 2023-11-28T13:07:56.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc146362700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14014d700 con 0x7fc12c003f90 2023-11-28T13:07:56.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.938+0000 7fc146362700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc140150430 con 0x7fc14014b9e0 2023-11-28T13:07:56.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.942+0000 7fc144b5f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc14015eb30 0x7fc14015ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.942+0000 7fc144b5f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc14015eb30 0x7fc14015ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51798/0 (socket says 172.21.15.82:51798) 2023-11-28T13:07:56.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.942+0000 7fc144b5f700 1 -- 172.21.15.82:0/2749526207 learned_addr learned my addr 172.21.15.82:0/2749526207 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:56.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.942+0000 7fc145360700 1 --2- 172.21.15.82:0/2749526207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc12c003f90 0x7fc14015e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.942+0000 7fc145b61700 1 --2- 172.21.15.82:0/2749526207 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc14014b9e0 0x7fc14014be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.942+0000 7fc144b5f700 1 -- 172.21.15.82:0/2749526207 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc14014b9e0 msgr2=0x7fc14014be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.942+0000 7fc144b5f700 1 --2- 172.21.15.82:0/2749526207 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc14014b9e0 0x7fc14014be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.942+0000 7fc144b5f700 1 -- 172.21.15.82:0/2749526207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc12c003f90 msgr2=0x7fc14015e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.942+0000 7fc144b5f700 1 --2- 172.21.15.82:0/2749526207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc12c003f90 0x7fc14015e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.942+0000 7fc144b5f700 1 -- 172.21.15.82:0/2749526207 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc140160880 con 0x7fc14015eb30 2023-11-28T13:07:56.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.942+0000 7fc144b5f700 1 --2- 172.21.15.82:0/2749526207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc14015eb30 0x7fc14015ef80 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00ba30 tx=0x7fc13c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:56.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.942+0000 7fc135ffb700 1 -- 172.21.15.82:0/2749526207 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c00e6c0 con 0x7fc14015eb30 2023-11-28T13:07:56.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.942+0000 7fc135ffb700 1 -- 172.21.15.82:0/2749526207 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c013e00 con 0x7fc14015eb30 2023-11-28T13:07:56.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.942+0000 7fc135ffb700 1 -- 172.21.15.82:0/2749526207 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c004290 con 0x7fc14015eb30 2023-11-28T13:07:56.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.942+0000 7fc146362700 1 -- 172.21.15.82:0/2749526207 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc140164380 con 0x7fc14015eb30 2023-11-28T13:07:56.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.942+0000 7fc146362700 1 -- 172.21.15.82:0/2749526207 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14006a8c0 con 0x7fc14015eb30 2023-11-28T13:07:56.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.942+0000 7fc146362700 1 -- 172.21.15.82:0/2749526207 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc1400cb820 con 0x7fc14015eb30 2023-11-28T13:07:56.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.946+0000 7fc135ffb700 1 -- 172.21.15.82:0/2749526207 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc13c02b030 con 0x7fc14015eb30 2023-11-28T13:07:56.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.946+0000 7fc135ffb700 1 --2- 172.21.15.82:0/2749526207 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc124064ee0 0x7fc124067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.946+0000 7fc135ffb700 1 -- 172.21.15.82:0/2749526207 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc13c082f30 con 0x7fc14015eb30 2023-11-28T13:07:56.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.946+0000 7fc145360700 1 --2- 172.21.15.82:0/2749526207 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc124064ee0 0x7fc124067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.946+0000 7fc135ffb700 1 --2- 172.21.15.82:0/2749526207 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x7fc12406b350 0x7fc12406d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:56.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.946+0000 7fc135ffb700 1 -- 172.21.15.82:0/2749526207 --> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc12406de10 con 0x7fc12406b350 2023-11-28T13:07:56.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.946+0000 7fc135ffb700 1 -- 172.21.15.82:0/2749526207 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc13c0855e0 con 0x7fc14015eb30 2023-11-28T13:07:56.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.946+0000 7fc145b61700 1 --2- 172.21.15.82:0/2749526207 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x7fc12406b350 0x7fc12406d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:56.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.946+0000 7fc145360700 1 --2- 172.21.15.82:0/2749526207 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc124064ee0 0x7fc124067390 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc130001840 tx=0x7fc130009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:56.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.946+0000 7fc145b61700 1 --2- 172.21.15.82:0/2749526207 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x7fc12406b350 0x7fc12406d760 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:56.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.946+0000 7fc135ffb700 1 -- 172.21.15.82:0/2749526207 <== osd.5 v2:172.21.15.114:6808/36804 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc12406de10 con 0x7fc12406b350 2023-11-28T13:07:56.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.966+0000 7fc146362700 1 -- 172.21.15.82:0/2749526207 --> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc140065fc0 con 0x7fc12406b350 2023-11-28T13:07:56.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.966+0000 7fc135ffb700 1 -- 172.21.15.82:0/2749526207 <== osd.5 v2:172.21.15.114:6808/36804 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc140065fc0 con 0x7fc12406b350 2023-11-28T13:07:56.974 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:07:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T13:07:56.975 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:07:56.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.966+0000 7fc146362700 1 -- 172.21.15.82:0/2749526207 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x7fc12406b350 msgr2=0x7fc12406d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.966+0000 7fc146362700 1 --2- 172.21.15.82:0/2749526207 >> [v2:172.21.15.114:6808/36804,v1:172.21.15.114:6809/36804] conn(0x7fc12406b350 0x7fc12406d760 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.966+0000 7fc146362700 1 -- 172.21.15.82:0/2749526207 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc124064ee0 msgr2=0x7fc124067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.966+0000 7fc146362700 1 --2- 172.21.15.82:0/2749526207 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc124064ee0 0x7fc124067390 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc130001840 tx=0x7fc130009040 comp rx=0 tx=0).stop 2023-11-28T13:07:56.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.966+0000 7fc146362700 1 -- 172.21.15.82:0/2749526207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc14015eb30 msgr2=0x7fc14015ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:56.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.966+0000 7fc146362700 1 --2- 172.21.15.82:0/2749526207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc14015eb30 0x7fc14015ef80 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00ba30 tx=0x7fc13c0047e0 comp rx=0 tx=0).stop 2023-11-28T13:07:56.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.966+0000 7fc145b61700 1 -- 172.21.15.82:0/2749526207 reap_dead start 2023-11-28T13:07:56.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.966+0000 7fc146362700 1 -- 172.21.15.82:0/2749526207 shutdown_connections 2023-11-28T13:07:56.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.966+0000 7fc146362700 1 -- 172.21.15.82:0/2749526207 >> 172.21.15.82:0/2749526207 conn(0x7fc14006cc60 msgr2=0x7fc140071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:56.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.970+0000 7fc146362700 1 -- 172.21.15.82:0/2749526207 shutdown_connections 2023-11-28T13:07:56.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:56.970+0000 7fc146362700 1 -- 172.21.15.82:0/2749526207 wait complete. 2023-11-28T13:07:56.993 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-28T13:07:57.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f465759e700 1 Processor -- start 2023-11-28T13:07:57.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f465759e700 1 -- start start 2023-11-28T13:07:57.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f465759e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4658070070 0x7f4658070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f465759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4658160900 0x7f46580cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f465759e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f46580c1910 0x7f46581641e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f465759e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4658070980 con 0x7f46580c1910 2023-11-28T13:07:57.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f465759e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46580ce030 con 0x7f4658070070 2023-11-28T13:07:57.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f465759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46580ce310 con 0x7f4658160900 2023-11-28T13:07:57.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f4656d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f46580c1910 0x7f46581641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f4656d9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f46580c1910 0x7f46581641e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51808/0 (socket says 172.21.15.82:51808) 2023-11-28T13:07:57.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f4656d9d700 1 -- 172.21.15.82:0/2231053130 learned_addr learned my addr 172.21.15.82:0/2231053130 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:57.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f4655d9b700 1 --2- 172.21.15.82:0/2231053130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4658160900 0x7f46580cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f465659c700 1 --2- 172.21.15.82:0/2231053130 >> v2:172.21.15.114:3300/0 conn(0x7f4658070070 0x7f4658070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f4656d9d700 1 -- 172.21.15.82:0/2231053130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4658160900 msgr2=0x7f46580cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:57.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f4656d9d700 1 --2- 172.21.15.82:0/2231053130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4658160900 0x7f46580cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f4656d9d700 1 -- 172.21.15.82:0/2231053130 >> v2:172.21.15.114:3300/0 conn(0x7f4658070070 msgr2=0x7f4658070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:57.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f4656d9d700 1 --2- 172.21.15.82:0/2231053130 >> v2:172.21.15.114:3300/0 conn(0x7f4658070070 0x7f4658070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f4656d9d700 1 -- 172.21.15.82:0/2231053130 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465806a5d0 con 0x7f46580c1910 2023-11-28T13:07:57.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f4656d9d700 1 --2- 172.21.15.82:0/2231053130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46580c1910 0x7f46581641e0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f465806bf40 tx=0x7f4640009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d01e6917b8de67 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:57.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f465559a700 1 -- 172.21.15.82:0/2231053130 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640011830 con 0x7f46580c1910 2023-11-28T13:07:57.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f465559a700 1 -- 172.21.15.82:0/2231053130 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4640011990 con 0x7f46580c1910 2023-11-28T13:07:57.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f465559a700 1 -- 172.21.15.82:0/2231053130 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640011d20 con 0x7f46580c1910 2023-11-28T13:07:57.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f465759e700 1 -- 172.21.15.82:0/2231053130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46580c1910 msgr2=0x7f46581641e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.106+0000 7f465759e700 1 --2- 172.21.15.82:0/2231053130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46580c1910 0x7f46581641e0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f465806bf40 tx=0x7f4640009bf0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.110+0000 7f465759e700 1 -- 172.21.15.82:0/2231053130 shutdown_connections 2023-11-28T13:07:57.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.110+0000 7f465759e700 1 --2- 172.21.15.82:0/2231053130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46580c1910 0x7f46581641e0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.110+0000 7f465759e700 1 --2- 172.21.15.82:0/2231053130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4658160900 0x7f46580cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.110+0000 7f465759e700 1 --2- 172.21.15.82:0/2231053130 >> v2:172.21.15.114:3300/0 conn(0x7f4658070070 0x7f4658070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.110+0000 7f465759e700 1 -- 172.21.15.82:0/2231053130 >> 172.21.15.82:0/2231053130 conn(0x7f46580ce600 msgr2=0x7f46580ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:57.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.110+0000 7f465759e700 1 -- 172.21.15.82:0/2231053130 shutdown_connections 2023-11-28T13:07:57.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.110+0000 7f465759e700 1 -- 172.21.15.82:0/2231053130 wait complete. 2023-11-28T13:07:57.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.110+0000 7f465759e700 1 Processor -- start 2023-11-28T13:07:57.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.110+0000 7f465759e700 1 -- start start 2023-11-28T13:07:57.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f465759e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4658070070 0x7f46581f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f465759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46581f9180 0x7f46580c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f465759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46580c2fa0 0x7f46580c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f465759e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465815f710 con 0x7f46580c2fa0 2023-11-28T13:07:57.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f465759e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46581f95f0 con 0x7f46581f9180 2023-11-28T13:07:57.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f465759e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46580af140 con 0x7f4658070070 2023-11-28T13:07:57.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f4656d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46580c2fa0 0x7f46580c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f4656d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46580c2fa0 0x7f46580c4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51822/0 (socket says 172.21.15.82:51822) 2023-11-28T13:07:57.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f4656d9d700 1 -- 172.21.15.82:0/1324303148 learned_addr learned my addr 172.21.15.82:0/1324303148 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:57.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f4655d9b700 1 --2- 172.21.15.82:0/1324303148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46581f9180 0x7f46580c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f465659c700 1 --2- 172.21.15.82:0/1324303148 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4658070070 0x7f46581f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f465659c700 1 -- 172.21.15.82:0/1324303148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46581f9180 msgr2=0x7f46580c2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f465659c700 1 --2- 172.21.15.82:0/1324303148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46581f9180 0x7f46580c2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f465659c700 1 -- 172.21.15.82:0/1324303148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46580c2fa0 msgr2=0x7f46580c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f465659c700 1 --2- 172.21.15.82:0/1324303148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46580c2fa0 0x7f46580c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f465659c700 1 -- 172.21.15.82:0/1324303148 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4640009570 con 0x7f4658070070 2023-11-28T13:07:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f4655d9b700 1 --2- 172.21.15.82:0/1324303148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46581f9180 0x7f46580c2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:07:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f465659c700 1 --2- 172.21.15.82:0/1324303148 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4658070070 0x7f46581f62e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f464800e8a0 tx=0x7f464800ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:57.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f464effd700 1 -- 172.21.15.82:0/1324303148 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4648013680 con 0x7f4658070070 2023-11-28T13:07:57.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f465759e700 1 -- 172.21.15.82:0/1324303148 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465806ab90 con 0x7f4658070070 2023-11-28T13:07:57.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f464effd700 1 -- 172.21.15.82:0/1324303148 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46480137e0 con 0x7f4658070070 2023-11-28T13:07:57.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f464effd700 1 -- 172.21.15.82:0/1324303148 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4648013b50 con 0x7f4658070070 2023-11-28T13:07:57.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f465759e700 1 -- 172.21.15.82:0/1324303148 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465806a8b0 con 0x7f4658070070 2023-11-28T13:07:57.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.114+0000 7f465759e700 1 -- 172.21.15.82:0/1324303148 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46580cc710 con 0x7f4658070070 2023-11-28T13:07:57.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.118+0000 7f464effd700 1 -- 172.21.15.82:0/1324303148 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4648019030 con 0x7f4658070070 2023-11-28T13:07:57.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.118+0000 7f464effd700 1 --2- 172.21.15.82:0/1324303148 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4638064ee0 0x7f4638067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.118+0000 7f464effd700 1 -- 172.21.15.82:0/1324303148 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f46480817d0 con 0x7f4658070070 2023-11-28T13:07:57.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.118+0000 7f4655d9b700 1 --2- 172.21.15.82:0/1324303148 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4638064ee0 0x7f4638067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.118+0000 7f4655d9b700 1 --2- 172.21.15.82:0/1324303148 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4638064ee0 0x7f4638067390 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f46580c2450 tx=0x7f465000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:57.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.126+0000 7f464effd700 1 -- 172.21.15.82:0/1324303148 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f464804fb90 con 0x7f4658070070 2023-11-28T13:07:57.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.290+0000 7f465759e700 1 -- 172.21.15.82:0/1324303148 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f4658065fc0 con 0x7f4638064ee0 2023-11-28T13:07:57.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.294+0000 7f464effd700 1 -- 172.21.15.82:0/1324303148 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4658065fc0 con 0x7f4638064ee0 2023-11-28T13:07:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.294+0000 7f465759e700 1 -- 172.21.15.82:0/1324303148 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4638064ee0 msgr2=0x7f4638067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.294+0000 7f465759e700 1 --2- 172.21.15.82:0/1324303148 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4638064ee0 0x7f4638067390 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f46580c2450 tx=0x7f465000b040 comp rx=0 tx=0).stop 2023-11-28T13:07:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.294+0000 7f465759e700 1 -- 172.21.15.82:0/1324303148 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4658070070 msgr2=0x7f46581f62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.294+0000 7f465759e700 1 --2- 172.21.15.82:0/1324303148 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4658070070 0x7f46581f62e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f464800e8a0 tx=0x7f464800ebb0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.294+0000 7f465759e700 1 -- 172.21.15.82:0/1324303148 shutdown_connections 2023-11-28T13:07:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.294+0000 7f465759e700 1 --2- 172.21.15.82:0/1324303148 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f4638064ee0 0x7f4638067390 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.294+0000 7f465759e700 1 --2- 172.21.15.82:0/1324303148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46580c2fa0 0x7f46580c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.294+0000 7f465759e700 1 --2- 172.21.15.82:0/1324303148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46581f9180 0x7f46580c2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.294+0000 7f465759e700 1 --2- 172.21.15.82:0/1324303148 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4658070070 0x7f46581f62e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.294+0000 7f465759e700 1 -- 172.21.15.82:0/1324303148 >> 172.21.15.82:0/1324303148 conn(0x7f46580ce600 msgr2=0x7f46580b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.294+0000 7f465759e700 1 -- 172.21.15.82:0/1324303148 shutdown_connections 2023-11-28T13:07:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.294+0000 7f465759e700 1 -- 172.21.15.82:0/1324303148 wait complete. 2023-11-28T13:07:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 5 to deep-scrub 2023-11-28T13:07:57.314 INFO:tasks.ceph:Scrubbing osd.6 2023-11-28T13:07:57.314 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-28T13:07:57.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.430+0000 7f71f969b700 1 Processor -- start 2023-11-28T13:07:57.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.430+0000 7f71f969b700 1 -- start start 2023-11-28T13:07:57.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f969b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f71f406b800 0x7f71f406bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f969b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71f40d2190 0x7f71f4069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f969b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f71f40d25c0 0x7f71f406a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f969b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f40ccfe0 con 0x7f71f406b800 2023-11-28T13:07:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f969b700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f406c110 con 0x7f71f40d25c0 2023-11-28T13:07:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f969b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40d10f0 con 0x7f71f40d2190 2023-11-28T13:07:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f3fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f71f406b800 0x7f71f406bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f3fff700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f71f406b800 0x7f71f406bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51834/0 (socket says 172.21.15.82:51834) 2023-11-28T13:07:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f3fff700 1 -- 172.21.15.82:0/127940913 learned_addr learned my addr 172.21.15.82:0/127940913 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71ebfff700 1 --2- 172.21.15.82:0/127940913 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71f40d2190 0x7f71f4069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f8e9a700 1 --2- 172.21.15.82:0/127940913 >> v2:172.21.15.114:3300/0 conn(0x7f71f40d25c0 0x7f71f406a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f3fff700 1 -- 172.21.15.82:0/127940913 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71f40d2190 msgr2=0x7f71f4069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f3fff700 1 --2- 172.21.15.82:0/127940913 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71f40d2190 0x7f71f4069bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f3fff700 1 -- 172.21.15.82:0/127940913 >> v2:172.21.15.114:3300/0 conn(0x7f71f40d25c0 msgr2=0x7f71f406a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f3fff700 1 --2- 172.21.15.82:0/127940913 >> v2:172.21.15.114:3300/0 conn(0x7f71f40d25c0 0x7f71f406a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f3fff700 1 -- 172.21.15.82:0/127940913 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f40d13d0 con 0x7f71f406b800 2023-11-28T13:07:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f3fff700 1 --2- 172.21.15.82:0/127940913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71f406b800 0x7f71f406bbd0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f71f406b0d0 tx=0x7f71e4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc096063a721a32 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f37fe700 1 -- 172.21.15.82:0/127940913 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4011830 con 0x7f71f406b800 2023-11-28T13:07:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f37fe700 1 -- 172.21.15.82:0/127940913 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e4011990 con 0x7f71f406b800 2023-11-28T13:07:57.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f37fe700 1 -- 172.21.15.82:0/127940913 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4011d20 con 0x7f71f406b800 2023-11-28T13:07:57.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f969b700 1 -- 172.21.15.82:0/127940913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71f406b800 msgr2=0x7f71f406bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f969b700 1 --2- 172.21.15.82:0/127940913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71f406b800 0x7f71f406bbd0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f71f406b0d0 tx=0x7f71e4009bf0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f969b700 1 -- 172.21.15.82:0/127940913 shutdown_connections 2023-11-28T13:07:57.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f969b700 1 --2- 172.21.15.82:0/127940913 >> v2:172.21.15.114:3300/0 conn(0x7f71f40d25c0 0x7f71f406a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f969b700 1 --2- 172.21.15.82:0/127940913 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71f40d2190 0x7f71f4069bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f969b700 1 --2- 172.21.15.82:0/127940913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71f406b800 0x7f71f406bbd0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f969b700 1 -- 172.21.15.82:0/127940913 >> 172.21.15.82:0/127940913 conn(0x7f71f40d00a0 msgr2=0x7f71f40d2990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:57.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f969b700 1 -- 172.21.15.82:0/127940913 shutdown_connections 2023-11-28T13:07:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.434+0000 7f71f969b700 1 -- 172.21.15.82:0/127940913 wait complete. 2023-11-28T13:07:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f969b700 1 Processor -- start 2023-11-28T13:07:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f969b700 1 -- start start 2023-11-28T13:07:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f969b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71f406b800 0x7f71f41f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f969b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71f40d2190 0x7f71f41559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f969b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71f40d25c0 0x7f71f4069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f969b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f41f2a50 con 0x7f71f406b800 2023-11-28T13:07:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f969b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f4159260 con 0x7f71f40d2190 2023-11-28T13:07:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f969b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f41562c0 con 0x7f71f40d25c0 2023-11-28T13:07:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71f406b800 0x7f71f41f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71f406b800 0x7f71f41f2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51846/0 (socket says 172.21.15.82:51846) 2023-11-28T13:07:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f3fff700 1 -- 172.21.15.82:0/2096149248 learned_addr learned my addr 172.21.15.82:0/2096149248 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71ebfff700 1 --2- 172.21.15.82:0/2096149248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71f40d2190 0x7f71f41559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f8e9a700 1 --2- 172.21.15.82:0/2096149248 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71f40d25c0 0x7f71f4069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f3fff700 1 -- 172.21.15.82:0/2096149248 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71f40d25c0 msgr2=0x7f71f4069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f3fff700 1 --2- 172.21.15.82:0/2096149248 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71f40d25c0 0x7f71f4069bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f3fff700 1 -- 172.21.15.82:0/2096149248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71f40d2190 msgr2=0x7f71f41559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f3fff700 1 --2- 172.21.15.82:0/2096149248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71f40d2190 0x7f71f41559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f3fff700 1 -- 172.21.15.82:0/2096149248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e4009570 con 0x7f71f406b800 2023-11-28T13:07:57.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f3fff700 1 --2- 172.21.15.82:0/2096149248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71f406b800 0x7f71f41f2510 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009f40 tx=0x7f71e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:57.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f17fa700 1 -- 172.21.15.82:0/2096149248 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4004240 con 0x7f71f406b800 2023-11-28T13:07:57.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f17fa700 1 -- 172.21.15.82:0/2096149248 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e401f070 con 0x7f71f406b800 2023-11-28T13:07:57.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f969b700 1 -- 172.21.15.82:0/2096149248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f40cd510 con 0x7f71f406b800 2023-11-28T13:07:57.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f17fa700 1 -- 172.21.15.82:0/2096149248 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4004600 con 0x7f71f406b800 2023-11-28T13:07:57.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.438+0000 7f71f969b700 1 -- 172.21.15.82:0/2096149248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f40cd230 con 0x7f71f406b800 2023-11-28T13:07:57.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.442+0000 7f71f969b700 1 -- 172.21.15.82:0/2096149248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f71f40b1ec0 con 0x7f71f406b800 2023-11-28T13:07:57.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.442+0000 7f71f17fa700 1 -- 172.21.15.82:0/2096149248 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f71e400f050 con 0x7f71f406b800 2023-11-28T13:07:57.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.442+0000 7f71f17fa700 1 --2- 172.21.15.82:0/2096149248 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f71d4064ee0 0x7f71d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.442+0000 7f71ebfff700 1 --2- 172.21.15.82:0/2096149248 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f71d4064ee0 0x7f71d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.442+0000 7f71f17fa700 1 -- 172.21.15.82:0/2096149248 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f71e4082c90 con 0x7f71f406b800 2023-11-28T13:07:57.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.442+0000 7f71f17fa700 1 --2- 172.21.15.82:0/2096149248 >> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] conn(0x7f71d406b1e0 0x7f71d406d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.442+0000 7f71f17fa700 1 -- 172.21.15.82:0/2096149248 --> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71d406dca0 con 0x7f71d406b1e0 2023-11-28T13:07:57.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.442+0000 7f71f17fa700 1 -- 172.21.15.82:0/2096149248 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71e4085340 con 0x7f71f406b800 2023-11-28T13:07:57.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.442+0000 7f71f8e9a700 1 --2- 172.21.15.82:0/2096149248 >> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] conn(0x7f71d406b1e0 0x7f71d406d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.446+0000 7f71ebfff700 1 --2- 172.21.15.82:0/2096149248 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f71d4064ee0 0x7f71d4067390 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f71f40b1580 tx=0x7f71dc009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:57.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.446+0000 7f71f8e9a700 1 --2- 172.21.15.82:0/2096149248 >> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] conn(0x7f71d406b1e0 0x7f71d406d5f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:57.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.446+0000 7f71f17fa700 1 -- 172.21.15.82:0/2096149248 <== osd.6 v2:172.21.15.114:6824/36805 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f71d406dca0 con 0x7f71d406b1e0 2023-11-28T13:07:57.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.462+0000 7f71f969b700 1 -- 172.21.15.82:0/2096149248 --> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f71f41526f0 con 0x7f71d406b1e0 2023-11-28T13:07:57.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.466+0000 7f71f17fa700 1 -- 172.21.15.82:0/2096149248 <== osd.6 v2:172.21.15.114:6824/36805 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f71f41526f0 con 0x7f71d406b1e0 2023-11-28T13:07:57.472 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:07:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T13:07:57.472 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:07:57.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.466+0000 7f71f969b700 1 -- 172.21.15.82:0/2096149248 >> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] conn(0x7f71d406b1e0 msgr2=0x7f71d406d5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.466+0000 7f71f969b700 1 --2- 172.21.15.82:0/2096149248 >> [v2:172.21.15.114:6824/36805,v1:172.21.15.114:6825/36805] conn(0x7f71d406b1e0 0x7f71d406d5f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.466+0000 7f71f969b700 1 -- 172.21.15.82:0/2096149248 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f71d4064ee0 msgr2=0x7f71d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.466+0000 7f71f969b700 1 --2- 172.21.15.82:0/2096149248 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f71d4064ee0 0x7f71d4067390 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f71f40b1580 tx=0x7f71dc009240 comp rx=0 tx=0).stop 2023-11-28T13:07:57.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.466+0000 7f71f969b700 1 -- 172.21.15.82:0/2096149248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71f406b800 msgr2=0x7f71f41f2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.466+0000 7f71f969b700 1 --2- 172.21.15.82:0/2096149248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71f406b800 0x7f71f41f2510 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009f40 tx=0x7f71e4004770 comp rx=0 tx=0).stop 2023-11-28T13:07:57.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.466+0000 7f71f8e9a700 1 -- 172.21.15.82:0/2096149248 reap_dead start 2023-11-28T13:07:57.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.466+0000 7f71f969b700 1 -- 172.21.15.82:0/2096149248 shutdown_connections 2023-11-28T13:07:57.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.466+0000 7f71f969b700 1 -- 172.21.15.82:0/2096149248 >> 172.21.15.82:0/2096149248 conn(0x7f71f40d00a0 msgr2=0x7f71f415b450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:57.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.466+0000 7f71f969b700 1 -- 172.21.15.82:0/2096149248 shutdown_connections 2023-11-28T13:07:57.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.466+0000 7f71f969b700 1 -- 172.21.15.82:0/2096149248 wait complete. 2023-11-28T13:07:57.491 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-28T13:07:57.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.598+0000 7f1c3b59e700 1 Processor -- start 2023-11-28T13:07:57.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.598+0000 7f1c3b59e700 1 -- start start 2023-11-28T13:07:57.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3b59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c3c0b1ce0 0x7f1c3c070730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3b59e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1c3c070c70 0x7f1c3c06cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3b59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c3c0710d0 con 0x7f1c3c15d420 2023-11-28T13:07:57.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3b59e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c3c15de60 con 0x7f1c3c070c70 2023-11-28T13:07:57.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3b59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c15e140 con 0x7f1c3c0b1ce0 2023-11-28T13:07:57.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3ad9d700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1c3c070c70 0x7f1c3c06cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3a59c700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1c3c15d420 0x7f1c3c0ce6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.82:58398/0 (socket says 172.21.15.82:58398) 2023-11-28T13:07:57.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3a59c700 1 -- 172.21.15.82:0/3134800578 learned_addr learned my addr 172.21.15.82:0/3134800578 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:57.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c39d9b700 1 --2- 172.21.15.82:0/3134800578 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c3c0b1ce0 0x7f1c3c070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3959a700 1 -- 172.21.15.82:0/3134800578 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795970499 0 0) 0x7f1c3c0710d0 con 0x7f1c3c15d420 2023-11-28T13:07:57.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3959a700 1 -- 172.21.15.82:0/3134800578 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c240035d0 con 0x7f1c3c15d420 2023-11-28T13:07:57.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3ad9d700 1 -- 172.21.15.82:0/3134800578 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c3c0b1ce0 msgr2=0x7f1c3c070730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:57.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3ad9d700 1 --2- 172.21.15.82:0/3134800578 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c3c0b1ce0 0x7f1c3c070730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3ad9d700 1 -- 172.21.15.82:0/3134800578 >> v1:172.21.15.114:6789/0 conn(0x7f1c3c15d420 legacy=0x7f1c3c0ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3ad9d700 1 -- 172.21.15.82:0/3134800578 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3c15e420 con 0x7f1c3c070c70 2023-11-28T13:07:57.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3ad9d700 1 --2- 172.21.15.82:0/3134800578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c3c070c70 0x7f1c3c06cad0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f1c34009d90 tx=0x7f1c3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a55e0b86ed2b1ae server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:57.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3959a700 1 -- 172.21.15.82:0/3134800578 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3400e070 con 0x7f1c3c070c70 2023-11-28T13:07:57.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3959a700 1 -- 172.21.15.82:0/3134800578 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3400bb20 con 0x7f1c3c070c70 2023-11-28T13:07:57.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3959a700 1 -- 172.21.15.82:0/3134800578 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c34012430 con 0x7f1c3c070c70 2023-11-28T13:07:57.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3b59e700 1 -- 172.21.15.82:0/3134800578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c3c070c70 msgr2=0x7f1c3c06cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3b59e700 1 --2- 172.21.15.82:0/3134800578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c3c070c70 0x7f1c3c06cad0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f1c34009d90 tx=0x7f1c3400b330 comp rx=0 tx=0).stop 2023-11-28T13:07:57.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3b59e700 1 -- 172.21.15.82:0/3134800578 shutdown_connections 2023-11-28T13:07:57.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3b59e700 1 --2- 172.21.15.82:0/3134800578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c3c070c70 0x7f1c3c06cad0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3b59e700 1 --2- 172.21.15.82:0/3134800578 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c3c0b1ce0 0x7f1c3c070730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3b59e700 1 -- 172.21.15.82:0/3134800578 >> 172.21.15.82:0/3134800578 conn(0x7f1c3c0cb890 msgr2=0x7f1c3c0cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:57.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3b59e700 1 -- 172.21.15.82:0/3134800578 shutdown_connections 2023-11-28T13:07:57.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.602+0000 7f1c3b59e700 1 -- 172.21.15.82:0/3134800578 wait complete. 2023-11-28T13:07:57.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c3b59e700 1 Processor -- start 2023-11-28T13:07:57.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c3b59e700 1 -- start start 2023-11-28T13:07:57.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c3b59e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c3c070c70 0x7f1c3c1f2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c3b59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c3c0b1ce0 0x7f1c3c1f1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c3b59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c3c15d420 0x7f1c3c1f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c3b59e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c14d7c0 con 0x7f1c3c15d420 2023-11-28T13:07:57.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c3b59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c1f2000 con 0x7f1c3c0b1ce0 2023-11-28T13:07:57.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c3b59e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c14cb40 con 0x7f1c3c070c70 2023-11-28T13:07:57.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c3ad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c3c15d420 0x7f1c3c1f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c3ad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c3c15d420 0x7f1c3c1f1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51858/0 (socket says 172.21.15.82:51858) 2023-11-28T13:07:57.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c3ad9d700 1 -- 172.21.15.82:0/3055410866 learned_addr learned my addr 172.21.15.82:0/3055410866 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:57.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c3a59c700 1 --2- 172.21.15.82:0/3055410866 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c3c070c70 0x7f1c3c1f2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c39d9b700 1 --2- 172.21.15.82:0/3055410866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c3c0b1ce0 0x7f1c3c1f1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c3ad9d700 1 -- 172.21.15.82:0/3055410866 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c3c070c70 msgr2=0x7f1c3c1f2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c3ad9d700 1 --2- 172.21.15.82:0/3055410866 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c3c070c70 0x7f1c3c1f2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c3ad9d700 1 -- 172.21.15.82:0/3055410866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c3c0b1ce0 msgr2=0x7f1c3c1f1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c3ad9d700 1 --2- 172.21.15.82:0/3055410866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c3c0b1ce0 0x7f1c3c1f1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c3ad9d700 1 -- 172.21.15.82:0/3055410866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c34009a70 con 0x7f1c3c15d420 2023-11-28T13:07:57.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c3ad9d700 1 --2- 172.21.15.82:0/3055410866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c3c15d420 0x7f1c3c1f1ac0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f1c34014040 tx=0x7f1c34004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:57.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c2affd700 1 -- 172.21.15.82:0/3055410866 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c34012430 con 0x7f1c3c15d420 2023-11-28T13:07:57.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c2affd700 1 -- 172.21.15.82:0/3055410866 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c34020070 con 0x7f1c3c15d420 2023-11-28T13:07:57.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c3b59e700 1 -- 172.21.15.82:0/3055410866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3c15e9e0 con 0x7f1c3c15d420 2023-11-28T13:07:57.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c2affd700 1 -- 172.21.15.82:0/3055410866 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c34004280 con 0x7f1c3c15d420 2023-11-28T13:07:57.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.606+0000 7f1c3b59e700 1 -- 172.21.15.82:0/3055410866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3c15e700 con 0x7f1c3c15d420 2023-11-28T13:07:57.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.610+0000 7f1c3b59e700 1 -- 172.21.15.82:0/3055410866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3c15db30 con 0x7f1c3c15d420 2023-11-28T13:07:57.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.610+0000 7f1c2affd700 1 -- 172.21.15.82:0/3055410866 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1c3402e070 con 0x7f1c3c15d420 2023-11-28T13:07:57.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.610+0000 7f1c2affd700 1 --2- 172.21.15.82:0/3055410866 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1c1c064ee0 0x7f1c1c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.610+0000 7f1c2affd700 1 -- 172.21.15.82:0/3055410866 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1c34022070 con 0x7f1c3c15d420 2023-11-28T13:07:57.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.610+0000 7f1c3a59c700 1 --2- 172.21.15.82:0/3055410866 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1c1c064ee0 0x7f1c1c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.610+0000 7f1c3a59c700 1 --2- 172.21.15.82:0/3055410866 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1c1c064ee0 0x7f1c1c067390 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c0011e0 tx=0x7f1c2c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:57.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.614+0000 7f1c2affd700 1 -- 172.21.15.82:0/3055410866 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1c34051db0 con 0x7f1c3c15d420 2023-11-28T13:07:57.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.778+0000 7f1c3b59e700 1 -- 172.21.15.82:0/3055410866 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c3c14d900 con 0x7f1c1c064ee0 2023-11-28T13:07:57.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.782+0000 7f1c2affd700 1 -- 172.21.15.82:0/3055410866 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1c3c14d900 con 0x7f1c1c064ee0 2023-11-28T13:07:57.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.782+0000 7f1c3b59e700 1 -- 172.21.15.82:0/3055410866 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1c1c064ee0 msgr2=0x7f1c1c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.782+0000 7f1c3b59e700 1 --2- 172.21.15.82:0/3055410866 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1c1c064ee0 0x7f1c1c067390 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c0011e0 tx=0x7f1c2c009040 comp rx=0 tx=0).stop 2023-11-28T13:07:57.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.782+0000 7f1c3b59e700 1 -- 172.21.15.82:0/3055410866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c3c15d420 msgr2=0x7f1c3c1f1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.782+0000 7f1c3b59e700 1 --2- 172.21.15.82:0/3055410866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c3c15d420 0x7f1c3c1f1ac0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f1c34014040 tx=0x7f1c34004af0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.782+0000 7f1c3b59e700 1 -- 172.21.15.82:0/3055410866 shutdown_connections 2023-11-28T13:07:57.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.782+0000 7f1c3b59e700 1 --2- 172.21.15.82:0/3055410866 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1c1c064ee0 0x7f1c1c067390 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.782+0000 7f1c3b59e700 1 --2- 172.21.15.82:0/3055410866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c3c15d420 0x7f1c3c1f1ac0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.782+0000 7f1c3b59e700 1 --2- 172.21.15.82:0/3055410866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c3c0b1ce0 0x7f1c3c1f1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.782+0000 7f1c3b59e700 1 --2- 172.21.15.82:0/3055410866 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1c3c070c70 0x7f1c3c1f2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.782+0000 7f1c3b59e700 1 -- 172.21.15.82:0/3055410866 >> 172.21.15.82:0/3055410866 conn(0x7f1c3c0cb890 msgr2=0x7f1c3c0c9590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:57.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.782+0000 7f1c3b59e700 1 -- 172.21.15.82:0/3055410866 shutdown_connections 2023-11-28T13:07:57.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.782+0000 7f1c3b59e700 1 -- 172.21.15.82:0/3055410866 wait complete. 2023-11-28T13:07:57.792 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 6 to deep-scrub 2023-11-28T13:07:57.803 INFO:tasks.ceph:Scrubbing osd.7 2023-11-28T13:07:57.803 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-28T13:07:57.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.910+0000 7f195989b700 1 Processor -- start 2023-11-28T13:07:57.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.910+0000 7f195989b700 1 -- start start 2023-11-28T13:07:57.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f195989b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19540b80e0 0x7f19540b4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f195989b700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f195406b100 0x7f19540b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f195989b700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1954160630 con 0x7f19540d23f0 2023-11-28T13:07:57.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f195989b700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19540d2250 con 0x7f195406b100 2023-11-28T13:07:57.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f195989b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19540ceb30 con 0x7f19540b80e0 2023-11-28T13:07:57.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f195909a700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f195406b100 0x7f19540b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f1953fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f19540d23f0 0x7f1954069bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:46074/0 (socket says 172.21.15.82:46074) 2023-11-28T13:07:57.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f1953fff700 1 -- 172.21.15.82:0/488970306 learned_addr learned my addr 172.21.15.82:0/488970306 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:57.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f1958899700 1 --2- 172.21.15.82:0/488970306 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19540b80e0 0x7f19540b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f195909a700 1 -- 172.21.15.82:0/488970306 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19540b80e0 msgr2=0x7f19540b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:57.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f195909a700 1 --2- 172.21.15.82:0/488970306 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19540b80e0 0x7f19540b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f195909a700 1 -- 172.21.15.82:0/488970306 >> v1:172.21.15.82:6789/0 conn(0x7f19540d23f0 legacy=0x7f1954069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f19537fe700 1 -- 172.21.15.82:0/488970306 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647308194 0 0) 0x7f1954160630 con 0x7f19540d23f0 2023-11-28T13:07:57.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f195909a700 1 -- 172.21.15.82:0/488970306 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1954160b60 con 0x7f195406b100 2023-11-28T13:07:57.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f195909a700 1 --2- 172.21.15.82:0/488970306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f195406b100 0x7f19540b4940 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f194c009850 tx=0x7f194c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a2248707926665 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:57.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f19537fe700 1 -- 172.21.15.82:0/488970306 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c011830 con 0x7f195406b100 2023-11-28T13:07:57.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f19537fe700 1 -- 172.21.15.82:0/488970306 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194c011990 con 0x7f195406b100 2023-11-28T13:07:57.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f19537fe700 1 -- 172.21.15.82:0/488970306 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c011d40 con 0x7f195406b100 2023-11-28T13:07:57.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f195989b700 1 -- 172.21.15.82:0/488970306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f195406b100 msgr2=0x7f19540b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f195989b700 1 --2- 172.21.15.82:0/488970306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f195406b100 0x7f19540b4940 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f194c009850 tx=0x7f194c009b60 comp rx=0 tx=0).stop 2023-11-28T13:07:57.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f195989b700 1 -- 172.21.15.82:0/488970306 shutdown_connections 2023-11-28T13:07:57.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f195989b700 1 --2- 172.21.15.82:0/488970306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f195406b100 0x7f19540b4940 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f195989b700 1 --2- 172.21.15.82:0/488970306 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19540b80e0 0x7f19540b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f195989b700 1 -- 172.21.15.82:0/488970306 >> 172.21.15.82:0/488970306 conn(0x7f195406c7d0 msgr2=0x7f19540cf400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:57.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f195989b700 1 -- 172.21.15.82:0/488970306 shutdown_connections 2023-11-28T13:07:57.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.914+0000 7f195989b700 1 -- 172.21.15.82:0/488970306 wait complete. 2023-11-28T13:07:57.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.918+0000 7f195989b700 1 Processor -- start 2023-11-28T13:07:57.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.918+0000 7f195989b700 1 -- start start 2023-11-28T13:07:57.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.918+0000 7f195989b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f195406b100 0x7f19541f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.918+0000 7f195989b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19540b80e0 0x7f19540c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.918+0000 7f195989b700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19540d23f0 0x7f19540c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.918+0000 7f195989b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19540c7170 con 0x7f19540b80e0 2023-11-28T13:07:57.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.918+0000 7f195989b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19540c7590 con 0x7f195406b100 2023-11-28T13:07:57.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.918+0000 7f195989b700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19540c6530 con 0x7f19540d23f0 2023-11-28T13:07:57.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.918+0000 7f1953fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19540b80e0 0x7f19540c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.918+0000 7f1958899700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f195406b100 0x7f19541f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.918+0000 7f195909a700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19540d23f0 0x7f19540c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.918+0000 7f1953fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19540b80e0 0x7f19540c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51880/0 (socket says 172.21.15.82:51880) 2023-11-28T13:07:57.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.918+0000 7f1953fff700 1 -- 172.21.15.82:0/638394162 learned_addr learned my addr 172.21.15.82:0/638394162 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:57.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.918+0000 7f1953fff700 1 -- 172.21.15.82:0/638394162 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19540d23f0 msgr2=0x7f19540c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.918+0000 7f1953fff700 1 --2- 172.21.15.82:0/638394162 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19540d23f0 0x7f19540c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.918+0000 7f1953fff700 1 -- 172.21.15.82:0/638394162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f195406b100 msgr2=0x7f19541f23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.918+0000 7f1953fff700 1 --2- 172.21.15.82:0/638394162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f195406b100 0x7f19541f23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.918+0000 7f1953fff700 1 -- 172.21.15.82:0/638394162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c0094b0 con 0x7f19540b80e0 2023-11-28T13:07:57.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.918+0000 7f1953fff700 1 --2- 172.21.15.82:0/638394162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19540b80e0 0x7f19540c8170 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f193c00c520 tx=0x7f193c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:57.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.918+0000 7f19517fa700 1 -- 172.21.15.82:0/638394162 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c0074e0 con 0x7f19540b80e0 2023-11-28T13:07:57.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.922+0000 7f19517fa700 1 -- 172.21.15.82:0/638394162 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c007640 con 0x7f19540b80e0 2023-11-28T13:07:57.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.922+0000 7f195989b700 1 -- 172.21.15.82:0/638394162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1954160880 con 0x7f19540b80e0 2023-11-28T13:07:57.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.922+0000 7f19517fa700 1 -- 172.21.15.82:0/638394162 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c005a70 con 0x7f19540b80e0 2023-11-28T13:07:57.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.922+0000 7f195989b700 1 -- 172.21.15.82:0/638394162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19540b84b0 con 0x7f19540b80e0 2023-11-28T13:07:57.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.922+0000 7f195989b700 1 -- 172.21.15.82:0/638394162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f19540ced40 con 0x7f19540b80e0 2023-11-28T13:07:57.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.922+0000 7f19517fa700 1 -- 172.21.15.82:0/638394162 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f193c019030 con 0x7f19540b80e0 2023-11-28T13:07:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.922+0000 7f19517fa700 1 --2- 172.21.15.82:0/638394162 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1934064ee0 0x7f1934067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.922+0000 7f19517fa700 1 -- 172.21.15.82:0/638394162 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f193c080f20 con 0x7f19540b80e0 2023-11-28T13:07:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.922+0000 7f1958899700 1 --2- 172.21.15.82:0/638394162 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1934064ee0 0x7f1934067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.922+0000 7f19517fa700 1 --2- 172.21.15.82:0/638394162 >> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] conn(0x7f193406b350 0x7f193406d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.922+0000 7f19517fa700 1 -- 172.21.15.82:0/638394162 --> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f193406de10 con 0x7f193406b350 2023-11-28T13:07:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.922+0000 7f19517fa700 1 -- 172.21.15.82:0/638394162 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f193c086530 con 0x7f19540b80e0 2023-11-28T13:07:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.922+0000 7f195909a700 1 --2- 172.21.15.82:0/638394162 >> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] conn(0x7f193406b350 0x7f193406d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:57.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.922+0000 7f1958899700 1 --2- 172.21.15.82:0/638394162 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1934064ee0 0x7f1934067390 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f19540cbcf0 tx=0x7f194400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:57.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.926+0000 7f195909a700 1 --2- 172.21.15.82:0/638394162 >> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] conn(0x7f193406b350 0x7f193406d760 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:57.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.926+0000 7f19517fa700 1 -- 172.21.15.82:0/638394162 <== osd.7 v2:172.21.15.114:6816/36806 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f193406de10 con 0x7f193406b350 2023-11-28T13:07:57.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.942+0000 7f195989b700 1 -- 172.21.15.82:0/638394162 --> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f19540c72b0 con 0x7f193406b350 2023-11-28T13:07:57.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.942+0000 7f19517fa700 1 -- 172.21.15.82:0/638394162 <== osd.7 v2:172.21.15.114:6816/36806 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f19540c72b0 con 0x7f193406b350 2023-11-28T13:07:57.951 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-11-28T13:07:57.951 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T13:07:57.951 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-11-28T13:07:57.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.946+0000 7f195989b700 1 -- 172.21.15.82:0/638394162 >> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] conn(0x7f193406b350 msgr2=0x7f193406d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.946+0000 7f195989b700 1 --2- 172.21.15.82:0/638394162 >> [v2:172.21.15.114:6816/36806,v1:172.21.15.114:6817/36806] conn(0x7f193406b350 0x7f193406d760 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:57.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.946+0000 7f195989b700 1 -- 172.21.15.82:0/638394162 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1934064ee0 msgr2=0x7f1934067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.946+0000 7f195989b700 1 --2- 172.21.15.82:0/638394162 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f1934064ee0 0x7f1934067390 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f19540cbcf0 tx=0x7f194400b040 comp rx=0 tx=0).stop 2023-11-28T13:07:57.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.946+0000 7f195989b700 1 -- 172.21.15.82:0/638394162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19540b80e0 msgr2=0x7f19540c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:57.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.946+0000 7f195989b700 1 --2- 172.21.15.82:0/638394162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19540b80e0 0x7f19540c8170 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f193c00c520 tx=0x7f193c00c830 comp rx=0 tx=0).stop 2023-11-28T13:07:57.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.946+0000 7f195909a700 1 -- 172.21.15.82:0/638394162 reap_dead start 2023-11-28T13:07:57.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.946+0000 7f195989b700 1 -- 172.21.15.82:0/638394162 shutdown_connections 2023-11-28T13:07:57.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.946+0000 7f195989b700 1 -- 172.21.15.82:0/638394162 >> 172.21.15.82:0/638394162 conn(0x7f195406c7d0 msgr2=0x7f1954069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:57.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.946+0000 7f195989b700 1 -- 172.21.15.82:0/638394162 shutdown_connections 2023-11-28T13:07:57.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:57.946+0000 7f195989b700 1 -- 172.21.15.82:0/638394162 wait complete. 2023-11-28T13:07:57.964 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-28T13:07:58.011 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:07:58.013 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:07:58.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.074+0000 7fcd09a3e700 1 Processor -- start 2023-11-28T13:07:58.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.074+0000 7fcd09a3e700 1 -- start start 2023-11-28T13:07:58.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.074+0000 7fcd09a3e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcd0415c7f0 0x7fcd040cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:58.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.074+0000 7fcd09a3e700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcd040cd430 0x7fcd040cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:58.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.074+0000 7fcd09a3e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd040d1390 con 0x7fcd0406b2e0 2023-11-28T13:07:58.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.074+0000 7fcd09a3e700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd040cdba0 con 0x7fcd040cd430 2023-11-28T13:07:58.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.074+0000 7fcd09a3e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd040cd8c0 con 0x7fcd0415c7f0 2023-11-28T13:07:58.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.074+0000 7fcd037fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcd040cd430 0x7fcd040cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:58.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.074+0000 7fcd037fe700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcd040cd430 0x7fcd040cfbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51892/0 (socket says 172.21.15.82:51892) 2023-11-28T13:07:58.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.074+0000 7fcd037fe700 1 -- 172.21.15.82:0/2232804113 learned_addr learned my addr 172.21.15.82:0/2232804113 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.074+0000 7fcd02ffd700 1 --2- 172.21.15.82:0/2232804113 >> v2:172.21.15.114:3300/0 conn(0x7fcd0415c7f0 0x7fcd040cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.074+0000 7fcd037fe700 1 -- 172.21.15.82:0/2232804113 >> v2:172.21.15.114:3300/0 conn(0x7fcd0415c7f0 msgr2=0x7fcd040cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.074+0000 7fcd037fe700 1 --2- 172.21.15.82:0/2232804113 >> v2:172.21.15.114:3300/0 conn(0x7fcd0415c7f0 0x7fcd040cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.074+0000 7fcd037fe700 1 -- 172.21.15.82:0/2232804113 >> v1:172.21.15.114:6789/0 conn(0x7fcd0406b2e0 legacy=0x7fcd040b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.074+0000 7fcd037fe700 1 -- 172.21.15.82:0/2232804113 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd040d15d0 con 0x7fcd040cd430 2023-11-28T13:07:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.074+0000 7fcd037fe700 1 --2- 172.21.15.82:0/2232804113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd040cd430 0x7fcd040cfbd0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fcd0408b9e0 tx=0x7fccfc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8766c268b9320223 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:58.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.078+0000 7fcd01ffb700 1 -- 172.21.15.82:0/2232804113 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00e070 con 0x7fcd040cd430 2023-11-28T13:07:58.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.078+0000 7fcd01ffb700 1 -- 172.21.15.82:0/2232804113 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc003a40 con 0x7fcd040cd430 2023-11-28T13:07:58.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.078+0000 7fcd01ffb700 1 -- 172.21.15.82:0/2232804113 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc003df0 con 0x7fcd040cd430 2023-11-28T13:07:58.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.078+0000 7fcd09a3e700 1 -- 172.21.15.82:0/2232804113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd040cd430 msgr2=0x7fcd040cfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:58.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.078+0000 7fcd09a3e700 1 --2- 172.21.15.82:0/2232804113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd040cd430 0x7fcd040cfbd0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fcd0408b9e0 tx=0x7fccfc00b330 comp rx=0 tx=0).stop 2023-11-28T13:07:58.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.078+0000 7fcd09a3e700 1 -- 172.21.15.82:0/2232804113 shutdown_connections 2023-11-28T13:07:58.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.078+0000 7fcd09a3e700 1 --2- 172.21.15.82:0/2232804113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd040cd430 0x7fcd040cfbd0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:58.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.078+0000 7fcd09a3e700 1 --2- 172.21.15.82:0/2232804113 >> v2:172.21.15.114:3300/0 conn(0x7fcd0415c7f0 0x7fcd040cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:58.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.078+0000 7fcd09a3e700 1 -- 172.21.15.82:0/2232804113 >> 172.21.15.82:0/2232804113 conn(0x7fcd0406bd00 msgr2=0x7fcd0406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:58.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.078+0000 7fcd09a3e700 1 -- 172.21.15.82:0/2232804113 shutdown_connections 2023-11-28T13:07:58.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.078+0000 7fcd09a3e700 1 -- 172.21.15.82:0/2232804113 wait complete. 2023-11-28T13:07:58.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fcd09a3e700 1 Processor -- start 2023-11-28T13:07:58.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fcd09a3e700 1 -- start start 2023-11-28T13:07:58.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fcd09a3e700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcd0406b2e0 0x7fcd040b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:58.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fcd09a3e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd040cd430 0x7fcd04153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:58.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fcd09a3e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd0415c7f0 0x7fcd040ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:58.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fcd09a3e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd04156a40 con 0x7fcd040cd430 2023-11-28T13:07:58.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fcd09a3e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd04156d20 con 0x7fcd0415c7f0 2023-11-28T13:07:58.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fcd09a3e700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd04154d90 con 0x7fcd0406b2e0 2023-11-28T13:07:58.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fcd027fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd040cd430 0x7fcd04153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:58.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fcd027fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd040cd430 0x7fcd04153050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51902/0 (socket says 172.21.15.82:51902) 2023-11-28T13:07:58.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fcd027fc700 1 -- 172.21.15.82:0/4058962786 learned_addr learned my addr 172.21.15.82:0/4058962786 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:58.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fcd037fe700 1 --2- 172.21.15.82:0/4058962786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd0415c7f0 0x7fcd040ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:58.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fcd02ffd700 1 --2- 172.21.15.82:0/4058962786 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcd0406b2e0 0x7fcd040b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:58.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fcd027fc700 1 -- 172.21.15.82:0/4058962786 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcd0406b2e0 msgr2=0x7fcd040b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:58.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fcd027fc700 1 --2- 172.21.15.82:0/4058962786 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcd0406b2e0 0x7fcd040b2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:58.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fcd027fc700 1 -- 172.21.15.82:0/4058962786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd0415c7f0 msgr2=0x7fcd040ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fcd027fc700 1 --2- 172.21.15.82:0/4058962786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd0415c7f0 0x7fcd040ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fcd027fc700 1 -- 172.21.15.82:0/4058962786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc009b30 con 0x7fcd040cd430 2023-11-28T13:07:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fcd027fc700 1 --2- 172.21.15.82:0/4058962786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd040cd430 0x7fcd04153050 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fccec00c4e0 tx=0x7fccec00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fccfbfff700 1 -- 172.21.15.82:0/4058962786 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec011790 con 0x7fcd040cd430 2023-11-28T13:07:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fccfbfff700 1 -- 172.21.15.82:0/4058962786 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccec011910 con 0x7fcd040cd430 2023-11-28T13:07:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fcd09a3e700 1 -- 172.21.15.82:0/4058962786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd040d1b90 con 0x7fcd040cd430 2023-11-28T13:07:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fccfbfff700 1 -- 172.21.15.82:0/4058962786 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec011cc0 con 0x7fcd040cd430 2023-11-28T13:07:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.082+0000 7fcd09a3e700 1 -- 172.21.15.82:0/4058962786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd040d18b0 con 0x7fcd040cd430 2023-11-28T13:07:58.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.086+0000 7fcd09a3e700 1 -- 172.21.15.82:0/4058962786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd040d0110 con 0x7fcd040cd430 2023-11-28T13:07:58.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.086+0000 7fccfbfff700 1 -- 172.21.15.82:0/4058962786 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fccec010050 con 0x7fcd040cd430 2023-11-28T13:07:58.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.086+0000 7fccfbfff700 1 --2- 172.21.15.82:0/4058962786 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcce4064f10 0x7fcce40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:58.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.086+0000 7fccfbfff700 1 -- 172.21.15.82:0/4058962786 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fccec0816d0 con 0x7fcd040cd430 2023-11-28T13:07:58.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.086+0000 7fcd02ffd700 1 --2- 172.21.15.82:0/4058962786 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcce4064f10 0x7fcce40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:58.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.086+0000 7fcd02ffd700 1 --2- 172.21.15.82:0/4058962786 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcce4064f10 0x7fcce40673c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fccf4007a60 tx=0x7fccf4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:58.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.094+0000 7fccfbfff700 1 -- 172.21.15.82:0/4058962786 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fccec04fb70 con 0x7fcd040cd430 2023-11-28T13:07:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.258+0000 7fcd09a3e700 1 -- 172.21.15.82:0/4058962786 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd04156e90 con 0x7fcce4064f10 2023-11-28T13:07:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.258+0000 7fccfbfff700 1 -- 172.21.15.82:0/4058962786 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcd04156e90 con 0x7fcce4064f10 2023-11-28T13:07:58.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.262+0000 7fcd09a3e700 1 -- 172.21.15.82:0/4058962786 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcce4064f10 msgr2=0x7fcce40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:58.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.262+0000 7fcd09a3e700 1 --2- 172.21.15.82:0/4058962786 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcce4064f10 0x7fcce40673c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fccf4007a60 tx=0x7fccf4008040 comp rx=0 tx=0).stop 2023-11-28T13:07:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.262+0000 7fcd09a3e700 1 -- 172.21.15.82:0/4058962786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd040cd430 msgr2=0x7fcd04153050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.262+0000 7fcd09a3e700 1 --2- 172.21.15.82:0/4058962786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd040cd430 0x7fcd04153050 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fccec00c4e0 tx=0x7fccec00c7f0 comp rx=0 tx=0).stop 2023-11-28T13:07:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.262+0000 7fcd09a3e700 1 -- 172.21.15.82:0/4058962786 shutdown_connections 2023-11-28T13:07:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.262+0000 7fcd09a3e700 1 --2- 172.21.15.82:0/4058962786 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcce4064f10 0x7fcce40673c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.262+0000 7fcd09a3e700 1 --2- 172.21.15.82:0/4058962786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd0415c7f0 0x7fcd040ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.262+0000 7fcd09a3e700 1 --2- 172.21.15.82:0/4058962786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd040cd430 0x7fcd04153050 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.262+0000 7fcd09a3e700 1 --2- 172.21.15.82:0/4058962786 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcd0406b2e0 0x7fcd040b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:58.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.262+0000 7fcd09a3e700 1 -- 172.21.15.82:0/4058962786 >> 172.21.15.82:0/4058962786 conn(0x7fcd0406bd00 msgr2=0x7fcd04159420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:58.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.262+0000 7fcd09a3e700 1 -- 172.21.15.82:0/4058962786 shutdown_connections 2023-11-28T13:07:58.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.262+0000 7fcd09a3e700 1 -- 172.21.15.82:0/4058962786 wait complete. 2023-11-28T13:07:58.271 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 7 to deep-scrub 2023-11-28T13:07:58.281 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:07:58.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.386+0000 7f9accf14700 1 Processor -- start 2023-11-28T13:07:58.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.386+0000 7f9accf14700 1 -- start start 2023-11-28T13:07:58.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.386+0000 7f9accf14700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ac80b3910 0x7f9ac806b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:58.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.386+0000 7f9accf14700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac806c480 con 0x7f9ac8070070 2023-11-28T13:07:58.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.386+0000 7f9accf14700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac806dbe0 con 0x7f9ac806c910 2023-11-28T13:07:58.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.386+0000 7f9accf14700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac806dec0 con 0x7f9ac80b3910 2023-11-28T13:07:58.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.386+0000 7f9ac7fff700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9ac8070070 0x7f9ac815db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:46076/0 (socket says 172.21.15.82:46076) 2023-11-28T13:07:58.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.386+0000 7f9ac7fff700 1 -- 172.21.15.82:0/1799619113 learned_addr learned my addr 172.21.15.82:0/1799619113 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:07:58.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.386+0000 7f9ac67fc700 1 -- 172.21.15.82:0/1799619113 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759662084 0 0) 0x7f9ac806c480 con 0x7f9ac8070070 2023-11-28T13:07:58.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.386+0000 7f9ac77fe700 1 --2- 172.21.15.82:0/1799619113 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ac80b3910 0x7f9ac806b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:58.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.386+0000 7f9ac67fc700 1 -- 172.21.15.82:0/1799619113 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9aa80035d0 con 0x7f9ac8070070 2023-11-28T13:07:58.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac67fc700 1 -- 172.21.15.82:0/1799619113 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437204143 0 0) 0x7f9ac806dbe0 con 0x7f9ac806c910 2023-11-28T13:07:58.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac67fc700 1 -- 172.21.15.82:0/1799619113 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ac806c480 con 0x7f9ac806c910 2023-11-28T13:07:58.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac67fc700 1 -- 172.21.15.82:0/1799619113 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4073692717 0 0) 0x7f9aa80035d0 con 0x7f9ac8070070 2023-11-28T13:07:58.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac67fc700 1 -- 172.21.15.82:0/1799619113 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ac80b3910 msgr2=0x7f9ac806b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:58.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac67fc700 1 --2- 172.21.15.82:0/1799619113 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ac80b3910 0x7f9ac806b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:58.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac67fc700 1 -- 172.21.15.82:0/1799619113 >> v1:172.21.15.114:6789/0 conn(0x7f9ac806c910 legacy=0x7f9ac806d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:58.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac67fc700 1 -- 172.21.15.82:0/1799619113 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac806c110 con 0x7f9ac8070070 2023-11-28T13:07:58.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac67fc700 1 -- 172.21.15.82:0/1799619113 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7f9ab8001670 con 0x7f9ac8070070 2023-11-28T13:07:58.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac67fc700 1 -- 172.21.15.82:0/1799619113 >> v1:172.21.15.82:6789/0 conn(0x7f9ac8070070 legacy=0x7f9ac815db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:58.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac67fc700 1 --2- 172.21.15.82:0/1799619113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aa8003be0 0x7f9aa8003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:58.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac67fc700 1 --2- 172.21.15.82:0/1799619113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa8004870 0x7f9aa8004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:58.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac67fc700 1 --2- 172.21.15.82:0/1799619113 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ac80b3910 0x7f9aa8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:58.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac67fc700 1 -- 172.21.15.82:0/1799619113 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac806dec0 con 0x7f9aa8004870 2023-11-28T13:07:58.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac67fc700 1 -- 172.21.15.82:0/1799619113 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa800bae0 con 0x7f9aa8003be0 2023-11-28T13:07:58.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac67fc700 1 -- 172.21.15.82:0/1799619113 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa800bc50 con 0x7f9ac80b3910 2023-11-28T13:07:58.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac6ffd700 1 --2- 172.21.15.82:0/1799619113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa8004870 0x7f9aa8004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:58.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac77fe700 1 --2- 172.21.15.82:0/1799619113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aa8003be0 0x7f9aa8003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:58.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac6ffd700 1 -- 172.21.15.82:0/1799619113 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ac80b3910 msgr2=0x7f9aa8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:58.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac6ffd700 1 --2- 172.21.15.82:0/1799619113 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ac80b3910 0x7f9aa8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:58.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac6ffd700 1 -- 172.21.15.82:0/1799619113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aa8003be0 msgr2=0x7f9aa8003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:07:58.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac6ffd700 1 --2- 172.21.15.82:0/1799619113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aa8003be0 0x7f9aa8003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:58.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac6ffd700 1 -- 172.21.15.82:0/1799619113 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa80035d0 con 0x7f9aa8004870 2023-11-28T13:07:58.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac77fe700 1 --2- 172.21.15.82:0/1799619113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aa8003be0 0x7f9aa8003fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:07:58.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac6ffd700 1 --2- 172.21.15.82:0/1799619113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa8004870 0x7f9aa8004ce0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000c2f0 tx=0x7f9aa80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbec3158af96b0c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:58.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac67fc700 1 -- 172.21.15.82:0/1799619113 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0001f30 con 0x7f9aa8004870 2023-11-28T13:07:58.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac67fc700 1 -- 172.21.15.82:0/1799619113 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab000ce90 con 0x7f9aa8004870 2023-11-28T13:07:58.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac67fc700 1 -- 172.21.15.82:0/1799619113 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0003c60 con 0x7f9aa8004870 2023-11-28T13:07:58.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9accf14700 1 -- 172.21.15.82:0/1799619113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa8004870 msgr2=0x7f9aa8004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:58.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9accf14700 1 --2- 172.21.15.82:0/1799619113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa8004870 0x7f9aa8004ce0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000c2f0 tx=0x7f9aa80058a0 comp rx=0 tx=0).stop 2023-11-28T13:07:58.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9ac7fff700 1 -- 172.21.15.82:0/1799619113 reap_dead start 2023-11-28T13:07:58.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9accf14700 1 -- 172.21.15.82:0/1799619113 shutdown_connections 2023-11-28T13:07:58.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9accf14700 1 -- 172.21.15.82:0/1799619113 >> 172.21.15.82:0/1799619113 conn(0x7f9ac80ce600 msgr2=0x7f9ac80ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:58.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9accf14700 1 -- 172.21.15.82:0/1799619113 shutdown_connections 2023-11-28T13:07:58.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.390+0000 7f9accf14700 1 -- 172.21.15.82:0/1799619113 wait complete. 2023-11-28T13:07:58.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9accf14700 1 Processor -- start 2023-11-28T13:07:58.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9accf14700 1 -- start start 2023-11-28T13:07:58.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9accf14700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aa8004870 0x7f9ac8146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:58.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9accf14700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ac80c75e0 0x7f9ac80c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:58.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9accf14700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ac80c56d0 0x7f9ac80c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:58.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9accf14700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac80c6080 con 0x7f9ac80c75e0 2023-11-28T13:07:58.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9accf14700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac8146f40 con 0x7f9aa8004870 2023-11-28T13:07:58.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9accf14700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac80ae790 con 0x7f9ac80c56d0 2023-11-28T13:07:58.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9ac6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ac80c75e0 0x7f9ac80c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:58.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9ac6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ac80c75e0 0x7f9ac80c7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51910/0 (socket says 172.21.15.82:51910) 2023-11-28T13:07:58.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9ac6ffd700 1 -- 172.21.15.82:0/2995839264 learned_addr learned my addr 172.21.15.82:0/2995839264 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:07:58.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9ac77fe700 1 --2- 172.21.15.82:0/2995839264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aa8004870 0x7f9ac8146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:58.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9ac7fff700 1 --2- 172.21.15.82:0/2995839264 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ac80c56d0 0x7f9ac80c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:58.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9ac6ffd700 1 -- 172.21.15.82:0/2995839264 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ac80c56d0 msgr2=0x7f9ac80c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:58.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9ac6ffd700 1 --2- 172.21.15.82:0/2995839264 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ac80c56d0 0x7f9ac80c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:58.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9ac6ffd700 1 -- 172.21.15.82:0/2995839264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aa8004870 msgr2=0x7f9ac8146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:58.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9ac6ffd700 1 --2- 172.21.15.82:0/2995839264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aa8004870 0x7f9ac8146a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:58.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9ac6ffd700 1 -- 172.21.15.82:0/2995839264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac80b3ce0 con 0x7f9ac80c75e0 2023-11-28T13:07:58.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9ac6ffd700 1 --2- 172.21.15.82:0/2995839264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ac80c75e0 0x7f9ac80c7a50 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80047a0 tx=0x7f9ab0001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:58.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9abffff700 1 -- 172.21.15.82:0/2995839264 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0003e50 con 0x7f9ac80c75e0 2023-11-28T13:07:58.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9abffff700 1 -- 172.21.15.82:0/2995839264 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab00052e0 con 0x7f9ac80c75e0 2023-11-28T13:07:58.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9abffff700 1 -- 172.21.15.82:0/2995839264 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0005690 con 0x7f9ac80c75e0 2023-11-28T13:07:58.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9accf14700 1 -- 172.21.15.82:0/2995839264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac80c8f80 con 0x7f9ac80c75e0 2023-11-28T13:07:58.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.394+0000 7f9accf14700 1 -- 172.21.15.82:0/2995839264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac80b3e70 con 0x7f9ac80c75e0 2023-11-28T13:07:58.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.398+0000 7f9accf14700 1 -- 172.21.15.82:0/2995839264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac8065fc0 con 0x7f9ac80c75e0 2023-11-28T13:07:58.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.398+0000 7f9abffff700 1 -- 172.21.15.82:0/2995839264 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9ab0010050 con 0x7f9ac80c75e0 2023-11-28T13:07:58.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.398+0000 7f9abffff700 1 --2- 172.21.15.82:0/2995839264 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9aac064ee0 0x7f9aac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:07:58.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.398+0000 7f9abffff700 1 -- 172.21.15.82:0/2995839264 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9ab0083240 con 0x7f9ac80c75e0 2023-11-28T13:07:58.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.398+0000 7f9ac77fe700 1 --2- 172.21.15.82:0/2995839264 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9aac064ee0 0x7f9aac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:07:58.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.398+0000 7f9ac77fe700 1 --2- 172.21.15.82:0/2995839264 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9aac064ee0 0x7f9aac067390 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0009b20 tx=0x7f9ac0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:07:58.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.406+0000 7f9abffff700 1 -- 172.21.15.82:0/2995839264 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9ab00516e0 con 0x7f9ac80c75e0 2023-11-28T13:07:58.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.566+0000 7f9accf14700 1 -- 172.21.15.82:0/2995839264 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ac80ae610 con 0x7f9aac064ee0 2023-11-28T13:07:58.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.578+0000 7f9abffff700 1 -- 172.21.15.82:0/2995839264 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71511 (secure 0 0 0) 0x7f9ac00137d0 con 0x7f9aac064ee0 2023-11-28T13:07:58.581 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:07:58.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.578+0000 7f9accf14700 1 -- 172.21.15.82:0/2995839264 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9aac064ee0 msgr2=0x7f9aac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:58.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.578+0000 7f9accf14700 1 --2- 172.21.15.82:0/2995839264 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9aac064ee0 0x7f9aac067390 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0009b20 tx=0x7f9ac0008040 comp rx=0 tx=0).stop 2023-11-28T13:07:58.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.578+0000 7f9accf14700 1 -- 172.21.15.82:0/2995839264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ac80c75e0 msgr2=0x7f9ac80c7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:07:58.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.578+0000 7f9accf14700 1 --2- 172.21.15.82:0/2995839264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ac80c75e0 0x7f9ac80c7a50 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80047a0 tx=0x7f9ab0001650 comp rx=0 tx=0).stop 2023-11-28T13:07:58.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.578+0000 7f9accf14700 1 -- 172.21.15.82:0/2995839264 shutdown_connections 2023-11-28T13:07:58.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.578+0000 7f9accf14700 1 --2- 172.21.15.82:0/2995839264 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f9aac064ee0 0x7f9aac067390 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:58.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.578+0000 7f9accf14700 1 --2- 172.21.15.82:0/2995839264 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ac80c56d0 0x7f9ac80c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:58.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.578+0000 7f9accf14700 1 --2- 172.21.15.82:0/2995839264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ac80c75e0 0x7f9ac80c7a50 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:58.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.578+0000 7f9accf14700 1 --2- 172.21.15.82:0/2995839264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aa8004870 0x7f9ac8146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:07:58.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.578+0000 7f9accf14700 1 -- 172.21.15.82:0/2995839264 >> 172.21.15.82:0/2995839264 conn(0x7f9ac80ce600 msgr2=0x7f9ac806cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:07:58.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.578+0000 7f9accf14700 1 -- 172.21.15.82:0/2995839264 shutdown_connections 2023-11-28T13:07:58.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:07:58.578+0000 7f9accf14700 1 -- 172.21.15.82:0/2995839264 wait complete. 2023-11-28T13:07:58.586 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:07:58.597 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2023-11-28T13:07:57.319320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":89352,"kb_used_data":7816,"kb_used_omap":0,"kb_used_meta":81472,"kb_avail":754885368,"statfs":{"total":773094113280,"available":773002616832,"internally_reserved":0,"allocated":8003584,"data_stored":4199280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":83427328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12288,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-6,"num_read_kb":-5,"num_write":-76,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":-70,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002759"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":216,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T13:07:49.446937+0000","last_change":"2023-11-28T13:00:16.451709+0000","last_active":"2023-11-28T13:07:49.446937+0000","last_peered":"2023-11-28T13:07:49.446937+0000","last_clean":"2023-11-28T13:07:49.446937+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:07:49.446937+0000","last_undegraded":"2023-11-28T13:07:49.446937+0000","last_fullsized":"2023-11-28T13:07:49.446937+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:15.378000+0000","last_clean_scrub_stamp":"2023-11-28T13:00:15.378000+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:03.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T13:07:49.648423+0000","last_change":"2023-11-28T13:00:21.463354+0000","last_active":"2023-11-28T13:07:49.648423+0000","last_peered":"2023-11-28T13:07:49.648423+0000","last_clean":"2023-11-28T13:07:49.648423+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:07:49.648423+0000","last_undegraded":"2023-11-28T13:07:49.648423+0000","last_fullsized":"2023-11-28T13:07:49.648423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:16:29.135401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T13:07:49.446798+0000","last_change":"2023-11-28T13:00:21.460191+0000","last_active":"2023-11-28T13:07:49.446798+0000","last_peered":"2023-11-28T13:07:49.446798+0000","last_clean":"2023-11-28T13:07:49.446798+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:07:49.446798+0000","last_undegraded":"2023-11-28T13:07:49.446798+0000","last_fullsized":"2023-11-28T13:07:49.446798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:52:23.424027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T13:07:49.438392+0000","last_change":"2023-11-28T13:00:21.464044+0000","last_active":"2023-11-28T13:07:49.438392+0000","last_peered":"2023-11-28T13:07:49.438392+0000","last_clean":"2023-11-28T13:07:49.438392+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:07:49.438392+0000","last_undegraded":"2023-11-28T13:07:49.438392+0000","last_fullsized":"2023-11-28T13:07:49.438392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T13:07:49.650168+0000","last_change":"2023-11-28T13:00:21.465422+0000","last_active":"2023-11-28T13:07:49.650168+0000","last_peered":"2023-11-28T13:07:49.650168+0000","last_clean":"2023-11-28T13:07:49.650168+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:07:49.650168+0000","last_undegraded":"2023-11-28T13:07:49.650168+0000","last_fullsized":"2023-11-28T13:07:49.650168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:35:55.877640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T13:07:49.513847+0000","last_change":"2023-11-28T13:00:21.461277+0000","last_active":"2023-11-28T13:07:49.513847+0000","last_peered":"2023-11-28T13:07:49.513847+0000","last_clean":"2023-11-28T13:07:49.513847+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:07:49.513847+0000","last_undegraded":"2023-11-28T13:07:49.513847+0000","last_fullsized":"2023-11-28T13:07:49.513847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.162940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T13:07:49.447180+0000","last_change":"2023-11-28T13:00:21.457388+0000","last_active":"2023-11-28T13:07:49.447180+0000","last_peered":"2023-11-28T13:07:49.447180+0000","last_clean":"2023-11-28T13:07:49.447180+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:07:49.447180+0000","last_undegraded":"2023-11-28T13:07:49.447180+0000","last_fullsized":"2023-11-28T13:07:49.447180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:49.641317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T13:07:49.512712+0000","last_change":"2023-11-28T13:00:21.463714+0000","last_active":"2023-11-28T13:07:49.512712+0000","last_peered":"2023-11-28T13:07:49.512712+0000","last_clean":"2023-11-28T13:07:49.512712+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:07:49.512712+0000","last_undegraded":"2023-11-28T13:07:49.512712+0000","last_fullsized":"2023-11-28T13:07:49.512712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:18:39.499418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T13:07:50.017308+0000","last_change":"2023-11-28T13:00:21.462677+0000","last_active":"2023-11-28T13:07:50.017308+0000","last_peered":"2023-11-28T13:07:50.017308+0000","last_clean":"2023-11-28T13:07:50.017308+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:07:50.017308+0000","last_undegraded":"2023-11-28T13:07:50.017308+0000","last_fullsized":"2023-11-28T13:07:50.017308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:00:20.426645+0000","last_clean_scrub_stamp":"2023-11-28T13:00:20.426645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:56:27.198921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574943,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15308,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":13888,"kb_avail":94356532,"statfs":{"total":96636764160,"available":96621088768,"internally_reserved":0,"allocated":1445888,"data_stored":967686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14221312},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.84999999999999998,"15min":0.82899999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2150000000000001,"5min":1.28,"15min":1.3859999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.85899999999999999,"15min":0.89200000000000002},"min":{"1min":0.65100000000000002,"5min":0.51200000000000001,"15min":0.5},"max":{"1min":1.196,"5min":1.2130000000000001,"15min":1.377},"last":1.236}]},{"osd":1,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.86599999999999999,"15min":0.90100000000000002},"min":{"1min":0.63800000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.1839999999999999,"5min":1.2410000000000001,"15min":1.599},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.86699999999999999,"15min":0.91900000000000004},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.091,"5min":1.194,"15min":1.375},"last":0.88500000000000001}]},{"osd":2,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.85499999999999998,"15min":0.91000000000000003},"min":{"1min":0.61299999999999999,"5min":0.54100000000000004,"15min":0.53300000000000003},"max":{"1min":1.1559999999999999,"5min":1.198,"15min":2.9060000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.94099999999999995,"15min":0.91800000000000004},"min":{"1min":0.63600000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1830000000000001,"5min":1.3109999999999999,"15min":1.6659999999999999},"last":0.69399999999999995}]},{"osd":3,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.89900000000000002,"15min":0.93200000000000005},"min":{"1min":0.625,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.26,"5min":1.26,"15min":1.6399999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.022,"5min":0.95399999999999996,"15min":0.93400000000000005},"min":{"1min":0.80400000000000005,"5min":0.72499999999999998,"15min":0.59799999999999998},"max":{"1min":1.2090000000000001,"5min":1.212,"15min":1.3660000000000001},"last":1.0680000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.85599999999999998,"15min":0.95699999999999996},"min":{"1min":0.60799999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.135,"5min":1.1739999999999999,"15min":1.6819999999999999},"last":0.999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.90700000000000003,"15min":0.94599999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1499999999999999,"5min":1.2649999999999999,"15min":1.409},"last":0.92500000000000004}]},{"osd":5,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.91800000000000004,"15min":0.996},"min":{"1min":0.66700000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.282,"5min":1.282,"15min":1.466},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.99099999999999999,"15min":1.0680000000000001},"min":{"1min":0.71099999999999997,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.175,"5min":1.2589999999999999,"15min":1.5449999999999999},"last":1.1759999999999999}]},{"osd":6,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0429999999999999,"15min":1.1379999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.68799999999999994},"max":{"1min":1.236,"5min":1.28,"15min":2.0630000000000002},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.042,"15min":1.1299999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.2450000000000001,"5min":1.407,"15min":1.794},"last":1.0429999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574944,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9608,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362232,"statfs":{"total":96636764160,"available":96626925568,"internally_reserved":0,"allocated":851968,"data_stored":377318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81000000000000005,"15min":0.82699999999999996},"min":{"1min":0.54400000000000004,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1000000000000001,"5min":1.23,"15min":1.5580000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.90500000000000003,"15min":0.86499999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.54100000000000004},"max":{"1min":1.1599999999999999,"5min":1.448,"15min":1.448},"last":0.86299999999999999}]},{"osd":1,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.93600000000000005,"15min":0.88800000000000001},"min":{"1min":0.65300000000000002,"5min":0.59199999999999997,"15min":0.51900000000000002},"max":{"1min":1.25,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85599999999999998,"15min":0.86299999999999999},"min":{"1min":0.66900000000000004,"5min":0.59699999999999998,"15min":0.55900000000000005},"max":{"1min":1.0349999999999999,"5min":1.716,"15min":1.716},"last":0.69599999999999995}]},{"osd":2,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.878,"15min":0.88100000000000001},"min":{"1min":0.60599999999999998,"5min":0.505,"15min":0.505},"max":{"1min":1.1319999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93700000000000006,"15min":0.90600000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.175,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.75600000000000001}]},{"osd":3,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.88,"15min":0.88100000000000001},"min":{"1min":0.68300000000000005,"5min":0.57399999999999995,"15min":0.53300000000000003},"max":{"1min":1.149,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":1.093},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96399999999999997,"15min":0.97199999999999998},"min":{"1min":0.69399999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1950000000000001,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.0509999999999999}]},{"osd":4,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.94299999999999995,"15min":0.94699999999999995},"min":{"1min":0.61599999999999999,"5min":0.60999999999999999,"15min":0.59699999999999998},"max":{"1min":1.3,"5min":1.746,"15min":1.8049999999999999},"last":1.129},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.96399999999999997,"15min":1.3140000000000001},"min":{"1min":0.72499999999999998,"5min":0.63500000000000001,"15min":0.629},"max":{"1min":1.228,"5min":1.2969999999999999,"15min":10.566000000000001},"last":0.96199999999999997}]},{"osd":5,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":1.006,"15min":1.0580000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3069999999999999,"5min":2.048,"15min":2.048},"last":1.157},{"interface":"front","average":{"1min":1.042,"5min":1.1120000000000001,"15min":1.095},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.325,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":1.2130000000000001}]},{"osd":7,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.044,"15min":1.1779999999999999},"min":{"1min":0.78400000000000003,"5min":0.751,"15min":0.74299999999999999},"max":{"1min":1.208,"5min":1.367,"15min":3.4980000000000002},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.141,"15min":1.264},"min":{"1min":0.98899999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.3759999999999999,"5min":1.7669999999999999,"15min":3.593},"last":1.3100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574945,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9800,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362040,"statfs":{"total":96636764160,"available":96626728960,"internally_reserved":0,"allocated":851968,"data_stored":377318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.82099999999999995,"15min":0.81799999999999995},"min":{"1min":0.60899999999999999,"5min":0.53700000000000003,"15min":0.502},"max":{"1min":1.054,"5min":1.171,"15min":1.171},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.876,"15min":0.83899999999999997},"min":{"1min":0.68400000000000005,"5min":0.55400000000000005,"15min":0.48399999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.169}]},{"osd":1,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.84699999999999998,"15min":0.83099999999999996},"min":{"1min":0.66000000000000003,"5min":0.48999999999999999,"15min":0.46000000000000002},"max":{"1min":1.077,"5min":1.1919999999999999,"15min":1.274},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.86899999999999999,"15min":0.82099999999999995},"min":{"1min":0.54600000000000004,"5min":0.434,"15min":0.434},"max":{"1min":1.173,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.72999999999999998}]},{"osd":2,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.88300000000000001,"15min":0.83599999999999997},"min":{"1min":0.67800000000000005,"5min":0.59599999999999997,"15min":0.45500000000000002},"max":{"1min":1.212,"5min":1.395,"15min":1.395},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.89400000000000002,"15min":0.92300000000000004},"min":{"1min":0.66200000000000003,"5min":0.55700000000000005,"15min":0.53000000000000003},"max":{"1min":1.198,"5min":1.26,"15min":1.3560000000000001},"last":1.044}]},{"osd":3,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.93999999999999995,"15min":0.89600000000000002},"min":{"1min":0.70299999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":1.21},{"interface":"front","average":{"1min":1.014,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.82399999999999995,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2210000000000001,"5min":1.365,"15min":1.403},"last":1.1379999999999999}]},{"osd":4,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.86899999999999999,"15min":0.88200000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.40699999999999997},"max":{"1min":1.246,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.97899999999999998,"15min":0.96699999999999997},"min":{"1min":0.56899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.444,"5min":1.5189999999999999,"15min":4.3300000000000001},"last":1.2450000000000001}]},{"osd":6,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97299999999999998,"15min":1.0089999999999999},"min":{"1min":0.68799999999999994,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.224,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0660000000000001,"15min":1.0409999999999999},"min":{"1min":0.82899999999999996,"5min":0.70599999999999996,"15min":0.59299999999999997},"max":{"1min":1.3129999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.0720000000000001}]},{"osd":7,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.1000000000000001,"15min":1.0629999999999999},"min":{"1min":0.73399999999999999,"5min":0.58399999999999996,"15min":0.56599999999999995},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":4.234},"last":1.514},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.101,"15min":1.1259999999999999},"min":{"1min":0.77900000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2989999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.234}]}]},{"osd":4,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":9992,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361848,"statfs":{"total":96636764160,"available":96626532352,"internally_reserved":0,"allocated":851968,"data_stored":377318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.86099999999999999,"15min":0.82799999999999996},"min":{"1min":0.58899999999999997,"5min":0.57999999999999996,"15min":0.53600000000000003},"max":{"1min":1.107,"5min":1.1699999999999999,"15min":1.2589999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.84399999999999997,"15min":0.82299999999999995},"min":{"1min":0.69499999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2150000000000001,"5min":1.429,"15min":1.429},"last":0.71599999999999997}]},{"osd":1,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81799999999999995,"15min":0.81699999999999995},"min":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.54300000000000004},"max":{"1min":1.038,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.88800000000000001,"15min":0.876},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0700000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.76700000000000002}]},{"osd":2,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.82499999999999996,"15min":0.83499999999999996},"min":{"1min":0.65200000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.002,"5min":1.296,"15min":1.357},"last":1.038},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.90500000000000003,"15min":0.89300000000000002},"min":{"1min":0.65600000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1339999999999999,"5min":1.2270000000000001,"15min":1.2549999999999999},"last":0.79200000000000004}]},{"osd":3,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.90600000000000003,"15min":0.88500000000000001},"min":{"1min":0.64900000000000002,"5min":0.64300000000000002,"15min":0.61899999999999999},"max":{"1min":1.1519999999999999,"5min":1.252,"15min":1.252},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.98099999999999998,"15min":0.98799999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.66400000000000003},"max":{"1min":1.1619999999999999,"5min":1.222,"15min":1.474},"last":0.84199999999999997}]},{"osd":5,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.85499999999999998,"15min":0.88700000000000001},"min":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.53400000000000003},"max":{"1min":1.0369999999999999,"5min":1.2809999999999999,"15min":1.4590000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.94099999999999995,"15min":0.97599999999999998},"min":{"1min":0.68200000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2490000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.81200000000000006}]},{"osd":6,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.92600000000000005,"15min":0.997},"min":{"1min":0.65500000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.093,"5min":1.657,"15min":1.657},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.026,"15min":1.0629999999999999},"min":{"1min":0.77000000000000002,"5min":0.62,"15min":0.62},"max":{"1min":1.135,"5min":1.4690000000000001,"15min":1.5149999999999999},"last":1.0069999999999999}]},{"osd":7,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.034,"15min":1.073},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.296,"5min":1.389,"15min":1.526},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.071,"5min":1.0960000000000001,"15min":1.133},"min":{"1min":0.82299999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.258,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.095}]}]},{"osd":3,"up_from":13,"seq":55834574943,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9992,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361848,"statfs":{"total":96636764160,"available":96626532352,"internally_reserved":0,"allocated":851968,"data_stored":377318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.629,"15min":0.60999999999999999},"min":{"1min":0.48299999999999998,"5min":0.41399999999999998,"15min":0.39400000000000002},"max":{"1min":1.0049999999999999,"5min":1.0840000000000001,"15min":1.0900000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.54100000000000004,"5min":0.45100000000000001,"15min":0.43099999999999999},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.67000000000000004}]},{"osd":1,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.496,"5min":0.45500000000000002,"15min":0.32500000000000001},"max":{"1min":0.93899999999999995,"5min":1.0129999999999999,"15min":1.1890000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77400000000000002,"15min":0.76400000000000001},"min":{"1min":0.55600000000000005,"5min":0.48399999999999999,"15min":0.441},"max":{"1min":0.93200000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.94899999999999995}]},{"osd":2,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76400000000000001,"15min":0.749},"min":{"1min":0.49099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0129999999999999,"5min":1.028,"15min":1.2989999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.83699999999999997,"15min":0.83099999999999996},"min":{"1min":0.71799999999999997,"5min":0.52400000000000002,"15min":0.438},"max":{"1min":1.0720000000000001,"5min":1.1659999999999999,"15min":1.4550000000000001},"last":1.032}]},{"osd":4,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.90800000000000003,"15min":0.96599999999999997},"min":{"1min":0.80900000000000005,"5min":0.65200000000000002,"15min":0.63100000000000001},"max":{"1min":1.2569999999999999,"5min":1.3400000000000001,"15min":1.405},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.98199999999999998,"15min":1.0249999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.57899999999999996},"max":{"1min":1.2929999999999999,"5min":1.3620000000000001,"15min":1.7150000000000001},"last":0.77100000000000002}]},{"osd":5,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.97499999999999998,"15min":1.034},"min":{"1min":0.79300000000000004,"5min":0.64400000000000002,"15min":0.57399999999999995},"max":{"1min":1.26,"5min":1.518,"15min":1.5549999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.044,"15min":1.075},"min":{"1min":0.91700000000000004,"5min":0.76400000000000001,"15min":0.73799999999999999},"max":{"1min":1.329,"5min":1.5449999999999999,"15min":1.6639999999999999},"last":1.151}]},{"osd":6,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.02,"15min":1.069},"min":{"1min":0.89200000000000002,"5min":0.72699999999999998,"15min":0.55600000000000005},"max":{"1min":1.3420000000000001,"5min":1.371,"15min":1.446},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0700000000000001,"15min":1.0980000000000001},"min":{"1min":0.75600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3360000000000001,"5min":1.45,"15min":1.6220000000000001},"last":0.93000000000000005}]},{"osd":7,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1120000000000001,"15min":1.141},"min":{"1min":0.99099999999999999,"5min":0.85699999999999998,"15min":0.67900000000000005},"max":{"1min":1.4019999999999999,"5min":1.488,"15min":1.5669999999999999},"last":1.357},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.073,"15min":1.141},"min":{"1min":0.879,"5min":0.77200000000000002,"15min":0.67100000000000004},"max":{"1min":1.3069999999999999,"5min":1.534,"15min":1.6499999999999999},"last":0.98699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574945,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9736,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362104,"statfs":{"total":96636764160,"available":96626794496,"internally_reserved":0,"allocated":851968,"data_stored":377318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77400000000000002,"5min":0.94999999999999996,"15min":0.997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71299999999999997,"15min":0.64800000000000002},"min":{"1min":0.52200000000000002,"5min":0.39400000000000002,"15min":0.38500000000000001},"max":{"1min":0.96699999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.63100000000000001}]},{"osd":1,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64600000000000002,"15min":0.628},"min":{"1min":0.45000000000000001,"5min":0.378,"15min":0.36199999999999999},"max":{"1min":0.85599999999999998,"5min":0.997,"15min":1.123},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72299999999999998,"15min":0.68999999999999995},"min":{"1min":0.56499999999999995,"5min":0.45600000000000002,"15min":0.44400000000000001},"max":{"1min":0.90000000000000002,"5min":1.0009999999999999,"15min":1.0569999999999999},"last":0.70299999999999996}]},{"osd":3,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80900000000000005,"15min":0.751},"min":{"1min":0.61399999999999999,"5min":0.46000000000000002,"15min":0.317},"max":{"1min":1.079,"5min":1.143,"15min":1.1599999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76700000000000002,"15min":0.75},"min":{"1min":0.54900000000000004,"5min":0.436,"15min":0.34000000000000002},"max":{"1min":0.93400000000000005,"5min":1.222,"15min":1.222},"last":0.50900000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.93500000000000005,"15min":0.92100000000000004},"min":{"1min":0.80600000000000005,"5min":0.64800000000000002,"15min":0.498},"max":{"1min":1.1639999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.998,"5min":1.0029999999999999,"15min":1.004},"min":{"1min":0.86699999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1599999999999999,"5min":1.3,"15min":1.4159999999999999},"last":0.88700000000000001}]},{"osd":5,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94299999999999995,"15min":0.95099999999999996},"min":{"1min":0.70199999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.226,"5min":1.343,"15min":1.4430000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.022,"15min":1},"min":{"1min":0.71099999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.407,"5min":1.643,"15min":1.6830000000000001},"last":0.749}]},{"osd":6,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.024,"15min":1.0329999999999999},"min":{"1min":0.78700000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.3260000000000001,"5min":1.6060000000000001,"15min":1.8240000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.018,"15min":1.006},"min":{"1min":0.71899999999999997,"5min":0.67900000000000005,"15min":0.55400000000000005},"max":{"1min":1.224,"5min":1.54,"15min":1.54},"last":0.72399999999999998}]},{"osd":7,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0700000000000001,"15min":1.0640000000000001},"min":{"1min":0.77000000000000002,"5min":0.74399999999999999,"15min":0.57199999999999995},"max":{"1min":1.276,"5min":1.5069999999999999,"15min":1.5980000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.147,"15min":1.1160000000000001},"min":{"1min":0.83399999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3640000000000001,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":0.86499999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9864,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361976,"statfs":{"total":96636764160,"available":96626663424,"internally_reserved":0,"allocated":851968,"data_stored":377318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.624,"15min":0.63900000000000001},"min":{"1min":0.502,"5min":0.38700000000000001,"15min":0.314},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68600000000000005,"15min":0.68100000000000005},"min":{"1min":0.52500000000000002,"5min":0.39500000000000002,"15min":0.318},"max":{"1min":1.0629999999999999,"5min":1.1040000000000001,"15min":1.181},"last":0.64100000000000001}]},{"osd":2,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.54500000000000004,"5min":0.42699999999999999,"15min":0.38500000000000001},"max":{"1min":1.208,"5min":1.2230000000000001,"15min":1.3009999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.75900000000000001,"15min":0.75600000000000001},"min":{"1min":0.55600000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1200000000000001,"5min":1.228,"15min":1.409},"last":0.93300000000000005}]},{"osd":3,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.871,"15min":0.83999999999999997},"min":{"1min":0.626,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.246,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.80700000000000005,"15min":0.76200000000000001},"min":{"1min":0.66600000000000004,"5min":0.46300000000000002,"15min":0.435},"max":{"1min":1.036,"5min":1.1240000000000001,"15min":1.2529999999999999},"last":0.75}]},{"osd":4,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.97599999999999998,"15min":0.98599999999999999},"min":{"1min":0.81699999999999995,"5min":0.66600000000000004,"15min":0.61899999999999999},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92500000000000004,"15min":0.93500000000000005},"min":{"1min":0.73199999999999998,"5min":0.64100000000000001,"15min":0.52000000000000002},"max":{"1min":1.1060000000000001,"5min":1.3049999999999999,"15min":2.1309999999999998},"last":0.95199999999999996}]},{"osd":5,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0029999999999999,"15min":0.98399999999999999},"min":{"1min":0.80200000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.95999999999999996,"15min":1.0189999999999999},"min":{"1min":0.88200000000000001,"5min":0.63100000000000001,"15min":0.60799999999999998},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":2.004},"last":0.81799999999999995}]},{"osd":6,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97799999999999998,"15min":0.996},"min":{"1min":0.78400000000000003,"5min":0.63600000000000001,"15min":0.61499999999999999},"max":{"1min":1.3109999999999999,"5min":1.3660000000000001,"15min":1.889},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.129,"5min":1.087,"15min":1.1000000000000001},"min":{"1min":0.93300000000000005,"5min":0.745,"15min":0.64400000000000002},"max":{"1min":1.5389999999999999,"5min":1.6739999999999999,"15min":1.9610000000000001},"last":1.002}]},{"osd":7,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.0840000000000001,"15min":1.089},"min":{"1min":0.81200000000000006,"5min":0.629,"15min":0.629},"max":{"1min":1.5149999999999999,"5min":1.6200000000000001,"15min":1.766},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.0569999999999999,"15min":1.0980000000000001},"min":{"1min":0.91500000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":2.0470000000000002},"last":1.028}]}]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15052,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":13632,"kb_avail":94356788,"statfs":{"total":96636764160,"available":96621350912,"internally_reserved":0,"allocated":1445888,"data_stored":967686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13959168},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65600000000000003,"15min":0.64000000000000001},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.35099999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71099999999999997,"15min":0.66400000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.36699999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.198},"last":0.61799999999999999}]},{"osd":2,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.74099999999999999,"15min":0.71799999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.28599999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.73599999999999999,"15min":0.71699999999999997},"min":{"1min":0.55800000000000005,"5min":0.434,"15min":0.34399999999999997},"max":{"1min":1.099,"5min":1.099,"15min":1.143},"last":0.91000000000000003}]},{"osd":3,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70399999999999996,"15min":0.68700000000000006},"min":{"1min":0.52700000000000002,"5min":0.41299999999999998,"15min":0.39200000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.298},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.83799999999999997,"15min":0.84299999999999997},"min":{"1min":0.66300000000000003,"5min":0.54700000000000004,"15min":0.32100000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.629},"last":0.85999999999999999}]},{"osd":4,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.71499999999999997,"5min":0.69999999999999996,"15min":0.68700000000000006},"max":{"1min":1.153,"5min":1.341,"15min":1.341},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.01,"5min":0.98099999999999998,"15min":0.96499999999999997},"min":{"1min":0.83699999999999997,"5min":0.73599999999999999,"15min":0.56100000000000005},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.042}]},{"osd":5,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97299999999999998,"15min":0.98399999999999999},"min":{"1min":0.755,"5min":0.71699999999999997,"15min":0.65800000000000003},"max":{"1min":1.2170000000000001,"5min":1.337,"15min":1.895},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.96299999999999997,"15min":0.94699999999999995},"min":{"1min":0.90300000000000002,"5min":0.76200000000000001,"15min":0.68899999999999995},"max":{"1min":1.1879999999999999,"5min":1.3009999999999999,"15min":1.319},"last":1.0780000000000001}]},{"osd":6,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0580000000000001,"15min":1.0509999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.70299999999999996},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.113},{"interface":"front","average":{"1min":1.05,"5min":1.0640000000000001,"15min":1.0760000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.75800000000000001},"max":{"1min":1.3149999999999999,"5min":1.4950000000000001,"15min":2.1059999999999999},"last":1.1399999999999999}]},{"osd":7,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.075,"15min":1.099},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.329,"5min":1.4330000000000001,"15min":2.1869999999999998},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0409999999999999,"15min":1.0229999999999999},"min":{"1min":0.83199999999999996,"5min":0.748,"15min":0.60899999999999999},"max":{"1min":1.2789999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.173}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:07:58.601 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-28T13:00:15.378000+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=13, tm_min=0, tm_sec=15, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=13, tm_min=7, tm_sec=53, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T13:07:58.601 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-28T13:00:20.426645+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=13, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=13, tm_min=7, tm_sec=53, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T13:07:58.601 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-28T13:00:20.426645+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=13, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=13, tm_min=7, tm_sec=53, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T13:07:58.602 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-28T13:00:20.426645+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=13, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=13, tm_min=7, tm_sec=53, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T13:07:58.602 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-28T13:00:20.426645+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=13, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=13, tm_min=7, tm_sec=53, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T13:07:58.602 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-28T13:00:20.426645+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=13, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=13, tm_min=7, tm_sec=53, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T13:07:58.602 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-28T13:00:20.426645+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=13, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=13, tm_min=7, tm_sec=53, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T13:07:58.602 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-28T13:00:20.426645+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=13, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=13, tm_min=7, tm_sec=53, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T13:07:58.603 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-28T13:00:20.426645+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=13, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=13, tm_min=7, tm_sec=53, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T13:07:58.603 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-28T13:08:18.604 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T13:08:18.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.721+0000 7fc2011d0700 1 Processor -- start 2023-11-28T13:08:18.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.721+0000 7fc2011d0700 1 -- start start 2023-11-28T13:08:18.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc2011d0700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc1fc0b3910 0x7fc1fc06b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:08:18.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc2011d0700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1fc070070 0x7fc1fc070470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:08:18.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc2011d0700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1fc06c480 con 0x7fc1fc06c910 2023-11-28T13:08:18.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc2011d0700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1fc0709b0 con 0x7fc1fc0b3910 2023-11-28T13:08:18.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc2011d0700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1fc06dbe0 con 0x7fc1fc070070 2023-11-28T13:08:18.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc1fb7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc1fc06c910 0x7fc1fc06d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55984/0 (socket says 172.21.15.82:55984) 2023-11-28T13:08:18.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc1fb7fe700 1 -- 172.21.15.82:0/1676598573 learned_addr learned my addr 172.21.15.82:0/1676598573 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:08:18.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc1fbfff700 1 --2- 172.21.15.82:0/1676598573 >> v2:172.21.15.82:3300/0 conn(0x7fc1fc0b3910 0x7fc1fc06b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:08:18.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc2009cf700 1 --2- 172.21.15.82:0/1676598573 >> v2:172.21.15.114:3300/0 conn(0x7fc1fc070070 0x7fc1fc070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:08:18.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc1faffd700 1 -- 172.21.15.82:0/1676598573 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758618339 0 0) 0x7fc1fc06c480 con 0x7fc1fc06c910 2023-11-28T13:08:18.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc1faffd700 1 -- 172.21.15.82:0/1676598573 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1e40035d0 con 0x7fc1fc06c910 2023-11-28T13:08:18.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc1fbfff700 1 -- 172.21.15.82:0/1676598573 >> v2:172.21.15.114:3300/0 conn(0x7fc1fc070070 msgr2=0x7fc1fc070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:08:18.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc1fbfff700 1 --2- 172.21.15.82:0/1676598573 >> v2:172.21.15.114:3300/0 conn(0x7fc1fc070070 0x7fc1fc070470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:18.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc1fbfff700 1 -- 172.21.15.82:0/1676598573 >> v1:172.21.15.82:6789/0 conn(0x7fc1fc06c910 legacy=0x7fc1fc06d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:08:18.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc1faffd700 1 -- 172.21.15.82:0/1676598573 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 336975351 0 0) 0x7fc1e40035d0 con 0x7fc1fc06c910 2023-11-28T13:08:18.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc1fbfff700 1 -- 172.21.15.82:0/1676598573 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1fc06dec0 con 0x7fc1fc0b3910 2023-11-28T13:08:18.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc1fbfff700 1 --2- 172.21.15.82:0/1676598573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1fc0b3910 0x7fc1fc06b0a0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc070000 tx=0x7fc1f0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b7407160f6858a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:08:18.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc1faffd700 1 -- 172.21.15.82:0/1676598573 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec0019f0 con 0x7fc1fc0b3910 2023-11-28T13:08:18.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc1faffd700 1 -- 172.21.15.82:0/1676598573 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f0004030 con 0x7fc1fc0b3910 2023-11-28T13:08:18.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc1faffd700 1 -- 172.21.15.82:0/1676598573 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f00043a0 con 0x7fc1fc0b3910 2023-11-28T13:08:18.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc2011d0700 1 -- 172.21.15.82:0/1676598573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1fc0b3910 msgr2=0x7fc1fc06b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:08:18.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc2011d0700 1 --2- 172.21.15.82:0/1676598573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1fc0b3910 0x7fc1fc06b0a0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc070000 tx=0x7fc1f0009b30 comp rx=0 tx=0).stop 2023-11-28T13:08:18.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc2011d0700 1 -- 172.21.15.82:0/1676598573 shutdown_connections 2023-11-28T13:08:18.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc2011d0700 1 --2- 172.21.15.82:0/1676598573 >> v2:172.21.15.114:3300/0 conn(0x7fc1fc070070 0x7fc1fc070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:18.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc2011d0700 1 --2- 172.21.15.82:0/1676598573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1fc0b3910 0x7fc1fc06b0a0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:18.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc2011d0700 1 -- 172.21.15.82:0/1676598573 >> 172.21.15.82:0/1676598573 conn(0x7fc1fc0ce600 msgr2=0x7fc1fc0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:08:18.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc2011d0700 1 -- 172.21.15.82:0/1676598573 shutdown_connections 2023-11-28T13:08:18.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.725+0000 7fc2011d0700 1 -- 172.21.15.82:0/1676598573 wait complete. 2023-11-28T13:08:18.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.729+0000 7fc2011d0700 1 Processor -- start 2023-11-28T13:08:18.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.729+0000 7fc2011d0700 1 -- start start 2023-11-28T13:08:18.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.729+0000 7fc2011d0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1fc06c910 0x7fc1fc1579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:08:18.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.729+0000 7fc2011d0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1fc070070 0x7fc1fc15b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:08:18.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.729+0000 7fc2011d0700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1fc0b3910 0x7fc1fc15df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:08:18.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.729+0000 7fc2011d0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc157f20 con 0x7fc1fc070070 2023-11-28T13:08:18.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.729+0000 7fc2011d0700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc15dac0 con 0x7fc1fc06c910 2023-11-28T13:08:18.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.729+0000 7fc2011d0700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc15b7c0 con 0x7fc1fc0b3910 2023-11-28T13:08:18.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.729+0000 7fc1fb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1fc070070 0x7fc1fc15b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:08:18.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.729+0000 7fc1fb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1fc070070 0x7fc1fc15b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57170/0 (socket says 172.21.15.82:57170) 2023-11-28T13:08:18.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.729+0000 7fc1fb7fe700 1 -- 172.21.15.82:0/3552283015 learned_addr learned my addr 172.21.15.82:0/3552283015 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:08:18.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.733+0000 7fc1fbfff700 1 --2- 172.21.15.82:0/3552283015 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1fc06c910 0x7fc1fc1579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:08:18.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.733+0000 7fc2009cf700 1 --2- 172.21.15.82:0/3552283015 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1fc0b3910 0x7fc1fc15df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:08:18.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.733+0000 7fc1fb7fe700 1 -- 172.21.15.82:0/3552283015 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1fc0b3910 msgr2=0x7fc1fc15df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:08:18.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.733+0000 7fc1fb7fe700 1 --2- 172.21.15.82:0/3552283015 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1fc0b3910 0x7fc1fc15df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:18.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.733+0000 7fc1fb7fe700 1 -- 172.21.15.82:0/3552283015 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1fc06c910 msgr2=0x7fc1fc1579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:08:18.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.733+0000 7fc1fb7fe700 1 --2- 172.21.15.82:0/3552283015 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1fc06c910 0x7fc1fc1579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:18.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.733+0000 7fc1fb7fe700 1 -- 172.21.15.82:0/3552283015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f00094b0 con 0x7fc1fc070070 2023-11-28T13:08:18.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.733+0000 7fc1fbfff700 1 --2- 172.21.15.82:0/3552283015 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1fc06c910 0x7fc1fc1579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T13:08:18.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.733+0000 7fc1fb7fe700 1 --2- 172.21.15.82:0/3552283015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1fc070070 0x7fc1fc15b280 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec001940 tx=0x7fc1ec00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:08:18.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.733+0000 7fc1f8ff9700 1 -- 172.21.15.82:0/3552283015 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec00ad80 con 0x7fc1fc070070 2023-11-28T13:08:18.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.733+0000 7fc1f8ff9700 1 -- 172.21.15.82:0/3552283015 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec0070d0 con 0x7fc1fc070070 2023-11-28T13:08:18.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.733+0000 7fc2011d0700 1 -- 172.21.15.82:0/3552283015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1fc0c8f80 con 0x7fc1fc070070 2023-11-28T13:08:18.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.733+0000 7fc2011d0700 1 -- 172.21.15.82:0/3552283015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1fc06c110 con 0x7fc1fc070070 2023-11-28T13:08:18.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.733+0000 7fc1f8ff9700 1 -- 172.21.15.82:0/3552283015 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec007480 con 0x7fc1fc070070 2023-11-28T13:08:18.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.733+0000 7fc2011d0700 1 -- 172.21.15.82:0/3552283015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1fc0b3ce0 con 0x7fc1fc070070 2023-11-28T13:08:18.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.733+0000 7fc1f8ff9700 1 -- 172.21.15.82:0/3552283015 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc1ec010070 con 0x7fc1fc070070 2023-11-28T13:08:18.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.737+0000 7fc1f8ff9700 1 --2- 172.21.15.82:0/3552283015 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc1e8064ee0 0x7fc1e8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:08:18.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.737+0000 7fc1fbfff700 1 --2- 172.21.15.82:0/3552283015 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc1e8064ee0 0x7fc1e8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:08:18.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.737+0000 7fc1f8ff9700 1 -- 172.21.15.82:0/3552283015 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc1ec0817b0 con 0x7fc1fc070070 2023-11-28T13:08:18.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.737+0000 7fc1fbfff700 1 --2- 172.21.15.82:0/3552283015 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc1e8064ee0 0x7fc1e8067390 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009b70 tx=0x7fc1f0013040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:08:18.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.741+0000 7fc1f8ff9700 1 -- 172.21.15.82:0/3552283015 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc1ec04fb40 con 0x7fc1fc070070 2023-11-28T13:08:18.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.901+0000 7fc2011d0700 1 -- 172.21.15.82:0/3552283015 --> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc1fc15dc50 con 0x7fc1e8064ee0 2023-11-28T13:08:18.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.905+0000 7fc1f8ff9700 1 -- 172.21.15.82:0/3552283015 <== mgr.4110 v2:172.21.15.82:6832/36500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71547 (secure 0 0 0) 0x7fc1fc15dc50 con 0x7fc1e8064ee0 2023-11-28T13:08:18.912 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:08:18.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.913+0000 7fc2011d0700 1 -- 172.21.15.82:0/3552283015 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc1e8064ee0 msgr2=0x7fc1e8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:08:18.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.913+0000 7fc2011d0700 1 --2- 172.21.15.82:0/3552283015 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc1e8064ee0 0x7fc1e8067390 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009b70 tx=0x7fc1f0013040 comp rx=0 tx=0).stop 2023-11-28T13:08:18.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.913+0000 7fc2011d0700 1 -- 172.21.15.82:0/3552283015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1fc070070 msgr2=0x7fc1fc15b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:08:18.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.913+0000 7fc2011d0700 1 --2- 172.21.15.82:0/3552283015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1fc070070 0x7fc1fc15b280 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec001940 tx=0x7fc1ec00a340 comp rx=0 tx=0).stop 2023-11-28T13:08:18.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.913+0000 7fc2011d0700 1 -- 172.21.15.82:0/3552283015 shutdown_connections 2023-11-28T13:08:18.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.913+0000 7fc2011d0700 1 --2- 172.21.15.82:0/3552283015 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fc1e8064ee0 0x7fc1e8067390 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:18.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.913+0000 7fc2011d0700 1 --2- 172.21.15.82:0/3552283015 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1fc0b3910 0x7fc1fc15df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:18.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.913+0000 7fc2011d0700 1 --2- 172.21.15.82:0/3552283015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1fc070070 0x7fc1fc15b280 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:18.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.913+0000 7fc2011d0700 1 --2- 172.21.15.82:0/3552283015 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1fc06c910 0x7fc1fc1579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:18.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.913+0000 7fc2011d0700 1 -- 172.21.15.82:0/3552283015 >> 172.21.15.82:0/3552283015 conn(0x7fc1fc0ce600 msgr2=0x7fc1fc0ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:08:18.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.913+0000 7fc2011d0700 1 -- 172.21.15.82:0/3552283015 shutdown_connections 2023-11-28T13:08:18.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:18.913+0000 7fc2011d0700 1 -- 172.21.15.82:0/3552283015 wait complete. 2023-11-28T13:08:18.918 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-11-28T13:08:18.931 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2023-11-28T13:08:17.325197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":89352,"kb_used_data":7816,"kb_used_omap":0,"kb_used_meta":81472,"kb_avail":754885368,"statfs":{"total":773094113280,"available":773002616832,"internally_reserved":0,"allocated":8003584,"data_stored":4199280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":83427328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003480"},"pg_stats":[{"pgid":"1.0","version":"70'119","reported_seq":233,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T13:08:03.814410+0000","last_change":"2023-11-28T13:08:03.814344+0000","last_active":"2023-11-28T13:08:03.814410+0000","last_peered":"2023-11-28T13:08:03.814410+0000","last_clean":"2023-11-28T13:08:03.814410+0000","last_became_active":"2023-11-28T13:00:16.449607+0000","last_became_peered":"2023-11-28T13:00:16.449607+0000","last_unstale":"2023-11-28T13:08:03.814410+0000","last_undegraded":"2023-11-28T13:08:03.814410+0000","last_fullsized":"2023-11-28T13:08:03.814410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'119","last_scrub_stamp":"2023-11-28T13:08:03.814077+0000","last_deep_scrub":"70'119","last_deep_scrub_stamp":"2023-11-28T13:08:03.814077+0000","last_clean_scrub_stamp":"2023-11-28T13:08:03.814077+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:47:24.179682+0000","scrub_duration":0.013443023,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T13:08:06.718833+0000","last_change":"2023-11-28T13:08:06.718764+0000","last_active":"2023-11-28T13:08:06.718833+0000","last_peered":"2023-11-28T13:08:06.718833+0000","last_clean":"2023-11-28T13:08:06.718833+0000","last_became_active":"2023-11-28T13:00:21.462947+0000","last_became_peered":"2023-11-28T13:00:21.462947+0000","last_unstale":"2023-11-28T13:08:06.718833+0000","last_undegraded":"2023-11-28T13:08:06.718833+0000","last_fullsized":"2023-11-28T13:08:06.718833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:08:06.718511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:08:06.718511+0000","last_clean_scrub_stamp":"2023-11-28T13:08:06.718511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:46:22.897751+0000","scrub_duration":0.0058515490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":78,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T13:08:04.836980+0000","last_change":"2023-11-28T13:08:04.836917+0000","last_active":"2023-11-28T13:08:04.836980+0000","last_peered":"2023-11-28T13:08:04.836980+0000","last_clean":"2023-11-28T13:08:04.836980+0000","last_became_active":"2023-11-28T13:00:21.459876+0000","last_became_peered":"2023-11-28T13:00:21.459876+0000","last_unstale":"2023-11-28T13:08:04.836980+0000","last_undegraded":"2023-11-28T13:08:04.836980+0000","last_fullsized":"2023-11-28T13:08:04.836980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:08:04.836651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:08:04.836651+0000","last_clean_scrub_stamp":"2023-11-28T13:08:04.836651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:46:21.015891+0000","scrub_duration":0.0062714709999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T13:07:58.110051+0000","last_change":"2023-11-28T13:07:58.109999+0000","last_active":"2023-11-28T13:07:58.110051+0000","last_peered":"2023-11-28T13:07:58.110051+0000","last_clean":"2023-11-28T13:07:58.110051+0000","last_became_active":"2023-11-28T13:00:21.463506+0000","last_became_peered":"2023-11-28T13:00:21.463506+0000","last_unstale":"2023-11-28T13:07:58.110051+0000","last_undegraded":"2023-11-28T13:07:58.110051+0000","last_fullsized":"2023-11-28T13:07:58.110051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:07:58.109795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:07:58.109795+0000","last_clean_scrub_stamp":"2023-11-28T13:07:58.109795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:15.032680+0000","scrub_duration":0.00519909,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T13:08:05.739110+0000","last_change":"2023-11-28T13:08:05.739054+0000","last_active":"2023-11-28T13:08:05.739110+0000","last_peered":"2023-11-28T13:08:05.739110+0000","last_clean":"2023-11-28T13:08:05.739110+0000","last_became_active":"2023-11-28T13:00:21.465103+0000","last_became_peered":"2023-11-28T13:00:21.465103+0000","last_unstale":"2023-11-28T13:08:05.739110+0000","last_undegraded":"2023-11-28T13:08:05.739110+0000","last_fullsized":"2023-11-28T13:08:05.739110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:08:05.738794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:08:05.738794+0000","last_clean_scrub_stamp":"2023-11-28T13:08:05.738794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:47:26.104399+0000","scrub_duration":0.0060121749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T13:07:57.373223+0000","last_change":"2023-11-28T13:07:57.373172+0000","last_active":"2023-11-28T13:07:57.373223+0000","last_peered":"2023-11-28T13:07:57.373223+0000","last_clean":"2023-11-28T13:07:57.373223+0000","last_became_active":"2023-11-28T13:00:21.460824+0000","last_became_peered":"2023-11-28T13:00:21.460824+0000","last_unstale":"2023-11-28T13:07:57.373223+0000","last_undegraded":"2023-11-28T13:07:57.373223+0000","last_fullsized":"2023-11-28T13:07:57.373223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:07:57.372929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:07:57.372929+0000","last_clean_scrub_stamp":"2023-11-28T13:07:57.372929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:17.378455+0000","scrub_duration":0.0051051530000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T13:08:05.802264+0000","last_change":"2023-11-28T13:08:05.802146+0000","last_active":"2023-11-28T13:08:05.802264+0000","last_peered":"2023-11-28T13:08:05.802264+0000","last_clean":"2023-11-28T13:08:05.802264+0000","last_became_active":"2023-11-28T13:00:21.456961+0000","last_became_peered":"2023-11-28T13:00:21.456961+0000","last_unstale":"2023-11-28T13:08:05.802264+0000","last_undegraded":"2023-11-28T13:08:05.802264+0000","last_fullsized":"2023-11-28T13:08:05.802264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:08:05.801894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:08:05.801894+0000","last_clean_scrub_stamp":"2023-11-28T13:08:05.801894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:40:02.339292+0000","scrub_duration":0.0061667290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T13:07:56.324267+0000","last_change":"2023-11-28T13:07:56.324214+0000","last_active":"2023-11-28T13:07:56.324267+0000","last_peered":"2023-11-28T13:07:56.324267+0000","last_clean":"2023-11-28T13:07:56.324267+0000","last_became_active":"2023-11-28T13:00:21.463406+0000","last_became_peered":"2023-11-28T13:00:21.463406+0000","last_unstale":"2023-11-28T13:07:56.324267+0000","last_undegraded":"2023-11-28T13:07:56.324267+0000","last_fullsized":"2023-11-28T13:07:56.324267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:07:56.323982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:07:56.323982+0000","last_clean_scrub_stamp":"2023-11-28T13:07:56.323982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:44:34.781409+0000","scrub_duration":0.0050889619999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T13:07:58.005399+0000","last_change":"2023-11-28T13:07:58.005372+0000","last_active":"2023-11-28T13:07:58.005399+0000","last_peered":"2023-11-28T13:07:58.005399+0000","last_clean":"2023-11-28T13:07:58.005399+0000","last_became_active":"2023-11-28T13:00:21.462248+0000","last_became_peered":"2023-11-28T13:00:21.462248+0000","last_unstale":"2023-11-28T13:07:58.005399+0000","last_undegraded":"2023-11-28T13:07:58.005399+0000","last_fullsized":"2023-11-28T13:07:58.005399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T13:07:58.005258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T13:07:58.005258+0000","last_clean_scrub_stamp":"2023-11-28T13:07:58.005258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:06:53.818913+0000","scrub_duration":0.0048951610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574947,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15308,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":13888,"kb_avail":94356532,"statfs":{"total":96636764160,"available":96621088768,"internally_reserved":0,"allocated":1445888,"data_stored":967686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14221312},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.84999999999999998,"15min":0.82899999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2150000000000001,"5min":1.28,"15min":1.3859999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.85899999999999999,"15min":0.89200000000000002},"min":{"1min":0.65100000000000002,"5min":0.51200000000000001,"15min":0.5},"max":{"1min":1.196,"5min":1.2130000000000001,"15min":1.377},"last":0.57399999999999995}]},{"osd":1,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.86599999999999999,"15min":0.90100000000000002},"min":{"1min":0.63800000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.1839999999999999,"5min":1.2410000000000001,"15min":1.599},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.86699999999999999,"15min":0.91900000000000004},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.091,"5min":1.194,"15min":1.375},"last":0.94299999999999995}]},{"osd":2,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.85499999999999998,"15min":0.91000000000000003},"min":{"1min":0.61299999999999999,"5min":0.54100000000000004,"15min":0.53300000000000003},"max":{"1min":1.1559999999999999,"5min":1.198,"15min":2.9060000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.94099999999999995,"15min":0.91800000000000004},"min":{"1min":0.63600000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1830000000000001,"5min":1.3109999999999999,"15min":1.6659999999999999},"last":0.621}]},{"osd":3,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.89900000000000002,"15min":0.93200000000000005},"min":{"1min":0.625,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.26,"5min":1.26,"15min":1.6399999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.022,"5min":0.95399999999999996,"15min":0.93400000000000005},"min":{"1min":0.80400000000000005,"5min":0.72499999999999998,"15min":0.59799999999999998},"max":{"1min":1.2090000000000001,"5min":1.212,"15min":1.3660000000000001},"last":0.98299999999999998}]},{"osd":4,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.85599999999999998,"15min":0.95699999999999996},"min":{"1min":0.60799999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.135,"5min":1.1739999999999999,"15min":1.6819999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.90700000000000003,"15min":0.94599999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1499999999999999,"5min":1.2649999999999999,"15min":1.409},"last":0.92400000000000004}]},{"osd":5,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.91800000000000004,"15min":0.996},"min":{"1min":0.66700000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.282,"5min":1.282,"15min":1.466},"last":0.875},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.99099999999999999,"15min":1.0680000000000001},"min":{"1min":0.71099999999999997,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.175,"5min":1.2589999999999999,"15min":1.5449999999999999},"last":0.69299999999999995}]},{"osd":6,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0429999999999999,"15min":1.1379999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.68799999999999994},"max":{"1min":1.236,"5min":1.28,"15min":2.0630000000000002},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.042,"15min":1.1299999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.2450000000000001,"5min":1.407,"15min":1.794},"last":1.0609999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574948,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9608,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362232,"statfs":{"total":96636764160,"available":96626925568,"internally_reserved":0,"allocated":851968,"data_stored":377318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81000000000000005,"15min":0.82699999999999996},"min":{"1min":0.54400000000000004,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1000000000000001,"5min":1.23,"15min":1.5580000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.90500000000000003,"15min":0.86499999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.54100000000000004},"max":{"1min":1.1599999999999999,"5min":1.448,"15min":1.448},"last":1.0580000000000001}]},{"osd":1,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.93600000000000005,"15min":0.88800000000000001},"min":{"1min":0.65300000000000002,"5min":0.59199999999999997,"15min":0.51900000000000002},"max":{"1min":1.25,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.872},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85599999999999998,"15min":0.86299999999999999},"min":{"1min":0.66900000000000004,"5min":0.59699999999999998,"15min":0.55900000000000005},"max":{"1min":1.0349999999999999,"5min":1.716,"15min":1.716},"last":0.84699999999999998}]},{"osd":2,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.878,"15min":0.88100000000000001},"min":{"1min":0.60599999999999998,"5min":0.505,"15min":0.505},"max":{"1min":1.1319999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93700000000000006,"15min":0.90600000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.175,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.96499999999999997}]},{"osd":3,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.88,"15min":0.88100000000000001},"min":{"1min":0.68300000000000005,"5min":0.57399999999999995,"15min":0.53300000000000003},"max":{"1min":1.149,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96399999999999997,"15min":0.97199999999999998},"min":{"1min":0.69399999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1950000000000001,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.036}]},{"osd":4,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.94299999999999995,"15min":0.94699999999999995},"min":{"1min":0.61599999999999999,"5min":0.60999999999999999,"15min":0.59699999999999998},"max":{"1min":1.3,"5min":1.746,"15min":1.8049999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.96399999999999997,"15min":1.3140000000000001},"min":{"1min":0.72499999999999998,"5min":0.63500000000000001,"15min":0.629},"max":{"1min":1.228,"5min":1.2969999999999999,"15min":10.566000000000001},"last":0.98399999999999999}]},{"osd":5,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":1.006,"15min":1.0580000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3069999999999999,"5min":2.048,"15min":2.048},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.042,"5min":1.1120000000000001,"15min":1.095},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.325,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":1.0129999999999999}]},{"osd":7,"last update":"Tue Nov 28 13:07:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.044,"15min":1.1779999999999999},"min":{"1min":0.78400000000000003,"5min":0.751,"15min":0.74299999999999999},"max":{"1min":1.208,"5min":1.367,"15min":3.4980000000000002},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.141,"15min":1.264},"min":{"1min":0.98899999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.3759999999999999,"5min":1.7669999999999999,"15min":3.593},"last":1.087}]}]},{"osd":5,"up_from":13,"seq":55834574949,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9800,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362040,"statfs":{"total":96636764160,"available":96626728960,"internally_reserved":0,"allocated":851968,"data_stored":377318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.82099999999999995,"15min":0.81799999999999995},"min":{"1min":0.60899999999999999,"5min":0.53700000000000003,"15min":0.502},"max":{"1min":1.054,"5min":1.171,"15min":1.171},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.876,"15min":0.83899999999999997},"min":{"1min":0.68400000000000005,"5min":0.55400000000000005,"15min":0.48399999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.70599999999999996}]},{"osd":1,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.84699999999999998,"15min":0.83099999999999996},"min":{"1min":0.66000000000000003,"5min":0.48999999999999999,"15min":0.46000000000000002},"max":{"1min":1.077,"5min":1.1919999999999999,"15min":1.274},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.86899999999999999,"15min":0.82099999999999995},"min":{"1min":0.54600000000000004,"5min":0.434,"15min":0.434},"max":{"1min":1.173,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.72899999999999998}]},{"osd":2,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.88300000000000001,"15min":0.83599999999999997},"min":{"1min":0.67800000000000005,"5min":0.59599999999999997,"15min":0.45500000000000002},"max":{"1min":1.212,"5min":1.395,"15min":1.395},"last":0.871},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.89400000000000002,"15min":0.92300000000000004},"min":{"1min":0.66200000000000003,"5min":0.55700000000000005,"15min":0.53000000000000003},"max":{"1min":1.198,"5min":1.26,"15min":1.3560000000000001},"last":0.84299999999999997}]},{"osd":3,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.93999999999999995,"15min":0.89600000000000002},"min":{"1min":0.70299999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.014,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.82399999999999995,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2210000000000001,"5min":1.365,"15min":1.403},"last":1.052}]},{"osd":4,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.86899999999999999,"15min":0.88200000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.40699999999999997},"max":{"1min":1.246,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.97899999999999998,"15min":0.96699999999999997},"min":{"1min":0.56899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.444,"5min":1.5189999999999999,"15min":4.3300000000000001},"last":1.0129999999999999}]},{"osd":6,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97299999999999998,"15min":1.0089999999999999},"min":{"1min":0.68799999999999994,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.224,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0660000000000001,"15min":1.0409999999999999},"min":{"1min":0.82899999999999996,"5min":0.70599999999999996,"15min":0.59299999999999997},"max":{"1min":1.3129999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.995}]},{"osd":7,"last update":"Tue Nov 28 13:07:27 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.1000000000000001,"15min":1.0629999999999999},"min":{"1min":0.73399999999999999,"5min":0.58399999999999996,"15min":0.56599999999999995},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":4.234},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.101,"15min":1.1259999999999999},"min":{"1min":0.77900000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2989999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.129}]}]},{"osd":4,"up_from":13,"seq":55834574948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":9992,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361848,"statfs":{"total":96636764160,"available":96626532352,"internally_reserved":0,"allocated":851968,"data_stored":377318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.86099999999999999,"15min":0.82799999999999996},"min":{"1min":0.58899999999999997,"5min":0.57999999999999996,"15min":0.53600000000000003},"max":{"1min":1.107,"5min":1.1699999999999999,"15min":1.2589999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.84399999999999997,"15min":0.82299999999999995},"min":{"1min":0.69499999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2150000000000001,"5min":1.429,"15min":1.429},"last":0.63700000000000001}]},{"osd":1,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81799999999999995,"15min":0.81699999999999995},"min":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.54300000000000004},"max":{"1min":1.038,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.88800000000000001,"15min":0.876},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0700000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.90400000000000003}]},{"osd":2,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.82499999999999996,"15min":0.83499999999999996},"min":{"1min":0.65200000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.002,"5min":1.296,"15min":1.357},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.90500000000000003,"15min":0.89300000000000002},"min":{"1min":0.65600000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1339999999999999,"5min":1.2270000000000001,"15min":1.2549999999999999},"last":0.82499999999999996}]},{"osd":3,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.90600000000000003,"15min":0.88500000000000001},"min":{"1min":0.64900000000000002,"5min":0.64300000000000002,"15min":0.61899999999999999},"max":{"1min":1.1519999999999999,"5min":1.252,"15min":1.252},"last":1.04},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.98099999999999998,"15min":0.98799999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.66400000000000003},"max":{"1min":1.1619999999999999,"5min":1.222,"15min":1.474},"last":0.94699999999999995}]},{"osd":5,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.85499999999999998,"15min":0.88700000000000001},"min":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.53400000000000003},"max":{"1min":1.0369999999999999,"5min":1.2809999999999999,"15min":1.4590000000000001},"last":1.111},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.94099999999999995,"15min":0.97599999999999998},"min":{"1min":0.68200000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2490000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.139}]},{"osd":6,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.92600000000000005,"15min":0.997},"min":{"1min":0.65500000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.093,"5min":1.657,"15min":1.657},"last":0.871},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.026,"15min":1.0629999999999999},"min":{"1min":0.77000000000000002,"5min":0.62,"15min":0.62},"max":{"1min":1.135,"5min":1.4690000000000001,"15min":1.5149999999999999},"last":1.25}]},{"osd":7,"last update":"Tue Nov 28 13:07:24 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.034,"15min":1.073},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.296,"5min":1.389,"15min":1.526},"last":1.093},{"interface":"front","average":{"1min":1.071,"5min":1.0960000000000001,"15min":1.133},"min":{"1min":0.82299999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.258,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.016}]}]},{"osd":3,"up_from":13,"seq":55834574947,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9992,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361848,"statfs":{"total":96636764160,"available":96626532352,"internally_reserved":0,"allocated":851968,"data_stored":377318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.629,"15min":0.60999999999999999},"min":{"1min":0.48299999999999998,"5min":0.41399999999999998,"15min":0.39400000000000002},"max":{"1min":1.0049999999999999,"5min":1.0840000000000001,"15min":1.0900000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.54100000000000004,"5min":0.45100000000000001,"15min":0.43099999999999999},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.53100000000000003}]},{"osd":1,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.496,"5min":0.45500000000000002,"15min":0.32500000000000001},"max":{"1min":0.93899999999999995,"5min":1.0129999999999999,"15min":1.1890000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77400000000000002,"15min":0.76400000000000001},"min":{"1min":0.55600000000000005,"5min":0.48399999999999999,"15min":0.441},"max":{"1min":0.93200000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54800000000000004}]},{"osd":2,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76400000000000001,"15min":0.749},"min":{"1min":0.49099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0129999999999999,"5min":1.028,"15min":1.2989999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.83699999999999997,"15min":0.83099999999999996},"min":{"1min":0.71799999999999997,"5min":0.52400000000000002,"15min":0.438},"max":{"1min":1.0720000000000001,"5min":1.1659999999999999,"15min":1.4550000000000001},"last":0.64400000000000002}]},{"osd":4,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.90800000000000003,"15min":0.96599999999999997},"min":{"1min":0.80900000000000005,"5min":0.65200000000000002,"15min":0.63100000000000001},"max":{"1min":1.2569999999999999,"5min":1.3400000000000001,"15min":1.405},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.98199999999999998,"15min":1.0249999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.57899999999999996},"max":{"1min":1.2929999999999999,"5min":1.3620000000000001,"15min":1.7150000000000001},"last":1.1240000000000001}]},{"osd":5,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.97499999999999998,"15min":1.034},"min":{"1min":0.79300000000000004,"5min":0.64400000000000002,"15min":0.57399999999999995},"max":{"1min":1.26,"5min":1.518,"15min":1.5549999999999999},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.044,"15min":1.075},"min":{"1min":0.91700000000000004,"5min":0.76400000000000001,"15min":0.73799999999999999},"max":{"1min":1.329,"5min":1.5449999999999999,"15min":1.6639999999999999},"last":0.92200000000000004}]},{"osd":6,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.02,"15min":1.069},"min":{"1min":0.89200000000000002,"5min":0.72699999999999998,"15min":0.55600000000000005},"max":{"1min":1.3420000000000001,"5min":1.371,"15min":1.446},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0700000000000001,"15min":1.0980000000000001},"min":{"1min":0.75600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3360000000000001,"5min":1.45,"15min":1.6220000000000001},"last":1.256}]},{"osd":7,"last update":"Tue Nov 28 13:07:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1120000000000001,"15min":1.141},"min":{"1min":0.99099999999999999,"5min":0.85699999999999998,"15min":0.67900000000000005},"max":{"1min":1.4019999999999999,"5min":1.488,"15min":1.5669999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.073,"15min":1.141},"min":{"1min":0.879,"5min":0.77200000000000002,"15min":0.67100000000000004},"max":{"1min":1.3069999999999999,"5min":1.534,"15min":1.6499999999999999},"last":1.095}]}]},{"osd":2,"up_from":13,"seq":55834574949,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9736,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362104,"statfs":{"total":96636764160,"available":96626794496,"internally_reserved":0,"allocated":851968,"data_stored":377318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77400000000000002,"5min":0.94999999999999996,"15min":0.997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71299999999999997,"15min":0.64800000000000002},"min":{"1min":0.52200000000000002,"5min":0.39400000000000002,"15min":0.38500000000000001},"max":{"1min":0.96699999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.58899999999999997}]},{"osd":1,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64600000000000002,"15min":0.628},"min":{"1min":0.45000000000000001,"5min":0.378,"15min":0.36199999999999999},"max":{"1min":0.85599999999999998,"5min":0.997,"15min":1.123},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72299999999999998,"15min":0.68999999999999995},"min":{"1min":0.56499999999999995,"5min":0.45600000000000002,"15min":0.44400000000000001},"max":{"1min":0.90000000000000002,"5min":1.0009999999999999,"15min":1.0569999999999999},"last":0.67000000000000004}]},{"osd":3,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80900000000000005,"15min":0.751},"min":{"1min":0.61399999999999999,"5min":0.46000000000000002,"15min":0.317},"max":{"1min":1.079,"5min":1.143,"15min":1.1599999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76700000000000002,"15min":0.75},"min":{"1min":0.54900000000000004,"5min":0.436,"15min":0.34000000000000002},"max":{"1min":0.93400000000000005,"5min":1.222,"15min":1.222},"last":0.81200000000000006}]},{"osd":4,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.93500000000000005,"15min":0.92100000000000004},"min":{"1min":0.80600000000000005,"5min":0.64800000000000002,"15min":0.498},"max":{"1min":1.1639999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.998,"5min":1.0029999999999999,"15min":1.004},"min":{"1min":0.86699999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1599999999999999,"5min":1.3,"15min":1.4159999999999999},"last":0.78800000000000003}]},{"osd":5,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94299999999999995,"15min":0.95099999999999996},"min":{"1min":0.70199999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.226,"5min":1.343,"15min":1.4430000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.022,"15min":1},"min":{"1min":0.71099999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.407,"5min":1.643,"15min":1.6830000000000001},"last":0.86799999999999999}]},{"osd":6,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.024,"15min":1.0329999999999999},"min":{"1min":0.78700000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.3260000000000001,"5min":1.6060000000000001,"15min":1.8240000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.018,"15min":1.006},"min":{"1min":0.71899999999999997,"5min":0.67900000000000005,"15min":0.55400000000000005},"max":{"1min":1.224,"5min":1.54,"15min":1.54},"last":0.93500000000000005}]},{"osd":7,"last update":"Tue Nov 28 13:07:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0700000000000001,"15min":1.0640000000000001},"min":{"1min":0.77000000000000002,"5min":0.74399999999999999,"15min":0.57199999999999995},"max":{"1min":1.276,"5min":1.5069999999999999,"15min":1.5980000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.147,"15min":1.1160000000000001},"min":{"1min":0.83399999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3640000000000001,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":1.014}]}]},{"osd":1,"up_from":13,"seq":55834574948,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9864,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361976,"statfs":{"total":96636764160,"available":96626663424,"internally_reserved":0,"allocated":851968,"data_stored":377318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.624,"15min":0.63900000000000001},"min":{"1min":0.502,"5min":0.38700000000000001,"15min":0.314},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68600000000000005,"15min":0.68100000000000005},"min":{"1min":0.52500000000000002,"5min":0.39500000000000002,"15min":0.318},"max":{"1min":1.0629999999999999,"5min":1.1040000000000001,"15min":1.181},"last":0.628}]},{"osd":2,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.54500000000000004,"5min":0.42699999999999999,"15min":0.38500000000000001},"max":{"1min":1.208,"5min":1.2230000000000001,"15min":1.3009999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.75900000000000001,"15min":0.75600000000000001},"min":{"1min":0.55600000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1200000000000001,"5min":1.228,"15min":1.409},"last":0.79600000000000004}]},{"osd":3,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.871,"15min":0.83999999999999997},"min":{"1min":0.626,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.246,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.80700000000000005,"15min":0.76200000000000001},"min":{"1min":0.66600000000000004,"5min":0.46300000000000002,"15min":0.435},"max":{"1min":1.036,"5min":1.1240000000000001,"15min":1.2529999999999999},"last":0.76600000000000001}]},{"osd":4,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.97599999999999998,"15min":0.98599999999999999},"min":{"1min":0.81699999999999995,"5min":0.66600000000000004,"15min":0.61899999999999999},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92500000000000004,"15min":0.93500000000000005},"min":{"1min":0.73199999999999998,"5min":0.64100000000000001,"15min":0.52000000000000002},"max":{"1min":1.1060000000000001,"5min":1.3049999999999999,"15min":2.1309999999999998},"last":0.88800000000000001}]},{"osd":5,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0029999999999999,"15min":0.98399999999999999},"min":{"1min":0.80200000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.95999999999999996,"15min":1.0189999999999999},"min":{"1min":0.88200000000000001,"5min":0.63100000000000001,"15min":0.60799999999999998},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":2.004},"last":1.232}]},{"osd":6,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97799999999999998,"15min":0.996},"min":{"1min":0.78400000000000003,"5min":0.63600000000000001,"15min":0.61499999999999999},"max":{"1min":1.3109999999999999,"5min":1.3660000000000001,"15min":1.889},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.087,"15min":1.1000000000000001},"min":{"1min":0.93300000000000005,"5min":0.745,"15min":0.64400000000000002},"max":{"1min":1.5389999999999999,"5min":1.6739999999999999,"15min":1.9610000000000001},"last":1.1639999999999999}]},{"osd":7,"last update":"Tue Nov 28 13:07:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.0840000000000001,"15min":1.089},"min":{"1min":0.81200000000000006,"5min":0.629,"15min":0.629},"max":{"1min":1.5149999999999999,"5min":1.6200000000000001,"15min":1.766},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.0569999999999999,"15min":1.0980000000000001},"min":{"1min":0.91500000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":2.0470000000000002},"last":0.94999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574949,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15052,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":13632,"kb_avail":94356788,"statfs":{"total":96636764160,"available":96621350912,"internally_reserved":0,"allocated":1445888,"data_stored":967686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13959168},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65600000000000003,"15min":0.64000000000000001},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.35099999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71099999999999997,"15min":0.66400000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.36699999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.198},"last":0.69999999999999996}]},{"osd":2,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.74099999999999999,"15min":0.71799999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.28599999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.73599999999999999,"15min":0.71699999999999997},"min":{"1min":0.55800000000000005,"5min":0.434,"15min":0.34399999999999997},"max":{"1min":1.099,"5min":1.099,"15min":1.143},"last":0.81799999999999995}]},{"osd":3,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70399999999999996,"15min":0.68700000000000006},"min":{"1min":0.52700000000000002,"5min":0.41299999999999998,"15min":0.39200000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.298},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.83799999999999997,"15min":0.84299999999999997},"min":{"1min":0.66300000000000003,"5min":0.54700000000000004,"15min":0.32100000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.629},"last":0.79000000000000004}]},{"osd":4,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.71499999999999997,"5min":0.69999999999999996,"15min":0.68700000000000006},"max":{"1min":1.153,"5min":1.341,"15min":1.341},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.01,"5min":0.98099999999999998,"15min":0.96499999999999997},"min":{"1min":0.83699999999999997,"5min":0.73599999999999999,"15min":0.56100000000000005},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.84599999999999997}]},{"osd":5,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97299999999999998,"15min":0.98399999999999999},"min":{"1min":0.755,"5min":0.71699999999999997,"15min":0.65800000000000003},"max":{"1min":1.2170000000000001,"5min":1.337,"15min":1.895},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.96299999999999997,"15min":0.94699999999999995},"min":{"1min":0.90300000000000002,"5min":0.76200000000000001,"15min":0.68899999999999995},"max":{"1min":1.1879999999999999,"5min":1.3009999999999999,"15min":1.319},"last":0.97999999999999998}]},{"osd":6,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0580000000000001,"15min":1.0509999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.70299999999999996},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.0640000000000001,"15min":1.0760000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.75800000000000001},"max":{"1min":1.3149999999999999,"5min":1.4950000000000001,"15min":2.1059999999999999},"last":0.93700000000000006}]},{"osd":7,"last update":"Tue Nov 28 13:07:28 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.075,"15min":1.099},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.329,"5min":1.4330000000000001,"15min":2.1869999999999998},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0409999999999999,"15min":1.0229999999999999},"min":{"1min":0.83199999999999996,"5min":0.748,"15min":0.60899999999999999},"max":{"1min":1.2789999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.071}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T13:08:18.933 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-28T13:08:19.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.041+0000 7fccb1267700 1 Processor -- start 2023-11-28T13:08:19.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.041+0000 7fccb1267700 1 -- start start 2023-11-28T13:08:19.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccb1267700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fccac0b1d10 0x7fccac0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:08:19.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccb1267700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fccac06c140 0x7fccac06a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:08:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccb1267700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccac069bc0 con 0x7fccac0d25b0 2023-11-28T13:08:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccb1267700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccac0d1480 con 0x7fccac06c140 2023-11-28T13:08:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccb1267700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccac0cd280 con 0x7fccac0b1d10 2023-11-28T13:08:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccab7fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fccac0d25b0 0x7fccac06ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55996/0 (socket says 172.21.15.82:55996) 2023-11-28T13:08:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccab7fe700 1 -- 172.21.15.82:0/3234454546 learned_addr learned my addr 172.21.15.82:0/3234454546 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:08:19.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccb0a66700 1 --2- 172.21.15.82:0/3234454546 >> v2:172.21.15.114:3300/0 conn(0x7fccac06c140 0x7fccac06a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:08:19.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccabfff700 1 --2- 172.21.15.82:0/3234454546 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fccac0b1d10 0x7fccac0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:08:19.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccaaffd700 1 -- 172.21.15.82:0/3234454546 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030279050 0 0) 0x7fccac069bc0 con 0x7fccac0d25b0 2023-11-28T13:08:19.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccaaffd700 1 -- 172.21.15.82:0/3234454546 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc980035d0 con 0x7fccac0d25b0 2023-11-28T13:08:19.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccaaffd700 1 -- 172.21.15.82:0/3234454546 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2327141842 0 0) 0x7fcc980035d0 con 0x7fccac0d25b0 2023-11-28T13:08:19.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccaaffd700 1 -- 172.21.15.82:0/3234454546 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fccac0b1d10 msgr2=0x7fccac0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:08:19.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccaaffd700 1 --2- 172.21.15.82:0/3234454546 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fccac0b1d10 0x7fccac0cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:19.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccaaffd700 1 -- 172.21.15.82:0/3234454546 >> v2:172.21.15.114:3300/0 conn(0x7fccac06c140 msgr2=0x7fccac06a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:08:19.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccaaffd700 1 --2- 172.21.15.82:0/3234454546 >> v2:172.21.15.114:3300/0 conn(0x7fccac06c140 0x7fccac06a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:19.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccaaffd700 1 -- 172.21.15.82:0/3234454546 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac0cd560 con 0x7fccac0d25b0 2023-11-28T13:08:19.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccaaffd700 1 -- 172.21.15.82:0/3234454546 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 147993615 0 0) 0x7fcc94001670 con 0x7fccac0d25b0 2023-11-28T13:08:19.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccaaffd700 1 -- 172.21.15.82:0/3234454546 >> v1:172.21.15.82:6789/0 conn(0x7fccac0d25b0 legacy=0x7fccac06ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:08:19.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccaaffd700 1 --2- 172.21.15.82:0/3234454546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc98003a20 0x7fcc98003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:08:19.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccaaffd700 1 --2- 172.21.15.82:0/3234454546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc98004870 0x7fcc98004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:08:19.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccaaffd700 1 --2- 172.21.15.82:0/3234454546 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fccac0b1d10 0x7fcc98005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:08:19.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccaaffd700 1 -- 172.21.15.82:0/3234454546 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac0d1480 con 0x7fcc98004870 2023-11-28T13:08:19.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccaaffd700 1 -- 172.21.15.82:0/3234454546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac0cd280 con 0x7fcc98003a20 2023-11-28T13:08:19.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccaaffd700 1 -- 172.21.15.82:0/3234454546 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9800ba30 con 0x7fccac0b1d10 2023-11-28T13:08:19.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccb0a66700 1 --2- 172.21.15.82:0/3234454546 >> v2:172.21.15.114:3300/0 conn(0x7fccac06c140 0x7fccac06a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:08:19.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccab7fe700 1 --2- 172.21.15.82:0/3234454546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc98004870 0x7fcc98004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:08:19.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccabfff700 1 --2- 172.21.15.82:0/3234454546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc98003a20 0x7fcc98003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:08:19.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccb0a66700 1 --2- 172.21.15.82:0/3234454546 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fccac0b1d10 0x7fcc98005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:08:19.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccab7fe700 1 -- 172.21.15.82:0/3234454546 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fccac0b1d10 msgr2=0x7fcc98005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:08:19.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccab7fe700 1 --2- 172.21.15.82:0/3234454546 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fccac0b1d10 0x7fcc98005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:19.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccab7fe700 1 -- 172.21.15.82:0/3234454546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc98003a20 msgr2=0x7fcc98003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:08:19.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccab7fe700 1 --2- 172.21.15.82:0/3234454546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc98003a20 0x7fcc98003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:19.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccab7fe700 1 -- 172.21.15.82:0/3234454546 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc980035d0 con 0x7fcc98004870 2023-11-28T13:08:19.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.045+0000 7fccab7fe700 1 --2- 172.21.15.82:0/3234454546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc98004870 0x7fcc98004ce0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400c270 tx=0x7fcc980058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115c562744c7717 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:08:19.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.049+0000 7fccaaffd700 1 -- 172.21.15.82:0/3234454546 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc94007b90 con 0x7fcc98004870 2023-11-28T13:08:19.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.049+0000 7fccaaffd700 1 -- 172.21.15.82:0/3234454546 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9400cdb0 con 0x7fcc98004870 2023-11-28T13:08:19.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.049+0000 7fccaaffd700 1 -- 172.21.15.82:0/3234454546 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc94005bc0 con 0x7fcc98004870 2023-11-28T13:08:19.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.049+0000 7fccb1267700 1 -- 172.21.15.82:0/3234454546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc98004870 msgr2=0x7fcc98004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:08:19.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.049+0000 7fccb1267700 1 --2- 172.21.15.82:0/3234454546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc98004870 0x7fcc98004ce0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400c270 tx=0x7fcc980058a0 comp rx=0 tx=0).stop 2023-11-28T13:08:19.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.049+0000 7fccb0a66700 1 -- 172.21.15.82:0/3234454546 reap_dead start 2023-11-28T13:08:19.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.049+0000 7fccb1267700 1 -- 172.21.15.82:0/3234454546 shutdown_connections 2023-11-28T13:08:19.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.049+0000 7fccb1267700 1 -- 172.21.15.82:0/3234454546 >> 172.21.15.82:0/3234454546 conn(0x7fccac0b52a0 msgr2=0x7fccac0d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:08:19.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.049+0000 7fccb1267700 1 -- 172.21.15.82:0/3234454546 shutdown_connections 2023-11-28T13:08:19.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.049+0000 7fccb1267700 1 -- 172.21.15.82:0/3234454546 wait complete. 2023-11-28T13:08:19.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.049+0000 7fccb1267700 1 Processor -- start 2023-11-28T13:08:19.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.049+0000 7fccb1267700 1 -- start start 2023-11-28T13:08:19.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fccb1267700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc98004870 0x7fccac152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:08:19.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fccb1267700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccac0c9b40 0x7fccac145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:08:19.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fccb1267700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccac1f55a0 0x7fccac0cf760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:08:19.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fccb1267700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac146140 con 0x7fccac0c9b40 2023-11-28T13:08:19.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fccb1267700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac152640 con 0x7fccac1f55a0 2023-11-28T13:08:19.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fccb1267700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccac0ca000 con 0x7fcc98004870 2023-11-28T13:08:19.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fccab7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccac0c9b40 0x7fccac145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:08:19.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fccabfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc98004870 0x7fccac152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:08:19.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fccb0a66700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccac1f55a0 0x7fccac0cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:08:19.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fccabfff700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc98004870 0x7fccac152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.82:42296/0 (socket says 172.21.15.82:42296) 2023-11-28T13:08:19.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fccab7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccac0c9b40 0x7fccac145c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57190/0 (socket says 172.21.15.82:57190) 2023-11-28T13:08:19.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fccabfff700 1 -- 172.21.15.82:0/46042250 learned_addr learned my addr 172.21.15.82:0/46042250 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:08:19.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fccabfff700 1 -- 172.21.15.82:0/46042250 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccac1f55a0 msgr2=0x7fccac0cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:08:19.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fccabfff700 1 --2- 172.21.15.82:0/46042250 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccac1f55a0 0x7fccac0cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:19.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fccabfff700 1 -- 172.21.15.82:0/46042250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccac0c9b40 msgr2=0x7fccac145c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:08:19.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fccabfff700 1 --2- 172.21.15.82:0/46042250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccac0c9b40 0x7fccac145c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:19.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fccabfff700 1 -- 172.21.15.82:0/46042250 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac0d1050 con 0x7fcc98004870 2023-11-28T13:08:19.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fccab7fe700 1 --2- 172.21.15.82:0/46042250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccac0c9b40 0x7fccac145c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T13:08:19.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fccabfff700 1 --2- 172.21.15.82:0/46042250 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc98004870 0x7fccac152840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c011a10 tx=0x7fcc9c011d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:08:19.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fcca8ff9700 1 -- 172.21.15.82:0/46042250 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c011eb0 con 0x7fcc98004870 2023-11-28T13:08:19.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fcca8ff9700 1 -- 172.21.15.82:0/46042250 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9c00f940 con 0x7fcc98004870 2023-11-28T13:08:19.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fccb1267700 1 -- 172.21.15.82:0/46042250 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccac0b20e0 con 0x7fcc98004870 2023-11-28T13:08:19.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fcca8ff9700 1 -- 172.21.15.82:0/46042250 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c00fcd0 con 0x7fcc98004870 2023-11-28T13:08:19.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.053+0000 7fccb1267700 1 -- 172.21.15.82:0/46042250 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccac0d11e0 con 0x7fcc98004870 2023-11-28T13:08:19.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.057+0000 7fccb1267700 1 -- 172.21.15.82:0/46042250 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccac0cb3b0 con 0x7fcc98004870 2023-11-28T13:08:19.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.057+0000 7fcca8ff9700 1 -- 172.21.15.82:0/46042250 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcc9c014440 con 0x7fcc98004870 2023-11-28T13:08:19.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.057+0000 7fcca8ff9700 1 --2- 172.21.15.82:0/46042250 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcc8c064f10 0x7fcc8c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:08:19.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.057+0000 7fcca8ff9700 1 -- 172.21.15.82:0/46042250 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fcc9c082230 con 0x7fcc98004870 2023-11-28T13:08:19.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.057+0000 7fccab7fe700 1 --2- 172.21.15.82:0/46042250 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcc8c064f10 0x7fcc8c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:08:19.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.057+0000 7fccab7fe700 1 --2- 172.21.15.82:0/46042250 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcc8c064f10 0x7fcc8c0673c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400c270 tx=0x7fcc9400a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:08:19.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.069+0000 7fcca8ff9700 1 -- 172.21.15.82:0/46042250 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcc9c0506a0 con 0x7fcc98004870 2023-11-28T13:08:19.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.229+0000 7fccb1267700 1 -- 172.21.15.82:0/46042250 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fccac065fc0 con 0x7fcc98004870 2023-11-28T13:08:19.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.245+0000 7fcca8ff9700 1 -- 172.21.15.82:0/46042250 <== mon.2 v2:172.21.15.114:3301/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcc9c0506a0 con 0x7fcc98004870 2023-11-28T13:08:19.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.245+0000 7fcca8ff9700 1 -- 172.21.15.82:0/46042250 <== mon.2 v2:172.21.15.114:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7fcc9c0220c0 con 0x7fcc98004870 2023-11-28T13:08:19.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.249+0000 7fccb1267700 1 -- 172.21.15.82:0/46042250 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcc8c064f10 msgr2=0x7fcc8c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:08:19.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.249+0000 7fccb1267700 1 --2- 172.21.15.82:0/46042250 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcc8c064f10 0x7fcc8c0673c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400c270 tx=0x7fcc9400a000 comp rx=0 tx=0).stop 2023-11-28T13:08:19.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.249+0000 7fccb1267700 1 -- 172.21.15.82:0/46042250 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc98004870 msgr2=0x7fccac152840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:08:19.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.249+0000 7fccb1267700 1 --2- 172.21.15.82:0/46042250 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc98004870 0x7fccac152840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c011a10 tx=0x7fcc9c011d20 comp rx=0 tx=0).stop 2023-11-28T13:08:19.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.249+0000 7fccb1267700 1 -- 172.21.15.82:0/46042250 shutdown_connections 2023-11-28T13:08:19.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.249+0000 7fccb1267700 1 --2- 172.21.15.82:0/46042250 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7fcc8c064f10 0x7fcc8c0673c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:19.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.249+0000 7fccb1267700 1 --2- 172.21.15.82:0/46042250 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccac1f55a0 0x7fccac0cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:19.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.249+0000 7fccb1267700 1 --2- 172.21.15.82:0/46042250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccac0c9b40 0x7fccac145c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:19.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.249+0000 7fccb1267700 1 --2- 172.21.15.82:0/46042250 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc98004870 0x7fccac152840 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:19.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.249+0000 7fccb1267700 1 -- 172.21.15.82:0/46042250 >> 172.21.15.82:0/46042250 conn(0x7fccac0b52a0 msgr2=0x7fccac1602b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:08:19.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.249+0000 7fccb1267700 1 -- 172.21.15.82:0/46042250 shutdown_connections 2023-11-28T13:08:19.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.249+0000 7fccb1267700 1 -- 172.21.15.82:0/46042250 wait complete. 2023-11-28T13:08:19.270 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T13:08:19.270 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T13:08:19.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50dd281700 1 Processor -- start 2023-11-28T13:08:19.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50dd281700 1 -- start start 2023-11-28T13:08:19.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50dd281700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f50d8160b00 0x7f50d80d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:08:19.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50dd281700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50d80c3fc0 0x7f50d80700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:08:19.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50dd281700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d8070a40 con 0x7f50d80705e0 2023-11-28T13:08:19.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50dd281700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d8164e80 con 0x7f50d8160b00 2023-11-28T13:08:19.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50dd281700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d8165370 con 0x7f50d80c3fc0 2023-11-28T13:08:19.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50d77fe700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f50d80705e0 0x7f50d8160ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55998/0 (socket says 172.21.15.82:55998) 2023-11-28T13:08:19.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50d6ffd700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f50d8160b00 0x7f50d80d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:08:19.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50d77fe700 1 -- 172.21.15.82:0/2318450863 learned_addr learned my addr 172.21.15.82:0/2318450863 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-11-28T13:08:19.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50d67fc700 1 --2- 172.21.15.82:0/2318450863 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50d80c3fc0 0x7f50d80700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:08:19.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50d6ffd700 1 -- 172.21.15.82:0/2318450863 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50d80c3fc0 msgr2=0x7f50d80700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T13:08:19.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50d6ffd700 1 --2- 172.21.15.82:0/2318450863 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50d80c3fc0 0x7f50d80700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:19.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50d6ffd700 1 -- 172.21.15.82:0/2318450863 >> v1:172.21.15.82:6789/0 conn(0x7f50d80705e0 legacy=0x7f50d8160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:08:19.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50d6ffd700 1 -- 172.21.15.82:0/2318450863 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d80d0960 con 0x7f50d8160b00 2023-11-28T13:08:19.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50d5ffb700 1 -- 172.21.15.82:0/2318450863 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411044415 0 0) 0x7f50d8070a40 con 0x7f50d80705e0 2023-11-28T13:08:19.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50d6ffd700 1 --2- 172.21.15.82:0/2318450863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d8160b00 0x7f50d80d0420 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f50c8009850 tx=0x7f50c8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba3607f17dd6a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:08:19.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50d5ffb700 1 -- 172.21.15.82:0/2318450863 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c8011830 con 0x7f50d8160b00 2023-11-28T13:08:19.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50d5ffb700 1 -- 172.21.15.82:0/2318450863 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f50c8011990 con 0x7f50d8160b00 2023-11-28T13:08:19.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50d5ffb700 1 -- 172.21.15.82:0/2318450863 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c8011d60 con 0x7f50d8160b00 2023-11-28T13:08:19.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50dd281700 1 -- 172.21.15.82:0/2318450863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d8160b00 msgr2=0x7f50d80d0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:08:19.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.377+0000 7f50dd281700 1 --2- 172.21.15.82:0/2318450863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d8160b00 0x7f50d80d0420 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f50c8009850 tx=0x7f50c8009b60 comp rx=0 tx=0).stop 2023-11-28T13:08:19.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.381+0000 7f50dd281700 1 -- 172.21.15.82:0/2318450863 shutdown_connections 2023-11-28T13:08:19.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.381+0000 7f50dd281700 1 --2- 172.21.15.82:0/2318450863 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50d80c3fc0 0x7f50d80700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:19.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.381+0000 7f50dd281700 1 --2- 172.21.15.82:0/2318450863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d8160b00 0x7f50d80d0420 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:19.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.381+0000 7f50dd281700 1 -- 172.21.15.82:0/2318450863 >> 172.21.15.82:0/2318450863 conn(0x7f50d80d0be0 msgr2=0x7f50d80d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:08:19.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.381+0000 7f50dd281700 1 -- 172.21.15.82:0/2318450863 shutdown_connections 2023-11-28T13:08:19.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.381+0000 7f50dd281700 1 -- 172.21.15.82:0/2318450863 wait complete. 2023-11-28T13:08:19.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.381+0000 7f50dd281700 1 Processor -- start 2023-11-28T13:08:19.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.381+0000 7f50dd281700 1 -- start start 2023-11-28T13:08:19.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50dd281700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d80705e0 0x7f50d80c2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:08:19.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50dd281700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d80c3fc0 0x7f50d80c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:08:19.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50dd281700 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50d8160b00 0x7f50d806e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:08:19.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50dd281700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d80c71e0 con 0x7f50d80c3fc0 2023-11-28T13:08:19.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50dd281700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d8157a20 con 0x7f50d80705e0 2023-11-28T13:08:19.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50dd281700 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d815e9d0 con 0x7f50d8160b00 2023-11-28T13:08:19.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50d67fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d80c3fc0 0x7f50d80c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:08:19.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50d67fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d80c3fc0 0x7f50d80c6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57208/0 (socket says 172.21.15.82:57208) 2023-11-28T13:08:19.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50d67fc700 1 -- 172.21.15.82:0/2284175006 learned_addr learned my addr 172.21.15.82:0/2284175006 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-11-28T13:08:19.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50d6ffd700 1 --2- 172.21.15.82:0/2284175006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d80705e0 0x7f50d80c2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:08:19.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50d77fe700 1 --2- 172.21.15.82:0/2284175006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50d8160b00 0x7f50d806e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:08:19.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50d67fc700 1 -- 172.21.15.82:0/2284175006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50d8160b00 msgr2=0x7f50d806e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:08:19.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50d67fc700 1 --2- 172.21.15.82:0/2284175006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50d8160b00 0x7f50d806e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:19.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50d67fc700 1 -- 172.21.15.82:0/2284175006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d80705e0 msgr2=0x7f50d80c2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:08:19.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50d67fc700 1 --2- 172.21.15.82:0/2284175006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d80705e0 0x7f50d80c2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:19.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50d67fc700 1 -- 172.21.15.82:0/2284175006 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c80094b0 con 0x7f50d80c3fc0 2023-11-28T13:08:19.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50d67fc700 1 --2- 172.21.15.82:0/2284175006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d80c3fc0 0x7f50d80c6ca0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009db0 tx=0x7f50d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:08:19.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50cf7fe700 1 -- 172.21.15.82:0/2284175006 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d0009c20 con 0x7f50d80c3fc0 2023-11-28T13:08:19.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50cf7fe700 1 -- 172.21.15.82:0/2284175006 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f50d000f040 con 0x7f50d80c3fc0 2023-11-28T13:08:19.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50dd281700 1 -- 172.21.15.82:0/2284175006 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d80ce850 con 0x7f50d80c3fc0 2023-11-28T13:08:19.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50cf7fe700 1 -- 172.21.15.82:0/2284175006 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d0014480 con 0x7f50d80c3fc0 2023-11-28T13:08:19.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.385+0000 7f50dd281700 1 -- 172.21.15.82:0/2284175006 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d8165090 con 0x7f50d80c3fc0 2023-11-28T13:08:19.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.389+0000 7f50dd281700 1 -- 172.21.15.82:0/2284175006 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d80ceb30 con 0x7f50d80c3fc0 2023-11-28T13:08:19.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.389+0000 7f50cf7fe700 1 -- 172.21.15.82:0/2284175006 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f50d00145e0 con 0x7f50d80c3fc0 2023-11-28T13:08:19.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.389+0000 7f50cf7fe700 1 --2- 172.21.15.82:0/2284175006 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f50b8064ee0 0x7f50b8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T13:08:19.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.389+0000 7f50cf7fe700 1 -- 172.21.15.82:0/2284175006 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f50d00824c0 con 0x7f50d80c3fc0 2023-11-28T13:08:19.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.389+0000 7f50d6ffd700 1 --2- 172.21.15.82:0/2284175006 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f50b8064ee0 0x7f50b8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T13:08:19.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.389+0000 7f50d6ffd700 1 --2- 172.21.15.82:0/2284175006 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f50b8064ee0 0x7f50b8067390 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f50c80090b0 tx=0x7f50c801c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T13:08:19.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.397+0000 7f50cf7fe700 1 -- 172.21.15.82:0/2284175006 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f50d0050960 con 0x7f50d80c3fc0 2023-11-28T13:08:19.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.585+0000 7f50dd281700 1 -- 172.21.15.82:0/2284175006 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50d8073e20 con 0x7f50d80c3fc0 2023-11-28T13:08:19.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.589+0000 7f50cf7fe700 1 -- 172.21.15.82:0/2284175006 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f50d0053f80 con 0x7f50d80c3fc0 2023-11-28T13:08:19.592 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-11-28T13:08:19.592 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":33,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/3176308867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3176308867},{"type":"v1","addr":"172.21.15.114:6833","nonce":3176308867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6184,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1779270694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1779270694},{"type":"v1","addr":"172.21.15.114:6835","nonce":1779270694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1570999968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1570999968},{"type":"v1","addr":"172.21.15.82:6835","nonce":1570999968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":6945,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2872092995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2872092995},{"type":"v1","addr":"172.21.15.82:6837","nonce":2872092995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[]} 2023-11-28T13:08:19.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.589+0000 7f50dd281700 1 -- 172.21.15.82:0/2284175006 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f50b8064ee0 msgr2=0x7f50b8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:08:19.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.589+0000 7f50dd281700 1 --2- 172.21.15.82:0/2284175006 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f50b8064ee0 0x7f50b8067390 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f50c80090b0 tx=0x7f50c801c040 comp rx=0 tx=0).stop 2023-11-28T13:08:19.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.589+0000 7f50dd281700 1 -- 172.21.15.82:0/2284175006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d80c3fc0 msgr2=0x7f50d80c6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T13:08:19.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.589+0000 7f50dd281700 1 --2- 172.21.15.82:0/2284175006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d80c3fc0 0x7f50d80c6ca0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009db0 tx=0x7f50d000c3a0 comp rx=0 tx=0).stop 2023-11-28T13:08:19.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.589+0000 7f50dd281700 1 -- 172.21.15.82:0/2284175006 shutdown_connections 2023-11-28T13:08:19.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.589+0000 7f50dd281700 1 --2- 172.21.15.82:0/2284175006 >> [v2:172.21.15.82:6832/36500,v1:172.21.15.82:6833/36500] conn(0x7f50b8064ee0 0x7f50b8067390 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:19.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.589+0000 7f50dd281700 1 --2- 172.21.15.82:0/2284175006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50d8160b00 0x7f50d806e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:19.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.589+0000 7f50dd281700 1 --2- 172.21.15.82:0/2284175006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d80c3fc0 0x7f50d80c6ca0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:19.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.589+0000 7f50dd281700 1 --2- 172.21.15.82:0/2284175006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d80705e0 0x7f50d80c2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T13:08:19.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.589+0000 7f50dd281700 1 -- 172.21.15.82:0/2284175006 >> 172.21.15.82:0/2284175006 conn(0x7f50d80d0be0 msgr2=0x7f50d8161a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T13:08:19.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.589+0000 7f50dd281700 1 -- 172.21.15.82:0/2284175006 shutdown_connections 2023-11-28T13:08:19.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-11-28T13:08:19.589+0000 7f50dd281700 1 -- 172.21.15.82:0/2284175006 wait complete. 2023-11-28T13:08:19.598 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 33 2023-11-28T13:08:19.607 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-28T13:08:19.607 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-28T13:08:19.607 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T13:08:19.607 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:08:19.624 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T13:08:19.624 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T13:08:19.624 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:08:19.641 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T13:08:19.641 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T13:08:19.641 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:08:19.657 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T13:08:19.658 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T13:08:19.658 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:08:19.721 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T13:08:19.722 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-28T13:08:19.722 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-28T13:08:19.723 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:08:19.783 INFO:tasks.ceph.osd.0:Stopped 2023-11-28T13:08:19.784 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-28T13:08:19.784 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:08:19.865 INFO:tasks.ceph.osd.1:Stopped 2023-11-28T13:08:19.865 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-28T13:08:19.865 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:08:19.929 INFO:tasks.ceph.osd.2:Stopped 2023-11-28T13:08:19.930 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-28T13:08:19.930 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:08:19.987 INFO:tasks.ceph.osd.3:Stopped 2023-11-28T13:08:19.987 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-28T13:08:19.988 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:08:20.048 INFO:tasks.ceph.osd.4:Stopped 2023-11-28T13:08:20.049 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-28T13:08:20.049 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:08:20.132 INFO:tasks.ceph.osd.5:Stopped 2023-11-28T13:08:20.132 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-28T13:08:20.132 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:08:20.205 INFO:tasks.ceph.osd.6:Stopped 2023-11-28T13:08:20.206 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-28T13:08:20.206 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:08:20.280 INFO:tasks.ceph.osd.7:Stopped 2023-11-28T13:08:20.280 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-28T13:08:20.281 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-28T13:08:20.281 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:08:20.316 INFO:tasks.ceph.mgr.y:Stopped 2023-11-28T13:08:20.316 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-28T13:08:20.316 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:08:20.349 INFO:tasks.ceph.mgr.x:Stopped 2023-11-28T13:08:20.350 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-28T13:08:20.350 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-28T13:08:20.350 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:08:20.381 INFO:tasks.ceph.mon.a:Stopped 2023-11-28T13:08:20.382 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-28T13:08:20.382 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:08:20.401 INFO:tasks.ceph.mon.b:Stopped 2023-11-28T13:08:20.402 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-28T13:08:20.402 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T13:08:20.467 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-11-28T13:08:20.468 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-11-28T13:08:20.468 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-11-28T13:08:20.468 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-11-28T13:08:20.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-11-28T13:08:20.469 INFO:tasks.ceph.mon.c:Stopped 2023-11-28T13:08:20.469 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-28T13:08:20.470 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2023-11-28T13:08:20.496 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi082.front.sepia.ceph.com 2023-11-28T13:08:20.496 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-28T13:08:20.773 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi082.front.sepia.ceph.com 2023-11-28T13:08:20.773 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-28T13:08:21.012 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi082.front.sepia.ceph.com 2023-11-28T13:08:21.013 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-28T13:08:21.196 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi082.front.sepia.ceph.com 2023-11-28T13:08:21.197 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-28T13:08:21.412 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi114.front.sepia.ceph.com 2023-11-28T13:08:21.413 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-28T13:08:21.633 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi114.front.sepia.ceph.com 2023-11-28T13:08:21.633 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-28T13:08:21.845 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi114.front.sepia.ceph.com 2023-11-28T13:08:21.846 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-28T13:08:22.030 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi114.front.sepia.ceph.com 2023-11-28T13:08:22.030 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-28T13:08:22.225 INFO:tasks.ceph:Archiving mon data... 2023-11-28T13:08:22.226 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469970/data/mon.a.tgz 2023-11-28T13:08:22.227 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2023-11-28T13:08:22.233 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.ludFBf4GCA 2023-11-28T13:08:22.234 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ludFBf4GCA 2023-11-28T13:08:22.320 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.ludFBf4GCA 2023-11-28T13:08:22.344 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.ludFBf4GCA is 305KB 2023-11-28T13:08:22.365 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.ludFBf4GCA 2023-11-28T13:08:22.370 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469970/data/mon.b.tgz 2023-11-28T13:08:22.370 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2023-11-28T13:08:22.377 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.w3YHXlAjQ9 2023-11-28T13:08:22.377 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.w3YHXlAjQ9 2023-11-28T13:08:22.463 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.w3YHXlAjQ9 2023-11-28T13:08:22.489 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.w3YHXlAjQ9 is 310KB 2023-11-28T13:08:22.551 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.w3YHXlAjQ9 2023-11-28T13:08:22.557 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469970/data/mon.c.tgz 2023-11-28T13:08:22.558 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2023-11-28T13:08:22.564 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.YMZtNq3dWb 2023-11-28T13:08:22.564 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.YMZtNq3dWb 2023-11-28T13:08:22.646 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.YMZtNq3dWb 2023-11-28T13:08:22.674 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.YMZtNq3dWb is 310KB 2023-11-28T13:08:22.736 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.YMZtNq3dWb 2023-11-28T13:08:22.744 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-28T13:08:22.744 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-28T13:08:22.747 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-28T13:08:22.763 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-28T13:08:22.764 DEBUG:teuthology.orchestra.run.smithi082:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-28T13:08:22.767 DEBUG:teuthology.orchestra.run.smithi114:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-28T13:08:22.794 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-28T13:08:22.838 INFO:teuthology.orchestra.run.smithi114.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-28T13:08:22.845 INFO:tasks.ceph:Archiving crash dumps... 2023-11-28T13:08:22.847 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469970/remote/smithi082/crash 2023-11-28T13:08:22.848 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-28T13:08:22.866 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469970/remote/smithi114/crash 2023-11-28T13:08:22.867 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-28T13:08:22.883 INFO:tasks.ceph:Shutting down logrotate 2023-11-28T13:08:22.884 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:08:22.887 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T13:08:22.941 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-28T13:08:22.956 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-28T13:08:22.972 INFO:tasks.ceph:Compressing logs... 2023-11-28T13:08:22.972 DEBUG:teuthology.orchestra.run.smithi082:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T13:08:22.974 DEBUG:teuthology.orchestra.run.smithi114:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T13:08:24.925 INFO:tasks.ceph:Archiving logs... 2023-11-28T13:08:24.925 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469970/remote/smithi082/log 2023-11-28T13:08:24.926 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-28T13:08:25.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-11-28T13:08:25.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-11-28T13:08:25.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-11-28T13:08:25.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-11-28T13:08:25.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-11-28T13:08:25.539 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/log/ceph to /home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469970/remote/smithi114/log 2023-11-28T13:08:25.540 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-28T13:08:25.784 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-28T13:08:25.794 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-28T13:08:25.795 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-28T13:08:25.797 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-28T13:08:25.886 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-28T13:08:25.897 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-28T13:08:25.898 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T13:08:25.904 DEBUG:teuthology.orchestra.run.smithi114:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T13:08:25.925 INFO:teuthology.orchestra.run.smithi082.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T13:08:25.926 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================== 2023-11-28T13:08:25.926 INFO:teuthology.orchestra.run.smithi082.stdout:*hv01.front.sepi 44.4.53.2 2 u 19 64 377 0.081 -0.168 0.446 2023-11-28T13:08:25.926 INFO:teuthology.orchestra.run.smithi082.stdout:+hv02.front.sepi 63.231.80.2 3 u 20 64 377 0.069 1.115 0.450 2023-11-28T13:08:25.926 INFO:teuthology.orchestra.run.smithi082.stdout:+hv03.front.sepi 74.6.168.72 3 u 16 64 377 0.072 0.403 0.618 2023-11-28T13:08:25.927 INFO:teuthology.orchestra.run.smithi082.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 0.000 0.000 2023-11-28T13:08:25.928 INFO:teuthology.orchestra.run.smithi114.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T13:08:25.928 INFO:teuthology.orchestra.run.smithi114.stdout:============================================================================== 2023-11-28T13:08:25.928 INFO:teuthology.orchestra.run.smithi114.stdout:*hv01.front.sepi 44.4.53.2 2 u 16 64 377 0.076 0.120 0.321 2023-11-28T13:08:25.928 INFO:teuthology.orchestra.run.smithi114.stdout:+hv02.front.sepi 63.231.80.2 3 u 11 64 377 0.083 1.015 0.182 2023-11-28T13:08:25.928 INFO:teuthology.orchestra.run.smithi114.stdout:+hv03.front.sepi 74.6.168.72 3 u 8 64 377 0.084 1.290 0.297 2023-11-28T13:08:25.929 INFO:teuthology.orchestra.run.smithi114.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 0.000 0.000 2023-11-28T13:08:25.929 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-28T13:08:25.939 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-28T13:08:25.940 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-28T13:08:25.950 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-28T13:08:25.960 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-28T13:08:25.970 INFO:teuthology.task.internal:Duration was 1115.670464 seconds 2023-11-28T13:08:25.971 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-28T13:08:25.981 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-28T13:08:25.981 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-28T13:08:25.984 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-28T13:08:26.032 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-28T13:08:26.032 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2023-11-28T13:08:26.032 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-28T13:08:26.044 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi114.front.sepia.ceph.com 2023-11-28T13:08:26.045 DEBUG:teuthology.orchestra.run.smithi114:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-28T13:08:26.056 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-28T13:08:26.056 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T13:08:26.058 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T13:08:26.090 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-28T13:08:26.090 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T13:08:26.133 DEBUG:teuthology.orchestra.run.smithi114:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T13:08:26.208 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-28T13:08:26.235 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-28T13:08:26.235 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-28T13:08:26.251 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-28T13:08:26.266 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-28T13:08:26.275 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-28T13:08:26.277 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-28T13:08:26.290 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2023-11-28T13:08:26.291 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = core 2023-11-28T13:08:26.307 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-28T13:08:26.356 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T13:08:26.357 DEBUG:teuthology.orchestra.run.smithi114:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-28T13:08:26.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T13:08:26.364 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-28T13:08:26.377 INFO:teuthology.task.internal:Transferring archived files... 2023-11-28T13:08:26.378 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469970/remote/smithi082 2023-11-28T13:08:26.378 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-28T13:08:26.400 DEBUG:teuthology.misc:Transferring archived files from smithi114:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469970/remote/smithi114 2023-11-28T13:08:26.400 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-28T13:08:26.423 INFO:teuthology.task.internal:Removing archive directory... 2023-11-28T13:08:26.423 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-28T13:08:26.426 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-28T13:08:26.432 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-28T13:08:26.461 INFO:teuthology.task.internal:Not uploading archives. 2023-11-28T13:08:26.461 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-28T13:08:26.478 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-28T13:08:26.478 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-28T13:08:26.481 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-28T13:08:26.486 INFO:teuthology.orchestra.run.smithi082.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 28 13:08 /home/ubuntu/cephtest 2023-11-28T13:08:26.489 INFO:teuthology.orchestra.run.smithi114.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 28 13:08 /home/ubuntu/cephtest 2023-11-28T13:08:26.491 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-28T13:08:26.503 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-28T13:08:26.543 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T13:08:26.574 DEBUG:teuthology.nuke:shortname: smithi082 2023-11-28T13:08:26.574 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T13:08:26.602 DEBUG:teuthology.nuke:shortname: smithi114 2023-11-28T13:08:26.603 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T13:08:26.606 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469970', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 12:41:05.820021', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-28T13:08:26.627 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469970', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 12:41:05.818043', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-28T13:08:26.662 INFO:teuthology.orchestra.console.smithi082:Power off 2023-11-28T13:08:26.662 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T13:08:26.689 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2023-11-28T13:08:26.690 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:08:26.710 INFO:teuthology.orchestra.console.smithi114:Power off 2023-11-28T13:08:26.710 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T13:08:26.720 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2023-11-28T13:08:26.733 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2023-11-28T13:08:26.733 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:08:26.760 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-11-28T13:08:30.723 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:08:30.761 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:08:30.834 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2023-11-28T13:08:30.872 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-11-28T13:08:34.838 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:08:34.873 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:08:34.951 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2023-11-28T13:08:34.984 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-11-28T13:08:35.085 INFO:teuthology.orchestra.console.smithi114:Power off completed 2023-11-28T13:08:38.954 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:08:39.067 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2023-11-28T13:08:39.167 INFO:teuthology.orchestra.console.smithi082:Power off completed 2023-11-28T13:08:39.272 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} duration: 1115.6704642772675 failure_reason: 'Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub)' flavor: default owner: scheduled_neesingh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=e285605a25264ca48f9df0fa8ec5d42d status: fail success: false 2023-11-28T13:08:39.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:08:39.347 INFO:teuthology.run:FAIL